This paper introduces a method to encode the blur operators of an arbitrary dataset of sharp-blur image pairs into a blur kernel space that can handle unseen blur kernel, while avoiding using complicated handcrafted priors on the blur operator often found in classical methods.