This paper proposes a self-supervised deep learning approach for discovering landmarks from images that can directly be used as a shape descriptor for subsequent analysis, and proposes a regularization term that allows for robust optimization of the neural network and ensures that the landmarks uniformly span the image domain.