This work proposes to make pruning techniques aware of the robust training objective and let the training objective guide the search for which connections to prune, and demonstrates the success of this approach across CIFAR-10, SVHN, and ImageNet dataset with four robust training techniques.