A novel mutual consistency network (MC-Net+) is proposed to effectively exploit the unlabeled data for semi-supervised medical image segmentation to force the model to generate invariant results in such challenging regions, aiming at regularizing the model training.