A dataset of surgical activities captured using the da Vinci Surgical System and consisting of kinematic and video from eight surgeons with different levels of skill performing five repetitions of three elementary surgical tasks on a bench-top model is described.