The attentive state-space model is developed, a deep probabilistic model that learns accurate and interpretable structured representations for disease trajectories that demonstrates superior predictive accuracy and provides insights into the progression of chronic disease.