A novel unsupervised temporal representation learning model, named Deep Temporal Clustering Representation (DTCR), is proposed, which integrates the temporal reconstruction and K-means objective into the seq2seq model, which leads to improved cluster structures and thus obtains cluster-specific temporal representations.