CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval
Published in
Neurocomputing(2021)External Links:
TL
TL;DR
A CLIP4Clip model to transfer the knowledge of the CLIP model to video-language retrieval in an end-to-end manner can achieve SOTA results on various video-text retrieval datasets, including MSR-VTT, MSVC, LSMDC, ActivityNet, and DiDeMo.
References52 items
1
TeachText: CrossModal Generalized Distillation for Text-Video Retrieval
2
Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrieval
3
ViViT: A Video Vision Transformer
4
HiT: Hierarchical Transformer with Momentum Contrast for Video-Text Retrieval
5