You Only Need One Detector: Unified Object Detector for Different Modalities based on Vision Transformers

It is pointed out that by using a vision transformer together with cross/inter modality transfer learning, a unified detector can achieve better performances when using different modalities as inputs.