PMC-VQA

PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answering

This study reframe the problem of MedVQA as a generation task that naturally follows the human-machine interaction and proposes a generative-based model for medical visual understanding by aligning visual information from a pre-trained vision encoder with a large language model.