This work is the first work to condition a pre-trained transformer on visual and semantic features to generate medical reports and to include semantic similarity metrics in the quantitative analysis of the generated reports.
Authors
Omar Alfarghaly
1 papers
Rana Khaled
1 papers
A. Elkorany
1 papers
M. Helal
1 papers
Aly Fahmy
1 papers
References43 items
1
Generating Radiology Reports via Memory-driven Transformer
2
Learning Visual-Semantic Embeddings for Reporting Abnormal Findings on Chest X-rays
3
Chest X-ray Report Generation through Fine-Grained Label Learning
4
When Radiology Report Generation Meets Knowledge Graph
5
Reinforced Transformer for Medical Image Captioning
6
HuggingFace's Transformers: State-of-the-art Natural Language Processing
7
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
8
Encoder-Agnostic Adaptation for Conditional Language Generation
9
Automatic Radiology Report Generation based on Multi-view Image Fusion and Medical Concept Enrichment
10
A Survey on Biomedical Image Captioning
11
CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparison
12
Deep Relevance Ranking Using Enhanced Document-Query Interactions
13
TieNet: Text-Image Embedding Network for Common Thorax Disease Classification and Reporting in Chest X-Rays
14
On the Automatic Generation of Medical Imaging Reports
15
CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learning
16
MDNet: A Semantically and Visually Interpretable Medical Image Diagnosis Network
17
Relevance of Unsupervised Metrics in Task-Oriented Dialogue for Evaluating Natural Language Generation
18
Attention is All you Need
19
A Hierarchical Approach for Generating Descriptive Image Paragraphs
20
Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization
21
Densely Connected Convolutional Networks
22
Learning to Read Chest X-Rays: Recurrent Neural Cascade Model for Automated Image Annotation
23
Image Captioning with Semantic Attention
24
Preparing a collection of radiology examinations for distribution and retrieval
25
Skip-Thought Vectors
26
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention
27
Adam: A Method for Stochastic Optimization
28
Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling
29
Long-term recurrent convolutional networks for visual recognition and description
30
Show and tell: A neural image caption generator
31
Neural Machine Translation by Jointly Learning to Align and Translate
32
Distributed Representations of Words and Phrases and their Compositionality
33
ImageNet classification with deep convolutional neural networks
34
An Optimal Assessment of Natural Language Student Input Using Word-to-Word Similarity Metrics
35
METEOR: An Automatic Metric for MT Evaluation with Improved Correlation with Human Judgments
36
ROUGE: A Package for Automatic Evaluation of Summaries
37
Bleu: a Method for Automatic Evaluation of Machine Translation
38
Long Short-Term Memory
39
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
40
ChestX-ray: Hospital-Scale Chest X-ray Database and Benchmarks on Weakly Supervised Classification and Localization of Common Thorax Diseases
41
Consensus-based image description evaluation
42
Dropout: a simple way to prevent neural networks from overfitting