Doctor XAvIer: Explainable Diagnosis on Physician-Patient Dialogues and XAI Evaluation
TL
TL;DR
A novel performance plot and evaluation metric for feature attribution methods — Feature Attribution Dropping (FAD) curve and its Normalized Area Under the Curve (N-AUC).
Abstract
We introduce Doctor XAvIer — a BERT-based diagnostic system that extracts relevant clinical data from transcribed patient-doctor dialogues and explains predictions using feature attribution methods. We present a novel performance plot and evaluation metric for feature attribution methods — Feature Attribution Dropping (FAD) curve and its Normalized Area Under the Curve (N-AUC). FAD curve analysis shows that integrated gradients outperforms Shapley values in explaining diagnosis classification. Doctor XAvIer outperforms the baseline with 0.97 F1-score in named entity recognition and symptom pertinence classification and 0.91 F1-score in diagnosis classification.
References34 items
1
An alternative approach to dimension reduction for pareto distributed data: a case study
2
Transformer-Based Models for Question Answering on COVID19
3
An Experimental Evaluation of Transformer-based Language Models in the Biomedical Domain
4
The role of explainability in creating trustworthy artificial intelligence for health care: a comprehensive survey of the terminology, design choices, and evaluation strategies
5