Uncertainty-Aware Multi-Modal Ensembling for Severity Prediction of Alzheimer's Dementia
Published in
arXiv.org(2020)External Links:
TL
TL;DR
This work proposes an uncertainty-aware boosting technique for multi-modal ensembling to predict Alzheimer's Dementia Severity and aims to encourage fair and aware models.
Abstract
Reliability in Neural Networks (NNs) is crucial in safety-critical applications like healthcare, and uncertainty estimation is a widely researched method to highlight the confidence of NNs in deployment. In this work, we propose an uncertainty-aware boosting technique for multi-modal ensembling to predict Alzheimer's Dementia Severity. The propagation of uncertainty across acoustic, cognitive, and linguistic features produces an ensemble system robust to heteroscedasticity in the data. Weighing the different modalities based on the uncertainty estimates, we experiment on the benchmark ADReSS dataset, a subject-independent and balanced dataset, to show that our method outperforms the state-of-the-art methods while also reducing the overall entropy of the system. This work aims to encourage fair and aware models. The source code is available at this https URL
References40 items
1
Multi-Modal Fusion with Gating Using Audio, Lexical and Disfluency Features for Alzheimer's Dementia Recognition from Spontaneous Speech
2
Using State of the Art Speaker Recognition and Natural Language Processing Technologies to Detect Alzheimer's Disease and Assess its Severity
3
Why have a Unified Predictive Uncertainty? Disentangling it using Deep Split Ensembles
4
Multimodal Inductive Transfer Learning for Detection of Alzheimer's Dementia and its Severity
5