ICD Coding from Clinical Text Using Multi-Filter Residual Convolutional Neural Network (2019-11-25T00:00:00.000000Z)

TL;DR

A Multi-Filter Residual Convolutional Neural Network (MultiResCNN) for ICD coding that utilizes a multi-filter convolutional layer to capture various text patterns with different lengths and a residual convolutionAL layer to enlarge the receptive field.

Abstract

Automated ICD coding, which assigns the International Classification of Disease codes to patient visits, has attracted much research attention since it can save time and labor for billing. The previous state-of-the-art model utilized one convolutional layer to build document representations for predicting ICD codes. However, the lengths and grammar of text fragments, which are closely related to ICD coding, vary a lot in different documents. Therefore, a flat and fixed-length convolutional architecture may not be capable of learning good document representations. In this paper, we proposed a Multi-Filter Residual Convolutional Neural Network (MultiResCNN) for ICD coding. The innovations of our model are two-folds: it utilizes a multi-filter convolutional layer to capture various text patterns with different lengths and a residual convolutional layer to enlarge the receptive field. We evaluated the effectiveness of our model on the widely-used MIMIC dataset. On the full code set of MIMIC-III, our model outperformed the state-of-the-art model in 4 out of 6 evaluation metrics. On the top-50 code set of MIMIC-III and the full code set of MIMIC-II, our model outperformed all the existing and state-of-the-art models in all evaluation metrics. The code is available at https://github.com/foxlf823/Multi-Filter-Residual-Convolutional-Neural-Network.

Authors

Fei Li

1 papers

Hong Yu

2 papers

TL;DR

Abstract

Authors

References28 items

Leveraging data and information systems on the sustainable development goals

HIBERT: Document Level Pre-training of Hierarchical Bidirectional Transformers for Document Summarization

Transformer-XL: Attentive Language Models beyond a Fixed-Length Context

Multimodal Machine Learning for Automated ICD Coding

Explainable Prediction of Medical Codes from Clinical Text

A Neural Architecture for Automated ICD Coding

Selecting relevant features from the electronic health record for clinical code prediction

Multi-Label Classification of Patient Notes a Case Study on ICD Code Assignment

Attention is All you Need

Condensed Memory Networks for Clinical Diagnostic Inferencing

MIMIC-III, a freely accessible critical care database

Deep Residual Learning for Image Recognition

Learning to Diagnose with LSTM Recurrent Neural Networks

An empirical evaluation of supervised learning approaches in assigning diagnosis codes to electronic medical records

Adam: A Method for Stochastic Optimization

Convolutional Neural Networks for Sentence Classification

Diagnosis code assignment: models and evaluation metrics

Distributed Representations of Words and Phrases and their Compositionality

ImageNet classification with deep convolutional neural networks

A shared task involving multi-label classification of clinical free text

Intelligent information: a national system for monitoring clinical performance.

Measuring diagnoses: ICD code accuracy.

Convolutional face finder: a neural architecture for fast and robust face detection

Combining classifiers in text categorization

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Multi-Label Classification of Patient Notes: Case Study on ICD Code Assignment

Towards automated icd coding using deep learning

Multi-label text classification with a mixture model trained by EM

Field of Study

Journal Information

Name

Page

Volume

Venue Information

Name

Type

URL

Alternate Names