Medical Code Prediction from Discharge Summary: Document to Sequence BERT using Sequence Attention (2021-06-15T00:00:00.000000Z)

TL;DR

A model based on bidirectional encoder representations from transformers (BERT) using the sequence attention method for automatic ICD code assignment and is performing better than a performance of the state-of-the-art model using the MIMIC-III dataset.

Abstract

Clinical notes are unstructured text generated by clinicians during patient encounters. Clinical notes are usually accompanied by a set of metadata codes from the international classification of diseases (ICD). ICD code is an important code used in various operations, including insurance, reimbursement, medical diagnosis, etc. Therefore, it is important to classify ICD codes quickly and accurately. However, annotating these codes is costly and time-consuming. So we propose a model based on bidirectional encoder representations from transformers (BERT) using the sequence attention method for automatic ICD code assignment. We evaluate our approach on the medical information mart for intensive care III (MIMIC-III) benchmark dataset. Our model achieved performance of macro-averaged F1: 0.62898 and micro-averaged F1: 0.68555 and is performing better than a performance of the state-of-the-art model using the MIMIC-III dataset. The contribution of this study proposes a method of using BERT that can be applied to documents and a sequence attention method that can capture important sequence information appearing in documents.

Authors

Tak-Sung Heo

1 papers

Yongmin Yoo

1 papers

Yeongjoon Park

1 papers

Medical Code Prediction from Discharge Summary: Document to Sequence BERT using Sequence Attention

TL;DR

Abstract

Authors

References19 items

Prediction of Atrial Fibrillation Cases: Convolutional Neural Networks Using the Output Texts of Electrocardiography

An explainable CNN approach for medical codes prediction from clinical text

Various Approaches for Predicting Stroke Prognosis using Magnetic Resonance Imaging Text Records

Longformer: The Long-Document Transformer

Automated ICD-9 Coding via A Deep Learning Approach

How to Fine-Tune BERT for Text Classification?

BioWordVec, improving biomedical word embeddings with subword information and MeSH

Natural language processing and machine learning algorithm to identify brain MRI reports with acute ischemic stroke

BioBERT: a pre-trained biomedical language representation model for biomedical text mining

Transformer-XL: Attentive Language Models beyond a Fixed-Length Context

Explainable Prediction of Medical Codes from Clinical Text

An Empirical Evaluation of Deep Learning for ICD-9 Code Assignment using MIMIC-III Clinical Notes

Improving palliative care with deep learning

Enhancing Automatic ICD-9-CM Code Assignment for Medical Texts with PubMed

MIMIC-III, a freely accessible critical care database

Mining electronic health records: towards better research applications and clinical care

Accuracy of ICD-9-CM Codes for Identifying Cardiovascular and Stroke Risk Factors

Multi-channel, convolutional attention based neural model for automated diagnostic coding of unstructured patient discharge summaries

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

Field of Study

Journal Information

Name

Page

Venue Information

Name

Type

URL

Alternate Names