AnatomyNet: Deep learning for fast and fully automated whole‐volume segmentation of head and neck anatomy (2018-08-15T00:00:00.000000Z)

TL;DR

An end-to-end, atlas-free three-dimensional convolutional deep learning framework for fast and fully automated whole-volume HaN anatomy segmentation and demonstrates that the proposed model can improve segmentation accuracy and simplify the autosegmentation pipeline.

Abstract

PURPOSE Radiation therapy (RT) is a common treatment option for head and neck (HaN) cancer. An important step involved in RT planning is the delineation of organs-at-risks (OARs) based on HaN computed tomography (CT). However, manually delineating OARs is time-consuming as each slice of CT images needs to be individually examined and a typical CT consists of hundreds of slices. Automating OARs segmentation has the benefit of both reducing the time and improving the quality of RT planning. Existing anatomy autosegmentation algorithms use primarily atlas-based methods, which require sophisticated atlas creation and cannot adequately account for anatomy variations among patients. In this work, we propose an end-to-end, atlas-free three-dimensional (3D) convolutional deep learning framework for fast and fully automated whole-volume HaN anatomy segmentation. METHODS Our deep learning model, called AnatomyNet, segments OARs from head and neck CT images in an end-to-end fashion, receiving whole-volume HaN CT images as input and generating masks of all OARs of interest in one shot. AnatomyNet is built upon the popular 3D U-net architecture, but extends it in three important ways: (a) a new encoding scheme to allow autosegmentation on whole-volume CT images instead of local patches or subsets of slices, (b) incorporating 3D squeeze-and-excitation residual blocks in encoding layers for better feature representation, and (c) a new loss function combining Dice scores and focal loss to facilitate the training of the neural model. These features are designed to address two main challenges in deep learning-based HaN segmentation: (a) segmenting small anatomies (i.e., optic chiasm and optic nerves) occupying only a few slices, and (b) training with inconsistent data annotations with missing ground truth for some anatomical structures. RESULTS We collected 261 HaN CT images to train AnatomyNet and used MICCAI Head and Neck Auto Segmentation Challenge 2015 as a benchmark dataset to evaluate the performance of AnatomyNet. The objective is to segment nine anatomies: brain stem, chiasm, mandible, optic nerve left, optic nerve right, parotid gland left, parotid gland right, submandibular gland left, and submandibular gland right. Compared to previous state-of-the-art results from the MICCAI 2015 competition, AnatomyNet increases Dice similarity coefficient by 3.3% on average. AnatomyNet takes about 0.12 s to fully segment a head and neck CT image of dimension 178 × 302 × 225, significantly faster than previous methods. In addition, the model is able to process whole-volume CT images and delineate all OARs in one pass, requiring little pre- or postprocessing. CONCLUSION Deep learning models offer a feasible solution to the problem of delineating OARs from CT images. We demonstrate that our proposed model can improve segmentation accuracy and simplify the autosegmentation pipeline. With this method, it is possible to delineate OARs of a head and neck CT within a fraction of a second.

References46 items

Deep learning to achieve clinically applicable segmentation of head and neck anatomy for radiotherapy

3D Segmentation with Exponential Logarithmic Loss for Highly Unbalanced Object Sizes

The use of new delineation tool "MIRADA" at the level of regional lymph nodes, step-by-step development and first results for early-stage breast cancer patients.

DeepEM: Deep 3D ConvNets With EM For Weakly Supervised Pulmonary Nodule Detection

Interleaved 3D-CNNs for joint segmentation of small-volume structures in head and neck CT images.

Auto-contouring via automatic anatomy recognition of organs at risk in head and neck cancer on CT images

Image quality and segmentation

Hierarchical model-based object localization for auto-contouring in head and neck radiation therapy planning

Automated delineation of organs-at-risk in head and neck CT images using multi-output support vector regression

Comparison of different deep learning approaches for parotid gland segmentation from CT images

Hierarchical Vertex Regression-Based Segmentation of Head and Neck CT Images for Radiotherapy Planning

DeepLung: Deep 3D Dual Path Nets for Automated Pulmonary Nodule Detection and Classification

Adversarial deep structured nets for mass segmentation from mammograms

Squeeze-and-Excitation Networks

Focal Loss for Dense Object Detection

Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentations

Tversky Loss Function for Image Segmentation Using 3D Fully Convolutional Deep Networks

Evaluation of segmentation methods on head and neck CT: Auto‐segmentation challenge 2015

Radiomics strategies for risk assessment of tumour failure in head-and-neck cancer

Segmentation of organs‐at‐risks in head and neck CT images using convolutional neural networks

Deep Multi-instance Networks with Sparse Label Assignment for Whole Mammogram Classification

Feature Pyramid Networks for Object Detection

Deep Neural Networks for Fast Segmentation of 3D Medical Images

Validation of clinical acceptability of an atlas-based segmentation algorithm for the delineation of organs at risk in head and neck cancer.

Automatic tissue segmentation of head and neck MR images for hyperthermia treatment planning

Contour-Driven Atlas-Based Segmentation

U-Net: Convolutional Networks for Biomedical Image Segmentation

Global cancer statistics, 2012

The relevance of MRI for patient modeling in head and neck hyperthermia treatment planning: a comparison of CT and CT-MRI based tissue segmentation on simulated temperature.

Automatic segmentation of head and neck CT images for radiotherapy treatment planning using multiple atlases, statistical appearance models, and geodesic active contours.

Vision 20/20: perspectives on automated image segmentation for radiotherapy.

The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository

Tissue segmentation of head and neck CT images for treatment planning: a multiatlas approach combined with intensity modeling.

Auto-segmentation of normal and target structures in head and neck CT images: a feature-driven model-based approach.

Does atlas-based autosegmentation of neck levels require subsequent manual contour editing to avoid risk of severe target underdosage? A dosimetric analysis.

Combining registration and active shape models for the automatic segmentation of the lymph node regions in head and neck CT images.

A pre-clinical assessment of an atlas-based automatic segmentation tool for the head and neck.

Atlas-Based Auto-segmentation of Head and Neck CT Images

Atlas-based delineation of lymph node levels in head and neck computed tomography images.

Evaluation of an atlas-based automatic segmentation software for the delineation of brain organs at risk in a radiation therapy clinical context.

Validation of automatic landmark identification for atlas-based segmentation for radiation treatment planning of the head-and-neck region

Automatic delineation of on-line head-and-neck computed tomography images: toward on-line adaptive radiotherapy.

Generalized Overlap Measures for Evaluation and Validation in Medical Image Analysis

Rectifier Nonlinearities Improve Neural Network Acoustic Models

Lecture 6.5‐rmsprop: divide the gradient by a running average of its recent magnitude

Global cancer statistics