Multi-Task Recurrent Convolutional Network with Correlation Loss for Surgical Video Analysis

Published in

(2019)

External Links:

Generate Graph DownloadPDF

TL;DR

A novel method by developing a multi-task recurrent convolutional network with correlation loss (MTRCNet-CL) to exploit their relatedness to simultaneously boost the performance of both surgical tool presence detection and phase recognition.

Authors

Q. Dou

14 papers

P. Heng

25 papers

Hao Chen

9 papers

Chi-Wing Fu

13 papers

Yueming Jin

5 papers

J. Qin

4 papers

Huaxia Li

1 papers

References57 items

Hard Frame Detection and Online Mapping for Surgical Phase Recognition

Incorporating Temporal Prior from Motion Flow for Instrument Segmentation in Minimally Invasive Surgery Video

Graph Convolutional Nets for Tool Presence Detection in Surgical Videos

Assessment of Automated Identification of Phases in Videos of Cataract Surgery Using Machine Learning and Deep Learning Techniques

“Deep-Onto” network for surgical workflow and context recognition

Multi-Task Recurrent Convolutional Network with Correlation Loss for Surgical Video Analysis

Published in

(2019)

External Links:

Generate Graph DownloadPDF

TL;DR

Authors

Q. Dou

14 papers

P. Heng

25 papers

Hao Chen

9 papers

Chi-Wing Fu

13 papers

Yueming Jin

5 papers

J. Qin

4 papers

Huaxia Li

1 papers

References57 items

Hard Frame Detection and Online Mapping for Surgical Phase Recognition

Incorporating Temporal Prior from Motion Flow for Instrument Segmentation in Minimally Invasive Surgery Video

Graph Convolutional Nets for Tool Presence Detection in Surgical Videos

Assessment of Automated Identification of Phases in Videos of Cataract Surgery Using Machine Learning and Deep Learning Techniques

“Deep-Onto” network for surgical workflow and context recognition

DeepPhase: Surgical Phase Recognition in CATARACTS Videos

Deep Reinforcement Learning for Surgical Gesture Segmentation and Classification

Uncertainty in multitask learning: joint representations for probabilistic MR-only radiotherapy planning

Less is More: Surgical Phase Recognition with Less Annotations through Self-Supervised Pre-training of CNN-LSTM Networks

Instrument detection and pose estimation with rigid part mixtures model in video‐assisted surgeries

SV-RCNet: Workflow Recognition From Surgical Videos Using Recurrent Convolutional Network

Multi-Task Learning of Pairwise Sequence Classification Tasks over Disparate Label Spaces

SFCN-OPI: Detection and Fine-grained Classification of Nuclei Using Sibling FCN with Objectness Prior Interaction

Joint Prediction of Activity Labels and Starting Times in Untrimmed Videos

Joint Detection and Recounting of Abnormal Events by Learning Deep Generic Knowledge

Fine-Grained Recognition in the Wild: A Multi-task Domain Adaptation Approach

Automated Pulmonary Nodule Detection via 3D ConvNets with Online Sample Filtering and Hybrid-Loss Residual Learning

Surgical tool detection in cataract surgery videos through multi-image fusion inside a convolutional neural network

Surgical-tools detection based on Convolutional Neural Network in laparoscopic robot-assisted surgery

Full Quantification of Left Ventricle via Deep Multitask Learning Network Respecting Intra- and Inter-Task Relatedness

Deep learning based multi-label classification for surgical tool presence detection in laparoscopic videos

Concurrent Segmentation and Localization for Tracking of Surgical Instruments

Addressing multi-label imbalance problem of surgical tool detection using CNN

Detection and Localization of Robotic Tools in Robot-Assisted Surgery Videos Using Deep Neural Networks for Region Proposal and Detection

Spatial aggregation of holistically‐nested convolutional neural networks for automated pancreas localization and segmentation☆

Vision-based approaches for surgical activity recognition using laparoscopic and RBGD videos. (Approches basées vision pour la reconnaissance d'activités chirurgicales à partir de vidéos laparoscopiques et multi-vues RGBD)

TL;DR

Authors

References57 items

Hard Frame Detection and Online Mapping for Surgical Phase Recognition

Incorporating Temporal Prior from Motion Flow for Instrument Segmentation in Minimally Invasive Surgery Video

Graph Convolutional Nets for Tool Presence Detection in Surgical Videos

Assessment of Automated Identification of Phases in Videos of Cataract Surgery Using Machine Learning and Deep Learning Techniques

“Deep-Onto” network for surgical workflow and context recognition

TL;DR

Authors

References57 items

Hard Frame Detection and Online Mapping for Surgical Phase Recognition

Incorporating Temporal Prior from Motion Flow for Instrument Segmentation in Minimally Invasive Surgery Video

Graph Convolutional Nets for Tool Presence Detection in Surgical Videos

Assessment of Automated Identification of Phases in Videos of Cataract Surgery Using Machine Learning and Deep Learning Techniques

“Deep-Onto” network for surgical workflow and context recognition

DeepPhase: Surgical Phase Recognition in CATARACTS Videos

Deep Reinforcement Learning for Surgical Gesture Segmentation and Classification

Uncertainty in multitask learning: joint representations for probabilistic MR-only radiotherapy planning

Less is More: Surgical Phase Recognition with Less Annotations through Self-Supervised Pre-training of CNN-LSTM Networks

Instrument detection and pose estimation with rigid part mixtures model in video‐assisted surgeries

SV-RCNet: Workflow Recognition From Surgical Videos Using Recurrent Convolutional Network

Multi-Task Learning of Pairwise Sequence Classification Tasks over Disparate Label Spaces

SFCN-OPI: Detection and Fine-grained Classification of Nuclei Using Sibling FCN with Objectness Prior Interaction

Joint Prediction of Activity Labels and Starting Times in Untrimmed Videos

Joint Detection and Recounting of Abnormal Events by Learning Deep Generic Knowledge

Fine-Grained Recognition in the Wild: A Multi-task Domain Adaptation Approach

Automated Pulmonary Nodule Detection via 3D ConvNets with Online Sample Filtering and Hybrid-Loss Residual Learning

Surgical tool detection in cataract surgery videos through multi-image fusion inside a convolutional neural network

Surgical-tools detection based on Convolutional Neural Network in laparoscopic robot-assisted surgery

Full Quantification of Left Ventricle via Deep Multitask Learning Network Respecting Intra- and Inter-Task Relatedness

Deep learning based multi-label classification for surgical tool presence detection in laparoscopic videos

Concurrent Segmentation and Localization for Tracking of Surgical Instruments

Addressing multi-label imbalance problem of surgical tool detection using CNN

Detection and Localization of Robotic Tools in Robot-Assisted Surgery Videos Using Deep Neural Networks for Region Proposal and Detection

Spatial aggregation of holistically‐nested convolutional neural networks for automated pancreas localization and segmentation☆

Vision-based approaches for surgical activity recognition using laparoscopic and RBGD videos. (Approches basées vision pour la reconnaissance d'activités chirurgicales à partir de vidéos laparoscopiques et multi-vues RGBD)

A Dataset and Benchmarks for Segmentation and Recognition of Gestures in Robotic Surgery

M2CAI Workflow Challenge: Convolutional Neural Networks with Time Smoothing and Hidden Markov Model for Video Frames Classification

Recognizing Surgical Activities with Recurrent Neural Networks

Automatic data-driven real-time segmentation and recognition of surgical workflow

EndoNet: A Deep Architecture for Recognition Tasks on Laparoscopic Videos

Deep Residual Learning for Image Recognition

Detecting Surgical Tools by Modelling Local Appearance and Global Shape

Automatic phase prediction from low-level surgical activities

Real-Time Task Recognition in Cataract Surgery Videos Using Adaptive Spatiotemporal Polynomials

Learning with Pseudo-Ensembles

Long-term recurrent convolutional networks for visual recognition and description

Surgical process modelling: a review

Real-time recognition of surgical tasks in eye surgery videos

Surgical gesture classification from video and kinematic data

A Framework for the Recognition of High-Level Surgical Tasks From Video Images for Cataract Surgeries

Statistical modeling and recognition of surgical workflow

Modeling and Segmentation of Surgical Workflow from Laparoscopic Video

On-line Recognition of Surgical Activity for Monitoring in the Operating Room

Automatic feature generation in endoscopic images

Eye-Gaze Driven Surgical Workflow Segmentation

Real-Time Identification of Operating Room State from Video

OR 2020: The Operating Room of the Future

miccai surgical workflow challenge

Vision‐based and marker‐less surgical tool detection and tracking: a review of the literature

Hierarchical Clustering Multi-Task Learning for Joint Human Action Grouping and Recognition

Cholec 80 dataset

Surgical Phase Recognition: from Instrumented ORs to Hospitals Around the World

Surgical tool detection via multiple convolu

Process Models

Automatic knowledge-based recognition of low-level tasks in ophthalmological procedures

Context awareness in health care: A review

Field of Study

Journal Information

Name

Page

Volume