LaRS: A Diverse Panoptic Maritime Obstacle Detection Dataset and Benchmark (2023-08-18T00:00:00.000000Z)

TL;DR

The first maritime panoptic obstacle detection benchmark LaRS is presented, featuring scenes from Lakes, Rivers and Seas, and the new dataset boasts the largest diversity in recording locations, scene types, obstacle classes, and acquisition conditions among the related datasets.

Abstract

The progress in maritime obstacle detection is hindered by the lack of a diverse dataset that adequately captures the complexity of general maritime environments. We present the first maritime panoptic obstacle detection benchmark LaRS, featuring scenes from Lakes, Rivers and Seas. Our major contribution is the new dataset, which boasts the largest diversity in recording locations, scene types, obstacle classes, and acquisition conditions among the related datasets. LaRS is composed of over 4000 per-pixel labeled key frames with nine preceding frames to allow utilization of the temporal texture, amounting to over 40k frames. Each key frame is annotated with 8 thing, 3 stuff classes and 19 global scene attributes. We report the results of 27 semantic and panoptic segmentation methods, along with several performance insights and future research directions. To enable objective evaluation, we have implemented an online evaluation server. The LaRS dataset, evaluation toolkit and benchmark are publicly available at: https://lojzezust.github.io/lars-dataset

Authors

M. Kristan

9 papers

Lojze Žust

1 papers

J. Pers

2 papers

TL;DR

Abstract

Authors

References62 items

1st Workshop on Maritime Computer Vision (MaCVi) 2023: Challenge Results

MassMIND: Massachusetts Maritime INfrared Dataset

ROSEBUD: A Deep Fluvial Segmentation Dataset for Monocular Vision-Based River Navigation and Obstacle Avoidance

Unifying Panoptic Segmentation for Autonomous Driving

Temporal Context for Robust Maritime Obstacle Detection

Automated Full Scene Parsing for Marine ASVs Using Monocular Vision

Beyond Visible Light: Usage of Long Wave Infrared for Object Detection in Maritime Environment

Masked-attention Mask Transformer for Universal Image Segmentation

FloW: A Dataset and Benchmark for Floating Waste Detection in Inland Waters

ShorelineNet: An Efficient Deep Learning Approach for Shoreline Semantic Segmentation for Unmanned Surface Vehicles

RoboWhaler: A Robotic Vessel for Marine Autonomy and Dataset Collection

Are we ready for beyond-application high-volume data? The Reeds robot perception benchmark dataset

WaSR—A Water Segmentation and Refinement Maritime Obstacle Detection Network

K-Net: Towards Unified Image Segmentation

SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers

Segmenter: Transformer for Semantic Segmentation

MODS—A USV-Oriented Object Detection and Obstacle Segmentation Benchmark

SegmentMeIfYouCan: A Benchmark for Anomaly Segmentation

Rethinking BiSeNet For Real-time Semantic Segmentation

Are We Ready for Unmanned Surface Vehicles in Inland Waterways? The USVInland Multisensor Dataset and Benchmark

Temporal Memory Attention for Video Semantic Segmentation

MaX-DeepLab: End-to-End Panoptic Segmentation with Mask Transformers

Obstacle Tracking for Unmanned Surface Vessels Using 3-D Point Cloud

End-to-End Object Detection with Transformers

BiSeNet V2: Bilateral Network with Guided Aggregation for Real-Time Semantic Segmentation

Waterline and obstacle detection in images from low-cost autonomous boats for environmental monitoring

PointRend: Image Segmentation As Rendering

EfficientDet: Scalable and Efficient Object Detection

Convolutional neural network based obstacle detection for unmanned surface vehicle.

The MaSTr1325 dataset for training deep USV obstacle detection models

Panoptic-DeepLab: A Simple, Strong, and Fast Baseline for Bottom-Up Panoptic Segmentation

High-Resolution Water Segmentation for Autonomous Unmanned Surface Vehicles: a Novel Dataset and Evaluation

Sensor Evaluation for Autonomous Surface Vehicles in Inland Waterways

Object Detection in a Maritime Environment: Performance Evaluation of Background Subtraction Methods

Detecting the Unexpected via Image Resynthesis

FCOS: Fully Convolutional One-Stage Object Detection

Panoptic Feature Pyramid Networks

Evaluating deep semantic segmentation networks for object detection in maritime surveillance

BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentation

Datasheets for datasets

Stereo obstacle detection for unmanned surface vehicles by IMU-assisted semantic segmentation

Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation

Panoptic Segmentation

Rethinking Atrous Convolution for Semantic Image Segmentation

Video Processing From Electro-Optical Sensors for Object Detection and Tracking in a Maritime Environment: A Survey

Saliency-Based Detection for Maritime Object Tracking

The Cityscapes Dataset for Semantic Urban Scene Understanding

Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks

U-Net: Convolutional Networks for Biomedical Image Segmentation

Fast Image-Based Obstacle Detection From Unmanned Surface Vehicles

Fully convolutional networks for semantic segmentation

A Graphical Model for Rapid Obstacle Image-Map Estimation from Unmanned Surface Vehicles

Microsoft COCO: Common Objects in Context

Stereovision based obstacle detection system for unmanned surface vehicle

Are we ready for autonomous driving? The KITTI vision benchmark suite

WODIS: Water Obstacle Detection Network Based on Image Segmentation for Autonomous Surface Vehicles in Maritime Environments

CSANet for Video Semantic Segmentation With Inter-Frame Mutual Learning

Supplementary Materials for: RetinaFace: Single-shot Multi-level Face Localisation in the Wild

Mmsegmentation Contributors

MMSegmentation: Open-MMLab semantic segmentation toolbox and benchmark

Computer Society.

20255 applicable license agreement with IEEE. Restrictions apply

Field of Study

Journal Information

Name

Page

Venue Information

Name

Type

URL

Alternate Names