Survey of Deep Reinforcement Learning for Motion Planning of Autonomous Vehicles (2020-01-30T00:00:00.000000Z)

TL;DR

The paper provides insight into the hierarchical motion planning problem and describes the basics of DRL, which surveys the state-of-art solutions systematized by the different tasks and levels of autonomous driving.

Abstract

Academic research in the field of autonomous vehicles has reached high popularity in recent years related to several topics as sensor technologies, V2X communications, safety, security, decision making, control, and even legal and standardization rules. Besides classic control design approaches, Artificial Intelligence and Machine Learning methods are present in almost all of these fields. Another part of research focuses on different layers of Motion Planning, such as strategic decisions, trajectory planning, and control. A wide range of techniques in Machine Learning itself have been developed, and this article describes one of these fields, Deep Reinforcement Learning (DRL). The paper provides insight into the hierarchical motion planning problem and describes the basics of DRL. The main elements of designing such a system are the modeling of the environment, the modeling abstractions, the description of the state and the perception models, the appropriate rewarding, and the realization of the underlying neural network. The paper describes vehicle models, simulation possibilities and computational requirements. Strategic decisions on different layers and the observation models, e.g., continuous and discrete state representations, grid-based, and camera-based solutions are presented. The paper surveys the state-of-art solutions systematized by the different tasks and levels of autonomous driving, such as car-following, lane-keeping, trajectory following, merging, or driving in dense traffic. Finally, open questions and future challenges are discussed.

Authors

S. Aradi

1 papers

TL;DR

Abstract

Authors

References83 items

A Reinforcement Learning Approach to Autonomous Decision Making of Intelligent Vehicles on Highways

Automated Lane Change Decision Making using Deep Reinforcement Learning in Dynamic and Uncertain Highway Environment

Driving in Dense Traffic with Model-Free Reinforcement Learning

Hybrid DDPG Approach for Vehicle Motion Planning

Cooperation-Aware Reinforcement Learning for Merging in Dense Traffic

Cooperative Lane Changing via Deep Reinforcement Learning

Controlling an Autonomous Vehicle with Deep Reinforcement Learning

Deep Q-Network Based Decision Making for Autonomous Driving

Decision-Making System for Lane Change Using Deep Reinforcement Learning in Connected and Automated Driving

Combining Planning and Deep Reinforcement Learning in Tactical Decision Making for Autonomous Driving

Self Training Autonomous Driving Agent

Driving Decision and Control for Autonomous Lane Change based on Deep Reinforcement Learning

Reinforcement Learning with Probabilistic Guarantees for Autonomous Driving

Advanced planning for autonomous vehicles using reinforcement learning and deep inverse reinforcement learning

Lane Change Decision-making through Deep Reinforcement Learning with Rule-based Constraints

Autonomous Highway Driving using Deep Reinforcement Learning

Deep Reinforcement Learning Based High-level Driving Behavior Decision-making Model in Heterogeneous Traffic

A Systematic Review of Perception System and Simulators for Autonomous Vehicles Research

Safe, Efficient, and Comfortable Velocity Control based on Reinforcement Learning for Autonomous Driving

Human-Like Autonomous Car-Following Model with Deep Reinforcement Learning

Hybrid Trajectory Planning for Autonomous Vehicles using Neural Networks

Q-learning based Reinforcement Learning Approach for Lane Keeping

Reinforcement Learning and Deep Learning based Lateral Control for Autonomous Driving

A Survey of State-Action Representations for Autonomous Driving

Policy Gradient Based Reinforcement Learning Approach for Autonomous Highway Driving

Automatically Generated Curriculum based Reinforcement Learning for Autonomous Vehicles in Urban Environment

Overtaking Maneuvers in Simulated Highway Driving using Deep Reinforcement Learning

Adaptive Behavior Generation for Autonomous Driving using Deep Reinforcement Learning with Compact Semantic States

Improved Robustness and Safety for Autonomous Vehicle Control with Adversarial Reinforcement Learning

End-to-End Race Driving with Deep Reinforcement Learning

Multi-Modal Trajectory Prediction of Surrounding Vehicles with Maneuver based LSTMs

Robust Deep Reinforcement Learning for Security and Safety in Autonomous Vehicle Systems

A Reinforcement Learning Based Approach for Automated Lane Change Maneuvers

Automated vehicle's behavior decision making using deep reinforcement learning and high-fidelity simulation environment

Autonomous Ramp Merge Maneuver Based on Reinforcement Learning with Continuous Action Space

Automated Speed and Lane Change Decision Making using Deep Reinforcement Learning

Autonomous Driving in Reality with Reinforcement Learning and Image Translation

CARLA: An Open Urban Driving Simulator

Deep Q learning for traffic simulation in autonomous driving at a highway junction

Formulation of deep reinforcement learning architecture toward autonomous driving for on-ramp merge

End-to-End Driving in a Realistic Racing Game with Deep Reinforcement Learning

The kinematic bicycle model: A consistent model for planning feasible trajectories for autonomous vehicles?

Learning how to drive in a real world simulation with deep Q-Networks

Autonomous lane keeping based on approximate Q-learning

Deep Learning in Automotive Software

Development of a Test Track for Driverless Cars: Vehicle Design, Track Configuration, and Liability Considerations

End-to-End Deep Reinforcement Learning for Lane Keeping Assist

Lane changing prediction at highway lane drops using support vector machine and artificial neural network classifiers

A Survey of Motion Planning and Control Techniques for Self-Driving Urban Vehicles

Dueling Network Architectures for Deep Reinforcement Learning

Deep Reinforcement Learning with Double Q-Learning

Continuous control with deep reinforcement learning

Kinematic and dynamic vehicle models for autonomous driving control design

Route Planning in Transportation Networks

Human-level control through deep reinforcement learning

Probabilistic decision-making under uncertainty for autonomous driving using continuous POMDPs

Deterministic Policy Gradient Algorithms

Playing Atari with Deep Reinforcement Learning

Recent Development and Applications of SUMO - Simulation of Urban MObility

Probabilistic trajectory prediction with Gaussian mixture models

Cooperative Adaptive Cruise Control: A Reinforcement Learning Approach

A Multiple-Goal Reinforcement Learning Method for Complex Vehicle Overtaking Maneuvers

Optimal motion planning by reinforcement learning in autonomous mobile vehicles

Learning to overtake in TORCS using simple reinforcement learning

Automated Vehicle Overtaking based on a Multiple-Goal Reinforcement Learning Framework

General Lane-Changing Model MOBIL for Car-Following Models

Stanley: The robot that won the DARPA Grand Challenge

Congested traffic states in empirical observations and microscopic simulations

Planning and Acting in Partially Observable Stochastic Domains

Microscopic Simulation of Urban Traffic Based on Cellular Automata

Using occupancy grids for mobile robot perception and navigation

Complexity of the mover's problem and generalizations

Learning

Graph-based Multi-Vehicle Overtaking Strategy for Autonomous Vehicles

Highway Environment Model for Reinforcement Learning ⁎

“Automotive SPICE process assessment/reference model,”