FinRL: A Deep Reinforcement Learning Library for Automated Stock Trading in Quantitative Finance (2020-11-19T00:00:00.000000Z)

TL;DR

A DRL library FinRL is introduced that facilitates beginners to expose themselves to quantitative finance and to develop their own stock trading strategies and to compare with existing schemes easily.

Abstract

As deep reinforcement learning (DRL) has been recognized as an effective approach in quantitative finance, getting hands-on experiences is attractive to beginners. However, to train a practical DRL trading agent that decides where to trade, at what price, and what quantity involves error-prone and arduous development and debugging. In this paper, we introduce a DRL library FinRL that facilitates beginners to expose themselves to quantitative finance and to develop their own stock trading strategies. Along with easily-reproducible tutorials, FinRL library allows users to streamline their own developments and to compare with existing schemes easily. Within FinRL, virtual environments are configured with stock market datasets, trading agents are trained with neural networks, and extensive backtesting is analyzed via trading performance. Moreover, it incorporates important trading constraints such as transaction cost, market liquidity and the investor's degree of risk-aversion. FinRL is featured with completeness, hands-on tutorial and reproducibility that favors beginners: (i) at multiple levels of time granularity, FinRL simulates trading environments across various stock markets, including NASDAQ-100, DJIA, SP (ii) organized in a layered architecture with modular structure, FinRL provides fine-tuned state-of-the-art DRL algorithms (DQN, DDPG, PPO, SAC, A2C, TD3, etc.), commonly-used reward functions and standard evaluation baselines to alleviate the debugging workloads and promote the reproducibility, and (iii) being highly extendable, FinRL reserves a complete set of user-import interfaces. Furthermore, we incorporated three application demonstrations, namely single stock trading, multiple stock trading, and portfolio allocation. The FinRL library will be available on Github at link this https URL.

References46 items

Deep reinforcement learning for automated stock trading: an ensemble strategy

Sentiment and Knowledge Based Algorithmic Trading with Deep Reinforcement Learning

Deep Hedging of Derivatives Using Reinforcement Learning

Reinforcement Learning in Stock Trading

Deep Reinforcement Learning for Trading

Application of Deep Reinforcement Learning on Automated Stock Trading

Twin-Delayed DDPG: A Deep Reinforcement Learning Technique to Model a Continuous Movement of an Intelligent Robot Agent

Multi-Agent Deep Reinforcement Learning for Liquidation Strategy Analysis

Optimistic Bull or Pessimistic Bear: Adaptive Deep Reinforcement Learning for Stock Portfolio Allocation

Experience Replay Optimization

Deep Hedging: Hedging Derivatives Under Generic Market Frictions Using Reinforcement Learning

Learning to Trade with Deep Actor Critic Methods

Practical Deep Reinforcement Learning Approach for Stock Trading

Horizon: Facebook's Open Source Applied Reinforcement Learning Platform

Dopamine: A Research Framework for Deep Reinforcement Learning

Deep Reinforcement Learning in High Frequency Trading

Financial Trading as a Game: A Deep Reinforcement Learning Approach

Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor

RLlib: Abstractions for Distributed Reinforcement Learning

Proximal Policy Optimization Algorithms

A Deep Reinforcement Learning Framework for the Financial Portfolio Management Problem

Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments

An intelligent hybrid trading system for discovering trading rules for the futures market using rough sets and genetic algorithms

Deep Direct Reinforcement Learning for Financial Signal Representation and Trading

OpenAI Gym

Online Portfolio Selection Strategy Based on Combining Experts’ Advice

Asynchronous Methods for Deep Reinforcement Learning

Mastering the game of Go with deep neural networks and tree search

Continuous control with deep reinforcement learning

Human-level control through deep reinforcement learning

Profitable momentum trading strategies for individual investors

Q-Learning-Based Financial Trading Systems with Applications

Mean-Variance Investing

Skulls, Financial Turbulence, and Risk Management

Fuzzy adaptive decision-making for boundedly rational traders in speculative stock markets

Passive Investment Strategies and Efficient Markets

Learning to trade via direct reinforcement

Performance functions and reinforcement learning for trading systems and portfolios