MO-Gym is introduced, an extensible library containing a diverse set of multi-objective reinforcement learning environments that extends the widely-used OpenAI Gym API, allowing the reuse of algorithms and features that are well-established in the reinforcement learning community.