Open Source Reinforcement Learning Projects
Reinforcement learning is a machine learning approach in which an agent learns to make decisions by interacting with an environment. It uses feedback, often expressed as rewards, to improve a policy over time. This approach is useful for problems involving sequences of actions and changing conditions, such as robotics, resource allocation, game playing, and adaptive control. It can help optimize decisions where outcomes depend on both current choices and their longer-term effects.
Open source tools in this area include algorithm libraries, simulation environments, training frameworks, benchmarks, and utilities for evaluation or visualization. When choosing one, consider its maintenance activity, license, documentation, hardware and software requirements, supported algorithms, and compatibility with your data and existing workflows. Researchers, students, and practitioners can use these tools to study learning methods, run experiments, and develop agents for practical tasks.
3 repositories · updated October 4, 2026
verl-omni: Train Multimodal Generative Models with RL
VeRL-Omni is a Python framework for reinforcement-learning post-training of diffusion, unified multimodal, and omni-modality models. It builds on verl and targets teams that need distributed training, multimodal rollouts, and configurable reward workflows.
RL4LMs: Fine-Tune Language Models with Reinforcement Learning
RL4LMs is a Python library for training language models against custom reward functions using on-policy reinforcement learning. It suits NLP researchers and developers who need configurable training components for text-generation tasks.
verifiers: Build Environments for LLM Training and Evaluation
verifiers is a Python library for building environments to train and evaluate large language models. It fits teams developing LLM reinforcement-learning workflows or reusable evaluations, especially those using Prime Intellect's training tools.