verl

verl is a flexible, efficient and production-ready RL training library for large language models (LLMs). It enables easy extension of diverse RL algorithms, seamless integration of existing LLM infra with modular APIs, flexible device mapping, and state-of-the-art throughput.