rllm

About

Agentic RL on any harness, with any backend, on any benchmark.

rLLM is an open-source framework for training language agents with reinforcement learning. Bring any harness, run it in any sandbox, and switch training backends with one flag — the same agent code drives both eval and training.

rLLM requires Python >= 3.11. You can install it either directly via pip or build from source.

This installs dependencies for running rllm CLI with the tinker backend (single-machine, Tinker API). For other backends:

For building from source or Docker, see the installation guide.

Define a rollout (your agent) and an evaluator (your reward function), then hand them to the trainer:

During training,…