GitHub

crab

Observation pool · not formally ranked

This project does not currently meet the main index requirement of two current dimensions across two source types.

— Not ranked

Observed adoptionMissing

—

MomentumCurrent · 2026-09-12

AttentionCurrent · 2026-09-12

Signal confidence Based on how many independent score dimensions currently have data.

Medium2/3 · 1 source types

Methodology v2.0 · snapshot 2026-09-12 · stale after 2 days

About

CRAB is a framework for building LLM agent benchmark environments in a Python-centric way.

All datasets and experiment code are in crab-benchmark-v0 directory. Please carefully read the benchmark tutorial before using our benchmark.

Please cite our paper if you use anything related in your work:

Join us (Discord or WeChat) in pushing the boundaries of finding the scaling laws of agents.

[slack-url]: [slack-image]: [discord-url]: [discord-image]: [wechat-url]: [wechat-image]: [twitter-url]: [twitter-image]: [arxiv-image]: [arxiv-url]:

426 Stars