Quick Start

Run one of the supported recipes against the shared, content-pinned Terminal-Bench 2.0 subset. The launcher requires Bash, Python 3.12+, uv, Git 2.25+, and a running Docker daemon.

git clone https://github.com/simple-agent-lab/RSIHub.git
cd RSIHub

# API authentication is the default. Keep credentials out of recipe YAML.
cat > .env <<'EOF'
OPENAI_API_KEY=replace-me
# OPENAI_BASE_URL=https://your-openai-compatible-endpoint/v1
EOF

docker info

Choose a recipe, download and verify the pinned dataset, build that recipe's pinned mutate-runner image, and launch one generation:

RECIPE=ahe
./scripts/setup_terminal_bench.sh "$RECIPE"
./scripts/run_recipe_demo.sh "$RECIPE"

Supported values are aevolve, ahe, ahe_codex, gepa, hill_climb, hill_climb_codex, hyperagents, and hyperagents_codex. Codex-capable profiles may use CODEX_AUTH_JSON_PATH=/absolute/path/to/auth.json instead of an API key. Use WORKSPACE, TASKS, GENERATIONS, ENV_FILE, or EVOLVE_ASSET_DIR to override launcher defaults. See the recipe guide and operations guide for the full configuration and recovery workflow.

For evolution results on Terminal Bench 2 and Tau³ Banking, see the benchmark results in the README.