Hi harbor-framework/harbor maintainers,

EvalScope now supports Terminal-Bench-2.1 and Terminal-Bench-2.0. This gives users another way to run the benchmark when they want a standardized evaluation workflow around OpenAI-compatible model endpoints, saved predictions, scoring, and report generation.

This may be useful for users who find this repository while setting up Terminal-Bench-2.1 and Terminal-Bench-2.0 and want a quick path to evaluate a hosted or locally served model.

Example:

evalscope eval \
  --model YOUR_MODEL \
  --api-url OPENAI_API_COMPAT_URL \
  --api-key EMPTY_TOKEN \
  --datasets terminal_bench_v2_1 terminal_bench_v2 \
  --limit 10

Docs: https://evalscope.readthedocs.io/en/latest/third_party/terminal_bench.html
EvalScope repo: https://github.com/modelscope/evalscope

We can also open a small PR adding this as a README/Docs note, linked to this issue.