Set up the Python environment

First, create and activate a Python virtual environment using Conda (Python 3.11 is recommended), then install the dependencies:

conda create -n cr python=3.11
conda activate cr
pip install -r requirements.txt

Run the evaluation script

Execute the following command to start evaluation:

./run_cyclicreflex.sh

• --model_choice supports:

  • qwen1.5b: DeepSeek-R1-Distill-Qwen-1.5B
  • qwen7b: DeepSeek-R1-Distill-Qwen-7B
  • llama8b: DeepSeek-R1-Distill-Llama-8B

• --datasets supports:

  • math500
  • aime2024
  • aime2025
  • amc2023

Evaluation results will be stored under: results/evaluation/cyclicreflex. You can also monitor detailed logging via wandb.