agentcompass. Run it from an activated AgentCompass environment or through
uv run:
Command List
Choose run or launch
agentcompass run evaluates a selected benchmark with the harness, model,
and environment supplied through the command line and configuration files. Positional arguments select the benchmark,
harness, and model in that order, while --env selects the environment. Component parameters, concurrency, retries, output, and
reuse settings come from the same command or the configuration files it loads.
agentcompass launch reads multiple explicitly named evaluation
requests from a YAML or JSON file and submits them to one global scheduler. Use it to compare models, run several
benchmarks, or mix harnesses and environments. It does not generate a Cartesian product automatically; declare every
combination explicitly in the orchestration file.
Both commands share concurrency, timeout, retry, output, and debugging settings. See Run Controls for their scope and usage guidance.