Skip to main content

synth_ai.cli.eval

Eval command.

Functions

eval

eval(app_id: str | None, model: str, config_path: str, trace_db: str, metadata: tuple[str, ...], seeds: str, url: str, backend: str, env_file: str, ops: str, return_trace: bool, concurrency: str, seed_set: str, wait: bool, poll: str, output_path: str, traces_dir: str, output_txt: str, output_json: str) -> None
Execute evaluation rollouts against a task app.