Skip to main content

​
synth_ai.sdk.task.config

Configuration dataclasses for task app CLI commands (eval, filter).

​
Classes

​
EvalConfig

Configuration for ‘synth-ai eval’ command. Validates and provides defaults for evaluation runs against task apps. Methods:

​
from_dict

from_dict(cls, data: dict[str, Any]) -> EvalConfig
Create EvalConfig from a dictionary (e.g. from TOML). Args:
  • data: Dictionary with eval configuration
Returns:
  • Validated EvalConfig instance

​
FilterConfig

Configuration for ‘synth-ai filter’ command. Validates and provides defaults for filtering traces into SFT datasets. Methods:

​
from_dict

from_dict(cls, data: dict[str, Any]) -> FilterConfig
Create FilterConfig from a dictionary (e.g. from TOML). Args:
  • data: Dictionary with filter configuration
Returns:
  • Validated FilterConfig instance

​
get_db_url

get_db_url(self) -> str
Convert db path to proper SQLite URL if needed. Returns:
  • Database URL suitable for SQLAlchemy/aiosqlite

​
get_output_path

get_output_path(self) -> Path
Get resolved output path with parent directory created. Returns:
  • Resolved Path object with parent directory created