Synth AI OSS

Tools to run evals, trace LLM calls, and fine‑tune open models using a simple Python/CLI toolkit.

Install

pip install synth-ai

Try it quickly

  • Check your balance (prod backend):
uvx —from synth-ai synth-ai balance —api-key $SYNTH_API_KEY
- Start local services (tracing DB + env service):
```bash
uvx --from synth-ai synth-ai serve --force

What you can do

  • Configure simple and modular evals and metrics for agent runs
  • Run inference on and finetune Open models via Synth endpoints to iterate on hypotheses
  • Inspect every LLM/tool call with structured tracing
  • And more

Jump in

API

  • HTTP endpoints (inference, files, SFT, models, balance):

Contribute

Open source under MIT. PRs welcome for docs, environments, and tools.