telemetry.dev

telemetry.dev is an observability platform for AI agents. It shows each agent run as a single trace, with every model call and tool call represented as a span that includes duration, tokens, cost, and errors. Teams can use the same traces for prompts and evals, edit prompts without a deploy, run them against datasets, and compare scores with production. Alerts notify users of errors, cost spikes, and agent loops. Integration is available via TypeScript or Python SDKs or an OpenTelemetry exporter.