Token-economics and observability platform to trace requests, monitor token usage and AI spend, and debug LLM workflows from one dashboard.
Key features
Request Tracing: Captures structured traces for prompts, model inputs/outputs, tool calls and multi-step agent execution to visualize end-to-end LLM workflows and identify failure points.
Token & Spend Analytics: Aggregates token usage and monetary spend across requests, models, features, and customers to enable cost attribution, budgeting, and optimization.
Provider Proxies & SDKs: Official Python and Node.js SDKs and provider proxy wrappers (OpenAI, Anthropic, etc.) that automatically log requests, responses, and metadata for minimal instrumentation effort.
Workflows & Replay: Helpers for running and replaying prompts and multi-step workflows, enabling regression testing, deterministic re-runs, and comparison of outputs across model versions.
OpenTelemetry & Plugin Integrations: OTLP-compatible integrations and plugins (e.g., OpenClaw, Claude plugins) to export GenAI semantic traces and integrate with distributed tracing pipelines.
Grouping, Annotation & Evaluation: Request grouping, metadata tagging, and robust evaluation/regression sets to organize requests, annotate outcomes, and track prompt performance over time.
Self-Hosted Deployment: Full self-hosted stack (dockerized services with PostgreSQL, object storage, Redis) for teams needing on-prem data control, SOC 2/HIPAA/GDPR alignment and compliance.
Request tracing and distributed traces for multi-step LLM workflows (OTLP/HTTP JSON compatible)
Token usage tracking and AI spend monitoring with per-request and aggregated metrics
Cost attribution to features, workflows, or customers
Prompt/version management: template retrieval, listing, publishing, and cache invalidation
Prompt/agent evaluation tooling, regression sets and replay capabilities
SDKs for Node.js and Python with async support and promise-style or async methods
Client methods: run/runWorkflow (helpers), logRequest (manual logging), track (annotations/metadata/scores/groups), group creation, wrapWithSpan/traceable decorator for instrumenting code
Provider proxy wrappers for OpenAI and Anthropic that automatically log and trace requests
OpenTelemetry integration and OTLP/HTTP ingestion for third-party tracing sources
Plugins: Claude Code tracing plugin and OpenClaw observability plugin (exports OpenClaw activity as OTEL GenAI traces)
Environment-driven configuration with API key and base URL overrides
Best for
Cost Attribution: Measure token consumption and AI spend per feature, endpoint, or customer to allocate costs accurately and identify expensive usage patterns.
Debugging Multi-Step Agents: Trace multi-step agent runs and tool invocations to visualize execution flow, inspect intermediate responses, and diagnose failures or hallucinations.
Prompt Regression Testing: Store historical prompts and responses to create regression sets and run comparisons when upgrading models or altering prompts to ensure behavior stability.
Centralized Observability: Consolidate LLM requests, traces, and metrics from multiple providers (OpenAI, Anthropic, Claude) into a single dashboard for unified monitoring and alerts.
Compliance & Self-Hosting: Deploy a self-hosted instance to retain full control of prompt data and meet enterprise compliance requirements (SOC 2, HIPAA, GDPR).
Integration with Tracing Pipelines: Export GenAI semantic traces via OpenTelemetry plugins to integrate prompt traces with existing distributed tracing and APM systems.
Trace and debug complex multi-step LLM workflows and agent executions
Monitor token consumption and AI spend per feature, customer, or environment
Version, test and regress prompts and agent behaviors across releases
Integrate LLM telemetry into existing observability stacks via OpenTelemetry/OTLP
Self-hosted deployments for compliance (SOC 2, HIPAA, GDPR) and data residency requirements
Automatically capture Claude Code sessions and OpenClaw agent runs as structured traces
