Library / SDK
Observability & Evaluation
OpenLLMetry
1OpenTelemetry-based 2observability 3for 4LLM 5application 6stacks
the six Ws · specification
W1
Who
Maintained by Traceloop, an LLM observability startup.
W2
What
A set of OpenTelemetry instrumentations emitting standardized traces and metrics for LLM stacks.
W3
Where
A Python/TypeScript SDK exporting OTLP to any OpenTelemetry-compatible backend.
W4
When
Reach for it when you want vendor-neutral LLM telemetry in existing infrastructure.
W5
Why
Standardizes LLM tracing on OpenTelemetry so you avoid vendor lock-in.
W6
With
Built on OpenTelemetry; instruments OpenAI, Anthropic, LangChain, and Pinecone.
W7
Watch
Maintained by Traceloop; open-source (Apache-2.0) SDK. You choose the backend, so data goes wherever you export it (self-hosted or Traceloop's paid platform).