Open Source Alternatives to LangSmith
An AI development platform that provides observability, evaluation, and deployment tools for building, testing, and managing AI agents across frameworks with integrated tracing, monitoring, and usage analytics to accelerate iteration.
Whether you want to cut software costs or escape vendor lock-in, these open source alternatives to LangSmith give you an option you fully own. You can self-host them, so your data stays on infrastructure you control. This page lists 9 open source alternatives to LangSmith. The most popular are Langfuse, Opik and Arize Phoenix. Most use the Apache-2.0 or MIT license, and 8 offer an official Docker image.
Langfuse
Track LLM calls, manage prompts, and run evaluations to debug and monitor large language model applications.
Opik
An observability and evaluation platform for monitoring, testing, and optimizing generative AI and agentic systems.
Arize Phoenix
Trace, evaluate, and optimize LLM applications with an observability platform featuring prompt management and dataset versioning.
OpenLLMetry
Provides observability for LLM applications by using OpenTelemetry to monitor performance and track AI model interactions.
Helicone
Log, monitor, and debug large language model applications with a unified gateway for AI model routing.
Latitude
Monitors AI agents in production by clustering failures into issues and generating evaluations from real traces.
Agenta
An LLMOps platform for prompt management, evaluation, and observability to help teams build reliable AI applications.
Laminar
Collect and analyze trace data to monitor and evaluate the performance of AI agents and LLM applications.
OpenLIT
Provides observability, distributed tracing, and prompt management for generative AI and large language model applications.
Join our newsletter to get shiny new open source software delivered to your inbox. Unsubscribe anytime.