Helicone
NEWHelicone provides one-line LLM observability — add a single line to your OpenAI calls and get full logging,…
Opik
NEWOpik by Comet is an open-source LLM evaluation framework for testing AI application quality at scale. Automated evaluation…
Braintrust
NEWBraintrust is an enterprise AI evaluation platform for measuring, improving, and shipping AI applications. Logging, evaluation datasets, prompt…
Phoenix Arize
NEWPhoenix by Arize is an open-source AI observability library for ML engineers. Traces LLM and embedding applications, visualizes…
TruLens
NEWTruLens is an open-source framework for evaluating and tracking LLM applications. Feedback functions assess truthfulness, harmlessness, and helpfulness…
Weaviate
NEWWeaviate is an open-source vector database with built-in ML model integration. Automatically vectorizes data as it's imported and…
Qdrant
NEWQdrant is a high-performance vector database optimized for production AI applications. Rust-based engine delivers exceptional speed with filtering…
Chroma
NEWChroma is the open-source embedding database for AI applications. Simple Python API, local-first development, and seamless LangChain integration…
Milvus
NEWMilvus is a cloud-native vector database built for billion-scale AI applications. Handles trillion-dimensional vectors with hybrid search combining…
LlamaIndex
NEWLlamaIndex is a data framework for building LLM-powered applications over your data. Simple connectors for 160+ data sources,…
DSPy
NEWDSPy is a framework for algorithmically optimizing LLM prompts and weights. Instead of manually writing prompts, DSPy compiles…
Instructor
NEWInstructor makes it easy to get structured outputs from LLMs using Python type hints. Define a Pydantic model…