CE
Cerebrium
Cerebrium is listed in the FXDST software directory. Review its official website, pricing, privacy terms, integrations, and migration options before adopting it.
View selection notes →Software directory
LLM Serving
Compare tools by fit, operating cost, data boundaries, and migration risk.
TE
Text Generation Inference
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
View selection notes →RE
LO
LocalAI
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required. - mudler/LocalAI
View selection notes →VL
vLLM
A high-throughput and memory-efficient inference and serving engine for LLMs - vllm-project/vllm
View selection notes →LL
llama.cpp
LLM inference in C/C++. Contribute to ggml-org/llama.cpp development by creating an account on GitHub.
View selection notes →WA
WasmEdge
WasmEdge is listed in the FXDST software directory. Review its official website, pricing, privacy terms, integrations, and migration options before adopting it.
View selection notes →EV
Evidently
Ensure your AI is production-ready. Test LLMs and monitor performance across AI applications, RAG systems, and multi-agent workflows. Built on open-source.
View selection notes →TR
Traceloop
Traceloop turns evals and monitors into a continuous feedback loop - so every release gets better
View selection notes →LA
LangDB
Debug your AI agents in real time. Comprehensive observability for AI agents with tracing, monitoring, and optimization. Works with LangChain, Google ADK, OpenAI, and all major frameworks.
View selection notes →OP
OpenLIT
OpenLIT is an open-source LLM observability platform built on OpenTelemetry. Monitor token usage, cost, and latency. Self-host for free under Apache 2.0.
View selection notes →LA
LangWatch
LangWatch is listed in the FXDST software directory. Review its official website, pricing, privacy terms, integrations, and migration options before adopting it.
View selection notes →