If your favorite system is not on the list, please open an issue for us in the respective Github repo and we’ll take care of it. In the meantime, you can still use OpenLLMetry to report the LLM and vector DB calls manually.

​
LLM Foundation Models

Model SDKPythonTypescript
Azure OpenAI✅✅
Aleph Alpha✅❌
Anthropic✅✅
Amazon Bedrock✅✅
Amazon SageMaker✅❌
Cohere✅✅
IBM watsonx✅⏳
Google Gemini✅✅
Google VertexAI✅✅
Groq✅⏳
Mistral AI✅⏳
Ollama✅⏳
OpenAI✅✅
Replicate✅⏳
together.ai✅⏳
HuggingFace Transformers✅⏳
WRITER✅✅

​
Vector DBs

Vector DBPythonTypescript
Chroma DB✅✅
Elasticsearch✅✅
LanceDB✅⏳
Marqo✅❌
Milvus✅⏳
pgvector✅✅
Pinecone✅✅
Qdrant✅✅
Weaviate✅⏳

​
Frameworks

FrameworkPythonTypescript
Burr✅❌
CrewAI✅❌
Haystack by deepset✅❌
Langchain✅✅
LlamaIndex✅✅
OpenAI Agents✅❌