1

Fiddler AI Fiddler AI provides a platform for monitoring and ensuring the integrity of AI models, offering explainable AI and observability tools to manage the lifecycle of ML and LLM applications effectively. It integrates with major cloud providers.

freemium

United States

2

Promptfoo Promptfoo offers a platform for robust LLM application security testing, enabling developers to run tailored vulnerability scans and receive actionable insights for software protection.

freemium

United States

3

Deepchecks Monitoring Deepchecks offers comprehensive evaluation and monitoring tools for LLM applications, leveraging open-source ML testing packages to automate quality control, compliance checks, and risk mitigation, enhancing the reliability and performance of AI systems.

freemium

Israel

4

TruEra TruEra provides AI-driven solutions for machine learning model monitoring, testing, and quality management, ensuring reliable and trustworthy AI implementation across industries such as banking and manufacturing.

unknown

United States

5

Scade.pro Scade.pro offers a no-code platform that simplifies AI app development by providing access to over 1,500 models and tools. It reduces complexity with a unified API, allowing easy integration across web and mobile platforms without coding skills.

freemium

Unknown

6

Superwise SUPERWISE offers AI governance and monitoring solutions, ensuring compliance and operational efficiency for enterprises across various industries.

unknown

Israel

7

LLM Reference LLM Reference is a reference and benchmarking platform that helps technology leaders and engineers evaluate AI language models, providers, and tools. It aggregates model benchmarks, pricing data, provider information, comparisons, and curated recommendations, enabling users to compare models for use cases such as coding, agents, research, writing, long context tasks, tool use, image generation, video generation, and other AI workloads.

free

United States

+2

8

Traceloop Traceloop is an LLM observability and evaluation platform that turns raw logs into actionable insights. With one line of code, teams gain live visibility into prompts, responses, latency, and quality. It runs built-in checks for faithfulness, relevance, and safety, and lets you define custom evaluators trained on real examples. Traceloop integrates with major LLM providers, vector databases, and frameworks, and can be deployed in cloud, on-prem, or air-gapped environments. Built on OpenTelemetry and the open-source OpenLLMetry SDK, it helps teams catch drift early, enforce thresholds, and ship reliable AI.

unknown

United States

9

Twilix Confident AI offers a platform to evaluate and benchmark LLM applications through advanced observability and synthetic dataset generation. It utilizes metrics proven to match human evaluation and offers real-time feedback on performance drift and regressions.

freemium

Unknown

-2

10

RagaAI RagaAI Catalyst is a platform for evaluating and monitoring AI workflows, offering tools for observability, debugging, and performance enhancement, ensuring robust AI deployments.

freemium

United States

11

Agentops AgentOps is a developer platform designed to test and debug AI agents, enhancing reliability through tools like time travel debugging and cost tracking. It integrates with leading cloud services, ensuring seamless deployment and management.

freemium

United States

12

UBOS UBOS provides an open-source, low-code platform designed for AI-native companies to create enterprise-ready applications with minimal complexity, offering integrations with leading AI models and marketplace templates.

paid

United States

13

Prolego Prolego offers AI consultancy services using its proprietary Performance-Driven Development methodology to enhance LLM projects, focusing on transparency and performance optimization.

unknown

United States

Not Available

14

Ottic Ottic streamlines QA of large language model applications by facilitating collaboration between tech and non-tech teams, offering test management, and improving app reliability with clear user behavior insights.

paid

France

Not Available

15

Langtale Langtail is a low-code platform designed to test and refine AI applications, ensuring predictability in LLM prompt outputs and offering comprehensive security features for seamless integration with major AI models.

freemium

Czech Republic

-2

16

LLM DutchRank DutchRank is an AI evaluation platform that benchmarks and compares language models based on their performance in Dutch. It uses human preference testing, allowing users to compare anonymous model responses to Dutch prompts and vote on the better answer. The platform aggregates these evaluations to create a public leaderboard that measures language understanding, response quality, and overall model performance in Dutch.

free

Netherlands

Not Available

17

LLUMO AI LLUMO AI optimizes large language models by reducing costs, improving precision, and minimizing hallucinations, enabling faster and more reliable AI workflows.

paid

India

-3

18

Airtrain AI Airtrain AI is a data processing platform that enables enterprises to handle unstructured data efficiently using advanced LLM fine-tuning, evaluation, and semantic clustering.

freemium

United States

-3

19

Comet.com Comet offers a comprehensive model evaluation platform for developers, including LLM evaluations, experiment tracking, and model monitoring. Seamlessly integrates with various AI frameworks, enhancing productivity and collaboration in AI projects.

freemium

United States

-3