1

Fiddler AI

Fiddler AI provides a platform for monitoring and ensuring the integrity of AI models, offering explainable AI and observability tools to manage the lifecycle of ML and LLM applications effectively. It integrates with major cloud providers.

freemium

United States

2

Promptfoo

Promptfoo offers a platform for robust LLM application security testing, enabling developers to run tailored vulnerability scans and receive actionable insights for software protection.

freemium

United States

3

Deepchecks Monitoring

Deepchecks offers comprehensive evaluation and monitoring tools for LLM applications, leveraging open-source ML testing packages to automate quality control, compliance checks, and risk mitigation, enhancing the reliability and performance of AI systems.

freemium

Israel

4

TruEra

TruEra provides AI-driven solutions for machine learning model monitoring, testing, and quality management, ensuring reliable and trustworthy AI implementation across industries such as banking and manufacturing.

unknown

United States

5

Scade.pro

Scade.pro offers a no-code platform that simplifies AI app development by providing access to over 1,500 models and tools. It reduces complexity with a unified API, allowing easy integration across web and mobile platforms without coding skills.

freemium

Unknown

6

LLM Reference

LLM Reference is a reference and benchmarking platform that helps technology leaders and engineers evaluate AI language models, providers, and tools. It aggregates model benchmarks, pricing data, provider information, comparisons, and curated recommendations, enabling users to compare models for use cases such as coding, agents, research, writing, long context tasks, tool use, image generation, video generation, and other AI workloads.

+1

free

United States

7

Superwise

SUPERWISE offers AI governance and monitoring solutions, ensuring compliance and operational efficiency for enterprises across various industries.

-1

unknown

Israel

8

Twilix

Confident AI offers a platform to evaluate and benchmark LLM applications through advanced observability and synthetic dataset generation. It utilizes metrics proven to match human evaluation and offers real-time feedback on performance drift and regressions.

+1

freemium

Unknown

9

Traceloop

Traceloop provides LLM observability and evaluation, turning logs into insights. It monitors prompts, responses, latency, and quality metrics like faithfulness and relevance. One line of code enables tracking, custom evaluators, and automated checks in CI/CD or real-time, supporting OpenTelemetry and 20+ providers.

-1

unknown

United States

10

RagaAI

RagaAI Catalyst is a platform for evaluating and monitoring AI workflows, offering tools for observability, debugging, and performance enhancement, ensuring robust AI deployments.

freemium

United States

11

Agentops

AgentOps is a developer platform designed to test and debug AI agents, enhancing reliability through tools like time travel debugging and cost tracking. It integrates with leading cloud services, ensuring seamless deployment and management.

freemium

United States

12

Regression Games

Regression Games provides a comprehensive automation framework for testing Unity games, featuring no-code test creation and AI-driven integrations. It supports automated test creation and real-time data collection, making it suitable for developers and QA teams.

N/A

paid

United States

13

Ottic

Ottic streamlines QA of large language model applications by facilitating collaboration between tech and non-tech teams, offering test management, and improving app reliability with clear user behavior insights.

+1

paid

France

14

UBOS

UBOS provides an open-source, low-code platform designed for AI-native companies to create enterprise-ready applications with minimal complexity, offering integrations with leading AI models and marketplace templates.

-2

paid

United States

15

LLM DutchRank

DutchRank is an AI evaluation platform that benchmarks and compares language models based on their performance in Dutch. It uses human preference testing, allowing users to compare anonymous model responses to Dutch prompts and vote on the better answer. The platform aggregates these evaluations to create a public leaderboard that measures language understanding, response quality, and overall model performance in Dutch.

+1

free

Netherlands

16

Prolego

Prolego offers AI consultancy services using its proprietary Performance-Driven Development methodology to enhance LLM projects, focusing on transparency and performance optimization.

-3

unknown

United States

17

Langtale

Langtail is a low-code platform designed to test and refine AI applications, ensuring predictability in LLM prompt outputs and offering comprehensive security features for seamless integration with major AI models.

-2

freemium

Czech Republic

18

LLUMO AI

LLUMO AI optimizes large language models by reducing costs, improving precision, and minimizing hallucinations, enabling faster and more reliable AI workflows.

-1

paid

India

19

InfAI

InfAI provides AI governance software for tech-driven teams, offering customizable workflow packages that support responsible AI practices at different stages of development and deployment with a by-design, tech-first approach.

N/A

paid

United Kingdom

20

Lytix

Lytix is an open-source evaluation layer for LLMOps that continuously monitors and scores your AI workflows. It supports custom evaluation models, real-time alerts, and a console for tracing events, isolating workflows, and generating reports. With Python and TypeScript SDKs, Lytix integrates with OpenAI, Gemini, and Vercel AI, helping teams ensure accuracy, empathy, and reliability in production LLM systems.

N/A

unknown

United States

21

Comet.com

Comet offers a comprehensive model evaluation platform for developers, including LLM evaluations, experiment tracking, and model monitoring. Seamlessly integrates with various AI frameworks, enhancing productivity and collaboration in AI projects.

-3

freemium

United States