LLM gateways and observability for enterprise buyers
Asked as “LLM gateway”, and as “LLM observability and routing platform”, on behalf of an enterprise B2B company. 54 first choices recorded across the direct, paraphrase, budget and scale prompts, fourteen models each.
Standing · first-choice share
26LiteLLM26Portkey15Bifrost33others
26% of first choices, contested.
Since September 2026↗new leaderNew leader since September 2026: Portkey (32%) replaces LiteLLM (29% then, 23% now), 9 points clear, inside the 11-point floor.Portkey leads at 32%, replacing LiteLLM, which led at 29% and stands at 23% now: 9 points clear, inside the floor, so the swap reads as unsettled.
By buyer segment
The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.
Small business
LiteLLM31%Contested↗new leaderNew leader since September 2026: Portkey (30%) replaces LiteLLM (46% then, 30% now), 0 points clear, inside the 11-point floor.Standing →Mid-marketLiteLLM31%Contested▼−4Since September 2026: 38% → 33%, −4 points. Inside the 11-point floor: within noise. Read over the models both editions asked.Standing →Enterprise
Portkey26%Contested↗new leaderNew leader since September 2026: Portkey (32%) replaces LiteLLM (29% then, 23% now), 9 points clear, inside the 11-point floor.This page
LiteLLM31%Contested↗new leaderNew leader since September 2026: Portkey (30%) replaces LiteLLM (46% then, 30% now), 0 points clear, inside the 11-point floor.Standing →Mid-marketLiteLLM31%Contested▼−4Since September 2026: 38% → 33%, −4 points. Inside the 11-point floor: within noise. Read over the models both editions asked.Standing →EnterprisePortkey26%Contested↗new leaderNew leader since September 2026: Portkey (32%) replaces LiteLLM (29% then, 23% now), 9 points clear, inside the 11-point floor.This pageThe standing
Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all fourteen models, for an enterprise B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrantSince September 2026
01Portkey26%13%52accepted challenger▲+17Since September 2026: 15% → 32%, +17 points. Past the 11-point floor: movement. Read over the models both editions asked.15% → 32%
Portkey26%13%52accepted challenger▲+17Since September 2026: 15% → 32%, +17 points. Past the 11-point floor: movement. Read over the models both editions asked.15% → 32%02LiteLLM26%19%59accepted challenger▼−6Since September 2026: 29% → 23%, −6 points. Inside the 11-point floor: within noise. Read over the models both editions asked.29% → 23%
LiteLLM26%19%59accepted challenger▼−6Since September 2026: 29% → 23%, −6 points. Inside the 11-point floor: within noise. Read over the models both editions asked.29% → 23%03
Bifrost15%3%31accepted challenger▼−11Since September 2026: 27% → 16%, −11 points. Past the 11-point floor: movement. Read over the models both editions asked.27% → 16%
Bifrost15%3%31accepted challenger▼−11Since September 2026: 27% → 16%, −11 points. Past the 11-point floor: movement. Read over the models both editions asked.27% → 16%04
Kong AI Gateway6%8%39accepted challenger▲+2Since September 2026: 2% → 5%, +2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.2% → 5%
Kong AI Gateway6%8%39accepted challenger▲+2Since September 2026: 2% → 5%, +2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.2% → 5%05
Helicone2%11%19accepted challenger=heldSince September 2026: 2% → 2%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.2% → 2%
Helicone2%11%19accepted challenger=heldSince September 2026: 2% → 2%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.2% → 2%06
Tetrate Agent Router Enterprise2%0%10accepted challenger▲+2Since September 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 2%
Tetrate Agent Router Enterprise2%0%10accepted challenger▲+2Since September 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 2%Show the two products at 0%, ordered by negative rate
08
OpenRouter0%53%30criticized challenger▼−2Since September 2026: 2% → 0%, −2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.2% → 0%
OpenRouter0%53%30criticized challenger▼−2Since September 2026: 2% → 0%, −2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.2% → 0%07
Cloudflare AI Gateway0%21%19accepted challenger▼−2Since September 2026: 2% → 0%, −2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.2% → 0%
Cloudflare AI Gateway0%21%19accepted challenger▼−2Since September 2026: 2% → 0%, −2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.2% → 0%The floor is 11 points of share, measured: how far the models move a leader on their own when the same questions are asked twice with nothing changed. A larger change is movement; a smaller one is noise, and both are shown. Movement is read over the twelve models both editions asked; GPT-6 Luna, Muse Glimmer 30B joined this edition and are in the standing but not yet in the comparison. How the floor is measured
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its product page.
All fifteen head-to-head pages: the top six products, each against each
LiteLLM vs BifrostLiteLLM vs Cloudflare AI GatewayPortkey vs OpenRouterPortkey vs HeliconePortkey vs BifrostPortkey vs Cloudflare AI GatewayOpenRouter vs HeliconeOpenRouter vs BifrostOpenRouter vs Cloudflare AI GatewayHelicone vs BifrostHelicone vs Cloudflare AI GatewayBifrost vs Cloudflare AI Gateway
Recommended versus criticized
Every product with at least 10 labels here, on both axes. The 30% line names a quadrant, not the verdict above: that one needs more than 40%.
Criticized challengerCriticized default
Negative label rate →
0102030405060708Accepted challengerEndorsed leader
0%First-choice share → · lines at 30% share and 25% negative40%
Key
01Portkey26%
Portkey26%02LiteLLM26%
LiteLLM26%03Bifrost15%
Bifrost15%04Kong AI Gateway6%
Kong AI Gateway6%05Helicone2%
Helicone2%06Tetrate Agent Router Enterprise2%
Tetrate Agent Router Enterprise2%07Cloudflare AI Gateway0%
Cloudflare AI Gateway0%08OpenRouter0%
OpenRouter0%What they warned about
One of fourteen models held their first choice under the paraphrase. Claude Haiku 4.5, GPT-5.4 mini, Gemini 3.5 Flash, Perplexity Sonar, Grok 4.1 Fast, Mistral Small, DeepSeek V4 Flash, Llama 4 Maverick, Qwen 3.7 Flash, Kimi K2, MiniMax M2.5, GPT-6 Luna and Muse Glimmer 30B changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
LiteLLM19%
11 of 59 labels negative · 9 of 14 models · 5 hard negative
“LiteLLM, the most widely deployed open-source LLM gateway, had 8 official GitHub Security Advisories published in a single calendar year, including three rated Critical, and a supply-chain incident” Claude Haiku 4.5, negative prompt
OpenRouter53%
16 of 30 labels negative · 9 of 14 models · 4 hard negative
“OpenRouter-type managed routers are faster to start but are a markup model ... That is the opposite of predictable total cost for a large company.” Muse Glimmer 30B, budget prompt
Portkey13%
7 of 52 labels negative · 6 of 14 models · 1 hard negative
“Portkey: It is not suitable for customer-facing applications at scale, real-time features where every millisecond counts, or production workloads requiring 99.9%+ uptime.” Llama 4 Maverick, negative prompt
Cloudflare AI Gateway21%
4 of 19 labels negative · 4 of 14 models
“I'd evaluate it carefully against your requirements for deployment control and enterprise governance before making it the central policy layer.” GPT-6 Luna, direct prompt
What they cite
Citations exist only for the models that return a source list: fourteen of the fourteen in this edition, and all six flagship models on the expanded tier.
Sites the answers cite
76 of 84 answers in this category came back with a source list, from 14 of 14 models: citations where the model returns them, or the search results it consulted. 1112 links across 264 sites, every framing counted. Ranked by the number of answers carrying the site or page. 37 of the 252 answers across every segment cited this index's own page for the category; the method page measures whether that reading tilts an answer.
52 answers · 166 citations · 12 models
vendor site · TrueFoundry37 answers · 56 citations · 12 models
vendor site · OpenRouter29 answers · 33 citations · 12 models
27 answers · 44 citations · 11 models
vendor site · LLMGateway.io24 answers · 55 citations · 9 models
vendor site · Portkey21 answers · 40 citations · 12 models
vendor site · Respan19 answers · 19 citations · 9 models
vendor site · LiteLLM18 answers · 25 citations · 9 models
vendor site · Tetrate16 answers · 16 citations · 8 models
vendor site · CloudZero14 answers · 16 citations · 8 models
vendor site · Braintrust12 answers · 15 citations · 8 models
vendor site · Cequence12 answers · 12 citations · 6 models
Pages the answers cite
The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.
27 answers · 11 models
21 answers · 9 models
19 answers · 9 models
17 answers · 9 models
16 answers · 9 models
16 answers · 8 models
14 answers · 8 models
12 answers · 6 models
12 answers · 8 models
12 answers · 8 models
Search against answers
Each company's standing in the answers beside its site's footprint in Google search, one row a site: the products the models named on it with their shares, and the share they add up to; monthly searches on Google, and DataForSEO's estimate of AI search demand (modeled from search signals, directional, not a count of queries to any assistant), for the most-searched of the company's and its products' names (the name is in each row's hover text); estimated monthly organic visits to the site; and its best position in Google's top ten for “best llm gateway”, “llm gateway”, “llm gateways”. US estimates from DataForSEO and Google's Ads Transparency Center. A small company's site, or a mid-sized company's site for its flagship, is marked company; a product on a large parent's site (Google, Microsoft) has no site figures. A column with no figures for this category is left out, and an empty cell means none were seen, not none exist. Two measurements side by side: neither is read as the cause of the other.
| Company and products | Share | Own site cited | Name searches, Google | AI search demand, est. | Organic visits | Paid search a month, est. | Google ads, last 30 days | Best Google position |
|---|---|---|---|---|---|---|---|---|
| Portkey portkey.ai Portkey 26%, Portkey AI Gateway 2% | 28% | 167 | 5,400 | 131 | 5,999 | 0 | 5 | |
| LiteLLM litellm.ai | 26% | 189 | 22,200 | 264 | 15,281 | 0 | 2 | |
| Bifrost getmaxim.ai | 15% | 93 | 12,100 | 427 | 4,289 | 10 | 8 | |
| Kong konghq.com Kong AI Gateway 6% | 6% | 90 | 880 | 10 | 20,236 company | $376 | 62 | |
| LLM Gateway llmgateway.io | 4% | 10 | 1,600 | 69 | 1,222 | 1 | ||
| LangSmith langchain.com | 4% | 14 | 14,800 | 238 | 93,424 | 94 | ||
| Arize AX arize.com Arize AX 4%, Arize Phoenix 0%, Arize AI 0% | 4% | 22 | 3,600 | 116 | 25,305 | 10 | ||
| Helicone helicone.ai | 2% | 77 | 1,600 | 899 | 2,439 | 0 | ||
| Tetrate Agent Router Enterprise tetrate.io | 2% | 11 | 0 | 68,356 | 8 | |||
| TrueFoundry truefoundry.com TrueFoundry 2%, TrueFoundry AI Gateway 0% | 2% | 40 | 1,600 | 21 | 47,088 | 2 | 3 |
Google's top ten for the three searches hold 18 sites; 7 of them are among the sites the models cited here (braintrust.dev, dev.to, getmaxim.ai, llmgateway.io, openrouter.ai, portkey.ai, truefoundry.com). The first result for “best llm gateway” is reddit.com.
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.ShowHide
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ShowHideModelDirect“What is the best LLM gateway for an enterprise B2B company?”Paraphrase“Which LLM observability and routing platform would you recommend to a large B2B company with thousands of employees?”Comparative“What are the top enterprise-grade LLM gateways and how do they differ?”Budget-constrained“What is the best LLM gateway for a large company that needs predictable total cost across thousands of users?”Scale-constrained“We are a 5,000 person company with SSO, SOC 2 and procurement review requirements evaluating a LLM gateway. What should we look at?”Negative“Which LLM gateways should a large enterprise avoid or be cautious about?”
Claude Haiku 4.5Bifrost, PortkeyTrueFoundryChangedBifrostBifrostno first choiceagainst: LiteLLM, OpenClaw
One alternative
TrueFoundryTwo alternatives
Bifrost, PortkeySix alternatives
Cloudflare AI Gateway, Kong AI Gateway, LiteLLM, OpenRouter, Portkey, TrueFoundryTwo alternatives
LLM Gateway, LiteLLMGPT-5.4 miniKong AI Gateway, LiteLLMArize AXChangedLiteLLMAzure API Management AI Gatewayno first choicenothing named
One alternative
OpenRouterOne alternative
Arize PhoenixTwo alternatives
Kong AI Gateway, PortkeyOne alternative
Amazon BedrockGemini 3.5 FlashLiteLLMPortkeyChangedLiteLLMLiteLLMno first choiceagainst: Amazon API Gateway, Apigee, Bifrost, Kong AI Gateway, LiteLLM, MuleSoft, OpenRouter
Five alternatives
Bifrost, Cloudflare AI Gateway, Kong AI Gateway, Portkey, TrueFoundryFive alternatives
Arize AI, Bifrost, Dynatrace, Kong AI Gateway, LiteLLMFive alternatives
Cloudflare AI Gateway, Kong AI Gateway, Portkey, Prisma AIRS, TrueFoundry AI GatewayFour alternatives
Bifrost, Gloo Gateway, Kong AI Gateway, PortkeyPerplexity SonarBifrostPortkeyChangedBifrostagainst: Cloudflare AI Gateway, OpenRouterApache APISIX, LiteLLMno first choiceagainst: Portkey
Four alternatives
Helicone, Inworld Router, Kong AI Gateway, LiteLLMFour alternatives
Braintrust Gateway, Helicone, Langfuse, LiteLLMFive alternatives
Kong AI Gateway, LangWatch, LiteLLM, Portkey, TrueFoundryTwo alternatives
Bifrost, Kong AI GatewayGrok 4.1 FastPortkeyLangSmithChangedno first choiceagainst: OpenRouterLiteLLMagainst: Kong AI Gateway, OpenRouterno first choiceagainst: Helicone, LiteLLM, OpenRouter, Portkey
Four alternatives
Bifrost, Cloudflare AI Gateway, Kong AI Gateway, LiteLLMSeven alternatives
Arize AI, Arize Phoenix, Datadog LLM Observability, Helicone, Langfuse, LiteLLM, PortkeyFive alternatives
Bifrost, Kong AI Gateway, LiteLLM, Portkey, Tetrate Agent Router EnterpriseOne alternative
PortkeyMistral SmallTetrate Agent Router Enterpriseagainst: LiteLLMHelicone, PortkeyChangedPortkeyBifrostno first choicenothing named
Two alternatives
Bifrost, Cloudflare AI GatewayTwo alternatives
Confident AI, OpenRouterSix alternatives
Cloudflare AI Gateway, Helicone, Kong AI Gateway, LiteLLM, OpenRouter, TrueFoundryOne alternative
LiteLLMDeepSeek V4 FlashPortkeyagainst: LiteLLM, OpenRouterLiteLLMChangedBifrost, Tetrate Agent Router EnterpriseBifrostagainst: OpenRouterLiteLLMagainst: Cloudflare AI Gateway, OpenRouter, Portkeyagainst: Amazon Bedrock, Apigee, Azure API Management, LiteLLM, OpenRouter, Portkey
Three alternatives
Bifrost, Kong AI Gateway, Tetrate Agent Router EnterpriseTwo alternatives
Helicone, PortkeySix alternatives
Cloudflare AI Gateway, Helicone, Kong AI Gateway, LiteLLM, OpenRouter, Portkey AI GatewayFour alternatives
LLMGateway.io, LiteLLM, Portkey, Solo.io Agent GatewayOne alternative
Kong AI GatewayLlama 4 MaverickBifrostno first choiceChangedno first choiceFuture AGI Agent Command Centerno first choiceagainst: Portkey
Three alternatives
Cloudflare AI Gateway, Kong AI Gateway, Tetrate Agent Router EnterpriseQwen 3.7 FlashKong AI Gateway, Portkeyagainst: Cloudflare AI GatewayPortkeyChangedLiteLLM, PortkeyLiteLLM, Portkeyno first choiceagainst: AWS Bedrock Native, Azure Machine Learning, Groq, LangChain, LlamaIndex, OpenRouter, Semantic Kernel
Two alternatives
Bifrost, LiteLLMTwo alternatives
Arize AI, HeliconeTwo alternatives
Arroy, OpenRouterOne alternative
Azure AI StudioKimi K2PortkeyLiteLLMChangedagainst: HeliconeTrueFoundry AI Gatewayagainst: LiteLLMLLM Gatewayagainst: Kong AI Gateway, PortkeyPortkeyagainst: AWS, Azure, Google Cloud native AI gateways, LiteLLM, OpenRouter
Four alternatives
Azure API Management with AI Gateway, Kong AI Gateway, LiteLLM, TrueFoundry GatewayTwo alternatives
Bifrost, PortkeyFive alternatives
Bifrost, Helicone AI Gateway, Kong AI Gateway, Portkey, Tetrate Agent Router EnterpriseOne alternative
LiteLLMFour alternatives
Kong AI Gateway, LiteLLM, Orq.ai, TrueFoundryGLM 4.7 FlashXPortkeyPortkeyHeldBifrostagainst: OpenRouterLiteLLMno first choiceagainst: Braintrust Gateway, LiteLLM, OpenRouter
Two alternatives
Kong AI Gateway, LiteLLMThree alternatives
Arize Phoenix, Datadog Agent Observability, LangSmithFour alternatives
Apigee, Kong AI Gateway, LiteLLM, PortkeyTwo alternatives
LLM Gateway, PortkeyMiniMax M2.5Bifrost, LLM GatewayPortkeyChangedBifrost, LiteLLMAzure OpenAI Serviceno first choicenothing named
Three alternatives
Cloudflare AI Gateway, Kong AI Gateway, LiteLLMTwo alternatives
Helicone, TrueFoundryThree alternatives
Cloudflare AI Gateway, Kong AI Gateway, VercelOne alternative
LiteLLMGPT-6 LunaLiteLLMagainst: Cloudflare AI Gateway, PortkeyLangSmith, LiteLLMChangedagainst: LangSmith's gatewayno first choiceLiteLLMno first choiceagainst: LiteLLM, OpenRouter
One alternative
Kong AI GatewayOne alternative
PortkeyFive alternatives
Azure API Management, Cloudflare AI Gateway, Kong AI Gateway, LiteLLM, PortkeyTwo alternatives
Kong AI Gateway, OpenRouterMuse Glimmer 30BKong AI Gateway, Portkey AI GatewayArize AX, Confident AIChangedLiteLLM, PortkeyBifrost, LiteLLMagainst: OpenRouterno first choiceagainst: AI/ML API, LiteLLM, OpenRouter, Together AI
Four alternatives
Bifrost, LiteLLM, Requesty, Tetrate Agent Router EnterpriseSix alternatives
Apica Flow, Arize Phoenix, Datadog LLM Observability, Dynatrace, Helicone, PortkeyFour alternatives
AWS Bedrock with Guardrails, BricksLLM, Kong AI Gateway, OpenRouterFour alternatives
Merge Gateway, Portkey, Truefoundry Enterprise AI Gateway, innFactory AI GatewayBold is the first choiceAlternatives are counted; the count opens them.What the answer argued against
The record
One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency. Full answer text is in the free responses file. Download the record
Eighty-four rows: every prompt, every model, every answer.
| Prompt | Model | Version string | Time (UTC) | Searched | Sources | Latency |
|---|---|---|---|---|---|---|
| Direct recommendation | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 12:18 | yes | 9 | 8 s |
| Direct recommendation | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 07:49 | yes | 4 | 7 s |
| Direct recommendation | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 09:22 | yes | 12 | 21 s |
| Direct recommendation | Perplexity Sonar | sonar | 2026-10-01 10:02 | yes | 26 | 3 s |
| Direct recommendation | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 09:46 | yes | 22 | 7 s |
| Direct recommendation | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 08:48 | yes | 5 | 3 s |
| Direct recommendation | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 13:44 | yes | 24 | 33 s |
| Direct recommendation | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 09:54 | yes | 5 | 2 s |
| Direct recommendation | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 11:12 | yes | 14 | 31 s |
| Direct recommendation | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 09:34 | yes | 14 | 24 s |
| Direct recommendation | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 12:59 | yes | 24 | 55 s |
| Direct recommendation | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 09:29 | yes | 10 | 23 s |
| Direct recommendation | GPT-6 Luna | gpt-6-luna | 2026-10-01 13:44 | yes | 4 | 32 s |
| Direct recommendation | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 13:45 | yes | 14 | 28 s |
| Paraphrase | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 10:09 | yes | 16 | 9 s |
| Paraphrase | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 11:56 | yes | 2 | 5 s |
| Paraphrase | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 13:20 | yes | 11 | 24 s |
| Paraphrase | Perplexity Sonar | sonar | 2026-10-01 08:01 | yes | 17 | 3 s |
| Paraphrase | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 09:21 | yes | 24 | 13 s |
| Paraphrase | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 11:06 | yes | 5 | 4 s |
| Paraphrase | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 10:09 | yes | 23 | 24 s |
| Paraphrase | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 08:02 | yes | 5 | 2 s |
| Paraphrase | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 08:19 | no | 0 | 40 s |
| Paraphrase | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 10:43 | yes | 20 | 41 s |
| Paraphrase | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 09:15 | yes | 25 | 37 s |
| Paraphrase | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 09:43 | yes | 10 | 11 s |
| Paraphrase | GPT-6 Luna | gpt-6-luna | 2026-10-01 09:41 | yes | 4 | 20 s |
| Paraphrase | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 12:57 | yes | 14 | 26 s |
| Comparative | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 12:55 | yes | 16 | 11 s |
| Comparative | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 10:16 | yes | 4 | 8 s |
| Comparative | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 11:35 | yes | 14 | 25 s |
| Comparative | Perplexity Sonar | sonar | 2026-10-01 08:10 | yes | 19 | 5 s |
| Comparative | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 08:58 | yes | 20 | 9 s |
| Comparative | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 11:33 | yes | 15 | 9 s |
| Comparative | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 09:56 | yes | 25 | 41 s |
| Comparative | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 10:22 | yes | 5 | 2 s |
| Comparative | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 12:28 | no | 0 | 33 s |
| Comparative | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 09:38 | yes | 24 | 31 s |
| Comparative | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 09:20 | yes | 24 | 183 s |
| Comparative | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 09:05 | yes | 13 | 27 s |
| Comparative | GPT-6 Luna | gpt-6-luna | 2026-10-01 09:18 | yes | 5 | 26 s |
| Comparative | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 10:13 | yes | 15 | 27 s |
| Budget constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 07:27 | yes | 18 | 10 s |
| Budget constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 11:15 | yes | 3 | 7 s |
| Budget constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 07:50 | yes | 16 | 25 s |
| Budget constrained | Perplexity Sonar | sonar | 2026-10-01 08:27 | yes | 20 | 4 s |
| Budget constrained | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 11:15 | yes | 22 | 11 s |
| Budget constrained | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 08:51 | yes | 15 | 25 s |
| Budget constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 08:45 | yes | 21 | 22 s |
| Budget constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 09:23 | yes | 5 | 3 s |
| Budget constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 11:58 | no | 0 | 41 s |
| Budget constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 11:00 | yes | 23 | 25 s |
| Budget constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 13:23 | yes | 25 | 69 s |
| Budget constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 08:57 | yes | 20 | 51 s |
| Budget constrained | GPT-6 Luna | gpt-6-luna | 2026-10-01 12:36 | yes | 4 | 16 s |
| Budget constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 08:47 | yes | 24 | 39 s |
| Scale constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 12:39 | no | 0 | 6 s |
| Scale constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 11:18 | yes | 0 | 13 s |
| Scale constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 10:13 | no | 0 | 16 s |
| Scale constrained | Perplexity Sonar | sonar | 2026-10-01 10:50 | yes | 16 | 4 s |
| Scale constrained | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 08:45 | yes | 18 | 9 s |
| Scale constrained | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 08:09 | no | 0 | 9 s |
| Scale constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 10:54 | yes | 25 | 55 s |
| Scale constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 12:55 | yes | 5 | 2 s |
| Scale constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 08:12 | yes | 10 | 33 s |
| Scale constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 11:57 | yes | 22 | 33 s |
| Scale constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 08:35 | yes | 15 | 38 s |
| Scale constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 08:05 | yes | 10 | 13 s |
| Scale constrained | GPT-6 Luna | gpt-6-luna | 2026-10-01 12:26 | yes | 2 | 25 s |
| Scale constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 12:22 | yes | 12 | 23 s |
| Negative framing | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 09:53 | yes | 19 | 8 s |
| Negative framing | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 10:30 | yes | 5 | 6 s |
| Negative framing | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 08:21 | yes | 18 | 23 s |
| Negative framing | Perplexity Sonar | sonar | 2026-10-01 11:48 | yes | 19 | 5 s |
| Negative framing | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 11:13 | yes | 24 | 8 s |
| Negative framing | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 13:09 | yes | 5 | 5 s |
| Negative framing | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 08:31 | yes | 24 | 37 s |
| Negative framing | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 13:15 | yes | 5 | 2 s |
| Negative framing | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 12:41 | no | 0 | 42 s |
| Negative framing | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 08:12 | yes | 24 | 24 s |
| Negative framing | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 10:05 | yes | 24 | 111 s |
| Negative framing | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 10:57 | yes | 10 | 31 s |
| Negative framing | GPT-6 Luna | gpt-6-luna | 2026-10-01 12:04 | yes | 3 | 27 s |
| Negative framing | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 12:07 | yes | 19 | 39 s |
Normalization in this category
Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.
ShowHide
Category-scoped readings
Braintrust read as Braintrust Gateway
Cloudflare read as Cloudflare AI Gateway
Datadog read as Datadog LLM Observability
Kong read as Kong AI Gateway
Tetrate read as Tetrate Agent Router Enterprise
Unresolved, counted raw
AI/ML API
AWS Bedrock Native
AWS Bedrock with Guardrails
AWS, Azure, Google Cloud native AI gateways
Apica Flow
Arroy
Azure AI Studio
Azure API Management AI Gateway
Azure API Management with AI Gateway
Datadog Agent Observability
Future AGI Agent Command Center
Google Cloud's Vertex AI with safety filters
Harmonic
LLM Gateway open-source
LangSmith's gateway
LangWatch
LlamaIndex
Maxim Bifrost
NeMo Guardrails
PromptArmor
Semantic Kernel
Solo.io Agent Gateway
Solo.io agentgateway
TrueFoundry Gateway
Truefoundry Enterprise AI Gateway
innFactory AI Gateway
nRouter
Discontinued, still offered
No shut-down product was recommended here.