LLM gateways and observability for small business buyers
Asked as “LLM gateway”, and as “LLM observability and routing platform”, on behalf of a small B2B company. 58 first choices recorded across the direct, paraphrase, budget and scale prompts, fourteen models each.
Standing · first-choice share
31%
Contested · Portkey 28%
31LiteLLM28Portkey21OpenRouter21others
31% of first choices, contested.
Since September 2026↗new leaderNew leader since September 2026: Portkey (30%) replaces LiteLLM (46% then, 30% now), 0 points clear, inside the 11-point floor.Portkey leads at 30%, replacing LiteLLM, which led at 46% and stands at 30% now: 0 points clear, inside the floor, so the swap reads as unsettled. The verdict moved from clear leader to contested.
By buyer segment
The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.
Small business
LiteLLM31%Contested↗new leaderNew leader since September 2026: Portkey (30%) replaces LiteLLM (46% then, 30% now), 0 points clear, inside the 11-point floor.This pageMid-marketLiteLLM31%Contested▼−4Since September 2026: 38% → 33%, −4 points. Inside the 11-point floor: within noise. Read over the models both editions asked.Standing →Enterprise
Portkey26%Contested↗new leaderNew leader since September 2026: Portkey (32%) replaces LiteLLM (29% then, 23% now), 9 points clear, inside the 11-point floor.Standing →
LiteLLM31%Contested↗new leaderNew leader since September 2026: Portkey (30%) replaces LiteLLM (46% then, 30% now), 0 points clear, inside the 11-point floor.This pageMid-marketLiteLLM31%Contested▼−4Since September 2026: 38% → 33%, −4 points. Inside the 11-point floor: within noise. Read over the models both editions asked.Standing →EnterprisePortkey26%Contested↗new leaderNew leader since September 2026: Portkey (32%) replaces LiteLLM (29% then, 23% now), 9 points clear, inside the 11-point floor.Standing →The standing
Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all fourteen models, for a small B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrantSince September 2026
01LiteLLM31%16%61endorsed leader▼−16Since September 2026: 46% → 30%, −16 points. Past the 11-point floor: movement. Read over the models both editions asked.46% → 30%
LiteLLM31%16%61endorsed leader▼−16Since September 2026: 46% → 30%, −16 points. Past the 11-point floor: movement. Read over the models both editions asked.46% → 30%02Portkey28%12%59accepted challenger▲+15Since September 2026: 15% → 30%, +15 points. Past the 11-point floor: movement. Read over the models both editions asked.15% → 30%
Portkey28%12%59accepted challenger▲+15Since September 2026: 15% → 30%, +15 points. Past the 11-point floor: movement. Read over the models both editions asked.15% → 30%03
OpenRouter21%11%53accepted challenger▲+10Since September 2026: 10% → 20%, +10 points. Inside the 11-point floor: within noise. Read over the models both editions asked.10% → 20%
OpenRouter21%11%53accepted challenger▲+10Since September 2026: 10% → 20%, +10 points. Inside the 11-point floor: within noise. Read over the models both editions asked.10% → 20%04
Cloudflare AI Gateway7%7%28accepted challenger▲+2Since September 2026: 4% → 6%, +2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.4% → 6%
Cloudflare AI Gateway7%7%28accepted challenger▲+2Since September 2026: 4% → 6%, +2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.4% → 6%05
Helicone5%15%34accepted challenger▼−4Since September 2026: 10% → 6%, −4 points. Inside the 11-point floor: within noise. Read over the models both editions asked.10% → 6%
Helicone5%15%34accepted challenger▼−4Since September 2026: 10% → 6%, −4 points. Inside the 11-point floor: within noise. Read over the models both editions asked.10% → 6%06
Bifrost2%15%20accepted challenger▲+2Since September 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 2%
Bifrost2%15%20accepted challenger▲+2Since September 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 2%Show the one product at 0%, ordered by negative rate
07
Kong AI Gateway0%24%21accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%
Kong AI Gateway0%24%21accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%The floor is 11 points of share, measured: how far the models move a leader on their own when the same questions are asked twice with nothing changed. A larger change is movement; a smaller one is noise, and both are shown. Movement is read over the twelve models both editions asked; GPT-6 Luna, Muse Glimmer 30B joined this edition and are in the standing but not yet in the comparison. How the floor is measured
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its product page.
All fifteen head-to-head pages: the top six products, each against each
LiteLLM vs BifrostLiteLLM vs Cloudflare AI GatewayPortkey vs OpenRouterPortkey vs HeliconePortkey vs BifrostPortkey vs Cloudflare AI GatewayOpenRouter vs HeliconeOpenRouter vs BifrostOpenRouter vs Cloudflare AI GatewayHelicone vs BifrostHelicone vs Cloudflare AI GatewayBifrost vs Cloudflare AI Gateway
Recommended versus criticized
Every product with at least 10 labels here, on both axes. The 30% line names a quadrant, not the verdict above: that one needs more than 40%.
Criticized challengerCriticized default
Negative label rate →
01020304050607Accepted challengerEndorsed leader
0%First-choice share → · lines at 30% share and 25% negative50%
Key
01LiteLLM31%
LiteLLM31%02Portkey28%
Portkey28%03OpenRouter21%
OpenRouter21%04Cloudflare AI Gateway7%
Cloudflare AI Gateway7%05Helicone5%
Helicone5%06Bifrost2%
Bifrost2%07Kong AI Gateway0%
Kong AI Gateway0%What they warned about
Four of fourteen models held their first choice under the paraphrase. Claude Haiku 4.5, GPT-5.4 mini, Gemini 3.5 Flash, Grok 4.1 Fast, Mistral Small, Llama 4 Maverick, Qwen 3.7 Flash, Kimi K2, GPT-6 Luna and Muse Glimmer 30B changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
LiteLLM16%
10 of 61 labels negative · 10 of 14 models · 4 hard negative
“**LiteLLM** – Widely used open‑source gateway, but there are **hundreds of publicly exposed LiteLLM servers** worldwide. Security concerns include...” GLM 4.7 FlashX, negative prompt
OpenRouter11%
6 of 53 labels negative · 6 of 14 models · 1 hard negative
“**Avoid using OpenRouter for any production workload involving sensitive data**” DeepSeek V4 Flash, negative prompt
Portkey12%
7 of 59 labels negative · 6 of 14 models · 1 hard negative
“Known for hidden costs and billing surprises... it has crashed and failed requests” Mistral Small, negative prompt
Helicone15%
5 of 34 labels negative · 5 of 14 models · 1 hard negative
“"Avoid depending on Helicone — it's now in maintenance mode"ic” Muse Glimmer 30B, negative prompt
What they cite
Citations exist only for the models that return a source list: fourteen of the fourteen in this edition, and all six flagship models on the expanded tier.
Sites the answers cite
78 of 84 answers in this category came back with a source list, from 14 of 14 models: citations where the model returns them, or the search results it consulted. 1074 links across 240 sites, every framing counted. Ranked by the number of answers carrying the site or page. 37 of the 252 answers across every segment cited this index's own page for the category; the method page measures whether that reading tilts an answer.
vendor site · OpenRouter39 answers · 56 citations · 12 models
vendor site · Dataiku32 answers · 32 citations · 11 models
31 answers · 44 citations · 12 models
30 answers · 50 citations · 11 models
vendor site · Respan28 answers · 33 citations · 12 models
vendor site · Portkey26 answers · 42 citations · 12 models
vendor site · CloudZero26 answers · 26 citations · 9 models
vendor site · TrueFoundry25 answers · 30 citations · 11 models
vendor site · LLMGateway.io22 answers · 28 citations · 9 models
21 answers · 22 citations · 11 models
21 answers · 21 citations · 11 models
vendor site · Helicone19 answers · 23 citations · 9 models
Pages the answers cite
The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.
36 answers · 11 models
30 answers · 11 models
26 answers · 9 models
23 answers · 12 models
21 answers · 11 models
17 answers · 10 models
17 answers · 9 models
16 answers · 9 models
16 answers · 9 models
11 answers · 4 models
Search against answers
Each company's standing in the answers beside its site's footprint in Google search, one row a site: the products the models named on it with their shares, and the share they add up to; monthly searches on Google, and DataForSEO's estimate of AI search demand (modeled from search signals, directional, not a count of queries to any assistant), for the most-searched of the company's and its products' names (the name is in each row's hover text); estimated monthly organic visits to the site; and its best position in Google's top ten for “best llm gateway”, “llm gateway”, “llm gateways”. US estimates from DataForSEO and Google's Ads Transparency Center. A small company's site, or a mid-sized company's site for its flagship, is marked company; a product on a large parent's site (Google, Microsoft) has no site figures. A column with no figures for this category is left out, and an empty cell means none were seen, not none exist. Two measurements side by side: neither is read as the cause of the other.
| Company and products | Share | Own site cited | Name searches, Google | AI search demand, est. | Organic visits | Google ads, last 30 days | Best Google position |
|---|---|---|---|---|---|---|---|
| LiteLLM litellm.ai | 31% | 189 | 22,200 | 264 | 15,281 | 0 | 2 |
| Portkey portkey.ai | 28% | 167 | 5,400 | 131 | 5,999 | 0 | 5 |
| OpenRouter openrouter.ai | 21% | 122 | 135,000 | 655 | 225,878 | 68 | 7 |
| Cloudflare parent site Cloudflare AI Gateway 7% | 7% | 77 | 550,000 | 10,897 | |||
| Helicone helicone.ai | 5% | 77 | 1,600 | 899 | 2,439 | 0 | |
| Bifrost getmaxim.ai | 2% | 93 | 12,100 | 427 | 4,289 | 10 | 8 |
| Vercel AI Gateway vercel.com | 2% | 14 | 2,400 | 26 | 141,210 | 26 | |
| LangSmith langchain.com | 2% | 14 | 14,800 | 238 | 93,424 | 94 | |
| FreeLLMAPI | 2% | ||||||
| LiteLLM self-hosted OSS | 2% |
Google's top ten for the three searches hold 18 sites; 7 of them are among the sites the models cited here (dataiku.com, dev.to, getmaxim.ai, llmgateway.io, openrouter.ai, portkey.ai, truefoundry.com). The first result for “best llm gateway” is reddit.com.
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.ShowHide
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ShowHideModelDirect“What is the best LLM gateway for a small B2B company?”Paraphrase“Which LLM observability and routing platform would you recommend to a small business that sells to other businesses?”Comparative“What are the top LLM gateways for a small team and how do they differ?”Budget-constrained“What is the best LLM gateway for a small company with a tight budget?”Scale-constrained“We are a 30 person company evaluating a LLM gateway. What should we look at?”Negative“Which LLM gateways should a small business avoid or be cautious about?”
Claude Haiku 4.5LiteLLM, OpenRouterPortkeyChangedOpenRouterLiteLLM, OpenRouterno first choiceagainst: Helicone, Kong AI Gateway, LiteLLM, Portkey, TrueFoundry
One alternative
HeliconeTwo alternatives
Braintrust Gateway, HeliconeTwo alternatives
Helicone, LiteLLMTwo alternatives
Braintrust Gateway, HeliconeGPT-5.4 miniLiteLLMPortkeyChangedLiteLLM, PortkeyLiteLLM self-hosted OSSno first choicenothing named
Two alternatives
Kong AI Gateway, PortkeyThree alternatives
Arize, Langfuse, LiteLLMThree alternatives
Helicone, Kong AI Gateway, OpenRouterTwo alternatives
Helicone, OpenRouterGemini 3.5 FlashLiteLLMPortkeyChangedLiteLLM, OpenRouteragainst: Cloudflare AI GatewayCloudflare AI GatewayPortkeyagainst: Amazon Bedrock, Apigee, Azure API Management, Bifrost, GCP Vertex AI, Kong AI Gateway, LiteLLM, OpenRouter, OpenZiti's *llm-gateway*, Portkey
Three alternatives
Bifrost, Cloudflare AI Gateway, PortkeyTwo alternatives
Helicone, LiteLLMTwo alternatives
Bifrost, PortkeyThree alternatives
LiteLLM, OpenRouter, PortkeyTwo alternatives
Cloudflare AI Gateway, LiteLLMPerplexity SonarPortkeyPortkeyHeldLiteLLM, OpenRouter, PortkeyOpenRouteragainst: Portkeyno first choiceagainst: Kong AI Gateway, LiteLLM, OpenRouter, Portkey
Two alternatives
Bifrost, LiteLLMTwo alternatives
Helicone, LangfuseOne alternative
Helicone AI GatewayOne alternative
LiteLLMGrok 4.1 FastLiteLLMHeliconeChangedLiteLLM, OpenRouterLiteLLMagainst: PortkeyLiteLLM, OpenRouter, Portkeyagainst: new-api, one-api
Three alternatives
OpenRouter, Portkey, Vercel AI GatewayFive alternatives
Braintrust Gateway, LangSmith, Langfuse, LiteLLM, PortkeyTwo alternatives
Helicone, PortkeyThree alternatives
Cloudflare AI Gateway, Helicone, OpenRouterOne alternative
HeliconeMistral SmallCloudflare AI GatewayPortkeyChangedOpenRouterBifrost, LiteLLMno first choiceagainst: Bifrost, Kong AI Gateway, LiteLLM, Portkey, TrueFoundry
Two alternatives
Dataiku, Vercel AI GatewayTwo alternatives
Braintrust Gateway, OpenRouterFour alternatives
Helicone, LiteLLM, Morph, PortkeyTwo alternatives
Apache APISIX, Kong AI GatewayDeepSeek V4 FlashLiteLLMagainst: Bifrost, Kong AI GatewayLiteLLMHeldagainst: LangSmithOpenRouterLiteLLMOpenRouteragainst: LiteLLM, OpenRouter
Two alternatives
OpenRouter, PortkeyThree alternatives
Helicone, Langfuse, PortkeyFour alternatives
Bifrost, Helicone, LiteLLM, PortkeyTwo alternatives
Cloudflare AI Gateway, OpenRouterThree alternatives
LiteLLM, Nexos.ai, PortkeyLlama 4 MaverickCloudflare AI Gatewayno first choiceChangedNexos.aiOpenRouterno first choiceagainst: Portkey
Two alternatives
Respan, VercelThree alternatives
Apica, Braintrust Gateway, Orq.aiThree alternatives
LiteLLM, OpenRouter, PortkeyThree alternatives
Helicone, Portkey, Vercel AI GatewayQwen 3.7 FlashPortkeyLangSmithChangedLiteLLM, PortkeyLiteLLMLiteLLMagainst: Helicone, LiteLLM, Ollama
Two alternatives
LiteLLM, OpenRouterTwo alternatives
Helicone, PortkeyTwo alternatives
Cloudflare AI Gateway, OpenRouterTwo alternatives
Cloudflare AI Gateway, OpenRouterTwo alternatives
OpenRouter, PortkeyKimi K2LiteLLMPortkeyChangedagainst: HeliconeOpenRouterHelicone, LiteLLMHelicone, Portkeyagainst: LiteLLM, OpenRouter
Two alternatives
Helicone, PortkeyTwo alternatives
LangSmith, LangfuseFour alternatives
Bifrost, Helicone, LiteLLM, PortkeyTwo alternatives
Bifrost OSS, OpenRouterOne alternative
LiteLLMGLM 4.7 FlashXPortkeyPortkeyHeldOpenRouterOpenRouterno first choiceagainst: LiteLLM, Ollama
Two alternatives
LLM Gateway, OpenRouterTwo alternatives
Langfuse, OpenRouterThree alternatives
LiteLLM, Portkey, Vercel AI GatewayThree alternatives
Groq, Hypereal AI, Together AIMiniMax M2.5OpenRouter, PortkeyOpenRouter, PortkeyHeldHelicone, OpenRouterFreeLLMAPI, OpenRouterno first choiceagainst: Helicone, LiteLLM
One alternative
LiteLLMTwo alternatives
Helicone, LangSmithThree alternatives
Cloudflare AI Gateway, LiteLLM, PortkeyOne alternative
LiteLLMGPT-6 LunaVercel AI GatewayPortkeyChangedCloudflare AI Gateway, Vercel AI GatewayCloudflare AI Gatewayno first choiceagainst: Cloudflare AI Gateway, LiteLLM, OpenRouter
Two alternatives
Cloudflare AI Gateway, LiteLLMOne alternative
LangfuseThree alternatives
LiteLLM, OpenRouter, PortkeyTwo alternatives
LiteLLM, OpenRouterMuse Glimmer 30BLiteLLM, OpenRouterLiteLLMChangedOpenRouterLiteLLM, OpenRouterno first choiceagainst: Helicone, OpenRouter
Two alternatives
OpenRouter, PortkeyThree alternatives
Cloudflare AI Gateway, LiteLLM, PortkeyTwo alternatives
Opper, PortkeyBold is the first choiceAlternatives are counted; the count opens them.What the answer argued against
The record
One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency. Full answer text is in the free responses file. Download the record
Eighty-four rows: every prompt, every model, every answer.
| Prompt | Model | Version string | Time (UTC) | Searched | Sources | Latency |
|---|---|---|---|---|---|---|
| Direct recommendation | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 12:21 | yes | 14 | 8 s |
| Direct recommendation | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 12:48 | yes | 3 | 7 s |
| Direct recommendation | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 11:21 | yes | 12 | 26 s |
| Direct recommendation | Perplexity Sonar | sonar | 2026-10-01 10:37 | yes | 17 | 2 s |
| Direct recommendation | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 12:36 | yes | 23 | 7 s |
| Direct recommendation | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 10:07 | yes | 5 | 3 s |
| Direct recommendation | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 10:36 | yes | 19 | 29 s |
| Direct recommendation | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 13:04 | yes | 5 | 2 s |
| Direct recommendation | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 12:02 | yes | 9 | 30 s |
| Direct recommendation | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 13:11 | yes | 13 | 18 s |
| Direct recommendation | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 12:16 | yes | 23 | 133 s |
| Direct recommendation | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 12:21 | yes | 5 | 22 s |
| Direct recommendation | GPT-6 Luna | gpt-6-luna | 2026-10-01 09:25 | yes | 3 | 17 s |
| Direct recommendation | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 09:09 | yes | 14 | 26 s |
| Paraphrase | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 12:06 | yes | 10 | 7 s |
| Paraphrase | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 09:46 | yes | 2 | 11 s |
| Paraphrase | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 10:39 | yes | 11 | 23 s |
| Paraphrase | Perplexity Sonar | sonar | 2026-10-01 12:42 | yes | 18 | 4 s |
| Paraphrase | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 13:42 | yes | 23 | 7 s |
| Paraphrase | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 10:07 | yes | 5 | 3 s |
| Paraphrase | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 12:57 | yes | 24 | 23 s |
| Paraphrase | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 11:12 | yes | 5 | 2 s |
| Paraphrase | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 08:31 | no | 0 | 29 s |
| Paraphrase | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 11:56 | yes | 19 | 22 s |
| Paraphrase | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 12:27 | yes | 25 | 61 s |
| Paraphrase | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 10:16 | yes | 8 | 62 s |
| Paraphrase | GPT-6 Luna | gpt-6-luna | 2026-10-01 09:14 | yes | 3 | 10 s |
| Paraphrase | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 08:34 | yes | 22 | 44 s |
| Comparative | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 08:10 | yes | 16 | 9 s |
| Comparative | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 10:27 | yes | 3 | 8 s |
| Comparative | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 10:08 | yes | 12 | 23 s |
| Comparative | Perplexity Sonar | sonar | 2026-10-01 07:59 | yes | 21 | 5 s |
| Comparative | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 08:21 | yes | 21 | 7 s |
| Comparative | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 12:28 | yes | 10 | 9 s |
| Comparative | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 10:13 | yes | 22 | 45 s |
| Comparative | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 10:07 | yes | 5 | 2 s |
| Comparative | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 09:05 | yes | 5 | 31 s |
| Comparative | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 12:06 | yes | 18 | 29 s |
| Comparative | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 08:06 | yes | 23 | 82 s |
| Comparative | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 11:29 | yes | 18 | 49 s |
| Comparative | GPT-6 Luna | gpt-6-luna | 2026-10-01 09:57 | yes | 6 | 21 s |
| Comparative | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 10:57 | yes | 15 | 23 s |
| Budget constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 12:30 | yes | 17 | 10 s |
| Budget constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 09:27 | yes | 4 | 4 s |
| Budget constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 09:34 | yes | 16 | 23 s |
| Budget constrained | Perplexity Sonar | sonar | 2026-10-01 11:58 | yes | 26 | 3 s |
| Budget constrained | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 13:11 | yes | 24 | 8 s |
| Budget constrained | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 09:31 | yes | 5 | 5 s |
| Budget constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 13:16 | yes | 19 | 31 s |
| Budget constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 11:10 | yes | 5 | 2 s |
| Budget constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 07:53 | yes | 20 | 47 s |
| Budget constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 07:42 | yes | 18 | 18 s |
| Budget constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 11:07 | yes | 23 | 120 s |
| Budget constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 11:15 | yes | 16 | 25 s |
| Budget constrained | GPT-6 Luna | gpt-6-luna | 2026-10-01 11:11 | yes | 4 | 14 s |
| Budget constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 12:48 | yes | 15 | 18 s |
| Scale constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 11:51 | no | 0 | 6 s |
| Scale constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 13:41 | no | 0 | 8 s |
| Scale constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 11:06 | yes | 13 | 24 s |
| Scale constrained | Perplexity Sonar | sonar | 2026-10-01 11:34 | yes | 17 | 6 s |
| Scale constrained | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 10:26 | yes | 13 | 8 s |
| Scale constrained | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 11:43 | no | 0 | 7 s |
| Scale constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 12:54 | yes | 21 | 41 s |
| Scale constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 12:46 | yes | 5 | 2 s |
| Scale constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 08:08 | no | 0 | 39 s |
| Scale constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 08:21 | yes | 13 | 19 s |
| Scale constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 08:40 | yes | 13 | 12 s |
| Scale constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 13:32 | yes | 5 | 13 s |
| Scale constrained | GPT-6 Luna | gpt-6-luna | 2026-10-01 12:18 | yes | 4 | 18 s |
| Scale constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 10:39 | no | 0 | 1 s |
| Negative framing | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 12:09 | yes | 18 | 9 s |
| Negative framing | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 11:39 | yes | 4 | 8 s |
| Negative framing | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 09:14 | yes | 14 | 32 s |
| Negative framing | Perplexity Sonar | sonar | 2026-10-01 08:27 | yes | 20 | 3 s |
| Negative framing | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 13:23 | yes | 22 | 9 s |
| Negative framing | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 11:54 | yes | 5 | 4 s |
| Negative framing | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 08:10 | yes | 25 | 25 s |
| Negative framing | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 11:38 | yes | 5 | 2 s |
| Negative framing | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 11:26 | yes | 15 | 46 s |
| Negative framing | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 11:11 | yes | 23 | 23 s |
| Negative framing | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 08:21 | yes | 24 | 61 s |
| Negative framing | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 11:11 | yes | 23 | 53 s |
| Negative framing | GPT-6 Luna | gpt-6-luna | 2026-10-01 10:37 | yes | 3 | 17 s |
| Negative framing | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 11:38 | yes | 22 | 49 s |
Normalization in this category
Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.
ShowHide
Category-scoped readings
Braintrust read as Braintrust Gateway
Cloudflare read as Cloudflare AI Gateway
Kong read as Kong AI Gateway
Unresolved, counted raw
Bifrost OSS
EdgeLabs
F5 AI Gateway
FreeLLMAPI
Google AI Studio
HuggingFace Inference
Hypereal AI
LiteLLM self-hosted OSS
Morph
OpenZiti's *llm-gateway*
Token360
new-api
one-api
Discontinued, still offered
No shut-down product was recommended here.