LLM gateways and observability
Asked as “LLM gateway”, and as “LLM observability and routing platform”, on behalf of a mid-market B2B company. 54 first choices recorded across the direct, paraphrase, budget and scale prompts, fourteen models each.
Standing · first-choice share
31LiteLLM31Portkey09OpenRouter28others
31% of first choices, contested.
Since September 2026▼−4Since September 2026: 38% → 33%, −4 points. Inside the 11-point floor: within noise. Read over the models both editions asked.LiteLLM held the lead, −4 points on 38%, inside the 11-point floor.
By buyer segment
The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.
Small business
LiteLLM31%Contested↗new leaderNew leader since September 2026: Portkey (30%) replaces LiteLLM (46% then, 30% now), 0 points clear, inside the 11-point floor.Standing →Mid-marketLiteLLM31%Contested▼−4Since September 2026: 38% → 33%, −4 points. Inside the 11-point floor: within noise. Read over the models both editions asked.This pageEnterprise
Portkey26%Contested↗new leaderNew leader since September 2026: Portkey (32%) replaces LiteLLM (29% then, 23% now), 9 points clear, inside the 11-point floor.Standing →
LiteLLM31%Contested↗new leaderNew leader since September 2026: Portkey (30%) replaces LiteLLM (46% then, 30% now), 0 points clear, inside the 11-point floor.Standing →Mid-marketLiteLLM31%Contested▼−4Since September 2026: 38% → 33%, −4 points. Inside the 11-point floor: within noise. Read over the models both editions asked.This pageEnterprisePortkey26%Contested↗new leaderNew leader since September 2026: Portkey (32%) replaces LiteLLM (29% then, 23% now), 9 points clear, inside the 11-point floor.Standing →The standing
Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all fourteen models, for a mid-market B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrantSince September 2026
01LiteLLM31%16%58endorsed leader▼−4Since September 2026: 38% → 33%, −4 points. Inside the 11-point floor: within noise. Read over the models both editions asked.38% → 33%
LiteLLM31%16%58endorsed leader▼−4Since September 2026: 38% → 33%, −4 points. Inside the 11-point floor: within noise. Read over the models both editions asked.38% → 33%02Portkey31%11%53endorsed leader=heldSince September 2026: 29% → 29%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.29% → 29%
Portkey31%11%53endorsed leader=heldSince September 2026: 29% → 29%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.29% → 29%03
OpenRouter9%17%42accepted challenger▲+8Since September 2026: 2% → 10%, +8 points. Inside the 11-point floor: within noise. Read over the models both editions asked.2% → 10%
OpenRouter9%17%42accepted challenger▲+8Since September 2026: 2% → 10%, +8 points. Inside the 11-point floor: within noise. Read over the models both editions asked.2% → 10%04
Helicone6%15%27accepted challenger▼−3Since September 2026: 9% → 6%, −3 points. Inside the 11-point floor: within noise. Read over the models both editions asked.9% → 6%
Helicone6%15%27accepted challenger▼−3Since September 2026: 9% → 6%, −3 points. Inside the 11-point floor: within noise. Read over the models both editions asked.9% → 6%05
Bifrost4%8%24accepted challenger▲+4Since September 2026: 0% → 4%, +4 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 4%
Bifrost4%8%24accepted challenger▲+4Since September 2026: 0% → 4%, +4 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 4%06
Cloudflare AI Gateway2%3%29accepted challenger▼−2Since September 2026: 2% → 0%, −2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.2% → 0%
Cloudflare AI Gateway2%3%29accepted challenger▼−2Since September 2026: 2% → 0%, −2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.2% → 0%Show the two products at 0%, ordered by negative rate
07
Kong AI Gateway0%7%29accepted challenger▼−2Since September 2026: 2% → 0%, −2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.2% → 0%
Kong AI Gateway0%7%29accepted challenger▼−2Since September 2026: 2% → 0%, −2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.2% → 0%08
Langfuse0%0%10accepted challenger▼−9Since September 2026: 9% → 0%, −9 points. Inside the 11-point floor: within noise. Read over the models both editions asked.9% → 0%
Langfuse0%0%10accepted challenger▼−9Since September 2026: 9% → 0%, −9 points. Inside the 11-point floor: within noise. Read over the models both editions asked.9% → 0%The floor is 11 points of share, measured: how far the models move a leader on their own when the same questions are asked twice with nothing changed. A larger change is movement; a smaller one is noise, and both are shown. Movement is read over the twelve models both editions asked; GPT-6 Luna, Muse Glimmer 30B joined this edition and are in the standing but not yet in the comparison. How the floor is measured
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its product page.
All fifteen head-to-head pages: the top six products, each against each
LiteLLM vs BifrostLiteLLM vs Cloudflare AI GatewayPortkey vs OpenRouterPortkey vs HeliconePortkey vs BifrostPortkey vs Cloudflare AI GatewayOpenRouter vs HeliconeOpenRouter vs BifrostOpenRouter vs Cloudflare AI GatewayHelicone vs BifrostHelicone vs Cloudflare AI GatewayBifrost vs Cloudflare AI Gateway
Recommended versus criticized
Every product with at least 10 labels here, on both axes. The 30% line names a quadrant, not the verdict above: that one needs more than 40%.
Criticized challengerCriticized default
Negative label rate →
0102030405060708Accepted challengerEndorsed leader
0%First-choice share → · lines at 30% share and 25% negative50%
Key
01LiteLLM31%
LiteLLM31%02Portkey31%
Portkey31%03OpenRouter9%
OpenRouter9%04Helicone6%
Helicone6%05Bifrost4%
Bifrost4%06Cloudflare AI Gateway2%
Cloudflare AI Gateway2%07Kong AI Gateway0%
Kong AI Gateway0%08Langfuse0%
Langfuse0%What they warned about
Five of fourteen models held their first choice under the paraphrase. GPT-5.4 mini, Gemini 3.5 Flash, Grok 4.1 Fast, Mistral Small, DeepSeek V4 Flash, Qwen 3.7 Flash, GLM 4.7 FlashX, MiniMax M2.5 and GPT-6 Luna changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
LiteLLM16%
9 of 58 labels negative · 8 of 14 models · 3 hard negative
“High Caution/Avoid if Possible: **LiteLLM (especially older/self-hosted versions)**: Suffered a major supply chain attack” Grok 4.1 Fast, negative prompt
OpenRouter17%
7 of 42 labels negative · 6 of 14 models · 2 hard negative
“It is considered a high-risk option for data residency as its default catalog includes Chinese-hosted models.” Llama 4 Maverick, negative prompt
Portkey11%
6 of 53 labels negative · 6 of 14 models · 1 hard negative
“avoid Portkey hosted** due to CVEs and black-box concerns” DeepSeek V4 Flash, negative prompt
Helicone15%
4 of 27 labels negative · 3 of 14 models · 2 hard negative
“What I'd Avoid... **Helicone** | In maintenance mode since Mintlify acquisition” Kimi K2, paraphrase prompt
What they cite
Citations exist only for the models that return a source list: fourteen of the fourteen in this edition, and all six flagship models on the expanded tier.
Sites the answers cite
77 of 84 answers in this category came back with a source list, from 14 of 14 models: citations where the model returns them, or the search results it consulted. 1084 links across 242 sites, every framing counted. Ranked by the number of answers carrying the site or page. 37 of the 252 answers across every segment cited this index's own page for the category; the method page measures whether that reading tilts an answer.
40 answers · 85 citations · 12 models
vendor site · OpenRouter39 answers · 54 citations · 11 models
29 answers · 41 citations · 12 models
vendor site · Respan27 answers · 27 citations · 11 models
vendor site · CloudZero25 answers · 25 citations · 10 models
vendor site · TrueFoundry23 answers · 33 citations · 11 models
vendor site · Portkey21 answers · 48 citations · 11 models
vendor site · Dataiku17 answers · 17 citations · 8 models
vendor site · Braintrust16 answers · 22 citations · 9 models
vendor site · Orq.ai16 answers · 17 citations · 9 models
vendor site · Contabo15 answers · 16 citations · 7 models
vendor site · Arize14 answers · 20 citations · 8 models
Pages the answers cite
The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.
36 answers · 10 models
25 answers · 10 models
25 answers · 11 models
16 answers · 7 models
15 answers · 8 models
13 answers · 7 models
13 answers · 6 models
13 answers · 8 models
13 answers · 9 models
12 answers · 7 models
Search against answers
Each company's standing in the answers beside its site's footprint in Google search, one row a site: the products the models named on it with their shares, and the share they add up to; monthly searches on Google, and DataForSEO's estimate of AI search demand (modeled from search signals, directional, not a count of queries to any assistant), for the most-searched of the company's and its products' names (the name is in each row's hover text); estimated monthly organic visits to the site; and its best position in Google's top ten for “best llm gateway”, “llm gateway”, “llm gateways”. US estimates from DataForSEO and Google's Ads Transparency Center. A small company's site, or a mid-sized company's site for its flagship, is marked company; a product on a large parent's site (Google, Microsoft) has no site figures. A column with no figures for this category is left out, and an empty cell means none were seen, not none exist. Two measurements side by side: neither is read as the cause of the other.
| Company and products | Share | Own site cited | Name searches, Google | AI search demand, est. | Organic visits | Google ads, last 30 days | Best Google position |
|---|---|---|---|---|---|---|---|
| Portkey portkey.ai Portkey 31%, Portkey AI Gateway 4% | 35% | 167 | 5,400 | 131 | 5,999 | 0 | 5 |
| LiteLLM litellm.ai | 31% | 189 | 22,200 | 264 | 15,281 | 0 | 2 |
| OpenRouter openrouter.ai | 9% | 122 | 135,000 | 655 | 225,878 | 68 | 7 |
| Helicone helicone.ai | 6% | 77 | 1,600 | 899 | 2,439 | 0 | |
| Bifrost getmaxim.ai | 4% | 93 | 12,100 | 427 | 4,289 | 10 | 8 |
| Cloudflare parent site Cloudflare AI Gateway 2% | 2% | 77 | 550,000 | 10,897 | |||
| Nexos.ai nexos.ai | 2% | 7 | |||||
| Gateway-LLM gateway-llm.com | 2% | 3 | |||||
| Apache APISIX apache.org | 2% | 75 | 260 | 6 | 1,144,025 | 0 | |
| LangSmith langchain.com | 2% | 14 | 14,800 | 238 | 93,424 | 94 |
Google's top ten for the three searches hold 18 sites; 8 of them are among the sites the models cited here (braintrust.dev, dataiku.com, dev.to, getmaxim.ai, openrouter.ai, orq.ai, portkey.ai, truefoundry.com). The first result for “best llm gateway” is reddit.com.
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.ShowHide
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ShowHideModelDirect“What is the best LLM gateway for a mid-market B2B company?”Paraphrase“Which LLM observability and routing platform would you recommend to a mid-sized B2B company?”Comparative“What are the top LLM gateways and how do they differ?”Budget-constrained“What is the best LLM gateway for a company with a limited budget?”Scale-constrained“We are a 500 person company evaluating a LLM gateway. What should we look at?”Negative“Which LLM gateways should I avoid or be cautious about?”
Claude Haiku 4.5PortkeyPortkeyHeldBifrostLiteLLMno first choicenothing named
Four alternatives
Bifrost, LiteLLM, Nexos.ai, OpenRouterThree alternatives
Confident AI, Langfuse, TrueFoundryFive alternatives
Cloudflare AI Gateway, Kong AI Gateway, LiteLLM, OpenRouter, PortkeyTwo alternatives
Cloudflare AI Gateway, OpenRouterGPT-5.4 miniLiteLLMLangSmith, OpenRouterChangedKong AI Gateway, LiteLLMagainst: Unify AILiteLLMagainst: Portkeyno first choicenothing named
One alternative
PortkeyThree alternatives
LangSmith’s LLM Gateway, LiteLLM, PortkeyThree alternatives
Helicone, OpenRouter, PortkeyOne alternative
OpenRouterGemini 3.5 FlashLiteLLMLiteLLM, PortkeyChangedBifrost, LiteLLMLiteLLMLiteLLM OSS, Portkeyagainst: Cloudflare AI Gatewayagainst: LiteLLM, Martian's model router, OneAPI
Three alternatives
Bifrost, Cloudflare AI Gateway, PortkeyTwo alternatives
Braintrust Gateway, LangfuseFive alternatives
Cloudflare AI Gateway, Kong AI Gateway, Lunar.dev, OpenRouter, PortkeyTwo alternatives
Cloudflare AI Gateway, OpenRouterTwo alternatives
Braintrust Gateway, Kong AI GatewayPerplexity SonarPortkeyagainst: OpenRouterPortkeyHeldno first choiceLiteLLM, OpenRouteragainst: Portkeyno first choicenothing named
Two alternatives
Bifrost, LiteLLMTwo alternatives
Braintrust Gateway, HeliconeGrok 4.1 FastPortkey AI GatewayPortkeyChangedagainst: Datadog LLM Observability, Helicone, SplunkLiteLLM, OpenRouter, PortkeyLiteLLMagainst: Portkeyno first choiceagainst: LiteLLM
Three alternatives
Bifrost, Cloudflare AI Gateway, LiteLLMFour alternatives
LangSmith, Langfuse, LiteLLM, PostHogTwo alternatives
Braintrust Gateway, HeliconeThree alternatives
Bifrost, Cloudflare AI Gateway, OpenRouterThree alternatives
Bifrost, LiteLLM, PortkeyMistral SmallNexos.aiHelicone, LiteLLMChangedno first choiceLiteLLM, OpenRouterno first choiceagainst: Bifrost
One alternative
Cloudflare AI GatewayThree alternatives
Langfuse, OpenRouter, PortkeyThree alternatives
Cloudflare AI Gateway, Helicone, PortkeyDeepSeek V4 FlashPortkeyPortkey AI GatewayChangedagainst: Arize, Datadog LLM Observability, Helicone, LangSmith, New RelicLiteLLM, OpenRouteragainst: Bifrost, Merge GatewayLiteLLMno first choiceagainst: Helicone, LiteLLM, OpenRouter, Portkey
Three alternatives
Helicone, LiteLLM, OpenRouterOne alternative
LangfuseFive alternatives
Cloudflare AI Gateway, Envoy AI Gateway, Kong AI Gateway, Portkey, Vercel AI GatewayTwo alternatives
OpenRouter, PortkeyLlama 4 Maverickno first choiceno first choiceHeldno first choiceApache APISIX, Bifrost, LiteLLMno first choiceagainst: Kong AI Gateway, LiteLLM, OpenRouter, Portkey
Two alternatives
OpenRouter, Orq.ai RouterQwen 3.7 FlashPortkeyHeliconeChangedHeliconeLiteLLMno first choiceagainst: LiteLLM, Small/Unknown Third-Party LLM Routers
Three alternatives
Amazon Bedrock, Azure AI, LiteLLMTwo alternatives
Arize AI, LangSmithThree alternatives
Arize AI, Portkey, RequestyOne alternative
BifrostKimi K2PortkeyPortkeyHeldagainst: Braintrust Gateway, Helicone, LangSmith, LiteLLMLiteLLMBifrost, LiteLLMagainst: Kong AI Gateway, OpenRouter, Requestyno first choiceagainst: LiteLLM
Three alternatives
Cloudflare AI Gateway, Kong AI Gateway, LiteLLMOne alternative
LangfuseSix alternatives
Bifrost, Cloudflare AI Gateway, Kong AI Gateway, OpenRouter, Portkey, TrueFoundryTwo alternatives
Gateway-LLM, LLM GatewayGLM 4.7 FlashXOpenRouter, PortkeyPortkeyChangedLiteLLM, OpenRouterLiteLLM, OpenRouterno first choicenothing named
Two alternatives
Kong AI Gateway, LiteLLMTwo alternatives
Arize, LangfuseTwo alternatives
Bifrost, Cloudflare AI GatewayOne alternative
PortkeyMiniMax M2.5Helicone, Portkey.aiPortkeyChangedno first choiceGateway-LLM, LiteLLMno first choiceagainst: LiteLLM, Portkey
Two alternatives
Cloudflare AI Gateway, Kong AI GatewayTwo alternatives
Helicone, LiteLLMOne alternative
OpenRouterGPT-6 LunaPortkey, now branded PRISMA AIRS AI GatewayPortkeyChangedLiteLLM, PortkeyCloudflare AI Gatewayagainst: OpenRouterno first choiceagainst: LiteLLM, OpenRouter
Two alternatives
Cloudflare AI Gateway, LiteLLMThree alternatives
Helicone, Langfuse, LiteLLMFour alternatives
Cloudflare AI Gateway, Kong AI Gateway, OpenRouter, Vercel AI GatewayOne alternative
LiteLLMMuse Glimmer 30BPortkeyPortkeyHeldLiteLLM, OpenRouterLiteLLMno first choiceagainst: OpenRouter
Two alternatives
LiteLLM, OpenRouterTwo alternatives
Helicone, LangfuseEight alternatives
Bifrost, Cloudflare AI Gateway, Fireworks AI, Helicone, Portkey, Requesty, Together AI, TrueFoundryOne alternative
OpenRouterTwo alternatives
Kong AI Gateway, PortkeyBold is the first choiceAlternatives are counted; the count opens them.What the answer argued against
The record
One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency. Full answer text is in the free responses file. Download the record
Eighty-four rows: every prompt, every model, every answer.
| Prompt | Model | Version string | Time (UTC) | Searched | Sources | Latency |
|---|---|---|---|---|---|---|
| Direct recommendation | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 11:54 | yes | 15 | 9 s |
| Direct recommendation | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 12:59 | yes | 2 | 6 s |
| Direct recommendation | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 13:00 | yes | 10 | 26 s |
| Direct recommendation | Perplexity Sonar | sonar | 2026-10-01 11:28 | yes | 16 | 4 s |
| Direct recommendation | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 12:50 | yes | 24 | 9 s |
| Direct recommendation | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 07:49 | yes | 5 | 2 s |
| Direct recommendation | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 11:53 | yes | 24 | 22 s |
| Direct recommendation | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 12:48 | yes | 5 | 2 s |
| Direct recommendation | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 12:13 | no | 0 | 27 s |
| Direct recommendation | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 11:11 | yes | 25 | 22 s |
| Direct recommendation | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 13:28 | yes | 24 | 223 s |
| Direct recommendation | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 11:52 | yes | 9 | 34 s |
| Direct recommendation | GPT-6 Luna | gpt-6-luna | 2026-10-01 08:35 | yes | 4 | 19 s |
| Direct recommendation | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 13:18 | yes | 22 | 33 s |
| Paraphrase | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 07:56 | yes | 15 | 9 s |
| Paraphrase | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 10:00 | yes | 3 | 6 s |
| Paraphrase | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 10:15 | yes | 14 | 25 s |
| Paraphrase | Perplexity Sonar | sonar | 2026-10-01 12:13 | yes | 20 | 3 s |
| Paraphrase | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 12:27 | yes | 25 | 8 s |
| Paraphrase | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 09:19 | yes | 8 | 7 s |
| Paraphrase | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 10:00 | yes | 25 | 34 s |
| Paraphrase | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 09:44 | yes | 5 | 2 s |
| Paraphrase | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 10:55 | no | 0 | 35 s |
| Paraphrase | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 13:09 | yes | 25 | 22 s |
| Paraphrase | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 08:36 | yes | 25 | 248 s |
| Paraphrase | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 08:26 | yes | 20 | 31 s |
| Paraphrase | GPT-6 Luna | gpt-6-luna | 2026-10-01 11:40 | yes | 4 | 21 s |
| Paraphrase | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 13:28 | yes | 18 | 29 s |
| Comparative | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 13:43 | yes | 17 | 9 s |
| Comparative | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 12:23 | yes | 6 | 9 s |
| Comparative | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 11:04 | yes | 14 | 27 s |
| Comparative | Perplexity Sonar | sonar | 2026-10-01 11:25 | yes | 19 | 6 s |
| Comparative | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 09:04 | yes | 19 | 7 s |
| Comparative | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 10:41 | yes | 9 | 7 s |
| Comparative | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 08:52 | yes | 22 | 58 s |
| Comparative | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 07:46 | yes | 5 | 1 s |
| Comparative | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 12:13 | yes | 5 | 23 s |
| Comparative | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 10:07 | yes | 14 | 19 s |
| Comparative | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 08:47 | yes | 25 | 37 s |
| Comparative | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 11:16 | yes | 9 | 36 s |
| Comparative | GPT-6 Luna | gpt-6-luna | 2026-10-01 07:27 | yes | 6 | 24 s |
| Comparative | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 08:30 | yes | 15 | 40 s |
| Budget constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 12:21 | yes | 9 | 7 s |
| Budget constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 13:08 | yes | 2 | 3 s |
| Budget constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 10:48 | yes | 12 | 23 s |
| Budget constrained | Perplexity Sonar | sonar | 2026-10-01 10:55 | yes | 19 | 2 s |
| Budget constrained | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 12:27 | yes | 21 | 6 s |
| Budget constrained | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 13:23 | yes | 10 | 6 s |
| Budget constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 11:16 | yes | 21 | 30 s |
| Budget constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 10:56 | yes | 8 | 2 s |
| Budget constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 10:02 | yes | 5 | 17 s |
| Budget constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 10:18 | yes | 10 | 16 s |
| Budget constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 08:24 | yes | 25 | 271 s |
| Budget constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 08:05 | yes | 10 | 13 s |
| Budget constrained | GPT-6 Luna | gpt-6-luna | 2026-10-01 11:45 | yes | 4 | 13 s |
| Budget constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 09:52 | yes | 12 | 19 s |
| Scale constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 10:12 | no | 0 | 7 s |
| Scale constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 09:39 | no | 0 | 8 s |
| Scale constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 13:27 | yes | 14 | 24 s |
| Scale constrained | Perplexity Sonar | sonar | 2026-10-01 09:16 | yes | 17 | 4 s |
| Scale constrained | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 12:25 | yes | 17 | 9 s |
| Scale constrained | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 09:09 | no | 0 | 8 s |
| Scale constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 13:21 | yes | 22 | 39 s |
| Scale constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 08:28 | yes | 5 | 2 s |
| Scale constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 09:16 | no | 0 | 40 s |
| Scale constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 09:38 | yes | 8 | 17 s |
| Scale constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 12:51 | yes | 15 | 21 s |
| Scale constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 08:15 | yes | 5 | 14 s |
| Scale constrained | GPT-6 Luna | gpt-6-luna | 2026-10-01 09:34 | yes | 4 | 28 s |
| Scale constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 13:14 | yes | 15 | 25 s |
| Negative framing | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 08:50 | no | 0 | 4 s |
| Negative framing | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 13:21 | yes | 6 | 7 s |
| Negative framing | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 13:42 | yes | 22 | 28 s |
| Negative framing | Perplexity Sonar | sonar | 2026-10-01 09:06 | yes | 19 | 3 s |
| Negative framing | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 10:35 | yes | 24 | 8 s |
| Negative framing | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 11:11 | yes | 5 | 4 s |
| Negative framing | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 09:18 | yes | 25 | 37 s |
| Negative framing | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 09:22 | yes | 5 | 2 s |
| Negative framing | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 13:07 | yes | 20 | 54 s |
| Negative framing | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 08:54 | yes | 25 | 26 s |
| Negative framing | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 13:17 | yes | 24 | 103 s |
| Negative framing | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 12:39 | yes | 18 | 23 s |
| Negative framing | GPT-6 Luna | gpt-6-luna | 2026-10-01 12:18 | yes | 2 | 24 s |
| Negative framing | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 11:43 | yes | 22 | 36 s |
Normalization in this category
Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.
ShowHide
Category-scoped readings
Braintrust read as Braintrust Gateway
Cloudflare read as Cloudflare AI Gateway
Datadog read as Datadog LLM Observability
Kong read as Kong AI Gateway
Kong AI read as Kong AI Gateway
Tetrate read as Tetrate Agent Router Enterprise
Unresolved, counted raw
AI Gateway for IBM API Connect
AI-gateway by GitLab
API Logic
Azure AI
LLMGateway
LMstudio
LangSmith’s LLM Gateway
LiteLLM OSS
Lunar.dev
MLflow AI Gateway
Martian's model router
Microsoft Foundry
OneAPI
Orq.ai Router
Portkey Gateway
Portkey, now branded PRISMA AIRS AI Gateway
Portkey.ai
Requesty.ai
Small/Unknown Third-Party LLM Routers
Wealthsimple LLM Gateway
aigateway.app
haimaker.ai
Discontinued, still offered
No shut-down product was recommended here.