# LLM gateways and observability for small business buyers: what AI models recommend, September 2026

IT AI Recommendation Index, September 2026 Edition. Asked as "LLM gateway" and as "LLM observability and routing platform", six framings each, to twelve models with search on, on behalf of a small B2B company. Page: https://it-ai-index.com/it-data/llm-gateways-and-observability/smb/

**Standing:** LiteLLM leads with 46% of first choices; verdict clear leader. 52 first choices across the direct, paraphrase, budget and scale prompts.

## First-choice share

| # | Product | Share | Negative rate | Labels |
|---|---|---|---|---|
| 1 | LiteLLM | 46% | 14% | 57 |
| 2 | Portkey | 15% | 8% | 49 |
| 3 | OpenRouter | 10% | 9% | 43 |
| 4 | Helicone | 10% | 22% | 36 |
| 5 | Cloudflare AI Gateway | 4% | 7% | 27 |
| 6 | Bifrost | 0% | 15% | 13 |

## Each model's first choice on the direct prompt

- Claude Haiku 4.5: OpenRouter; alternatives Braintrust Gateway, Helicone, LiteLLM
- GPT-5.4 mini: LiteLLM; alternatives OpenRouter, Portkey
- Gemini 3.5 Flash: Portkey; alternatives Bifrost, Cloudflare AI Gateway, LiteLLM, OpenRouter
- Perplexity Sonar: LiteLLM; alternatives Bifrost, Cloudflare AI Gateway, OpenRouter, Portkey
- Grok 4.1 Fast: LiteLLM, OpenRouter; alternatives Portkey
- Mistral Small: Helicone, LiteLLM; alternatives Cloudflare AI Gateway
- DeepSeek V4 Flash: LiteLLM, Portkey; alternatives Cloudflare AI Gateway, OpenRouter
- Llama 4 Maverick: Helicone, LiteLLM
- Qwen 3.7 Flash: LiteLLM; alternatives OpenRouter, Portkey
- Kimi K2: LiteLLM, Portkey
- GLM 4.7 FlashX: LiteLLM; alternatives Portkey
- MiniMax M2.5: Helicone; alternatives LiteLLM, OpenRouter

## Sources the answers cite

66 of 72 answers came back with a source list, from 12 of 12 models. Sites named in the most answers:

- truefoundry.com: 37 answers, 51 citations
- braintrust.dev: 27 answers, 38 citations
- orq.ai: 27 answers, 29 citations
- techsy.io: 27 answers, 27 citations
- dev.to: 26 answers, 41 citations
- dataiku.com: 26 answers, 26 citations
- respan.ai: 25 answers, 27 citations
- getmaxim.ai: 24 answers, 45 citations

Pages named in the most answers:

- https://techsy.io/en/blog/best-llm-gateway-tools (27 answers)
- https://dataiku.com/blog/best-llm-gateways (26 answers)
- https://orq.ai/blog/best-llm-gateways (25 answers)
- https://truefoundry.com/blog/best-llm-gateways (25 answers)
- https://cloudzero.com/blog/llm-gateways (24 answers)
- https://respan.ai/articles/best-llm-gateways (23 answers)
- https://braintrust.dev/articles/best-llm-gateways-2026 (16 answers)
- https://contabo.com/blog/best-llm-gateways (14 answers)
- https://dev.to/debmckinney/we-evaluated-13-llm-gateways-for-production-heres-what-we-found-2dkm (14 answers)
- https://beri.net/article/best-llm-gateways-multi-provider-cost-control-2026 (11 answers)

## Warned against

- LiteLLM: 8 of 57 labels negative. "hundreds of publicly exposed LiteLLM servers (a popular open-source AI gateway) were accepting the default master key (`sk-1234`) or required no authentication at all" (Kimi K2, negative prompt)
- Helicone: 8 of 36 labels negative. "Acquired by Mintlify (2026); in maintenance mode with no new features/updates ... not future-proof for production." (Grok 4.1 Fast, negative prompt)
- OpenRouter: 4 of 43 labels negative. "No uptime SLA; auto-routing/fallbacks can silently send data to non-compliant providers ... risking data residency/GDPR issues" (Grok 4.1 Fast, negative prompt)
- Portkey: 4 of 49 labels negative. "Portkey – Hidden Costs & Design Gaps ... Billing surprise ... Higher latency" (MiniMax M2.5, negative prompt)

## Record

- Method: https://it-ai-index.com/methodology/
- Raw judge labels and full responses: https://it-ai-index.com/data/
- License: CC BY 4.0. Cite as IT AI Recommendation Index, September 2026 Edition, it-ai-index.com.