Five of fourteen models named Datadog first on the direct prompt; zero named PagerDuty AIOps. Datadog was named by thirteen of the fourteen models and PagerDuty AIOps by seven and Datadog carries 40 labels and PagerDuty AIOps 10, so the shares are not directly comparable.
Named in eight categories this edition.
Named in one category this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all fourteen models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the aiops platforms page.
| Model | Direct | Paraphrase | Comparative | Budget-constrained | Scale-constrained | Negative |
|---|---|---|---|---|---|---|
| Claude Haiku 4.5 | ||||||
| GPT-5.4 mini | ||||||
| Gemini 3.5 Flash | ||||||
| Perplexity Sonar | ||||||
| Grok 4.1 Fast | ||||||
| Mistral Small | ||||||
| DeepSeek V4 Flash | ||||||
| Llama 4 Maverick | ||||||
| Qwen 3.7 Flash | ||||||
| Kimi K2 | ||||||
| GLM 4.7 FlashX | ||||||
| MiniMax M2.5 | ||||||
| GPT-6 Luna | ||||||
| Muse Glimmer 30B |
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
No label in this category carried a quote.
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of seven in this category shown.
“It charges by accepted events, so model your real event stream—including spikes and maintenance windows—before signing.” GPT-6 Luna · negative prompt · soft negative
“though some users find per-user costs steep, so it's best to evaluate their pricing carefully” Mistral Small · budget prompt · soft negative
“Users report steep pricing and a "really struggling in the current market" vibe” GLM 4.7 FlashX · negative prompt · soft negative
“For a typical mid-sized B2B company, PagerDuty AIOps offers the best balance of capability, cost transparency, and ease of deployment.” DeepSeek V4 Flash · paraphrase prompt · first choice
“I'd generally recommend PagerDuty AIOps / Signal Intelligence as the best starting point” GPT-5.4 mini · paraphrase prompt · first choice
“My default recommendation: PagerDuty AIOps” GPT-6 Luna · paraphrase prompt · first choice
Comparisons are drawn for the top eight products in each category, each against each. The output is the models' output; nothing here is a recommendation by the index.