Six of fourteen models named incident.io first on the direct prompt; six named Freshservice. incident.io was named by fourteen of the fourteen models and Freshservice by ten and incident.io carries 57 labels and Freshservice 17, so the shares are not directly comparable.
Named in two categories this edition.
Named in nine categories this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all fourteen models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the incident management and on-call page.
| Model | Direct | Paraphrase | Comparative | Budget-constrained | Scale-constrained | Negative |
|---|---|---|---|---|---|---|
| Claude Haiku 4.5 | ||||||
| GPT-5.4 mini | ||||||
| Gemini 3.5 Flash | ||||||
| Perplexity Sonar | ||||||
| Grok 4.1 Fast | ||||||
| Mistral Small | ||||||
| DeepSeek V4 Flash | ||||||
| Llama 4 Maverick | ||||||
| Qwen 3.7 Flash | ||||||
| Kimi K2 | ||||||
| GLM 4.7 FlashX | ||||||
| MiniMax M2.5 | ||||||
| GPT-6 Luna | ||||||
| Muse Glimmer 30B |
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of seven in this category shown.
“missing features in incident.io, particularly in reporting capabilities and SLA tracking” Claude Haiku 4.5 · negative prompt · soft negative
“if your teams don't want incident workflows tied to Slack or Microsoft Teams” GPT-6 Luna · negative prompt · soft negative
“Pricing surprises: Costs spike sharply after small-team thresholds” Qwen 3.7 Flash · negative prompt · soft negative
“Small team ≤5-10 responders and wants zero cost: incident.io free, FireHydrant free up to 10 responders, Better Stack free, or Opsgenie free up to 5 users.” Muse Glimmer 30B · budget prompt · first choice
“Choose incident.io if your team is Slack-centric and values speed of implementation, modern UX, and transparent all-in-one pricing.” Kimi K2 · direct prompt · first choice
“Highly recommended for mid-market/scale-up companies. It is highly polished, opinionated, runs seamlessly inside Slack/Teams” Gemini 3.5 Flash · scale prompt · first choice
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. One of one in this category shown.
“Very slow to deploy, highly complex, and intensely disliked by most modern software engineering/DevOps teams” Gemini 3.5 Flash · comparative prompt · soft negative
Comparisons are drawn for the top eight products in each category, each against each. The output is the models' output; nothing here is a recommendation by the index.