Five of twelve models named incident.io first on the direct prompt; five named PagerDuty. Both were named by all twelve models and incident.io carries 50 labels and PagerDuty 59, so the shares are not directly comparable.
Named in one category this edition.
Named in two categories this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all twelve models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the incident management and on-call page.
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Three of four in this category shown.
“my default pick is incident.io if you want the best balance of ease of use, modern workflow automation, and strong Slack-native coordination” GPT-5.4 mini · direct prompt · first choice
“If you want a single recommendation without more context, I'd pick incident.io for most mid-market B2B companies” Perplexity Sonar · direct prompt · first choice
“I'd recommend starting with incident.io if you're Slack-centric, or Hyperping if you want flat-rate pricing” MiniMax M2.5 · paraphrase prompt · first choice
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of eight in this category shown.
“One of the most widely used platforms, but has received significant criticism for: High costs... Poor support” MiniMax M2.5 · negative prompt · hard negative
“Avoid PagerDuty unless you have substantial budget” DeepSeek V4 Flash · budget prompt · hard negative
“most battle-tested paging platform at enterprise scale, but it does not natively cover incident coordination, postmortems, or status pages” Claude Haiku 4.5 · comparative prompt · soft negative
“PagerDuty is the most mature platform on the market... Go with PagerDuty if budget is not an object and you need maximum customization.” Qwen 3.7 Flash · paraphrase prompt · first choice
“PagerDuty tops many lists (e.g., Viewpoint Analysis, Rootly blogs) for proven reliability in tech-forward B2B, but evaluate cost” Grok 4.1 Fast · direct prompt · first choice
“PagerDuty | Mature on-call/enterprise | $21/user/mo | 700+ integrations, AI noise reduction | Pricey add-ons” Grok 4.1 Fast · scale prompt · first choice
Comparisons are drawn for the top three products in each category. The output is the models' output; nothing here is a recommendation by the index.