accepted challengerNamed in eight categories this edition.
accepted challengerNamed in four categories this edition.
First-choice share15%2%Of first choices across the direct, paraphrase, budget and scale prompts, 0 to 100.
Negative rate15%7%Negative labels as a share of the product's labels, 0 to 100.
Rank in category#2#7A position in a field of 10; printed, not drawn.
Labels4014A count; the two differ.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all fourteen models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the aiops platforms page.
By framing
How many of the fourteen models made each the first choice, per way of asking, and how many argued against it.
DatadogFirst choices, of fourteen modelsPagerDuty
Direct511 against Datadog
Paraphrase30
Comparative20
Budget-constrained002 against Datadog
Scale-constrained00
Negative003 against Datadog · 1 against PagerDuty
Bars are first choices, 0 to 14 each sideModels that argued againstA model can name both, so the two sides of a row do not sum to fourteen.
The direct prompt
The plain question, one answer per model, grouped by where Datadog and PagerDuty stood in it.
Datadog first, PagerDuty an alternative
5 of 14 modelsPagerDuty was named in the answer but not as the choice, or not at all.Gemini 3.5 FlashDatadog, LogicMonitor alternatives: New Relic, PagerDuty
xAIGrok 4.1 FastDatadog alternatives: New Relic
MiniMax M2.5Datadog, New Relic alternatives: Dynatrace
GPT-6 LunaDatadog alternatives: Dynatrace, New Relic
Muse Glimmer 30BDatadog, Dynatrace, New Relic alternatives: Freshservice
PagerDuty first, Datadog not the choice
1 of 14 modelsDatadog was named in the answer but not as the choice, or not at all.Claude Haiku 4.5PagerDuty alternatives: BigPanda, LogicMonitor, New Relic
Neither was the first choice, one was named
5 of 14 modelsThe answer put something else first and named one of the two as an alternative.GPT-5.4 miniDynatrace alternatives: Datadog, New Relic, Splunk
DeepSeek V4 FlashLogicMonitor, New Relic alternatives: BigPanda, Freshservice, PagerDuty
Qwen 3.7 FlashDynatrace alternatives: BigPanda, Datadog, Elastic Observability, Grafana Cloud, OpenTelemetry
Kimi K2New Relic alternatives: Datadog, LogicMonitor
Z.AIGLM 4.7 FlashXDynatrace alternatives: Datadog, Freshservice, ManageEngine OpManager Nexus, New Relic
Neither was named
3 of 14 modelsThe answer made no first choice from these two in this category.Perplexity SonarNew Relic alternatives: Coralogix
Mistral SmallDynatrace alternatives: BigPanda, LogicMonitor, New Relic
Llama 4 MaverickDynatrace
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
Comparisons are drawn for the top eight products in each category, each against each. The output is the models' output; nothing here is a recommendation by the index.