Zero of fourteen models named Zabbix first on the direct prompt; two named New Relic. Both were named by all fourteen models and Zabbix carries 46 labels and New Relic 49, so the shares are not directly comparable.
Named in eight categories this edition.
Named in eight categories this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all fourteen models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the infrastructure monitoring page.
| Model | Direct | Paraphrase | Comparative | Budget-constrained | Scale-constrained | Negative |
|---|---|---|---|---|---|---|
| Claude Haiku 4.5 | ||||||
| GPT-5.4 mini | ||||||
| Gemini 3.5 Flash | ||||||
| Perplexity Sonar | ||||||
| Grok 4.1 Fast | ||||||
| Mistral Small | ||||||
| DeepSeek V4 Flash | ||||||
| Llama 4 Maverick | ||||||
| Qwen 3.7 Flash | ||||||
| Kimi K2 | ||||||
| GLM 4.7 FlashX | ||||||
| MiniMax M2.5 | ||||||
| GPT-6 Luna | ||||||
| Muse Glimmer 30B |
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Three of three in this category shown.
“Avoid Nagios and raw Zabbix if you value speed and ease-of-use over granular control.” Qwen 3.7 Flash · negative prompt · hard negative
“Avoid Zabbix if you need modern UI and simplicity, as its user interface feels dated.” Claude Haiku 4.5 · negative prompt · hard negative
“Zabbix – best all-in-one for traditional infrastructure ... Need one install with UI, alerting and auto-discovery and minimal ops overhead → Zabbix.” Muse Glimmer 30B · budget prompt · first choice
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Two of two in this category shown.
“Avoid SaaS like Datadog/New Relic (start at $15+/host/month, costs explode)” Grok 4.1 Fast · budget prompt · hard negative
“Offers a simpler pricing model than Datadog... strong, unified platform that is often much easier to budget for at a 500-person scale.” Gemini 3.5 Flash · scale prompt · first choice
Comparisons are drawn for the top eight products in each category, each against each. The output is the models' output; nothing here is a recommendation by the index.