Nine of fourteen models named New Relic first on the direct prompt; one named Honeycomb. New Relic was named by fourteen of the fourteen models and Honeycomb by ten and New Relic carries 63 labels and Honeycomb 19, so the shares are not directly comparable.
Named in eight categories this edition.
Named in six categories this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all fourteen models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the observability platforms page.
| Model | Direct | Paraphrase | Comparative | Budget-constrained | Scale-constrained | Negative |
|---|---|---|---|---|---|---|
| Claude Haiku 4.5 | ||||||
| GPT-5.4 mini | ||||||
| Gemini 3.5 Flash | ||||||
| Perplexity Sonar | ||||||
| Grok 4.1 Fast | ||||||
| Mistral Small | ||||||
| DeepSeek V4 Flash | ||||||
| Llama 4 Maverick | ||||||
| Qwen 3.7 Flash | ||||||
| Kimi K2 | ||||||
| GLM 4.7 FlashX | ||||||
| MiniMax M2.5 | ||||||
| GPT-6 Luna | ||||||
| Muse Glimmer 30B |
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Three of three in this category shown.
“| New Relic/Datadog | SaaS | Limited free | High ($0.35/GB + users) | Avoid for tight budgets |” Grok 4.1 Fast · budget prompt · hard negative
“New Relic Why be cautious: - Complex pricing model” Kimi K2 · negative prompt · hard negative
“New Relic is recommended for teams wanting all telemetry types on a single ingest meter with a genuinely useful free tier” Claude Haiku 4.5 · direct prompt · first choice
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Three of three in this category shown.
“Event-based pricing creates a structural incident risk because volume spikes during production incidents increase costs” Claude Haiku 4.5 · negative prompt · soft negative
“Using them now carries a "hold my horse" risk.” Qwen 3.7 Flash · negative prompt · soft negative
“Go with Honeycomb if you are a B2B SaaS company that suffers from customer-specific performance issues” Gemini 3.5 Flash · direct prompt · first choice
Comparisons are drawn for the top eight products in each category, each against each. The output is the models' output; nothing here is a recommendation by the index.