IT AI Index
September 2026 Edition · The permanent record of this edition. The unqualified address always carries the latest edition.
Index Developer platform Error monitoring › Enterprise September 2026 Edition

Error and crash monitoring for enterprise buyers

Asked as “error monitoring tool”, and as “application error and crash reporting service”, on behalf of an enterprise B2B company. 45 first choices recorded across the direct, paraphrase, budget and scale prompts, twelve models each.
Standing
Clear leader
62% of first choices, clear leader.

By buyer segment

The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.

01The standing

Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all twelve models, for an enterprise B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrant
01Sentry62%21%67endorsed leader
02Datadog11%35%49criticized challenger
03Rollbar7%12%48accepted challenger
04Bugsnag4%21%39accepted challenger
05New Relic4%31%36criticized challenger
06Honeybadger4%33%12criticized challenger
07Datadog Error Tracking2%17%12accepted challenger
Show the one product at 0%, ordered by negative rate
08Raygun0%31%16criticized challenger
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its vendor page.

One product takes 62% of first choices here, so the chart would put seven markers in one corner and one at the far edge. The two measurements it plots are columns in the standing above: share, and the negative label rate. Four products carry a negative rate above 25% in this category. Jump to the standing

02What they warned about

Eight of twelve models held their first choice under the paraphrase. Grok 4.1 Fast, Llama 4 Maverick, Kimi K2 and MiniMax M2.5 changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
Datadog
35%
17 of 49 labels negative · 12 of 12 models · 3 hard negative
“Tools to Avoid for Predictable Costs | **Datadog** | Per-host pricing... becomes unpredictable at scale” Kimi K2, budget prompt
Sentry
21%
14 of 67 labels negative · 11 of 12 models · 1 hard negative
“Tools to **Avoid or Be Highly Cautious With**: 1. **Sentry**... can lead to unpredictable and skyrocketing costs” Grok 4.1 Fast, negative prompt
New Relic
31%
11 of 36 labels negative · 8 of 12 models · 2 hard negative
“Platforms like *New Relic* charge a premium per "Full Platform User"... you would pay up to $1.2 million annually just for user licenses” Gemini 3.5 Flash, budget prompt
Bugsnag
21%
8 of 39 labels negative · 8 of 12 models · 1 hard negative
“limited scalability for enterprise needs... Best avoided if: You need end-to-end visibility” Grok 4.1 Fast, negative prompt

03What they cite

Citations exist only for the models that return a source list: twelve of the twelve in this edition, and all six flagship models on the expanded tier.

Sites the answers cite

63 of 72 answers in this category came back with a source list, from 12 of 12 models: citations where the model returns them, or the search results it consulted. 6 of those lists are Google grounding redirects that name no site and are left out of the counts. 964 links across 237 sites, every framing counted. Ranked by the number of answers carrying the site or page.

vendor site · Scout APM38 answers · 50 citations · 11 models
vendor site · Rollbar34 answers · 49 citations · 10 models
vendor site · Guideflow24 answers · 24 citations · 9 models
vendor site · CubeAPM21 answers · 31 citations · 10 models
21 answers · 30 citations · 8 models
vendor site · Sentry21 answers · 29 citations · 8 models
vendor site · Raygun21 answers · 28 citations · 8 models
vendor site · Better Stack18 answers · 23 citations · 6 models
18 answers · 18 citations · 9 models
16 answers · 16 citations · 9 models
14 answers · 14 citations · 5 models
13 answers · 18 citations · 8 models

Pages the answers cite

The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.

04How they answered

Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ModelDirect“What is the best error monitoring tool for an enterprise B2B company?”Paraphrase“Which application error and crash reporting service would you recommend to a large B2B company with thousands of employees?”Comparative“What are the top enterprise-grade error monitoring tools and how do they differ?”Budget-constrained“What is the best error monitoring tool for a large company that needs predictable total cost across thousands of users?”Scale-constrained“We are a 5,000 person company with SSO, SOC 2 and procurement review requirements evaluating an error monitoring tool. What should we look at?”Negative“Which error monitoring tools should a large enterprise avoid or be cautious about?”
Claude Haiku 4.5no first choiceno first choiceHeldno first choiceBugsnag
One alternativeScout Monitoring
against: Datadog, Sentry
no first choiceagainst: Datadog, New Relic, Sentry
GPT-5.4 miniSentry
Three alternativesBugsnag, Datadog, Rollbar
SentryHeld
Four alternativesBugsnag, Datadog, New Relic, Rollbar
Sentry
Four alternativesBugsnag, Datadog, New Relic, Rollbar
Bugsnag
Two alternativesGlitchTip, Rollbar
against: Sentry
Sentry
Three alternativesBugsnag, Datadog Error Tracking, Rollbar
against: Bugsnag, Datadog, New Relic, Rollbar, Sentry
Gemini 3.5 FlashSentry
Two alternativesBugsnag, LogRocket
against: Datadog
SentryHeld
Three alternativesBugsnag, CubeAPM, Datadog Error Tracking
Sentry
Three alternativesBugsnag, Raygun, Rollbar
against: Datadog, New Relic
Sentry
Three alternativesGlitchTip, Rollbar, TrackJS
against: New Relic
Sentry
Two alternativesBugsnag, Datadog
against: Airbrake, Bugsnag, Datadog, FullStory, LogRocket, New Relic, Raygun, Rollbar, Sentry
Perplexity SonarSentry
Three alternativesDatadog, Honeybadger, Rollbar
SentryHeld
Three alternativesBugsnag, Datadog Error Tracking, Firebase Crashlytics
Sentry
Six alternativesAppSignal, Bugsnag, Datadog Error Tracking, New Relic, Rollbar, Scout Monitoring
Scout Monitoring
One alternativeCubeAPM
against: Datadog, Sentry
Sentry
Three alternativesBugsnag, Datadog, Rollbar
against: Airbrake, BugSplat, Bugsnag, CatchJS, Errorception, LogRocket, Rollbar, TrackJS
Grok 4.1 FastDatadog, New Relic
Two alternativesDynatrace, Sentry
SentryChanged
Three alternativesDatadog, New Relic, Rollbar
Sentry
Two alternativesDatadog, New Relic
Honeybadger
Three alternativesAirbrake, Raygun, Rollbar
against: Datadog, New Relic, Sentry
Sentry
Three alternativesBetter Stack, Datadog, Rollbar
against: Checkend
against: AppSignal, Bugsnag, Honeybadger, LogRocket, Raygun, Rollbar, Sentry
Mistral SmallSentry
Three alternativesDatadog, LogRocket, Rollbar
SentryHeld
Three alternativesBugsnag, Firebase Crashlytics, Splunk Observability Cloud
Datadog Error Tracking, Sentry
Four alternativesBugsnag, Dynatrace, New Relic Errors Inbox, Rollbar
CubeAPM, Honeybadgeragainst: Datadog, Scout Monitoring, Sentryno first choiceagainst: Bugsnag, Datadog Error Tracking, Honeybadger, Raygun
DeepSeek V4 FlashSentry
Three alternativesDatadog, New Relic, Rollbar
SentryHeld
Four alternativesBugsnag, Datadog, New Relic, Rollbar
Sentry
Four alternativesBugsnag, Datadog Error Tracking, New Relic Errors Inbox, Rollbar
Sentry
Three alternativesGlitchTip, Rollbar, Scout Monitoring
against: Datadog
no first choiceagainst: Bugsnag, Datadog Error Tracking, GlitchTip, Honeybadger, LogRocket, Raygun, Rollbar, Sentry
Llama 4 MaverickSentry
Two alternativesRollbar, Scout Monitoring
no first choiceChangedDatadog
Three alternativesBugsnag, Rollbar, Sentry
Sentryno first choiceagainst: AppSignal, Datadog, New Relic, Scout, Sentry
Qwen 3.7 FlashSentry
Three alternativesDatadog, Honeycomb, Splunk
SentryHeld
Two alternativesDatadog, Rollbar
Rollbar, Sentry
Three alternativesBugsnag, Datadog, New Relic
New Relic, Sentry
One alternativeHoneybadger
against: Datadog
no first choiceagainst: Datadog, Elasticsearch, New Relic, Raygun, Rollbar, Sentry
Kimi K2Datadog, Sentry
Two alternativesHoneybadger, New Relic
Datadog Error TrackingChanged
Three alternativesBugsnag, Rollbar, Sentry
Sentry
Seven alternativesAirbrake, Bugsnag, Datadog, LogRocket, New Relic, Raygun, Rollbar
Rollbar
Three alternativesRaygun, Sentry, TrackJS
against: Datadog, LogRocket, New Relic
Sentry
Three alternativesBugsnag, Datadog Error Tracking, Rollbar
against: Airbrake, Bugsnag, Datadog, Honeybadger, New Relic
GLM 4.7 FlashXSentry
Three alternativesBugsnag, Datadog, Rollbar
SentryHeld
Three alternativesBugsnag, Raygun, Rollbar
Sentry
Four alternativesBugsnag, Datadog, New Relic, Rollbar
Rollbar
One alternativeRaygun
against: Bugsnag
no first choiceagainst: Datadog, LogRocket, Scout APM, Sentry, Splunk
MiniMax M2.5Datadog, Rollbar
Two alternativesNew Relic, Sentry
against: Splunk
Datadog, SentryChanged
One alternativeNew Relic
Sentry
Four alternativesBugsnag, Datadog, New Relic, Rollbar
no first choiceDatadog, Sentry
One alternativeCheckend
against: Datadog, New Relic, Sentry
Bold is the first choiceAlternatives are counted; the count opens them.What the answer argued against

05The record

One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency. Full answer text is in the free responses file. Download the record
Seventy-two rows: every prompt, every model, every answer.
PromptModelVersion stringTime (UTC)SearchedSourcesLatency
Direct recommendationClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 13:52no04 s
Direct recommendationGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 10:10yes45 s
Direct recommendationGemini 3.5 Flashgemini-3.5-flash2026-09-17 10:20yes1426 s
Direct recommendationPerplexity Sonarsonar2026-09-17 10:49yes204 s
Direct recommendationGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 12:55yes3617 s
Direct recommendationMistral Smallmistral/mistral-small via mistral2026-09-17 10:58yes86 s
Direct recommendationDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 11:06yes1314 s
Direct recommendationLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 12:09yes53 s
Direct recommendationQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 14:03no036 s
Direct recommendationKimi K2moonshotai/kimi-k2 via novita2026-09-17 12:11yes1543 s
Direct recommendationGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 13:29yes30287 s
Direct recommendationMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 09:22yes524 s
ParaphraseClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 13:17no04 s
ParaphraseGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 13:26yes55 s
ParaphraseGemini 3.5 Flashgemini-3.5-flash2026-09-17 12:07yes1021 s
ParaphrasePerplexity Sonarsonar2026-09-17 09:26yes205 s
ParaphraseGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 12:12yes4019 s
ParaphraseMistral Smallmistral/mistral-small via mistral2026-09-17 11:40yes129 s
ParaphraseDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 12:33yes2018 s
ParaphraseLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 13:22yes53 s
ParaphraseQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 11:28no035 s
ParaphraseKimi K2moonshotai/kimi-k2 via novita2026-09-17 11:38yes2051 s
ParaphraseGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 10:17yes29135 s
ParaphraseMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 13:30yes748 s
ComparativeClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 12:25yes99 s
ComparativeGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 14:09yes510 s
ComparativeGemini 3.5 Flashgemini-3.5-flash2026-09-17 13:00yes1225 s
ComparativePerplexity Sonarsonar2026-09-17 09:35yes209 s
ComparativeGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 10:00yes2414 s
ComparativeMistral Smallmistral/mistral-small via mistral2026-09-17 10:58yes810 s
ComparativeDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 11:49yes1925 s
ComparativeLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 13:38yes74 s
ComparativeQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 11:44no045 s
ComparativeKimi K2moonshotai/kimi-k2 via novita2026-09-17 12:09yes2047 s
ComparativeGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 11:55yes2452 s
ComparativeMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 12:36yes1339 s
Budget constrainedClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 10:58yes1710 s
Budget constrainedGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 14:08no05 s
Budget constrainedGemini 3.5 Flashgemini-3.5-flash2026-09-17 13:56yes1632 s
Budget constrainedPerplexity Sonarsonar2026-09-17 09:42yes205 s
Budget constrainedGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 12:04yes3821 s
Budget constrainedMistral Smallmistral/mistral-small via mistral2026-09-17 12:52yes96 s
Budget constrainedDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 12:17yes2734 s
Budget constrainedLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 12:28yes55 s
Budget constrainedQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 10:40no046 s
Budget constrainedKimi K2moonshotai/kimi-k2 via novita2026-09-17 10:30yes1926 s
Budget constrainedGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 11:33yes27371 s
Budget constrainedMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 14:10yes20157 s
Scale constrainedClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 10:22yes1811 s
Scale constrainedGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 11:22yes58 s
Scale constrainedGemini 3.5 Flashgemini-3.5-flash2026-09-17 10:57yes1026 s
Scale constrainedPerplexity Sonarsonar2026-09-17 12:30yes2010 s
Scale constrainedGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 12:31yes1913 s
Scale constrainedMistral Smallmistral/mistral-small via mistral2026-09-17 10:38no09 s
Scale constrainedDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 14:10yes2845 s
Scale constrainedLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 10:40yes53 s
Scale constrainedQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 12:40no043 s
Scale constrainedKimi K2moonshotai/kimi-k2 via novita2026-09-17 13:49yes3047 s
Scale constrainedGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 12:29yes1535 s
Scale constrainedMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 13:10yes1329 s
Negative framingClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 14:08yes1810 s
Negative framingGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 10:27yes35 s
Negative framingGemini 3.5 Flashgemini-3.5-flash2026-09-17 12:58yes2930 s
Negative framingPerplexity Sonarsonar2026-09-17 11:02yes208 s
Negative framingGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 12:47yes2112 s
Negative framingMistral Smallmistral/mistral-small via mistral2026-09-17 10:32yes56 s
Negative framingDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 12:42yes2940 s
Negative framingLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 12:50yes52 s
Negative framingQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 10:59yes1545 s
Negative framingKimi K2moonshotai/kimi-k2 via novita2026-09-17 09:35yes2538 s
Negative framingGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 11:25yes2492 s
Negative framingMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 14:09yes2161 s

Normalization in this category

Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.

Category-scoped readings
None. Every name in this category resolved on its own.
Unresolved, counted raw
OpenTelemetry-based platforms
Sematext Error Tracking
Discontinued, still offered
No shut-down product was recommended here.
← CI/CDFeature flags →