IT AI Index
September 2026 Edition · The permanent record of this edition. The unqualified address always carries the latest edition.
Index › Developer platform › September 2026 Edition

Error and crash monitoring

Asked as “error monitoring tool”, and as “application error and crash reporting service”, on behalf of a mid-market B2B company. 44 first choices recorded across the direct, paraphrase, budget and scale prompts, twelve models each.
Standing
Sentry
Clear leader
82% of first choices, clear leader.
ShowinginAll 67 categories in the September 2026 Edition →

By buyer segment

The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.
Small businessSentry79%Clear leaderStanding →Mid-marketSentry82%Clear leaderThis pageEnterpriseSentry62%Clear leaderStanding →

01The standing

Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all twelve models, for a mid-market B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrant
01Sentry82%14%65endorsed leader
02Rollbar14%13%63accepted challenger
03GlitchTip2%0%14accepted challenger
Show the seven products at 0%, ordered by negative rate
10Datadog0%60%40criticized challenger
09New Relic0%52%27criticized challenger
08Airbrake0%30%10criticized challenger
04Bugsnag0%17%41accepted challenger
05Honeybadger0%10%30accepted challenger
07LogRocket0%7%15accepted challenger
06Raygun0%7%15accepted challenger
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its vendor page.
Head to head
Sentry vs RollbarSentry vs GlitchTipRollbar vs GlitchTip

One product takes 82% of first choices here, so the chart would put nine markers in one corner and one at the far edge. The two measurements it plots are columns in the standing above: share, and the negative label rate. Three products carry a negative rate above 25% in this category. Jump to the standing

02What they warned about

Eight of twelve models held their first choice under the paraphrase. Claude Haiku 4.5, Mistral Small, Qwen 3.7 Flash and MiniMax M2.5 changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
Datadog
60%
24 of 40 labels negative · 12 of 12 models · 1 hard negative
“**Avoid Datadog** if you are a small team without dedicated DevOps” Mistral Small, negative prompt
New Relic
52%
14 of 27 labels negative · 10 of 12 models
“they come with a warning label regarding cost control... you might accidentally flood these tools with data and wake up to a bill for $5,000+” Qwen 3.7 Flash, negative prompt
Sentry
14%
9 of 65 labels negative · 9 of 12 models · 1 hard negative
“**Avoid Sentry** if you require deep Application Performance Monitoring (APM)” Mistral Small, negative prompt
Rollbar
13%
8 of 63 labels negative · 7 of 12 models · 1 hard negative
“avoid SaaS-only tools like Rollbar” Gemini 3.5 Flash, negative prompt

03What they cite

Citations exist only for the models that return a source list: twelve of the twelve in this edition, and all six flagship models on the expanded tier.

Sites the answers cite

57 of 72 answers in this category came back with a source list, from 12 of 12 models: citations where the model returns them, or the search results it consulted. 5 of those lists are Google grounding redirects that name no site and are left out of the counts. 717 links across 188 sites, every framing counted. Ranked by the number of answers carrying the site or page.

scoutapm.com
vendor site · Scout APM37 answers · 40 citations · 9 models
rollbar.com
vendor site · Rollbar34 answers · 44 citations · 10 models
guideflow.com
vendor site · Guideflow27 answers · 27 citations · 9 models
raygun.com
vendor site · Raygun21 answers · 22 citations · 9 models
worldmetrics.org
19 answers · 21 citations · 7 models
apistatuscheck.com
16 answers · 16 citations · 6 models
observeone.com
16 answers · 16 citations · 9 models
dupple.com
15 answers · 16 citations · 8 models
radartrek.com
14 answers · 15 citations · 8 models
saucelabs.com
13 answers · 14 citations · 10 models
debugg.ai
13 answers · 13 citations · 8 models
ones.com
vendor site · ONES.com13 answers · 13 citations · 8 models

Pages the answers cite

The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.

scoutapm.com/blog/best-error-monitoring-tools
36 answers · 8 models
rollbar.com/blog/best-error-monitoring-tools
29 answers · 10 models
guideflow.com/blog/error-monitoring-software
26 answers · 9 models
raygun.com/blog/best-error-monitoring-tools
20 answers · 9 models
worldmetrics.org/best/error-monitoring-software
18 answers · 7 models
apistatuscheck.com/blog/best-error-tracking-tools-2026
16 answers · 6 models
observeone.com/best/error-monitoring-tools
16 answers · 9 models
radartrek.com/error-monitoring
14 answers · 8 models
debugg.ai/resources/best-error-monitoring-tools-2024
13 answers · 8 models
saucelabs.com/resources/blog/the-best-error-reporting-and-crash-monitoring-…
13 answers · 10 models

04How they answered

Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ModelDirect“What is the best error monitoring tool for a mid-market B2B company?”Paraphrase“Which application error and crash reporting service would you recommend to a mid-sized B2B company?”Comparative“What are the top error monitoring tools and how do they differ?”Budget-constrained“What is the best error monitoring tool for a company with a limited budget?”Scale-constrained“We are a 500 person company evaluating an error monitoring tool. What should we look at?”Negative“Which error monitoring tools should I avoid or be cautious about?”
Claude Haiku 4.5Sentry
Two alternativesCubeAPM, Rollbar
Rollbar, SentryChangedagainst: Datadogno first choiceSentry
Three alternativesBugsnag, New Relic, Rollbar
against: Datadogno first choicenothing named
GPT-5.4 miniSentry
Three alternativesBugsnag, Datadog, Rollbar
SentryHeld
One alternativeBugsnag
Sentry
Three alternativesBugsnag, Datadog Error Tracking, Rollbar
Sentry
Two alternativesHoneybadger, Rollbar
against: Bugsnag, Datadog, New Relicno first choicenothing named
Gemini 3.5 FlashSentry
Three alternativesBugsnag, Datadog, Rollbar
SentryHeld
Two alternativesBugsnag, Rollbar
against: Datadog, New RelicSentry
Seven alternativesAirbrake, Bugsnag, Datadog, Highlight.io, Honeybadger, New Relic, Rollbar
GlitchTip
Five alternativesBetter Stack, Bugsink, Honeybadger, Rollbar, Sentry
against: Datadog, New RelicSentry
Five alternativesBugsnag, Datadog, Highlight.io, LogRocket, Rollbar
against: Airbrake, Bugsnag, FullStory, LogRocket, Rollbar, Sentry
Perplexity SonarSentry
Three alternativesBetter Stack, Rollbar, Scout
SentryHeld
One alternativeFirebase Crashlytics
against: DatadogSentry
Six alternativesAirbrake, Bugsnag, Datadog, Honeybadger, New Relic, Rollbar
Sentry
Three alternativesBetter Stack, GlitchTip, Honeybadger
no first choiceagainst: Bugsnag, Datadog, New Relic, Rollbar, Sentry
Grok 4.1 FastSentry
One alternativeRollbar
against: Datadog, New RelicSentryHeld
Three alternativesBugsnag, Raygun, Rollbar
Sentry
Two alternativesBugsnag, Rollbar
against: Datadog, New RelicSentry
Four alternativesGlitchTip, Honeybadger, PostHog, Rollbar
Sentry
Three alternativesBugsnag, LogRocket, Rollbar
against: Datadogagainst: Bugsnag, Datadog, New Relic, Rollbar, Scout APM, Sentry
Mistral SmallRollbar, Scout Monitoring
One alternativeSentry
against: Airbrake, HoneybadgerSentryChanged
One alternativeFirebase Crashlytics
Sentry
Four alternativesAirbrake, Bugsnag, Raygun, Rollbar
against: Datadog, New RelicSentry
Two alternativesHoneybadger, Rollbar
no first choiceagainst: Bugsnag, Datadog, Rollbar, Scout APM, Sentry
DeepSeek V4 FlashSentry
Two alternativesDatadog Error Tracking, Rollbar
SentryHeld
Four alternativesBugsnag, Datadog, LogRocket, Rollbar
Sentry
Five alternativesBugsnag, GlitchTip, Honeybadger, Raygun, Rollbar
against: Datadog Error TrackingSentry
Three alternativesBugsink, GlitchTip, Honeybadger
against: Grafana CloudSentry
One alternativeBugsnag
against: Datadog, Rollbaragainst: AppSignal, Bugsnag, Datadog, Errorception, Highlight.io, Honeybadger, New Relic, Rollbar, Scout, Sentry
Llama 4 Maverickno first choiceno first choiceHeldno first choiceRollbar
Two alternativesHoneybadger, Sentry
no first choiceagainst: AppSignal, Datadog, New Relic, Scout, Sentry
Qwen 3.7 FlashSentry
Two alternativesRaygun, Rollbar
against: DatadogRollbar, SentryChangedagainst: DatadogSentry
Four alternativesAirbrake, Bugsnag, Raygun, Rollbar
Sentry
Three alternativesGlitchTip, LogRocket, Rollbar
against: Honeybadger, RaygunSentry
Two alternativesHoneybadger, Rollbar
against: Datadog, New Relicagainst: AWS X-Ray, AppDynamics, Azure Monitor, Datadog, Elastic Stack, Habits.io, Logstash, New Relic, SolarWinds Papertrail, Splunk
Kimi K2Sentry
Three alternativesBugsnag, LogRocket, Rollbar
against: Datadog Error Tracking, FullStorySentryHeld
Four alternativesDatadog APM / Error Tracking, LogRocket, Raygun, Rollbar
Sentry
Three alternativesBugsnag, Honeybadger, Rollbar
against: Airbrake, Datadog Error TrackingSentry
Three alternativesBugsnag, GlitchTip, Rollbar
Rollbar, Sentryagainst: Datadogagainst: Bugsnag, Datadog, Highlight.io, New Relic, Rollbar, Sentry
GLM 4.7 FlashXSentry
Three alternativesBetter Stack, Bugsnag, Rollbar
SentryHeld
Two alternativesBugsnag, Rollbar
Sentry
Six alternativesBugsnag, Datadog, LogRocket, Raygun, Rollbar, TrackJS
Sentry
Five alternativesBugsnag, GlitchTip, Honeybadger, PostHog, Rollbar
no first choiceagainst: Datadog, Dynatrace, New Relic, Rollbar, Sentry
MiniMax M2.5Rollbar, Sentry
One alternativeScout Monitoring
against: Datadog APMSentryChanged
Two alternativesDatadog, Rollbar
Sentry
Five alternativesAirbrake, Bugsnag, LogRocket, New Relic, Rollbar
against: DatadogSentry
Three alternativesGlitchTip, Honeybadger, Rollbar
no first choiceagainst: Sentry
Bold is the first choiceAlternatives are counted; the count opens them.What the answer argued against

05The record

One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency. Full answer text is in the free responses file. Download the record
Seventy-two rows: every prompt, every model, every answer.
PromptModelVersion stringTime (UTC)SearchedSourcesLatency
Direct recommendationClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 11:20yes97 s
Direct recommendationGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 09:53yes56 s
Direct recommendationGemini 3.5 Flashgemini-3.5-flash2026-09-17 11:26yes1121 s
Direct recommendationPerplexity Sonarsonar2026-09-17 14:03yes205 s
Direct recommendationGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 12:27yes1810 s
Direct recommendationMistral Smallmistral/mistral-small via mistral2026-09-17 13:17yes119 s
Direct recommendationDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 11:47yes817 s
Direct recommendationLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 11:38yes52 s
Direct recommendationQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 11:58no039 s
Direct recommendationKimi K2moonshotai/kimi-k2 via novita2026-09-17 14:12yes1054 s
Direct recommendationGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 12:35yes22138 s
Direct recommendationMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 12:19yes954 s
ParaphraseClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 12:39no05 s
ParaphraseGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 13:01yes15 s
ParaphraseGemini 3.5 Flashgemini-3.5-flash2026-09-17 10:24yes920 s
ParaphrasePerplexity Sonarsonar2026-09-17 12:49yes186 s
ParaphraseGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 12:38yes4417 s
ParaphraseMistral Smallmistral/mistral-small via mistral2026-09-17 11:13yes55 s
ParaphraseDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 09:32yes1013 s
ParaphraseLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 10:49yes53 s
ParaphraseQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 14:09yes531 s
ParaphraseKimi K2moonshotai/kimi-k2 via novita2026-09-17 12:19no044 s
ParaphraseGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 14:14yes3579 s
ParaphraseMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 12:11yes1338 s
ComparativeClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 11:35yes97 s
ComparativeGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 13:11yes812 s
ComparativeGemini 3.5 Flashgemini-3.5-flash2026-09-17 13:50yes1223 s
ComparativePerplexity Sonarsonar2026-09-17 10:53yes208 s
ComparativeGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 10:58yes158 s
ComparativeMistral Smallmistral/mistral-small via mistral2026-09-17 10:12yes57 s
ComparativeDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 11:20yes1417 s
ComparativeLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 11:56yes53 s
ComparativeQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 10:24yes524 s
ComparativeKimi K2moonshotai/kimi-k2 via novita2026-09-17 09:48yes1031 s
ComparativeGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 12:17yes1842 s
ComparativeMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 09:58yes2581 s
Budget constrainedClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 09:55no04 s
Budget constrainedGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 12:25no04 s
Budget constrainedGemini 3.5 Flashgemini-3.5-flash2026-09-17 11:50yes1322 s
Budget constrainedPerplexity Sonarsonar2026-09-17 11:03yes204 s
Budget constrainedGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 12:38yes189 s
Budget constrainedMistral Smallmistral/mistral-small via mistral2026-09-17 11:09yes53 s
Budget constrainedDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 12:59yes88 s
Budget constrainedLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 10:31yes52 s
Budget constrainedQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 12:36no044 s
Budget constrainedKimi K2moonshotai/kimi-k2 via novita2026-09-17 10:31yes1533 s
Budget constrainedGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 09:26yes1482 s
Budget constrainedMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 12:46yes918 s
Scale constrainedClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 09:30no05 s
Scale constrainedGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 11:45no06 s
Scale constrainedGemini 3.5 Flashgemini-3.5-flash2026-09-17 11:38no015 s
Scale constrainedPerplexity Sonarsonar2026-09-17 10:55yes207 s
Scale constrainedGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 11:06yes1612 s
Scale constrainedMistral Smallmistral/mistral-small via mistral2026-09-17 11:11no08 s
Scale constrainedDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 10:28yes921 s
Scale constrainedLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 11:23yes53 s
Scale constrainedQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 10:42no041 s
Scale constrainedKimi K2moonshotai/kimi-k2 via novita2026-09-17 10:40yes923 s
Scale constrainedGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 10:58yes19123 s
Scale constrainedMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 12:08no055 s
Negative framingClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 11:02no04 s
Negative framingGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 10:25no04 s
Negative framingGemini 3.5 Flashgemini-3.5-flash2026-09-17 11:57yes1924 s
Negative framingPerplexity Sonarsonar2026-09-17 10:18yes209 s
Negative framingGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 10:24yes4015 s
Negative framingMistral Smallmistral/mistral-small via mistral2026-09-17 11:36yes55 s
Negative framingDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 10:24yes2935 s
Negative framingLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 11:50yes53 s
Negative framingQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 10:05no049 s
Negative framingKimi K2moonshotai/kimi-k2 via novita2026-09-17 13:01yes2455 s
Negative framingGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 10:48yes2190 s
Negative framingMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 14:10yes1429 s

Normalization in this category

Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.

Category-scoped readings
ELK Stack read as Elastic Stack
Unresolved, counted raw
Datadog APM / Error Tracking
GlitchReplay
Habits.io
Inspectlet
Logwise
Discontinued, still offered
No shut-down product was recommended here.

Also in developer platform

The other categories of this function, with the leader in each.
← CI/CDFeature flags →