AI Indexes
IT AI Index
September 2026 Edition, published September 17, 2026 · The permanent record of that edition, superseded since. The current standing is on the category page →
Index › Developer platform › Error monitoring › Small business › September 2026 Edition

Error and crash monitoring for small business buyers

Asked as “error monitoring tool”, and as “application error and crash reporting service”, on behalf of a small B2B company. 54 first choices recorded across the direct, paraphrase, budget and scale prompts, twelve models each.
Standing · first-choice share
69%
Clear leader
69Sentry20Honeybadger04Bugsnag07others

69% of first choices, clear leader.

By buyer segment

The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.

The standing

Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all twelve models, for a small B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrant
01Sentry69%14%76endorsed leader
02Honeybadger20%2%50accepted challenger
03Bugsnag4%14%49accepted challenger
04GlitchTip4%3%33accepted challenger
05Rollbar2%10%58accepted challenger
Show the six products at 0%, ordered by negative rate
10New Relic Errors Inbox0%93%14criticized challenger
11Datadog Error Tracking0%79%24criticized challenger
09Raygun0%42%12criticized challenger
08LogRocket0%18%11accepted challenger
07Airbrake0%8%12accepted challenger
06PostHog0%8%12accepted challenger
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its product page.

One product takes 69% of first choices here, so the chart would put ten markers in one corner and one at the far edge. The two measurements it plots are columns in the standing above: share, and the negative label rate. Three products carry a negative rate above 25% in this category.

What they warned about

Five of twelve models held their first choice under the paraphrase. Claude Haiku 4.5, Perplexity Sonar, Mistral Small, Llama 4 Maverick, Qwen 3.7 Flash, Kimi K2 and MiniMax M2.5 changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
Datadog Error Tracking
79%
19 of 24 labels negative · 13 of 12 models · 11 hard negative
“**Avoid** Datadog, New Relic, Dynatrace, Elastic Stack (ELK), Splunk, and other heavy, all‑in‑one observability platforms” GLM 4.7 FlashX, negative prompt
New Relic Errors Inbox
93%
13 of 14 labels negative · 11 of 12 models · 9 hard negative
“"you should avoid or be highly cautious of the following categories ... Enterprise Observability & APM Suites (e.g., Datadog, New Relic, Dynatrace)"” Muse Glimmer 30B, negative prompt
Dynatrace
100%
9 of 9 labels negative · 8 of 12 models · 9 hard negative
“Avoid full-stack observability platforms ... Examples: Datadog, Dynatrace, AppDynamics, New Relic (full suite).” Qwen 3.7 Flash, negative prompt
Sentry
14%
11 of 76 labels negative · 8 of 12 models
“self-hosting Sentry requires heavy infrastructure (Kafka, ZooKeeper, multiple databases) and at least 4–8 GB of RAM, which is expensive and complex for a small team” Gemini 3.5 Flash, budget prompt

What they cite

Citations exist only for the models that return a source list: fourteen of the twelve in this edition, and all six flagship models on the expanded tier.

Sites the answers cite

75 of 84 answers in this category came back with a source list, from 14 of 12 models: citations where the model returns them, or the search results it consulted. 947 links across 177 sites, every framing counted. Ranked by the number of answers carrying the site or page.

vendor site · ONES.com53 answers · 108 citations · 12 models
45 answers · 55 citations · 11 models
29 answers · 33 citations · 10 models
vendor site · Sentry26 answers · 27 citations · 10 models
vendor site · Guideflow26 answers · 26 citations · 11 models
vendor site · Rollbar22 answers · 34 citations · 10 models
vendor site · ZipDo.co22 answers · 25 citations · 8 models
vendor site · Scout APM17 answers · 18 citations · 7 models
vendor site · Sentry16 answers · 21 citations · 8 models
14 answers · 14 citations · 7 models
14 answers · 14 citations · 7 models
14 answers · 14 citations · 7 models

Pages the answers cite

The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.

Search against answers

Each company's standing in the answers beside its site's footprint in Google search, one row a site: the products the models named on it with their shares, and the share they add up to; monthly searches on Google, and DataForSEO's estimate of AI search demand (modeled from search signals, directional, not a count of queries to any assistant), for the most-searched of the company's and its products' names (the name is in each row's hover text); estimated monthly organic visits to the site; and its best position in Google's top ten for “best error monitoring tool”, “error monitoring tool”, “error monitoring tools”. US estimates from DataForSEO and Google's Ads Transparency Center. A small company's site, or a mid-sized company's site for its flagship, is marked company; a product on a large parent's site (Google, Microsoft) has no site figures. A column with no figures for this category is left out, and an empty cell means none were seen, not none exist. Two measurements side by side: neither is read as the cause of the other.
Company and productsShareOwn site citedName searches, GoogleAI search demand, est.Organic visitsGoogle ads, last 30 daysBest Google position
Sentry sentry.io69%26990,50021,086254,6861201
Honeybadger honeybadger.io20%86201,0009813,851
Bugsnag bugsnag.com4%1461,600231,51246
GlitchTip glitchtip.com4%6659092508
Rollbar rollbar.com2%1545,40017512,38255
Better Stack betterstack.com2%2851,6001,01741,811119
PostHog posthog.com0%2333,10027125,9361208
Airbrake airbrake.io0%315,40016410,122
Bugsink bugsink.com0%131401403
AppSignal appsignal.com0%21880213,3721

Google's top ten for the three searches hold 13 sites; 3 of them are among the sites the models cited here (rollbar.com, scoutapm.com, sentry.io). The first result for “best error monitoring tool” is sentry.io.

How they answered

Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ShowHide
ModelDirect“What is the best error monitoring tool for a small B2B company?”Paraphrase“Which application error and crash reporting service would you recommend to a small business that sells to other businesses?”Comparative“What are the top error monitoring tools for a small team and how do they differ?”Budget-constrained“What is the best error monitoring tool for a small company with a tight budget?”Scale-constrained“We are a 30 person company evaluating an error monitoring tool. What should we look at?”Negative“Which error monitoring tools should a small business avoid or be cautious about?”
Claude Haiku 4.5no first choiceagainst: Datadog Error TrackingSentryChanged
Three alternativesAppSignal, Firebase Crashlytics, Raygun
Sentry
Five alternativesAirbrake, GlitchTip, Honeybadger, Rollbar, Scout Monitoring
Sentry
Five alternativesAirbrake, Firebase Crashlytics, GlitchTip, Rollbar, TrackJS
no first choiceagainst: Datadog Error Tracking, Elastic, FullStory, LogRocket, New Relic Errors Inbox, Raygun
GPT-5.4 miniSentry
Two alternativesBugsnag, Rollbar
SentryHeld
Three alternativesBugsnag, Datadog Error Tracking, Firebase Crashlytics
Sentry
Two alternativesBugsnag, Rollbar
against: Datadog Error Tracking
Honeybadger
One alternativeRollbar
against: Sentry
no first choiceagainst: Datadog Error Tracking, Sentry
Gemini 3.5 FlashSentry
Three alternativesGlitchTip, Highlight.io, Honeybadger
SentryHeld
Three alternativesHoneybadger, PostHog, Raygun
Sentry
Five alternativesBugsnag, GlitchTip, Highlight.io, Honeybadger, Rollbar
Better Stack, GlitchTip
Three alternativesBugsink, Honeybadger, PostHog
against: Sentry
Honeybadger, Sentry
Two alternativesBugsnag, GlitchTip
against: Datadog Error Tracking, Dynatrace
against: Datadog Error Tracking, Dynatrace, FullStory, LogRocket, New Relic Errors Inbox, Rollbar, Sentry
Perplexity SonarHoneybadger
Three alternativesBetter Stack, GlitchTip, Sentry
BugsnagChanged
Two alternativesFirebase Crashlytics, Sentry
Honeybadger
Five alternativesBetter Stack, Bugsnag, Rollbar, Sentry, TrackJS
Sentry
One alternativeGlitchTip
against: Honeybadger
no first choiceagainst: Datadog Error Tracking
Grok 4.20Sentry
Two alternativesGlitchTip, Honeybadger
against: Bugsnag, Rollbar
SentryHeld
Two alternativesBugsnag, Rollbar
Sentry
Three alternativesGlitchTip, Honeybadger, Rollbar
Sentry
One alternativeGlitchTip
Sentry
Three alternativesBugsnag, Honeybadger, Rollbar
against: AppDynamics, Bugsnag, Datadog Error Tracking, Dynatrace, New Relic Errors Inbox, Raygun
Mistral SmallHoneybadger
Two alternativesBetter Stack, Sentry
BugsnagChangedSentry
Four alternativesBugsnag, GlitchTip, Honeybadger, Raygun
Sentry
Two alternativesDatadog Error Tracking, Rollbar
no first choiceagainst: Datadog Error Trackingagainst: Datadog Error Tracking, New Relic Errors Inbox, Sentry
DeepSeek V4 FlashSentry
One alternativeRollbar
against: Bugsnag
SentryHeld
Three alternativesAirbrake, Honeybadger, Rollbar
Honeybadger, Sentry
Three alternativesBugsnag, GlitchTip, Rollbar
against: Airbrake
Sentry
Three alternativesBugsnag, Honeybadger, Rollbar
Sentry
Three alternativesBugsnag, Honeybadger, Rollbar
against: Bugsnag, Datadog Error Tracking, Dynatrace, New Relic Errors Inbox, Rollbar, Sentry
Llama 4 MaverickHoneybadgerno first choiceChangedno first choice
One alternativeHoneybadger
Sentry
Three alternativesBugsnag, Datadog Error Tracking, New Relic Errors Inbox
no first choiceagainst: Sentry
Qwen 3.7 FlashHoneybadger, Sentry
One alternativeBugsnag
SentryChanged
Two alternativesPostHog, Rollbar
Sentry
Four alternativesBugsnag, Honeybadger, Raygun, Rollbar
Sentry
Two alternativesBugsnag, Rollbar
Sentry
One alternativeRollbar
against: Datadog Error Tracking, New Relic Errors Inbox
against: AppDynamics, Datadog Error Tracking, Dynatrace, GlitchTip, Honeycomb, New Relic Errors Inbox, SigNoz, TrackJS
Kimi K2Sentry
Four alternativesBugsnag, GlitchTip, Honeybadger, Rollbar
HoneybadgerChanged
One alternativeGlitchTip
against: Sentry
Honeybadger, Sentry
Three alternativesBugsnag, LogRocket, Rollbar
against: Raygun
GlitchTip, Honeybadger
Two alternativesRollbar, Sentry
Honeybadger, Sentry
Two alternativesBugsnag, Rollbar
against: Bugsnag, Datadog Error Tracking, Dynatrace, New Relic Errors Inbox, Raygun, Sentry
GLM 4.7 FlashXSentry
Four alternativesBugsnag, Honeybadger, PostHog, Rollbar
SentryHeld
One alternativeRollbar
against: Raygun
Sentry
Five alternativesBugsnag, Honeybadger, LogRocket, Rollbar, TrackJS
against: Datadog Error Tracking, New Relic Errors Inbox
Sentry
Three alternativesGlitchTip, PostHog, Rollbar
Sentry
Two alternativesBugsnag, Rollbar
against: AppSignal, Datadog Error Tracking, Dynatrace, Elastic Stack, Firebase Crashlytics, Honeycomb, Loggly, New Relic Errors Inbox, PostHog, Scout Monitoring, Splunk, Sumo Logic
MiniMax M2.5Rollbar, Sentry
One alternativeBugsnag
SentryChanged
Three alternativesBugsnag, Honeybadger, Rollbar
Rollbar, Sentry
Four alternativesAirbrake, Bugsnag, Honeybadger, Raygun
Sentry
Three alternativesGlitchTip, Honeybadger, Rollbar
no first choiceagainst: Bugsnag, Datadog Error Tracking, Dynatrace, New Relic Errors Inbox, Rollbar
Bold is the first choiceAlternatives are counted; the count opens them.What the answer argued against

The record

One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency. Full answer text is in the free responses file. Download the record
Seventy-two rows: every prompt, every model, every answer.
PromptModelVersion stringTime (UTC)SearchedSourcesLatency
Direct recommendationClaude Haiku 4.5claude-haiku-4-5-202510012026-10-01 12:45no04 s
Direct recommendationGPT-5.4 minigpt-5.4-mini-2026-03-172026-10-01 12:35yes45 s
Direct recommendationGemini 3.5 Flashgemini-3.5-flash2026-10-01 13:40yes721 s
Direct recommendationPerplexity Sonarsonar2026-10-01 11:59yes184 s
Direct recommendationGrok 4.20spacexai/grok-4.1-fast-non-reasoning via vertex2026-10-01 10:32yes176 s
Direct recommendationMistral Smallmistral/mistral-small via mistral2026-10-01 10:04yes53 s
Direct recommendationDeepSeek V4 Flashdeepseek/deepseek-v4-flash via deepinfra2026-10-01 09:24yes2427 s
Direct recommendationLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-10-01 10:18yes52 s
Direct recommendationQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-10-01 12:48yes1043 s
Direct recommendationKimi K2moonshotai/kimi-k2 via novita2026-10-01 11:35yes1420 s
Direct recommendationGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-10-01 08:45yes2129 s
Direct recommendationMiniMax M2.5minimax/minimax-m2.5 via minimax2026-10-01 11:29yes57 s
ParaphraseClaude Haiku 4.5claude-haiku-4-5-202510012026-10-01 11:42yes98 s
ParaphraseGPT-5.4 minigpt-5.4-mini-2026-03-172026-10-01 12:04no02 s
ParaphraseGemini 3.5 Flashgemini-3.5-flash2026-10-01 13:44yes1022 s
ParaphrasePerplexity Sonarsonar2026-10-01 10:06yes203 s
ParaphraseGrok 4.20spacexai/grok-4.1-fast-non-reasoning via vertex2026-10-01 08:48yes245 s
ParaphraseMistral Smallmistral/mistral-small via mistral2026-10-01 07:53yes53 s
ParaphraseDeepSeek V4 Flashdeepseek/deepseek-v4-flash via deepinfra2026-10-01 09:46yes1628 s
ParaphraseLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-10-01 11:53yes52 s
ParaphraseQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-10-01 08:00no029 s
ParaphraseKimi K2moonshotai/kimi-k2 via novita2026-10-01 12:54yes2421 s
ParaphraseGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-10-01 08:28yes25165 s
ParaphraseMiniMax M2.5minimax/minimax-m2.5 via minimax2026-10-01 11:05yes518 s
ComparativeClaude Haiku 4.5claude-haiku-4-5-202510012026-10-01 11:25yes99 s
ComparativeGPT-5.4 minigpt-5.4-mini-2026-03-172026-10-01 09:12yes45 s
ComparativeGemini 3.5 Flashgemini-3.5-flash2026-10-01 08:38yes1124 s
ComparativePerplexity Sonarsonar2026-10-01 09:57yes145 s
ComparativeGrok 4.20spacexai/grok-4.1-fast-non-reasoning via vertex2026-10-01 07:58yes248 s
ComparativeMistral Smallmistral/mistral-small via mistral2026-10-01 10:58yes99 s
ComparativeDeepSeek V4 Flashdeepseek/deepseek-v4-flash via deepinfra2026-10-01 11:03yes2453 s
ComparativeLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-10-01 11:42yes52 s
ComparativeQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-10-01 11:26no031 s
ComparativeKimi K2moonshotai/kimi-k2 via novita2026-10-01 10:31yes1829 s
ComparativeGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-10-01 11:37yes10107 s
ComparativeMiniMax M2.5minimax/minimax-m2.5 via minimax2026-10-01 09:58yes2524 s
Budget constrainedClaude Haiku 4.5claude-haiku-4-5-202510012026-10-01 10:55yes96 s
Budget constrainedGPT-5.4 minigpt-5.4-mini-2026-03-172026-10-01 09:51yes35 s
Budget constrainedGemini 3.5 Flashgemini-3.5-flash2026-10-01 13:17yes1724 s
Budget constrainedPerplexity Sonarsonar2026-10-01 12:54yes194 s
Budget constrainedGrok 4.20spacexai/grok-4.1-fast-non-reasoning via vertex2026-10-01 07:42yes194 s
Budget constrainedMistral Smallmistral/mistral-small via mistral2026-10-01 07:47yes52 s
Budget constrainedDeepSeek V4 Flashdeepseek/deepseek-v4-flash via deepinfra2026-10-01 08:57yes1924 s
Budget constrainedLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-10-01 09:15yes52 s
Budget constrainedQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-10-01 08:08yes517 s
Budget constrainedKimi K2moonshotai/kimi-k2 via novita2026-10-01 11:31yes1524 s
Budget constrainedGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-10-01 08:57yes2548 s
Budget constrainedMiniMax M2.5minimax/minimax-m2.5 via minimax2026-10-01 11:13yes1018 s
Scale constrainedClaude Haiku 4.5claude-haiku-4-5-202510012026-10-01 13:09no05 s
Scale constrainedGPT-5.4 minigpt-5.4-mini-2026-03-172026-10-01 07:59no06 s
Scale constrainedGemini 3.5 Flashgemini-3.5-flash2026-10-01 10:31no015 s
Scale constrainedPerplexity Sonarsonar2026-10-01 11:19yes195 s
Scale constrainedGrok 4.20spacexai/grok-4.1-fast-non-reasoning via vertex2026-10-01 11:46yes913 s
Scale constrainedMistral Smallmistral/mistral-small via mistral2026-10-01 11:44no05 s
Scale constrainedDeepSeek V4 Flashdeepseek/deepseek-v4-flash via deepinfra2026-10-01 07:54yes2137 s
Scale constrainedLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-10-01 08:00yes52 s
Scale constrainedQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-10-01 08:38no030 s
Scale constrainedKimi K2moonshotai/kimi-k2 via novita2026-10-01 11:33yes1119 s
Scale constrainedGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-10-01 10:51yes838 s
Scale constrainedMiniMax M2.5minimax/minimax-m2.5 via minimax2026-10-01 10:46yes524 s
Negative framingClaude Haiku 4.5claude-haiku-4-5-202510012026-10-01 08:56yes159 s
Negative framingGPT-5.4 minigpt-5.4-mini-2026-03-172026-10-01 09:22yes35 s
Negative framingGemini 3.5 Flashgemini-3.5-flash2026-10-01 09:28yes2822 s
Negative framingPerplexity Sonarsonar2026-10-01 11:48yes193 s
Negative framingGrok 4.20spacexai/grok-4.1-fast-non-reasoning via vertex2026-10-01 13:10yes2112 s
Negative framingMistral Smallmistral/mistral-small via mistral2026-10-01 13:03yes137 s
Negative framingDeepSeek V4 Flashdeepseek/deepseek-v4-flash via deepinfra2026-10-01 08:43yes2116 s
Negative framingLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-10-01 09:38yes52 s
Negative framingQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-10-01 07:47yes1344 s
Negative framingKimi K2moonshotai/kimi-k2 via novita2026-10-01 09:35yes2120 s
Negative framingGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-10-01 10:28yes2048 s
Negative framingMiniMax M2.5minimax/minimax-m2.5 via minimax2026-10-01 10:18yes1831 s

Normalization in this category

Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.

ShowHide
Category-scoped readings
Datadog read as Datadog Error Tracking
New Relic read as New Relic Errors Inbox
Unresolved, counted raw
AppMetrica
Microsoft Clarity
Discontinued, still offered
No shut-down product was recommended here.
← DASTFeature flags →