Error and crash monitoring
Asked as “error monitoring tool”, and as “application error and crash reporting service”, on behalf of a mid-market B2B company. 51 first choices recorded across the direct, paraphrase, budget and scale prompts, fourteen models each.
Standing · first-choice share
76%
Clear leader
76Sentry08Rollbar04Bugsnag12others
76% of first choices, clear leader.
Since September 2026▼−5Since September 2026: 82% → 77%, −5 points. Inside the 11-point floor: within noise. Read over the models both editions asked.Sentry held the lead, −5 points on 82%, inside the 11-point floor.
By buyer segment
The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.
Small business
Sentry69%Clear leader▼−11Since September 2026: 79% → 67%, −11 points. Past the 11-point floor: movement. Read over the models both editions asked.Standing →Mid-marketSentry76%Clear leader▼−5Since September 2026: 82% → 77%, −5 points. Inside the 11-point floor: within noise. Read over the models both editions asked.This pageEnterpriseSentry75%Clear leader▲+11Since September 2026: 62% → 73%, +11 points. Inside the 11-point floor: within noise. Read over the models both editions asked.Standing →
Sentry69%Clear leader▼−11Since September 2026: 79% → 67%, −11 points. Past the 11-point floor: movement. Read over the models both editions asked.Standing →Mid-marketSentry76%Clear leader▼−5Since September 2026: 82% → 77%, −5 points. Inside the 11-point floor: within noise. Read over the models both editions asked.This pageEnterpriseSentry75%Clear leader▲+11Since September 2026: 62% → 73%, +11 points. Inside the 11-point floor: within noise. Read over the models both editions asked.Standing →The standing
Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all fourteen models, for a mid-market B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrantSince September 2026
01Sentry76%16%76endorsed leader▼−5Since September 2026: 82% → 77%, −5 points. Inside the 11-point floor: within noise. Read over the models both editions asked.82% → 77%
Sentry76%16%76endorsed leader▼−5Since September 2026: 82% → 77%, −5 points. Inside the 11-point floor: within noise. Read over the models both editions asked.82% → 77%02
Rollbar8%5%56accepted challenger▼−7Since September 2026: 14% → 7%, −7 points. Inside the 11-point floor: within noise. Read over the models both editions asked.14% → 7%
Rollbar8%5%56accepted challenger▼−7Since September 2026: 14% → 7%, −7 points. Inside the 11-point floor: within noise. Read over the models both editions asked.14% → 7%03
Bugsnag4%7%56accepted challenger▲+5Since September 2026: 0% → 5%, +5 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 5%
Bugsnag4%7%56accepted challenger▲+5Since September 2026: 0% → 5%, +5 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 5%04
GlitchTip2%9%23accepted challenger=heldSince September 2026: 2% → 2%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.2% → 2%
GlitchTip2%9%23accepted challenger=heldSince September 2026: 2% → 2%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.2% → 2%05
Raygun2%5%20accepted challenger▲+2Since September 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 2%
Raygun2%5%20accepted challenger▲+2Since September 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 2%06
Datadog Error Tracking2%43%46criticized challenger▲+2Since September 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 2%
Datadog Error Tracking2%43%46criticized challenger▲+2Since September 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 2%Show the five products at 0%, ordered by negative rate
11
New Relic Errors Inbox0%41%32criticized challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%
New Relic Errors Inbox0%41%32criticized challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%10
Airbrake0%20%10accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%
Airbrake0%20%10accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%09
LogRocket0%15%20accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%
LogRocket0%15%20accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%07
Honeybadger0%4%23accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%
Honeybadger0%4%23accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%08
Firebase Crashlytics Lab in the set0%0%12accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%
Firebase Crashlytics Lab in the set0%0%12accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%The floor is 11 points of share, measured: how far the models move a leader on their own when the same questions are asked twice with nothing changed. A larger change is movement; a smaller one is noise, and both are shown. Movement is read over the twelve models both editions asked; GPT-6 Luna, Muse Glimmer 30B joined this edition and are in the standing but not yet in the comparison. How the floor is measured
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its product page.
Firebase Crashlytics is made by Google, whose model Gemini 3.5 Flash is in the set. On the four share prompts that model made it the first choice zero times of 4; the other thirteen models zero times of 52. Lab treatment is defined on the method page; the row is marked, not excluded.
All fifteen head-to-head pages: the top six products, each against each
One product takes 76% of first choices here, so the chart would put ten markers in one corner and one at the far edge. The two measurements it plots are columns in the standing above: share, and the negative label rate. Two products carry a negative rate above 25% in this category.
What they warned about
Ten of fourteen models held their first choice under the paraphrase. Claude Haiku 4.5, Mistral Small, Llama 4 Maverick and Muse Glimmer 30B changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
Datadog Error Tracking43%
20 of 46 labels negative · 11 of 14 models · 3 hard negative
“*Avoid if*: You're not already in their ecosystem—adds unnecessary infra monitoring bloat.” Grok 4.1 Fast, negative prompt
Sentry16%
12 of 76 labels negative · 9 of 14 models
“Recent CVE tracking shows active issues in the Sentry stack... That is not a reason to avoid Sentry, but it illustrates why patch velocity... are listed as evaluation criteria” Muse Glimmer 30B, negative prompt
New Relic Errors Inbox41%
13 of 32 labels negative · 7 of 14 models · 3 hard negative
“Avoid: Datadog or New Relic for *just* error monitoring—they're overkill and overpriced” Kimi K2, direct prompt
Bugsnag7%
4 of 56 labels negative · 4 of 14 models
“some developers caution against it due to changes in billing and packaging post-acquisition” Gemini 3.5 Flash, negative prompt
What they cite
Citations exist only for the models that return a source list: fourteen of the fourteen in this edition, and all six flagship models on the expanded tier.
Sites the answers cite
76 of 84 answers in this category came back with a source list, from 14 of 14 models: citations where the model returns them, or the search results it consulted. 984 links across 202 sites, every framing counted. Ranked by the number of answers carrying the site or page. 19 of the 252 answers across every segment cited this index's own page for the category; the method page measures whether that reading tilts an answer.
vendor site · ONES.com48 answers · 96 citations · 11 models
vendor site · Guideflow37 answers · 39 citations · 12 models
35 answers · 42 citations · 11 models
vendor site · Scout APM23 answers · 26 citations · 11 models
vendor site · Rollbar22 answers · 34 citations · 9 models
vendor site · Sentry22 answers · 24 citations · 9 models
vendor site · ZipDo.co21 answers · 28 citations · 8 models
20 answers · 22 citations · 6 models
18 answers · 18 citations · 9 models
17 answers · 18 citations · 8 models
16 answers · 17 citations · 9 models
16 answers · 16 citations · 10 models
Pages the answers cite
The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.
37 answers · 12 models
34 answers · 11 models
33 answers · 10 models
23 answers · 10 models
23 answers · 9 models
19 answers · 6 models
19 answers · 8 models
18 answers · 9 models
16 answers · 10 models
15 answers · 8 models
Search against answers
Each company's standing in the answers beside its site's footprint in Google search, one row a site: the products the models named on it with their shares, and the share they add up to; monthly searches on Google, and DataForSEO's estimate of AI search demand (modeled from search signals, directional, not a count of queries to any assistant), for the most-searched of the company's and its products' names (the name is in each row's hover text); estimated monthly organic visits to the site; and its best position in Google's top ten for “best error monitoring tool”, “error monitoring tool”, “error monitoring tools”. US estimates from DataForSEO and Google's Ads Transparency Center. A small company's site, or a mid-sized company's site for its flagship, is marked company; a product on a large parent's site (Google, Microsoft) has no site figures. A column with no figures for this category is left out, and an empty cell means none were seen, not none exist. Two measurements side by side: neither is read as the cause of the other.
| Company and products | Share | Own site cited | Name searches, Google | AI search demand, est. | Organic visits | Google ads, last 30 days | Best Google position |
|---|---|---|---|---|---|---|---|
| Sentry sentry.io | 76% | 269 | 90,500 | 21,086 | 254,686 | 120 | 1 |
| Rollbar rollbar.com | 8% | 154 | 5,400 | 175 | 12,382 | 5 | 5 |
| Bugsnag bugsnag.com | 4% | 146 | 1,600 | 23 | 1,512 | 4 | 6 |
| GlitchTip glitchtip.com | 2% | 66 | 590 | 9 | 250 | 8 | |
| Raygun raygun.com | 2% | 53 | 60,500 | 1,699 | 21,222 | 29 | 5 |
| PostHog posthog.com | 2% | 23 | 33,100 | 271 | 25,936 | 120 | 8 |
| Scout scoutapm.com Scout Monitoring 2% | 2% | 4 | 50 | 4 | 4,420 company | 1 | 2 |
| PostHog Error Tracking | 2% | ||||||
| Datadog parent site Datadog Error Tracking 2% | 2% | 122 | 74,000 | 3,541 | |||
| Honeybadger honeybadger.io | 0% | 86 | 201,000 | 98 | 13,851 |
Google's top ten for the three searches hold 13 sites; 3 of them are among the sites the models cited here (rollbar.com, scoutapm.com, sentry.io). The first result for “best error monitoring tool” is sentry.io.
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.ShowHide
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ShowHideModelDirect“What is the best error monitoring tool for a mid-market B2B company?”Paraphrase“Which application error and crash reporting service would you recommend to a mid-sized B2B company?”Comparative“What are the top error monitoring tools and how do they differ?”Budget-constrained“What is the best error monitoring tool for a company with a limited budget?”Scale-constrained“We are a 500 person company evaluating an error monitoring tool. What should we look at?”Negative“Which error monitoring tools should I avoid or be cautious about?”
Claude Haiku 4.5SentryRaygun, SentryChangedSentrySentryagainst: Elastic Stackno first choicenothing named
Two alternatives
Honeybadger, RollbarTwo alternatives
Bugsnag, Firebase CrashlyticsFour alternatives
Bugsnag, Datadog Error Tracking, Firebase Crashlytics, RollbarSix alternatives
Bugsnag, Grafana Cloud, LogRocket, New Relic Errors Inbox, Raygun, RollbarGPT-5.4 miniSentryagainst: Datadog Error TrackingSentryHeldagainst: Datadog Error TrackingSentryagainst: Datadog Error Tracking, New Relic Errors InboxGlitchTipagainst: Sentryno first choiceagainst: Bugsnag, New Relic Errors Inbox, Sentry
Two alternatives
Bugsnag, RollbarTwo alternatives
Bugsnag, RollbarThree alternatives
Bugsnag, Honeybadger, RollbarOne alternative
RollbarGemini 3.5 FlashSentryagainst: Datadog Error Tracking, New Relic Errors InboxSentryHeldSentryagainst: Datadog Error Tracking, New Relic Errors InboxPostHogagainst: Highlight.io, SentrySentryagainst: Datadog Error Tracking, Dynatrace, New Relic Errors Inboxagainst: Airbrake, Bugsnag, Datadog Error Tracking, Dynatrace, FullStory, LogRocket, New Relic Errors Inbox, PostHog, Sentry
Three alternatives
LogRocket, Raygun, RollbarThree alternatives
Bugsnag, PostHog, RaygunSix alternatives
Bugsink, Bugsnag, GlitchTip, LogRocket, Raygun, RollbarThree alternatives
Bugsink, Firebase Crashlytics, GlitchTipTwo alternatives
Bugsnag, LogRocketPerplexity SonarSentrySentryHeldSentrySentryno first choicenothing named
Three alternatives
Better Stack, GlitchTip, HoneybadgerTwo alternatives
Bugsnag, Firebase CrashlyticsSix alternatives
Better Stack, Bugsnag, Firebase Crashlytics, LogRocket, New Relic Errors Inbox, RollbarTwo alternatives
Crashlytics, HoneybadgerGrok 4.1 FastSentryagainst: Datadog Error Tracking, New Relic Errors InboxSentryHeldSentryagainst: Datadog Error Tracking, New Relic Error TrackingSentryno first choiceagainst: Bugsnag, Datadog Error Tracking, New Relic Errors Inbox, Rollbar, Scout APM, Sentry
Two alternatives
Bugsnag, RollbarThree alternatives
Bugsnag, GlitchTip, RollbarFive alternatives
Bugsnag, Honeybadger, LogRocket, Raygun, RollbarFour alternatives
GlitchTip, Highlight.io, Rollbar, UptraceMistral SmallRollbar, Scout MonitoringBugsnagChangedSentrySentryno first choiceagainst: Datadog Error Tracking, New Relic Errors Inbox, Scout APM, Sentry
One alternative
AirbrakeFour alternatives
Airbrake, Bugsnag, Raygun, RollbarTwo alternatives
GlitchTip, HoneybadgerDeepSeek V4 FlashSentryagainst: Datadog Error TrackingSentryHeldSentrySentryno first choiceagainst: Bugsnag, CatchJS, Datadog Error Tracking, Errorception, Honeybadger, Raygun, Rollbar, Sentry, TrackJS
Three alternatives
Bugsnag, New Relic Errors Inbox, RollbarFour alternatives
Bugsnag, Datadog Error Tracking, Raygun, RollbarSeven alternatives
Airbrake, Bugsnag, Datadog Error Tracking, GlitchTip, New Relic Errors Inbox, Rollbar, TrackJSTwo alternatives
GlitchTip, RollbarLlama 4 MaverickRollbarBugsnagChangedno first choiceSentryno first choicenothing named
One alternative
BugsnagTwo alternatives
Airbrake, RaygunQwen 3.7 FlashSentrySentryHeldSentrySentryRollbar, Sentryagainst: Adobe Analytics, Airbrake, Datadog Error Tracking, GlitchTip, Google Analytics, New Relic Errors Inbox, Stackify, TrackJS
Three alternatives
Bugsnag, Datadog Error Tracking, HoneybadgerTwo alternatives
Raygun, RollbarFour alternatives
Bugsnag, Datadog Error Tracking, New Relic Errors, RollbarThree alternatives
Firebase Crashlytics, GlitchTip, HoneybadgerTwo alternatives
Bugsnag, Datadog Error TrackingKimi K2Sentryagainst: Datadog Error Tracking, New Relic Errors InboxSentryHeldSentrySentryDatadog Error Tracking, Sentryagainst: Datadog Error Tracking, LogRocket, New Relic Errors Inbox, Sentry
Three alternatives
Bugsnag, Honeybadger, RollbarThree alternatives
Bugsnag, Datadog Error Tracking, RollbarFour alternatives
Bugsnag, Datadog Error Tracking, GlitchTip, LogRocketFour alternatives
Bugsink, Firebase Crashlytics, GlitchTip, RollbarGLM 4.7 FlashXSentryagainst: Datadog Error TrackingSentryHeldSentrySentrySentrynothing named
Three alternatives
Bugsnag, LogRocket, RollbarTwo alternatives
Bugsnag, RaygunEight alternatives
Bugsnag, Datadog Error Tracking, LogRocket, New Relic Errors Inbox, PostHog, Raygun, Rollbar, TrackJSFour alternatives
Bugsnag, LogRocket, New Relic Errors Inbox, RollbarFour alternatives
Bugsnag, Datadog Error Tracking, Honeybadger, RollbarMiniMax M2.5SentrySentryHeldno first choiceSentryno first choiceagainst: Datadog Error Tracking, Sentry
Three alternatives
Bugsnag, Datadog Error Tracking, RollbarThree alternatives
Firebase Crashlytics, Raygun, RollbarFour alternatives
Bugsnag, GlitchTip, Honeybadger, New Relic Errors InboxGPT-6 LunaSentrySentryHeldSentryPostHog Error Trackingno first choiceagainst: Datadog Error Tracking, GlitchTip, Rollbar, Sentry
Two alternatives
Datadog Error Tracking, New Relic Errors InboxTwo alternatives
Bugsnag, Datadog Error TrackingFour alternatives
Bugsnag, Datadog Error Tracking, Honeybadger, New Relic Errors InboxTwo alternatives
GlitchTip, SentryMuse Glimmer 30BRollbar, SentrySentryChangedSentryagainst: Datadog Error Tracking, New Relic Errors InboxSentryno first choiceagainst: Sentryagainst: LogRocket, Sentry
Three alternatives
Datadog Error Tracking, Honeybadger, Scout MonitoringFive alternatives
Airbrake, Bugsnag, Datadog Error Tracking, New Relic Errors Inbox, RollbarThree alternatives
Bugsnag, Honeybadger, RollbarThree alternatives
Bugsnag, GlitchTip, HoneybadgerBold is the first choiceAlternatives are counted; the count opens them.What the answer argued against
The record
One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency. Full answer text is in the free responses file. Download the record
Eighty-four rows: every prompt, every model, every answer.
| Prompt | Model | Version string | Time (UTC) | Searched | Sources | Latency |
|---|---|---|---|---|---|---|
| Direct recommendation | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 10:34 | yes | 9 | 8 s |
| Direct recommendation | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 11:30 | yes | 4 | 5 s |
| Direct recommendation | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 10:38 | yes | 13 | 29 s |
| Direct recommendation | Perplexity Sonar | sonar | 2026-10-01 07:55 | yes | 22 | 3 s |
| Direct recommendation | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 07:46 | yes | 24 | 7 s |
| Direct recommendation | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 10:25 | yes | 5 | 2 s |
| Direct recommendation | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 10:17 | yes | 24 | 17 s |
| Direct recommendation | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 08:37 | yes | 5 | 1 s |
| Direct recommendation | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 11:13 | no | 0 | 37 s |
| Direct recommendation | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 10:06 | yes | 14 | 17 s |
| Direct recommendation | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 09:54 | yes | 18 | 44 s |
| Direct recommendation | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 11:37 | yes | 5 | 20 s |
| Direct recommendation | GPT-6 Luna | gpt-6-luna | 2026-10-01 08:10 | yes | 3 | 13 s |
| Direct recommendation | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 10:57 | yes | 15 | 16 s |
| Paraphrase | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 10:32 | yes | 9 | 8 s |
| Paraphrase | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 09:19 | yes | 5 | 4 s |
| Paraphrase | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 10:14 | yes | 11 | 28 s |
| Paraphrase | Perplexity Sonar | sonar | 2026-10-01 09:21 | yes | 19 | 3 s |
| Paraphrase | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 13:32 | yes | 24 | 7 s |
| Paraphrase | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 07:59 | yes | 5 | 2 s |
| Paraphrase | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 11:09 | yes | 20 | 22 s |
| Paraphrase | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 08:19 | yes | 5 | 2 s |
| Paraphrase | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 12:59 | yes | 5 | 30 s |
| Paraphrase | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 13:09 | yes | 20 | 19 s |
| Paraphrase | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 09:54 | yes | 25 | 71 s |
| Paraphrase | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 13:19 | yes | 5 | 15 s |
| Paraphrase | GPT-6 Luna | gpt-6-luna | 2026-10-01 12:44 | yes | 4 | 16 s |
| Paraphrase | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 10:53 | yes | 14 | 19 s |
| Comparative | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 09:28 | yes | 9 | 9 s |
| Comparative | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 08:28 | yes | 3 | 7 s |
| Comparative | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 13:36 | yes | 16 | 30 s |
| Comparative | Perplexity Sonar | sonar | 2026-10-01 12:00 | yes | 16 | 5 s |
| Comparative | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 11:47 | yes | 18 | 9 s |
| Comparative | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 07:55 | yes | 6 | 5 s |
| Comparative | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 08:48 | yes | 23 | 29 s |
| Comparative | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 10:56 | yes | 5 | 1 s |
| Comparative | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 07:53 | yes | 5 | 20 s |
| Comparative | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 08:18 | yes | 14 | 27 s |
| Comparative | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 12:24 | yes | 22 | 56 s |
| Comparative | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 08:52 | yes | 5 | 18 s |
| Comparative | GPT-6 Luna | gpt-6-luna | 2026-10-01 07:51 | yes | 6 | 23 s |
| Comparative | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 12:23 | yes | 13 | 22 s |
| Budget constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 08:32 | no | 0 | 4 s |
| Budget constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 11:41 | yes | 3 | 4 s |
| Budget constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 13:50 | yes | 20 | 23 s |
| Budget constrained | Perplexity Sonar | sonar | 2026-10-01 10:02 | yes | 18 | 3 s |
| Budget constrained | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 09:48 | yes | 23 | 8 s |
| Budget constrained | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 11:42 | yes | 5 | 6 s |
| Budget constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 09:21 | yes | 24 | 29 s |
| Budget constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 09:44 | yes | 5 | 1 s |
| Budget constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 10:03 | yes | 5 | 35 s |
| Budget constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 10:30 | yes | 15 | 18 s |
| Budget constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 12:27 | no | 0 | 20 s |
| Budget constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 12:59 | yes | 9 | 14 s |
| Budget constrained | GPT-6 Luna | gpt-6-luna | 2026-10-01 09:05 | yes | 3 | 9 s |
| Budget constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 12:19 | yes | 13 | 22 s |
| Scale constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 09:41 | no | 0 | 5 s |
| Scale constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 13:19 | no | 0 | 5 s |
| Scale constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 09:52 | no | 0 | 15 s |
| Scale constrained | Perplexity Sonar | sonar | 2026-10-01 12:39 | yes | 19 | 6 s |
| Scale constrained | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 08:23 | yes | 14 | 7 s |
| Scale constrained | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 09:36 | no | 0 | 7 s |
| Scale constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 12:19 | yes | 24 | 67 s |
| Scale constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 13:13 | yes | 5 | 2 s |
| Scale constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 12:17 | yes | 8 | 39 s |
| Scale constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 12:52 | yes | 15 | 21 s |
| Scale constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 10:16 | yes | 18 | 66 s |
| Scale constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 12:46 | yes | 5 | 30 s |
| Scale constrained | GPT-6 Luna | gpt-6-luna | 2026-10-01 11:51 | yes | 2 | 12 s |
| Scale constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 12:54 | yes | 19 | 26 s |
| Negative framing | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 11:29 | no | 0 | 3 s |
| Negative framing | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 10:18 | yes | 3 | 7 s |
| Negative framing | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 13:31 | yes | 23 | 24 s |
| Negative framing | Perplexity Sonar | sonar | 2026-10-01 11:21 | yes | 24 | 5 s |
| Negative framing | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 07:54 | yes | 21 | 8 s |
| Negative framing | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 11:55 | yes | 5 | 4 s |
| Negative framing | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 10:09 | yes | 23 | 48 s |
| Negative framing | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 08:50 | yes | 5 | 1 s |
| Negative framing | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 09:08 | yes | 23 | 102 s |
| Negative framing | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 13:40 | yes | 25 | 27 s |
| Negative framing | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 10:26 | yes | 16 | 112 s |
| Negative framing | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 10:29 | yes | 23 | 29 s |
| Negative framing | GPT-6 Luna | gpt-6-luna | 2026-10-01 10:34 | yes | 4 | 13 s |
| Negative framing | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 13:06 | yes | 24 | 34 s |
Normalization in this category
Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.
ShowHide
Category-scoped readings
Datadog read as Datadog Error Tracking
Datadog (Error Tracking) read as Datadog Error Tracking
ELK Stack read as Elastic Stack
New Relic read as New Relic Errors Inbox
New Relic One read as New Relic Errors Inbox
Unresolved, counted raw
Adobe Analytics
Crashlytics
Grafana Faro
New Relic Error Tracking
New Relic Errors
PostHog Error Tracking
Stackify (Retrace)
UXCam
Discontinued, still offered
No shut-down product was recommended here.