IT AI Index
September 2026 Edition · The permanent record of this edition. The unqualified address always carries the latest edition.
Index IT operations and endpoint September 2026 Edition

Application performance monitoring

Asked as “APM tool”, and as “application performance monitoring solution”, on behalf of a mid-market B2B company. 46 first choices recorded across the direct, paraphrase, budget and scale prompts, twelve models each.
Standing
Clear leader
54% of first choices, clear leader.

By buyer segment

The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.

01The standing

Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all twelve models, for a mid-market B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrant
01New Relic54%15%67endorsed leader
02SigNoz13%4%23accepted challenger
03Datadog11%37%62criticized challenger
04Grafana Cloud4%0%24accepted challenger
05IBM Instana2%7%14accepted challenger
06Honeycomb2%9%11accepted challenger
Show the four products at 0%, ordered by negative rate
10Dynatrace0%42%45criticized challenger
09AppDynamics0%27%26criticized challenger
07Sentry0%0%14accepted challenger
08Elastic APM0%0%13accepted challenger
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its vendor page.

One product takes 54% of first choices here, so the chart would put nine markers in one corner and one at the far edge. The two measurements it plots are columns in the standing above: share, and the negative label rate. Three products carry a negative rate above 25% in this category. Jump to the standing

02What they warned about

Seven of twelve models held their first choice under the paraphrase. Claude Haiku 4.5, Mistral Small, Llama 4 Maverick, GLM 4.7 FlashX and MiniMax M2.5 changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
Datadog
37%
23 of 62 labels negative · 11 of 12 models · 2 hard negative
“High Caution: Major Commercial APM Vendors ... Unpredictable pricing - Bills can triple or quadruple at scale” Kimi K2, negative prompt
Dynatrace
42%
19 of 45 labels negative · 10 of 12 models · 2 hard negative
“Most expensive at scale among commercial APMs ... Memory-based pricing makes bills unpredictable” Kimi K2, negative prompt
New Relic
15%
10 of 67 labels negative · 8 of 12 models · 1 hard negative
“Pricing model confusion ... Stability concerns - users report "laughable" stability in some regions” Kimi K2, negative prompt
AppDynamics
27%
7 of 26 labels negative · 7 of 12 models · 2 hard negative
“Scalability issues - doesn't scale well; requires multiple controllers that don't communicate” Kimi K2, negative prompt

03What they cite

Citations exist only for the models that return a source list: twelve of the twelve in this edition, and all six flagship models on the expanded tier.

Sites the answers cite

63 of 72 answers in this category came back with a source list, from 12 of 12 models: citations where the model returns them, or the search results it consulted. 5 of those lists are Google grounding redirects that name no site and are left out of the counts. 773 links across 173 sites, every framing counted. Ranked by the number of answers carrying the site or page.

vendor site · New Relic26 answers · 40 citations · 8 models
vendor site · ManageEngine26 answers · 30 citations · 10 models
26 answers · 26 citations · 10 models
24 answers · 49 citations · 9 models
vendor site · CubeAPM24 answers · 27 citations · 10 models
vendor site · OpenObserve21 answers · 24 citations · 7 models
vendor site · Rollbar21 answers · 21 citations · 9 models
vendor site · Instatus20 answers · 20 citations · 8 models
vendor site · Motadata16 answers · 16 citations · 8 models
16 answers · 16 citations · 8 models
15 answers · 16 citations · 8 models
15 answers · 15 citations · 6 models

Pages the answers cite

The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.

04How they answered

Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ModelDirect“What is the best APM tool for a mid-market B2B company?”Paraphrase“Which application performance monitoring solution would you recommend to a mid-sized B2B company?”Comparative“What are the top APM tools and how do they differ?”Budget-constrained“What is the best APM tool for a company with a limited budget?”Scale-constrained“We are a 500 person company evaluating a APM tool. What should we look at?”Negative“Which APM tools should I avoid or be cautious about?”
Claude Haiku 4.5no first choiceagainst: DynatraceIBM Instana, SigNozChanged
One alternativeElastic APM
ManageEngine OpManager NexusNew Relic
Three alternativesAtatus, Elastic, Scout APM
no first choiceagainst: Datadog
GPT-5.4 miniNew Relic
Four alternativesAppDynamics, Datadog, Dynatrace, Grafana Cloud
New RelicHeld
Three alternativesAppDynamics, Datadog, Dynatrace
no first choice
Five alternativesAppDynamics, Datadog, Dynatrace, Elastic APM, New Relic
Grafana Cloud
Three alternativesElastic Observability, New Relic, OpenTelemetry
against: Datadog
no first choicenothing named
Gemini 3.5 FlashNew Relic
Two alternativesHoneycomb, Sentry
against: Datadog
New RelicHeld
Four alternativesGrafana Cloud, Honeycomb, Sentry, SigNoz
against: Datadog, Dynatrace
Datadog
Five alternativesAppDynamics, Dynatrace, Grafana Cloud / LGTM Stack, Honeycomb, New Relic
Grafana Cloud, New Relic
Four alternativesAppSignal, OpenObserve, Sentry, SigNoz
against: Datadog, Dynatrace
Honeycomb
Four alternativesGrafana Cloud, Highlight.io, Sentry, SigNoz
against: Datadog, Dynatrace, New Relic
against: AppDynamics, Datadog, Dynatrace, Grafana, Jaeger, New Relic, Prometheus, SigNoz, Splunk APM
Perplexity SonarNew Relic
Three alternativesDatadog, Dynatrace, ManageEngine Applications Manager / OpManager Nexus
New RelicHeld
Five alternativesDatadog, IBM Instana, ManageEngine Applications Manager, Site24x7, SolarWinds Observability
Datadog
Six alternativesAppDynamics, Dynatrace, Elastic APM, New Relic, SigNoz, Splunk APM
New Relic, Scout APM
Two alternativesCubeAPM, SigNoz
against: Grafana + Prometheus
no first choiceagainst: AppDynamics, Datadog, Dynatrace, Honeycomb, New Relic, Splunk Observability Cloud
Grok 4.1 FastNew Relic
Three alternativesDatadog, ManageEngine Applications Manager, SolarWinds
New RelicHeld
Four alternativesDatadog, Dynatrace, SigNoz, Site24x7
Datadog
Two alternativesDynatrace, New Relic
New Relic
One alternativeSigNoz
against: Datadog, Jaeger, Prometheus + Grafana
no first choiceagainst: AppDynamics, Broadcom DX APM, Datadog, Dynatrace, New Relic
Mistral SmallNew Relic
One alternativeDatadog
Datadog, New RelicChanged
Two alternativesIBM Instana, ManageEngine Applications Manager
Datadog APM
Three alternativesDynatrace, Elastic APM, New Relic
New Relic, SigNoz
One alternativeGrafana + Prometheus
against: CubeAPM
no first choiceagainst: AppDynamics
DeepSeek V4 FlashNew Relic
One alternativeManageEngine Applications Manager
against: Datadog, Dynatrace
New RelicHeld
Two alternativesDatadog, Grafana Cloud
against: Dynatrace
Datadog, Dynatrace
Five alternativesAppDynamics, Elastic APM, Honeycomb, New Relic, Open-source
New Relic, SigNoz
Four alternativesAtatus, Grafana, Prometheus, Sentry
against: Datadog
New Relic
One alternativeSigNoz
against: Datadog
against: AppDynamics, Azure Monitor Application Insights, Broadcom DX APM, Datadog, Dynatrace, IBM Instana
Llama 4 Maverickno first choiceSite24x7Changed
Five alternativesDatadog, Dynatrace, IBM Instana, ManageEngine Applications Manager, New Relic
no first choiceManageEngine OpManager Nexus
Three alternativesAtatus, CubeAPM, ToolRadar
no first choiceagainst: Datadog, Dynatrace, New Relic, Splunk
Qwen 3.7 FlashDatadog
Three alternativesIBM Instana, New Relic, Sentry
DatadogHeld
Three alternativesGrafana Cloud, Honeycomb, New Relic
Datadog
Six alternativesAppDynamics, Dynatrace, Elastic APM, IBM Instana, New Relic, Sentry
New Relic, SigNoz
Five alternativesElastic APM, Grafana Stack, ManageEngine OpManager Nexus, OpenObserve, Site24x7
against: Datadog, Dynatrace
Datadog
Two alternativesDynatrace, New Relic
against: AppDynamics
against: Apache SkyWalking, Datadog, Dynatrace, Jaeger, New Relic, OpenTelemetry
Kimi K2New Relic
Two alternativesManageEngine Applications Manager, SolarWinds
against: Datadog
New RelicHeld
Four alternativesAtatus, ManageEngine Applications Manager, Sentry, SigNoz
against: Datadog, Dynatrace
Datadog
Four alternativesAppDynamics, Dynatrace, Grafana Cloud / Open Source Stack, New Relic
SigNoz
Three alternativesNew Relic, Prometheus + Grafana + Loki + Tempo, Sentry
New Relic
Three alternativesDatadog, Dynatrace, Site24x7
against: AppDynamics, Datadog, Dynatrace, New Relic
GLM 4.7 FlashXNew Relic
Seven alternativesAppDynamics, Datadog, Grafana/Tempo, OpenObserve, OpenTelemetry, SigNoz, SolarWinds Applications Manager
against: Dynatrace
no first choiceChangedDatadog
Nine alternativesAppDynamics, Azure Monitor Application Insights, Dynatrace, Elastic APM, Grafana Cloud, IBM Instana, New Relic, Sentry, SolarWinds Observability
OpenObserve, SigNoz
Three alternativesGrafana Cloud, New Relic, Prometheus + Grafana
no first choiceagainst: Datadog, Dynatrace, LogicMonitor LM APM Synthetics, ManageEngine Applications Manager, New Relic, SAP Legacy APM Products, Site24x7, SolarWinds AppOptics
MiniMax M2.5ManageEngine Applications Manager, SolarWinds APM
One alternativePandora FMS
DatadogChanged
Two alternativesIBM Instana, New Relic
Datadog, Dynatrace
Four alternativesIBM Instana, LogRocket, New Relic, Sentry
New Relic
Three alternativesElastic APM, Grafana Cloud, Sentry
no first choiceagainst: Datadog, Dynatrace, New Relicagainst: Datadog, Dynatrace, New Relic
Bold is the first choiceAlternatives are counted; the count opens them.What the answer argued against

05The record

One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency. Full answer text is in the free responses file. Download the record
Seventy-two rows: every prompt, every model, every answer.
PromptModelVersion stringTime (UTC)SearchedSourcesLatency
Direct recommendationClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 11:56no05 s
Direct recommendationGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 11:51yes65 s
Direct recommendationGemini 3.5 Flashgemini-3.5-flash2026-09-17 10:12yes1327 s
Direct recommendationPerplexity Sonarsonar2026-09-17 10:25yes205 s
Direct recommendationGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 12:28yes3819 s
Direct recommendationMistral Smallmistral/mistral-small via mistral2026-09-17 10:22yes54 s
Direct recommendationDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 11:40yes2017 s
Direct recommendationLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 13:54yes53 s
Direct recommendationQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 09:24no042 s
Direct recommendationKimi K2moonshotai/kimi-k2 via novita2026-09-17 12:17yes929 s
Direct recommendationGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 12:10yes14158 s
Direct recommendationMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 09:32yes514 s
ParaphraseClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 10:37yes1810 s
ParaphraseGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 12:25yes36 s
ParaphraseGemini 3.5 Flashgemini-3.5-flash2026-09-17 11:43yes1022 s
ParaphrasePerplexity Sonarsonar2026-09-17 09:31yes205 s
ParaphraseGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 12:21yes199 s
ParaphraseMistral Smallmistral/mistral-small via mistral2026-09-17 09:51yes56 s
ParaphraseDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 13:16yes2017 s
ParaphraseLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 14:11yes54 s
ParaphraseQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 09:54no040 s
ParaphraseKimi K2moonshotai/kimi-k2 via novita2026-09-17 11:56yes1958 s
ParaphraseGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 11:56yes1012 s
ParaphraseMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 11:35yes1023 s
ComparativeClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 10:39yes98 s
ComparativeGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 10:23yes57 s
ComparativeGemini 3.5 Flashgemini-3.5-flash2026-09-17 11:09yes1925 s
ComparativePerplexity Sonarsonar2026-09-17 11:02yes2010 s
ComparativeGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 13:19yes2513 s
ComparativeMistral Smallmistral/mistral-small via mistral2026-09-17 11:12yes57 s
ComparativeDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 10:13yes1017 s
ComparativeLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 12:52yes53 s
ComparativeQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 10:55yes1060 s
ComparativeKimi K2moonshotai/kimi-k2 via novita2026-09-17 14:02yes927 s
ComparativeGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 10:23yes2543 s
ComparativeMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 13:26yes1549 s
Budget constrainedClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 12:48yes99 s
Budget constrainedGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 09:24no04 s
Budget constrainedGemini 3.5 Flashgemini-3.5-flash2026-09-17 10:09yes1222 s
Budget constrainedPerplexity Sonarsonar2026-09-17 12:02yes205 s
Budget constrainedGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 09:58yes136 s
Budget constrainedMistral Smallmistral/mistral-small via mistral2026-09-17 10:07yes56 s
Budget constrainedDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 10:08yes1012 s
Budget constrainedLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 13:53yes52 s
Budget constrainedQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 11:21yes524 s
Budget constrainedKimi K2moonshotai/kimi-k2 via novita2026-09-17 11:03yes1327 s
Budget constrainedGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 12:38yes1033 s
Budget constrainedMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 11:01yes525 s
Scale constrainedClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 13:42no07 s
Scale constrainedGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 12:50no06 s
Scale constrainedGemini 3.5 Flashgemini-3.5-flash2026-09-17 11:37no015 s
Scale constrainedPerplexity Sonarsonar2026-09-17 09:30yes178 s
Scale constrainedGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 12:35yes1311 s
Scale constrainedMistral Smallmistral/mistral-small via mistral2026-09-17 11:24no06 s
Scale constrainedDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 09:54yes1425 s
Scale constrainedLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 13:26yes54 s
Scale constrainedQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 13:08no041 s
Scale constrainedKimi K2moonshotai/kimi-k2 via novita2026-09-17 10:59yes1425 s
Scale constrainedGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 12:35yes14136 s
Scale constrainedMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 10:53yes528 s
Negative framingClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 09:43yes198 s
Negative framingGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 13:52yes38 s
Negative framingGemini 3.5 Flashgemini-3.5-flash2026-09-17 12:27yes1224 s
Negative framingPerplexity Sonarsonar2026-09-17 11:54yes207 s
Negative framingGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 13:50yes3418 s
Negative framingMistral Smallmistral/mistral-small via mistral2026-09-17 10:38yes56 s
Negative framingDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 13:54yes2745 s
Negative framingLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 10:10yes53 s
Negative framingQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 11:00yes2552 s
Negative framingKimi K2moonshotai/kimi-k2 via novita2026-09-17 10:53yes2534 s
Negative framingGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 13:15yes3075 s
Negative framingMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 13:37yes1440 s

Normalization in this category

Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.

Category-scoped readings
Scout Monitoring read as Scout APM
Unresolved, counted raw
Grafana Cloud / Open Source Stack
LogicMonitor LM APM Synthetics
ManageEngine Applications Manager / OpManager Nexus
Open-source (Prometheus/Grafana/OpenTelemetry/Jaeger)
Pandora FMS
SAP Legacy APM Products
SolarWinds APM
SolarWinds Applications Manager
Splunk On-Demand
ToolRadar
Discontinued, still offered
No shut-down product was recommended here.
← Vuln managementEndpoint protection →