IT AI Index
Index Developer platform September 2026 Edition

AI coding assistants

Asked as “AI coding assistant”, and as “AI pair programming tool”, on behalf of a mid-market B2B company. 48 first choices recorded across the direct, paraphrase, budget and scale prompts, twelve models each.
Standing
Clear leader
67% of first choices, clear leader.

By buyer segment

The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.

01The standing

Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all twelve models, for a mid-market B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrant
01GitHub Copilot67%13%70endorsed leader
02Windsurf10%19%26accepted challenger
03Cursor4%19%52accepted challenger
04Cline4%8%12accepted challenger
05Amazon Q Developer2%17%35accepted challenger
06Aider2%17%12accepted challenger
Show the two products at 0%, ordered by negative rate
08Claude Code0%14%28accepted challenger
07Tabnine0%5%39accepted challenger
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its vendor page.

One product takes 67% of first choices here, so the chart would put seven markers in one corner and one at the far edge. The two measurements it plots are columns in the standing above: share, and the negative label rate. Zero products carry a negative rate above 25% in this category. Jump to the standing

02What they warned about

Eight of twelve models held their first choice under the paraphrase. Claude Haiku 4.5, Gemini 3.5 Flash, Mistral Small and Llama 4 Maverick changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
Cursor
19%
10 of 52 labels negative · 8 of 12 models · 3 hard negative
“avoid** standard free-tier or public instances of major AI coding assistants (such as GitHub Copilot standard, Cursor, or Windsurf)” Qwen 3.7 Flash, negative prompt
GitHub Copilot
13%
9 of 70 labels negative · 7 of 12 models · 3 hard negative
“You should generally **avoid** standard free-tier or public instances of major AI coding assistants (such as GitHub Copilot standard, Cursor, or Windsurf)” Qwen 3.7 Flash, negative prompt
Windsurf
19%
5 of 26 labels negative · 5 of 12 models · 3 hard negative
“avoid** standard free-tier or public instances of major AI coding assistants (such as GitHub Copilot standard, Cursor, or Windsurf)” Qwen 3.7 Flash, negative prompt
Amazon Q Developer
17%
6 of 35 labels negative · 5 of 12 models
“Exercise **caution** when using any AI assistant (including GitHub Copilot, JetBrains AI, or Amazon Q)” Qwen 3.7 Flash, negative prompt

03What they cite

Citations exist only for the models that return a source list: twelve of the twelve in this edition, and all six flagship models on the expanded tier.

Sites the answers cite

64 of 72 answers in this category came back with a source list, from 12 of 12 models: citations where the model returns them, or the search results it consulted. 6 of those lists are Google grounding redirects that name no site and are left out of the counts. 734 links across 277 sites, every framing counted. Ranked by the number of answers carrying the site or page.

24 answers · 24 citations · 10 models
20 answers · 25 citations · 10 models
18 answers · 18 citations · 9 models
vendor site · Augment Code16 answers · 26 citations · 6 models
12 answers · 13 citations · 8 models
12 answers · 12 citations · 7 models
11 answers · 12 citations · 8 models
vendor site · Zapier11 answers · 11 citations · 5 models
vendor site · GitHub10 answers · 20 citations · 6 models
10 answers · 10 citations · 8 models
10 answers · 10 citations · 8 models
8 answers · 8 citations · 6 models

Pages the answers cite

The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.

04How they answered

Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ModelDirect“What is the best AI coding assistant for a mid-market B2B company?”Paraphrase“Which AI pair programming tool would you recommend to a mid-sized B2B company?”Comparative“What are the top AI coding assistants and how do they differ?”Budget-constrained“What is the best AI coding assistant for a company with a limited budget?”Scale-constrained“We are a 500 person company evaluating an AI coding assistant. What should we look at?”Negative“Which AI coding assistants should I avoid or be cautious about?”
Claude Haiku 4.5Claude, GitHub CopilotGitHub Copilot, WindsurfChangedClaude Code, Cursor
Two alternativesAider, GitHub Copilot
GitHub Copilot, Windsurf
Three alternativesAider, Cline, opencode
no first choicenothing named
GPT-5.4 miniGitHub Copilot
Two alternativesAmazon Q Developer, Cursor
GitHub CopilotHeld
One alternativeTabnine
GitHub Copilot
Five alternativesAmazon Q Developer, ChatGPT, Claude Code, Cursor, OpenAI Codex
GitHub Copilot
Two alternativesTabnine, Windsurf
no first choiceagainst: Cursor, GitHub Copilot
Gemini 3.5 FlashAugment Code
Two alternativesGitHub Copilot, Tabnine
against: Cursor
GitHub CopilotChanged
Two alternativesCursor, Tabnine
Cursor
Four alternativesClaude Code, Cline, Devin, GitHub Copilot
Cline
Six alternativesCursor, GitHub Copilot, Goose, Ollama, Windsurf, opencode
no first choice
Three alternativesClaude Code, Cursor, GitHub Copilot
against: ChatGPT, Claude, Claude Code, Cursor, Devin, Google Gemini, Kite, Windsurf
Perplexity SonarGitHub Copilot
Two alternativesCursor, Sourcegraph Cody
GitHub CopilotHeld
Four alternativesAmazon Q Developer, Claude Code, Cursor, Tabnine
GitHub Copilot
Four alternativesAmazon Q Developer, Claude Code, Cursor, Tabnine
GitHub Copilot
Four alternativesAmazon Q Developer, Cline, Replit AI, Tabnine
no first choiceagainst: Cursor, GitHub Copilot, JetBrains Junie, Roo Code
Grok 4.1 FastGitHub Copilot
Four alternativesAmazon Q Developer, Cursor, Gemini Code Assist, Tabnine
GitHub CopilotHeld
Three alternativesAmazon Q Developer, Cursor, Tabnine
Cursor
Four alternativesClaude Code, GitHub Copilot, Tabnine, Windsurf
Windsurf
Four alternativesAmazon Q Developer, Cline, Continue, GitHub Copilot
GitHub Copilot
Two alternativesAmazon Q Developer, Cursor
against: Amazon Q Developer, Claude Code, Cursor, GitHub Copilot, Replit AI
Mistral SmallCursor, GitHub Copilot
One alternativeClaude Code
GitHub CopilotChanged
Three alternativesAider, Amazon Q Developer, Cursor
GitHub Copilot
Four alternativesAmazon Q Developer, Replit AI, Sourcegraph Cody, Tabnine
GitHub Copilot
Two alternativesCursor, Windsurf
no first choicenothing named
DeepSeek V4 FlashGitHub Copilot
Three alternativesAmazon Q Developer, Cursor, Tabnine
GitHub CopilotHeld
One alternativeCursor
Claude Code, Cursor, Windsurf
Three alternativesDevin, GitHub Copilot, Tabnine
against: Amazon Q Developer / AWS Kiro
Gemini Code Assist, GitHub Copilot
Six alternativesAider, Amazon Q Developer, Claude Code, Cline, Continue, opencode
against: Cursor, Tabnine
no first choiceagainst: Aider, Amazon Q Developer, Claude Code, Cline, GitHub Copilot, OpenAI Codex, Roo Code, Windsurf
Llama 4 MaverickCursor, GitHub Copilot
One alternativeClaude
GitHub CopilotChanged
One alternativeCursor
no first choiceGitHub Copilot, Google Gemini, Replit AI
Four alternativesAider, Cline, Windsurf, Zed
GitHub Copilot
One alternativeClaude Code
nothing named
Qwen 3.7 FlashGitHub Copilot
One alternativeCursor
GitHub CopilotHeld
Two alternativesAmazon Q Developer, Tabnine
against: Cursor
GitHub Copilot
Four alternativesAmazon Q Developer, Claude Code, Cursor, Tabnine
Windsurf
One alternativeCline
against: GitHub Copilot
GitHub Copilot
Three alternativesAmazon Q Developer, JetBrains AI, Tabnine
against: Amazon Q Developer, Cursor, GitHub Copilot, JetBrains AI, OpenClaw/Claude Code, Windsurf
Kimi K2GitHub Copilot
Two alternativesTabnine, Windsurf
GitHub CopilotHeld
Three alternativesAmazon Q Developer, Cursor, Tabnine
GitHub Copilot
Five alternativesAmazon Q Developer, Claude Code, Cursor, Gemini Code Assist, Tabnine
Windsurf
One alternativeGitHub Copilot
against: Amazon Q Developer, Tabnine
no first choiceagainst: Amazon Q / Amazon Kiro, Claude Code / Claude Cowork, Cursor, GitHub Copilot, Google Antigravity IDE, Replit Agent, Windsurf
GLM 4.7 FlashXGitHub Copilot
Three alternativesAmazon Q Developer, Cursor, Tabnine
GitHub CopilotHeld
Four alternativesAmazon Q Developer, Cursor, Tabnine, Windsurf
Cursor, GitHub Copilot
Six alternativesAmazon Q Developer, ChatGPT, Claude Code, Replit AI, Tabnine, Windsurf
Aider, Cline
Four alternativesContinue, GitHub Copilot, Tabby, Windsurf
no first choiceagainst: Aider, Amazon Q Developer, ChatGPT, Claude Code, Copilot Workspace, Cursor, Devin, GitHub Copilot, JetBrains Junie, Kiro.dev, OpenClaw / ClawHub, Roo Code, Windsurf, Zed
MiniMax M2.5GitHub Copilot
Three alternativesClaude, Claude Code, Cursor
GitHub CopilotHeld
Three alternativesClaude Code, Cursor, Windsurf
GitHub Copilot
Five alternativesAmazon Q Developer, Augment Code, Claude Code, Cursor, Tabnine
Amazon Q Developer
Three alternativesCursor, GitHub Copilot, Tabnine
no first choice
One alternativeGitHub Copilot
nothing named
Bold is the first choiceAlternatives are counted; the count opens them.What the answer argued against

05The record

One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency. Full answer text is in the free responses file. Download the record
Seventy-two rows: every prompt, every model, every answer.
PromptModelVersion stringTime (UTC)SearchedSourcesLatency
Direct recommendationClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 08:42no06 s
Direct recommendationGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 09:03yes46 s
Direct recommendationGemini 3.5 Flashgemini-3.5-flash2026-09-17 08:29yes1626 s
Direct recommendationPerplexity Sonarsonar2026-09-17 08:53yes207 s
Direct recommendationGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 08:25yes1815 s
Direct recommendationMistral Smallmistral/mistral-small via mistral2026-09-17 09:09yes54 s
Direct recommendationDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 08:34yes2018 s
Direct recommendationLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 08:39yes52 s
Direct recommendationQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 08:31yes1030 s
Direct recommendationKimi K2moonshotai/kimi-k2 via novita2026-09-17 08:19yes10137 s
Direct recommendationGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 09:01yes12113 s
Direct recommendationMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 08:38yes518 s
ParaphraseClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 08:53no05 s
ParaphraseGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 08:36yes34 s
ParaphraseGemini 3.5 Flashgemini-3.5-flash2026-09-17 08:54yes1421 s
ParaphrasePerplexity Sonarsonar2026-09-17 08:53yes206 s
ParaphraseGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 08:54yes209 s
ParaphraseMistral Smallmistral/mistral-small via mistral2026-09-17 08:27yes55 s
ParaphraseDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 09:12yes1921 s
ParaphraseLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 08:48yes53 s
ParaphraseQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 09:04yes550 s
ParaphraseKimi K2moonshotai/kimi-k2 via novita2026-09-17 09:10yes1536 s
ParaphraseGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 08:53yes1419 s
ParaphraseMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 08:34yes518 s
ComparativeClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 08:42yes98 s
ComparativeGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 08:30yes910 s
ComparativeGemini 3.5 Flashgemini-3.5-flash2026-09-17 09:04yes1731 s
ComparativePerplexity Sonarsonar2026-09-17 08:20yes209 s
ComparativeGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 08:39yes149 s
ComparativeMistral Smallmistral/mistral-small via mistral2026-09-17 09:09yes1010 s
ComparativeDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 08:37yes1819 s
ComparativeLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 08:45yes53 s
ComparativeQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 08:31yes523 s
ComparativeKimi K2moonshotai/kimi-k2 via novita2026-09-17 08:57yes1540 s
ComparativeGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 08:46yes10141 s
ComparativeMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 08:30yes1438 s
Budget constrainedClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 08:45yes99 s
Budget constrainedGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 08:26no03 s
Budget constrainedGemini 3.5 Flashgemini-3.5-flash2026-09-17 08:45yes2524 s
Budget constrainedPerplexity Sonarsonar2026-09-17 08:30yes205 s
Budget constrainedGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 08:32yes1910 s
Budget constrainedMistral Smallmistral/mistral-small via mistral2026-09-17 08:20yes138 s
Budget constrainedDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 08:27yes915 s
Budget constrainedLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 09:09yes73 s
Budget constrainedQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 08:38yes522 s
Budget constrainedKimi K2moonshotai/kimi-k2 via novita2026-09-17 08:34yes2027 s
Budget constrainedGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 09:03yes2481 s
Budget constrainedMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 08:18no011 s
Scale constrainedClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 08:17no06 s
Scale constrainedGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 08:25no07 s
Scale constrainedGemini 3.5 Flashgemini-3.5-flash2026-09-17 08:28yes1025 s
Scale constrainedPerplexity Sonarsonar2026-09-17 09:02yes207 s
Scale constrainedGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 08:32yes159 s
Scale constrainedMistral Smallmistral/mistral-small via mistral2026-09-17 08:37no06 s
Scale constrainedDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 08:38yes916 s
Scale constrainedLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 08:19yes53 s
Scale constrainedQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 08:52no039 s
Scale constrainedKimi K2moonshotai/kimi-k2 via novita2026-09-17 08:23yes923 s
Scale constrainedGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 08:47yes1447 s
Scale constrainedMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 08:42yes515 s
Negative framingClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 09:03yes1610 s
Negative framingGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 08:56yes55 s
Negative framingGemini 3.5 Flashgemini-3.5-flash2026-09-17 09:12yes1826 s
Negative framingPerplexity Sonarsonar2026-09-17 08:53yes205 s
Negative framingGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 08:49yes3915 s
Negative framingMistral Smallmistral/mistral-small via mistral2026-09-17 08:54yes58 s
Negative framingDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 09:10yes3031 s
Negative framingLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 08:54yes52 s
Negative framingQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 08:41yes548 s
Negative framingKimi K2moonshotai/kimi-k2 via novita2026-09-17 08:23yes2562 s
Negative framingGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 09:12yes2789 s
Negative framingMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 08:48yes514 s

Normalization in this category

Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.

Category-scoped readings
Amazon Q read as Amazon Q Developer
Copilot read as GitHub Copilot
GitHub read as GitHub Copilot
Replit read as Replit AI
Unresolved, counted raw
Amazon Q / Amazon Kiro
Amazon Q Developer / AWS Kiro
ChatGPT Business with Codex
ChatGPT/GPT-4
Claude Code / Claude Cowork (Anthropic)
Copilot Workspace
Goose
Kiro.dev
Kite
Llama 3/Coder local
OpenClaw / ClawHub
OpenClaw/Claude Code
Replit Agent / browser builders
Tabby
Windsurf / Devin-style agents
Discontinued, still offered
No shut-down product was recommended here.
← Object storageAPI gateways →