AI coding assistants for enterprise buyers
Asked as “AI coding assistant”, and as “AI pair programming tool”, on behalf of an enterprise B2B company. 44 first choices recorded across the direct, paraphrase, budget and scale prompts, fourteen models each.
Standing · first-choice share
82%
Clear leader
82GitHub Copilot09Tabnine07Amazon Q Developer02others
82% of first choices, clear leader.
Since September 2026▼−13Since September 2026: 95% → 82%, −13 points. Past the 11-point floor: movement. Read over the models both editions asked.GitHub Copilot held the lead, −13 points on 95%, past the floor.
By buyer segment
The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.
Small business
GitHub Copilot63%Clear leader▼−4Since September 2026: 65% → 61%, −4 points. Inside the 11-point floor: within noise. Read over the models both editions asked.Standing →Mid-marketGitHub Copilot75%Clear leader▲+8Since September 2026: 67% → 75%, +8 points. Inside the 11-point floor: within noise. Read over the models both editions asked.Standing →EnterpriseGitHub Copilot82%Clear leader▼−13Since September 2026: 95% → 82%, −13 points. Past the 11-point floor: movement. Read over the models both editions asked.This page
GitHub Copilot63%Clear leader▼−4Since September 2026: 65% → 61%, −4 points. Inside the 11-point floor: within noise. Read over the models both editions asked.Standing →Mid-marketGitHub Copilot75%Clear leader▲+8Since September 2026: 67% → 75%, +8 points. Inside the 11-point floor: within noise. Read over the models both editions asked.Standing →EnterpriseGitHub Copilot82%Clear leader▼−13Since September 2026: 95% → 82%, −13 points. Past the 11-point floor: movement. Read over the models both editions asked.This pageThe standing
Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all fourteen models, for an enterprise B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrantSince September 2026
01GitHub Copilot82%12%83endorsed leader▼−13Since September 2026: 95% → 82%, −13 points. Past the 11-point floor: movement. Read over the models both editions asked.95% → 82%
GitHub Copilot82%12%83endorsed leader▼−13Since September 2026: 95% → 82%, −13 points. Past the 11-point floor: movement. Read over the models both editions asked.95% → 82%02
Tabnine9%4%46accepted challenger▲+11Since September 2026: 0% → 11%, +11 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 11%
Tabnine9%4%46accepted challenger▲+11Since September 2026: 0% → 11%, +11 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 11%03
Amazon Q Developer7%16%50accepted challenger=heldSince September 2026: 5% → 5%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.5% → 5%
Amazon Q Developer7%16%50accepted challenger=heldSince September 2026: 5% → 5%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.5% → 5%Show the six products at 0%, ordered by negative rate
09
Cursor0%48%50criticized challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%
Cursor0%48%50criticized challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%08
Claude Code Lab in the set0%42%24criticized challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%
Claude Code Lab in the set0%42%24criticized challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%07
Windsurf0%25%24criticized challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%
Windsurf0%25%24criticized challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%04Gemini Code Assist Lab in the set0%15%26accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%
06
Sourcegraph Cody0%8%12accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%
Sourcegraph Cody0%8%12accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%05
Augment Code0%7%14accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%
Augment Code0%7%14accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%The floor is 11 points of share, measured: how far the models move a leader on their own when the same questions are asked twice with nothing changed. A larger change is movement; a smaller one is noise, and both are shown. Movement is read over the twelve models both editions asked; GPT-6 Luna, Muse Glimmer 30B joined this edition and are in the standing but not yet in the comparison. How the floor is measured
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its product page.
Gemini Code Assist is made by Google, whose model Gemini 3.5 Flash is in the set. On the four share prompts that model made it the first choice zero times of 4; the other thirteen models zero times of 52. Claude Code is made by Anthropic, whose model Claude Haiku 4.5 is in the set. On the four share prompts that model made it the first choice zero times of 4; the other thirteen models zero times of 52. Lab treatment is defined on the method page; the row is marked, not excluded.
All ten head-to-head pages: the top five products, each against each
One product takes 82% of first choices here, so the chart would put eight markers in one corner and one at the far edge. The two measurements it plots are columns in the standing above: share, and the negative label rate. Three products carry a negative rate above 25% in this category.
What they warned about
Ten of fourteen models held their first choice under the paraphrase. Claude Haiku 4.5, Gemini 3.5 Flash, Llama 4 Maverick and MiniMax M2.5 changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
GitHub Copilot12%
10 of 83 labels negative · 10 of 14 models · 5 hard negative
“Free/Consumer Tiers of Major Tools (GitHub Copilot Free, etc.) ... Data retention risks ... 40% higher credential exposure” Kimi K2, negative prompt
Cursor48%
24 of 50 labels negative · 10 of 14 models · 2 hard negative
“**Avoid for Pure Predictability**: Tools like Cursor (~$40/user Business, but less enterprise scale)” Grok 4.1 Fast, budget prompt
Amazon Q Developer16%
8 of 50 labels negative · 7 of 14 models · 2 hard negative
“Amazon Q Developer and GitHub Copilot are cloud-only services with no on-premises or air-gapped deployment option” Muse Glimmer 30B, negative prompt
Claude Code42%
10 of 24 labels negative · 7 of 14 models · 1 hard negative
“Avoid for Pure Predictability ... Claude Code ($100+/user Max, usage-capped)” Grok 4.1 Fast, budget prompt
What they cite
Citations exist only for the models that return a source list: fourteen of the fourteen in this edition, and all six flagship models on the expanded tier.
Sites the answers cite
76 of 84 answers in this category came back with a source list, from 14 of 14 models: citations where the model returns them, or the search results it consulted. 1157 links across 356 sites, every framing counted. Ranked by the number of answers carrying the site or page. 12 of the 252 answers across every segment cited this index's own page for the category; the method page measures whether that reading tilts an answer.
vendor site · Augment Code43 answers · 93 citations · 12 models
27 answers · 27 citations · 9 models
vendor site · GitHub25 answers · 63 citations · 10 models
21 answers · 24 citations · 10 models
vendor site · GitHub16 answers · 25 citations · 8 models
15 answers · 16 citations · 7 models
15 answers · 15 citations · 10 models
14 answers · 19 citations · 8 models
14 answers · 14 citations · 10 models
vendor site · Guideflow13 answers · 13 citations · 8 models
vendor site · IBM13 answers · 13 citations · 9 models
vendor site · Amazon12 answers · 12 citations · 9 models
Pages the answers cite
The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.
27 answers · 9 models
14 answers · 7 models
14 answers · 10 models
14 answers · 10 models
13 answers · 8 models
13 answers · 8 models
11 answers · 8 models
11 answers · 7 models
10 answers · 7 models
9 answers · 6 models
Search against answers
Each company's standing in the answers beside its site's footprint in Google search, one row a site: the products the models named on it with their shares, and the share they add up to; monthly searches on Google, and DataForSEO's estimate of AI search demand (modeled from search signals, directional, not a count of queries to any assistant), for the most-searched of the company's and its products' names (the name is in each row's hover text); estimated monthly organic visits to the site; and its best position in Google's top ten for “ai coding assistant”, “ai coding assistants”, “best ai coding assistant”. US estimates from DataForSEO and Google's Ads Transparency Center. A small company's site, or a mid-sized company's site for its flagship, is marked company; a product on a large parent's site (Google, Microsoft) has no site figures. A column with no figures for this category is left out, and an empty cell means none were seen, not none exist. Two measurements side by side: neither is read as the cause of the other.
| Company and products | Share | Own site cited | Name searches, Google | AI search demand, est. | Organic visits | Paid search a month, est. | Google ads, last 30 days | Best Google position |
|---|---|---|---|---|---|---|---|---|
| GitHub github.com GitHub Copilot 82% | 82% | 216 | 1,500,000 | 31,479 | 42,019,137 company | $81 | 14 | |
| Tabnine tabnine.com | 9% | 108 | 2,900 | 62 | 15,577 | 0 | ||
| Amazon Q amazon.com Amazon Q Developer 7% | 7% | 98 | 9,900 | 738 | 1,681,997,879 company | $106,125 | 115 | |
| AWS parent site AWS Kiro 2% | 2% | 2 | 368,000 | 114,001 | ||||
| Gemini Code Assist | 0% | 6,600 | 167 | |||||
| Augment Code augmentcode.com | 0% | 23 | 6,600 | 199 | 146,518 | 20 | 1 | |
| Sourcegraph Cody sourcegraph.com | 0% | 28 | 880 | 14 | 10,627 | 14 | ||
| Windsurf windsurf.com | 0% | 91 | 60,500 | 4,501 | 21,603 | 0 | ||
| IBM parent site IBM watsonx Code Assistant 0% | 0% | 3 | 201,000 | 34,098 | ||||
| JetBrains AI Assistant jetbrains.com | 0% | 18 | 880 | 24 | 485,270 | 120 |
Google's top ten for the three searches hold 24 sites; 2 of them are among the sites the models cited here (augmentcode.com, axify.io). The first result for “ai coding assistant” is augmentcode.com.
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.ShowHide
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ShowHideModelDirect“What is the best AI coding assistant for an enterprise B2B company?”Paraphrase“Which AI pair programming tool would you recommend to a large B2B company with thousands of employees?”Comparative“What are the top enterprise-grade AI coding assistants and how do they differ?”Budget-constrained“What is the best AI coding assistant for a large company that needs predictable total cost across thousands of users?”Scale-constrained“We are a 5,000 person company with SSO, SOC 2 and procurement review requirements evaluating an AI coding assistant. What should we look at?”Negative“Which AI coding assistants should a large enterprise avoid or be cautious about?”
Claude Haiku 4.5no first choiceAmazon Q Developer, GitHub CopilotChangedno first choiceGitHub Copilotno first choiceagainst: ChatGPT, Claude, Copilot Individual
One alternative
Augment CodeGPT-5.4 miniGitHub Copilotagainst: CursorGitHub CopilotHeldGitHub CopilotGitHub Copilotagainst: Cursor, OpenAIno first choiceagainst: Amazon Q Developer
Two alternatives
Amazon Q Developer, Gemini Code AssistThree alternatives
Amazon Q Developer, Cursor, Gemini Code AssistSix alternatives
Amazon Q Developer, Cursor, Gemini Code Assist, OpenAI Codex, Tabnine, WindsurfGemini 3.5 FlashTabnineagainst: Claude Code, CursorGitHub CopilotChangedagainst: CursorGitHub CopilotTabnineagainst: Cursor, Windsurfno first choiceagainst: ChatGPT, Claude, Claude Code, Cursor, DeepSeek-Coder, Devin, GitHub Copilot, Google Gemini, Llama 3, Ollama, Qwen, Windsurf
Three alternatives
GitHub Copilot, Sourcegraph Cody, WindsurfTwo alternatives
Tabnine, WindsurfSix alternatives
Amazon Q Developer, Augment Code, Claude Code, Cursor, Gemini Code Assist, TabnineTwo alternatives
Augment Code, GitHub CopilotPerplexity SonarGitHub Copilotagainst: Claude, Claude Code, CursorGitHub CopilotHeldagainst: CursorGitHub CopilotGitHub Copilotagainst: Cursorno first choicenothing named
Two alternatives
Devin AI, TabnineOne alternative
WindsurfSeven alternatives
Augment Code, Claude, Claude Code, Gemini Code Assist, IBM watsonx Code Assistant, Sourcegraph Cody, TabnineOne alternative
Claude CodeGrok 4.1 FastGitHub CopilotGitHub CopilotHeldagainst: Cursor, JetBrains AI AssistantGitHub Copilotagainst: Claude Code, CursorGitHub Copilotagainst: Claude Code, CursorGitHub Copilotagainst: Gemini Code Assist, Replit Agentagainst: Consumer Amazon CodeWhisperer, Cursor, GitHub Copilot, Replit AI
Three alternatives
Amazon Q Developer, Cursor, TabnineTwo alternatives
Amazon Q Developer, TabnineFour alternatives
Amazon Q Developer, Gemini Code Assist, Sourcegraph Cody, TabnineThree alternatives
Amazon Q Developer, Gemini Code Assist, TabnineThree alternatives
Amazon Q Developer, Sourcegraph Cody, TabnineMistral SmallGitHub CopilotGitHub CopilotHeldGitHub CopilotGitHub Copilot, Tabnineno first choicenothing named
Two alternatives
Gemini Code Assist, TabnineTwo alternatives
Amazon Q Developer, JetBrains AI AssistantSix alternatives
Amazon Q Developer, Claude Code, Cursor, Sourcegraph Cody, Tabnine, WindsurfOne alternative
Gemini Code AssistDeepSeek V4 FlashGitHub Copilotagainst: WindsurfGitHub CopilotHeldagainst: Cursor, JetBrains AI AssistantGitHub CopilotAWS Kiroagainst: Claude Code, Cursorno first choiceagainst: Aider, ChatGPT, Claude Code, Cline, Copilot Workspace, Cursor, Devin, GitHub Copilot, Google's Gemini, OpenAI Codex, Windsurf
Four alternatives
Augment Code, Claude Code, Cursor, TabnineTwo alternatives
Amazon Q Developer, TabnineFour alternatives
Amazon Q Developer, Claude Code, Cursor, TabnineOne alternative
GitHub CopilotLlama 4 Maverickno first choiceGitHub CopilotChangedGitHub Copilotno first choiceno first choiceagainst: Amazon Q Developer, GitHub Copilot, Tabnine
Two alternatives
Gemini Code Assist, IBM watsonx Code AssistantQwen 3.7 FlashGitHub CopilotGitHub CopilotHeldGitHub CopilotGitHub Copilotagainst: Augment Code, Cursor, Sourcegraph Codyno first choiceagainst: Claude Code, Cursor, GitHub Copilot, OpenAI Codex
Three alternatives
Amazon Q Developer, Augment Code, TabnineFour alternatives
Amazon Q Developer, Continue, JetBrains AI Assistant, TabbyThree alternatives
Amazon Q Developer, Claude Code, CursorFour alternatives
Amazon Q Developer, GitLab Duo, Google Gemini, TabnineKimi K2GitHub CopilotGitHub CopilotHeldGitHub CopilotGitHub Copilotagainst: Amazon Q Developer, Claude Code, Cursor, Gemini Code Assist, TabnineAmazon Q Developer, GitHub Copilotagainst: GitHub Copilot
Two alternatives
Amazon Q Developer, TabnineOne alternative
Amazon Q DeveloperFour alternatives
Amazon Q Developer, Gemini Code Assist, Sourcegraph Cody, TabnineTwo alternatives
Amazon Q Developer, Augment CodeOne alternative
TabnineGLM 4.7 FlashXGitHub Copilotagainst: CursorGitHub CopilotHeldAmazon Q Developer, GitHub CopilotGitHub Copilotno first choiceagainst: Amazon Q Developer, Cursor, Gemini Code Assist, GitHub Copilot, Lovable, OpenAI Codex, Windsurf, Z.ai's ZCode
Three alternatives
Amazon Q Developer, Gemini Code Assist, TabnineOne alternative
WindsurfFive alternatives
CodeSquire, Cursor, Qodo, Sourcegraph Cody, TabnineTwo alternatives
Amazon Q Developer, Gemini Code AssistMiniMax M2.5TabnineGitHub CopilotChangedGitHub CopilotGitHub Copilotagainst: Claude Code, Cursorno first choiceagainst: Amazon Q Developer, ChatGPT, GitHub Copilot, OpenAI-Based Coding Tools
Four alternatives
Amazon Q Developer, Augment Code, Cursor, GitHub CopilotTwo alternatives
Amazon Q Developer, TabnineFive alternatives
Amazon Q Developer, Augment Code, Sourcegraph Cody, Tabnine, WindsurfOne alternative
Amazon Q DeveloperGPT-6 LunaGitHub CopilotGitHub CopilotHeldGitHub CopilotGitHub Copilotagainst: Cursorno first choiceagainst: Amazon Q Developer, Cursor, GitHub Copilot
One alternative
CursorOne alternative
CursorSix alternatives
Amazon Q Developer, Claude Code, Cursor, Gemini Code Assist, OpenAI Codex, TabnineMuse Glimmer 30BGitHub CopilotGitHub CopilotHeldGitHub CopilotAmazon Q Developerno first choiceagainst: Amazon Q Developer, Gemini Code Assist, GitHub Copilot, Windsurf
Four alternatives
Amazon Q Developer, Claude Code, Cursor, TabnineThree alternatives
Amazon Q Developer, Tabnine, WindsurfSeven alternatives
Amazon Q Developer, Augment Code, Cursor, Gemini Code Assist, Sourcegraph Cody, Tabnine, WindsurfTwo alternatives
GitHub Copilot, TabnineBold is the first choiceAlternatives are counted; the count opens them.What the answer argued against
The record
One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency. Full answer text is in the free responses file. Download the record
Eighty-four rows: every prompt, every model, every answer.
| Prompt | Model | Version string | Time (UTC) | Searched | Sources | Latency |
|---|---|---|---|---|---|---|
| Direct recommendation | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 10:14 | no | 0 | 4 s |
| Direct recommendation | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 07:53 | yes | 4 | 5 s |
| Direct recommendation | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 10:32 | yes | 22 | 29 s |
| Direct recommendation | Perplexity Sonar | sonar | 2026-10-01 09:37 | yes | 23 | 6 s |
| Direct recommendation | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 10:49 | yes | 24 | 8 s |
| Direct recommendation | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 09:59 | yes | 10 | 4 s |
| Direct recommendation | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 12:19 | yes | 25 | 38 s |
| Direct recommendation | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 13:31 | yes | 5 | 2 s |
| Direct recommendation | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 10:24 | yes | 25 | 62 s |
| Direct recommendation | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 11:11 | yes | 15 | 17 s |
| Direct recommendation | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 12:40 | yes | 25 | 58 s |
| Direct recommendation | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 07:55 | yes | 10 | 17 s |
| Direct recommendation | GPT-6 Luna | gpt-6-luna | 2026-10-01 09:22 | yes | 2 | 13 s |
| Direct recommendation | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 08:16 | yes | 15 | 20 s |
| Paraphrase | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 13:41 | no | 0 | 4 s |
| Paraphrase | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 11:48 | yes | 5 | 5 s |
| Paraphrase | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 13:10 | yes | 11 | 30 s |
| Paraphrase | Perplexity Sonar | sonar | 2026-10-01 13:26 | yes | 29 | 3 s |
| Paraphrase | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 08:21 | yes | 24 | 8 s |
| Paraphrase | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 09:02 | yes | 20 | 9 s |
| Paraphrase | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 07:45 | yes | 25 | 33 s |
| Paraphrase | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 13:00 | yes | 5 | 2 s |
| Paraphrase | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 13:33 | no | 0 | 30 s |
| Paraphrase | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 11:59 | yes | 20 | 20 s |
| Paraphrase | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 11:36 | yes | 19 | 19 s |
| Paraphrase | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 10:44 | yes | 20 | 36 s |
| Paraphrase | GPT-6 Luna | gpt-6-luna | 2026-10-01 11:10 | yes | 3 | 12 s |
| Paraphrase | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 07:52 | yes | 15 | 23 s |
| Comparative | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 10:18 | yes | 16 | 9 s |
| Comparative | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 10:00 | yes | 6 | 13 s |
| Comparative | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 13:23 | yes | 28 | 32 s |
| Comparative | Perplexity Sonar | sonar | 2026-10-01 12:14 | yes | 19 | 6 s |
| Comparative | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 12:39 | yes | 23 | 12 s |
| Comparative | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 08:29 | yes | 7 | 10 s |
| Comparative | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 13:08 | yes | 25 | 59 s |
| Comparative | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 13:06 | yes | 5 | 2 s |
| Comparative | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 10:12 | yes | 15 | 47 s |
| Comparative | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 08:29 | yes | 25 | 31 s |
| Comparative | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 09:43 | no | 0 | 24 s |
| Comparative | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 08:13 | yes | 19 | 26 s |
| Comparative | GPT-6 Luna | gpt-6-luna | 2026-10-01 11:07 | yes | 8 | 28 s |
| Comparative | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 09:45 | yes | 15 | 29 s |
| Budget constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 10:43 | yes | 18 | 8 s |
| Budget constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 10:29 | yes | 4 | 4 s |
| Budget constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 08:00 | yes | 17 | 30 s |
| Budget constrained | Perplexity Sonar | sonar | 2026-10-01 13:34 | yes | 18 | 4 s |
| Budget constrained | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 11:46 | yes | 24 | 9 s |
| Budget constrained | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 07:54 | yes | 5 | 4 s |
| Budget constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 08:50 | yes | 24 | 23 s |
| Budget constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 10:07 | yes | 5 | 2 s |
| Budget constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 09:28 | yes | 5 | 39 s |
| Budget constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 12:16 | yes | 25 | 29 s |
| Budget constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 12:17 | yes | 24 | 147 s |
| Budget constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 13:43 | yes | 20 | 63 s |
| Budget constrained | GPT-6 Luna | gpt-6-luna | 2026-10-01 08:52 | yes | 3 | 14 s |
| Budget constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 13:27 | yes | 24 | 41 s |
| Scale constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 09:54 | no | 0 | 8 s |
| Scale constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 12:23 | yes | 4 | 7 s |
| Scale constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 10:31 | no | 0 | 20 s |
| Scale constrained | Perplexity Sonar | sonar | 2026-10-01 10:42 | yes | 20 | 5 s |
| Scale constrained | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 10:28 | no | 0 | 7 s |
| Scale constrained | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 09:59 | no | 0 | 7 s |
| Scale constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 10:47 | yes | 25 | 38 s |
| Scale constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 11:44 | yes | 5 | 3 s |
| Scale constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 08:45 | yes | 5 | 43 s |
| Scale constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 11:17 | yes | 15 | 29 s |
| Scale constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 11:56 | yes | 23 | 51 s |
| Scale constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 12:59 | yes | 5 | 30 s |
| Scale constrained | GPT-6 Luna | gpt-6-luna | 2026-10-01 09:23 | yes | 4 | 26 s |
| Scale constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 12:02 | yes | 13 | 29 s |
| Negative framing | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 08:54 | yes | 9 | 8 s |
| Negative framing | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 10:02 | yes | 4 | 9 s |
| Negative framing | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 09:01 | yes | 18 | 28 s |
| Negative framing | Perplexity Sonar | sonar | 2026-10-01 10:09 | yes | 24 | 5 s |
| Negative framing | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 08:01 | yes | 25 | 8 s |
| Negative framing | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 09:50 | yes | 5 | 6 s |
| Negative framing | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 09:53 | yes | 23 | 33 s |
| Negative framing | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 08:43 | yes | 5 | 2 s |
| Negative framing | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 07:45 | yes | 15 | 49 s |
| Negative framing | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 11:15 | yes | 25 | 26 s |
| Negative framing | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 07:48 | yes | 23 | 25 s |
| Negative framing | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 13:08 | yes | 14 | 48 s |
| Negative framing | GPT-6 Luna | gpt-6-luna | 2026-10-01 10:00 | yes | 5 | 19 s |
| Negative framing | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 13:35 | yes | 15 | 28 s |
Normalization in this category
Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.
ShowHide
Category-scoped readings
Amazon Q read as Amazon Q Developer
Copilot read as GitHub Copilot
GitHub read as GitHub Copilot
JetBrains AI read as JetBrains AI Assistant
Unresolved, counted raw
AWS CodeWhisperer
Anthropic's Claude for Enterprise
CodeSquire
CodeWhisperer
Consumer Amazon CodeWhisperer (pre-rebrand)
DeepSeek-Coder
Devin AI
GPT-4
Google's Gemini
IBM watsonx Code Assistant for Z
Llama 3
Lovable
OpenAI's GPT
OpenAI's GPT-5 Mini
OpenAI-Based Coding Tools
Qwen
Tongyi Lingma
Z.ai's ZCode
Discontinued, still offered
No shut-down product was recommended here.