CI/CD platforms for enterprise buyers
Asked as “CI/CD platform”, and as “continuous integration and delivery tool”, on behalf of an enterprise B2B company. 53 first choices recorded across the direct, paraphrase, budget and scale prompts, fourteen models each.
Standing · first-choice share
42%
Clear leader
42GitLab CI/CD19GitHub Actions11Azure DevOps28others
42% of first choices, clear leader.
Since September 2026▼−1Since September 2026: 44% → 43%, −1 point. Inside the 11-point floor: within noise. Read over the models both editions asked.GitLab CI/CD held the lead, −1 point on 44%, inside the 11-point floor.
By buyer segment
The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.
Small business
GitHub Actions75%Clear leader▼−17Since September 2026: 93% → 76%, −17 points. Past the 11-point floor: movement. Read over the models both editions asked.Standing →Mid-marketGitHub Actions68%Clear leader▼−2Since September 2026: 65% → 63%, −2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.Standing →Enterprise
GitLab CI/CD42%Clear leader▼−1Since September 2026: 44% → 43%, −1 point. Inside the 11-point floor: within noise. Read over the models both editions asked.This page
GitHub Actions75%Clear leader▼−17Since September 2026: 93% → 76%, −17 points. Past the 11-point floor: movement. Read over the models both editions asked.Standing →Mid-marketGitHub Actions68%Clear leader▼−2Since September 2026: 65% → 63%, −2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.Standing →EnterpriseGitLab CI/CD42%Clear leader▼−1Since September 2026: 44% → 43%, −1 point. Inside the 11-point floor: within noise. Read over the models both editions asked.This pageThe standing
Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all fourteen models, for an enterprise B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrantSince September 2026
01GitLab CI/CD42%13%76endorsed leader▼−1Since September 2026: 44% → 43%, −1 point. Inside the 11-point floor: within noise. Read over the models both editions asked.44% → 43%
GitLab CI/CD42%13%76endorsed leader▼−1Since September 2026: 44% → 43%, −1 point. Inside the 11-point floor: within noise. Read over the models both editions asked.44% → 43%02GitHub Actions19%28%65criticized challenger▲+1Since September 2026: 16% → 17%, +1 point. Inside the 11-point floor: within noise. Read over the models both editions asked.16% → 17%
GitHub Actions19%28%65criticized challenger▲+1Since September 2026: 16% → 17%, +1 point. Inside the 11-point floor: within noise. Read over the models both editions asked.16% → 17%03
Azure DevOps11%9%44accepted challenger▲+3Since September 2026: 8% → 11%, +3 points. Inside the 11-point floor: within noise. Read over the models both editions asked.8% → 11%
Azure DevOps11%9%44accepted challenger▲+3Since September 2026: 8% → 11%, +3 points. Inside the 11-point floor: within noise. Read over the models both editions asked.8% → 11%04
Buildkite11%8%24accepted challenger▲+5Since September 2026: 6% → 11%, +5 points. Inside the 11-point floor: within noise. Read over the models both editions asked.6% → 11%
Buildkite11%8%24accepted challenger▲+5Since September 2026: 6% → 11%, +5 points. Inside the 11-point floor: within noise. Read over the models both editions asked.6% → 11%05
JetBrains TeamCity4%0%23accepted challenger▲+4Since September 2026: 0% → 4%, +4 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 4%
JetBrains TeamCity4%0%23accepted challenger▲+4Since September 2026: 0% → 4%, +4 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 4%06
Harness2%11%35accepted challenger▲+2Since September 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 2%
Harness2%11%35accepted challenger▲+2Since September 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 2%07
Azure Pipelines2%6%18accepted challenger▲+2Since September 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 2%
Azure Pipelines2%6%18accepted challenger▲+2Since September 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 2%08
Jenkins2%53%62criticized challenger▼−6Since September 2026: 8% → 2%, −6 points. Inside the 11-point floor: within noise. Read over the models both editions asked.8% → 2%
Jenkins2%53%62criticized challenger▼−6Since September 2026: 8% → 2%, −6 points. Inside the 11-point floor: within noise. Read over the models both editions asked.8% → 2%Show the four products at 0%, ordered by negative rate
12
CircleCI0%44%45criticized challenger▼−2Since September 2026: 2% → 0%, −2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.2% → 0%
CircleCI0%44%45criticized challenger▼−2Since September 2026: 2% → 0%, −2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.2% → 0%10
CloudBees CI0%30%10criticized challenger▼−2Since September 2026: 2% → 0%, −2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.2% → 0%
CloudBees CI0%30%10criticized challenger▼−2Since September 2026: 2% → 0%, −2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.2% → 0%11
AWS CodePipeline0%27%11criticized challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%
AWS CodePipeline0%27%11criticized challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%09
Argo CD0%0%12accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%
Argo CD0%0%12accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%The floor is 11 points of share, measured: how far the models move a leader on their own when the same questions are asked twice with nothing changed. A larger change is movement; a smaller one is noise, and both are shown. Movement is read over the twelve models both editions asked; GPT-6 Luna, Muse Glimmer 30B joined this edition and are in the standing but not yet in the comparison. How the floor is measured
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its product page.
All six head-to-head pages: the top four products, each against each
Recommended versus criticized
Every product with at least 10 labels here, on both axes. The 30% line names a quadrant, not the verdict above: that one needs more than 40%.
Criticized challengerCriticized default
Negative label rate →
010203040506070809101112Accepted challengerEndorsed leader
0%First-choice share → · lines at 30% share and 25% negative60%
Key
01GitLab CI/CD42%
GitLab CI/CD42%02GitHub Actions19%
GitHub Actions19%03Azure DevOps11%
Azure DevOps11%04Buildkite11%
Buildkite11%05JetBrains TeamCity4%
JetBrains TeamCity4%06Harness2%
Harness2%07Azure Pipelines2%
Azure Pipelines2%08Jenkins2%
Jenkins2%09Argo CD0%
Argo CD0%10CloudBees CI0%
CloudBees CI0%11AWS CodePipeline0%
AWS CodePipeline0%12CircleCI0%
CircleCI0%What they warned about
Six of fourteen models held their first choice under the paraphrase. Claude Haiku 4.5, GPT-5.4 mini, Gemini 3.5 Flash, Perplexity Sonar, Grok 4.1 Fast, Qwen 3.7 Flash, GLM 4.7 FlashX and MiniMax M2.5 changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
Jenkins53%
33 of 62 labels negative · 14 of 14 models · 6 hard negative
“**Why Avoid:** It slows down developer velocity because developers wait on operations teams to manage infrastructure rather than writing code.” Qwen 3.7 Flash, negative prompt
CircleCI44%
20 of 45 labels negative · 11 of 14 models · 5 hard negative
“**Why to avoid:** ... CircleCI's cloud offering uses per-minute/credit billing, which can result in unpredictable and escalating costs” Mistral Small, negative prompt
GitHub Actions28%
18 of 65 labels negative · 11 of 14 models · 3 hard negative
“GitHub Actions and CircleCI are not recommended for large enterprises due to their per-minute/credit billing that scales linearly” Llama 4 Maverick, negative prompt
GitLab CI/CD13%
10 of 76 labels negative · 8 of 14 models
“GitLab self-managed, Jenkins, and other self-hosted systems can make sense when control is essential—but they transfer more responsibility” GPT-6 Luna, negative prompt
What they cite
Citations exist only for the models that return a source list: fourteen of the fourteen in this edition, and all six flagship models on the expanded tier.
Sites the answers cite
74 of 84 answers in this category came back with a source list, from 14 of 14 models: citations where the model returns them, or the search results it consulted. 1092 links across 263 sites, every framing counted. Ranked by the number of answers carrying the site or page. 32 of the 252 answers across every segment cited this index's own page for the category; the method page measures whether that reading tilts an answer.
41 answers · 49 citations · 12 models
vendor site · Harness28 answers · 39 citations · 11 models
vendor site · G225 answers · 25 citations · 10 models
23 answers · 42 citations · 11 models
vendor site · Atlassian21 answers · 31 citations · 10 models
vendor site · GitLab20 answers · 31 citations · 9 models
vendor site · Augment Code20 answers · 23 citations · 9 models
vendor site · Siit20 answers · 23 citations · 10 models
19 answers · 19 citations · 10 models
16 answers · 16 citations · 7 models
16 answers · 16 citations · 9 models
15 answers · 15 citations · 9 models
Pages the answers cite
The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.
41 answers · 12 models
25 answers · 10 models
19 answers · 10 models
19 answers · 10 models
18 answers · 9 models
16 answers · 7 models
16 answers · 9 models
15 answers · 9 models
15 answers · 9 models
14 answers · 10 models
Search against answers
Each company's standing in the answers beside its site's footprint in Google search, one row a site: the products the models named on it with their shares, and the share they add up to; monthly searches on Google, and DataForSEO's estimate of AI search demand (modeled from search signals, directional, not a count of queries to any assistant), for the most-searched of the company's and its products' names (the name is in each row's hover text); estimated monthly organic visits to the site; and its best position in Google's top ten for “best ci/cd platform”, “ci/cd platform”, “ci/cd platforms”. US estimates from DataForSEO and Google's Ads Transparency Center. A small company's site, or a mid-sized company's site for its flagship, is marked company; a product on a large parent's site (Google, Microsoft) has no site figures. A column with no figures for this category is left out, and an empty cell means none were seen, not none exist. Two measurements side by side: neither is read as the cause of the other.
| Company and products | Share | Own site cited | Name searches, Google | AI search demand, est. | Organic visits | Paid search a month, est. | Google ads, last 30 days | Best Google position |
|---|---|---|---|---|---|---|---|---|
| GitLab gitlab.com GitLab CI/CD 42% | 42% | 188 | 90,500 | 4,844 | 603,028 company | $884 | 66 | 5 |
| GitHub parent site GitHub Actions 19%, GitHub Enterprise Server 2% | 21% | 175 | 1,500,000 | 31,479 | ||||
| Azure parent site Azure DevOps 11%, Azure Pipelines 2% | 13% | 138 | 301,000 | 47,904 | ||||
| Buildkite buildkite.com | 11% | 57 | 3,600 | 98 | 3,563 | $477 | 0 | |
| JetBrains TeamCity jetbrains.com | 4% | 56 | 140 | 7 | 485,270 | 120 | 2 | |
| GitHub github.com | 4% | 237 | 1,500,000 | 31,479 | 42,019,137 | $81 | 14 | 5 |
| Harness harness.io | 2% | 75 | 60,500 | 55,100 | 86,302 | 6 | 1 | |
| Microsoft Azure DevOps Services | 2% | |||||||
| Jenkins jenkins.io | 2% | 158 | 33,100 | 22,088 | 182,143 | |||
| Argo argoproj.io Argo CD 0%, Argo Workflows 0% | 0% | 49 | 3,600 | 240 | 182 company |
Google's top ten for the three searches hold 16 sites; 5 of them are among the sites the models cited here (about.gitlab.com, atlassian.com, blog.jetbrains.com, harness.io, octopus.com). The first result for “best ci/cd platform” is reddit.com.
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.ShowHide
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ShowHideModelDirect“What is the best CI/CD platform for an enterprise B2B company?”Paraphrase“Which continuous integration and delivery tool would you recommend to a large B2B company with thousands of employees?”Comparative“What are the top enterprise-grade CI/CD platforms and how do they differ?”Budget-constrained“What is the best CI/CD platform for a large company that needs predictable total cost across thousands of users?”Scale-constrained“We are a 5,000 person company with SSO, SOC 2 and procurement review requirements evaluating a CI/CD platform. What should we look at?”Negative“Which CI/CD platforms should a large enterprise avoid or be cautious about?”
Claude Haiku 4.5GitHub Actions, GitLab CI/CDno first choiceChangedno first choiceBuildkiteagainst: CircleCI, GitHub Actions, Harnessno first choiceagainst: Atlassian Bamboo, CircleCI, GitHub Actions, GitLab CI/CD, Jenkins
Three alternatives
AWS CodePipeline, Azure Pipelines, JenkinsTwo alternatives
AWS CodePipeline, Atlassian BambooGPT-5.4 miniGitHub Actionsagainst: JenkinsAzure Pipelines, GitHub ActionsChangedagainst: JenkinsGitLab CI/CDagainst: JenkinsBuildkiteagainst: GitLab CI/CDno first choiceagainst: CircleCI, GitHub Actions, GitLab CI/CD
Three alternatives
Azure DevOps, CircleCI, GitLab CI/CDFour alternatives
Azure DevOps, Azure Pipelines, CircleCI, GitHub ActionsTwo alternatives
CircleCI Server, GitHub ActionsGemini 3.5 FlashGitHub Actionsagainst: Jenkins / CloudBees EnterpriseGitHub, GitLab CI/CDChangedagainst: JenkinsGitHub Actionsagainst: JenkinsAzure DevOps, BuildkiteGitHubagainst: AWS CodePipeline, Buddy, CircleCI, GCP Cloud Build, Jenkins, Travis CI
Four alternatives
Argo CD, Azure DevOps, GitLab CI/CD, HarnessTwo alternatives
Argo CD, HarnessThree alternatives
Argo CD, GitLab CI/CD, HarnessTwo alternatives
GitHub, GitLab CI/CDThree alternatives
Azure DevOps, GitLab CI/CD, HarnessPerplexity SonarGitLab CI/CD, Harnessagainst: JenkinsGitLab CI/CDChangedagainst: Jenkinsno first choiceJetBrains TeamCityagainst: CircleCI, GitHub Actions, GitLab CI/CDno first choiceagainst: CircleCI, GitHub Actions, Jenkins, Spinnaker
Two alternatives
Azure Pipelines, JetBrains TeamCityThree alternatives
CloudBees CI, Harness, Octopus DeployTwo alternatives
GitLab CI/CD, JenkinsGrok 4.1 FastGitHub Actions, GitLab CI/CDagainst: JenkinsJenkinsChangedagainst: CircleCIno first choiceAzure DevOpsagainst: CircleCI, CloudBees CI, GitHub Actions, Harness, JenkinsGitHub Actions, GitLab CI/CDagainst: Jenkinsagainst: Azure Pipelines, CircleCI, Drone CI, GitHub Actions, Jenkins, Tekton
One alternative
Azure PipelinesThree alternatives
Azure DevOps, GitHub Actions, GitLab CI/CDTwo alternatives
GitHub Enterprise Server, GitLab CI/CDTwo alternatives
Azure DevOps, CircleCIMistral SmallAzure DevOps, GitLab CI/CDAzure DevOps, GitLab CI/CDHeldno first choiceBuildkiteagainst: GitHub Actions, GitLab CI/CD, Jenkinsno first choiceagainst: AWS CodePipeline, Atlassian Bitbucket Pipelines, Azure DevOps, CircleCI, GitHub Actions, Google Cloud Build, Jenkins
Two alternatives
Buildkite, JetBrains TeamCityTwo alternatives
GitHub Actions, JenkinsOne alternative
CircleCIDeepSeek V4 FlashGitLab CI/CDagainst: JenkinsGitLab CI/CDHeldno first choiceagainst: JenkinsBuildkite, GitLab CI/CDagainst: CircleCI, CloudBees CI, GitHub, GitHub Actions, Harness, Jenkinsno first choiceagainst: CircleCI, Jenkinsagainst: CircleCI, Drone CI, GitLab CI/CD, Jenkins, Travis CI
Four alternatives
Azure DevOps, Azure Pipelines, GitHub Actions, HarnessThree alternatives
Azure DevOps, GitHub Actions, JenkinsLlama 4 Maverickno first choiceno first choiceHeldno first choiceno first choiceGitLab CI/CDagainst: Atlassian's Data Center, CircleCI, GitHub Actions, Jenkins
Four alternatives
Azure DevOps, Buildkite, GitHub Actions, HarnessQwen 3.7 FlashGitHub Actions, GitLab CI/CDGitLab CI/CDChangedGitLab CI/CDMicrosoft Azure DevOps Servicesagainst: GitHub Actions, Jenkinsno first choiceagainst: AWS CodePipeline, Azure DevOps, CircleCI, GitHub Actions, GitLab CI/CD, Jenkins, Spinnaker, Travis CI
Two alternatives
CircleCI, HarnessThree alternatives
Azure Pipelines, GitHub Enterprise Actions, JenkinsFour alternatives
Azure DevOps, CircleCI, GitHub Actions, JenkinsOne alternative
GitLab CI/CDKimi K2GitLab CI/CDGitLab CI/CDHeldagainst: CloudBees CI, Jenkinsno first choiceGitLab CI/CDagainst: Azure DevOps, GitHubno first choiceagainst: Atlassian Bamboo, Jenkins, Travis CI
Two alternatives
GitHub Actions, JenkinsThree alternatives
Azure DevOps, GitHub, GitHub ActionsSeven alternatives
Argo CD, Azure Pipelines, CircleCI, GitHub Actions, GitLab CI/CD, Harness, JenkinsTwo alternatives
CloudBees CI, JenkinsGLM 4.7 FlashXGitHub Actions, GitLab CI/CDGitLab CI/CDChangedagainst: Jenkinsno first choiceGitLab CI/CDno first choiceagainst: AppVeyor, Atlassian Bamboo, Bitbucket Pipelines, GoCD, Jenkins, Travis CI
Six alternatives
Argo CD, Azure Pipelines, CloudBees CI, Harness, Jenkins, JetBrains TeamCityTwo alternatives
GitHub Actions, JetBrains TeamCityNine alternatives
AWS CodePipeline, Azure Pipelines, Buildkite, CircleCI, GitHub Actions, GitLab CI/CD, Harness, Jenkins, JetBrains TeamCityThree alternatives
Azure DevOps, GitHub Actions, HarnessMiniMax M2.5no first choiceAzure DevOpsChangedagainst: Atlassian Bamboo, Jenkinsno first choiceagainst: CircleCIJetBrains TeamCityagainst: Azure DevOps, Buildkite, GitHub Actions, GitLab CI/CDno first choiceagainst: CircleCIagainst: CircleCI, GitHub Actions
One alternative
GitLab CI/CDOne alternative
JenkinsFive alternatives
Azure DevOps, Buildkite, GitHub Actions, GitLab CI/CD, JenkinsGPT-6 LunaGitHub ActionsGitHub ActionsHeldno first choiceBuildkiteagainst: GitLab CI/CDno first choiceagainst: Bitbucket Pipelines, GitHub Actions, GitLab CI/CD, Jenkins
Three alternatives
Azure Pipelines, Buildkite, GitLab CI/CDOne alternative
GitLab CI/CDNine alternatives
Azure Pipelines, Bitbucket Pipelines, CircleCI, CloudBees CI, GitHub Actions, GitLab CI/CD, Harness, Jenkins, JetBrains TeamCityTwo alternatives
Azure DevOps, GitHub ActionsMuse Glimmer 30BGitLab CI/CDagainst: JenkinsGitLab CI/CDHeldagainst: JenkinsGitLab CI/CDAzure DevOpsagainst: Buildkite, CircleCI, GitHub Actions, HarnessGitHub Enterprise Serveragainst: CircleCI, GitHub Actions, Jenkins, Travis CI
Four alternatives
Azure DevOps, GitHub, Harness, JetBrains TeamCityOne alternative
Azure DevOpsNine alternatives
Argo CD, Azure Pipelines, CircleCI, Flux, GitHub Actions, Harness CD & GitOps, Jenkins – CloudBees Jenkins Enterprise, JetBrains TeamCity, Octopus DeployOne alternative
GitLab CI/CDTwo alternatives
Azure Pipelines, GitLab CI/CDBold is the first choiceAlternatives are counted; the count opens them.What the answer argued against
The record
One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency. Full answer text is in the free responses file. Download the record
Eighty-four rows: every prompt, every model, every answer.
| Prompt | Model | Version string | Time (UTC) | Searched | Sources | Latency |
|---|---|---|---|---|---|---|
| Direct recommendation | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 10:20 | no | 0 | 5 s |
| Direct recommendation | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 13:02 | yes | 4 | 7 s |
| Direct recommendation | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 09:10 | yes | 12 | 29 s |
| Direct recommendation | Perplexity Sonar | sonar | 2026-10-01 12:21 | yes | 18 | 3 s |
| Direct recommendation | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 09:56 | yes | 25 | 10 s |
| Direct recommendation | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 09:58 | yes | 5 | 4 s |
| Direct recommendation | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 12:11 | yes | 24 | 35 s |
| Direct recommendation | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 13:37 | yes | 5 | 2 s |
| Direct recommendation | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 13:19 | no | 0 | 30 s |
| Direct recommendation | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 11:13 | yes | 15 | 22 s |
| Direct recommendation | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 10:10 | yes | 15 | 33 s |
| Direct recommendation | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 09:27 | yes | 5 | 21 s |
| Direct recommendation | GPT-6 Luna | gpt-6-luna | 2026-10-01 08:01 | yes | 4 | 28 s |
| Direct recommendation | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 11:09 | yes | 15 | 22 s |
| Paraphrase | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 08:27 | no | 0 | 4 s |
| Paraphrase | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 09:03 | yes | 5 | 5 s |
| Paraphrase | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 09:06 | yes | 12 | 23 s |
| Paraphrase | Perplexity Sonar | sonar | 2026-10-01 13:01 | yes | 19 | 4 s |
| Paraphrase | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 12:21 | yes | 20 | 6 s |
| Paraphrase | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 08:27 | yes | 10 | 7 s |
| Paraphrase | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 09:41 | yes | 19 | 27 s |
| Paraphrase | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 12:32 | yes | 5 | 3 s |
| Paraphrase | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 12:04 | yes | 15 | 95 s |
| Paraphrase | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 12:34 | yes | 19 | 26 s |
| Paraphrase | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 09:58 | yes | 10 | 12 s |
| Paraphrase | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 13:10 | no | 0 | 59 s |
| Paraphrase | GPT-6 Luna | gpt-6-luna | 2026-10-01 07:59 | yes | 4 | 17 s |
| Paraphrase | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 07:42 | yes | 14 | 21 s |
| Comparative | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 10:03 | yes | 9 | 9 s |
| Comparative | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 08:16 | yes | 9 | 9 s |
| Comparative | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 13:30 | yes | 22 | 29 s |
| Comparative | Perplexity Sonar | sonar | 2026-10-01 09:57 | yes | 19 | 6 s |
| Comparative | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 09:51 | yes | 23 | 9 s |
| Comparative | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 11:04 | yes | 12 | 10 s |
| Comparative | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 11:20 | yes | 22 | 70 s |
| Comparative | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 08:54 | yes | 5 | 2 s |
| Comparative | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 13:10 | no | 0 | 37 s |
| Comparative | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 12:23 | yes | 15 | 45 s |
| Comparative | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 08:49 | yes | 25 | 70 s |
| Comparative | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 10:14 | yes | 14 | 36 s |
| Comparative | GPT-6 Luna | gpt-6-luna | 2026-10-01 09:36 | yes | 8 | 23 s |
| Comparative | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 08:11 | yes | 14 | 33 s |
| Budget constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 10:23 | yes | 16 | 9 s |
| Budget constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 09:35 | yes | 5 | 6 s |
| Budget constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 09:25 | yes | 14 | 29 s |
| Budget constrained | Perplexity Sonar | sonar | 2026-10-01 07:26 | yes | 19 | 3 s |
| Budget constrained | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 08:10 | yes | 25 | 18 s |
| Budget constrained | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 09:59 | yes | 10 | 6 s |
| Budget constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 13:16 | yes | 25 | 26 s |
| Budget constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 12:30 | yes | 5 | 1 s |
| Budget constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 12:36 | no | 0 | 31 s |
| Budget constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 08:49 | yes | 17 | 26 s |
| Budget constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 10:58 | yes | 21 | 22 s |
| Budget constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 13:14 | yes | 23 | 68 s |
| Budget constrained | GPT-6 Luna | gpt-6-luna | 2026-10-01 12:21 | yes | 4 | 21 s |
| Budget constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 12:25 | yes | 21 | 39 s |
| Scale constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 12:54 | yes | 18 | 12 s |
| Scale constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 12:09 | no | 0 | 10 s |
| Scale constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 13:27 | no | 0 | 16 s |
| Scale constrained | Perplexity Sonar | sonar | 2026-10-01 08:55 | yes | 19 | 4 s |
| Scale constrained | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 09:42 | yes | 19 | 14 s |
| Scale constrained | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 09:35 | no | 0 | 10 s |
| Scale constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 09:45 | yes | 23 | 37 s |
| Scale constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 09:12 | yes | 5 | 2 s |
| Scale constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 13:31 | no | 0 | 31 s |
| Scale constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 08:07 | yes | 16 | 34 s |
| Scale constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 09:51 | yes | 15 | 20 s |
| Scale constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 10:55 | yes | 10 | 19 s |
| Scale constrained | GPT-6 Luna | gpt-6-luna | 2026-10-01 11:40 | yes | 4 | 23 s |
| Scale constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 09:33 | yes | 24 | 35 s |
| Negative framing | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 11:55 | yes | 18 | 10 s |
| Negative framing | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 07:28 | yes | 6 | 7 s |
| Negative framing | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 08:44 | yes | 25 | 28 s |
| Negative framing | Perplexity Sonar | sonar | 2026-10-01 11:55 | yes | 19 | 3 s |
| Negative framing | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 10:52 | yes | 19 | 8 s |
| Negative framing | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 09:26 | yes | 5 | 6 s |
| Negative framing | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 12:43 | yes | 25 | 25 s |
| Negative framing | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 10:55 | yes | 5 | 3 s |
| Negative framing | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 11:28 | yes | 25 | 52 s |
| Negative framing | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 12:35 | yes | 24 | 23 s |
| Negative framing | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 11:07 | yes | 21 | 206 s |
| Negative framing | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 09:47 | yes | 18 | 70 s |
| Negative framing | GPT-6 Luna | gpt-6-luna | 2026-10-01 08:39 | yes | 4 | 18 s |
| Negative framing | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 09:00 | yes | 24 | 38 s |
Normalization in this category
Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.
ShowHide
Category-scoped readings
AWS CodePipeline/CodeBuild read as AWS CodePipeline
CloudBees read as CloudBees CI
Drone read as Drone CI
GitLab read as GitLab CI/CD
GitLab CI read as GitLab CI/CD
GitLab CI (EE) read as GitLab CI/CD
GitLab Enterprise read as GitLab CI/CD
GitLab Premium read as GitLab CI/CD
GitLab Premium/Ultimate read as GitLab CI/CD
GitLab Self-Managed read as GitLab CI/CD
GitLab Ultimate read as GitLab CI/CD
GitLab Ultimate (Self-Managed) read as GitLab CI/CD
GitLab Ultimate (or GitLab Enterprise) read as GitLab CI/CD
GitLab self-managed read as GitLab CI/CD
GitLab.com read as GitLab CI/CD
Unresolved, counted raw
AppVeyor
Atlassian's Data Center
CircleCI Server
GitHub Enterprise Actions
Harness CD & GitOps
Harness Platform
Jenkins – CloudBees Jenkins Enterprise
Microsoft Azure DevOps Services
Octopus CD
Discontinued, still offered
No shut-down product was recommended here.