CI/CD platforms for small business buyers
Asked as “CI/CD platform”, and as “continuous integration and delivery tool”, on behalf of a small B2B company. 60 first choices recorded across the direct, paraphrase, budget and scale prompts, fourteen models each.
Standing · first-choice share
75%
Clear leader
75GitHub Actions15GitLab CI/CD05CircleCI05others
75% of first choices, clear leader.
Since September 2026▼−17Since September 2026: 93% → 76%, −17 points. Past the 11-point floor: movement. Read over the models both editions asked.GitHub Actions held the lead, −17 points on 93%, past the floor.
By buyer segment
The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.
Small business
GitHub Actions75%Clear leader▼−17Since September 2026: 93% → 76%, −17 points. Past the 11-point floor: movement. Read over the models both editions asked.This pageMid-marketGitHub Actions68%Clear leader▼−2Since September 2026: 65% → 63%, −2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.Standing →Enterprise
GitLab CI/CD42%Clear leader▼−1Since September 2026: 44% → 43%, −1 point. Inside the 11-point floor: within noise. Read over the models both editions asked.Standing →
GitHub Actions75%Clear leader▼−17Since September 2026: 93% → 76%, −17 points. Past the 11-point floor: movement. Read over the models both editions asked.This pageMid-marketGitHub Actions68%Clear leader▼−2Since September 2026: 65% → 63%, −2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.Standing →EnterpriseGitLab CI/CD42%Clear leader▼−1Since September 2026: 44% → 43%, −1 point. Inside the 11-point floor: within noise. Read over the models both editions asked.Standing →The standing
Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all fourteen models, for a small B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrantSince September 2026
01GitHub Actions75%1%74endorsed leader▼−17Since September 2026: 93% → 76%, −17 points. Past the 11-point floor: movement. Read over the models both editions asked.93% → 76%
GitHub Actions75%1%74endorsed leader▼−17Since September 2026: 93% → 76%, −17 points. Past the 11-point floor: movement. Read over the models both editions asked.93% → 76%02GitLab CI/CD15%13%76accepted challenger▲+9Since September 2026: 5% → 14%, +9 points. Inside the 11-point floor: within noise. Read over the models both editions asked.5% → 14%
GitLab CI/CD15%13%76accepted challenger▲+9Since September 2026: 5% → 14%, +9 points. Inside the 11-point floor: within noise. Read over the models both editions asked.5% → 14%03
CircleCI5%19%67accepted challenger▲+4Since September 2026: 2% → 6%, +4 points. Inside the 11-point floor: within noise. Read over the models both editions asked.2% → 6%
CircleCI5%19%67accepted challenger▲+4Since September 2026: 2% → 6%, +4 points. Inside the 11-point floor: within noise. Read over the models both editions asked.2% → 6%Show the six products at 0%, ordered by negative rate
09
Jenkins0%85%61criticized challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%
Jenkins0%85%61criticized challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%08
Travis CI0%67%12criticized challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%
Travis CI0%67%12criticized challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%07
Azure Pipelines0%54%13criticized challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%
Azure Pipelines0%54%13criticized challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%06
JetBrains TeamCity0%45%11criticized challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%
JetBrains TeamCity0%45%11criticized challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%05
Buildkite0%19%16accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%
Buildkite0%19%16accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%04
Bitbucket Pipelines0%17%23accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%
Bitbucket Pipelines0%17%23accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%The floor is 11 points of share, measured: how far the models move a leader on their own when the same questions are asked twice with nothing changed. A larger change is movement; a smaller one is noise, and both are shown. Movement is read over the twelve models both editions asked; GPT-6 Luna, Muse Glimmer 30B joined this edition and are in the standing but not yet in the comparison. How the floor is measured
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its product page.
All six head-to-head pages: the top four products, each against each
One product takes 75% of first choices here, so the chart would put eight markers in one corner and one at the far edge. The two measurements it plots are columns in the standing above: share, and the negative label rate. Four products carry a negative rate above 25% in this category.
What they warned about
Nine of fourteen models held their first choice under the paraphrase. Claude Haiku 4.5, Mistral Small, Qwen 3.7 Flash, MiniMax M2.5 and Muse Glimmer 30B changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
Jenkins85%
52 of 61 labels negative · 14 of 14 models · 20 hard negative
“Jenkins, Travis CI, and GitLab Premium may be platforms to avoid or be cautious about due to their complexity, pricing, and potential for sudden changes.” Llama 4 Maverick, negative prompt
CircleCI19%
13 of 67 labels negative · 11 of 14 models · 1 hard negative
“Known for heavy usage-based pricing that can spiral unexpectedly” Mistral Small, negative prompt
GitLab CI/CD13%
10 of 76 labels negative · 10 of 14 models · 3 hard negative
“Jenkins, Travis CI, and GitLab Premium may be platforms to avoid or be cautious about due to their complexity, pricing, and potential for sudden changes.” Llama 4 Maverick, negative prompt
Travis CI67%
8 of 12 labels negative · 8 of 14 models · 5 hard negative
“Jenkins, Travis CI, and GitLab Premium may be platforms to avoid or be cautious about due to their complexity, pricing, and potential for sudden changes.” Llama 4 Maverick, negative prompt
What they cite
Citations exist only for the models that return a source list: fourteen of the fourteen in this edition, and all six flagship models on the expanded tier.
Sites the answers cite
68 of 84 answers in this category came back with a source list, from 14 of 14 models: citations where the model returns them, or the search results it consulted. 874 links across 206 sites, every framing counted. Ranked by the number of answers carrying the site or page. 32 of the 252 answers across every segment cited this index's own page for the category; the method page measures whether that reading tilts an answer.
42 answers · 53 citations · 12 models
25 answers · 32 citations · 10 models
vendor site · DeployHQ25 answers · 25 citations · 11 models
22 answers · 29 citations · 11 models
vendor site · Atlassian21 answers · 24 citations · 10 models
21 answers · 24 citations · 9 models
19 answers · 19 citations · 7 models
17 answers · 17 citations · 7 models
vendor site · CircleCI16 answers · 20 citations · 10 models
16 answers · 16 citations · 10 models
13 answers · 14 citations · 7 models
13 answers · 13 citations · 6 models
Pages the answers cite
The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.
41 answers · 12 models
25 answers · 11 models
19 answers · 7 models
17 answers · 7 models
16 answers · 9 models
15 answers · 9 models
14 answers · 8 models
14 answers · 10 models
13 answers · 7 models
12 answers · 6 models
Search against answers
Each company's standing in the answers beside its site's footprint in Google search, one row a site: the products the models named on it with their shares, and the share they add up to; monthly searches on Google, and DataForSEO's estimate of AI search demand (modeled from search signals, directional, not a count of queries to any assistant), for the most-searched of the company's and its products' names (the name is in each row's hover text); estimated monthly organic visits to the site; and its best position in Google's top ten for “best ci/cd platform”, “ci/cd platform”, “ci/cd platforms”. US estimates from DataForSEO and Google's Ads Transparency Center. A small company's site, or a mid-sized company's site for its flagship, is marked company; a product on a large parent's site (Google, Microsoft) has no site figures. A column with no figures for this category is left out, and an empty cell means none were seen, not none exist. Two measurements side by side: neither is read as the cause of the other.
| Company and products | Share | Own site cited | Name searches, Google | AI search demand, est. | Organic visits | Paid search a month, est. | Google ads, last 30 days | Best Google position |
|---|---|---|---|---|---|---|---|---|
| GitHub parent site GitHub Actions 75% | 75% | 175 | 1,500,000 | 31,479 | ||||
| GitLab gitlab.com GitLab CI/CD 15% | 15% | 188 | 90,500 | 4,844 | 603,028 company | $884 | 66 | 5 |
| CircleCI circleci.com | 5% | 151 | 4,400 | 207 | 133,932 | 24 | ||
| DeployHQ deployhq.com | 2% | 9 | 260 | 1 | 13,215 | |||
| GitHub github.com | 2% | 237 | 1,500,000 | 31,479 | 42,019,137 | $81 | 14 | 5 |
| Podman podman.io | 2% | 2 | ||||||
| Bitbucket Pipelines bitbucket.org | 0% | 29 | 590 | 97 | 22,601 | |||
| Buildkite buildkite.com | 0% | 57 | 3,600 | 98 | 3,563 | $477 | 0 | |
| Vercel vercel.app | 0% | 20 | ||||||
| Netlify netlify.com | 0% | 11 |
Google's top ten for the three searches hold 16 sites; 3 of them are among the sites the models cited here (atlassian.com, blog.jetbrains.com, thectoclub.com). The first result for “best ci/cd platform” is reddit.com.
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.ShowHide
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ShowHideModelDirect“What is the best CI/CD platform for a small B2B company?”Paraphrase“Which continuous integration and delivery tool would you recommend to a small business that sells to other businesses?”Comparative“What are the top CI/CD platforms for a small team and how do they differ?”Budget-constrained“What is the best CI/CD platform for a small company with a tight budget?”Scale-constrained“We are a 30 person company evaluating a CI/CD platform. What should we look at?”Negative“Which CI/CD platforms should a small business avoid or be cautious about?”
Claude Haiku 4.5GitHub Actionsagainst: Jenkinsno first choiceChangedagainst: JenkinsGitHub Actionsagainst: JenkinsGitHub Actionsagainst: Jenkinsno first choiceagainst: Bitbucket Pipelines, Buildkite, CircleCI, GitLab CI/CD, Harness, Jenkins, Nortal
Two alternatives
CircleCI, GitLab CI/CDThree alternatives
CircleCI, DeployHQ, GitLab CI/CDTwo alternatives
CircleCI, GitLab CI/CDGPT-5.4 miniGitHub Actionsagainst: JenkinsGitHub ActionsHeldagainst: JenkinsGitHub Actionsagainst: JenkinsGitHub Actionsagainst: CircleCI, Jenkinsno first choiceagainst: CircleCI, GitLab CI/CD
Two alternatives
CircleCI, GitLab CI/CDThree alternatives
Azure DevOps, CircleCI, GitLab CI/CDThree alternatives
Bitbucket Pipelines, CircleCI, GitLab CI/CDOne alternative
GitLab CI/CDGemini 3.5 FlashGitHub Actionsagainst: JenkinsGitHub ActionsHeldagainst: JenkinsGitHub Actionsagainst: JenkinsGitHub Actionsagainst: JenkinsGitHub Actionsagainst: Argo CD, Jenkinsagainst: AWS CodePipeline, Atlassian Bamboo, CircleCI, Jenkins, JetBrains TeamCity, Spinnaker, Travis CI
Five alternatives
Bitbucket Pipelines, GitLab CI/CD, Railway, Render, VercelTwo alternatives
GitLab CI/CD, Octopus DeployFive alternatives
Bitbucket Pipelines, CircleCI, GitLab CI/CD, Netlify, VercelTwo alternatives
CircleCI, GitLab CI/CDFive alternatives
CircleCI, GitLab CI/CD, Railway, Render, VercelPerplexity SonarGitHub ActionsGitHub ActionsHeldGitHub ActionsGitHub Actionsagainst: Jenkinsno first choiceagainst: CircleCI, GitLab CI/CD, Jenkins, Spinnaker, Travis CI
Three alternatives
CircleCI, DeployHQ, SemaphoreThree alternatives
Azure Pipelines, GitLab CI/CD, JetBrains TeamCityFour alternatives
Bitbucket Pipelines, CircleCI, DeployHQ, GitLab CI/CDOne alternative
GitLab CI/CDGrok 4.1 FastGitHub Actionsagainst: JenkinsGitHub ActionsHeldagainst: CircleCI, JenkinsGitHub Actionsagainst: JenkinsGitHub Actionsagainst: JenkinsGitHub Actionsagainst: Jenkinsagainst: AWS CodeBuild, Azure Pipelines, CircleCI, GitLab CI/CD, Google Cloud Build, Jenkins, Travis CI
Two alternatives
CircleCI, GitLab CI/CDOne alternative
GitLab CI/CDTwo alternatives
CircleCI, GitLab CI/CDTwo alternatives
CircleCI, GitLab CI/CDTwo alternatives
CircleCI, GitLab CI/CDMistral SmallGitHub Actions, GitLab CI/CDGitHub ActionsChangedagainst: JenkinsGitHub ActionsCircleCI, GitHub Actionsno first choiceagainst: AWS CodeBuild, Azure Pipelines, CircleCI, GitLab CI/CD, Jenkins, Travis CI
Two alternatives
Buildkite, CircleCITwo alternatives
CircleCI, GitLab CI/CDThree alternatives
CircleCI, GitLab CI/CD, JenkinsDeepSeek V4 FlashGitHub Actionsagainst: JenkinsGitHub ActionsHeldagainst: JenkinsGitHub Actionsagainst: Azure PipelinesGitHub Actionsagainst: JenkinsGitHub Actionsagainst: Buildkite, Jenkinsagainst: Atlassian Bamboo, Azure DevOps, CircleCI, Drone CI, Harness, JFrog Pipelines, Jenkins, Tekton, Travis CI
Three alternatives
Bitbucket Pipelines, CircleCI, GitLab CI/CDFour alternatives
Azure Pipelines, Buildkite, CircleCI, GitLab CI/CDThree alternatives
Buildkite, CircleCI, GitLab CI/CDTwo alternatives
CircleCI, GitLab CI/CDTwo alternatives
CircleCI, GitLab CI/CDLlama 4 Maverickno first choiceno first choiceHeldno first choiceCircleCI, DeployHQ, Podmanno first choiceagainst: GitLab CI/CD, Jenkins, Travis CI
One alternative
DeployHQQwen 3.7 FlashGitHub Actions, GitLab CI/CDagainst: JenkinsGitHub ActionsChangedagainst: Bitbucket Pipelines, JenkinsGitHub ActionsGitHub Actionsagainst: JenkinsGitHub Actions, GitLab CI/CDagainst: AWS CodePipeline, Azure Pipelines, Jenkinsagainst: AWS CodeBuild, Azure Pipelines, CircleCI, GitLab Premium Plan, Jenkins, Travis CI
One alternative
Bitbucket PipelinesOne alternative
GitLab CI/CDFour alternatives
Azure DevOps, Bitbucket Pipelines, CircleCI, GitLab CI/CDTwo alternatives
CircleCI, GitLab CI/CDOne alternative
CircleCIKimi K2GitHub ActionsGitHub ActionsHeldagainst: JenkinsGitHub Actions, GitLab CI/CDagainst: Drone CIGitHub ActionsGitHub Actions, GitLab CI/CDagainst: Jenkinsagainst: AWS CodeBuild, Azure DevOps, Azure Pipelines, CircleCI, GitLab CI/CD, Jenkins, JetBrains TeamCity
Two alternatives
CircleCI, GitLab CI/CDTwo alternatives
CircleCI, GitLab CI/CDThree alternatives
CircleCI, Semaphore, Woodpecker CITwo alternatives
CircleCI, GitLab CI/CDThree alternatives
Azure Pipelines, Buildkite, CircleCIGLM 4.7 FlashXGitHub ActionsGitHub ActionsHeldagainst: JenkinsGitHub Actionsagainst: JenkinsGitHub ActionsCircleCI, GitHub Actionsagainst: Jenkinsagainst: AWS CodeBuild, Bitbucket Pipelines, CircleCI, GitLab CI/CD, Jenkins, JetBrains TeamCity
Three alternatives
CircleCI, GitLab CI/CD, JenkinsThree alternatives
Bitbucket Pipelines, CircleCI, GitLab CI/CDThree alternatives
Azure DevOps, CircleCI, GitLab CI/CDTwo alternatives
GitLab CI/CD, JenkinsOne alternative
GitLab CI/CDMiniMax M2.5GitHub Actionsagainst: JenkinsGitLab CI/CDChangedGitHub ActionsGitHub Actions, GitLab CI/CDagainst: Bitbucket PipelinesGitHub Actions, GitLab CI/CDagainst: Jenkinsagainst: Atlassian Bamboo, Azure Pipelines, CircleCI, GitLab CI/CD, Jenkins, JetBrains TeamCity, Travis CI
One alternative
GitLab CI/CDFour alternatives
AWS CodeBuild, CircleCI, CodePipeline, GitHub ActionsThree alternatives
CircleCI, GitLab CI/CD, JenkinsOne alternative
JenkinsGPT-6 LunaGitHub ActionsGitHub ActionsHeldGitHub ActionsGitHub ActionsGitHub, GitLab CI/CDagainst: Buildkite, GitHub Actions, GitLab CI/CD, Jenkins
One alternative
GitLab CI/CDTwo alternatives
Azure Pipelines, GitLab CI/CDFour alternatives
Bitbucket Pipelines, Buildkite, CircleCI, GitLab CI/CDTwo alternatives
CircleCI, GitLab CI/CDOne alternative
BuildkiteMuse Glimmer 30BGitHub ActionsGitHub Actions, GitLab CI/CDChangedagainst: JenkinsGitHub Actionsagainst: JenkinsGitHub Actionsagainst: JenkinsGitHub Actionsagainst: Jenkinsagainst: Argo CD, Atlassian Bamboo, Azure DevOps, Harness, Jenkins, JetBrains TeamCity, Octopus Deploy, Spinnaker
Two alternatives
CircleCI, GitLab CI/CDThree alternatives
Bitbucket Pipelines, CircleCI, GitLab CI/CDFour alternatives
Bitbucket Pipelines, Buildkite, CircleCI, GitLab CI/CDTwo alternatives
CircleCI, GitLab CI/CDBold is the first choiceAlternatives are counted; the count opens them.What the answer argued against
The record
One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency. Full answer text is in the free responses file. Download the record
Eighty-four rows: every prompt, every model, every answer.
| Prompt | Model | Version string | Time (UTC) | Searched | Sources | Latency |
|---|---|---|---|---|---|---|
| Direct recommendation | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 10:09 | no | 0 | 5 s |
| Direct recommendation | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 10:16 | yes | 3 | 4 s |
| Direct recommendation | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 08:23 | yes | 8 | 23 s |
| Direct recommendation | Perplexity Sonar | sonar | 2026-10-01 09:35 | yes | 18 | 3 s |
| Direct recommendation | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 08:48 | yes | 15 | 5 s |
| Direct recommendation | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 11:20 | yes | 5 | 4 s |
| Direct recommendation | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 10:48 | yes | 22 | 26 s |
| Direct recommendation | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 09:39 | yes | 5 | 2 s |
| Direct recommendation | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 08:55 | no | 0 | 32 s |
| Direct recommendation | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 11:55 | yes | 10 | 16 s |
| Direct recommendation | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 10:27 | no | 0 | 38 s |
| Direct recommendation | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 07:26 | no | 0 | 8 s |
| Direct recommendation | GPT-6 Luna | gpt-6-luna | 2026-10-01 11:57 | yes | 3 | 6 s |
| Direct recommendation | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 07:28 | yes | 15 | 21 s |
| Paraphrase | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 13:11 | no | 0 | 4 s |
| Paraphrase | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 11:35 | no | 0 | 3 s |
| Paraphrase | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 11:28 | no | 0 | 14 s |
| Paraphrase | Perplexity Sonar | sonar | 2026-10-01 10:52 | yes | 18 | 2 s |
| Paraphrase | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 13:11 | yes | 15 | 12 s |
| Paraphrase | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 08:46 | no | 0 | 2 s |
| Paraphrase | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 12:15 | yes | 25 | 39 s |
| Paraphrase | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 09:51 | yes | 5 | 2 s |
| Paraphrase | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 09:33 | no | 0 | 27 s |
| Paraphrase | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 11:29 | yes | 15 | 16 s |
| Paraphrase | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 11:54 | yes | 20 | 41 s |
| Paraphrase | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 10:52 | yes | 10 | 34 s |
| Paraphrase | GPT-6 Luna | gpt-6-luna | 2026-10-01 07:47 | yes | 3 | 11 s |
| Paraphrase | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 08:33 | yes | 15 | 25 s |
| Comparative | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 11:57 | yes | 10 | 10 s |
| Comparative | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 09:46 | yes | 6 | 9 s |
| Comparative | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 13:02 | yes | 7 | 21 s |
| Comparative | Perplexity Sonar | sonar | 2026-10-01 09:56 | yes | 19 | 6 s |
| Comparative | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 08:35 | yes | 15 | 5 s |
| Comparative | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 11:30 | yes | 10 | 7 s |
| Comparative | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 09:25 | yes | 23 | 52 s |
| Comparative | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 12:06 | yes | 5 | 2 s |
| Comparative | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 11:02 | yes | 9 | 38 s |
| Comparative | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 10:21 | yes | 19 | 23 s |
| Comparative | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 09:17 | yes | 14 | 98 s |
| Comparative | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 09:57 | yes | 11 | 17 s |
| Comparative | GPT-6 Luna | gpt-6-luna | 2026-10-01 11:54 | yes | 6 | 19 s |
| Comparative | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 11:09 | yes | 14 | 25 s |
| Budget constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 09:12 | yes | 17 | 9 s |
| Budget constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 08:09 | no | 0 | 4 s |
| Budget constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 11:34 | yes | 11 | 22 s |
| Budget constrained | Perplexity Sonar | sonar | 2026-10-01 11:11 | yes | 20 | 4 s |
| Budget constrained | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 11:59 | yes | 15 | 4 s |
| Budget constrained | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 09:11 | yes | 5 | 3 s |
| Budget constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 11:53 | yes | 15 | 13 s |
| Budget constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 11:30 | yes | 5 | 1 s |
| Budget constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 08:09 | yes | 5 | 15 s |
| Budget constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 11:43 | yes | 10 | 14 s |
| Budget constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 08:39 | yes | 23 | 61 s |
| Budget constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 11:22 | no | 0 | 8 s |
| Budget constrained | GPT-6 Luna | gpt-6-luna | 2026-10-01 13:10 | yes | 3 | 11 s |
| Budget constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 11:57 | yes | 15 | 29 s |
| Scale constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 12:09 | no | 0 | 6 s |
| Scale constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 08:21 | no | 0 | 7 s |
| Scale constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 08:54 | yes | 14 | 27 s |
| Scale constrained | Perplexity Sonar | sonar | 2026-10-01 12:40 | yes | 18 | 6 s |
| Scale constrained | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 11:15 | yes | 13 | 10 s |
| Scale constrained | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 13:53 | no | 0 | 8 s |
| Scale constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 13:12 | yes | 23 | 50 s |
| Scale constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 11:36 | yes | 5 | 1 s |
| Scale constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 09:31 | no | 0 | 27 s |
| Scale constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 08:58 | yes | 19 | 28 s |
| Scale constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 08:25 | no | 0 | 21 s |
| Scale constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 09:15 | yes | 5 | 18 s |
| Scale constrained | GPT-6 Luna | gpt-6-luna | 2026-10-01 09:14 | yes | 3 | 19 s |
| Scale constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 08:23 | yes | 13 | 33 s |
| Negative framing | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 10:27 | yes | 17 | 11 s |
| Negative framing | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 11:03 | yes | 4 | 7 s |
| Negative framing | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 13:53 | yes | 17 | 23 s |
| Negative framing | Perplexity Sonar | sonar | 2026-10-01 08:41 | yes | 19 | 3 s |
| Negative framing | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 13:49 | yes | 21 | 9 s |
| Negative framing | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 12:14 | yes | 5 | 4 s |
| Negative framing | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 09:23 | yes | 24 | 35 s |
| Negative framing | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 13:30 | yes | 5 | 2 s |
| Negative framing | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 09:52 | yes | 23 | 51 s |
| Negative framing | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 07:54 | yes | 24 | 24 s |
| Negative framing | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 11:26 | yes | 20 | 297 s |
| Negative framing | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 12:53 | yes | 13 | 48 s |
| Negative framing | GPT-6 Luna | gpt-6-luna | 2026-10-01 13:30 | yes | 3 | 21 s |
| Negative framing | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 10:38 | yes | 24 | 42 s |
Normalization in this category
Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.
ShowHide
Category-scoped readings
CloudBees read as CloudBees CI
Drone read as Drone CI
GitLab read as GitLab CI/CD
GitLab CI read as GitLab CI/CD
GitLab Premium read as GitLab CI/CD
Unresolved, counted raw
GitLab Premium Plan
Harness CI
Nortal
Discontinued, still offered
No shut-down product was recommended here.