CI/CD platforms · September 2026 Edition
GitLab CI/CD vs CircleCI
Five of twelve models named GitLab CI/CD first on the direct prompt; one named CircleCI. Both were named by all twelve models and GitLab CI/CD carries 64 labels and CircleCI 58, so the shares are not directly comparable.
Named in one category this edition.
Named in one category this edition.
First-choice share27%4%Of first choices across the direct, paraphrase, budget and scale prompts, 0 to 100.
Negative rate5%16%Negative labels as a share of the product's labels, 0 to 100.
Rank in category#2#3A position in a field of 9; printed, not drawn.
Labels6458A count; the two differ.
The two percentage rows are drawn on one 0 to 100 track, GitLab CI/CD reading right to left. Rank and label count are printed, not drawn.GitHub Actions was named alongside these two in ten of the twelve direct answers. GitHub Actions vs GitLab CI/CD · GitHub Actions vs CircleCI
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all twelve models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the CI/CD platforms page.
By framing
How many of the twelve models made each the first choice, per way of asking, and how many argued against it.
GitLab CI/CDFirst choices, of twelve modelsCircleCI
Direct511 against CircleCI
Paraphrase51
Comparative00
Budget-constrained002 against CircleCI
Scale-constrained30
Negative103 against GitLab CI/CD · 6 against CircleCI
Bars are first choices, 0 to 12 each sideModels that argued againstA model can name both, so the two sides of a row do not sum to twelve.
The direct prompt
The plain question, one answer per model, grouped by where GitLab CI/CD and CircleCI stood in it.
Both were the first choice
1 of 12 modelsThe answer named them together, and the judge labeled each a first choice.MiniMax M2.5CircleCI, GitLab CI/CD alternatives: Azure DevOps
GitLab CI/CD first, CircleCI an alternative
4 of 12 modelsCircleCI was named in the answer but not as the choice, or not at all.Claude Haiku 4.5GitHub Actions, GitLab CI/CD alternatives: Azure DevOps, CircleCI
Gemini 3.5 FlashGitHub Actions, GitLab CI/CD alternatives: Argo CD
Perplexity SonarGitLab CI/CD alternatives: CircleCI, GitHub Actions, Semaphore
Mistral SmallGitHub Actions, GitLab CI/CD alternatives: CircleCI, Jenkins
Neither was the first choice, one was named
6 of 12 modelsThe answer put something else first and named one of the two as an alternative.GPT-5.4 miniGitHub Actions alternatives: Azure Pipelines, CircleCI, GitLab CI/CD
Grok 4.1 FastGitHub Actions alternatives: CircleCI, GitLab CI/CD
DeepSeek V4 FlashGitHub Actions alternatives: GitLab CI/CD
Qwen 3.7 FlashGitHub Actions alternatives: CircleCI, GitLab CI/CD
Kimi K2GitHub Actions alternatives: Azure DevOps, CircleCI, GitLab CI/CD
GLM 4.7 FlashXGitHub Actions alternatives: Azure Pipelines, CircleCI, GitLab CI/CD
Neither was named
1 of 12 modelsThe answer made no first choice from these two in this category.Llama 4 Maverickno first choice
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
By buyer segment
The same question asked on behalf of a different buyer. Each standing is computed within its segment and they are never added together. The figures above are the mid-market standing, which is the one the category orders by.
Small business
GitLab CI/CD leads by two points.
GitLab CI/CD5%#2 of 9CircleCI2%#3 of 9Mid-marketThe figures above
GitLab CI/CD leads by twenty-two points.
GitLab CI/CD27%#2 of 9CircleCI4%#3 of 9Enterprise
GitLab CI/CD leads by forty-two points.
GitLab CI/CD44%#1 of 11CircleCI2%#8 of 11What the models said about GitLab CI/CD
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of seven in this category shown.
“When to be cautious: SaaS users needing high availability; self-hosted setups amplify risks if not updated.” Grok 4.1 Fast · negative prompt · soft negative
“The Caution: Stability & Downtime. ... Avoid GitLab.com (SaaS)” GLM 4.7 FlashX · negative prompt · soft negative
“its pricing model is also based on per-minute usage on SaaS” Llama 4 Maverick · negative prompt · soft negative
“the best overall CI/CD platform is usually GitLab CI/CD if you want an integrated platform with built-in DevSecOps” Perplexity Sonar · direct prompt · first choice
“Shortlist: GitHub Actions (if GitHub-centric), GitLab (end-to-end), CircleCI (speed-focused).” Grok 4.1 Fast · scale prompt · first choice
“GitHub Actions and GitLab CI/CD are the undisputed leaders for mid-market B2B companies” Gemini 3.5 Flash · direct prompt · first choice
What the models said about CircleCI
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of eight in this category shown.
“Avoid CircleCI initially: While powerful, its pricing model can spiral quickly” Qwen 3.7 Flash · budget prompt · hard negative
“In January 2023, CircleCI suffered a severe breach... you are trusting a third party that has proven it can be breached” DeepSeek V4 Flash · negative prompt · soft negative
“Major 2023 breach—malware on an engineer's laptop stole session tokens, exposing customer encryption keys” Grok 4.1 Fast · negative prompt · soft negative
“GitLab CI/CD or CircleCI are excellent choices due to their balance of features, ease of use, and scalability” Mistral Small · paraphrase prompt · first choice
“I'd recommend considering GitLab or CircleCI as top choices” MiniMax M2.5 · direct prompt · first choice
“worth considering if you need stronger performance or parallelism, but budget-conscious guides still tend to put GitHub Actions ahead” Perplexity Sonar · budget prompt · alternative
Comparisons are drawn for the top three products in each category. The output is the models' output; nothing here is a recommendation by the index.