CI/CD platforms · September 2026 Edition
GitHub Actions vs CircleCI
Nine of twelve models named GitHub Actions first on the direct prompt; one named CircleCI. Both were named by all twelve models and GitHub Actions carries 63 labels and CircleCI 58, so the shares are not directly comparable.
Named in two categories this edition.
Named in one category this edition.
First-choice share65%4%Of first choices across the direct, paraphrase, budget and scale prompts, 0 to 100.
Negative rate8%16%Negative labels as a share of the product's labels, 0 to 100.
Rank in category#1#3A position in a field of 9; printed, not drawn.
Labels6358A count; the two differ.
The two percentage rows are drawn on one 0 to 100 track, GitHub Actions reading right to left. Rank and label count are printed, not drawn.GitLab CI/CD was named alongside these two in eleven of the twelve direct answers. GitHub Actions vs GitLab CI/CD · GitLab CI/CD vs CircleCI
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all twelve models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the CI/CD platforms page.
By framing
How many of the twelve models made each the first choice, per way of asking, and how many argued against it.
GitHub ActionsFirst choices, of twelve modelsCircleCI
Direct911 against CircleCI
Paraphrase71
Comparative70
Budget-constrained1202 against CircleCI
Scale-constrained401 against GitHub Actions
Negative304 against GitHub Actions · 6 against CircleCI
Bars are first choices, 0 to 12 each sideModels that argued againstA model can name both, so the two sides of a row do not sum to twelve.
The direct prompt
The plain question, one answer per model, grouped by where GitHub Actions and CircleCI stood in it.
GitHub Actions first, CircleCI an alternative
9 of 12 modelsCircleCI was named in the answer but not as the choice, or not at all.Claude Haiku 4.5GitHub Actions, GitLab CI/CD alternatives: Azure DevOps, CircleCI
GPT-5.4 miniGitHub Actions alternatives: Azure Pipelines, CircleCI, GitLab CI/CD
Gemini 3.5 FlashGitHub Actions, GitLab CI/CD alternatives: Argo CD
Grok 4.1 FastGitHub Actions alternatives: CircleCI, GitLab CI/CD
Mistral SmallGitHub Actions, GitLab CI/CD alternatives: CircleCI, Jenkins
DeepSeek V4 FlashGitHub Actions alternatives: GitLab CI/CD
Qwen 3.7 FlashGitHub Actions alternatives: CircleCI, GitLab CI/CD
Kimi K2GitHub Actions alternatives: Azure DevOps, CircleCI, GitLab CI/CD
GLM 4.7 FlashXGitHub Actions alternatives: Azure Pipelines, CircleCI, GitLab CI/CD
CircleCI first, GitHub Actions not the choice
1 of 12 modelsGitHub Actions was named in the answer but not as the choice, or not at all.MiniMax M2.5CircleCI, GitLab CI/CD alternatives: Azure DevOps
Neither was the first choice, one was named
1 of 12 modelsThe answer put something else first and named one of the two as an alternative.Perplexity SonarGitLab CI/CD alternatives: CircleCI, GitHub Actions, Semaphore
Neither was named
1 of 12 modelsThe answer made no first choice from these two in this category.Llama 4 Maverickno first choice
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
By buyer segment
The same question asked on behalf of a different buyer. Each standing is computed within its segment and they are never added together. The figures above are the mid-market standing, which is the one the category orders by.
Small business
GitHub Actions leads by ninety-one points.
GitHub Actions93%#1 of 9CircleCI2%#3 of 9Mid-marketThe figures above
GitHub Actions leads by sixty-one points.
GitHub Actions65%#1 of 9CircleCI4%#3 of 9Enterprise
GitHub Actions leads by fourteen points.
GitHub Actions16%#2 of 11CircleCI2%#8 of 11What the models said about GitHub Actions
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of eight in this category shown.
“Issues: Frequent outages—e.g., 57 incidents... Supply-chain attacks via unvetted third-party actions are common” Grok 4.1 Fast · negative prompt · soft negative
“simple solutions (like basic GitHub Actions with limited runners) often break down due to scaling issues” Qwen 3.7 Flash · scale prompt · soft negative
“its pricing model is based on per-minute usage on hosted runners” Llama 4 Maverick · negative prompt · soft negative
“If your code is on GitHub and you want something fast and simple: Go with GitHub Actions. It requires no setup, has a massive marketplace, and is highly cost-effective.” Gemini 3.5 Flash · comparative prompt · first choice
“Most mid-market B2B companies find GitHub Actions or GitLab CI/CD to be the sweet spot between ease of use, feature completeness, and cost.” Claude Haiku 4.5 · direct prompt · first choice
“Code on GitHub? GitHub Actions is the default, but evaluate GitHub Actions + required third-party security tools vs. GitLab (all-in-one)” Kimi K2 · scale prompt · first choice
What the models said about CircleCI
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of eight in this category shown.
“Avoid CircleCI initially: While powerful, its pricing model can spiral quickly” Qwen 3.7 Flash · budget prompt · hard negative
“In January 2023, CircleCI suffered a severe breach... you are trusting a third party that has proven it can be breached” DeepSeek V4 Flash · negative prompt · soft negative
“Major 2023 breach—malware on an engineer's laptop stole session tokens, exposing customer encryption keys” Grok 4.1 Fast · negative prompt · soft negative
“GitLab CI/CD or CircleCI are excellent choices due to their balance of features, ease of use, and scalability” Mistral Small · paraphrase prompt · first choice
“I'd recommend considering GitLab or CircleCI as top choices” MiniMax M2.5 · direct prompt · first choice
“worth considering if you need stronger performance or parallelism, but budget-conscious guides still tend to put GitHub Actions ahead” Perplexity Sonar · budget prompt · alternative
Comparisons are drawn for the top three products in each category. The output is the models' output; nothing here is a recommendation by the index.