Nine of twelve models named GitHub Actions first on the direct prompt; five named GitLab CI/CD. Both were named by all twelve models and GitHub Actions carries 63 labels and GitLab CI/CD 64, so the shares are not directly comparable.
Named in two categories this edition.
Named in one category this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all twelve models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the CI/CD platforms page.
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of eight in this category shown.
“Issues: Frequent outages—e.g., 57 incidents... Supply-chain attacks via unvetted third-party actions are common” Grok 4.1 Fast · negative prompt · soft negative
“simple solutions (like basic GitHub Actions with limited runners) often break down due to scaling issues” Qwen 3.7 Flash · scale prompt · soft negative
“its pricing model is based on per-minute usage on hosted runners” Llama 4 Maverick · negative prompt · soft negative
“If your code is on GitHub and you want something fast and simple: Go with GitHub Actions. It requires no setup, has a massive marketplace, and is highly cost-effective.” Gemini 3.5 Flash · comparative prompt · first choice
“Most mid-market B2B companies find GitHub Actions or GitLab CI/CD to be the sweet spot between ease of use, feature completeness, and cost.” Claude Haiku 4.5 · direct prompt · first choice
“Code on GitHub? GitHub Actions is the default, but evaluate GitHub Actions + required third-party security tools vs. GitLab (all-in-one)” Kimi K2 · scale prompt · first choice
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of seven in this category shown.
“When to be cautious: SaaS users needing high availability; self-hosted setups amplify risks if not updated.” Grok 4.1 Fast · negative prompt · soft negative
“The Caution: Stability & Downtime. ... Avoid GitLab.com (SaaS)” GLM 4.7 FlashX · negative prompt · soft negative
“its pricing model is also based on per-minute usage on SaaS” Llama 4 Maverick · negative prompt · soft negative
“the best overall CI/CD platform is usually GitLab CI/CD if you want an integrated platform with built-in DevSecOps” Perplexity Sonar · direct prompt · first choice
“Shortlist: GitHub Actions (if GitHub-centric), GitLab (end-to-end), CircleCI (speed-focused).” Grok 4.1 Fast · scale prompt · first choice
“GitHub Actions and GitLab CI/CD are the undisputed leaders for mid-market B2B companies” Gemini 3.5 Flash · direct prompt · first choice
Comparisons are drawn for the top three products in each category. The output is the models' output; nothing here is a recommendation by the index.