Two of fourteen models named GitLab CI/CD first on the direct prompt; zero named Buildkite. GitLab CI/CD was named by fourteen of the fourteen models and Buildkite by nine and GitLab CI/CD carries 73 labels and Buildkite 19, so the shares are not directly comparable.
Named in one category this edition.
Named in two categories this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all fourteen models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the CI/CD platforms page.
Across every category in the October 2026 Edition, GitLab CI/CD and Buildkite were named in the same answer fifty-six times, of the 223 answers naming GitLab CI/CD and the 60 naming Buildkite. In those answers Buildkite took the first choice four times and GitLab CI/CD ten.
| Model | Direct | Paraphrase | Comparative | Budget-constrained | Scale-constrained | Negative |
|---|---|---|---|---|---|---|
| Claude Haiku 4.5 | ||||||
| GPT-5.4 mini | ||||||
| Gemini 3.5 Flash | ||||||
| Perplexity Sonar | ||||||
| Grok 4.1 Fast | ||||||
| Mistral Small | ||||||
| DeepSeek V4 Flash | ||||||
| Llama 4 Maverick | ||||||
| Qwen 3.7 Flash | ||||||
| Kimi K2 | ||||||
| GLM 4.7 FlashX | ||||||
| MiniMax M2.5 | ||||||
| GPT-6 Luna | ||||||
| Muse Glimmer 30B |
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of eight in this category shown.
“Over 810 hours, caused by faulty updates and overload of CI/CD services during periods of heavy traffic.” Muse Glimmer 30B · negative prompt · soft negative
“GitLab specifically warns about shared non-ephemeral runners and privileged containers” GPT-6 Luna · negative prompt · soft negative
“Vendor Lock-in Risk ... Self-hosted GitLab is notoriously resource-hungry.” Qwen 3.7 Flash · negative prompt · soft negative
“Some of the top recommendations include: 1. GitLab CI: A comprehensive CI/CD solution integrated within the GitLab DevSecOps platform.” Llama 4 Maverick · paraphrase prompt · first choice
“GitHub Actions or GitLab CI/CD offer the best combination of features, ease of use, and generous free tiers.” Kimi K2 · budget prompt · first choice
“GitHub Actions and GitLab CI/CD are the safest defaults if you're already on those ecosystems” DeepSeek V4 Flash · scale prompt · first choice
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of eight in this category shown.
“Consider Buildkite; it supports hosted and self-managed agents, but self-managed infrastructure adds operational work.” GPT-6 Luna · paraphrase prompt · soft negative
“likely overkill for most mid-sized B2B companies” DeepSeek V4 Flash · paraphrase prompt · soft negative
“Great tools, but less favorable free tiers” DeepSeek V4 Flash · budget prompt · soft negative
“Buildkite or GitLab CI/CD are excellent choices due to their balance of scalability, ease of use, and integration capabilities” Mistral Small · paraphrase prompt · first choice
“Buildkite or Harness are worth strong consideration if you need high-scale performance or advanced CD capabilities.” DeepSeek V4 Flash · scale prompt · alternative
“If you need more control over your infrastructure, Buildkite or TeamCity may be preferable.” Mistral Small · direct prompt · alternative
Comparisons are drawn for the top eight products in each category, each against each. The output is the models' output; nothing here is a recommendation by the index.