One of fourteen models named CircleCI first on the direct prompt; zero named Buildkite. CircleCI was named by fourteen of the fourteen models and Buildkite by nine and CircleCI carries 64 labels and Buildkite 19, so the shares are not directly comparable.
Named in two categories this edition.
Named in two categories this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all fourteen models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the CI/CD platforms page.
Across every category in the October 2026 Edition, CircleCI and Buildkite were named in the same answer forty-four times, of the 177 answers naming CircleCI and the 60 naming Buildkite. In those answers Buildkite took the first choice four times and CircleCI one.
| Model | Direct | Paraphrase | Comparative | Budget-constrained | Scale-constrained | Negative |
|---|---|---|---|---|---|---|
| Claude Haiku 4.5 | ||||||
| GPT-5.4 mini | ||||||
| Gemini 3.5 Flash | ||||||
| Perplexity Sonar | ||||||
| Grok 4.1 Fast | ||||||
| Mistral Small | ||||||
| DeepSeek V4 Flash | ||||||
| Llama 4 Maverick | ||||||
| Qwen 3.7 Flash | ||||||
| Kimi K2 | ||||||
| GLM 4.7 FlashX | ||||||
| MiniMax M2.5 | ||||||
| GPT-6 Luna | ||||||
| Muse Glimmer 30B |
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of eight in this category shown.
“most companies have migrated to GitHub Actions to avoid paying for two separate platform subscriptions” Gemini 3.5 Flash · direct prompt · soft negative
“solid standalone CI tool, but it's CI-focused (not full CD) and has faced pricing pressure” DeepSeek V4 Flash · paraphrase prompt · soft negative
“Best for: Speed-critical builds, though free tier is more limited than competitors” Kimi K2 · budget prompt · soft negative
“GitHub Actions or CircleCI are the best starting points due to their generous free tiers and ease of use” Mistral Small · budget prompt · first choice
“CircleCI or GitLab CI are the best CI/CD platforms due to their balance of features, scalability, and cost” Mistral Small · direct prompt · first choice
“CircleCI if its execution environments, concurrency, or existing workflows are a particularly good match.” GPT-6 Luna · direct prompt · alternative
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of eight in this category shown.
“Consider Buildkite; it supports hosted and self-managed agents, but self-managed infrastructure adds operational work.” GPT-6 Luna · paraphrase prompt · soft negative
“likely overkill for most mid-sized B2B companies” DeepSeek V4 Flash · paraphrase prompt · soft negative
“Great tools, but less favorable free tiers” DeepSeek V4 Flash · budget prompt · soft negative
“Buildkite or GitLab CI/CD are excellent choices due to their balance of scalability, ease of use, and integration capabilities” Mistral Small · paraphrase prompt · first choice
“Buildkite or Harness are worth strong consideration if you need high-scale performance or advanced CD capabilities.” DeepSeek V4 Flash · scale prompt · alternative
“If you need more control over your infrastructure, Buildkite or TeamCity may be preferable.” Mistral Small · direct prompt · alternative
Comparisons are drawn for the top eight products in each category, each against each. The output is the models' output; nothing here is a recommendation by the index.