Five of fourteen models named Cloudsmith first on the direct prompt; one named GitHub Packages. Cloudsmith was named by ten of the fourteen models and GitHub Packages by twelve and Cloudsmith carries 21 labels and GitHub Packages 42, so the shares are not directly comparable.
Named in three categories this edition.
Named in one category this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all fourteen models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the artifact and container registries page.
Across every category in the October 2026 Edition, Cloudsmith and GitHub Packages were named in the same answer thirty-five times, of the 64 answers naming Cloudsmith and the 120 naming GitHub Packages. In those answers GitHub Packages took the first choice five times and Cloudsmith two.
| Model | Direct | Paraphrase | Comparative | Budget-constrained | Scale-constrained | Negative |
|---|---|---|---|---|---|---|
| Claude Haiku 4.5 | GP | |||||
| GPT-5.4 mini | ||||||
| Gemini 3.5 Flash | GP | GP | GP | |||
| Perplexity Sonar | ||||||
| Grok 4.1 Fast | GP | GP | GP | |||
| Mistral Small | GP | |||||
| DeepSeek V4 Flash | GP | GP | ||||
| Llama 4 Maverick | ||||||
| Qwen 3.7 Flash | GP | GP | ||||
| Kimi K2 | GP | GP | GP | GP | ||
| GLM 4.7 FlashX | GP | |||||
| MiniMax M2.5 | GP | |||||
| GPT-6 Luna | GP | GP | ||||
| Muse Glimmer 30B | GP |
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Five of six in this category shown.
“Skip cloud-hosted options (like JFrog Cloud or Cloudsmith)” DeepSeek V4 Flash · budget prompt · hard negative
“Cons: Can get expensive with high usage” MiniMax M2.5 · budget prompt · soft negative
“Cloudsmith - a natural fit for engineering teams at scaling startups and mid-size companies that want enterprise-grade artifact management” Llama 4 Maverick · direct prompt · first choice
“Cloudsmith stands out as a particularly strong choice for engineering teams at scaling startups and mid-size companies” Mistral Small · direct prompt · first choice
“Best Overall for SaaS & Multi-Language Stacks: Cloudsmith ... is the standout choice” Gemini 3.5 Flash · direct prompt · first choice
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of eight in this category shown.
“avoid direct, unrestricted use of public community images from Docker Hub, GitHub Container Registry, npm/PyPI, Artifact Hub” Muse Glimmer 30B · negative prompt · hard negative
“GitHub Packages does not natively support PyPI (Python). If your team writes a significant amount of Python, GitHub Packages will not be a complete solution.” Gemini 3.5 Flash · direct prompt · soft negative
“Cons: Often less mature in terms of advanced proxying, virtual repositories, and advanced binary management compared to dedicated tools.” Gemini 3.5 Flash · scale prompt · soft negative
“For most small to medium companies, GitHub Packages is often the best choice if you're already using GitHub” Claude Haiku 4.5 · budget prompt · first choice
“The Best "All-in-One" Option: GitHub Packages / GitLab Package Registry” Gemini 3.5 Flash · budget prompt · first choice
“Top Recommendation: GitHub Packages” Kimi K2 · direct prompt · first choice
Comparisons are drawn for the top eight products in each category, each against each. The output is the models' output; nothing here is a recommendation by the index.