Zero of fourteen models named Chroma first on the direct prompt; zero named Milvus. Both were named by all fourteen models and Chroma carries 36 labels and Milvus 41, so the shares are not directly comparable.
Named in one category this edition.
Named in one category this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all fourteen models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the vector databases page.
Across every category in the October 2026 Edition, Chroma and Milvus were named in the same answer sixty-four times, of the 101 answers naming Chroma and the 140 naming Milvus. In those answers Milvus took the first choice two times and Chroma seven.
| Model | Direct | Paraphrase | Comparative | Budget-constrained | Scale-constrained | Negative |
|---|---|---|---|---|---|---|
| Claude Haiku 4.5 | ||||||
| GPT-5.4 mini | ||||||
| Gemini 3.5 Flash | ||||||
| Perplexity Sonar | ||||||
| Grok 4.1 Fast | ||||||
| Mistral Small | ||||||
| DeepSeek V4 Flash | ||||||
| Llama 4 Maverick | ||||||
| Qwen 3.7 Flash | ||||||
| Kimi K2 | ||||||
| GLM 4.7 FlashX | ||||||
| MiniMax M2.5 | ||||||
| GPT-6 Luna | ||||||
| Muse Glimmer 30B |
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of eight in this category shown.
“Chroma has experienced significant production issues, including a critical memory leak... A severe cache invalidation bug in version 0.5 caused p99 latency to spike from 42ms to 542ms” MiniMax M2.5 · negative prompt · hard negative
“Only use Chroma behind a private network with auth enabled and patched, never internet exposed with defaults.” Muse Glimmer 30B · negative prompt · hard negative
“Avoid Chroma for production — it's a prototype tool, not a production database” Kimi K2 · negative prompt · hard negative
“Start with Chroma or Qdrant (self‑hosted) or pgvector if you already have PostgreSQL.” GLM 4.7 FlashX · budget prompt · first choice
“Best for small budgets: Chroma (free, self-hosted) or pgvector (free, if using PostgreSQL).” Mistral Small · budget prompt · first choice
“Chroma: Offers a free plan and is considered one of the cheapest options.” Llama 4 Maverick · budget prompt · first choice
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of eight in this category shown.
“heavy self-hosted systems like Milvus (requires Kubernetes know-how) ... neither is friendly to a limited budget” DeepSeek V4 Flash · budget prompt · hard negative
“Caution: If you run Milvus self-hosted, you must be on 2.4.24+, 2.5.21+ or 2.6.5+ and strip `sourceID` at the gateway” Muse Glimmer 30B · negative prompt · soft negative
“handles billions of vectors at lower cost; requires engineering resources... more resource-intensive to operate” Claude Haiku 4.5 · comparative prompt · soft negative
“likely to be an open-source option such as Milvus or Chroma, as they offer free or low-cost options” Llama 4 Maverick · budget prompt · first choice
“I'd recommend starting with either self-hosted Milvus/Qdrant (if you have DevOps capacity)” Claude Haiku 4.5 · budget prompt · first choice
“Massive Scale / Billions of vectors | Milvus” Qwen 3.7 Flash · comparative prompt · first choice
Comparisons are drawn for the top eight products in each category, each against each. The output is the models' output; nothing here is a recommendation by the index.