Five of fourteen models named Pinecone first on the direct prompt; zero named MongoDB Atlas Vector Search. Pinecone was named by fourteen of the fourteen models and MongoDB Atlas Vector Search by eight and Pinecone carries 70 labels and MongoDB Atlas Vector Search 12, so the shares are not directly comparable.
Named in one category this edition.
Named in one category this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all fourteen models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the vector databases page.
| Model | Direct | Paraphrase | Comparative | Budget-constrained | Scale-constrained | Negative |
|---|---|---|---|---|---|---|
| Claude Haiku 4.5 | ||||||
| GPT-5.4 mini | ||||||
| Gemini 3.5 Flash | ||||||
| Perplexity Sonar | ||||||
| Grok 4.1 Fast | ||||||
| Mistral Small | ||||||
| DeepSeek V4 Flash | ||||||
| Llama 4 Maverick | ||||||
| Qwen 3.7 Flash | ||||||
| Kimi K2 | ||||||
| GLM 4.7 FlashX | ||||||
| MiniMax M2.5 | ||||||
| GPT-6 Luna | ||||||
| Muse Glimmer 30B |
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Six of eight in this category shown.
“Pinecone operates as a "black box" with no infrastructure access or visibility into underlying systems. It's notably expensive” MiniMax M2.5 · negative prompt · hard negative
“Be cautious about closed-source managed vendors (especially Pinecone) where you risk lock-in and escalating costs” DeepSeek V4 Flash · negative prompt · hard negative
“Pinecone (serverless) | Unpredictable costs, vendor lock-in, known outages” GLM 4.7 FlashX · negative prompt · hard negative
“The lowest operational overhead. You pay purely for what you write and read, with zero cluster management or pod sizing. Ideal if you want to ship fast.” Gemini 3.5 Flash · scale prompt · first choice
“For most teams, Pinecone is recommended if you want zero-ops managed deployment, and Qdrant if you want open-source performance and cost control.” Claude Haiku 4.5 · comparative prompt · first choice
“I'd recommend either Pinecone (if you prioritize ease and managed infrastructure) or Weaviate (if you want flexibility and cost control)” Claude Haiku 4.5 · direct prompt · first choice
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Four of four in this category shown.
“MongoDB Atlas gets pricing gripes in broader DB contexts” Grok 4.1 Fast · negative prompt · soft negative
“the sweet spot today is MongoDB Atlas Vector Search (if your data already lives in MongoDB)” GLM 4.7 FlashX · paraphrase prompt · first choice
“Stick with MongoDB Atlas if your existing data pipeline is already built around MongoDB documents.” Qwen 3.7 Flash · direct prompt · alternative
“Use pgvector or Atlas Vector Search” Kimi K2 · scale prompt · alternative
Comparisons are drawn for the top eight products in each category, each against each. The output is the models' output; nothing here is a recommendation by the index.