Secrets management for enterprise buyers
Asked as “secrets management tool”, and as “secrets vault for applications and infrastructure”, on behalf of an enterprise B2B company. 51 first choices recorded across the direct, paraphrase, budget and scale prompts, fourteen models each.
Standing · first-choice share
61%
Clear leader
61HashiCorp Vault06Infisical04AWS Secrets Manager29others
61% of first choices, clear leader.
Since September 2026▼−12Since September 2026: 75% → 63%, −12 points. Past the 11-point floor: movement. Read over the models both editions asked.HashiCorp Vault held the lead, −12 points on 75%, past the floor.
By buyer segment
The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.
Small business
Doppler39%Contested▼−12Since September 2026: 46% → 34%, −12 points. Past the 11-point floor: movement. Read over the models both editions asked.Standing →Mid-market
HashiCorp Vault31%Contested↗new leaderNew leader since September 2026: HashiCorp Vault (33%) replaces Doppler (33% then, 29% now), 4 points clear, inside the 11-point floor.Standing →EnterpriseHashiCorp Vault61%Clear leader▼−12Since September 2026: 75% → 63%, −12 points. Past the 11-point floor: movement. Read over the models both editions asked.This page
Doppler39%Contested▼−12Since September 2026: 46% → 34%, −12 points. Past the 11-point floor: movement. Read over the models both editions asked.Standing →Mid-marketHashiCorp Vault31%Contested↗new leaderNew leader since September 2026: HashiCorp Vault (33%) replaces Doppler (33% then, 29% now), 4 points clear, inside the 11-point floor.Standing →EnterpriseHashiCorp Vault61%Clear leader▼−12Since September 2026: 75% → 63%, −12 points. Past the 11-point floor: movement. Read over the models both editions asked.This pageThe standing
Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all fourteen models, for an enterprise B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrantSince September 2026
01HashiCorp Vault61%18%82endorsed leader▼−12Since September 2026: 75% → 63%, −12 points. Past the 11-point floor: movement. Read over the models both editions asked.75% → 63%
HashiCorp Vault61%18%82endorsed leader▼−12Since September 2026: 75% → 63%, −12 points. Past the 11-point floor: movement. Read over the models both editions asked.75% → 63%02
Infisical6%24%34accepted challenger▲+5Since September 2026: 2% → 7%, +5 points. Inside the 11-point floor: within noise. Read over the models both editions asked.2% → 7%
Infisical6%24%34accepted challenger▲+5Since September 2026: 2% → 7%, +5 points. Inside the 11-point floor: within noise. Read over the models both editions asked.2% → 7%03
Akeyless4%2%42accepted challenger▼−5Since September 2026: 10% → 5%, −5 points. Inside the 11-point floor: within noise. Read over the models both editions asked.10% → 5%
Akeyless4%2%42accepted challenger▼−5Since September 2026: 10% → 5%, −5 points. Inside the 11-point floor: within noise. Read over the models both editions asked.10% → 5%04
AWS Secrets Manager4%31%61criticized challenger▼−2Since September 2026: 2% → 0%, −2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.2% → 0%
AWS Secrets Manager4%31%61criticized challenger▼−2Since September 2026: 2% → 0%, −2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.2% → 0%05
CyberArk Secrets Manager4%11%19accepted challenger▲+5Since September 2026: 0% → 5%, +5 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 5%
CyberArk Secrets Manager4%11%19accepted challenger▲+5Since September 2026: 0% → 5%, +5 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 5%06Doppler4%31%39criticized challenger=heldSince September 2026: 5% → 5%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.5% → 5%
Doppler4%31%39criticized challenger=heldSince September 2026: 5% → 5%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.5% → 5%07
OpenBao4%8%12accepted challenger▲+2Since September 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 2%
OpenBao4%8%12accepted challenger▲+2Since September 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 2%08
Azure Key Vault2%21%53accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%
Azure Key Vault2%21%53accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%09
CyberArk Conjur2%23%30accepted challenger▲+2Since September 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 2%
CyberArk Conjur2%23%30accepted challenger▲+2Since September 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 2%10
Google Secret Manager Lab in the set2%25%40criticized challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%
Google Secret Manager Lab in the set2%25%40criticized challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%Show the two products at 0%, ordered by negative rate
12
Delinea Secret Server0%20%10accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%
Delinea Secret Server0%20%10accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%11
1Password0%8%12accepted challenger▼−5Since September 2026: 5% → 0%, −5 points. Inside the 11-point floor: within noise. Read over the models both editions asked.5% → 0%
1Password0%8%12accepted challenger▼−5Since September 2026: 5% → 0%, −5 points. Inside the 11-point floor: within noise. Read over the models both editions asked.5% → 0%The floor is 11 points of share, measured: how far the models move a leader on their own when the same questions are asked twice with nothing changed. A larger change is movement; a smaller one is noise, and both are shown. Movement is read over the twelve models both editions asked; GPT-6 Luna, Muse Glimmer 30B joined this edition and are in the standing but not yet in the comparison. How the floor is measured
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its product page.
Google Secret Manager is made by Google, whose model Gemini 3.5 Flash is in the set. On the four share prompts that model made it the first choice zero times of 4; the other thirteen models one time of 52. Lab treatment is defined on the method page; the row is marked, not excluded.
Head to head
All twenty-eight head-to-head pages: the top eight products, each against each
HashiCorp Vault vs Azure Key VaultHashiCorp Vault vs Bitwarden Secrets ManagerHashiCorp Vault vs 1PasswordHashiCorp Vault vs SOPSDoppler vs InfisicalDoppler vs AWS Secrets ManagerDoppler vs Azure Key VaultDoppler vs Bitwarden Secrets ManagerDoppler vs 1PasswordDoppler vs SOPSInfisical vs AWS Secrets ManagerInfisical vs Azure Key VaultInfisical vs Bitwarden Secrets ManagerInfisical vs 1PasswordInfisical vs SOPSAWS Secrets Manager vs Azure Key VaultAWS Secrets Manager vs Bitwarden Secrets ManagerAWS Secrets Manager vs 1PasswordAWS Secrets Manager vs SOPSAzure Key Vault vs Bitwarden Secrets ManagerAzure Key Vault vs 1PasswordAzure Key Vault vs SOPSBitwarden Secrets Manager vs 1PasswordBitwarden Secrets Manager vs SOPS1Password vs SOPS
One product takes 61% of first choices here, so the chart would put eleven markers in one corner and one at the far edge. The two measurements it plots are columns in the standing above: share, and the negative label rate. Three products carry a negative rate above 25% in this category.
What they warned about
Ten of fourteen models held their first choice under the paraphrase. Qwen 3.7 Flash, Kimi K2, MiniMax M2.5 and GPT-6 Luna changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
AWS Secrets Manager31%
19 of 61 labels negative · 12 of 14 models · 3 hard negative
“"**Avoid AWS Secrets Manager** for your use case — the per-secret pricing ($0.40/month) becomes prohibitively expensive"” Muse Glimmer 30B, paraphrase prompt
HashiCorp Vault18%
15 of 82 labels negative · 10 of 14 models · 3 hard negative
“HashiCorp's HCP Vault Secrets page states it will be retired on **2026-06-30**, so enterprises should avoid adopting it for new long-term deployments now.” GPT-5.4 mini, negative prompt
Azure Key Vault21%
11 of 53 labels negative · 9 of 14 models · 2 hard negative
“**Avoid:** Native-only tools like **AWS Secrets Manager** or **Azure Key Vault** as your central authority.” Qwen 3.7 Flash, negative prompt
Google Secret Manager25%
10 of 40 labels negative · 9 of 14 models
“While AWS Secrets Manager, Azure Key Vault, or Google Cloud Secret Manager may work well for single-cloud deployments, they become problematic in multi-cloud and hybrid environments.” MiniMax M2.5, negative prompt
What they cite
Citations exist only for the models that return a source list: fourteen of the fourteen in this edition, and all six flagship models on the expanded tier.
Sites the answers cite
77 of 84 answers in this category came back with a source list, from 14 of 14 models: citations where the model returns them, or the search results it consulted. 1142 links across 239 sites, every framing counted. Ranked by the number of answers carrying the site or page. 14 of the 252 answers across every segment cited this index's own page for the category; the method page measures whether that reading tilts an answer.
vendor site · Guideflow45 answers · 45 citations · 11 models
vendor site · GitGuardian43 answers · 44 citations · 12 models
42 answers · 59 citations · 12 models
vendor site · Cycode33 answers · 38 citations · 11 models
vendor site · Infisical30 answers · 43 citations · 11 models
27 answers · 31 citations · 11 models
vendor site · Akeyless25 answers · 35 citations · 9 models
vendor site · Railway24 answers · 24 citations · 10 models
vendor site · Doppler22 answers · 25 citations · 10 models
vendor site · HashiCorp20 answers · 32 citations · 11 models
vendor site · Pulumi18 answers · 18 citations · 11 models
vendor site · CyberPress17 answers · 26 citations · 8 models
Pages the answers cite
The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.
44 answers · 10 models
43 answers · 12 models
25 answers · 11 models
25 answers · 9 models
24 answers · 9 models
24 answers · 10 models
22 answers · 11 models
18 answers · 11 models
17 answers · 8 models
16 answers · 9 models
Search against answers
Each company's standing in the answers beside its site's footprint in Google search, one row a site: the products the models named on it with their shares, and the share they add up to; monthly searches on Google, and DataForSEO's estimate of AI search demand (modeled from search signals, directional, not a count of queries to any assistant), for the most-searched of the company's and its products' names (the name is in each row's hover text); estimated monthly organic visits to the site; and its best position in Google's top ten for “best secrets management tool”, “secrets management tool”, “secrets management tools”. US estimates from DataForSEO and Google's Ads Transparency Center. A small company's site, or a mid-sized company's site for its flagship, is marked company; a product on a large parent's site (Google, Microsoft) has no site figures. A column with no figures for this category is left out, and an empty cell means none were seen, not none exist. Two measurements side by side: neither is read as the cause of the other.
| Company and products | Share | Own site cited | Name searches, Google | AI search demand, est. | Organic visits | Paid search a month, est. | Google ads, last 30 days | Best Google position |
|---|---|---|---|---|---|---|---|---|
| HashiCorp Vault hashicorp.com | 61% | 357 | 5,400 | 317 | 173,934 | $26 | 29 | 7 |
| CyberArk cyberark.com CyberArk Secrets Manager 4%, CyberArk Conjur 2%, CyberArk Identity Security Platform 2% | 8% | 100 | 22,200 | 1,253 | 147,793 company | $62 | 0 | |
| Infisical infisical.com | 6% | 159 | 4,400 | 40 | 4,742 | 14 | 3 | |
| Akeyless akeyless.io | 4% | 155 | 1,000 | 16 | 3,357 | $916 | 24 | 2 |
| AWS parent site AWS Secrets Manager 4% | 4% | 191 | 368,000 | 114,001 | ||||
| Doppler doppler.com | 4% | 163 | 90,500 | 11,875 | 2,255 | 12 | ||
| OpenBao openbao.org | 4% | 41 | 1,600 | 13 | 1,491 | |||
| Azure parent site Azure Key Vault 2% | 2% | 136 | 301,000 | 47,904 | ||||
| Google Secret Manager cloud.google.com | 2% | 102 | 1,000 | 46 | 7,405,347 | |||
| 1Password 1password.com 1Password Business or Enterprise 2%, 1Password 0% | 2% | 281 | 201,000 | 3,085 | 927,263 | 120 |
Google's top ten for the three searches hold 20 sites; 6 of them are among the sites the models cited here (akeyless.io, blog.gitguardian.com, cycode.com, hashicorp.com, infisical.com, pulumi.com). The first result for “best secrets management tool” is tigergate.dev.
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.ShowHide
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ShowHideModelDirect“What is the best secrets management tool for an enterprise B2B company?”Paraphrase“Which secrets vault for applications and infrastructure would you recommend to a large B2B company with thousands of employees?”Comparative“What are the top enterprise-grade secrets management tools and how do they differ?”Budget-constrained“What is the best secrets management tool for a large company that needs predictable total cost across thousands of users?”Scale-constrained“We are a 5,000 person company with SSO, SOC 2 and procurement review requirements evaluating a secrets management tool. What should we look at?”Negative“Which secrets management tools should a large enterprise avoid or be cautious about?”
Claude Haiku 4.5HashiCorp VaultHashiCorp VaultHeldHashiCorp VaultDoppler, Infisicalagainst: AWS Secrets Managerno first choiceagainst: AWS Secrets Manager, Azure Key Vault, Confidant, CyberArk Conjur, Google Secret Manager, HashiCorp Vault, Keywhiz, Knox, Kubernetes Secrets
Three alternatives
AWS Secrets Manager, Akeyless, CyberArk ConjurOne alternative
CyberArk ConjurSix alternatives
AWS Secrets Manager, Akeyless, Azure Key Vault, CyberArk Conjur, Doppler, Google Secret ManagerOne alternative
Bitwarden Secrets ManagerGPT-5.4 miniHashiCorp Vaultagainst: CyberArk Secrets ManagerHashiCorp VaultHeldHashiCorp Vaultagainst: DopplerCyberArk Secrets Manageragainst: AWS Secrets Manager, Google Secret Manager, HashiCorp Vaultno first choiceagainst: HashiCorp Vault
One alternative
AWS Secrets ManagerThree alternatives
AWS Secrets Manager, Azure Key Vault, Google Secret ManagerFive alternatives
AWS Secrets Manager, Akeyless, Azure Key Vault, CyberArk Conjur, Google Secret ManagerOne alternative
AkeylessGemini 3.5 FlashHashiCorp VaultHashiCorp VaultHeldHashiCorp VaultInfisicalagainst: Bitwarden Secrets Manager, Doppler, Keeperno first choiceagainst: AWS Secrets Manager, Azure Key Vault, Doppler, Google Secret Manager, HashiCorp Vault, Infisicalagainst: Ansible Vault, Confidant, Docker Secrets, GitHub Actions Secrets, GitLab CI/CD variables, HashiCorp Vault, Keywhiz, Kubernetes Secrets, SOPS, Sealed Secrets, git-crypt, git-secret, transcrypt
Five alternatives
AWS Secrets Manager, Akeyless, Doppler, Infisical, OpenBaoTwo alternatives
Akeyless, InfisicalEight alternatives
AWS Secrets Manager, Akeyless, Azure Key Vault, CyberArk Conjur, Doppler, Google Secret Manager, Infisical, OpenBaoFive alternatives
AWS Secrets Manager, Akeyless, Azure Key Vault, Google Secret Manager, OpenBaoOne alternative
AkeylessPerplexity SonarHashiCorp VaultHashiCorp VaultHeldagainst: Keeper Secrets ManagerHashiCorp Vaultagainst: Doppler, InfisicalHashiCorp Vault Enterprise or HCP Vault Dedicatedagainst: Dopplerno first choicenothing named
Four alternatives
Akeyless, BeyondTrust Password Safe, Cycode, Keeper Secrets ManagerTwo alternatives
Azure Key Vault, CyberArk Secrets ManagerSix alternatives
AWS Secrets Manager, Akeyless, Azure Key Vault, CyberArk Conjur, CyberArk Secrets Manager, Google Secret ManagerOne alternative
AWS Secrets ManagerGrok 4.1 FastHashiCorp VaultHashiCorp VaultHeldHashiCorp Vault1Password Business or Enterpriseagainst: AWS Secrets Manager, Google Secret Manager, HashiCorp Vaultno first choiceagainst: AWS Secrets Manager, Akeyless, Azure Key Vault, CyberArk Conjur, Doppler, Google Secret Manager, HashiCorp Vault, Infisical, OpenBao
Four alternatives
AWS Secrets Manager, Azure Key Vault, CyberArk Conjur, Google Secret ManagerThree alternatives
AWS Secrets Manager, Azure Key Vault, Google Secret ManagerFive alternatives
AWS Secrets Manager, Azure Key Vault, CyberArk Conjur, Google Secret Manager, Keeper Secrets ManagerTwo alternatives
CyberArk Secrets Manager, DopplerFour alternatives
Akeyless, Azure Key Vault, CyberArk Secrets Manager, HashiCorp VaultMistral SmallHashiCorp VaultHashiCorp VaultHeldHashiCorp VaultHashiCorp Vault, Infisicalagainst: AWS Secrets Manager, Azure Key Vault, Google Secret Managerno first choiceagainst: AWS Secrets Manager, HashiCorp Vault
Two alternatives
Azure Key Vault, GitGuardianSeven alternatives
AWS Secrets Manager, Akeyless, Azure Key Vault, CyberArk Conjur, Doppler, Google Secret Manager, InfisicalDeepSeek V4 FlashHashiCorp Vaultagainst: Keeper Secrets ManagerHashiCorp VaultHeldagainst: AWS Secrets Manager, Azure Key Vault, Doppler, InfisicalHashiCorp VaultHashiCorp Vaultagainst: AWS Secrets Manager, Azure Key VaultHashiCorp Vaultagainst: AWSagainst: AWS Secrets Manager, Azure Key Vault, CyberArk Conjur, Doppler, Google Secret Manager, Kubernetes Native Secrets
Four alternatives
AWS Secrets Manager, Akeyless, Azure Key Vault, DopplerTwo alternatives
Akeyless, CyberArk ConjurFour alternatives
AWS Secrets Manager, Azure Key Vault, CyberArk Conjur, Google Secret ManagerTwo alternatives
Akeyless, DopplerThree alternatives
Akeyless, CyberArk Conjur, DopplerLlama 4 MaverickHashiCorp VaultHashiCorp VaultHeldno first choiceno first choiceno first choiceagainst: AWS Secrets Manager, CyberArk Conjur, Doppler, HashiCorp Vault, Infisical
Qwen 3.7 FlashAkeylessHashiCorp VaultChangedHashiCorp VaultAkeylessagainst: Cloud-Nativeno first choiceagainst: AWS Secrets Manager, Azure Key Vault, CyberArk Conjur, HashiCorp Vault
Four alternatives
AWS Secrets Manager, Azure Key Vault, CyberArk Secrets Manager, HashiCorp VaultFour alternatives
1Password, Akeyless, CyberArk Secrets Manager, DopplerSix alternatives
AWS Secrets Manager, Akeyless, Azure Key Vault, CyberArk Secrets Manager, Delinea Secret Server, Google Secret ManagerOne alternative
HashiCorp VaultKimi K2HashiCorp VaultCyberArk Conjur, CyberArk Identity Security PlatformChangedHashiCorp VaultBitwarden Secrets Manageragainst: AWS, CyberArk Secrets Manager, Delinea Secret Server, HashiCorp Vaultno first choiceagainst: AWS Secrets Manageragainst: 1Password, AWS Secrets Manager, Azure Key Vault, Bitwarden Secrets Manager, CyberArk Conjur, Google Secret Manager, HashiCorp Vault
Two alternatives
Akeyless, CyberArk Privileged Access ManagerTwo alternatives
Delinea Secret Server, HashiCorp VaultFive alternatives
1Password, AWS Secrets Manager, Azure Key Vault, CyberArk Conjur, Delinea Secret ServerTwo alternatives
1Password, InfisicalGLM 4.7 FlashXHashiCorp VaultHashiCorp VaultHeldHashiCorp VaultDopplerno first choiceagainst: CyberArk Conjur, HashiCorp Vault
Seven alternatives
AWS Secrets Manager, Akeyless Identity Security Platform, Azure Key Vault, CyberArk Conjur, Delinea Secret Server, Doppler, PassworkThree alternatives
AWS Secrets Manager, Azure Key Vault, CyberArk Secrets ManagerEight alternatives
1Password, AWS Secrets Manager, Akeyless, Azure Key Vault, CyberArk Conjur, Delinea Secret Server, Doppler, InfisicalFive alternatives
AWS Secrets Manager, Akeyless, CyberArk Secrets Manager, EnvManager, HashiCorp VaultMiniMax M2.5CyberArk Secrets Manager, HashiCorp VaultHashiCorp VaultChangedagainst: Bitwarden Secrets Manager, CyberArk Enterprise Password Vault, Delinea Secret Server, Keeper SecurityHashiCorp VaultHashiCorp Vault, OpenBaoagainst: Bitwarden Secrets Manager, Doppler, Infisicalno first choiceagainst: AWS Secrets Manager, Azure Key Vault, Google Secret Manager
Four alternatives
AWS Secrets Manager, Azure Key Vault, Delinea Secret Server, Google Secret ManagerThree alternatives
AWS Secrets Manager, Azure Key Vault, Google Secret ManagerThree alternatives
AWS Secrets Manager, Azure Key Vault, CyberArk ConjurThree alternatives
Akeyless, CyberArk Conjur, Keeper Secrets ManagerGPT-6 LunaAWS Secrets Manageragainst: HashiCorp VaultHashiCorp VaultChangedno first choiceOpenBaoagainst: AWS Secrets Manager, Google Secret Manager, InfisicalAWS Secrets Manager, Azure Key Vault, Google Secret Manageragainst: GitHub Actions Secrets, HashiCorp Vault, Kubernetes Secrets, Sealed Secrets
Three alternatives
Akeyless, Azure Key Vault, HashiCorp VaultOne alternative
AWS Secrets ManagerSeven alternatives
AWS Secrets Manager, Akeyless, Azure Key Vault, CyberArk Secrets Manager, Delinea Secret Server, Google Secret Manager, HashiCorp VaultOne alternative
HashiCorp VaultMuse Glimmer 30BHashiCorp VaultHashiCorp VaultHeldagainst: AWS Secrets ManagerHashiCorp VaultHashiCorp Vaultagainst: Doppler, InfisicalHashiCorp Vaultagainst: AWS Secrets Manager, Azure Key Vault, Doppler
Five alternatives
AWS Secrets Manager, Akeyless, Azure Key Vault, CyberArk Conjur, Google Secret ManagerThree alternatives
Akeyless, CyberArk Conjur, External Secrets OperatorFour alternatives
AWS Secrets Manager, Azure Key Vault, CyberArk Conjur, Google Secret ManagerTwo alternatives
AWS Secrets Manager, Azure Key VaultFive alternatives
AWS Secrets Manager, Akeyless, CyberArk Conjur, Doppler, InfisicalBold is the first choiceAlternatives are counted; the count opens them.What the answer argued against
The record
One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency. Full answer text is in the free responses file. Download the record
Eighty-four rows: every prompt, every model, every answer.
| Prompt | Model | Version string | Time (UTC) | Searched | Sources | Latency |
|---|---|---|---|---|---|---|
| Direct recommendation | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 08:30 | yes | 18 | 9 s |
| Direct recommendation | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 11:46 | yes | 3 | 4 s |
| Direct recommendation | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 08:09 | yes | 11 | 25 s |
| Direct recommendation | Perplexity Sonar | sonar | 2026-10-01 09:57 | yes | 33 | 4 s |
| Direct recommendation | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 13:02 | yes | 23 | 15 s |
| Direct recommendation | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 11:37 | yes | 5 | 2 s |
| Direct recommendation | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 10:34 | yes | 19 | 27 s |
| Direct recommendation | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 12:29 | yes | 5 | 1 s |
| Direct recommendation | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 13:24 | yes | 5 | 28 s |
| Direct recommendation | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 09:29 | yes | 15 | 19 s |
| Direct recommendation | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 08:10 | yes | 22 | 35 s |
| Direct recommendation | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 09:40 | no | 0 | 10 s |
| Direct recommendation | GPT-6 Luna | gpt-6-luna | 2026-10-01 09:23 | yes | 4 | 15 s |
| Direct recommendation | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 12:30 | yes | 11 | 18 s |
| Paraphrase | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 09:10 | yes | 9 | 7 s |
| Paraphrase | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 10:22 | yes | 4 | 5 s |
| Paraphrase | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 12:41 | yes | 13 | 23 s |
| Paraphrase | Perplexity Sonar | sonar | 2026-10-01 13:39 | yes | 25 | 6 s |
| Paraphrase | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 13:35 | yes | 25 | 8 s |
| Paraphrase | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 13:28 | yes | 5 | 4 s |
| Paraphrase | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 11:18 | yes | 20 | 27 s |
| Paraphrase | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 13:39 | yes | 5 | 3 s |
| Paraphrase | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 08:40 | no | 0 | 32 s |
| Paraphrase | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 13:32 | yes | 23 | 28 s |
| Paraphrase | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 09:07 | yes | 15 | 56 s |
| Paraphrase | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 10:11 | no | 0 | 54 s |
| Paraphrase | GPT-6 Luna | gpt-6-luna | 2026-10-01 12:15 | yes | 4 | 15 s |
| Paraphrase | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 11:37 | yes | 12 | 22 s |
| Comparative | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 08:30 | yes | 9 | 9 s |
| Comparative | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 08:04 | yes | 5 | 13 s |
| Comparative | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 13:43 | yes | 18 | 29 s |
| Comparative | Perplexity Sonar | sonar | 2026-10-01 12:13 | yes | 21 | 6 s |
| Comparative | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 09:08 | yes | 21 | 9 s |
| Comparative | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 07:52 | yes | 9 | 10 s |
| Comparative | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 08:28 | yes | 23 | 49 s |
| Comparative | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 10:21 | yes | 5 | 1 s |
| Comparative | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 11:41 | yes | 19 | 39 s |
| Comparative | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 09:33 | yes | 15 | 23 s |
| Comparative | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 10:51 | yes | 24 | 34 s |
| Comparative | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 08:07 | yes | 16 | 32 s |
| Comparative | GPT-6 Luna | gpt-6-luna | 2026-10-01 11:01 | yes | 7 | 21 s |
| Comparative | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 08:28 | yes | 15 | 30 s |
| Budget constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 11:31 | yes | 17 | 9 s |
| Budget constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 13:12 | yes | 4 | 5 s |
| Budget constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 13:05 | yes | 17 | 29 s |
| Budget constrained | Perplexity Sonar | sonar | 2026-10-01 09:34 | yes | 21 | 4 s |
| Budget constrained | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 10:38 | yes | 22 | 9 s |
| Budget constrained | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 11:45 | yes | 5 | 4 s |
| Budget constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 09:13 | yes | 23 | 31 s |
| Budget constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 10:59 | yes | 5 | 1 s |
| Budget constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 12:27 | no | 0 | 27 s |
| Budget constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 12:35 | yes | 24 | 28 s |
| Budget constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 09:45 | yes | 22 | 370 s |
| Budget constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 09:23 | yes | 21 | 51 s |
| Budget constrained | GPT-6 Luna | gpt-6-luna | 2026-10-01 12:51 | yes | 3 | 18 s |
| Budget constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 10:33 | yes | 22 | 42 s |
| Scale constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 12:03 | yes | 19 | 13 s |
| Scale constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 12:40 | yes | 0 | 7 s |
| Scale constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 13:26 | yes | 8 | 25 s |
| Scale constrained | Perplexity Sonar | sonar | 2026-10-01 12:40 | yes | 26 | 6 s |
| Scale constrained | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 12:06 | yes | 14 | 10 s |
| Scale constrained | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 10:47 | no | 0 | 8 s |
| Scale constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 11:40 | yes | 24 | 48 s |
| Scale constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 11:14 | yes | 5 | 2 s |
| Scale constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 09:51 | no | 0 | 33 s |
| Scale constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 11:11 | yes | 15 | 29 s |
| Scale constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 12:01 | yes | 22 | 91 s |
| Scale constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 13:47 | yes | 5 | 20 s |
| Scale constrained | GPT-6 Luna | gpt-6-luna | 2026-10-01 10:59 | yes | 5 | 28 s |
| Scale constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 13:23 | yes | 14 | 27 s |
| Negative framing | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 13:28 | yes | 17 | 11 s |
| Negative framing | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 12:02 | yes | 5 | 10 s |
| Negative framing | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 10:11 | yes | 35 | 27 s |
| Negative framing | Perplexity Sonar | sonar | 2026-10-01 09:58 | yes | 21 | 5 s |
| Negative framing | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 12:17 | yes | 22 | 7 s |
| Negative framing | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 08:27 | yes | 5 | 5 s |
| Negative framing | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 09:03 | yes | 25 | 37 s |
| Negative framing | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 07:37 | yes | 5 | 2 s |
| Negative framing | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 13:35 | yes | 15 | 70 s |
| Negative framing | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 09:13 | yes | 22 | 31 s |
| Negative framing | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 12:49 | yes | 21 | 90 s |
| Negative framing | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 09:03 | yes | 17 | 81 s |
| Negative framing | GPT-6 Luna | gpt-6-luna | 2026-10-01 08:13 | yes | 4 | 28 s |
| Negative framing | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 11:04 | yes | 24 | 32 s |
Normalization in this category
Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.
ShowHide
Category-scoped readings
Bitwarden read as Bitwarden Secrets Manager
Bitwarden Enterprise read as Bitwarden Secrets Manager
CyberArk read as CyberArk Secrets Manager
CyberArk (Conjur) read as CyberArk Secrets Manager
Cyberark read as CyberArk Secrets Manager
Delinea read as Delinea Secret Server
Delinea (formerly Thycotic) read as Delinea Secret Server
Unresolved, counted raw
1Password Business or Enterprise
CyberArk Enterprise Password Vault
Docker Secrets
HashiCorp Vault Enterprise or HCP Vault Dedicated
Key Vault
Kubernetes Native Secrets
SatisVault
Secrets Manager
Vault-style or enterprise PAM-converged solutions
transcrypt
Discontinued, still offered
No shut-down product was recommended here.