Penetration testing as a service for enterprise buyers
Asked as “penetration testing service”, and as “pentest-as-a-service provider”, on behalf of an enterprise B2B company. 48 first choices recorded across the direct, paraphrase, budget and scale prompts, fourteen models each.
Standing · first-choice share
46%
Clear leader
46NetSPI23Synack12Cobalt19others
46% of first choices, clear leader.
Since September 2026▲+8Since September 2026: 40% → 48%, +8 points. Inside the 11-point floor: within noise. Read over the models both editions asked.NetSPI held the lead, +8 points on 40%, inside the 11-point floor.
By buyer segment
The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.
Small business
Cobalt17%Contested↗new leaderNew leader since September 2026: Bright Defense (18%) replaces BreachLock (28% then, 12% now), 5 points clear, inside the 11-point floor.Standing →Mid-marketCobalt45%Clear leader▼−1Since September 2026: 44% → 44%, −1 point. Inside the 11-point floor: within noise. Read over the models both editions asked.Standing →Enterprise
NetSPI46%Clear leader▲+8Since September 2026: 40% → 48%, +8 points. Inside the 11-point floor: within noise. Read over the models both editions asked.This page
Cobalt17%Contested↗new leaderNew leader since September 2026: Bright Defense (18%) replaces BreachLock (28% then, 12% now), 5 points clear, inside the 11-point floor.Standing →Mid-marketCobalt45%Clear leader▼−1Since September 2026: 44% → 44%, −1 point. Inside the 11-point floor: within noise. Read over the models both editions asked.Standing →EnterpriseNetSPI46%Clear leader▲+8Since September 2026: 40% → 48%, +8 points. Inside the 11-point floor: within noise. Read over the models both editions asked.This pageThe standing
Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all fourteen models, for an enterprise B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrantSince September 2026
01NetSPI46%2%46endorsed leader▲+8Since September 2026: 40% → 48%, +8 points. Inside the 11-point floor: within noise. Read over the models both editions asked.40% → 48%
NetSPI46%2%46endorsed leader▲+8Since September 2026: 40% → 48%, +8 points. Inside the 11-point floor: within noise. Read over the models both editions asked.40% → 48%02
Synack23%2%47accepted challenger▲+2Since September 2026: 23% → 25%, +2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.23% → 25%
Synack23%2%47accepted challenger▲+2Since September 2026: 23% → 25%, +2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.23% → 25%03Cobalt12%10%42accepted challenger▼−5Since September 2026: 15% → 10%, −5 points. Inside the 11-point floor: within noise. Read over the models both editions asked.15% → 10%
Cobalt12%10%42accepted challenger▼−5Since September 2026: 15% → 10%, −5 points. Inside the 11-point floor: within noise. Read over the models both editions asked.15% → 10%04
BreachLock6%4%25accepted challenger▲+3Since September 2026: 4% → 8%, +3 points. Inside the 11-point floor: within noise. Read over the models both editions asked.4% → 8%
BreachLock6%4%25accepted challenger▲+3Since September 2026: 4% → 8%, +3 points. Inside the 11-point floor: within noise. Read over the models both editions asked.4% → 8%05
Bishop Fox4%0%22accepted challenger▼−2Since September 2026: 4% → 2%, −2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.4% → 2%
Bishop Fox4%0%22accepted challenger▼−2Since September 2026: 4% → 2%, −2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.4% → 2%06
Mandiant Lab in the set2%7%15accepted challenger▲+2Since September 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 2%
Mandiant Lab in the set2%7%15accepted challenger▲+2Since September 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 2%07
Bugcrowd2%20%10accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%
Bugcrowd2%20%10accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%Show the four products at 0%, ordered by negative rate
10
HackerOne0%12%17accepted challenger▼−4Since September 2026: 4% → 0%, −4 points. Inside the 11-point floor: within noise. Read over the models both editions asked.4% → 0%
HackerOne0%12%17accepted challenger▼−4Since September 2026: 4% → 0%, −4 points. Inside the 11-point floor: within noise. Read over the models both editions asked.4% → 0%08
NCC Group0%0%18accepted challenger▼−2Since September 2026: 2% → 0%, −2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.2% → 0%
NCC Group0%0%18accepted challenger▼−2Since September 2026: 2% → 0%, −2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.2% → 0%09
Rapid70%0%15accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%
Rapid70%0%15accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%11
Astra Security0%0%11accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%
Astra Security0%0%11accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%The floor is 11 points of share, measured: how far the models move a leader on their own when the same questions are asked twice with nothing changed. A larger change is movement; a smaller one is noise, and both are shown. Movement is read over the twelve models both editions asked; GPT-6 Luna, Muse Glimmer 30B joined this edition and are in the standing but not yet in the comparison. How the floor is measured
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its product page.
Mandiant is made by Google, whose model Gemini 3.5 Flash is in the set. On the four share prompts that model made it the first choice zero times of 4; the other thirteen models one time of 52. Lab treatment is defined on the method page; the row is marked, not excluded.
All twenty-one head-to-head pages: the top seven products, each against each
Cobalt vs UnderDefenseCobalt vs HackerOneCobalt vs BugcrowdBreachLock vs SynackBreachLock vs Astra SecurityBreachLock vs UnderDefenseBreachLock vs HackerOneBreachLock vs BugcrowdSynack vs Astra SecuritySynack vs UnderDefenseSynack vs HackerOneSynack vs BugcrowdAstra Security vs UnderDefenseAstra Security vs HackerOneAstra Security vs BugcrowdUnderDefense vs HackerOneUnderDefense vs BugcrowdHackerOne vs Bugcrowd
Recommended versus criticized
Every product with at least 10 labels here, on both axes. The 30% line names a quadrant, not the verdict above: that one needs more than 40%.
Criticized challengerCriticized default
Negative label rate →
0102030405060708091011Accepted challengerEndorsed leader
0%First-choice share → · lines at 30% share and 25% negative60%
Key
01NetSPI46%
NetSPI46%02Synack23%
Synack23%03Cobalt12%
Cobalt12%04BreachLock6%
BreachLock6%05Bishop Fox4%
Bishop Fox4%06Mandiant2%
Mandiant2%07Bugcrowd2%
Bugcrowd2%08NCC Group0%
NCC Group0%09Rapid70%
Rapid70%10HackerOne0%
HackerOne0%11Astra Security0%
Astra Security0%What they warned about
Three of fourteen models held their first choice under the paraphrase. Claude Haiku 4.5, GPT-5.4 mini, Gemini 3.5 Flash, Perplexity Sonar, Mistral Small, Llama 4 Maverick, Qwen 3.7 Flash, Kimi K2, GLM 4.7 FlashX, MiniMax M2.5 and GPT-6 Luna changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
Cobalt10%
4 of 42 labels negative · 3 of 14 models
“uses a credit-based model that requires active management to avoid credit expiration — less predictable” DeepSeek V4 Flash, budget prompt
Bugcrowd20%
2 of 10 labels negative · 2 of 14 models
“Crowdsourced ... platforms (e.g., HackerOne, Bugcrowd, Synack, etc.) can be powerful for certain use cases, but they are not universally suitable for large enterprises.” GLM 4.7 FlashX, negative prompt
HackerOne12%
2 of 17 labels negative · 2 of 14 models
“Crowdsourced Penetration Testing as a Service (PTaaS) platforms (e.g., HackerOne, Bugcrowd, Synack, etc.) can be powerful for certain use cases, but they are not universally suitable for large enterprises.” GLM 4.7 FlashX, negative prompt
BreachLock4%
1 of 25 labels negative · 1 of 14 models
“more geared toward SMB/mid-market and lacks the enterprise scale and compliance depth of Synack” DeepSeek V4 Flash, budget prompt
What they cite
Citations exist only for the models that return a source list: fourteen of the fourteen in this edition, and all six flagship models on the expanded tier.
Sites the answers cite
75 of 84 answers in this category came back with a source list, from 14 of 14 models: citations where the model returns them, or the search results it consulted. 1023 links across 237 sites, every framing counted. Ranked by the number of answers carrying the site or page. 8 of the 252 answers across every segment cited this index's own page for the category; the method page measures whether that reading tilts an answer.
vendor site · DeepStrike50 answers · 105 citations · 11 models
vendor site · Synack50 answers · 74 citations · 13 models
vendor site · UnderDefense41 answers · 44 citations · 11 models
vendor site · Stingrai37 answers · 75 citations · 12 models
37 answers · 52 citations · 10 models
29 answers · 30 citations · 9 models
vendor site · Software Secured28 answers · 35 citations · 9 models
vendor site · Beagle Security20 answers · 20 citations · 10 models
vendor site · Bright Defense17 answers · 18 citations · 9 models
vendor site · NetSPI11 answers · 18 citations · 8 models
11 answers · 13 citations · 6 models
11 answers · 11 citations · 7 models
Pages the answers cite
The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.
39 answers · 11 models
33 answers · 11 models
29 answers · 9 models
22 answers · 9 models
21 answers · 10 models
21 answers · 9 models
19 answers · 9 models
19 answers · 8 models
15 answers · 9 models
15 answers · 10 models
Search against answers
Each company's standing in the answers beside its site's footprint in Google search, one row a site: the products the models named on it with their shares, and the share they add up to; monthly searches on Google, and DataForSEO's estimate of AI search demand (modeled from search signals, directional, not a count of queries to any assistant), for the most-searched of the company's and its products' names (the name is in each row's hover text); estimated monthly organic visits to the site; and its best position in Google's top ten for “best penetration testing service”, “penetration testing service”, “penetration testing services”. US estimates from DataForSEO and Google's Ads Transparency Center. A small company's site, or a mid-sized company's site for its flagship, is marked company; a product on a large parent's site (Google, Microsoft) has no site figures. A column with no figures for this category is left out, and an empty cell means none were seen, not none exist. Two measurements side by side: neither is read as the cause of the other.
| Company and products | Share | Own site cited | Name searches, Google | AI search demand, est. | Organic visits | Paid search a month, est. | Google ads, last 30 days | Best Google position |
|---|---|---|---|---|---|---|---|---|
| NetSPI netspi.com | 46% | 81 | 1,900 | 58 | 4,142 | $336 | 43 | |
| Synack synack.com | 23% | 104 | 2,400 | 59 | 6,764 | 7 | 4 | |
| Cobalt cobalt.io | 12% | 114 | 135,000 | 27,732 | 23,655 | 14 | ||
| BreachLock breachlock.com | 6% | 92 | 590 | 6 | 2,479 | 22 | ||
| Bishop Fox bishopfox.com | 4% | 36 | 1,600 | 18 | 23,962 | 1 | ||
| Bugcrowd bugcrowd.com Bugcrowd 2%, Bugcrowd's PTaaS Subscription 2% | 4% | 32 | 3,600 | 77 | 38,523 | 0 | ||
| Mandiant cloud.google.com | 2% | 24 | 6,600 | 253 | 7,405,347 | |||
| DeepStrike deepstrike.io | 2% | 15 | 590 | 52 | 13,529 | 0 | ||
| NCC Group nccgroup.com | 0% | 20 | 1,300 | 79 | 3,182 | 10 | ||
| Rapid7 rapid7.com | 0% | 77 | 14,800 | 798 | 123,299 | $609 | 30 | 3 |
Google's top ten for the three searches hold 22 sites; 2 of them are among the sites the models cited here (getastra.com, synack.com). The first result for “best penetration testing service” is reddit.com.
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.ShowHide
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ShowHideModelDirect“What is the best penetration testing service for an enterprise B2B company?”Paraphrase“Which pentest-as-a-service provider would you recommend to a large B2B company with thousands of employees?”Comparative“What are the top enterprise-grade penetration testing services and how do they differ?”Budget-constrained“What is the best penetration testing service for a large company that needs predictable total cost across thousands of users?”Scale-constrained“We are a 5,000 person company with SSO, SOC 2 and procurement review requirements evaluating a penetration testing service. What should we look at?”Negative“Which penetration testing services should a large enterprise avoid or be cautious about?”
Claude Haiku 4.5no first choiceNetSPIChangedNetSPI, Synackno first choiceno first choicenothing named
Four alternatives
Bishop Fox, Rapid7, Synack, TrustwaveSeven alternatives
Bishop Fox, Coalfire, Cobalt, Mandiant, NCC Group, Rapid7, SpecterOpsGPT-5.4 miniNetSPI, SynackCobaltChangedno first choiceBugcrowd's PTaaS Subscriptionno first choicenothing named
Two alternatives
Cobalt, NCC GroupTwo alternatives
NetSPI, SynackOne alternative
HackerOne's pentest offeringGemini 3.5 FlashBishop Fox, NetSPISynackChangedBishop Fox, NetSPI, SynackCobaltno first choicenothing named
Three alternatives
BreachLock, Cobalt, SynackThree alternatives
Bishop Fox, Cobalt, NetSPIFive alternatives
Cobalt, HackerOne, Horizon3.ai NodeZero, Mandiant, PenteraFive alternatives
BreachLock, Hoxhunt, KnowBe4, Pentera, SynackPerplexity SonarNetSPI, SynackNetSPIChangedNetSPIagainst: MandiantNetSPIno first choicenothing named
Four alternatives
A-LIGN, BreachLock, GuidePoint Security, KrollSix alternatives
Bishop Fox, BreachLock, Kroll, Mandiant, NCC Group, SynackFour alternatives
A-LIGN, Astra Security, BreachLock, SynackTwo alternatives
Kroll, NCC GroupGrok 4.1 FastNetSPINetSPIHeldagainst: CobaltNetSPINetSPIagainst: Bugcrowd, Cobalt, HackerOneno first choicenothing named
Four alternatives
BreachLock, Cobalt, Synack, TrustedSecThree alternatives
Bishop Fox, CrowdStrike, SynackFour alternatives
BreachLock, Cobalt, Rapid7, SynackThree alternatives
Astra Security, BreachLock, SynackMistral SmallBreachLock, NetSPINetSPIChangedNetSPINetSPI, Synackno first choicenothing named
One alternative
Redbot SecurityTwo alternatives
Invicti, PenteraSeven alternatives
Cobalt, DeepStrike, HackerOne, LRQA Nettitude, NCC Group, PwC Cyber Security, SynackTwo alternatives
BreachLock, CobaltDeepSeek V4 FlashNetSPINetSPIHeldNetSPI, SynackSynackagainst: BreachLock, Cobaltno first choicenothing named
Five alternatives
Bishop Fox, Cobalt, NCC Group, Rapid7, SynackTwo alternatives
Bishop Fox, SynackFive alternatives
Bishop Fox, BreachLock, Cobalt, HackerOne, MandiantOne alternative
NetSPILlama 4 Maverickno first choiceBreachLockChangedno first choiceno first choiceno first choicenothing named
Three alternatives
Bugcrowd, Intigriti, NetSPIQwen 3.7 FlashMandiantagainst: Deloitte, EY, KPMG, PwCCobaltChangedNetragard, Rhino Security LabsCobaltno first choiceagainst: Burp Suite, Deloitte, EY, KPMG, PwC, Qualys, Tenable Nessus
Five alternatives
Coalfire, Cobalt, NCC Group, Secureworks, SynackTwo alternatives
HackerOne, TenableTwo alternatives
Cobalt, NetSPIThree alternatives
Bugcrowd, HackerOne, QualysKimi K2NetSPI, SynackNetSPIChangedNetSPISynackno first choicenothing named
Two alternatives
Bishop Fox, CobaltTwo alternatives
Bishop Fox, SynackSix alternatives
Bishop Fox, Coalfire, Mandiant, NCC Group, Rapid7, SynackTwo alternatives
Cobalt, NetSPIGLM 4.7 FlashXNetSPISynackChangedNetSPIDeepStrike, Synackno first choiceagainst: Bugcrowd, HackerOne, Synack
Five alternatives
Bishop Fox, Cobalt, NCC Group, Rapid7, SynackEight alternatives
BreachLock, Cobalt, DeepStrike, Invicti, KPMG, Kroll, NCC Group, NetSPIFourteen alternatives
A-LIGN, Astra Security, Bishop Fox, BreachLock, Coalfire, Cobalt, HackerOne, Invicti Security, NCC Group, Rapid7, Secureworks, SpecterOps, Synack, UnderDefenseThree alternatives
Astra Security, Cobalt, IntruderMiniMax M2.5BreachLockNetSPI, SynackChangedNetSPINetSPIagainst: Cobaltno first choicenothing named
Three alternatives
Bulletproof, Qualys, Redbot SecurityThree alternatives
Cobalt, DeepStrike, HackerOneFive alternatives
Deloitte, KPMG Cyber Security, NCC Group, PwC Cyber Security, SynackTwo alternatives
DeepStrike, SynackGPT-6 LunaBishop Fox, CobaltCobaltChangedno first choiceBugcrowdagainst: ThreatSpikeno first choicenothing named
One alternative
NetSPIOne alternative
SynackSeven alternatives
Bishop Fox, Coalfire, Cobalt, Mandiant, NCC Group, NetSPI, SynackOne alternative
CobaltMuse Glimmer 30BNetSPINetSPIHeldNetSPINetSPI, Synackno first choiceagainst: NetSPI
Six alternatives
Bugcrowd, Coalfire, Cobalt, HackerOne, NCC Group, SynackFour alternatives
Bishop Fox, NCC Group, Rapid7, SynackSix alternatives
Bishop Fox, Cobalt, HackerOne, Mandiant, Rapid7, SynackTwo alternatives
BreachLock, CobaltBold is the first choiceAlternatives are counted; the count opens them.What the answer argued against
The record
One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency. Full answer text is in the free responses file. Download the record
Eighty-four rows: every prompt, every model, every answer.
| Prompt | Model | Version string | Time (UTC) | Searched | Sources | Latency |
|---|---|---|---|---|---|---|
| Direct recommendation | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 13:42 | no | 0 | 5 s |
| Direct recommendation | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 08:45 | yes | 3 | 4 s |
| Direct recommendation | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 10:32 | yes | 9 | 18 s |
| Direct recommendation | Perplexity Sonar | sonar | 2026-10-01 12:43 | yes | 20 | 3 s |
| Direct recommendation | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 10:10 | yes | 23 | 6 s |
| Direct recommendation | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 09:07 | yes | 8 | 6 s |
| Direct recommendation | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 10:06 | yes | 19 | 28 s |
| Direct recommendation | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 07:53 | yes | 5 | 1 s |
| Direct recommendation | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 10:14 | no | 0 | 27 s |
| Direct recommendation | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 09:06 | yes | 18 | 26 s |
| Direct recommendation | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 11:38 | yes | 22 | 83 s |
| Direct recommendation | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 11:04 | yes | 5 | 21 s |
| Direct recommendation | GPT-6 Luna | gpt-6-luna | 2026-10-01 10:32 | yes | 4 | 25 s |
| Direct recommendation | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 09:52 | yes | 14 | 25 s |
| Paraphrase | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 10:06 | yes | 15 | 9 s |
| Paraphrase | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 09:37 | yes | 3 | 5 s |
| Paraphrase | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 13:11 | yes | 10 | 21 s |
| Paraphrase | Perplexity Sonar | sonar | 2026-10-01 12:25 | yes | 20 | 4 s |
| Paraphrase | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 12:49 | yes | 23 | 8 s |
| Paraphrase | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 07:50 | yes | 18 | 6 s |
| Paraphrase | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 08:14 | yes | 25 | 31 s |
| Paraphrase | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 09:25 | yes | 5 | 1 s |
| Paraphrase | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 09:55 | no | 0 | 33 s |
| Paraphrase | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 09:29 | yes | 17 | 15 s |
| Paraphrase | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 08:08 | yes | 14 | 32 s |
| Paraphrase | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 13:50 | yes | 15 | 30 s |
| Paraphrase | GPT-6 Luna | gpt-6-luna | 2026-10-01 13:48 | yes | 2 | 18 s |
| Paraphrase | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 11:43 | yes | 15 | 19 s |
| Comparative | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 12:10 | yes | 14 | 10 s |
| Comparative | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 09:01 | yes | 7 | 8 s |
| Comparative | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 07:56 | yes | 18 | 35 s |
| Comparative | Perplexity Sonar | sonar | 2026-10-01 12:02 | yes | 20 | 6 s |
| Comparative | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 08:58 | yes | 20 | 8 s |
| Comparative | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 12:15 | yes | 9 | 9 s |
| Comparative | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 09:56 | yes | 20 | 50 s |
| Comparative | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 12:50 | yes | 5 | 2 s |
| Comparative | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 09:53 | yes | 10 | 38 s |
| Comparative | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 12:02 | yes | 17 | 30 s |
| Comparative | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 10:05 | yes | 23 | 157 s |
| Comparative | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 12:07 | yes | 14 | 33 s |
| Comparative | GPT-6 Luna | gpt-6-luna | 2026-10-01 11:10 | yes | 7 | 32 s |
| Comparative | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 09:18 | yes | 19 | 53 s |
| Budget constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 13:09 | yes | 10 | 8 s |
| Budget constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 11:53 | yes | 3 | 5 s |
| Budget constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 12:54 | yes | 19 | 25 s |
| Budget constrained | Perplexity Sonar | sonar | 2026-10-01 12:23 | yes | 20 | 4 s |
| Budget constrained | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 11:12 | yes | 24 | 11 s |
| Budget constrained | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 07:26 | yes | 5 | 5 s |
| Budget constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 12:17 | yes | 21 | 24 s |
| Budget constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 12:12 | yes | 5 | 2 s |
| Budget constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 13:10 | no | 0 | 31 s |
| Budget constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 10:56 | yes | 20 | 27 s |
| Budget constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 10:34 | yes | 20 | 146 s |
| Budget constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 08:48 | yes | 24 | 48 s |
| Budget constrained | GPT-6 Luna | gpt-6-luna | 2026-10-01 11:59 | yes | 3 | 17 s |
| Budget constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 08:33 | yes | 18 | 36 s |
| Scale constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 11:14 | yes | 18 | 12 s |
| Scale constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 12:19 | yes | 3 | 8 s |
| Scale constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 12:54 | yes | 7 | 29 s |
| Scale constrained | Perplexity Sonar | sonar | 2026-10-01 09:54 | yes | 19 | 6 s |
| Scale constrained | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 12:39 | yes | 13 | 11 s |
| Scale constrained | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 11:39 | no | 0 | 5 s |
| Scale constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 10:19 | yes | 24 | 41 s |
| Scale constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 13:06 | yes | 5 | 3 s |
| Scale constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 13:01 | no | 0 | 34 s |
| Scale constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 10:19 | yes | 24 | 33 s |
| Scale constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 13:42 | yes | 15 | 18 s |
| Scale constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 11:51 | yes | 5 | 18 s |
| Scale constrained | GPT-6 Luna | gpt-6-luna | 2026-10-01 08:00 | yes | 4 | 29 s |
| Scale constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 10:04 | yes | 13 | 36 s |
| Negative framing | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 08:55 | yes | 18 | 13 s |
| Negative framing | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 10:38 | no | 0 | 6 s |
| Negative framing | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 08:28 | yes | 7 | 30 s |
| Negative framing | Perplexity Sonar | sonar | 2026-10-01 12:58 | yes | 20 | 5 s |
| Negative framing | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 08:17 | yes | 16 | 7 s |
| Negative framing | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 07:59 | yes | 5 | 5 s |
| Negative framing | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 10:13 | yes | 19 | 40 s |
| Negative framing | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 07:26 | yes | 5 | 2 s |
| Negative framing | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 12:22 | no | 0 | 39 s |
| Negative framing | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 13:34 | yes | 19 | 21 s |
| Negative framing | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 08:57 | yes | 19 | 99 s |
| Negative framing | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 09:03 | no | 0 | 65 s |
| Negative framing | GPT-6 Luna | gpt-6-luna | 2026-10-01 11:29 | yes | 4 | 12 s |
| Negative framing | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 08:23 | yes | 14 | 35 s |
Normalization in this category
Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.
ShowHide
Category-scoped readings
Astra read as Astra Security
Horizon3.ai (NodeZero) read as Horizon3.ai NodeZero
Unresolved, counted raw
Accenture Cyber
Bugcrowd's PTaaS Subscription
Bulletproof
DeepStrike-style specialist firms
Eleco Technologies
HackerOne's pentest offering
Invicti Security
KPMG Cyber Security
LRQA
LRQA Nettitude
Offensive Security
Positive Technologies
ThreatSpike
Discontinued, still offered
No shut-down product was recommended here.