Penetration testing as a service
Asked as “penetration testing service”, and as “pentest-as-a-service provider”, on behalf of a mid-market B2B company. 47 first choices recorded across the direct, paraphrase, budget and scale prompts, fourteen models each.
Standing · first-choice share
45%
Clear leader
45Cobalt19BreachLock04Astra Security32others
45% of first choices, clear leader.
Since September 2026▼−1Since September 2026: 44% → 44%, −1 point. Inside the 11-point floor: within noise. Read over the models both editions asked.Cobalt held the lead, −1 point on 44%, inside the 11-point floor.
By buyer segment
The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.
Small business
Cobalt17%Contested↗new leaderNew leader since September 2026: Bright Defense (18%) replaces BreachLock (28% then, 12% now), 5 points clear, inside the 11-point floor.Standing →Mid-marketCobalt45%Clear leader▼−1Since September 2026: 44% → 44%, −1 point. Inside the 11-point floor: within noise. Read over the models both editions asked.This pageEnterprise
NetSPI46%Clear leader▲+8Since September 2026: 40% → 48%, +8 points. Inside the 11-point floor: within noise. Read over the models both editions asked.Standing →
Cobalt17%Contested↗new leaderNew leader since September 2026: Bright Defense (18%) replaces BreachLock (28% then, 12% now), 5 points clear, inside the 11-point floor.Standing →Mid-marketCobalt45%Clear leader▼−1Since September 2026: 44% → 44%, −1 point. Inside the 11-point floor: within noise. Read over the models both editions asked.This pageEnterpriseNetSPI46%Clear leader▲+8Since September 2026: 40% → 48%, +8 points. Inside the 11-point floor: within noise. Read over the models both editions asked.Standing →The standing
Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all fourteen models, for a mid-market B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrantSince September 2026
01Cobalt45%2%41endorsed leader▼−1Since September 2026: 44% → 44%, −1 point. Inside the 11-point floor: within noise. Read over the models both editions asked.44% → 44%
Cobalt45%2%41endorsed leader▼−1Since September 2026: 44% → 44%, −1 point. Inside the 11-point floor: within noise. Read over the models both editions asked.44% → 44%02
BreachLock19%0%35accepted challenger▲+11Since September 2026: 9% → 20%, +11 points. Inside the 11-point floor: within noise. Read over the models both editions asked.9% → 20%
BreachLock19%0%35accepted challenger▲+11Since September 2026: 9% → 20%, +11 points. Inside the 11-point floor: within noise. Read over the models both editions asked.9% → 20%03
Synack4%10%29accepted challenger▲+5Since September 2026: 0% → 5%, +5 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 5%
Synack4%10%29accepted challenger▲+5Since September 2026: 0% → 5%, +5 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 5%04
Astra Security4%0%17accepted challenger▼−8Since September 2026: 13% → 5%, −8 points. Inside the 11-point floor: within noise. Read over the models both editions asked.13% → 5%
Astra Security4%0%17accepted challenger▼−8Since September 2026: 13% → 5%, −8 points. Inside the 11-point floor: within noise. Read over the models both editions asked.13% → 5%05
UnderDefense4%0%11accepted challenger▲+3Since September 2026: 2% → 5%, +3 points. Inside the 11-point floor: within noise. Read over the models both editions asked.2% → 5%
UnderDefense4%0%11accepted challenger▲+3Since September 2026: 2% → 5%, +3 points. Inside the 11-point floor: within noise. Read over the models both editions asked.2% → 5%06
HackerOne2%14%14accepted challenger▲+2Since September 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 2%
HackerOne2%14%14accepted challenger▲+2Since September 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 2%07
Bugcrowd2%17%12accepted challenger▲+2Since September 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 2%
Bugcrowd2%17%12accepted challenger▲+2Since September 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 2%Show the three products at 0%, ordered by negative rate
08NetSPI0%9%22accepted challenger▼−2Since September 2026: 2% → 0%, −2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.2% → 0%
NetSPI0%9%22accepted challenger▼−2Since September 2026: 2% → 0%, −2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.2% → 0%10
Rapid70%9%11accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%
Rapid70%9%11accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%09
Bishop Fox0%0%10accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%
Bishop Fox0%0%10accepted challenger=heldSince September 2026: 0% → 0%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.0% → 0%The floor is 11 points of share, measured: how far the models move a leader on their own when the same questions are asked twice with nothing changed. A larger change is movement; a smaller one is noise, and both are shown. Movement is read over the twelve models both editions asked; GPT-6 Luna, Muse Glimmer 30B joined this edition and are in the standing but not yet in the comparison. How the floor is measured
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its product page.
All twenty-one head-to-head pages: the top seven products, each against each
Cobalt vs UnderDefenseCobalt vs HackerOneCobalt vs BugcrowdBreachLock vs SynackBreachLock vs Astra SecurityBreachLock vs UnderDefenseBreachLock vs HackerOneBreachLock vs BugcrowdSynack vs Astra SecuritySynack vs UnderDefenseSynack vs HackerOneSynack vs BugcrowdAstra Security vs UnderDefenseAstra Security vs HackerOneAstra Security vs BugcrowdUnderDefense vs HackerOneUnderDefense vs BugcrowdHackerOne vs Bugcrowd
Recommended versus criticized
Every product with at least 10 labels here, on both axes. The 30% line names a quadrant, not the verdict above: that one needs more than 40%.
Criticized challengerCriticized default
Negative label rate →
01020304050607080910Accepted challengerEndorsed leader
0%First-choice share → · lines at 30% share and 25% negative60%
Key
01Cobalt45%
Cobalt45%02BreachLock19%
BreachLock19%03Synack4%
Synack4%04Astra Security4%
Astra Security4%05UnderDefense4%
UnderDefense4%06HackerOne2%
HackerOne2%07Bugcrowd2%
Bugcrowd2%08NetSPI0%
NetSPI0%09Bishop Fox0%
Bishop Fox0%10Rapid70%
Rapid70%What they warned about
Four of fourteen models held their first choice under the paraphrase. Claude Haiku 4.5, Perplexity Sonar, Grok 4.1 Fast, Mistral Small, DeepSeek V4 Flash, Llama 4 Maverick, Qwen 3.7 Flash, GLM 4.7 FlashX, MiniMax M2.5 and Muse Glimmer 30B changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
Synack10%
3 of 29 labels negative · 3 of 14 models
“**Choose Synack** if you want a **crowdsourced** model and are willing to validate scope and pricing more carefully” Perplexity Sonar, paraphrase prompt
Mandiant50%
2 of 4 labels negative · 2 of 14 models · 1 hard negative
“Avoid pure enterprise giants (e.g., Mandiant, Rapid7) which can be pricier/slower” Grok 4.1 Fast, direct prompt
Bugcrowd17%
2 of 12 labels negative · 2 of 14 models
“often more suited to larger enterprises or those with more complex needs” Mistral Small, paraphrase prompt
HackerOne14%
2 of 14 labels negative · 2 of 14 models
“crowdsourced like HackerOne/Cobalt work for speed but less for deep compliance” Grok 4.1 Fast, direct prompt
What they cite
Citations exist only for the models that return a source list: fourteen of the fourteen in this edition, and all six flagship models on the expanded tier.
Sites the answers cite
73 of 84 answers in this category came back with a source list, from 14 of 14 models: citations where the model returns them, or the search results it consulted. 904 links across 206 sites, every framing counted. Ranked by the number of answers carrying the site or page. 8 of the 252 answers across every segment cited this index's own page for the category; the method page measures whether that reading tilts an answer.
vendor site · DeepStrike41 answers · 80 citations · 12 models
vendor site · Synack39 answers · 46 citations · 14 models
vendor site · UnderDefense38 answers · 43 citations · 11 models
vendor site · Stingrai31 answers · 67 citations · 11 models
27 answers · 28 citations · 9 models
vendor site · Beagle Security25 answers · 25 citations · 11 models
20 answers · 28 citations · 10 models
vendor site · Software Secured16 answers · 16 citations · 9 models
vendor site · Bright Defense15 answers · 22 citations · 9 models
vendor site · G211 answers · 22 citations · 6 models
11 answers · 11 citations · 6 models
11 answers · 11 citations · 10 models
Pages the answers cite
The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.
33 answers · 11 models
27 answers · 9 models
24 answers · 10 models
23 answers · 11 models
18 answers · 9 models
15 answers · 9 models
14 answers · 9 models
12 answers · 6 models
12 answers · 7 models
12 answers · 9 models
Search against answers
Each company's standing in the answers beside its site's footprint in Google search, one row a site: the products the models named on it with their shares, and the share they add up to; monthly searches on Google, and DataForSEO's estimate of AI search demand (modeled from search signals, directional, not a count of queries to any assistant), for the most-searched of the company's and its products' names (the name is in each row's hover text); estimated monthly organic visits to the site; and its best position in Google's top ten for “best penetration testing service”, “penetration testing service”, “penetration testing services”. US estimates from DataForSEO and Google's Ads Transparency Center. A small company's site, or a mid-sized company's site for its flagship, is marked company; a product on a large parent's site (Google, Microsoft) has no site figures. A column with no figures for this category is left out, and an empty cell means none were seen, not none exist. Two measurements side by side: neither is read as the cause of the other.
| Company and products | Share | Own site cited | Name searches, Google | AI search demand, est. | Organic visits | Paid search a month, est. | Google ads, last 30 days | Best Google position |
|---|---|---|---|---|---|---|---|---|
| Cobalt cobalt.io | 45% | 114 | 135,000 | 27,732 | 23,655 | 14 | ||
| BreachLock breachlock.com | 19% | 92 | 590 | 6 | 2,479 | 22 | ||
| Synack synack.com | 4% | 104 | 2,400 | 59 | 6,764 | 7 | 4 | |
| Astra getastra.com Astra Security 4% | 4% | 90 | 590 | 20 | 60,832 company | $17,489 | 75 | 5 |
| UnderDefense underdefense.com | 4% | 68 | 170 | 1 | 11,823 | 10 | ||
| HackerOne hackerone.com | 2% | 40 | 9,900 | 169 | 2,038,087 | 7 | ||
| Raxis | 2% | 320 | 5 | |||||
| Bugcrowd bugcrowd.com | 2% | 32 | 3,600 | 77 | 38,523 | 0 | ||
| Vonahi vonahi.io Vonahi Security vPenTest 2% | 2% | 11 | ||||||
| Software Secured softwaresecured.com | 2% | 7 | 480 | 1,088 | 2,266 | 0 |
Google's top ten for the three searches hold 22 sites; 2 of them are among the sites the models cited here (getastra.com, synack.com). The first result for “best penetration testing service” is reddit.com.
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.ShowHide
How they answered
Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ShowHideModelDirect“What is the best penetration testing service for a mid-market B2B company?”Paraphrase“Which pentest-as-a-service provider would you recommend to a mid-sized B2B company?”Comparative“What are the top penetration testing services and how do they differ?”Budget-constrained“What is the best penetration testing service for a company with a limited budget?”Scale-constrained“We are a 500 person company evaluating a penetration testing service. What should we look at?”Negative“Which penetration testing services should I avoid or be cautious about?”
Claude Haiku 4.5BreachLock, CobaltCobaltChangedSynackno first choiceno first choicenothing named
Three alternatives
Packetlabs, Raxis, StingraiTwo alternatives
BreachLock, NetSPINine alternatives
Beagle Security, Bishop Fox, BreachLock, Coalfire, Cobalt, NCC Group, NetSPI, SpecterOps, TrustwaveGPT-5.4 miniCobaltagainst: QualysCobaltHeldno first choiceAstra Security, Vonahi Security vPenTestno first choicenothing named
Two alternatives
Cognisys, Trava SecurityThree alternatives
HackerOne, Intigriti, SynackTwo alternatives
Affordable Pentesting, CISAGemini 3.5 FlashCobaltagainst: CrowdStrike, MandiantCobaltHeldno first choiceAstra Securityno first choicenothing named
Three alternatives
BreachLock, NetSPI, UnderDefenseThree alternatives
BreachLock, Cybri, SynackSix alternatives
Bishop Fox, Cobalt, Horizon3.ai NodeZero, NetSPI, Synack, UnderDefenseFour alternatives
Budget Security, Intruder, UnderDefense, Vonahi Security vPenTestPerplexity SonarBreachLockCobaltChangedagainst: Synackno first choiceBreachLockno first choicenothing named
Three alternatives
Cobalt, Raxis, StingraiTwo alternatives
Astra Security, BreachLockThree alternatives
Andersen, Defendify, ScienceSoftGrok 4.1 FastBreachLockagainst: Cobalt, HackerOne, Mandiant, Rapid7CobaltChangedagainst: Bugcrowd, Pentera, Synackno first choiceBright Defenseagainst: OpenVASno first choicenothing named
Four alternatives
Bright Defense, NetSPI, Packetlabs, Prescient SecurityOne alternative
BreachLockTwo alternatives
Astra Security, BreachLockMistral SmallBreachLock, CobaltCobaltChangedagainst: Bugcrowd, HackerOne, SynackAstra SecuritySynackno first choicenothing named
Three alternatives
NetSPI, Stingrai, SynackOne alternative
Pentest-Tools.comSeven alternatives
BreachLock, Cobalt, Invicti, NetSPI, Rapid7, Synack, UnderDefenseThree alternatives
Cybri, Software Secured, Vonahi Security vPenTestDeepSeek V4 FlashCobalt, RaxisBreachLockChangedBishop Fox, NetSPIIntruderno first choicenothing named
Three alternatives
BreachLock, Packetlabs, UnderDefenseThree alternatives
Cobalt, Edgescan, RaxisFive alternatives
Beagle Security, BreachLock, Cobalt, Packetlabs, SynackFour alternatives
Astra Security, BreachLock, Software Secured, UnderDefenseLlama 4 Maverickno first choiceBreachLockChangedno first choiceSynackno first choicenothing named
Three alternatives
Astra Security, Raxis, Sprocket SecurityThree alternatives
Astra Security, Beagle Security, BreachLockQwen 3.7 FlashRed Siege Securityagainst: Counter Threat UnitCobalt, Software SecuredChangedCobaltagainst: Horizon3.ai NodeZero, StingraiCobaltagainst: Deloitte, PwC, Upworkno first choicenothing named
Four alternatives
Astra Security, BreachLock, Lumina.io, NetragardThree alternatives
Bugcrowd, Stingray.io, SynackFour alternatives
Astra Security, BreachLock, NetSPI, SynackTwo alternatives
Bugcrowd, HackerOneThree alternatives
Antisyphon, Cobalt, HackerOneKimi K2CobaltCobaltHeldAstra Securityagainst: IntruderBug Circuitno first choicenothing named
Three alternatives
BreachLock, Coalfire, PraetorianFour alternatives
Astra Security, BreachLock, NetSPI, SynackSeven alternatives
Acunetix, BreachLock, Bugcrowd, Cobalt, Invicti, NetSPI, NetragardSeven alternatives
Astra Security, BreachLock, Intruder, OWASP ZAP, Stingrai, Tenable Nessus, Vonahi Security vPenTestGLM 4.7 FlashXCobalt, UnderDefenseCobaltChangedno first choiceno first choiceno first choicenothing named
Three alternatives
BreachLock, NetSPI, PacketlabsThree alternatives
BreachLock, NetSPI, SynackSeven alternatives
Bishop Fox, BreachLock, Cobalt, DeepStrike, HackerOne, NetSPI, SynackMiniMax M2.5BreachLock, UnderDefenseCobaltChangedno first choiceBugcrowd, HackerOneno first choicenothing named
Two alternatives
Raxis, SynackThree alternatives
BreachLock, Bugcrowd, Pentest-Tools.comFour alternatives
Open Bug Bounty, Qualys, Rapid7, VerizonGPT-6 LunaCobaltCobaltHeldno first choiceagainst: NetSPICISA's free Cyber Hygiene serviceno first choicenothing named
Two alternatives
Bishop Fox, NetSPITwo alternatives
HackerOne, SynackFive alternatives
Bishop Fox, Coalfire, Cobalt, HackerOne, NCC GroupMuse Glimmer 30BCobaltBreachLockChangedagainst: NetSPIno first choicePractical Assuranceno first choicenothing named
Five alternatives
Astra Security, HackerOne, Netragard, Red Siege, UnderDefenseOne alternative
CobaltFour alternatives
Astra Security, HIFENCE, Qualysec, UnderDefenseBold is the first choiceAlternatives are counted; the count opens them.What the answer argued against
The record
One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency. Full answer text is in the free responses file. Download the record
Eighty-four rows: every prompt, every model, every answer.
| Prompt | Model | Version string | Time (UTC) | Searched | Sources | Latency |
|---|---|---|---|---|---|---|
| Direct recommendation | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 12:29 | yes | 15 | 9 s |
| Direct recommendation | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 13:06 | yes | 4 | 6 s |
| Direct recommendation | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 13:18 | yes | 11 | 21 s |
| Direct recommendation | Perplexity Sonar | sonar | 2026-10-01 11:53 | yes | 20 | 4 s |
| Direct recommendation | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 12:49 | yes | 19 | 8 s |
| Direct recommendation | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 11:49 | yes | 5 | 5 s |
| Direct recommendation | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 09:17 | yes | 18 | 31 s |
| Direct recommendation | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 13:21 | yes | 5 | 2 s |
| Direct recommendation | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 12:10 | yes | 5 | 32 s |
| Direct recommendation | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 10:43 | yes | 10 | 17 s |
| Direct recommendation | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 09:38 | yes | 12 | 17 s |
| Direct recommendation | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 10:57 | yes | 12 | 28 s |
| Direct recommendation | GPT-6 Luna | gpt-6-luna | 2026-10-01 08:14 | yes | 3 | 16 s |
| Direct recommendation | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 08:05 | yes | 14 | 22 s |
| Paraphrase | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 10:53 | yes | 18 | 9 s |
| Paraphrase | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 13:51 | yes | 5 | 5 s |
| Paraphrase | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 08:09 | yes | 9 | 21 s |
| Paraphrase | Perplexity Sonar | sonar | 2026-10-01 10:02 | yes | 20 | 4 s |
| Paraphrase | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 08:44 | yes | 21 | 8 s |
| Paraphrase | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 12:05 | yes | 19 | 7 s |
| Paraphrase | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 13:19 | yes | 24 | 32 s |
| Paraphrase | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 11:50 | yes | 5 | 1 s |
| Paraphrase | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 10:48 | yes | 5 | 12 s |
| Paraphrase | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 13:22 | yes | 19 | 20 s |
| Paraphrase | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 11:17 | yes | 19 | 176 s |
| Paraphrase | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 11:21 | yes | 21 | 41 s |
| Paraphrase | GPT-6 Luna | gpt-6-luna | 2026-10-01 13:26 | yes | 3 | 15 s |
| Paraphrase | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 09:04 | yes | 22 | 27 s |
| Comparative | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 09:18 | yes | 9 | 10 s |
| Comparative | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 09:44 | yes | 7 | 10 s |
| Comparative | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 08:10 | yes | 13 | 25 s |
| Comparative | Perplexity Sonar | sonar | 2026-10-01 09:45 | yes | 19 | 5 s |
| Comparative | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 12:48 | yes | 17 | 8 s |
| Comparative | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 10:38 | yes | 8 | 7 s |
| Comparative | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 09:19 | yes | 23 | 30 s |
| Comparative | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 09:23 | yes | 5 | 2 s |
| Comparative | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 09:06 | yes | 10 | 50 s |
| Comparative | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 12:28 | yes | 10 | 29 s |
| Comparative | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 10:24 | yes | 19 | 91 s |
| Comparative | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 13:06 | yes | 10 | 18 s |
| Comparative | GPT-6 Luna | gpt-6-luna | 2026-10-01 11:41 | yes | 9 | 23 s |
| Comparative | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 13:41 | yes | 15 | 29 s |
| Budget constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 11:26 | no | 0 | 4 s |
| Budget constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 12:00 | yes | 4 | 5 s |
| Budget constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 07:36 | yes | 24 | 24 s |
| Budget constrained | Perplexity Sonar | sonar | 2026-10-01 13:02 | yes | 20 | 3 s |
| Budget constrained | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 11:39 | yes | 23 | 8 s |
| Budget constrained | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 12:34 | yes | 5 | 3 s |
| Budget constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 10:41 | yes | 24 | 37 s |
| Budget constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 08:45 | yes | 5 | 2 s |
| Budget constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 12:39 | no | 0 | 46 s |
| Budget constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 09:46 | yes | 20 | 27 s |
| Budget constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 12:35 | no | 0 | 102 s |
| Budget constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 10:29 | no | 0 | 6 s |
| Budget constrained | GPT-6 Luna | gpt-6-luna | 2026-10-01 08:11 | yes | 2 | 20 s |
| Budget constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 12:45 | yes | 13 | 24 s |
| Scale constrained | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 12:53 | no | 0 | 5 s |
| Scale constrained | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 08:28 | no | 0 | 10 s |
| Scale constrained | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 11:00 | no | 0 | 15 s |
| Scale constrained | Perplexity Sonar | sonar | 2026-10-01 12:04 | yes | 19 | 7 s |
| Scale constrained | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 12:29 | yes | 9 | 6 s |
| Scale constrained | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 12:14 | no | 0 | 8 s |
| Scale constrained | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 12:42 | yes | 15 | 36 s |
| Scale constrained | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 09:56 | yes | 5 | 2 s |
| Scale constrained | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 13:01 | yes | 5 | 23 s |
| Scale constrained | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 11:13 | yes | 17 | 23 s |
| Scale constrained | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 12:17 | yes | 9 | 55 s |
| Scale constrained | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 12:19 | no | 0 | 9 s |
| Scale constrained | GPT-6 Luna | gpt-6-luna | 2026-10-01 08:01 | yes | 4 | 32 s |
| Scale constrained | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 10:37 | yes | 11 | 17 s |
| Negative framing | Claude Haiku 4.5 | claude-haiku-4-5-20251001 | 2026-10-01 11:12 | no | 0 | 5 s |
| Negative framing | GPT-5.4 mini | gpt-5.4-mini-2026-03-17 | 2026-10-01 08:00 | yes | 5 | 11 s |
| Negative framing | Gemini 3.5 Flash | gemini-3.5-flash | 2026-10-01 10:58 | yes | 9 | 23 s |
| Negative framing | Perplexity Sonar | sonar | 2026-10-01 12:04 | yes | 19 | 5 s |
| Negative framing | Grok 4.1 Fast | spacexai/grok-4.1-fast-non-reasoning via vertex | 2026-10-01 12:20 | yes | 14 | 5 s |
| Negative framing | Mistral Small | mistral/mistral-small via mistral | 2026-10-01 10:48 | yes | 5 | 5 s |
| Negative framing | DeepSeek V4 Flash | deepseek/deepseek-v4-flash via deepinfra | 2026-10-01 11:19 | yes | 22 | 53 s |
| Negative framing | Llama 4 Maverick | meta/llama-4-maverick via bedrock | 2026-10-01 13:30 | yes | 5 | 2 s |
| Negative framing | Qwen 3.7 Flash | alibaba/qwen3.7-flash via alibaba | 2026-10-01 11:07 | yes | 10 | 25 s |
| Negative framing | Kimi K2 | moonshotai/kimi-k2 via novita | 2026-10-01 08:27 | yes | 19 | 24 s |
| Negative framing | GLM 4.7 FlashX | zai/glm-4.7-flashx via zai | 2026-10-01 10:58 | yes | 9 | 70 s |
| Negative framing | MiniMax M2.5 | minimax/minimax-m2.5 via minimax | 2026-10-01 09:34 | no | 0 | 9 s |
| Negative framing | GPT-6 Luna | gpt-6-luna | 2026-10-01 13:39 | yes | 4 | 14 s |
| Negative framing | Muse Glimmer 30B | meta/muse-glimmer-30b via togetherai | 2026-10-01 13:19 | yes | 12 | 30 s |
Normalization in this category
Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.
ShowHide
Category-scoped readings
Astra read as Astra Security
Horizon3.ai read as Horizon3.ai NodeZero
Horizon3.ai (NodeZero) read as Horizon3.ai NodeZero
Vonahi Security (vPenTest) read as Vonahi Security vPenTest
Unresolved, counted raw
Cognisys
Counter Threat Unit (CTU)
Iterasec
Kali Linux
Lumina.io (Tenable)
Open Bug Bounty
Pentest Express
Red Siege
Red Siege Security
ScienceSoft
Stingray.io
ThreatSpike Labs
Toptal
Trava Security
Under Defense
VulnGuard
White Knight Labs
Discontinued, still offered
No shut-down product was recommended here.