AI Indexes
IT AI Index
October 2026 Edition · The permanent record of this edition. The unqualified address always carries the latest edition.
Index › Security operations › PTaaS › Small business › October 2026 Edition

Penetration testing as a service for small business buyers

Asked as “penetration testing service”, and as “pentest-as-a-service provider”, on behalf of a small B2B company. 47 first choices recorded across the direct, paraphrase, budget and scale prompts, fourteen models each.
Standing · first-choice share
17%
Contested · Cobalt 17%
17Bright Defense17Cobalt13BreachLock53others

17% of first choices, contested.

Since September 2026↗new leaderNew leader since September 2026: Bright Defense (18%) replaces BreachLock (28% then, 12% now), 5 points clear, inside the 11-point floor.Bright Defense leads at 18%, replacing BreachLock, which led at 28% and stands at 12% now: 5 points clear, inside the floor, so the swap reads as unsettled.

By buyer segment

The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.

The standing

Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all fourteen models, for a small B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrantSince September 2026
01Cobalt17%11%37accepted challenger▼−6Since September 2026: 21% → 15%, −6 points. Inside the 11-point floor: within noise. Read over the models both editions asked.21% → 15%
02Bright Defense17%0%17accepted challenger▲+18Since September 2026: 0% → 18%, +18 points. Past the 11-point floor: movement. Read over the models both editions asked.0% → 18%
03BreachLock13%0%24accepted challenger▼−15Since September 2026: 28% → 12%, −15 points. Past the 11-point floor: movement. Read over the models both editions asked.28% → 12%
04Astra Security11%0%21accepted challenger▼−6Since September 2026: 19% → 12%, −6 points. Inside the 11-point floor: within noise. Read over the models both editions asked.19% → 12%
05Acunetix9%20%15accepted challenger▲+1Since September 2026: 9% → 10%, +1 point. Inside the 11-point floor: within noise. Read over the models both editions asked.9% → 10%
06UnderDefense2%0%17accepted challenger=heldSince September 2026: 2% → 2%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.2% → 2%
07Bugcrowd2%8%12accepted challenger=heldSince September 2026: 2% → 2%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.2% → 2%
08Pentest-Tools.com2%0%10accepted challenger=heldSince September 2026: 2% → 2%, ±0 points. Inside the 11-point floor: within noise. Read over the models both editions asked.2% → 2%

The floor is 11 points of share, measured: how far the models move a leader on their own when the same questions are asked twice with nothing changed. A larger change is movement; a smaller one is noise, and both are shown. Movement is read over the twelve models both editions asked; GPT-6 Luna, Muse Glimmer 30B joined this edition and are in the standing but not yet in the comparison. How the floor is measured

Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its product page.
All twenty-one head-to-head pages: the top seven products, each against each

Recommended versus criticized

Every product with at least 10 labels here, on both axes. The 30% line names a quadrant, not the verdict above: that one needs more than 40%.

Criticized challengerCriticized default
Negative label rate →
01
02
03
04
05
06
07
08
Accepted challengerEndorsed leader
0%First-choice share → · lines at 30% share and 25% negative30%
Key
01Cobalt17%
02Bright Defense17%
03BreachLock13%
04Astra Security11%
05Acunetix9%
06UnderDefense2%
07Bugcrowd2%
08Pentest-Tools.com2%

What they warned about

Three of fourteen models held their first choice under the paraphrase. Claude Haiku 4.5, GPT-5.4 mini, Perplexity Sonar, Grok 4.1 Fast, Mistral Small, DeepSeek V4 Flash, Qwen 3.7 Flash, Kimi K2, GLM 4.7 FlashX, MiniMax M2.5 and Muse Glimmer 30B changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
Cobalt
11%
4 of 37 labels negative · 4 of 14 models
“Pricing starts around $65K–$100K+/year — likely overkill for a small business” Kimi K2, paraphrase prompt
Acunetix
20%
3 of 15 labels negative · 2 of 14 models · 1 hard negative
“Web-only scanner; no network/API/infrastructure testing” Kimi K2, paraphrase prompt
Bishop Fox
50%
2 of 4 labels negative · 2 of 14 models · 1 hard negative
“skip the enterprise giants (Bishop Fox, Mandiant, Rapid7, etc.)” DeepSeek V4 Flash, direct prompt
HackerOne
33%
2 of 6 labels negative · 2 of 14 models · 1 hard negative
“What to Avoid ... Median contract ~$41K/year; better for bug bounty programs” Kimi K2, paraphrase prompt

What they cite

Citations exist only for the models that return a source list: fourteen of the fourteen in this edition, and all six flagship models on the expanded tier.

Sites the answers cite

74 of 84 answers in this category came back with a source list, from 14 of 14 models: citations where the model returns them, or the search results it consulted. 885 links across 197 sites, every framing counted. Ranked by the number of answers carrying the site or page. 8 of the 252 answers across every segment cited this index's own page for the category; the method page measures whether that reading tilts an answer.

vendor site · DeepStrike38 answers · 75 citations · 13 models
vendor site · UnderDefense32 answers · 42 citations · 11 models
vendor site · Bright Defense27 answers · 35 citations · 12 models
vendor site · Synack26 answers · 35 citations · 13 models
26 answers · 28 citations · 10 models
23 answers · 23 citations · 10 models
vendor site · Stingrai22 answers · 39 citations · 8 models
vendor site · Netragard18 answers · 18 citations · 9 models
vendor site · G216 answers · 37 citations · 8 models
15 answers · 20 citations · 9 models
15 answers · 16 citations · 11 models
vendor site · Defendify15 answers · 15 citations · 7 models

Pages the answers cite

The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.

Search against answers

Each company's standing in the answers beside its site's footprint in Google search, one row a site: the products the models named on it with their shares, and the share they add up to; monthly searches on Google, and DataForSEO's estimate of AI search demand (modeled from search signals, directional, not a count of queries to any assistant), for the most-searched of the company's and its products' names (the name is in each row's hover text); estimated monthly organic visits to the site; and its best position in Google's top ten for “best penetration testing service”, “penetration testing service”, “penetration testing services”. US estimates from DataForSEO and Google's Ads Transparency Center. A small company's site, or a mid-sized company's site for its flagship, is marked company; a product on a large parent's site (Google, Microsoft) has no site figures. A column with no figures for this category is left out, and an empty cell means none were seen, not none exist. Two measurements side by side: neither is read as the cause of the other.
Company and productsShareOwn site citedName searches, GoogleAI search demand, est.Organic visitsPaid search a month, est.Google ads, last 30 daysBest Google position
Cobalt cobalt.io17%114135,00027,73223,65514
Bright Defense brightdefense.com17%2111010045,507
BreachLock breachlock.com13%9259062,47922
Astra getastra.com
Astra Security 11%
11%905902060,832 company$17,489755
Acunetix acunetix.com9%1138804315,29110
Bug Circuit bugcircuit.com6%710145
Prescient Security prescientsecurity.com4%5
HIFENCE hifence.com4%8
UnderDefense underdefense.com2%68170111,82310
Bugcrowd bugcrowd.com2%323,6007738,5230

Google's top ten for the three searches hold 22 sites; 3 of them are among the sites the models cited here (defendify.com, getastra.com, synack.com). The first result for “best penetration testing service” is reddit.com.

How they answered

Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ShowHide
ModelDirect“What is the best penetration testing service for a small B2B company?”Paraphrase“Which pentest-as-a-service provider would you recommend to a small business that sells to other businesses?”Comparative“What are the top penetration testing services for a small team and how do they differ?”Budget-constrained“What is the best penetration testing service for a small company with a tight budget?”Scale-constrained“We are a 30 person company evaluating a penetration testing service. What should we look at?”Negative“Which penetration testing services should a small business avoid or be cautious about?”
Claude Haiku 4.5Cobalt
Four alternativesAstra Security, Intruder, TraceSecurity, UnderDefense
Software SecuredChanged
Three alternativesBreachLock, Bright Defense, Cobalt
no first choice
Four alternativesBreachLock, Bright Defense, Pentest-Tools.com, UnderDefense
Acunetix
Five alternativesBreachLock, Cobalt, Intruder, TraceSecurity, UnderDefense
no first choicenothing named
GPT-5.4 miniAstra Security
Three alternativesCobalt, HackerOne, Vynox Security PTaaS
CobaltChanged
One alternativeKobalt.io
Cobalt
Two alternativesCrowdStrike Services, Rapid7 Penetration Testing Services
against: Qualys VMDR
Cobaltno first choicenothing named
Gemini 3.5 FlashAstra Security
Four alternativesBreachLock, Cobalt, Kobalt.io, UnderDefense
Astra SecurityHeld
Two alternativesBreachLock, Vonahi Security vPenTest
Astra Security
Four alternativesBreachLock, Cobalt, Red Sentry, UnderDefense
Vonahi Security vPenTest
Four alternativesAstra Security, Budget Security, Central InfoSec, Defense.com
against: Bug Circuit
no first choicenothing named
Perplexity SonarBright Defense
Two alternativesAstra Security, DeepStrike
against: Bishop Fox, Cobalt, NetSPI, Synack
BreachLockChanged
One alternativeCobalt
BreachLock
Four alternativesAstra Security, Bright Defense, Packetlabs, TraceSecurity
against: NetSPI, Synack
BreachLockno first choicenothing named
Grok 4.1 FastBreachLock, Cobalt
One alternativeAcunetix
BreachLockChanged
Four alternativesAcunetix, Bugcrowd, Cobalt, Pentest-Tools.com
against: NetSPI
BreachLock, Cobalt
Four alternativesAcunetix, Astra Security, Bugcrowd, HackerOne
UnderDefense
Two alternativesAcunetix, Bright Defense
against: Bug Circuit, Cobalt, HIFENCE
no first choice
Two alternativesDeepStrike, Synack
against: OpenVAS, Tenable Nessus
Mistral SmallAstra Security, Bright Defense
Two alternativesCobalt, NetSPI
Acunetix, Pentest-Tools.comChanged
One alternativeHIFENCE
Acunetix, Pentest-Tools.com
Two alternativesCobalt, NetSPI
Acunetix, Bug Circuit
One alternativeUnderDefense
no first choicenothing named
DeepSeek V4 FlashBright Defense
Three alternativesBreachLock, Cobalt, Prescient Security
against: Bishop Fox, Mandiant, Rapid7
CobaltChanged
Three alternativesBright Defense, Pentest-Tools.com, UnderDefense
Astra Security, Intruder
Five alternativesBugcrowd, Cobalt, Horizon3.ai NodeZero, RidgeBot, Vonahi Security vPenTest
against: Acunetix
Bright Defense
Two alternativesQualysec, UnderDefense
against: Acunetix, HIFENCE, PenTestPro, SecureScan
no first choicenothing named
Llama 4 Maverickno first choiceno first choiceHeldno first choiceno first choiceno first choicenothing named
Qwen 3.7 FlashBright Defense
Two alternativesAstra Security, Cobalt
CobaltChanged
Three alternativesCynergisTek, Pentera, Synnaps
Cobalt
Four alternativesBreachLock, Bright Defense, NetSPI, Netsparker
Acunetix
Two alternativesAntisyphon, ImmuniWeb
against: Cobalt, CrowdStrike, Deloitte, Volexity / Censys
no first choiceagainst: Fiverr, Upwork
Kimi K2Bright Defense, Prescient Security
Five alternativesAffordable Pentesting, Cobalt, Qualysec, Raxis, UnderDefense
Astra SecurityChanged
One alternativeBreachLock
against: Acunetix, Bugcrowd, Cobalt, HackerOne
Astra Security
Four alternativesBreachLock, Cobalt, Sprocket Security, Stingrai
Bug Circuit, HIFENCE
Three alternativesAcunetix, Budget Security, UnderDefense
no first choiceagainst: OpenVAS, Qualys, Tenable Nessus
GLM 4.7 FlashXAffordable Pentesting, Bright Defense
Two alternativesRevealSec, UnderDefense
BreachLockChanged
Four alternativesAstra Security, Bugcrowd, Cobalt, Rapid7
BreachLock, Bugcrowd, Cobalt, Synack
Six alternativesAstra Security, Bright Defense, Intruder, NetSPI, Prescient Security, UnderDefense
HIFENCE, SecureScan
Two alternativesAffordable Pentesting, Bug Circuit
no first choicenothing named
MiniMax M2.5no first choiceBugcrowdChanged
Four alternativesAstra Security, BreachLock, Pentest-Tools.com, Petronella Technology Group
Cobalt
Four alternativesBreachLock, Bugcrowd, HackER8, Synack
TurboPentest
Three alternativesDefense.com, HIFENCE, RevealSec
no first choicenothing named
GPT-6 LunaCobalt
Two alternativesKobalt.io, Packetlabs
CobaltHeld
One alternativeBugcrowd
Astra Security, Cobalt
Two alternativesHackerOne, Rapid7
against: Synack
Kobalt.iono first choicenothing named
Muse Glimmer 30BBright Defense, Prescient Security
Three alternativesAffordable Pentesting, RevealSec, UnderDefense
BreachLockChanged
Three alternativesBugcrowd, Pentest-Tools.com, UnderDefense
Astra Security, Cobalt
Four alternativesBreachLock, Bugcrowd Pen Test as a Service, SecureLayer7, Synack
against: HackerOne
Bug Circuit
Three alternativesDefense.com, HIFENCE, Practical Assurance
no first choicenothing named
Bold is the first choiceAlternatives are counted; the count opens them.What the answer argued against

The record

One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency. Full answer text is in the free responses file. Download the record
Eighty-four rows: every prompt, every model, every answer.
PromptModelVersion stringTime (UTC)SearchedSourcesLatency
Direct recommendationClaude Haiku 4.5claude-haiku-4-5-202510012026-10-01 08:42yes98 s
Direct recommendationGPT-5.4 minigpt-5.4-mini-2026-03-172026-10-01 07:44yes44 s
Direct recommendationGemini 3.5 Flashgemini-3.5-flash2026-10-01 10:44yes1620 s
Direct recommendationPerplexity Sonarsonar2026-10-01 11:11yes204 s
Direct recommendationGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-10-01 13:32yes219 s
Direct recommendationMistral Smallmistral/mistral-small via mistral2026-10-01 11:35yes1310 s
Direct recommendationDeepSeek V4 Flashdeepseek/deepseek-v4-flash via deepinfra2026-10-01 08:57yes2228 s
Direct recommendationLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-10-01 10:11yes52 s
Direct recommendationQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-10-01 11:43yes1317 s
Direct recommendationKimi K2moonshotai/kimi-k2 via novita2026-10-01 12:40yes916 s
Direct recommendationGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-10-01 12:05yes1474 s
Direct recommendationMiniMax M2.5minimax/minimax-m2.5 via minimax2026-10-01 10:19no08 s
Direct recommendationGPT-6 Lunagpt-6-luna2026-10-01 13:16yes521 s
Direct recommendationMuse Glimmer 30Bmeta/muse-glimmer-30b via togetherai2026-10-01 09:59yes1321 s
ParaphraseClaude Haiku 4.5claude-haiku-4-5-202510012026-10-01 13:28yes168 s
ParaphraseGPT-5.4 minigpt-5.4-mini-2026-03-172026-10-01 10:46yes25 s
ParaphraseGemini 3.5 Flashgemini-3.5-flash2026-10-01 10:48yes1622 s
ParaphrasePerplexity Sonarsonar2026-10-01 11:25yes203 s
ParaphraseGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-10-01 11:54yes206 s
ParaphraseMistral Smallmistral/mistral-small via mistral2026-10-01 08:50yes116 s
ParaphraseDeepSeek V4 Flashdeepseek/deepseek-v4-flash via deepinfra2026-10-01 12:49yes2228 s
ParaphraseLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-10-01 08:34yes52 s
ParaphraseQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-10-01 10:42no029 s
ParaphraseKimi K2moonshotai/kimi-k2 via novita2026-10-01 12:46yes1424 s
ParaphraseGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-10-01 08:24yes1445 s
ParaphraseMiniMax M2.5minimax/minimax-m2.5 via minimax2026-10-01 08:49yes524 s
ParaphraseGPT-6 Lunagpt-6-luna2026-10-01 10:41yes213 s
ParaphraseMuse Glimmer 30Bmeta/muse-glimmer-30b via togetherai2026-10-01 09:43yes1216 s
ComparativeClaude Haiku 4.5claude-haiku-4-5-202510012026-10-01 10:52yes108 s
ComparativeGPT-5.4 minigpt-5.4-mini-2026-03-172026-10-01 13:45yes48 s
ComparativeGemini 3.5 Flashgemini-3.5-flash2026-10-01 08:14yes922 s
ComparativePerplexity Sonarsonar2026-10-01 09:44yes195 s
ComparativeGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-10-01 12:33yes2110 s
ComparativeMistral Smallmistral/mistral-small via mistral2026-10-01 08:36yes148 s
ComparativeDeepSeek V4 Flashdeepseek/deepseek-v4-flash via deepinfra2026-10-01 11:27yes2237 s
ComparativeLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-10-01 12:11yes51 s
ComparativeQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-10-01 12:22yes1041 s
ComparativeKimi K2moonshotai/kimi-k2 via novita2026-10-01 10:26yes1524 s
ComparativeGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-10-01 08:31yes1426 s
ComparativeMiniMax M2.5minimax/minimax-m2.5 via minimax2026-10-01 10:49yes1834 s
ComparativeGPT-6 Lunagpt-6-luna2026-10-01 10:10yes524 s
ComparativeMuse Glimmer 30Bmeta/muse-glimmer-30b via togetherai2026-10-01 10:54yes1527 s
Budget constrainedClaude Haiku 4.5claude-haiku-4-5-202510012026-10-01 11:07yes97 s
Budget constrainedGPT-5.4 minigpt-5.4-mini-2026-03-172026-10-01 11:31yes55 s
Budget constrainedGemini 3.5 Flashgemini-3.5-flash2026-10-01 08:59yes1926 s
Budget constrainedPerplexity Sonarsonar2026-10-01 08:27yes193 s
Budget constrainedGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-10-01 11:12yes2110 s
Budget constrainedMistral Smallmistral/mistral-small via mistral2026-10-01 08:16yes54 s
Budget constrainedDeepSeek V4 Flashdeepseek/deepseek-v4-flash via deepinfra2026-10-01 12:12yes2226 s
Budget constrainedLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-10-01 12:29yes52 s
Budget constrainedQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-10-01 08:00no028 s
Budget constrainedKimi K2moonshotai/kimi-k2 via novita2026-10-01 10:17yes820 s
Budget constrainedGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-10-01 12:03yes1573 s
Budget constrainedMiniMax M2.5minimax/minimax-m2.5 via minimax2026-10-01 09:08yes519 s
Budget constrainedGPT-6 Lunagpt-6-luna2026-10-01 12:10yes111 s
Budget constrainedMuse Glimmer 30Bmeta/muse-glimmer-30b via togetherai2026-10-01 09:40yes1220 s
Scale constrainedClaude Haiku 4.5claude-haiku-4-5-202510012026-10-01 11:22yes910 s
Scale constrainedGPT-5.4 minigpt-5.4-mini-2026-03-172026-10-01 11:27no06 s
Scale constrainedGemini 3.5 Flashgemini-3.5-flash2026-10-01 09:39no014 s
Scale constrainedPerplexity Sonarsonar2026-10-01 07:45yes195 s
Scale constrainedGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-10-01 13:15yes109 s
Scale constrainedMistral Smallmistral/mistral-small via mistral2026-10-01 11:52no08 s
Scale constrainedDeepSeek V4 Flashdeepseek/deepseek-v4-flash via deepinfra2026-10-01 12:02yes1738 s
Scale constrainedLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-10-01 09:06yes52 s
Scale constrainedQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-10-01 07:43no031 s
Scale constrainedKimi K2moonshotai/kimi-k2 via novita2026-10-01 08:30yes1022 s
Scale constrainedGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-10-01 11:15yes1424 s
Scale constrainedMiniMax M2.5minimax/minimax-m2.5 via minimax2026-10-01 13:20yes521 s
Scale constrainedGPT-6 Lunagpt-6-luna2026-10-01 08:41yes321 s
Scale constrainedMuse Glimmer 30Bmeta/muse-glimmer-30b via togetherai2026-10-01 09:31yes1325 s
Negative framingClaude Haiku 4.5claude-haiku-4-5-202510012026-10-01 10:00yes1810 s
Negative framingGPT-5.4 minigpt-5.4-mini-2026-03-172026-10-01 11:05no06 s
Negative framingGemini 3.5 Flashgemini-3.5-flash2026-10-01 09:46yes924 s
Negative framingPerplexity Sonarsonar2026-10-01 09:07yes204 s
Negative framingGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-10-01 11:40yes1311 s
Negative framingMistral Smallmistral/mistral-small via mistral2026-10-01 12:23yes55 s
Negative framingDeepSeek V4 Flashdeepseek/deepseek-v4-flash via deepinfra2026-10-01 12:59yes2035 s
Negative framingLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-10-01 12:57yes54 s
Negative framingQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-10-01 11:00no030 s
Negative framingKimi K2moonshotai/kimi-k2 via novita2026-10-01 08:15yes1321 s
Negative framingGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-10-01 13:35yes1393 s
Negative framingMiniMax M2.5minimax/minimax-m2.5 via minimax2026-10-01 12:08no050 s
Negative framingGPT-6 Lunagpt-6-luna2026-10-01 07:47yes322 s
Negative framingMuse Glimmer 30Bmeta/muse-glimmer-30b via togetherai2026-10-01 10:21yes1124 s

Normalization in this category

Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.

ShowHide
Category-scoped readings
None. Every name in this category resolved on its own.
Unresolved, counted raw
Bugcrowd Pen Test as a Service
Central InfoSec
CrowdStrike Services
Cybrary-certified freelancers
CynergisTek
Fiverr
HackER8 (Software Secured)
Petronella Technology Group (PTG)
Rapid7 Penetration Testing Services
Red Sentry
RevealSec or AffordablePentesting
SecureLayer7
Synnaps
Trilight Security
Volexity / Censys
Vynox Security PTaaS
YesWeHack
Discontinued, still offered
No shut-down product was recommended here.
← OT/IoT securitySSPM →