Index › Security operations › PTaaS › Cobalt vs BreachLock

Penetration testing as a service · September 2026 Edition

Cobalt vs BreachLock

Nine of twelve models named Cobalt first on the direct prompt; zero named BreachLock. Cobalt was named by twelve of the twelve models and BreachLock by eleven and Cobalt carries 40 labels and BreachLock 30, so the shares are not directly comparable.

Cobalt

endorsed leader

Named in one category this edition.

BreachLock

accepted challenger

Named in one category this edition.

First-choice share44%9%Of first choices across the direct, paraphrase, budget and scale prompts, 0 to 100.

Negative rate5%3%Negative labels as a share of the product's labels, 0 to 100.

Rank in category#1#3A position in a field of 8; printed, not drawn.

Labels4030A count; the two differ.

The two percentage rows are drawn on one 0 to 100 track, Cobalt reading right to left. Rank and label count are printed, not drawn.Cobalt vs Astra Security · Astra Security vs BreachLock

Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all twelve models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the penetration testing as a service page.

By framing

How many of the twelve models made each the first choice, per way of asking, and how many argued against it.

CobaltFirst choices, of twelve modelsBreachLock

Direct90

Paraphrase91

Comparative10

Budget-constrained232 against Cobalt · 1 against BreachLock

Scale-constrained00

Negative00

Bars are first choices, 0 to 12 each sideModels that argued againstA model can name both, so the two sides of a row do not sum to twelve.

The direct prompt

The plain question, one answer per model, grouped by where Cobalt and BreachLock stood in it.

Cobalt first, BreachLock an alternative

9 of 12 modelsBreachLock was named in the answer but not as the choice, or not at all.

GPT-5.4 miniCobalt alternatives: Astra Security, HackerOne, Packetlabs, Thoropass Pentesting, UnderDefense, Vumetric

Gemini 3.5 FlashCobalt alternatives: BreachLock, Cybri, NetSPI

Perplexity SonarCobalt alternatives: BreachLock, DeepStrike, Prescient Security, Stingrai, UnderDefense

Mistral SmallCobalt alternatives: BreachLock, Packetlabs, Stingrai

DeepSeek V4 FlashCobalt alternatives: Astra Security, BreachLock, NetSPI, Packetlabs

Llama 4 MaverickCobalt alternatives: DeepStrike, Echelon Cyber

Qwen 3.7 FlashCobalt alternatives: Coalfire, Kforce, Synack, Trustwave

Kimi K2Cobalt alternatives: BreachLock, NetSPI, UnderDefense

GLM 4.7 FlashXCobalt, NetSPI alternatives: Astra Security, Bishop Fox, BreachLock, Secureworks, Synack

Neither was the first choice, one was named

2 of 12 modelsThe answer put something else first and named one of the two as an alternative.

Grok 4.1 FastPacketlabs alternatives: BreachLock, Cobalt

MiniMax M2.5Stingrai alternatives: Cobalt, Invadel

Neither was named

1 of 12 modelsThe answer made no first choice from these two in this category.

Claude Haiku 4.5no first choice

Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.

By buyer segment

The same question asked on behalf of a different buyer. Each standing is computed within its segment and they are never added together. The figures above are the mid-market standing, which is the one the category orders by.

Small business

BreachLock leads by seven points.

BreachLock#1 of 6

Cobalt#2 of 6

The full small business standing →

Mid-marketThe figures above

The order flips: Cobalt leads at mid-market.

Cobalt#1 of 8

BreachLock#3 of 8

The full mid-market standing →

Enterprise

Cobalt leads by ten points.

Cobalt#3 of 9

BreachLock#5 of 9

The full enterprise standing →

What the models said about Cobalt

Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Five of six in this category shown.

“though it is more of a managed marketplace than a low-cost commodity service” Perplexity Sonar · budget prompt · soft negative

“PTaaS from ~$3K-$10K/yr; crowdsourced for value, but less "one-off cheap."” Grok 4.1 Fast · budget prompt · soft negative

“Cobalt.io (Best Overall for Mid-Market SaaS & Dev Workflows) ... widely considered the gold standard for mid-market technology and SaaS companies” Gemini 3.5 Flash · direct prompt · first choice

“the best penetration testing service is usually Cobalt if you want fast turnaround, audit-ready reporting, and a PTaaS model” Perplexity Sonar · direct prompt · first choice

“Best overall for most mid-market B2B: Cobalt (PTaaS—fast, compliance-ready, retesting included, right-sized pricing)” DeepSeek V4 Flash · direct prompt · first choice

What the models said about BreachLock

Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Four of five in this category shown.

“PTaaS from ~$3K-$10K/yr; crowdsourced for value, but less "one-off cheap."” Grok 4.1 Fast · budget prompt · soft negative

“consider grey-box testing with a provider like BreachLock, UnderDefense, or Kualitatem, as this approach typically offers the best value for money” Claude Haiku 4.5 · budget prompt · first choice

“likely to be a platform-based provider such as Cobalt or BreachLock, which offer more accessible pricing models” Llama 4 Maverick · budget prompt · first choice

“Astra or BreachLock (the ~$2,000–2,500 sweet spot)” DeepSeek V4 Flash · budget prompt · first choice

Also compared

Cobalt vs Astra Security Astra Security vs BreachLock The full ptaas standing

Comparisons are drawn for the top three products in each category. The output is the models' output; nothing here is a recommendation by the index.