IT AI Index
Index Security operations September 2026 Edition

Compliance automation

Asked as “compliance automation platform”, and as “SOC 2 and ISO 27001 automation tool”, on behalf of a mid-market B2B company. 52 first choices recorded across the direct, paraphrase, budget and scale prompts, twelve models each.
Standing
Contested
37% of first choices, contested.

By buyer segment

The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.

01The standing

Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all twelve models, for a mid-market B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrant
01Drata37%25%59criticized default
02Vanta23%25%59criticized challenger
03Sprinto8%11%38accepted challenger
04Secureframe4%17%53accepted challenger
Show the five products at 0%, ordered by negative rate
09OneTrust0%40%10criticized challenger
08AuditBoard0%18%11accepted challenger
05Hyperproof0%14%22accepted challenger
06Scytale0%8%13accepted challenger
07Thoropass0%8%13accepted challenger
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its vendor page.

Recommended versus criticized

Every product with at least 10 labels here, on both axes. The 30% line names a quadrant, not the verdict above: that one needs more than 40%.

Criticized challengerCriticized default
Negative label rate →
01
02
03
04
05
06
07
08
09
Accepted challengerEndorsed leader
0%First-choice share → · lines at 30% share and 25% negative50%
Key
01Drata37%
02Vanta23%
03Sprinto8%
04Secureframe4%
05Hyperproof0%
06Scytale0%
07Thoropass0%
08AuditBoard0%
09OneTrust0%

02What they warned about

Three of twelve models held their first choice under the paraphrase. Claude Haiku 4.5, GPT-5.4 mini, Perplexity Sonar, Grok 4.1 Fast, DeepSeek V4 Flash, Llama 4 Maverick, Qwen 3.7 Flash, GLM 4.7 FlashX and MiniMax M2.5 changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
Drata
25%
15 of 59 labels negative · 9 of 12 models · 2 hard negative
“**Avoid**: Enterprise tools like Vanta/Drata (higher cost, sales-led pricing).” Grok 4.1 Fast, budget prompt
Vanta
25%
15 of 59 labels negative · 9 of 12 models · 2 hard negative
“**Avoid**: Enterprise tools like Vanta/Drata (higher cost, sales-led pricing).” Grok 4.1 Fast, budget prompt
Secureframe
17%
9 of 53 labels negative · 7 of 12 models
“frequently cited as platforms to **be cautious about** rather than outright avoid, specifically regarding long-term cost and vendor lock-in” Qwen 3.7 Flash, negative prompt
OneTrust
40%
4 of 10 labels negative · 4 of 12 models · 1 hard negative
“**Verdict:** Avoid unless you truly have thousands of employees and a dedicated GRC team.” DeepSeek V4 Flash, negative prompt

03What they cite

Citations exist only for the models that return a source list: twelve of the twelve in this edition, and all six flagship models on the expanded tier.

Sites the answers cite

66 of 72 answers in this category came back with a source list, from 12 of 12 models: citations where the model returns them, or the search results it consulted. 6 of those lists are Google grounding redirects that name no site and are left out of the counts. 935 links across 228 sites, every framing counted. Ranked by the number of answers carrying the site or page.

31 answers · 40 citations · 10 models
vendor site · Vanta30 answers · 44 citations · 11 models
vendor site · Optro25 answers · 25 citations · 10 models
vendor site · Expert Insights23 answers · 30 citations · 9 models
vendor site · Netwrix22 answers · 23 citations · 10 models
vendor site · Sprinto19 answers · 30 citations · 7 models
18 answers · 24 citations · 8 models
vendor site · Consilien18 answers · 18 citations · 8 models
vendor site · Cynomi17 answers · 19 citations · 8 models
vendor site · ComplyJet16 answers · 28 citations · 10 models
11 answers · 19 citations · 6 models
vendor site · Ciphrix11 answers · 11 citations · 9 models

Pages the answers cite

The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.

04How they answered

Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ModelDirect“What is the best compliance automation platform for a mid-market B2B company?”Paraphrase“Which SOC 2 and ISO 27001 automation tool would you recommend to a mid-sized B2B company?”Comparative“What are the top compliance automation platforms and how do they differ?”Budget-constrained“What is the best compliance automation platform for a company with a limited budget?”Scale-constrained“We are a 500 person company evaluating a compliance automation platform. What should we look at?”Negative“Which compliance automation platforms should I avoid or be cautious about?”
Claude Haiku 4.5Drata, Vanta
Four alternativesHyperproof, Secureframe, Sprinto, Thoropass
DrataChanged
Two alternativesSecureframe, Sprinto
Vanta
Five alternativesCynomi, Drata, Optro, Orbiq, Secureframe
against: Hyperproof
Sprinto
Two alternativesScrut, Secureframe
no first choiceagainst: Archer, ISMS.online, OneTrust
GPT-5.4 miniVanta
Two alternativesDrata, Secureframe
DrataChanged
Two alternativesSecureframe, Vanta
Drata, Vanta
Four alternativesAuditBoard, Hyperproof, OneTrust, Secureframe
Drata, Vanta
Two alternativesSecureframe, Sprinto
no first choicenothing named
Gemini 3.5 FlashDrata
Three alternativesHyperproof, Secureframe, Vanta
DrataHeld
Three alternativesHyperproof, Secureframe, Vanta
Drata, Vanta
Five alternativesAuditBoard, Cynomi, LogicGate Risk Cloud, Secureframe, Sprinto
Scrut Automation
Two alternativesScytale, Sprinto
against: Drata, Vanta
Drata, Vanta
Two alternativesSecureframe, Thoropass
against: AuditBoard, LogicGate
against: Delve, Drata, Vanta
Perplexity SonarVanta
Four alternativesDrata, Hyperproof, Secureframe, SureCloud
DrataChanged
One alternativeVanta
no first choiceSprinto
Two alternativesCATAAM, LowerPlane
against: Drata, Vanta
no first choicenothing named
Grok 4.1 FastDrata, Vanta
Three alternativesScrut Automation, Secureframe, Sprinto
DrataChanged
One alternativeVanta
against: Hyperproof, Secureframe, Sprinto
no first choiceLowerPlane
Three alternativesCATAAM, ComplyJet, Strike Graph
against: Drata, Vanta
no first choiceagainst: Drata, Hyperproof, Secureframe, Vanta
Mistral SmallDrata
Two alternativesSecureframe, Vanta
DrataHeld
Three alternativesSecureframe, Sprinto, Vanta
Scytale
Five alternativesDrata, Hyperproof, Mitratech Alyne, ServiceNow Integrated Risk Management, Strike Graph
CATAAM
One alternativeLowerPlane
against: Drata, Secureframe, Vanta
no first choiceagainst: Drata, Scrut, Scytale, Secureframe, Sprinto, Thoropass, Vanta
DeepSeek V4 FlashDrata
Two alternativesSecureframe, Vanta
against: Scrut, Sprinto
SecureframeChanged
Two alternativesDrata, Vanta
Vanta
Five alternativesDrata, OneTrust, Secureframe, ServiceNow Integrated Risk Management, Sprinto
against: Archer
OneTrust Certification Automation
Four alternativesComplyJet, SecureSlate, Secureframe, Sprinto
against: Drata, Vanta
Vanta
Three alternativesDrata, Orbiq, Secureframe
against: Archer, Drata, MetricStream, OneTrust, Secureframe, Sprinto, Vanta
Llama 4 MaverickVanta
Two alternativesDrata, Secureframe
SecureframeChanged
Four alternativesHyperproof, Mitratech Alyne, Optro, Vanta
no first choice
Six alternativesApptega, Archer Regulatory and Corporate Compliance, Drata, Hyperproof, Mitratech Alyne, OneTrust Certification Automation
CATAAM, Ciphrix, LowerPlane, Sprintono first choicenothing named
Qwen 3.7 FlashDrata, Vanta
Four alternativesLogicGate, Orbiq, Secureframe, SureCloud
VantaChanged
One alternativeDrata
Drata, Vanta
Five alternativesAuditBoard, Hyperproof, OneTrust, Secureframe, ServiceNow Integrated Risk Management
CATAAM, Scrut Automation
One alternativeScytale
against: Drata, Vanta
no first choice
Eight alternativesAuditBoard, Diligent, Drata, LogicManager, OneTrust, Secureframe, Vanta, WardenAI
against: Archer, ServiceNow Integrated Risk Management
against: Compliance Quest, Complyance, Drata, Kaseya's Compliance Manager, MyComplianceOffice, Secureframe, Vanta
Kimi K2Drata
Three alternativesSecureframe, Sprinto, Vanta
DrataHeld
Three alternativesSecureframe, Sprinto, Vanta
Vanta
Seven alternativesAuditBoard, Drata, Hyperproof, LogicGate Risk Cloud, OneTrust, Secureframe, Sprinto
SecureSlate, Sprinto
Three alternativesComp AI, Scrut, Scytale
against: Drata, Vanta
no first choiceagainst: Delve, Drata, Secureframe, Vanta
GLM 4.7 FlashXDrata, Vanta
Three alternativesHyperproof, Orbiq, Secureframe
against: AuditBoard, MetricStream, OneTrust, ServiceNow Integrated Risk Management
DrataChanged
Three alternativesComplyJet, Sprinto, Vanta
no first choiceLowerPlane, RealCISO
Four alternativesBright Defense Sentry, Ethicontrol, SimpleRisk, Sprinto
Strac Comply
Four alternativesDrata, Hyperproof, Secureframe, Vanta
against: Drata, Secureframe, Vanta
MiniMax M2.5Drata
Two alternativesOrbiq, Vanta
VantaChanged
Three alternativesCentraleyes, Drata, Secureframe
Vanta
Four alternativesDrata, Hyperproof, OneTrust Certification Automation, Secureframe
Complies.ai, SecureSlate
Three alternativesHiComply, Sprinto, Strike Graph
against: Drata, OneTrust, Secureframe, Vanta
no first choicenothing named
Bold is the first choiceAlternatives are counted; the count opens them.What the answer argued against

05The record

One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency. Full answer text is in the free responses file. Download the record
Seventy-two rows: every prompt, every model, every answer.
PromptModelVersion stringTime (UTC)SearchedSourcesLatency
Direct recommendationClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 08:33yes97 s
Direct recommendationGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 08:54yes46 s
Direct recommendationGemini 3.5 Flashgemini-3.5-flash2026-09-17 08:42yes2023 s
Direct recommendationPerplexity Sonarsonar2026-09-17 09:03yes207 s
Direct recommendationGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 08:41yes3217 s
Direct recommendationMistral Smallmistral/mistral-small via mistral2026-09-17 08:21yes56 s
Direct recommendationDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 08:22yes1514 s
Direct recommendationLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 08:55yes53 s
Direct recommendationQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 08:36yes528 s
Direct recommendationKimi K2moonshotai/kimi-k2 via novita2026-09-17 08:56yes1543 s
Direct recommendationGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 09:11yes1452 s
Direct recommendationMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 08:43yes926 s
ParaphraseClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 08:38yes149 s
ParaphraseGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 08:23yes44 s
ParaphraseGemini 3.5 Flashgemini-3.5-flash2026-09-17 08:42yes1423 s
ParaphrasePerplexity Sonarsonar2026-09-17 09:12yes206 s
ParaphraseGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 09:09yes4118 s
ParaphraseMistral Smallmistral/mistral-small via mistral2026-09-17 08:53yes55 s
ParaphraseDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 08:31yes1012 s
ParaphraseLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 08:53yes53 s
ParaphraseQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 08:40yes1049 s
ParaphraseKimi K2moonshotai/kimi-k2 via novita2026-09-17 08:22yes1525 s
ParaphraseGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 08:21yes2051 s
ParaphraseMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 08:19yes542 s
ComparativeClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 09:11yes1615 s
ComparativeGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 08:22yes69 s
ComparativeGemini 3.5 Flashgemini-3.5-flash2026-09-17 08:32yes2722 s
ComparativePerplexity Sonarsonar2026-09-17 08:17yes2010 s
ComparativeGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 08:51yes2514 s
ComparativeMistral Smallmistral/mistral-small via mistral2026-09-17 08:43yes811 s
ComparativeDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 08:21yes2828 s
ComparativeLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 08:54yes54 s
ComparativeQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 09:11no044 s
ComparativeKimi K2moonshotai/kimi-k2 via novita2026-09-17 08:45yes1875 s
ComparativeGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 08:27yes20109 s
ComparativeMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 09:04yes2340 s
Budget constrainedClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 08:54yes178 s
Budget constrainedGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 08:29no04 s
Budget constrainedGemini 3.5 Flashgemini-3.5-flash2026-09-17 08:56yes1319 s
Budget constrainedPerplexity Sonarsonar2026-09-17 08:56yes2013 s
Budget constrainedGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 09:05yes3814 s
Budget constrainedMistral Smallmistral/mistral-small via mistral2026-09-17 08:42yes53 s
Budget constrainedDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 08:26yes1314 s
Budget constrainedLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 08:47yes53 s
Budget constrainedQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 08:20yes2465 s
Budget constrainedKimi K2moonshotai/kimi-k2 via novita2026-09-17 08:48yes13146 s
Budget constrainedGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 08:50yes35178 s
Budget constrainedMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 08:23yes825 s
Scale constrainedClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 09:05no06 s
Scale constrainedGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 09:01no09 s
Scale constrainedGemini 3.5 Flashgemini-3.5-flash2026-09-17 09:11yes1326 s
Scale constrainedPerplexity Sonarsonar2026-09-17 08:57yes207 s
Scale constrainedGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 09:06yes189 s
Scale constrainedMistral Smallmistral/mistral-small via mistral2026-09-17 08:57no02 s
Scale constrainedDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 08:52yes2525 s
Scale constrainedLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 08:42yes52 s
Scale constrainedQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 08:42no038 s
Scale constrainedKimi K2moonshotai/kimi-k2 via novita2026-09-17 08:46yes1563 s
Scale constrainedGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 08:38yes1846 s
Scale constrainedMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 08:51yes516 s
Negative framingClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 08:44yes178 s
Negative framingGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 08:43yes27 s
Negative framingGemini 3.5 Flashgemini-3.5-flash2026-09-17 08:22yes2529 s
Negative framingPerplexity Sonarsonar2026-09-17 09:11yes206 s
Negative framingGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 08:51yes4517 s
Negative framingMistral Smallmistral/mistral-small via mistral2026-09-17 09:07yes58 s
Negative framingDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 08:58yes2929 s
Negative framingLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 08:51yes93 s
Negative framingQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 08:52yes1047 s
Negative framingKimi K2moonshotai/kimi-k2 via novita2026-09-17 08:47yes2941 s
Negative framingGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 08:55yes2956 s
Negative framingMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 08:45yes519 s

Normalization in this category

Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.

Category-scoped readings
None. Every name in this category resolved on its own.
Unresolved, counted raw
Archer Regulatory and Corporate Compliance
Bright Defense Sentry
Compliance Quest
Kaseya's Compliance Manager
MyComplianceOffice
SAIGlobal
WardenAI
Discontinued, still offered
No shut-down product was recommended here.
← ASMDLP →