Four of twelve models named Rapid7 InsightConnect first on the direct prompt; zero named Shuffle. Rapid7 InsightConnect was named by eleven of the twelve models and Shuffle by ten and Rapid7 InsightConnect carries 25 labels and Shuffle 10, so the shares are not directly comparable.
Named in one category this edition.
Named in one category this edition.
Share is the count of first choices across the direct, paraphrase, budget and scale prompts over all twelve models, for a mid-market B2B company; rank is within the category; every quote names the model and the prompt it came from. Both figures come from the SOAR platforms page.
Bold names in an answer are the products the judge labeled a first choice; a model naming several gives each of them that label. The full answer text for every row is in the record.
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Five of six in this category shown.
“the following SOAR platforms are mentioned as having drawbacks or being less desirable: 1. Rapid7 SOAR” Llama 4 Maverick · negative prompt · hard negative
“Be cautious with Rapid7 InsightConnect / Rapid7 SOAR ... it does indicate user dissatisfaction with those products” Perplexity Sonar · negative prompt · soft negative
“offering the most affordable entry point with a 30-day free trial for mid-market teams. It's purpose-built for mid-market security teams” Claude Haiku 4.5 · direct prompt · first choice
“Rapid7 InsightConnect and Tines are top choices due to their ease of use, low-code capabilities, and strong integration options.” Mistral Small · direct prompt · first choice
“Rapid7 InsightConnect if you're already on Rapid7 and want fastest time-to-value, or Tines if you want maximum flexibility” DeepSeek V4 Flash · direct prompt · first choice
Every negative label with a quote, up to three, then the highest-weighted positives, up to three. Three of four in this category shown.
“starting with an open-source platform like Cortex XSOAR Community Edition or Shuffle can be an excellent way” Claude Haiku 4.5 · budget prompt · first choice
“Shuffle (Best Overall for Budget-Conscious Teams)... start with Shuffle if you can self-host” Grok 4.1 Fast · budget prompt · first choice
“Tracecat and Shuffle are the top open-source SOAR platforms for small budgets” Mistral Small · budget prompt · first choice
Comparisons are drawn for the top three products in each category. The output is the models' output; nothing here is a recommendation by the index.