IT AI Index
Index Developer platform September 2026 Edition

Feature flags

Asked as “feature flag platform”, and as “feature management tool”, on behalf of a mid-market B2B company. 47 first choices recorded across the direct, paraphrase, budget and scale prompts, twelve models each.
Standing
Contested
30% of first choices, contested.

By buyer segment

The same question asked on behalf of a different buyer. Each standing is computed within its segment; they sit side by side and are never added together.

01The standing

Share is the count of first choices across the direct, paraphrase, budget and scale prompts, over all twelve models, for a mid-market B2B company. Ordered by share.
ProductFirst-choice shareNegative rateLabelsQuadrant
01LaunchDarkly30%31%61criticized challenger
02Flagsmith17%9%56accepted challenger
03ConfigCat17%11%36accepted challenger
04Unleash13%8%50accepted challenger
05Statsig9%7%42accepted challenger
06GrowthBook6%2%40accepted challenger
07PostHog6%12%24accepted challenger
Show the two products at 0%, ordered by negative rate
09Split0%30%33criticized challenger
08DevCycle0%0%10accepted challenger
Bars are the share of first choices, 0 to 100Every product with at least 10 labels here. Every product name links to its vendor page.

Recommended versus criticized

Every product with at least 10 labels here, on both axes. The 30% line names a quadrant, not the verdict above: that one needs more than 40%.

Criticized challengerCriticized default
Negative label rate →
01
02
03
04
05
06
07
08
09
Accepted challengerEndorsed leader
0%First-choice share → · lines at 30% share and 25% negative40%
Key
01LaunchDarkly30%
02Flagsmith17%
03ConfigCat17%
04Unleash13%
05Statsig9%
06GrowthBook6%
07PostHog6%
08DevCycle0%
09Split0%

02What they warned about

Two of twelve models held their first choice under the paraphrase. Claude Haiku 4.5, GPT-5.4 mini, Gemini 3.5 Flash, Mistral Small, DeepSeek V4 Flash, Llama 4 Maverick, Qwen 3.7 Flash, Kimi K2, GLM 4.7 FlashX and MiniMax M2.5 changed. A high negative share on a product with few labels is a warning. A low share on a product with many labels is salience, not sentiment.
LaunchDarkly
31%
19 of 61 labels negative · 10 of 12 models · 3 hard negative
“Caution level: High (especially for new adopters or scale-ups)... Avoid if... Microservices, startups, regulated industries, cost-sensitive” DeepSeek V4 Flash, negative prompt
Split
30%
10 of 33 labels negative · 6 of 12 models · 1 hard negative
“**Avoid for tight budgets**: LaunchDarkly/Split (free tiers cap quickly, then $10+/MAU or seats).” Grok 4.1 Fast, budget prompt
Flagsmith
9%
5 of 56 labels negative · 5 of 12 models · 1 hard negative
“Platforms with significant limitations or red flags ... **Flagsmith**: ... The free tier is very limited (50k requests/month)” Mistral Small, negative prompt
Unleash
8%
4 of 50 labels negative · 4 of 12 models · 2 hard negative
“its self-hosted version can be complex to set up and maintain ... Some users report scalability and performance issues at high traffic volumes” Mistral Small, negative prompt

03What they cite

Citations exist only for the models that return a source list: twelve of the twelve in this edition, and all six flagship models on the expanded tier.

Sites the answers cite

62 of 72 answers in this category came back with a source list, from 12 of 12 models: citations where the model returns them, or the search results it consulted. 6 of those lists are Google grounding redirects that name no site and are left out of the counts. 822 links across 157 sites, every framing counted. Ranked by the number of answers carrying the site or page.

vendor site · GrowthBook33 answers · 79 citations · 10 models
vendor site · Harness31 answers · 32 citations · 10 models
vendor site · Amplitude23 answers · 34 citations · 9 models
23 answers · 30 citations · 9 models
vendor site · LaunchDarkly20 answers · 28 citations · 9 models
vendor site · Statsig19 answers · 32 citations · 8 models
vendor site · Guideflow18 answers · 23 citations · 7 models
18 answers · 19 citations · 7 models
18 answers · 18 citations · 8 models
vendor site · ConfigCat17 answers · 28 citations · 9 models
vendor site · Flagsmith15 answers · 19 citations · 7 models
vendor site · Kameleoon15 answers · 17 citations · 9 models

Pages the answers cite

The ten pages named in the most answers, by full address. A page here is one the models returned with a recommendation, not one the index endorses.

04How they answered

Six framings of the same buying question, each sent to every model in a fresh session with search on. One row per model, so a row shows whether it held its answer under rewording, what it named when cost was the constraint, and what it argued against. Computed from the raw judge labels.
ModelDirect“What is the best feature flag platform for a mid-market B2B company?”Paraphrase“Which feature management tool would you recommend to a mid-sized B2B company?”Comparative“What are the top feature flag platforms and how do they differ?”Budget-constrained“What is the best feature flag platform for a company with a limited budget?”Scale-constrained“We are a 500 person company evaluating a feature flag platform. What should we look at?”Negative“Which feature flag platforms should I avoid or be cautious about?”
Claude Haiku 4.5Flagsmith, LaunchDarkly
One alternativeStatsig
FlagsmithChanged
Four alternativesConfigCat, GrowthBook, LaunchDarkly, PostHog
LaunchDarkly
Four alternativesFlagsmith, GrowthBook, PostHog Feature Flags, Statsig
Flagsmith, Unleash
Two alternativesLaunchDarkly, Statsig
no first choiceagainst: LaunchDarkly
GPT-5.4 miniConfigCat
Two alternativesFlagsmith, LaunchDarkly
LaunchDarklyChanged
One alternativeHarness FME
LaunchDarkly
Five alternativesConfigCat, Flagsmith, Split, Statsig, Unleash
Flagsmith, Unleashagainst: Firebase Remote Configno first choiceagainst: LaunchDarkly
Gemini 3.5 FlashFlagsmith
Four alternativesConfigCat, GrowthBook, PostHog, Schematic
against: LaunchDarkly
ConfigCatChanged
Four alternativesFlagsmith, GrowthBook, Schematic, Unleash
against: Harness FME, LaunchDarkly, Statsig
LaunchDarkly
Seven alternativesConfigCat, Flagsmith, GrowthBook, Harness FME, PostHog, Statsig, Unleash
PostHog
Three alternativesConfigCat, Flagsmith, GrowthBook
against: LaunchDarkly
LaunchDarkly
Three alternativesFlagsmith, GrowthBook, Unleash
against: Flagsmith, LaunchDarkly, Optimizely, Split, Unleash
Perplexity SonarLaunchDarkly
Four alternativesFlagsmith, GrowthBook, Statsig, Unleash
LaunchDarklyHeld
Three alternativesCloudBees Feature Management, GrowthBook, Unleash
no first choiceConfigCat, Flagsmith
Two alternativesGrowthBook, Statsig
no first choiceagainst: Flagsmith
Grok 4.1 FastLaunchDarkly
Four alternativesConfigCat, Flagsmith, Statsig, Unleash
LaunchDarklyHeld
Three alternativesFlagsmith, Statsig, Unleash
LaunchDarkly
Five alternativesConfigCat, Flagsmith, GrowthBook, Statsig, Unleash
against: Optimizely Feature Experimentation, Split
Unleash
Three alternativesFlagsmith, GrowthBook, Statsig
against: LaunchDarkly, Split
LaunchDarkly
Four alternativesFlagsmith, Harness, Statsig, Unleash
against: LaunchDarkly, PostHog, Split
Mistral SmallLaunchDarkly
Three alternativesFlagsmith, Statsig, Unleash
no first choiceChangedno first choiceConfigCat
Three alternativesDevCycle, Flagsmith, GrowthBook
no first choiceagainst: ConfigCat, Flagsmith, LaunchDarkly, Split, Unleash
DeepSeek V4 FlashGrowthBook
Four alternativesConfigCat, Flagsmith, Statsig, Unleash
against: LaunchDarkly
UnleashChanged
Two alternativesConfigCat, LaunchDarkly
against: Split
LaunchDarkly
Eight alternativesConfigCat, Flagsmith, GrowthBook, Harness, PostHog, Split, Statsig, Unleash
GrowthBook
Five alternativesConfigCat, Flagsmith, PostHog, Statsig, Unleash
no first choice
Five alternativesConfigCat, Flagsmith, GrowthBook, Statsig, Unleash
against: LaunchDarkly, Split
against: Amplitude, LaunchDarkly, Mixpanel, Split
Llama 4 MaverickLaunchDarklyKameleoonChanged
Three alternativesLaunchDarkly, Split, Swetrix
no first choice
Four alternativesConfigCat, GrowthBook, LaunchDarkly, Statsig
Flagsmith, GrowthBook, Statsig
One alternativeSupaship
no first choicenothing named
Qwen 3.7 FlashConfigCat
Three alternativesFlagsmith, Split, Unleash
against: LaunchDarkly
StatsigChanged
Two alternativesLaunchDarkly, Unleash
LaunchDarkly
Five alternativesConfigCat, Flagsmith, Split, Statsig, Unleash
against: Optimizely Feature Experimentation
Flagsmith, Unleash
Two alternativesConfigCat, PostHog
against: LaunchDarkly
no first choiceagainst: ConfigCat, Flagsmith, LaunchDarkly, Statsig, Unleash
Kimi K2ConfigCat, Statsigagainst: LaunchDarklyLaunchDarkly, UnleashChanged
Four alternativesConfigCat, Flagsmith, Split, Statsig
LaunchDarkly
Five alternativesFlagsmith, GrowthBook, PostHog, Statsig, Unleash
PostHog
Three alternativesFlagsmith, GrowthBook, Unleash
no first choiceagainst: ConfigCat, LaunchDarkly, PostHog, Split
GLM 4.7 FlashXLaunchDarkly
Four alternativesFlagsmith, GrowthBook, Split, Statsig
ConfigCatChanged
Three alternativesLaunchDarkly, Statsig, Unleash
LaunchDarkly, Statsig
Seven alternativesConfigCat, DevCycle, Flagsmith, GrowthBook, PostHog, Split, Unleash
against: Optimizely
Statsig
Four alternativesGrowthBook, LaunchDarkly, PostHog, Unleash
no first choiceagainst: ConfigCat, Flagsmith, GrowthBook, LaunchDarkly, Statsig, Unleash
MiniMax M2.5ConfigCat, LaunchDarkly
Two alternativesFlagsmith, GrowthBook
LaunchDarklyChanged
Two alternativesFlagsmith, Split
LaunchDarkly
Seven alternativesConfigCat, Flagsmith, GrowthBook, PostHog, Split, Statsig, Unleash
PostHog
Four alternativesFlagsmith, GrowthBook, Statsig, Unleash
no first choiceagainst: LaunchDarkly, PostHog, Split
Bold is the first choiceAlternatives are counted; the count opens them.What the answer argued against

05The record

One row per call: the version string exactly as returned, whether the model searched, sources cited, and latency. Full answer text is in the free responses file. Download the record
Seventy-two rows: every prompt, every model, every answer.
PromptModelVersion stringTime (UTC)SearchedSourcesLatency
Direct recommendationClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 09:58yes98 s
Direct recommendationGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 13:57yes47 s
Direct recommendationGemini 3.5 Flashgemini-3.5-flash2026-09-17 13:59yes1630 s
Direct recommendationPerplexity Sonarsonar2026-09-17 14:11yes205 s
Direct recommendationGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 13:20yes4118 s
Direct recommendationMistral Smallmistral/mistral-small via mistral2026-09-17 09:55yes54 s
Direct recommendationDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 09:49yes1820 s
Direct recommendationLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 13:53yes53 s
Direct recommendationQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 10:02no041 s
Direct recommendationKimi K2moonshotai/kimi-k2 via novita2026-09-17 14:07yes918 s
Direct recommendationGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 12:28yes10156 s
Direct recommendationMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 12:13yes919 s
ParaphraseClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 10:53yes198 s
ParaphraseGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 10:44yes25 s
ParaphraseGemini 3.5 Flashgemini-3.5-flash2026-09-17 13:23yes1023 s
ParaphrasePerplexity Sonarsonar2026-09-17 09:48yes204 s
ParaphraseGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 13:09yes1912 s
ParaphraseMistral Smallmistral/mistral-small via mistral2026-09-17 13:48no01 s
ParaphraseDeepSeek V4 Flashdeepseek/deepseek-v4-flash via deepinfra2026-09-17 13:59yes1939 s
ParaphraseLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 10:17yes53 s
ParaphraseQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 10:26yes1563 s
ParaphraseKimi K2moonshotai/kimi-k2 via novita2026-09-17 12:00yes1046 s
ParaphraseGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 11:33yes1889 s
ParaphraseMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 11:46yes523 s
ComparativeClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 12:45yes108 s
ComparativeGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 13:53yes1011 s
ComparativeGemini 3.5 Flashgemini-3.5-flash2026-09-17 13:55yes1623 s
ComparativePerplexity Sonarsonar2026-09-17 14:05yes207 s
ComparativeGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 14:12yes2417 s
ComparativeMistral Smallmistral/mistral-small via mistral2026-09-17 13:46yes913 s
ComparativeDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 13:43yes1622 s
ComparativeLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 11:02yes52 s
ComparativeQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 12:36yes528 s
ComparativeKimi K2moonshotai/kimi-k2 via novita2026-09-17 11:36yes939 s
ComparativeGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 09:40yes15178 s
ComparativeMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 12:52yes516 s
Budget constrainedClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 13:38no04 s
Budget constrainedGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 11:40no04 s
Budget constrainedGemini 3.5 Flashgemini-3.5-flash2026-09-17 10:27yes1420 s
Budget constrainedPerplexity Sonarsonar2026-09-17 10:31yes204 s
Budget constrainedGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 14:02yes4627 s
Budget constrainedMistral Smallmistral/mistral-small via mistral2026-09-17 13:24yes55 s
Budget constrainedDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 09:57yes1918 s
Budget constrainedLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 12:01yes53 s
Budget constrainedQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 11:23no033 s
Budget constrainedKimi K2moonshotai/kimi-k2 via novita2026-09-17 10:37yes1024 s
Budget constrainedGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 11:53yes958 s
Budget constrainedMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 09:48yes1530 s
Scale constrainedClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 13:00no08 s
Scale constrainedGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 14:13no020 s
Scale constrainedGemini 3.5 Flashgemini-3.5-flash2026-09-17 10:19yes939 s
Scale constrainedPerplexity Sonarsonar2026-09-17 10:21yes207 s
Scale constrainedGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 14:09yes1713 s
Scale constrainedMistral Smallmistral/mistral-small via mistral2026-09-17 10:17no010 s
Scale constrainedDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 13:25yes1823 s
Scale constrainedLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 12:21yes53 s
Scale constrainedQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 11:06yes1059 s
Scale constrainedKimi K2moonshotai/kimi-k2 via novita2026-09-17 10:33yes1023 s
Scale constrainedGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 10:44no022 s
Scale constrainedMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 10:04no012 s
Negative framingClaude Haiku 4.5claude-haiku-4-5-202510012026-09-17 13:18yes2711 s
Negative framingGPT-5.4 minigpt-5.4-mini-2026-03-172026-09-17 12:52yes56 s
Negative framingGemini 3.5 Flashgemini-3.5-flash2026-09-17 10:39yes2032 s
Negative framingPerplexity Sonarsonar2026-09-17 14:11yes199 s
Negative framingGrok 4.1 Fastspacexai/grok-4.1-fast-non-reasoning via vertex2026-09-17 13:52yes4118 s
Negative framingMistral Smallmistral/mistral-small via mistral2026-09-17 11:42yes57 s
Negative framingDeepSeek V4 Flashdeepseek/deepseek-v4-flash via fireworks2026-09-17 10:47yes2938 s
Negative framingLlama 4 Maverickmeta/llama-4-maverick via bedrock2026-09-17 12:33yes84 s
Negative framingQwen 3.7 Flashalibaba/qwen3.7-flash via alibaba2026-09-17 11:00yes2380 s
Negative framingKimi K2moonshotai/kimi-k2 via novita2026-09-17 09:39yes2933 s
Negative framingGLM 4.7 FlashXzai/glm-4.7-flashx via zai2026-09-17 13:54yes1467 s
Negative framingMiniMax M2.5minimax/minimax-m2.5 via minimax2026-09-17 12:33yes2362 s

Normalization in this category

Every judgment call made between the raw labels and the numbers above, listed so it is visible and reversible.

Category-scoped readings
None. Every name in this category resolved on its own.
Unresolved, counted raw
GO Feature Flag
Hypertune
Supaship
Swetrix
Discontinued, still offered
No shut-down product was recommended here.
← Error monitoringSCA →