AI Indexes
IT AI Index
Index › Products › LangSmith · October 2026 Edition
1 category · Named, not ranked

LangSmith

17Judge labels
4First choices
3Negative labels
10 / 14Models named it
1Category
October 2026 Edition. Every number here is derived from the raw labels under vendor table v2026-10.8, every buyer segment counted.
Standing
7 labels, too few to rank
A product needs 10 labels in a category before a share or quadrant is stated. LangSmith was named 7 times in LLM gateways, where LiteLLM led with 31%. The labels and the evidence are below, counted exactly.
By buyer segmentRead the same way at every buyer size.
In llm gateways · each standing computed within its segment · bars are 0 to 100 · the accent bar is the product's own best reading

Standing by category

Every category where a model named LangSmith for a mid-market B2B company. Share is first choices across the direct, paraphrase, budget and scale prompts; rank is within every product named in that category.
CategoryFunctionShareRankNegative rateLabelsQuadrantSince September 2026
LLM gateways and observabilityData platform2%11 of 6929%7under 10 labels · led by LiteLLM at 31%▲+2Since September 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.

Movement

Since September 2026, LangSmith held within the floor in its one category: no change cleared 11 points.

Best category · LLM gateways · by segment

Small business▲+2Since September 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.
2%from 0% in September 2026
Inside the floor by 9 pointsRank 11 → 7 of 51
Mid-market▲+2Since September 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.
2%from 0% in September 2026
Inside the floor by 9 pointsRank 29 → 10 of 54
Enterprise▲+2Since September 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.
2%from 0% in September 2026
Inside the floor by 9 pointsRank 15 → 9 of 75

All categories · Mid-market

CategorySeptember 2026NowChangeReadingRank
LLM gateways0%2%▲+2Since September 2026: 0% → 2%, +2 points. Inside the 11-point floor: within noise. Read over the models both editions asked.Within noiseRank 29 → 11 of 69

Shares here are read over the models both editions asked, so they can differ by a point or two from the standing above, which counts every model in this edition.

The floor is 11 points of share, measured: how far the models move a leader on their own when the same questions are asked twice with nothing changed. A larger change is movement; a smaller one is noise, and both are shown. Movement is read over the twelve models both editions asked; GPT-6 Luna, Muse Glimmer 30B joined this edition and are in the standing but not yet in the comparison. How the floor is measured · The editions

By model

How each model treated LangSmith across every prompt where it was named for a mid-market B2B company. Fourteen models, six prompts per category.
ShowHide
ModelFirst choiceAlternativeMentionNegativeLabels
Claude Haiku 4.500000
GPT-5.4 mini10001
Gemini 3.5 Flash00000
Perplexity Sonar00000
Grok 4.2001001
Mistral Small00000
DeepSeek V4 Flash00011
Llama 4 Maverick00101
Qwen 3.7 Flash01102
Kimi K200011
GLM 4.7 FlashX00000
MiniMax M2.500000
GPT-6 Luna00000
Muse Glimmer 30B00000

By framing

Which of the six questions produced the naming. By model says how often; this says asked what. The first-choice count on the right carries the marks of the models that produced it.
FramingLabels by classFirst choices
Direct0 labelsNone
Paraphrase15 labels4
Comparative0 labelsNone
Budget-constrained1 labelNone
Scale-constrained1 labelNone
Negative0 labelsNone
First choiceAlternativeMentionNegative17 labels in all, every segment counted; 4 of the 4 first choices count toward share, since the comparative and negative framings do not. The bar is one segment per label class, to scale within the framing.

What the models said for it

Verbatim evidence the judge attached to positive labels.

“I'd pick LangSmith as the observability layer” GPT-5.4 mini · LLM gateways · paraphrase prompt · first choice
“Heavy LangChain use: LangSmith (seamless evals/monitoring). ... Routing not as native/built-in.” Grok 4.20 · LLM gateways · paraphrase prompt · alternative
“LangSmith is the industry standard... Downside: Tightly coupled with the LangChain ecosystem.” Qwen 3.7 Flash · LLM gateways · paraphrase prompt · alternative

And against it

Verbatim evidence attached to negative labels. A warning on a product with few labels is a warning; on a product with many, it is one voice among them.

“What I'd avoid for your use case ... LangSmith \u2014 Proprietary, tightly coupled to LangChain, and expensive at scale” DeepSeek V4 Flash · LLM gateways · paraphrase prompt · hard negative
“$39/seat/month adds up quickly for teams” Kimi K2 · LLM gateways · paraphrase prompt · hard negative

Named alongside

The products named in the same answers as LangSmith, over the 17 answers that named it. Took the first choice instead counts the answers where the other product was the first choice and LangSmith was named but was not.
ShowHide
ProductSame answerTook the first choice insteadHead to head
Portkey14 of 175Not among the top eight
Helicone11 of 172Not among the top eight
Langfuse11 of 170Not among the top eight
LiteLLM8 of 171Not among the top eight
Arize Phoenix5 of 171Not among the top eight
Datadog LLM Observability4 of 170Not among the top eight
Arize AI3 of 171Not among the top eight
OpenRouter3 of 171Not among the top eight
Braintrust Gateway3 of 170Not among the top eight
Arize AX2 of 171Not among the top eight
A head-to-head page exists where both products are among a category's top eight. The other rows are the same fact without a page behind them, so they link to the product instead.

What carried it into the answer

The sites and pages cited by the answers that named LangSmith. A fact about retrieval, not a lever on the model.

Citations exist only for the models that return a source list, five of the fourteen in this edition, so these counts come from 14 of the 17 answers that named LangSmith and are not a share of its labels.

Domains cited

helicone.ai8
langchain.comYour site8
portkey.ai8
firecrawl.dev6
respan.ai6
braintrust.dev5
confident-ai.com4
it-ai-index.com4
signoz.io4
theairankings.com4

Forty-nine of the fifty-seven domain citations in answers naming LangSmith came from somebody else's page.

Pages cited

Pages are listed as the models cited them.

Search and answers

langchain.com is not in Google's top ten for any of the category's searches. In the answers, LangSmith takes 2% of first choices and LiteLLM takes 31%.
ShowHide

In search

Google, US estimates
Position for “llm gateway”
–
not in the top ten
Position for “llm gateways”
–
not in the top ten
Searches for its name, Google
14,800 a month (“langsmith”)
AI search demand for its name, est.
238 a month
Organic visits to its site
about 93,424 a month
Searches its site ranks for
11,133 · 1,391 in the top three
Sites linking to it
22,184
Paid Google search
No ads found in the estimate; that does not mean it runs none
Ads on GoogleDetailLess
120+ ads · 107 text, 13 video · 94 shown in the last 30 days

First shown February 2026, as LangChain Inc., verified. Ads started 2025-10 to 2026-09: 120 in the year.

On Google's pages: 1 2 3 4

In answers

This edition
Share of first choices
2%
rank 11 of 69 in LLM gateways
Segment leader
31%
LiteLLM
First choices
4 across its categories
Named in
17 answers
Its own site cited
in 14 of the answers that named it

Search figures are US estimates from DataForSEO, read September 28, 2026; AI search demand is its modeled, directional estimate, not a count of queries to any assistant. The answers are this edition's. Two measurements side by side: neither is read as the cause of the other.

What it publishes

ShowHide
Addresses on langchain.com
2,287
subdomains included
Content
665
counted in the table below
Documentation
1,565
Product · Integration
0 · 0
KindPagesLast 90 days2025-10 to 2026-09LatestCategories named
Blog5591382026-09-28LLM gateways, Object storage
Glossary or explainer3332026-09-07
Webinar or virtual event1762026-09-22
Case study14undated
Template or tool1402026-03-27
Conference or event1212026-08-26
Comparison1222026-09-10
Report or ebook2undated
Podcast or video202026-06-25
How it is countedHide how it is counted

Every page langchain.com exposes, subdomains included. Kind is read from the address and title. The last 90 days, the latest date and the twelve months count pages by when they were published, from the site's feeds, a date in the address, or the page's own publication date, read from up to a hundred of its most recently changed pages; a page that says only when it last changed is counted in its kind but not in when, so the recent counts are a floor, and a kind none of whose pages gives a publication date reads undated. An event counts as online when its address or title says so (webinar, on demand, virtual or online summit); a conference, summit, trade show, expo or roadshow that does not say so is counted as a conference or event, which on a vendor's site is mostly in person. Read September 29, 2026.

Names read as LangSmith

What the judge wrote, as written, with how often. The vendor table decides that these count as LangSmith; a claim can dispute any of them.
LangSmith (by LangChain) 1

Follow LangSmith

An email the morning each edition publishes: where this product moved, where it held, and by how much against the noise floor. One address, confirmed by a click; a stop link in every email.

Already following? Everything you follow, with a stop for each.

The company

LangSmith is its own company.
ShowHide

In its own words

Stated by the vendor, not checked
Positioning
the agent engineering platform
For
companies
Price stated
Developer: $0 / seat per month then pay as you go; Plus: $39 / seat per month then pay as you go; Enterprise: Custom pricing then pay as you go langchain.com/pricing
Starting price
$0 / seat per month langchain.com/pricing
Free plan or trial
Developer plan; Start for free langchain.com/pricing
Hosting
US or EU
Customers named
KlarnaMonday ServicePodiumC.H. RobinsonServiceNowNVIDIAMorningstarCisco
Not stated on the pages read
Integrations, certifications

What LangSmith's own pages state, read September 28, 2026: langchain.com, langchain.com/pricing, trust.langchain.com, langchain.com/customers. A claimed page can correct any of them.

Is this your product?

Claim this page

Claiming is free and changes nothing in the data. A claimed page shows a verified contact who is told when each edition publishes and when LangSmith's standing changes by more than the noise floor; the right to propose corrections to the vendor table, meaning names the judge wrote that should or should not read as LangSmith, applied by version and listed in the change log; and a one-line description supplied by the vendor and marked as such.

What a new claim receivesHide what a new claim receives

A new claim receives the current edition's vendor brief for LangSmith by email, built from the raw record of the edition. It shows:

  • where LangSmith is named, by buyer and by framing, and which cells hold its first choices;
  • the claims the models make when they name it, ranked, with the strongest and the weakest quoted;
  • its vocabulary against the segment leader's, and the pages the models cited;
  • who was chosen in the answers that did not name LangSmith, and every reason the record gives;
  • a battlecard for each top rival: the head-to-head split, why they win, and the reservation quoted against them;
  • one page of published figures cleared to show a buyer.
The subscriber app

A verification link goes to your work email; an address at langchain.com is approved on the spot, any other is reviewed by hand. Your email is never published. Claiming gives no say over labels, shares, verdicts or which quotes appear.