Arvind Jain
Frontier Insights
Frontier Thesis: LLMs are commoditizing into interchangeable infrastructure as open-source achieves parity for 90%+ of enterprise workloads. Front-line ROI belongs not to frontier model providers, but to the application layer governing proprietary enterprise context, workflows, and execution.
Strategic Decisions: Glean is expanding beyond enterprise search into autonomous agents, leveraging deep SaaS APIs, authoritative information filtering, and multi-model routing to automate core workflows and capture service-labor spend.
Risks & Warnings: Value capture is threatened by unreliable agents, brittle governance, complex permission indexing exposing data vulnerabilities, and the friction of human behavioral adoption.
Key Views & Dialogues
Why OpenAI and Anthropic Won’t Win the App Layer | Glean Founder
Open-source models now handle 90%+ of enterprise use cases, with GLM 5.2 within 3 months of frontier capability and trusted for most of Glean’s workloads. That cost advantage could shift most enterprise workloads open within 3 years, while falling token prices and consumption pricing pressure frontier labs and Microsoft’s bundling.
View summary (7)
- Open source just hit its enterprise inflection. Arvind Jain says 90%+ of enterprise use cases can now be fully handled by many models including open source, and GLM 5.2 — arriving within 3 months of frontier capability, “literally a month back” — is the first open model Glean’s own team trusts with “majority of our workloads.” His call: majority of enterprise workloads run on open source within 3 years “for sure,” and the only gate is comfort with Chinese models — “it’s not open source versus closed source.”
- The frontier model business may be mispriced. Standalone, it’s “probably not as lucrative as everybody believes”: fierce competition even in a three-way lab race plus open source at “an order of magnitude” cheaper, and Jain has “heard rumors that OpenAI was going to drastically reduce their model prices.” Meanwhile every model bizarrely raised per-token prices in the last 6-9 months; Stebbings’ jab — “they needed to prove that they were good businesses before they went public” — and his warning that if AI gets much cheaper, these loss-making labs “which prop up our entire global economy” are very threatened.
- The labs’ app-layer push is shallow. Anthropic’s vertical packs (Figma, legal, finance) are “quite shallow” — net-new usage that expands the market, not workload displacement — while enterprises are “terrified” of operational dependence: institutional learning accumulates inside the agent doing the work, so enterprises need control of the agent and its compounding learnings. Jain’s advice to founders: treat the labs as “a huge asset, not a competition.”
- Jain argues teams should get bigger — the episode’s sharpest disagreement. Glean is 1,000+ people and Jain wants 5,000 in five years: with symmetric AI access, the competitor that keeps headcount ships a 10x better product and “they’re going to beat you.” On the labor-versus-tokens framing, Jain says technology costs should fall: “we’ve not put technology cost and labor cost in the same sentence ever before… this is not how technology works” — inference costs will fall by orders of magnitude.
- AI ROI is a throughput problem, not a model problem. Nearly 100% of Glean’s code is AI-written, yet across companies “the actual shipping speed of products has not increased.” His triage agent resolves 95% of production issues for a 15-person on-call team — at $1M/month, a cost he questioned against the humans. Advanced use cases sit with only ~5% of employees; the fix is investing in context rather than letting models “brute force their way” through raw MCP connections.
- Consumption pricing can break bundling. Microsoft is a significant competitor today (“hard to compete with free”), but “once you move towards consumption, there’s no inherent bundling advantage” — enterprises pay per unit of work wherever users choose to do it, weakening the Copilot lock-in argument Stebbings pushed.
- China has the leading open models; the US is playing catch-up. On OpenRouter the top six models by usage are Chinese, with Anthropic the first US entry at seventh; Jain says China is the only country producing models outside the US, while Stebbings mentions perhaps a little activity in France. Jain’s explanation: model training needs upfront capital that skunkworks open source can’t fund. The US needs to build its own open models, with Nvidia among the motivated funders.
Arvind Jain on building Glean and the future of enterprise AI
Glean’s early BERT-based enterprise-search bet became a generative-AI wedge, combining customer-specific retrieval and permissions-aware indexing with GPT, Gemini, or Claude for synthesis and reasoning. The strongest ROI signal is reasoning across unstructured data, but stale or missing knowledge and retrieval failures remain larger risks than hallucinations as Glean expands toward an AI operating layer for every employee.
View summary (7)
Glean’s founding thesis was enterprise search, but its early transformer bet made the 2019 product unusually well positioned for generative AI. Arvind Jain began with a universal pain point—research suggested employees spend one-third of their working time finding information—and used BERT-based models to match concepts rather than keywords. As generation and reasoning improved, Glean evolved from “a Google for you in your work life” into “ChatGPT for work life.”
Glean uses frontier models where broad capabilities already exist while building enterprise-specific retrieval. It trains small models on a customer’s corpus for custom embeddings, and separately fine-tunes small open-domain models for narrow search tasks such as spell-checking, synonym handling, and acronym expansion. It uses GPT, Gemini, or Claude for synthesis and multi-step reasoning. Jain’s rule is blunt: “Do not reinvent things that have been invented already.”
Permissions and data freshness—not merely model quality—are the central enterprise-AI constraints. Glean imports governance from systems including Google Drive, Slack, and Salesforce, bakes permissions into its index, and retrieves only documents the signed-in user may access. Because embeddings themselves might leak restricted information, customer-specific models are trained only on subsets Glean judges safe.
Jain’s repeat-founder pattern is a contrarian bet on universal problems in markets others have abandoned. Lukas Biewald pressed him on whether Rubrik and Glean reflected exceptional execution rather than novel ideas; Jain agreed enterprise search had produced “only failures” and become a “dead area” where investors did not want to invest. His conviction came from two changes: SaaS made fragmented data much worse but also more accessible, while transformers made semantic understanding technically viable. His Google-derived operating model is to put innovation first, hire smart engineers, and largely let them build.
A concrete ROI example comes from reasoning across the 95% of enterprise data that is unstructured. A non-engineer in Glean’s finance team asked an agent to combine Salesforce customer lists, shared Slack sentiment, and product usage into green/yellow/red account-risk profiles after churn appeared. Jain says the result was better than a conventional dashboard because it could incorporate subjective textual evidence.
Glean evaluates the complete answer pipeline, while conceding that enterprise AI cannot eliminate errors. It derives “golden” question-answer sets from real interactions such as well-received Slack replies, tests retrieval and model changes against them, and uses LLMs as judges. For hallucinations, it checks answers “line by line” against supplied source material and may suppress unsupported claims or abstain—but Jain says stale, missing, or poorly retrieved knowledge causes more failures than fabrication alone.
Jain rejects labor reduction as the most valuable AI strategy and instead wants every employee surrounded by a scalable “dream team.” He imagines assistants, coworkers, and coaches helping each person do up to 90% of the work they need to do, while companies retain and even expand teams whose members can do “ten times more work.” The transformation may feel incremental—one task at a time—until workers discover they are fundamentally different from two years earlier.