Researchers
2 Curated Dialogues
Ion Stoica
Key Views & Dialogues
The Only Moat for AI Labs Is Capital | A Conversation with Databricks Co-Founder and Berkeley Professor Ion Stoica (English Interview)
Stoica sees capital and revenue, not technology, as the demonstrated moat at leading AI labs, with model rankings shifting roughly every two months. Vercel routing reportedly shifted from about 70% proprietary to about 70% open-source, though figures are uncertain; GPU scarcity and training across tens of trillions of tokens highlight post-training and data-movement opportunities.
View summary (6)
- Ion Stoica argues that capital is the leading moat at top AI labs, the one that has been demonstrated so far; capital and revenue together make a strong moat, while no technical moat is yet visible. Rankings shift about every 2 months: Gemini was widely seen as the strongest model at the end of last year, followed by Claude in the months after; he also says Opus 5.5 is very good at coding. Capital can attract talent, but he thinks it explains competition among labs better than talent does.
- Open-source models can win market share without catching up to the frontier because “every task has a threshold.” Stoica compares it to driving: if the task is getting from Santa Clara to San Francisco, a car that does 100 miles per hour is enough; a car that can go 300 miles is beside the point. He cites Vercel routing data showing that a few months ago about 70% of traffic went to proprietary models, while now about 70% goes to open-source models; he says he does not remember the exact figures.
- The opportunities for AI infra startups lie in emerging workloads: post-training, multimodal data, robotics stacks, and moving data across clusters. Post-training can substantially improve an existing model’s performance on specific tasks; strong open-weight models, many of them from China, provide a base for that work and could, once improved, outperform the best proprietary models on some tasks. When GPUs are scarce, large companies may source capacity from multiple cloud providers or build their own data centers; training across data centers on tens of trillions of tokens or more makes data movement and portability a challenge, which SkyPilot is working to address.
- Stoica agrees that taste matters, but does not think it has become a moat for AI labs. He compares it to explaining the same concept: some people can make it clear in 10–15 minutes, while others can talk for 3 hours and still leave you confused. If talent’s taste were a moat, model rankings would not shift about every 2 months; capital attracts talent, and talent moves between labs.
- He argues that AI security should improve by learning from attacks and steering systems toward desired outcomes. The internet and large distributed systems have also behaved in unexpected ways; but AI is ultimately a tool for raising productivity and improving lives.
- Arena’s vision is to have real people evaluate AI on real tasks. Its goal is to help people build AI that is more accurate, reliable, predictable, and cost-effective. Stoica does not dismiss the importance of human or static benchmarks, but argues that if systems are built for people, the ultimate evaluation should reflect people’s real preferences about model or agent performance.
Silicon Valley Coordinates x Professor Ion Stoica (co-founder of Databricks, Anyscale, and LMArena) | Open Source vs. Closed Source, and the Opportunity in Infrastructure Startups
AI infrastructure startups may still find wedges in post-training, multimodal data, robotics, and cross-cloud training and data movement as compute and data scale. Competitive open models, including many from China, could outperform proprietary models on specific tasks after post-training, while rapidly rotating rankings leave durable lab advantages and the path to revenue unresolved.
View summary (7)
- AI infrastructure startups can win by identifying the core problems in emerging workloads and solving them exceptionally well. Ion Stoica sees hardware, applications, and efficiency optimization becoming increasingly intertwined, but startups can still enter through post-training, multimodal data, robotics, and cross-cloud training and data movement: “Solve these problems and excel at them.”
- Post-training could keep expanding because it can materially improve existing models on specific tasks. A large pool of competitive open models—many of them from China—provides ready-made foundations; after post-training, they could even outperform the best proprietary models on certain tasks.
- Compute scarcity is turning multicloud portability and data movement into infrastructure opportunities. Even large companies may need to stitch together GPUs from multiple cloud providers and their own data centers; when training data reaches “several trillion or more,” SkyPilot-style scheduling across locations and data transfer both matter.
- For closed-source labs, the clearest competitive factor today is capital, not any other technical factor that has been proven. No company has yet shown it can build this class of model through something other than capital; capital is not enough—revenue is also needed. Model rankings rotate every few months: at the end of last year it might have been Gemini, followed by Claude, leading Ion to conclude that “no lab has fully dominated.”
- Open models do not need to match Frontier Lock models across the board; they only need to clear the usability threshold for a given task. Ion uses a car analogy: if all you need is a car that can safely drive between Santa Clara and San Francisco at 100 miles per hour, its ability to go 300 miles does not matter unless the task itself is a race; more tasks will therefore be covered by open models that are good enough—indeed, more than good enough.
- A model’s “taste” does affect the user experience, but it looks more like UX and communication quality than a durable lab moat. For the same concept, one person may make it click in 10–15 minutes while another can spend 3 hours explaining it and still leave people confused; but if a lab’s edge really came down to a handful of people with exceptional taste, model rankings would not reshuffle roughly every two months.
- Arena’s vision is to use human preferences from real-world tasks to build better AI, rather than relying solely on static leaderboards. Ion wants AI to be more accurate, reliable, predictable, and cost-effective; static benchmarks still matter, but “if we are building systems for humans, the ultimate measure is humans themselves.”