AIE Europe Debrief + Agent Labs Thesis: Unsupervised Learning x Latent Space Crossover Special (2026)
Summary
AI coding became a multibillion-dollar market in one year, and swyx thinks the momentum bet remains safer than assuming adjacent use cases must catch up. He cited Anthropic at roughly $2.5 billion of ARR from Claude Code, OpenAI at an estimated $2 billion, and Cursor rumored near $2 billion. Coding’s share moved from roughly 10% to 50%, so “why can’t it keep going?” rather than mean-revert.
The likely market structure is two large coding players plus a specialized tail, with application companies defended by focus and enterprise implementation rather than permanent model advantage. Cursor and Cognition can remain concentrated on coding while foundation labs chase broader TAMs such as finance, healthcare and consumer agents. The larger thesis: “2025 was the year of coding agents, 2026 is coding agents breaking containment to do everything else.”
Harness engineering looks closer to consensus, but the more consequential go-to-market shift is that agents themselves are becoming the customer. Skills have converged toward a minimal package—a Markdown file plus scripts—while 60% of traffic to Vercel’s admin app for configuring Vercel applications reportedly comes from bots. “If it doesn’t exist as an API that agents can use, it doesn’t exist,” and default recommendations may compress markets to three names rather than 20.
The “agent lab” playbook turns proprietary workloads into smaller domain models, making cost and latency the durable reasons to train even when frontier quality keeps advancing. Composer 2 and Sweet 1.6 reportedly rank among users’ top five choices without subsidies, while custom search models offer clearer domain value. Alternative chips could strengthen this economics: swyx contrasted thousands of tokens per second with less than 100 and argued that “every 10x does unlock a different usage pattern.”
Foundation-model launches look more dangerous to midsize startups and low-NPS SaaS than to tiny teams, whose failed product may still serve as a lab job interview. Swyx’s own test case is replacing event and sponsor software costing $200,000 annually with something he thinks could cost roughly $2,000 to build. The constraint is organizational: an executive’s weekend “80% solution” can leave everyone else maintaining “the rest of your shit.”
The coding frontier has moved from zero human-written code to zero human review, making automated verification the gating infrastructure for “dark factories.” Swyx expects disposable software volume eventually to improve quality, while warning that the winners will not be cynics dismissing everything as slop: “This is happening with or without me. Let’s bend this the right way.” Jeremie Harris softened on temporary post-training because the result may expire after three months, while Jacob Effron emphasized that “you don’t throw out the raw data.”
Model scale is still rising, but memory, context and grounded spatial understanding look like harder bottlenecks than another benchmark gain. Swyx abandoned his belief that models capped near two trillion parameters, yet called context “the slowest scaling factor”: roughly 4,000 tokens to one million over three years, with Gemini’s million-token context available for two years but little used. His world-model analogy is the book-smart but inexperienced protagonist of Good Will Hunting—an LLM that “knows everything but hasn’t experienced anything.”
Deep dive
1. Harnesses are converging on a minimum viable agent stack
Swyx’s AIE Europe signal stack put OpenClaw first, followed by harness engineering and context engineering; evals, observability, GPUs, LLM infrastructure, multimodality and generative media formed the durable long tail.
Harrison Chase’s claim that AI infrastructure finally feels stable has some basis: integrations appear to have converged on Skills, “just a Markdown file” with scripts, inside a loop of LLM, tools, filesystem and retrieval. Real-time operation, sub-agents and memory may still change, but swyx’s posture is pragmatic: “If it changes again, just change with it.”
The host’s pushback is worth keeping: application companies can repeatedly rebuild ahead of models because they retain sticky customers, while infrastructure sells to pickier developers who can churn completely. Swyx therefore favors vertical “outsourced AI teams”; horizontal opportunities remain, but sandboxes are ultimately “another form of compute” serving enormous workloads.
2. Agent labs turn user workloads into model economics
Swyx’s agent-lab playbook begins with frontier models, specializes them for a domain, then trains proprietary models once usage yields enough high-quality data. The payoff is lower cost and latency, plus a less substantive but real “marketing bonus” from naming a model and publishing research.
His evidence that the value is not merely marketing: Composer 2 and Sweet 1.6 reportedly sit among the top five models users select in unsubsidized switchers. Domain-specific search models are an even clearer case, while Thinking Machines’ Tinker and Prime Intellect’s tooling are making customization easier.
The host remained less convinced about DIY RL purely for quality, recalling domain pre-training companies whose claimed advantage disappeared with later frontier releases. Swyx answered that quality and economics are “two sides to the same coin”: hold quality constant—or surrender a little—for a drastic cost reduction on high-volume, low-variance work.
Alternative hardware changed swyx’s mind. Cerebras, Talos and MatX are among the non-NVIDIA systems that can push inference from under 100 to thousands of tokens per second; Cognition and OpenAI already use Cerebras. A move from 100 to 200 felt incremental, but “every 10x” may produce applications nobody can predict, supporting a multi-year investment cycle.
3. Agents are customers, but they are not rational buyers
Asked whether agents are the ultimate rational developers, swyx answered, “Absolutely not.” They are prompt-injectable and inclined to compound incumbents embedded in pre-2023 training data; Vercel CTO Malte Ubl’s conference statistic was that bots now generate 60% of traffic to Vercel’s admin app for configuring Vercel applications.
The immediate product rule is categorical: “If it doesn’t exist as an API that agents can use, it doesn’t exist.” Agent experience still resembles good developer experience—clear documentation, consistent and mostly stateless APIs, CLI access, search and progressive disclosure—while swyx is skeptical of stretching that into chatbot-gaming AEO.
Today’s default recommendations can still create winner-take-most distribution. Claude reportedly recommends Resend without prompting in roughly 70% of email-provider requests despite its relatively recent founding; swyx expects the shortlist to contain “like three,” not 20. Semantic-association content—“use my thing with Vercel”—may help until memory and personalization replace raw mention frequency.
4. Coding’s capability race rewards spending before efficiency
Both OpenAI and Anthropic have made coding a P0. Swyx cited Anthropic at about $2.5 billion of ARR from Claude Code, estimated OpenAI around $2 billion, and noted Cursor’s rumored $2 billion—markets created in roughly a year, with Claude Code only just reaching its first anniversary.
The popular catch-up thesis says founders should target the empty space beyond coding, now around 50% of Claude use cases. Swyx prefers the momentum question: if coding rose from perhaps 10% to 50% in a year, “why can’t it keep going?” Betting incorrectly on mean reversion could be far more painful than following the established trajectory.
Employers currently reward visible token consumption more than discernment. Ryan Lopopolo at OBI reportedly spends one billion tokens daily—about $10,000 per day at market API rates—and much may be slop; yet he will discover a new capability before someone who only runs workflows already known to work. “The people who are going to discover the next hot thing are living at the edge.”
Anthropic is the premium, capacity-restricted player; Codex says, in effect, “Come on in,” while Gemini is also heavily subsidized. Swyx’s tactical advice is to exploit the subsidies and use the $200-per-month Claude Code or OpenAI plans for capability exploration because most people still are not pushing them hard enough.
5. Concentration persists until a challenger invents a new experience
Swyx’s base case is two major coding players plus a smaller specialist tail. Changing that structure requires materially different economics, brands or value propositions; possible challengers he mentioned include Microsoft fully mobilizing GitHub, Mistral pursuing coding, and Chinese labs including Z.ai, GLM and Zhipu. He said the new labs had not meaningfully broken through in the past year, while cautioning listeners not to underestimate them.
Foundation labs also pursue other TAM-expansion areas, including a super app, Claude Code for finance and Claude Cowork. Cursor and Cognition remain comparatively coding-only, while dedicated agent labs can perform the enterprise “last mile” that minimalist model labs leave undone; large enterprises appear to want that separate partner.
Finance and healthcare are the clearest next verticals, though swyx considers healthcare more thorny and finance’s path to revenue clearer.
The host saw Claude Code’s first-mover stickiness as evidence that the next magical interface could let another company leap forward. Swyx called Codex’s Skills integration and speed somewhat better but still viewed it as catching up; in this “high volatility, high temperature phase,” he doubts loyalty will match older software categories. OpenClaw may preview the opening: coding agents generate software, “software eats the world,” therefore coding agents eat the world.
6. Low-NPS SaaS is squeezed, but organizations slow the replacement
Swyx is relaxed about tiny startups because competent attempts can become job interviews at foundation labs; he is more concerned about midsize companies. LLM infrastructure is already consolidating, with businesses such as Langfuse absorbed into ClickHouse, while low-NPS traditional SaaS faces a more fundamental threat.
His internal example is event and sponsor-management software costing $200,000 annually that he believes could be custom-built for roughly $2,000. He expects to replace it eventually—perhaps delayed one year, “but not, like, five”—because his less technical colleagues must accept and operate the result.
That exposes the corporate fault line: AI-native leaders think colleagues overestimate what software must contain, while teams see executives shipping weekend “80% solutions” and transferring the unfinished work downstream. Swyx nevertheless sees room for an AI-native system of record—perhaps something like Convex—because the “Firebase of AI apps” has not clearly emerged beyond Postgres and MongoDB.
7. Access restrictions are temporary; memory is the stubborn constraint
At a dinner with Anthropic CPO Mike Krieger, swyx named biosafety as his largest worry, while Krieger emphasized security. Swyx argued that a supposedly private model is not truly private if 40 companies, each with perhaps 10,000 employees, receive it: bad actors can exist inside that distribution perimeter.
Anthropic’s strategy is to restrict access and bundle model with product; OpenAI is more philosophically inclined toward broad enablement. The host’s cynical counterpoint was compute availability, and swyx agreed: current rationing of models above 10 trillion parameters may fade as larger clusters arrive over the next three to five years, only for rationing to move to the next frontier.
Swyx’s explicitly unconfirmed Gemini theory: Google announced Flash, Pro and Ultra, never released Ultra, and may keep it “sitting in a basement” to distill into cheaper models. That would be rational because the binding issue is cost, not whether users intrinsically prefer the smaller models.
He has abandoned his former view that model size capped around two trillion parameters, but cannot say whether the path stops at 200 trillion or two quadrillion. Context is scaling much more slowly—from roughly 4,000 tokens to one million in three years—and Gemini’s million-token context has existed for two years without broad use. “Memory is probably gonna be the biggest limiting constraint.”
8. Open models and disposable training have reopened the stack
Swyx previously cited Ankur Goyal’s estimate that open-source market share was 5% and falling; he now thinks it is rising. Public capability benchmarks are gameable, while OpenRouter offers somewhat more objective choice data—though heavy discounts mean observed volume must be price-adjusted.
The average market share also hides the relevant cohort split: the top 20% behaves differently from the bottom 80%, including average GPT wrappers. Leading teams are moving toward open models, Fireworks and Together are “crushing,” and fine-tuning-as-a-service can work as a derivative of growing open-model workloads.
Jeremie Harris’s reversal was narrower: post-training may be worthwhile when it is the best way to improve outcomes for the next three months, even if a frontier release later erases the advantage. Jacob Effron added that the better intervention may instead be more data, connectors or backend engineering; the work can resemble temporarily staffing several engineers, possibly even at a $10 million scale. Swyx’s key distinction was, “You throw out the results, but you don’t throw out the raw data.”
Swyx pointed listeners toward long trajectories, synthetic rubrics and Dr. GRPO. RL is becoming multi-turn—potentially hundreds of turns—allowing customization along far more domain-specific dimensions than shallow RL or SFT performed a year earlier.
9. Dark factories require software to become disposable
The first frontier was zero human-written code, which swyx encountered at Cognition five months earlier and which already sounds less radical. The next is zero human review: agents check in code directly, forcing companies to invert the SDLC around more testing and automated verification.
Few organizations operate this way, though OpenAI is exploring it. Swyx considers it “the only scalable way” to unlock unprecedented software volume; because software becomes cheap and disposable, quantity can eventually help teams search for quality rather than merely multiply slop.
His cultural call was blunt: the strongest performers of 2026 will not sit outside calling the output slop. They will say, “This is happening with or without me. Let’s bend this the right way.”
10. World models target experience, not merely robotics
Beyond memory, swyx’s next major frontier is world models. Their current manifestations—3D environments, gaming and embodied vision—make robotics the obvious narrative, but he argues that equating world models with those products understates the question: can a model understand matter, physics and what a table is?
He recommends Fei-Fei Li’s spatial-intelligence essay because she may not yet have the solution, but “she has the right problem statement.” Work ranging through Moonlake, General Intuition and adversarial world models represents competing attempts to move intelligence beyond next-token prediction.
The episode’s closing analogy came from Good Will Hunting: Matt Damon’s character knows what books can teach but has not lived the experiences Robin Williams describes. Swyx sees the same gap in “a very intelligent LLM who knows everything but hasn’t experienced anything.”