
Walter Goodwin
Key Views & Dialogues
20VC: Taking on NVIDIA: Fractile CEO on the Future of Chips | What Everyone Gets Wrong About Capex Spending | The Winners and Losers in Neo Clouds with Walter Goodwin
Fractile is betting that stacked memory can deliver SRAM-like bandwidth with DRAM capacity, targeting faster inference for long-running agents. Goodwin says reasoning models multiply compute through longer runs and parallel agents, while land and power limits make throughput per megawatt critical. Fractile has fabricated silicon, with full-product tape-outs expected in “a few months”; reliable rack-scale operation and manufacturing volume remain key milestones.
View summary (7)
- Fractile’s bet is that faster inference requires a different memory architecture. Goodwin says new platforms believe they can gain more than 10X on cost or speed in selected workloads; Fractile targets gains in both by stacking memory above logic. The aim is SRAM-like bandwidth with DRAM capacity for long-running agents. Fractile has received fabricated silicon, but full-product tape-outs remain “a few months” away.
- Goodwin expects inference demand to keep expanding even as intelligence becomes cheaper to deliver. Training is the factory’s fixed cost; deployment must ultimately justify building it. Reasoning models multiply consumption through both longer execution and parallel agents, leaving him expecting “thousands of times more compute” and far higher model-running expenditure in 10 years.
- Power constraints strengthen the case for more efficient chips. Goodwin says land and power are fundamental limits on data-center capacity, and that energy is the most fundamental long-term AI exposure: “buy energy.” Within a fixed power envelope, fast inference that sacrifices aggregate throughput becomes costly. He points to China’s large hydro projects and says the UK should bring more renewables, nuclear and other power online.
- Frontier models retain pricing power, while competent neo clouds face weaker differentiation. DeepSeek’s optimized serving stack illustrates why even open-model inference has not become a complete race to the bottom. Goodwin prefers flexible inference providers with enterprise distribution to capacity-heavy neo clouds, and predicts “a couple of multi-hundred-billion-dollar companies” in that space.
- Chip orchestration could be a temporary opportunity rather than a durable control point. Goodwin argues that splitting workloads across specialized processors creates a fixed hardware mix that can become wrong as models and contexts change. Stranded capacity is “completely unacceptable” when operators must maximize revenue from finite megawatts; Fractile aims to combine speed, capacity and compute on one platform.
- Goodwin predicts Nvidia will become a $10 trillion business within five years. His argument combines incumbent supply-chain advantages with replacement demand: every chip installed today will leave its data center within six or seven years at most, he says. “We’re so traumatized by the dot-com bubble that we’ve priced in exuberance right from the outset.”
- Fractile’s $720 million Series C finances supply-chain commitments and a broader roadmap. Introduced at a $7 billion valuation, the round supports future generations, systems, networking and internal ML experiments. Goodwin emphasizes “multiple shots on goal”: predicting workloads and securing components years ahead matter alongside getting the first product manufactured.
The Future of Frontier Model Architectures with Walter Goodwin, Founder & CEO of Fractile
Fractile is betting frontier inference will be constrained by memory bandwidth and cost, not compute, shifting from SRAM to a DRAM architecture expected to be fully operational in the second half of next year. Goodwin claims 25 times more bandwidth per chip than an HBM-based design, potentially making sparse MoE models economical, while its 150-person team targets a three-to-six-month lead; foundry cycles, ramps, and three-to-five-year amortization remain constraints.
View summary (7)
Fractile’s core bet is that frontier inference will be constrained by memory bandwidth and memory cost, not merely compute. Goodwin wants to combine DRAM’s capacity and economics with the “many thousands of tokens per second” associated with SRAM-based systems, enabling long-context agents and models with many trillions of parameters.
Goodwin sees much of today’s AI-chip variety as architecturally similar beneath the branding. NVIDIA and AMD GPUs, hyperscaler ASICs, and TPUs commonly rely on HBM, tensor cores, and TSMC advanced packaging. Fractile’s differentiation is attempting innovation across the entire stack rather than outsourcing physical implementation after front-end design.
Fractile abandoned an initial SRAM architecture after concluding that model size and context length would outgrow it. SRAM delivers extraordinary bandwidth but insufficient cost-effective capacity; even fast inference chips may fall back to GPUs for long-context processing. The company instead pursued “aggressively high bandwidth from the world’s cheapest memory,” DRAM, with a platform expected to be fully operational in the second half of next year.
The company’s roughly 150-person, vertically integrated team is designed to shorten the feedback loop between workload research, architecture, physical design, packaging, and foundry interaction. Goodwin argues that a durable three-to-six-month lead can decide deployments: “If you find a way to structurally secure a three- to six-month lead, you win all those implementations.”
AI may radically compress chip development, but it cannot abolish fabrication time or silicon economics. Foundry turnaround still takes three to five months, production ramps take 12-18 months, and a financially viable chip needs a three-to-five-year amortization window. Faster design therefore means maintaining more “irons in the fire,” not shipping a fundamentally new processor every few weeks.
Fractile claims 25 times more bandwidth per chip than an HBM-based design, potentially changing which model architectures are economical. Goodwin’s example is mixture-of-experts sparsity: moving from 1-to-16 toward 1-to-128 or 1-to-256 could save substantial computation, but current accelerators become bandwidth-bound. Compute has scaled roughly one million times in 20 years while memory bandwidth rose only about 40 times.
Goodwin expects frontier labs to keep buying from multiple hardware suppliers even as they develop proprietary silicon. In-house chips provide bargaining power, supply diversity, and control, but exclusive dependence is dangerous: a rival’s fivefold algorithmic efficiency breakthrough could leave a lab stranded for nine months while it redesigns hardware. Independent platforms remain valuable because they let labs compete at the model layer without betting survival on one architectural path.