
Doug O'Laughlin
Frontier Insights
Frontier Thesis: Agentic coding models like Claude Code are redefining knowledge work, turning code into the primary interface for complex labor while low-latency inference commands massive price premiums. Meanwhile, frontier models like Kimi K3 confirm China’s top-tier parity despite severe compute footprints.
Strategic Imperatives: Operators must exploit routing layers to optimize frontier costs and aggressively secure memory supply lines.
Risks & Bottlenecks: Systemic hardware crunches threaten deployment. HBM is cannibalizing standard DRAM capacity—spurring multi-year shortages and doubling memory/storage costs—while human review capacity, broken apprenticeship models, and data trustworthiness remain unaddressed execution chokepoints.
Key Views & Dialogues
[Emergency Episode] Moonshot’s Kimi K3 has Arrived! China has a Frontier Model
Kimi K3 is now a clear top-three model by benchmark composites, while Dylan ranks it second for practical use as Opus access remains frustrating and restricted. Its 2.8-trillion-parameter scale requires B300, GB300, or MI355X-class hardware, but $3/$15 per million input/output tokens suggests attractive economics; adoption, Western sovereign demand, and routing layers remain the key commercial variables.
View summary (6)
- Max calls Kimi K3 a clear third-best model, while Dylan says it may be second-best for his practical use. Max says benchmark composites show a clear, stable top three including Soul 5.6 and Kimi K3, ahead of Google, Meta, and SpaceX; he says Google should feel embarrassed. K3 is still slower and officially trails Fable 5 and GPT 5.6 full, but Dylan finds it less frustrating than Opus when access is rejected or limited.
- K3’s 2.8 trillion parameters make inference capacity an immediate bottleneck. Dylan says it cannot fit in a B200 and needs B300, GB300, or MI355X hardware for service on a single 8-way HGX system; multi-node pipeline parallelism would hurt performance. Max speculates that the roughly 10-day weights delay gives serving teams time to prepare and may let Moonshot arrange licensing and GB300 capacity with Together, Fireworks, Nebius, and CoreWeave.
- K3’s pricing highlights attractive frontier-model economics but a constrained buyer base. Pricing rose from $0.95/$4 for the previous 2.7 Code model to $3/$15 per million input/output tokens. Max argues that if K3 is probably not operating at negative margins, similarly sized Fable charging $10/$50 would imply extraordinary margins, potentially better than SaaS. Cost-conscious users may choose GLM-5.2 or MiniMax M3, while SemiAnalysis-like users continue using GPT-5.6 and Opus; Max doubts large enterprises will adopt K3 seriously.
- Dylan attributes the narrowed open-versus-closed gap squarely to US restrictions that limit access to Anthropic’s best models. He points to Mythos versus Fable, says he cannot use Opus and can use Sonnet only sometimes, and thinks Soul 5.6 may not be OpenAI’s largest model. He expects policy changes or another frontier step near the end of summer, while also arguing that open models may eventually reach true frontier parity.
- Western open source has a sovereign-computing opportunity beyond cost savings. Max sees strong demand for a Western model that does not suck and expects many US enterprises to reject Chinese weights even in air-gapped systems; he also says a Chinese-model ban may be coming. Dylan says Western models must beat both bulk Chinese open models and tier-2/3 frontier-lab models, with government as the larger market. K3’s quantization during SFT—MXFP4 weights and MXFP8 activations—supports broad hardware compatibility and China’s domestic-accelerator push.
- Harnesses, routing, and untapped adoption still support frontier-lab revenue. Max says model quality is increasingly difficult to distinguish across maximum, high, and medium effort, making features in tools such as OpenCode, Hermes, and Pi decisive. Dylan suggests outcome-based pricing could produce 95%-plus margins, and Max agrees that routers and adjustable thinking effort could do so. Max sees substantial room for new use cases across coding, audio, video, deep research, robotics, and world models; Dylan and Max believe new adopters will overwhelm any K3 substitution and prevent ARR-growth deceleration.
Ep. 004 - The Impact of AI Datacenters On Consumer Power Costs (Datacenter, Energy) | Jeremie Eliahou Ontiveros, Jordan Nanos, Doug O’Laughlin
PJM’s 15–20% electricity-bill spikes are presented mainly as a market-design failure: a once-yearly auction and forecast lag collided with new load, while supply accreditation cuts removed roughly 40 GW, including 14 GW from methodology changes. Custom tariffs and long-term minimum-demand agreements such as Oracle’s Michigan deal can keep underused infrastructure costs off ratepayers, while Anthropic’s accelerating ARR and disputed model-specialization thesis broaden the infrastructure and application-layer stakes.
View summary (8)
- Jeremie Eliahou Ontiveros’s core call: the 15–20% electricity-bill spikes in PJM territory are mostly a market-design failure, not raw AI demand. Data centers contribute “to some extent,” but the real culprit is a capacity auction run once a year on regulator forecasts hitting the first US load growth in 20 years — “this market was not designed for an environment where load is growing.” ERCOT’s real-time pricing lets participants see demand coming and place generation ahead; PJM’s signals arrive late, so “everything is just late and you just create a mechanism that is constrained.”
- PJM’s supply side quietly shrank
40 GW (-20%) in four years, and 41% of the decline — 14 GW — came from methodology changes, not retired plants. The thermal accreditation reform followed bad 2021–22 winters that revealed plants fail in clusters when it’s cold, so the cut from 170 GW offered to 156 GW is “legit” — but it means capacity numbers are moving opposite to the political push for more generation, with new gas only +3 GW and renewables +1.5 GW over the same window. - The ratepayer risk mechanism to watch: regulated transmission earns a required return on equity, so an overbuilt, under-utilized asset gets passed straight to consumers — “this is the worst-case scenario outcome.” The fix is custom tariffs; the specimen deal is Oracle’s ~1 GW IT (1.4 GW gross) Stargate site in Michigan: a $4B utility commitment alongside a battery-purchase commitment and a 15–20-year power agreement with a minimum demand charge, meaning Oracle pays even if the load never materializes.
- The desk believes Anthropic is crossing OpenAI on total ARR as of the February exit — roughly doubling ARR (+$10B) in two months — and that reported Claude Code revenue of $2.5B run-rate is “way too low.” Doug says Anthropic counts Claude Max subscription usage inside Claude Code as Claude Code, while API usage—including Claude Code API mode—is counted as API; SemiAnalysis’s own spend runs 90–95% through the API and isn’t attributed. Jordan reads the acceleration as true business adoption, not hype.
- The Department of War spat is a distribution gift, not clearly a revenue driver — and the speakers disagree on how much it matters. Doug notes Claude hit #1 on app downloads, above OpenAI, right on the DoW news (“that’s a pretty hardcore mog… a zeitgeist moment”); Jeremie pushes back that downloads may be random app trials and that the revenue impact was “most likely unrelated to that specific issue.” The narrative inversion stands either way: Anthropic came from the business world and is now beating OpenAI on consumer.
- Jeremie’s tradeable thesis: the “models are commodities, value accrues to the application layer” view is “just completely wrong.” Anthropic has models nobody else gets, owns the coding interface, and can build applications using them better than anybody else can, effectively for free — “the model companies will become the everything companies.” Doug’s counter: as with Moore’s Law CPUs, “until the generalized models don’t get better every three to six months, there’s no point of doing any specialization.”
- China is an underappreciated demand vector leaking into global GPU numbers. Doug’s speculative take is that Qwen leadership was pushed out over Chinese New Year user-acquisition misses after perhaps $1B of spending; ByteDance “won, for sure,” with CDance running a months-long paid queue (Jordan cites 14K of 30K). Doug says Chinese labs VPN through Japan/Korea — claims that region is 15% of Anthropic revenue are “Chinese demand” — and “if Eastern companies had access to Western compute… I think they would be ahead.”
- Pre-GTC positioning note from Doug: the SRAM-will-kill-HBM scare ahead of the LPU session is “the dumbest narrative I’ve heard recently.” Everyone is “super long HBM” and spooked into selling it — investor positioning, not a grounded technology conclusion.
Claude Code for Finance + The Global Memory Shortage: Doug O’Laughlin, SemiAnalysis
Claude Code with Opus 4.5 now behaves like a junior analyst, compressing PhD-scale projects into days while still requiring expert review of its frequent mistakes. Adoption near 4–5% of public GitHub and a memory shortage that could lift DRAM prices another 100% point to accelerating agent demand, constrained infrastructure, and exposed information-work roles.
View summary (7)
Doug O’Laughlin’s core call is that Claude Code crossed from novelty to economically useful information worker around Opus 4.5. It can compress what looked like a “PhD project” into a day or two, yet “this crap makes mistakes all the time”; today it resembles a junior analyst, not an autonomous expert. Shawn compared the paid tool to a perfectly compliant junior analyst. The immediate payoff accrues to experienced reviewers who recognize the “artisanal last 5%,” while junior data-analysis roles look increasingly exposed.
Claude Code’s adoption curve suggests coding agents are becoming the interface for all information work, not merely programming. Doug described Claude-attributed commits reaching roughly 4% of public GitHub in “2 weeks or something”; Shawn said the updated chart was around 5%. Doug’s deliberately sandbagged year-end prediction was 25%, while Shawn said the current rate pointed closer to 50% and that 25% fit a 95% confidence interval. The broader claim is sharper: “Excel is the IDE for analysts,” and Excel, Bloomberg, PowerPoint, and other human-oriented interfaces are vulnerable once agents can retrieve trusted data and render the answer directly.
The most concrete hardware call is a memory shortage that Doug thinks cannot clear for roughly two years. One bit of HBM effectively consumes three to four bits of conventional DRAM capacity after process complexity and yield, just as suppliers emerge from a severe bust that froze clean-room investment. SemiAnalysis sees scope for DRAM prices to rise another 100%, forcing demand destruction, delaying data centers and devices, reviving old DDR4 through CXL, and making “context rationing” a plausible product reality.
Google’s TPU V7 has a temporary cost window, but Nvidia’s control of memory and the wider supply chain may close it with Rubin. Doug thinks nearly every major lab would consume more TPU V7 if supply were unconstrained, and the shared discussion put a possible TPU business near $1 trillion at roughly 30% share. Yet TPU V8’s HBM3 position versus Rubin’s HBM4, Nvidia’s aggressive supplier management, and Google’s limited available capacity make this an installed-base race rather than a clean architectural victory.
Microsoft has “the most to lose” because AI attacks the horizontal software where humans perform information work while Azure finances the attackers. Doug compared OpenAI to “barbarians at the gate”: Microsoft can remain a highly profitable compute supplier while its Office abstractions are disrupted, or redirect investment toward defending Office and building internal models. Oracle’s attempt to absorb the displaced buildout was not necessarily a bad underlying investment, in Doug’s view, but its huge, poorly staged debt issuance overwhelmed market liquidity and turned financing cadence into a bottleneck.
The AI buildout already resembles railroads more than the internet, implying multiple booms and busts rather than one clean cycle. Shawn cited railroad investment at about 4.8% of GDP and 25% of gross fixed capital investment, while also comparing Stargate with roughly 2% of U.S. GDP. Doug will not claim demand rises forever, but Claude Code changed his own elasticity: he would value access at $20,000–$30,000 a year or more because it behaves like many parallel junior analysts.
Doug’s semiconductor framework remains the anchor: Moore’s Law slowing while scaling-law demand accelerated transferred value to companies that could still deliver system-level performance. His 2020 conclusion that Nvidia was the primary beneficiary proved directionally right, though even he did not anticipate “the most valuable company in the world.” The durable investing lesson is not precision EPS maintenance; it is finding the one to three technological variables capable of moving billions in revenue, then using agents to investigate them without outsourcing judgment.
Ep. 001 - Claude Code, Memory Mania, CPUs are Back | Jordan Nanos, Doug O’Laughlin, Myron Xie
Claude Code now authors roughly 4.7%–4.8% of public GitHub commits, while Opus Fast and GPT-5.3-Codex-Spark test how much users will pay for faster inference above the $2,400/year Max tier. Memory has shifted from the worst downturn since 1996 to a multi-year shortage as HBM absorbs wafer capacity, CPUs tighten, and even new supply may not close the gap; storage demand hinges on logs, synthetic data, and generated video.
View summary (7)
- The memory cycle has whipsawed from the worst downturn since 1996 — which “bankrupted a third of the industry” that year — to a historic shortage with little near-term relief. Myron Xie’s mechanism: HBM yields several times fewer bits per wafer than conventional DRAM, every incremental GPU/XPU pulls wafers toward HBM, and post-COVID there were virtually no additional wafer starts or cleanroom space — “we’re adding virtually no additional supply while demand is booming.” Doug O’Laughlin: memory and NVMe prices rose ~20% in a single day and ~100% month-on-month, and it stays tight “for a few years at least.”
- The classic cycle-top signal — Samsung capitulating and adding capacity last — may not work this time. Doug: “I think they’re gonna build capacity, and it’s still not gonna be enough. The supply-demand gap is the largest it’s ever been, and it gets worse from the work that we see.” His “galaxy brain take”: the EUV bottleneck could pull 3D DRAM forward from the expected ~2035 timeframe toward ~2030, though not before 2030.
- CPUs are back, and even Intel is still — or probably will be — sold out, “which tells you things are tight.” The discussion frames Intel as the marginal supplier, while Arm is “such a bigger threat than it’s ever been” and AMD “continues to crush.” Phoenix CPUs are an interesting change, particularly for how Arm’s business model may adapt.
- Claude Code now authors ~4.7–4.8% of public GitHub commits, per Doug’s scraped daily series — and Anthropic linked the article containing the estimate in the press release for its $30B raise at a $380B valuation. The share rose from ~2% on January 20 to ~4% on February 5 and is still growing; Doug built the tracker after a tweet tipped him that Claude Code signs its own commits.
- Opus Fast and OpenAI’s GPT-5.3-Codex-Spark (on Cerebras) are price-elasticity experiments above the $2,400/year Max tier — the “caviar trade.” Opus Fast charges ~6x per token for roughly 2–2.5x speed; Jordan Nanos describes the Cerebras trade as “10x the money for 4x the performance, or really more like 20x the money for 10x the performance or something like that.” Jordan says the Fast mode is working on him: “Now that I’m addicted to Fast tokens… I don’t think I could go back.”
- China Model Week delivered real breakthroughs: MiniMax 2.5 “at Opus performance… 1/10 the price,” GLM-5, and above all ByteDance’s Seedance/CDance 2 video model — “animation done, cooked.” Doug calls it the first “total victory” over Google’s Veo/Genie lead, and floats a conspiracy: “the surveillance state gives everyone better training data” — 10% of all hard-drive demand is Chinese surveillance.
- Jordan’s storage thesis: SSD/HDD demand will boom on logs, synthetic data, and generated video — not KV-cache offload, whose retained fraction can be “less than 1%” of generated video. He also warns against attach-rate shortcuts like Jensen’s 16TB-per-GPU figure, which makes ICMS look like <0.7% of drive shipments — “the right conclusion for ICMS, but not the right conclusion for the growth of drive demand.”
SemiAnalysis’s Doug O’Laughlin on all things AI, Power, and Corporate Governance
AI’s next phase is shifting Big Tech from cash-generative platforms toward debt-funded infrastructure, with power—not chips—as the binding bottleneck and TPU emerging as a credible number-two accelerator. The opportunity depends on monetizing token demand and agentic commerce, while rising capital intensity, a possible three-year runway to a hangover, and governance signals such as Target Hospitality’s PSU award remain key risks to monitor.
View summary (9)
Doug O’Loughlin thinks the AI capital cycle is only beginning to acquire the leverage required for a genuine bubble. Hyperscalers have funded the buildout from operating cash flow, while CoreWeave historically financed GPUs only after winning contracts; Oracle showed what becomes possible when debt enters the equation. Doug points to accelerated depreciation, less growth in capital requirements for risk capital and potentially lower rates; Andrew adds political pressure to announce American data-center investment. Andrew thinks the buildout still has a long way to run, even if a hangover could arrive in three years.
The market may be understating how radically AI changes Big Tech from capital-light platforms into capital-intensive infrastructure businesses. Mid-20s P/E multiples can look undemanding beside 20%-30% EBIT growth, but cash outlays make price-to-free-cash-flow expand as the business model changes. Andrew’s pushback is that today’s AI spending may suppress current earnings to produce tomorrow’s returns; Doug concedes that demand exceeds supply, but warns that “capital-intensive businesses tend to trade at low multiples of earnings.”
Google’s TPU is a credible number-two accelerator—and at the right price, Doug would choose it over NVLink. Doug says TPU’s 3D-torus architecture can be sliced and scaled without the NVL72’s failure blast-radius problem, where one failed GPU can pause the other 71; he also says TPU already handles training and inference in production, with Midjourney allegedly using it entirely. Google’s willingness to sell TPU externally and distribute Gemini beyond its own properties—including on Siri—creates “a real chance of being a true number two.”
The scaling thesis has shifted from ever-larger pre-training runs toward reinforcement learning, test-time compute and verifiable work. Doug accepts that the December case for a pre-training scaling wall was “probably pretty valid,” while treating Gemini 3’s expected release that month as a test. He argues that RL can probably improve tasks with checkable outcomes—from buying a book in fewer clicks to producing superhuman Dota 2 players. The ambition has narrowed from mystical AGI toward making “all white-collar information and knowledge” nearly free at the margin.
Inference hardware already offers extraordinary theoretical economics; selling and monetizing every token is the constraint. Doug estimates a roughly $3.5 million GB200 could generate about $5 million annually if all its tokens were sold, while the stack includes roughly 60% TSMC, 75% Nvidia and 40% neocloud margins before OpenAI’s losses. Supporting perhaps one billion monthly users for several billion to $10 billion should be monetizable—failure would be “a skill issue”—especially if agentic commerce can collect a take rate on purchases.
Power, not semiconductors, is the more structurally offsides bottleneck. Doug believes Taiwan could double chip output in roughly two years, while “we cannot double the power in two years”; conventional operators are still absorbing 120-kilowatt racks as faster players design for 500 kilowatts, one megawatt or even three megawatts. That mismatch benefits miners with usable interconnections and industrial contractors such as Comfort Systems, where roughly 40% revenue growth produced approximately 80% EBIT growth.
In a shortage, specialists can overthink relative winners. Generalists underestimate the physical scale because the “ginormous industrial revolution” is occurring around rural data centers rather than city centers. Specialists can become trapped in questions such as whether the Anthropic-Amazon deal means Trainium is “screwed,” while industry participants see absolute scarcity: even abandoning Trainium for GB200s could send Amazon revenue “through the roof” because every usable unit has value.
Executive compensation is useful signal only when an aligned board ties it to a controllable fundamental lever. Off-cycle PSUs can reveal a board’s intended lever, but they can also be delusional “Hail Mary grants” or incentives to pump a stock. Broadcom illustrates the reflexivity; Opendoor’s new CEO received a $1 salary and awards tied to roughly $9, $13, $17, $21 and $33 share prices while actively promoting the stock. Doug also flags Elastic (ESTC), where a giant off-cycle PSU might be aimed at consumption or an AI-linked search API, while admitting he has no fundamental knowledge of the company.
Target Hospitality combines an incentive tell with two possible demand shocks. The company lost major contracts during a sale process that was later pulled, including the Pecos Children’s Center agreement once worth roughly $2.5 billion. After the stock fell from about $8 to $5, Andrew says the company announced roughly two million PSUs four days later; he described the award as a roughly 5x share-price incentive, with detailed thresholds stated as $20 to $30. The possible levers are roughly 6,000 available detention beds and a West Texas data-center labor shortage—“the two most secular trends of our time” in one company, with execution still uncertain.