Shopify CTO Mikhail Parakhin on the AI Phase Transition and SimGym

Summary

• Shopify says internal AI use has effectively reached saturation, with daily active participation approaching 100% after a December 2025 “phase transition.” CLI agents such as Claude Code, Codex, Pi and Shopify’s Rover are outgrowing IDE tools, while employees receive effectively unlimited tokens and are told, “Please don’t use anything less than Opus 4.6.”
• Shopify’s key operating insight is that token consumption is directionally useful but insufficient by itself without high-end critique and PR review. Parakhin calls many noncommunicating parallel agents “almost useless”; he would rather spend slower GPT-5.4 Pro or Gemini Deep Think tokens on verification because models may write code with fewer bugs on average than humans yet produce so much code that aggregate defects rise.
• AI code volume has shifted Shopify’s constraint from generation to integration: PR merges are growing about 30% month over month versus 10% before, while estimated complexity also rises. Longer review is systemically cheaper than failed tests and rollbacks, and Parakhin says human-era Git and CI/CD may need “a different metaphor”—even prompting this lifelong microservices opponent to reconsider independently deployable services.
• Tangle and Tangent turn Shopify’s ML infrastructure into a compounding experimentation network rather than a collection of notebooks. Content hashes prevent duplicated work across teams and carry the same pipeline into production; auto-research then moved search from 800 to 4,200 QPS on the same machines at equal quality, making “the price of electricity” a substitute for hundreds of manual trials.
• SimGym’s defensibility, in the episode’s clearest investor call, comes from decades of merchant and buyer outcomes rather than generic agent prompting. Shopify spent almost a year working toward 0.7 correlation with add-to-cart results, now uses multimodal browser simulations to recommend conversion changes for a single site, and sees users rising daily; the immediate constraint is paying for models and browser farms.
• The larger ambition is to model customers and entire merchants as trajectories, then test when and how interventions change their futures. HSTU-based rollouts can compare coupons, thank-you cards, campaign settings or cashback against no intervention; swyx argues that this temporal, context-rich layer exceeds static A/B summaries, while Parakhin calls it “such an unlock.”
• Shopify is also attacking inference cost and distribution: Liquid models already power a 300M-parameter search system under 30 ms and 7–8B-parameter distilled batch workloads, while UCP opens catalog discovery at runtime. Parakhin says Liquid is taking internal share from Qwen in these niches—not a frontier-model replacement for GPT-5.4—and the catalog plus identity linking exposes “almost a superset” of goods sold worldwide.

Deep dive

Not yet available upstream; scheduled sync will retry.