He won a Nobel here for AlphaFold. Then he left. - John Jumper
Summary
- AlphaFold’s central lesson is that a narrow, deeply engineered scientific model can create enormous leverage without modeling all of biology. Jumper says one protein structure could require roughly a year and $100,000; AlphaFold predicts typical structures “within the radius of an atom” in 5–10 minutes and has scaled to 200 million proteins. It delivers “nature-level science with the press of a button” — but only for a precisely bounded class of measurement.
- The technical moat was accumulated domain knowledge, not one fashionable architecture. AlphaFold 2 combined Evoformer, geometric refinement, FAPE, recycling, biological hypotheses, and many smaller advances — “not one or two home runs” but “18 doubles.” A cited retraining study found AlphaFold 2 using 1% of the PDB still beat AlphaFold 1, leading Jumper to value its architecture and training ideas at “a clean 100x in data.”
- Protein structures accelerate discovery, but they do not remove drug development’s largest risk: choosing the right biological intervention. AlphaFold can reveal binding mechanisms and help fit atomic models into rough experimental data, yet Jumper stresses that “we do not know how biology works very well.” His factory analogy separates the cheap quarter-turn from the expensive knowledge of which screw to turn.
- AlphaFold 3 expands the opportunity from proteins to drugs and other cellular molecules, but calling it a diffusion model hides the load-bearing system. Its trunk likely determines most of the structure before diffusion acts as a “geometrization engine,” handling details such as ligands and local bonds. Jumper’s warning for AI investors: architecture labels do not explain why systems improve.
- The team’s operating advantage was unusually disciplined empiricism. Equivariance cost only about 2–2.5 points when removed from AlphaFold 2’s roughly 30-point gain over AlphaFold 1, contradicting the popular story that symmetry produced the breakthrough. Jumper’s benchmark for productive research is stark: “If you’re wrong nine times out of 10, you’re a very successful machine learner.”
- Open access converted the model from a laboratory result into scientific infrastructure. Emmanuel Nee says an unsuccessfully pursued structure that had consumed four or five years was obtained through one protein purification plus AlphaFold in under two or three months. His program scaled to 100 Africa-based researchers with no drop — in fact, an improvement — in training quality, and targets 100 annually for 10 years: close to 1,000 scientists working on malaria, HIV, and antibiotic-resistant infections.
- Jumper’s announced move from Google to Anthropic is strategically notable, but the episode supplies no disclosed roadmap. Scarfe emphasizes that Jumper built a highly structured scientific system, not a generic Claude- or Gemini-like predictor, and says of Anthropic’s interest, “We can only guess.” The signal is that frontier labs may value the craft behind hybrid, domain-specific systems alongside general-purpose foundation models.
Deep dive
1. AlphaFold collapsed a year-long measurement into minutes
Jumper describes proteins as cellular “nanomachines” assembled from a rope of 20 chemical groups, then folded into the shape that actually performs the work. His enduring analogy is an IKEA bookshelf that “builds itself”; humans have about 20,000 protein types, yet determining even one structure traditionally made a worthy PhD project.
The old workflow could involve years of crystallization work and synchrotrons “the size of small towns,” followed by another mathematical reconstruction problem. Jumper’s rough economics are one year and perhaps $100,000 for a single answer, despite a societal investment that had produced about 200,000 experimental structures — roughly 140,000 when AlphaFold was developed.
AlphaFold learned from public experimental data and reached typical accuracy “within the radius of an atom,” while reducing inference to 5–10 minutes. At CASP in 2020, its predictions for many single-chain targets were close enough that organizers called the problem essentially solved; the resulting database covers 200 million proteins.
The episode reports more than 3 million users across over 190 countries and repeatedly preserves the crucial qualifier: these are predicted structures, not experiments. The 2024 chemistry Nobel split one half to David Baker and the other to Demis Hassabis and Jumper, formalizing protein prediction as a major scientific use of AI.
2. A structure is a starting point, not a cure
Jumper’s preferred framing is that AlphaFold starts biological research. In a cholesterol-transport study, scientists combined a rough cryo-electron microscopy image — the technique was once nicknamed “blobology” — with an AlphaFold shape that fit the blob, producing an atomic model from which mutations and transport mechanisms could be investigated.
The sharper example is Midnolin, a little-studied human protein implicated by genetics in protein recycling. Researchers ran AlphaFold against almost 500 affected proteins and found that roughly 40% showed a specific motif clamped between two parts of Midnolin, turning a broad cellular correlation into a proposed recognition mechanism.
Experiments then tested about 10 examples: nine behaved as predicted, while one only partially responded. Revisiting AlphaFold showed that the exception had two predicted binding locations; removing the second abolished degradation, illustrating how prediction and wet-lab testing can iterate toward mechanism rather than substitute for one another.
The hard part of drug development remains knowing what to alter in the cell’s “big complex factory.” Jumper retells the joke of a technician charging $10,000 after turning a nut by one quarter-turn: turning it costs almost nothing; “knowing what to turn” accounts for the rest.
3. Scientific humility defines the product boundary
Scarfe’s pushback is that the body is a living system with adaptive, compensatory mechanisms: a mechanistically elegant intervention may become biological “whack-a-mole.” Machine learning itself often succeeds by abandoning human intuitions, collecting data, and testing many possibilities rather than trusting a tidy causal story.
Jumper’s answer is “the humility of AlphaFold”: it predicts what a specific year-long experiment would return, not everything a cell will do. “We are not a model of the entire cell”; the model’s reliability can be characterized against that experiment, while scientists remain responsible for using predictions, discovering mechanisms, and learning where the system fails.
AlphaFold 3 widens the boundary to the “protein cinematic universe,” including small-molecule drugs, cholesterol-like molecules, and other entities appearing in the PDB. That enables questions AlphaFold 2 could not accept — such as where a drug sticks — while efforts including Isomorphic Labs explore whether those predictions can support actual drug design.
4. AlphaFold 2 was six or seven papers, not one trick
Jumper objects thematically to summaries such as “AlphaFold 1 was a CNN” or “AlphaFold 3 is a diffusion model.” AlphaFold 1 used an off-the-shelf computer-vision CNN for one subproblem, with protein-specific machinery around it; AlphaFold 2 instead tried to “build the science” of protein prediction directly.
AlphaFold 2’s main trunk, Evoformer, consumed over 90% of its compute and accuracy. Two forms of axial attention let evolutionary sequence information and pairwise geometric beliefs “have a conversation”; a smaller structure module then harmonized N-squared constraints into N positions as a geometrization engine.
Invariant point attention used residue-aligned frames, but Jumper believes frame-aligned point error, or FAPE, was especially important. Training began from “black-hole initialization,” with residues piled together, and treated them as a “residue gas” rather than a rigid 900-joint robot arm, so optimization could proceed in roughly four or eight steps.
Removing equivariance cost only around 2–2.5 GDT points out of AlphaFold 2’s roughly 30-point advantage over AlphaFold 1. One reviewer called the system “six or seven papers’ worth of ideas”; Jumper’s own baseball metaphor is “18 doubles,” with many medium gains jointly producing the breakthrough.
5. Ablations, not architectural fashion, drove the next model
Interactions mattered more than isolated components: removing both recycling and invariant point attention cratered performance by perhaps 12–15 points, although even that was only about half the AlphaFold 1 gap. The team often solved a problem in two ways, so the model could tolerate losing either support but not both.
Layer visualizations suggested Evoformer spent most of its capacity on geometry after its earliest layers. That evidence helped motivate a simpler Pairformer, and Jumper says many such lessons went into AlphaFold 3; elsewhere, merely deleting convolutional layers — adding neither replacements nor parameters — improved validation loss because the convolutions may have been actively harmful to the required learning.
A study cited by Jumper found AlphaFold 2 trained on 1% of the PDB still surpassed AlphaFold 1, making its architecture and training ideas worth “a clean 100x in data.” AlphaFold 1 and 2 themselves used the same training data, isolating the value of problem-specific design rather than dataset expansion.
This is why Jumper rejects simplistic applications of the “bitter lesson.” Researchers should hypothesize, measure, and expect to be wrong nine times out of 10, then build a “science local to your area” from those failures; limits on available data make architectural research and decisions about which units communicate consequential.
6. Prediction and control arrived before human understanding
Jumper separates three concepts. Prediction says what future measurement will appear; control asks for that measurement to equal, say, 17; understanding requires a compact set of communicable facts — something that “fits on an index card” — with a human still in the loop.
Machine learning is “code meets data produces weights,” leaving an enduring question about which algorithm was programmed and which emerged. AlphaFold learned successive geometric refinement even though that intuitive algorithm was not explicitly written; recycling then gave the learned process more iterations without requiring an ever-deeper, memory-hungry network.
AlphaFold 3 is technically diffusion, but not in the familiar image-generation sense. Noisy coordinates mean it must establish the largest-scale relationship between protein blobs first — the problem AlphaFold 2 solves last — while a large preceding trunk and first diffusion pass likely establish the overall answer before later passes realize local details.
Jumper also resists explicitly naming every desired representation in code. Strong next-token prediction can slowly force concepts to emerge without a “high-level concept builder thingamajigger”; external memory, notes, and agent reminders can patch deficiencies, but researchers still cannot reliably distill those software harnesses back into weights that retain the capability.
7. Open access changed who can practice structural biology
Emmanuel Nee applies AlphaFold to cryo-EM structures and protein mechanisms in malaria and enteric-bacteria drug discovery. More broadly, he says researchers without expensive structural-biology equipment can now attempt work on malaria, HIV, and antibiotic-resistant infections that was previously inaccessible.
His personal before-and-after is concrete: after four or five unsuccessful years on one structure, one protein purification and AlphaFold-assisted analysis delivered it in under two or three months. With Google DeepMind and Swedish Research Council funding, his training program reached 100 researchers with no quality drop — in fact, with an improvement — and now targets close to 1,000 over a decade.
Scarfe closes by treating AlphaFold as proof that frontier scientific AI may remain hybrid and customized, requiring domain expertise, engineering, and tacit knowledge. Jumper’s interview preceded the announcement that he would leave Google for Anthropic, so the episode presents the move as an intriguing signal rather than evidence of a specific Anthropic project.