Pioneers Insight Method Research Author
AI Kills Everybody or Doomer Psyop? OpenAI’s Math Breakthrough, Nike’s $200B Collapse
Back to Episodes

AI Kills Everybody or Doomer Psyop? OpenAI’s Math Breakthrough, Nike’s $200B Collapse

Summary

  • Sacks argues that the viral Anthropic “whistleblower” resignation was an orchestrated doomer operation, not a spontaneous act of conscience. Jacob Coxon’s nearly blank account suddenly reached roughly 110 million views; three doomer policy groups amplified it within 10–15 minutes, and The Wall Street Journal’s embargoed story appeared before the tweetstorm. “Show us the data… all he’s got is vibes.”
  • The investor question is what the episode does to Anthropic’s IPO, which Polymarket put at 88%. Chamath argues that alignment lead Evan Hubinger’s public co-sign — including his claim that extinction risk is personally “over 10% within the next decade” — is more consequential than Coxon’s resignation. Anthropic must either disavow the claims and risk an internal revolt or accept the product-liability and disclosure implications, with investors demanding a major discount.
  • Sacks calls it a “time for choosing.” Anthropic’s implicit pitch — frontier AI is dangerous in everyone else’s hands but safe in its own — is, in his view, self-serving regulatory capture. If it agrees with Bernie Sanders that development should be frozen, he asks how it can IPO at a trillions-level valuation; if it rejects the doomer claims, its internal safety cohort may revolt.
  • The panel attacks the doomer track record and argues that the ultimate target is open source. Sacks counts GPT-2, reasoning models, catastrophic cyberattacks, and mass job loss as a 0-for-4 record. He argues that an “FDA for AI” could require centralized monitoring and rollback that open models cannot provide, effectively banning published weights and creating a government-backed duopoly.
  • Chamath, not Friedberg, makes the core counter to the precautionary principle: recursive self-improvement needs only power, chips, and an internet connection, so a US ban would leave the country behind while development continued elsewhere. Friedberg separately frames doomerism as a recurring social-panic pattern, while Jason argues that existential-threat narratives have historically been used to centralize power.
  • OpenAI’s Navier–Stokes result is presented as brute-force leverage rather than supernatural intelligence, while the discussion raises serious data-leakage concerns. Friedberg estimates 130 billion output tokens across 10,000 agents as roughly 50,000–500,000 human work-years. Chamath calls zero data retention “Swiss cheese” and recommends sovereign infrastructure such as a controlled VPC or bare-metal deployment; he predicts some CIOs will be fired for careless API deals.
  • Jensen Huang called Coxon’s claims “outlandish and deeply untrue,” prompting Sacks to ask why Anthropic has not said the same. Sacks characterizes Anthropic’s response as mealy-mouthed and interprets its reluctance to disavow the claims as evidence of internal and strategic tension; that remains his interpretation, not an established fact.
  • Nike’s removal from the S&P 100 after 18 years is attributed to channel destruction, product deterioration, and disputed marketing choices. Jason calls the Kaepernick campaign a turning point; Sacks criticizes the broader “woke” repositioning; Friedberg says the shoes themselves deteriorated. Chamath’s proposed recovery is a return to “mastery and excellence,” the aspirational North Star he says made Nike powerful.

Deep dive

1. The resignation heard round the internet — and why the numbers don’t add up

  • The trigger: Jacob Coxon, a researcher who spent three years across OpenAI and Anthropic but only six weeks at Anthropic before quitting, posted that “the people building AI earnestly believe that it could kill us all by the end of the decade. This is not a marketing stunt,” accusing both labs of “racing straight to self-improving superintelligence and gambling with our lives.” Jason notes he had not seen roughly 150 million views on a tweet since Elon’s cocaine-in-Coca-Cola joke.
  • What lit the fuse legally and virally: Evan Hubinger, who leads alignment science at Anthropic, replied, “Jacob is correct here. We really do earnestly believe AI could kill all humans! I personally think it is over 10% within the next decade. We do not yet have a plan to solve alignment.” The two posts reached roughly 200 million combined views, and Bernie Sanders cited them in connection with legislation to ban superintelligence; JB Pritzker called to “sound the alarm louder.”
  • Chamath asks how someone with almost no followers or prior activity could appear on a Monday and reach 110 million views on Tuesday. Coxon had contacted Jason about coming on the podcast, then canceled that morning, which Jason frames as possibly avoiding cross-examination by Sacks.

2. Sacks’ forensic case for a coordinated op

  • Sacks’ evidence chain: a blank or scrubbed account was amplified within 10–15 minutes by three organized doomer groups — Nathan Calvin, general counsel at Encode AI, the head of policy at the AI Policy Network, identified in the discussion as likely Peter Wildeford, and Daniel Kokotajlo of the AI Futures Project, who released a Rogan episode using similar language at the same time. Sacks says all three groups are funded by Jaan Tallinn, an EA mega-donor and Anthropic Series A co-lead. Later, he also names Dustin Moskovitz and Sam Bankman-Fried in connection with the Series A.
  • The apparent clincher is The Wall Street Journal’s story appearing minutes before the tweetstorm. Jason explains that this likely means the Journal was briefed under embargo and published at the wrong time. Sacks says the story was “teed up,” not spontaneous.
  • Sacks challenges the “whistleblower” label: “What evidence has he brought forward that we didn’t have? This is all just vibes… Show us the data, show us the report, show us the leaked information.” He also highlights the anomaly that, unlike in a typical whistleblower case, people inside the company amplified rather than rejected the claims.
  • His broader claim is that overlapping economic, political, and ideological interests may have converged around the same story. He does not claim Bernie Sanders personally participated in creating it; he says Sanders may have received it quickly through existing relationships because it served his agenda.

3. The endgame: an FDAI that exists to kill open source

  • Sacks says the groups want a federal department of AI or AI regulator that can impose their preferred framework. He argues the mechanism for banning open source will not be called a ban: regulators will apply the same standards to open and closed models, then require central monitoring, control, and rollback — requirements he says are technologically impossible once open weights are published.
  • The coalition he sketches includes ideological EA and rationalist groups that favor centralized solutions, politicians such as Sanders who gain power from public fear, and OpenAI, which Sacks says is running in Anthropic’s regulatory slipstream. A government-created moat could produce a duopoly with economic benefits for the labs and power benefits for regulators.
  • Sacks’ COVID counterfactual imagines the trust-and-safety regime applied to personal AI. Someone asking an AI about vaccine risks might receive the government’s official answer rather than an independent assessment, producing a more centralized and dystopian information system.
  • Friedberg adds that open source has no single corporate entity to make regulatory submissions or participate in the proposed review process. Yet he says open source can reduce AI costs by 50x and spread the benefits broadly. Sacks’ warning is that whoever controls the regulatory “gas pedal” can declare that open source has not complied and prohibit it.

4. Friedberg’s macro frame: hysteria; Chamath and Jason on control

  • Friedberg compares the current AI panic with Al Gore’s An Inconvenient Truth and IPCC forecasts that he says have been disproven, Fauci’s COVID warnings and resulting lockdowns and spending, and Three Mile Island–era opposition to nuclear development. He contrasts the estimated cost of a US nuclear gigawatt — roughly $15 billion — with about $4 billion in France and $1 billion in China.
  • He says social panic becomes self-reinforcing: data centers poll at negative 80 because people are frightened of what they do not understand. Humans, in his framing, are primates facing an unfamiliar frontier and instinctively treating it as an existential threat.
  • Chamath’s separate argument is that recursive self-improvement needs only adequate power, chips, and an internet connection. A US ban would not require approval from every government; someone elsewhere could continue, leaving the US like “the tribe in the Amazon that has never seen civilization.”
  • Chamath also says the core motivation behind the regulatory campaign is control: give some agency, senator, or regulator the power to decide how AI develops.
  • Jason broadens that into a theory of power structures. He argues that many systems of authority have used an existential-threat narrative — “you will all die; give me the power to protect you” — to centralize control.

5. Anthropic’s impossible position: Philip Morris with an S-1

  • Chamath’s securities-law framing draws on IPO examples. He recalls Google’s Playboy interview appearing during its quiet period and his own CNBC comments about Slack nearly disrupting Slack’s IPO, forcing the company to print the comments and address them in the S-1.
  • His analogy is Philip Morris: Anthropic appears to be saying that its product could be extraordinarily dangerous while still taking the company public without fully resolving how that danger is disclosed. “No company’s trying to raise money by also talking about how they’re trying to destroy humanity,” he says, and argues there is no clear legal precedent for the situation.
  • Sacks formulates the contradiction: public investors are being asked to underwrite a company at a valuation in the trillions while its own safety lead says the core product is unsolved and potentially civilization-ending. “At a minimum, that is the mother of all product-liability lawsuits,” he says.
  • Chamath says an ordinary risk factor — NVIDIA may withhold chips, or competitors may emerge — is not equivalent to employees publicly assigning a greater-than-10% extinction probability to the product.
  • Sacks and Jason agree that the S-1 may need to address the tweets. Sacks says Hubinger’s endorsement is more significant than Coxon’s resignation because Hubinger remains a senior alignment executive who co-signed and amplified the claim.

6. Why Anthropic can’t disavow him

  • Sacks’ “time for choosing” is that Anthropic must either renounce Coxon as an entry-level employee engaging in hyperbole and science fiction, or agree with the substance. If it agrees that frontier AI is civilization-ending, Sacks asks how it can IPO at a trillions-level valuation or reject Sanders’ call to freeze development.
  • Sacks also attacks Anthropic’s implicit solution: frontier AI is too dangerous in everyone else’s hands but safe in Anthropic’s “virtuous and wise” hands. He calls that self-serving and says the company is seeking a monopoly or duopoly through regulatory capture.
  • Chamath says Anthropic cannot simply disavow the claims because rational people are building a real company while a large enough internal cohort genuinely believes the existential-risk argument. Disavowal could trigger an internal revolt.
  • Jason lays out three possibilities: the employees believe the claims and are right; they believe them and are wrong, perhaps with “some level of psychosis”; or the story is part of a coordinated effort to regulate AI, ban open source, and pull up the ladder. He asks whether Coxon is participating or is merely a useful idiot.
  • Sacks resists treating the entire episode as one conspiracy. His view is that there was an organized amplification campaign, followed by different actors pursuing overlapping economic, political, and ideological agendas.

7. The doomer track record: 0-for-4

  • Sacks runs through prior claims: GPT-2 was too dangerous to release; reasoning models were too dangerous, including the model associated with what Ilya Sutskever saw; AI cyberattacks would bring down the banking system; and Dario had forecast that roughly half of entry-level white-collar or knowledge-worker jobs would disappear, alongside 10%–15% unemployment.
  • Sacks counts these as 0-for-4 so far. He says cyber risks remain real, but the best defense is AI-powered cyber defense, and he argues that the job-loss claims have not materialized; the economy has instead experienced job gains.
  • The panel’s running joke is that basic applications still fail: Python autocomplete is imperfect, and booking a hotel room through AI remains unreliable. The gap between those failures and human extinction is presented as an argument against skipping the intermediate steps.

8. “How Do We All Die?” — steelmanning extinction and why it falls apart

  • In Friedberg’s game, the panel tries to construct a 10% human-extinction scenario. Jason proposes a Terminator 2 path in which Claude is integrated into military systems and autonomous weapons. Friedberg proposes internet-connected bioreactors and robots using precursor materials to create and distribute a virulent airborne agent. He acknowledges that this requires many intermediate steps.
  • Friedberg also considers the shutdown of financial networks, but notes that financial institutions maintain hard backups, air-gapped systems, redundancy, and human-in-the-loop procedures.
  • Sacks says the cyber and biological scenarios involve real misuse risks, but the same technology could produce cyber defenses, antidotes, prevention, or cures. He also points to legal penalties and the fact that many capable people do not commit crimes even when they possess the tools.
  • Sacks says the strongest doomer argument is not an ordinary cyberattack but recursive self-improvement: an AI becomes capable of fully automating AI research, creates its own training run, produces a stronger model, and repeats the process without a human in the loop.
  • The counterargument from the panel is that current systems remain far from removing humans from AI development or even mundane applications. Jason says human approval points — such as requiring someone to press a button before a run continues — can be built into the software.
  • Friedberg’s structural argument is that humans operate on human timescales. Even if an AI could analyze a decision instantly, people still need to wake up, meet, approve actions, and perform physical tasks such as bringing a toiletry kit upstairs. Sacks invokes Bill Gurley’s argument that the important question is to identify every intermediate step and the interventions available before reaching an extreme outcome.

9. Jensen breaks the silence mid-show

  • During the recording, Sacks reports that Jensen Huang, speaking at a Goldman Sachs conference, called Coxon’s comments “outlandish and deeply untrue,” and described them as wrong, arrogant, and ignorant of safety work across the industry.
  • Sacks asks why Jensen can say that while Anthropic cannot. He characterizes Anthropic’s public statement as “mealy-mouthed,” meaning vague and noncommittal, and argues that Anthropic’s reluctance to disavow Coxon is consistent with its internal beliefs and regulatory strategy. That is Sacks’ interpretation.
  • Jason contrasts this with an earlier exchange roughly three weeks before, when Dario discussed claims raised by Gavin on the podcast. Jason also reads a response from Anthropic chief brand and communications officer Shasha, dated August 14, saying, “Dario has never said this. Complete and utter nonsense.” Jason speculates that Anthropic’s quiet-period status may have changed, but the transcript does not establish why the company is silent now.

10. Navier–Stokes: brute force in a lab coat

  • OpenAI claimed a result involving the Navier–Stokes equations, written in the 1800s and used to model fluid dynamics. Jason calls it one of the seven hardest mathematical problems in the world.
  • Friedberg’s deconstruction is that the reported 130 billion output tokens across 10,000 agents represent enormous distributed brute force, not a supernatural insight. He estimates the equivalent at roughly 50,000–500,000 human work-years, while noting that even an order-of-magnitude reduction still leaves tens of thousands of years of human knowledge labor.
  • His conclusion is that AI is an engine of leverage. The agents’ messages and work are documented and understandable to humans; the system can reduce years of aircraft-wing, engine, or energy-system design work to minutes or seconds.
  • The controversy is whether researchers’ use of OpenAI products helped the model make progress. OpenAI said, “While unlikely, we cannot rule out that de-identified data derived from their usage of our products helped improve our models.” Sacks believes Noam Brown’s denial that anyone examined the researchers’ prompts and considers it more plausible that OpenAI learned researchers were making progress and applied substantial compute to the problem. Jason says Sam Altman confirmed that OpenAI knew Anthropic was getting close.
  • Sacks still sympathizes with the researchers’ concern because OpenAI is both the provider of the models and a competitor developing breakthroughs in the same applications.

11. ZDR is Swiss cheese: the sovereignty trade

  • Chamath says zero data retention is a commercial best-efforts commitment, not a guarantee. Even if a customer asks a model not to retain a protein-design process, other interactions — such as clicking a Like button — may not be covered by the same promise.
  • He says awareness of this problem is moving through public-company audit and risk committees, with help from firms such as EY and Deloitte. His prediction is that some CIOs will be fired after executives discover that a standard API deal allowed sensitive information to enter a model ecosystem.
  • Chamath’s recommendation is not necessarily open source or on-premises hardware. It is a controlled sovereign deployment: a customer-owned environment or VPC, potentially using AWS, Nebius, or Fireworks, with models provisioned on the customer’s terms. He says sensitive enterprises should not rely on a standard rate-card API without understanding the leakage risk.
  • Friedberg describes asking a frontier model novel scientific questions that it identified as new insights, then later seeing a different account or model version describe the same ideas. He presents this as anecdotal evidence that prior conversations may have influenced training, while acknowledging that he cannot prove the mechanism.
  • His key distinction is that de-identification removes personal or company identifiers, not necessarily the underlying method. “The approach is the IP.” He has ordered two Mac Studio M5s to run local open models and move roughly 90% of sensitive work away from Claude. Chamath cautions that local hardware does not by itself solve collaboration, memory, or shared knowledge-base requirements.
  • Sacks broadens the issue to legal privacy. He says AI chat data currently receives weaker protection than email: a subpoena or court order may suffice where email would require a probable-cause warrant. Because people use AI as a lawyer, doctor, or therapist, he argues that AI conversations should receive at least email-level protection.
  • Sacks also notes that closed-model providers are entering the vertical applications built on top of their platforms. He cites Claude Code and the resulting conflict with Cursor as evidence that customers cannot assume the model provider will not compete with them. “Maybe that’s the law we should pass first before we regulate.”

12. Nike: how to woke your way out of the S&P 100

  • After 18 straight years, Nike was removed from the S&P 100 and replaced by Palo Alto Networks. Jason cites a peak market cap of $264 billion in 2021, peak revenue of $51 billion in 2024, an 80% decline in the stock from its peak, a 30% decline in China sales, and eight consecutive quarters of decline there. Chinese brands Anta and Li-Ning, along with HOKA, On, and Brooks, have gained share.
  • Jason attributes part of the damage to CEO John Donahoe’s aggressive direct-to-consumer strategy, which alienated retail partners and gave competitors shelf space. He also criticizes a reorganization from sport-based divisions such as basketball, football, and tennis into men’s, women’s, and kids’ categories.
  • Sacks calls it another “go woke, go broke” example and criticizes Nike’s movement away from athletes who embodied performance and excellence. He attacks the Kaepernick and Dylan Mulvaney campaigns as inconsistent with the brand. Jason, rather than Sacks, calls the Kaepernick campaign the turning point in his own view.
  • Friedberg says the decline was not just advertising. He says Nike shoes began falling apart within six weeks, prompting him to switch to Brooks. Brooks, owned by Berkshire Hathaway, has achieved nine consecutive years of double-digit revenue growth and reached $1.6 billion in revenue. Friedberg attributes its approach to Buffett’s instruction to make the product better every year.
  • His diagnosis is that Nike shifted from product to narrative, while Brooks kept improving the product.

13. The comeback thesis: mastery and excellence as North Star

  • Chamath says Nike’s North Star was “mastery and excellence embodied through athletics.” He cites Michael Jordan, Tiger Woods, Serena Williams, Pete Sampras, and Roger Federer as people whose performance made the products aspirational.
  • Chamath says he switched from Nike to On partly because Federer represented excellence and mastery. He argues that wanting to become better by following exceptional people is healthy and should not be shamed.
  • His recovery playbook is to restore that North Star, return to retail locations, and sell the product broadly. If Nike again stands for mastery and excellence, he believes tens of millions of customers could return. He calls the brand a “coiled spring” with substantial potential.
  • Jason suggests Nike should also revisit performance-oriented devices and communities such as Strava, while the episode closes with his joking “Do it or don’t” mock rebrand. Sacks calls it the one idea capable of making Nike’s situation worse.