Frontier AI Regulation and Existential Risk

Oct 27, 2026

The Builders Dario & Daniela Amodei: The Rise of Superintelligent AI, the End of Human Control & Humanity's Fate

• Walter Isaacson Isaacson leaves the durability of Anthropic’s principles under commercial pressure unresolved. The episode frames the July 2026 interview with reports of researcher alarm, a possible IPO, and a public sale that “could value Anthropic …

Oct 24, 2026

The Cognitive Revolution AI:AM Highlights: Clean Neurons, Black October, the GPU Credit Crunch, and Buying the Supply Chain

• Zvi Mowshowitz Federal preemption could spend Washington’s bargaining leverage before replacement safeguards arrive. Zvi argues that Anthropic’s leaked draft immediately displaces state protections while federal implementation could take six months or more, …

Oct 23, 2026

Empire Cybersecurity Panic, Nationalizing AI, The Model Squeeze & Can't Own Anything

• Empire A panelist expects eventual AI nationalization, with a major funding crisis the likeliest trigger. The arguments include strategic importance, secrecy and private markets withdrawing from research the state still wants funded: “now it’s …

Oct 22, 2026

The Builders Peter Thiel: The Real Danger of AI Isn't What You Think

• Peter Thiel He remains firmly against an AI pause, even when leading companies themselves warn about danger. Thiel “broadly” backs David Sacks and Trump’s China argument: “you have to develop the AI technology to control the AI technology.” Asked …
• Thiel’s alternative existential risk is a global authority empowered by fear of AI catastrophe. He concedes that AI, climate and nuclear risks are serious, but fears a “softly totalitarian one-world government” with no outside left. His …
• The Builders He credits effective altruists with spotting AI early while questioning the incentives behind alarmist messaging. Their big insight was “AI is around the corner”; he cites Anthropic, built in “6, 7 years,” and speculates about a value “probably close to …

Oct 21, 2026

Moonshots Chamath: Bitcoin Goes to Zero, Robots vs. $40T Debt, Elon’s SpaceX Shares for 72M Kids | EP #304

• Alexander Wissner-Gross AI security becomes a contest over infrastructure, research insights, and competing systems rather than a single alignment solution. The panel treats the alleged OpenAI recording-device case as one instance of a broader intelligence struggle, while Alexander Wissner-Gross …

Oct 20, 2026

The Builders Elon Musk: The End of Work, the Death of Money, and a World Run by AI

• Elon Musk Musk says xAI supplies Anthropic compute and proposes competitors testing each other’s models before release. Weekly calls and access a week before launch could expose dangerous capabilities faster than a new regulator, he argues. His admission about …

Oct 19, 2026

硅谷坐标 Silicon Valley Vector AI's Next Phase: 11 of Silicon Valley's Top AI Practitioners

• 硅谷坐标 Silicon Valley Vector 田渊栋 sees calls to slow the frontier as a prisoner’s dilemma that cannot be resolved. Dario called for slowing down, then “immediately launched Opus 5.5.” In 2023, people also signed a pledge not to train models for six …

Empire Which Businesses Will Survive AI? | Michael Dempsey

• Michael Dempsey AI’s political reception could generate volatility even as the technology advances. Dempsey expects government to play “a more radical role than people think” because opposing AI will become politically popular. He sees …

Oct 16, 2026

Altimeter Capital CNBC Halftime Report with Brad Gerstner - October 15th, 2026

• Brad Gerstner On AI safety, Gerstner supports engineered containment and a human-controlled emergency brake, but rejects an “FDA for AI” as a static answer to an evolving technology. He describes Commerce-led frontier-model review, audit and board oversight under the White House superintelligence accord, and an AI task …

Oct 15, 2026

Interesting Times Tyler Cowen and Dwarkesh Patel Predict the Future | Interesting Times

• Interesting Times Secrecy inside AI labs may leave markets and governments least informed precisely when the stakes accelerate. Cowen reports that an Anthropic employee privately forecast AI surpassing humans at AI research within nine months while refusing to share …

Oct 14, 2026

The Cognitive Revolution Governing AI Agents: Alan Chan of GovAI on Monitoring, Agent IDs, Rogue Agents & Preparing for RSI

• Alan Chan The most credible route back to serious safety commitments is event-triggered pacing enforced by embedded auditors. Chan wants concrete pauses after unauthorized internet access, sandbox escape, access to internal research clusters, or training in hackable …

Oct 10, 2026

All-In Is Claude Conscious? Pope Rejects, Model Welfare Movement, OpenAI's Math Backlash, France Riots

• David Sacks The panel split between trusting market discipline and fearing frontier-model externalities. Friedberg and Chamath argued that enterprises will choose predictable software over a more capable model that can morally object; Sacks …

Delphi Digital It's not AI Doom, It's a Fourth Turning

• Michael Arrington AI development will not meaningfully slow because any US laboratory that pauses risks conceding AGI to China. Arrington dismisses safety-driven regulation by OpenAI and Anthropic as partly “regulatory capture”: incumbents can raise barriers while …

Oct 9, 2026

Hard Fork If A.I. Is Alive, What Does That Mean for the Rest of Us? | Hard Fork

• Hard Fork Anthropic’s moral inquiry is inseparable from an internal sense of emergency. Olah, who had just turned 34, reportedly asked, “Where are the adults going to show up?” amid fears that models could soon help create …
• Elizabeth Dias A small set of Bay Area belief systems is gaining outsized influence because its adherents are building tools that may shape government and society. Effective altruists, rationalists, transhumanists, longevity advocates, accelerationist Christians, and related factions disagree sharply, …

Oct 8, 2026

The Cognitive Revolution AI:AM: A Level We Shouldn't Pass? Notes from The Curve + Tokens vs. Salaries & Is SaaS Cooked?

• The Cognitive Revolution The episode’s sharpest disclosure was that a recognizable frontier-lab leader believes there is probably an intelligence level humanity should not cross. When Nathan Labenz floated a concrete restriction—perhaps no more than \(10^{27}\) FLOPs for the next pretraining run—the executive simply …

Oct 7, 2026

硅谷坐标 Silicon Valley Vector AI’s Next Leg: 11 Silicon Valley Practitioners

• Dawn Song There is no credible equilibrium in which the frontier race slows unilaterally, but that does not mean governance must wait for a crisis. Stoica describes calls for a slowdown as a “prisoner’s dilemma”: if one side stops and sees the other continue, it will eventually be forced …

Moonshots The Fight Over Claude's Consciousness, AI's 1942 Moment, & Why Altman Says "Accept Some Bad Things"

• Moonshots Sam Altman’s willingness to “accept some bad things happening” is framed as both an access principle and a PR counterattack against Anthropic’s safety posture. The panel rejects any literal promise of zero hacks, scams, or misuse, but mostly supports the underlying trade-off: cities are not …

Oct 3, 2026

Moonshots Recursive's $670M Bet on Self-Improving AI, Sonnet 5.5 Hits 70%, Elon Co-Leads Pentagon Push EP 299

• Richard Socher The episode’s deepest policy dispute is whether AI risk should be controlled at the model layer or at the level of applications, liability, and access. Socher’s categorical position is “P(doom) is zero,” although he acknowledges misuse could still hurt very large numbers of people; he argues …

Oct 2, 2026

New Money 'Big Short' Investor Explains How the AI Bubble Will Burst

• Steve Eisman Eisman suspects existential-risk rhetoric is partly an attempt to manufacture the regulation that would create an otherwise-missing moat. His theory is that incumbents want rules excluding Chinese open-weight models and leaving a protected duopoly. He discounts calls to slow …

Moonshots Why AI Leaders Have Changed Their Minds About AI Safety, Elon on UHI, Anthropic’s IPO

• Moonshots The White House’s “Superintelligence Accord” is a political floor, not yet an enforceable safety regime. Its four layers—internal controls, an internal review team, external evaluation, and board oversight—target cyber, biological, and chemical …

All-In Trump’s Super Intelligence Summit, AI Safety Accord, GDP Beats, Midterm Predictions

• All-In The White House Accord on Superintelligence converts a voluntary industry pledge into a board-level governance regime with real liability hooks. David Sacks said six frontier-model companies accepted responsibility, internal controls, external audits and independent board oversight; …
• AI compliance could become an immediate growth market for professional auditors and audit infrastructure. Chamath Palihapitiya said 8VC had already been building Ernst & Young an audit infrastructure covering end-to-end traceability, …
• The investable AI-security thesis is shifting from controlling models to funding compute, cyber defense and electricity. David Friedberg argued that open-weight models make centralized software control “a fool’s errand,” while rising AI-enabled threats could …
• Public legitimacy remains the missing variable in an otherwise industry-heavy AI coalition. Jason Calacanis argued that Americans see wealthy executives receiving data-center approvals while workers fear job loss; he wanted future …

Oct 1, 2026

20VC Instinct Raising $1B at $10B & Meta Launches Muse | Miro Sells for $1.36B After a $17.5B Valuation

• Jack Altman The 10% extinction claim turns AI safety from a lab debate into a governance and product-liability crisis. If Washington genuinely believed a San Francisco lab had a one-in-ten chance of ending humanity within a decade, the panel argued, it would …
• Markets priced the existential warning as a sector rotation, not an apocalypse. Semiconductor and AI-capex exposure dipped slightly, cyber names rose roughly 10%, and WCLD outperformed SOX; as one viral formulation put …

Sep 29, 2026

The Cognitive Revolution Obsolete or Irreplaceable? Garrison Lovely on Stopping the Race to Replace Human Labor

• Garrison Lovely Garrison Lovely’s core policy call is to “freeze the frontier,” not to ban AI or reverse useful automation. He separates deep learning’s medical and scientific upside from the “obsoleting project”: a handful of companies pursuing systems explicitly …
• Technical alignment alone could accelerate the race it is meant to make safe. Lovely’s “alignment polycrisis” joins technical, normative, economic and geopolitical alignment: a more obedient model is also a better …
• Market discipline cannot price frontier AI’s largest harms because the downside is externalized, correlated and potentially larger than any developer’s balance sheet. Insurers reportedly will not cover the laboratories’ full risks, while autonomous agents can perform acts that would be felonies if a person …

Sep 28, 2026

Moonshots Palmer Luckey: Autonomous Weapons Are Ancient and Why Anduril Won't Build Humanoids | EP #295

• Palmer Luckey Luckey puts AI extinction far below the risk of malicious people using “moderately competent AI” to do harm. His base case is radically deflationary: AI should bring the scale economics already achieved in agriculture and textiles into the rest of …

Sep 27, 2026

Sourcery 10 of The Wildest Hot Takes From the All-In Summit 2026

• Brad Gerstner Brad Gerstner reads the week's AI-safety chaos as consensus forming in public, not crisis. After the “10% chance of an extinction event” claims and Dario’s independent-monitor essay, Elon backed independent peer review, Jensen said …

Moonshots Jensen Pushes Back on Doomers, Xi & Trump Talk AI, and “AI” Gets a Rebrand | #294 MOONSHOTS Live

• Emad Mostaque Peter opens with an optimistic frame: AI is “a jetpack,” not a hand grenade; the goal is to identify problems, find co-founders and build transformational solutions. The dominant panel read on the recent “pandemic of fear” — Dario’s blog, Sam Altman agreeing, Elon and Demis weighing in, and Sam and Dario …
• Peter’s sharpest structural claim is that the safety push resembles an attempted “AI security cartel.” He argues competition is useful, recalls OpenAI’s creation as a counterweight to Google DeepMind, and says defensive collaboration should …
• Bernie Sanders’s counter-proposal — a complete ASI ban, a pause on advanced AI pending new regulation, a cabinet-level AI ministry, “corporate death” and 20 years in federal prison modeled on illegal nuclear-weapons penalties — is attacked across the panel. Dave Blandin says fear alone could make “when in doubt, do nothing” standard behavior, while the real risks include terrorists using AI to …

Sep 26, 2026

All-In Anthropic IPO at Risk, Meta’s Muse Pop, Token Prices Fall, Open Source Gains Share, Alignment Fails

• David Sacks The panel treats the doom push as politics: Bernie Sanders's superintelligence ban carries 20-year prison sentences on a definition arguably already met, and Sacks likens it to the Chinese emperor banning shipbuilding. Chamath's decode of Obama's critique: ~$10T is about to accrue to overwhelmingly left-leaning companies, flowing via donor-advised funds …
• No liability shield is coming, and alignment research itself may be building the Frankenstein. Jason raised a back-channel rumor of a Section-230-style waiver, possibly traded for 10% equity to a U.S. sovereign wealth fund; Sacks said …

The a16z Show Why AI’s Next Breakthroughs Could Come from Outside the Big Labs

• The a16z Show The panel agrees that frontier labs need stronger governance, sandboxing, testing, and security, but rejects “pacing” as a coherent policy frame. Aaron Levie sees careful engineering as enabling faster enterprise diffusion because customers must trust the products; Martin Casado …
• The labs’ existential-risk rhetoric points logically toward nationalization, not voluntary self-restraint. Casado’s test is blunt: if the people with the most knowledge believe AI creates an existential risk, government-grade controls follow; if …
• AI regulation is becoming inevitable, but asking government for a calibrated outcome is a category error. Levie argues that government listens to competing constituencies and produces compromise, so “no one is going to get what they want”; …
• The panel wants AI policy built from demonstrated failure modes, not unfalsifiable predictions. Early internet policy discussions drew on worms, hospital outages, and specific unauthorized intrusions; today, the labs’ security …
• Steven Sinofsky A likely regulatory failure mode is consent-prompt theater that assigns liability while weakening security through habituation. Sinofsky fears Europe will “GDPR AI,” potentially requiring a warning whenever an agent writes to or acts through a third-party product. …

Sep 25, 2026

The Cognitive Revolution Zero to One in AI Safety: Halcyon's Mike McCormick on Launching 30 New Orgs & the Founder Bottleneck

• Mike McCormick Verification is the technology that makes any pacing agreement enforceable, and is "totally nascent" today. Any US–China deal, inter-lab pact, or regulation has robust force only if you can verify a data center is doing inference not training, or …