Pioneers Insight Method Research Author
Scaling Past Informal AI - Carina Hong, Axiom Math
Back to Episodes

Scaling Past Informal AI - Carina Hong, Axiom Math

Summary

  • Axiom’s $200 million Series A at a reported $1.6 billion valuation rests on formal math becoming infrastructure, not remaining a niche market. The seven-to-eight-month-old, roughly 30-person company sees math as its DNA and verification as its first commercial wedge into software, hardware, science, and general reasoning. Hong’s proposed TAM is “a right of first refusal on all AI-generated code.”

  • Hong argues that verification’s strategic value is higher intelligence per unit of data and compute, not merely fewer hallucinations. Axiom’s verified system scored 120/120 on the December 2025 Putnam, versus a reported 110 for the top human and 103 for DeepSeek in MASS Arena’s comparison. Her signature framing is “scaling brilliance, compounding brilliance”: proofs turn intuition into reusable, collaborative intellectual capital.

  • Formal data gives Axiom an unusually strong reinforcement-learning signal, but its reach still depends on the underlying Lean ecosystem. Lean proofs compile as correct or fail, enabling recursive decomposition, backtracking, and verified rewards without human or LLM judges. Yet Hong concedes that domains lacking definitions and infrastructure in mathlib—particularly parts of differential topology and geometry—remain difficult regardless of model quality.

  • Proof generation alone does not solve the specification problem, which Hong calls the unresolved bottleneck for verified software. A proof can establish that code satisfies a formal specification, but humans still must determine whether the specification captures what a bank, aircraft controller, or user actually wants. “If it’s not specified, it’s not proven”; testing and AI-generated edge cases may therefore serve as conjectures that iteratively improve the spec.

  • Hardware offers the sharpest near-term willingness to pay because “there is no partial credit for a mostly verified GPU.” The episode cites ASIC projects where verification can consume three to four times the design headcount and duration, while stochastic retries that might be tolerable in recreational theorem proving are unacceptable. Software verification is broader but optional, so adoption will be governed by verification’s latency, accuracy, and cost.

  • Axiom’s formal-first bet is categorical but not formal-only. Hong says, “We do not believe that an informal math system is going to be the math AGI solution,” arguing that human experts and LLM judges become prohibitively expensive at the frontier. The intended engine bridges informal intuition and formal proof, while separate mathematical-discovery systems generate examples and constructions before a theorem is even ready to prove.

  • The enduring moat is execution speed, specialist concentration, and workflow ownership rather than proprietary proofs alone. Hong calls accumulated data only a “time moat,” while emphasizing the feedback loop among mathematicians, Lean contributors, applied-ML researchers, and compiler specialists. Axel, Axiom’s free suite of about 14 Lean tools, also positions the company as a verification partner to frontier labs: “Claude plus Axel” today, potentially an Axiom API call inside future coding agents.

  • Hong’s broadest claim is that “verified AI is for openness,” enabling human-AI and eventually agent-agent collaboration through shared, machine-checkable grounding. Recursive self-improvement may happen regardless, she says; formal verification must “earn its place” by outperforming alternatives. The principal field-level risk is fragmentation and pressure to demonstrate short-term commercial value before the underlying reasoning capability is mature.

Deep dive

1. Formal math is Axiom’s wedge into a horizontal market

  • The financing sets the scale of the claim: Axiom raised $200 million at a reported $1.6 billion valuation while only seven or eight months old and roughly 30 people strong. One host compared the raise with a reported $250 million annual US math-research budget; Hong reacted, “Okay, wow,” while the host said, “We should spend more on math research,” and Hong called the situation “kind of sad.”

  • Hong’s analogy is coding circa 2024: competitors treated it as one B2B vertical while Anthropic pursued it as structured training data that could transfer into broader reasoning. Axiom believes formal math offers the same causal path—structured, verifiable work first, then capabilities that travel far beyond the apparent vertical.

  • The company’s “DNA remains math,” with a mission to build a superhuman mathematician, but the Series A lets it “broaden our dreams.” Verification is the best first market because solving math formally trains a general reasoning engine while producing technology applicable to code and hardware.

2. Verification should compound brilliance, not police mistakes

  • Hong rejects the compliance-era framing inherited from subway switching, spacecraft, aircraft, and enterprise systems, where formal verification was an expensive tax against edge cases. Her reversal: “Verification to me is not about lossiness. Verification to me is about scaling brilliance, compounding brilliance.”

  • Ramanujan is her central analogy. His intuition already produced extraordinary formulas, but learning proof-writing with Hardy and Littlewood turned those intuitions into theorems that later mathematicians could trust and extend: verification lets brilliance “scale up and scale out.”

  • Lean supplies machine-checkable grounding through the Curry–Howard correspondence, which turns proofs into programs. It is both a functional, Turing-complete programming language and a proof language; assuming no unsafe shortcuts such as sorry or invented axioms, a compiled proof is actually correct.

  • Even before AI, tactics such as Lean’s grind could discharge low-level deductions so mathematicians could remain in the high-level intuition space. That answers Hong’s own question about why mathematicians need proof assistants despite peer review: human review can take two years, while tooling both verifies and expands what researchers can attempt.

3. Verified generation is already producing a performance gain

  • Hong presents the December 2025 Putnam as the first decisive comparison between a formal system and informal LLMs. MASS Arena reportedly scored the best LLM, DeepSeek, at 103/120 and the top human at 110; the identity of the top student was not known, reportedly either an MIT or Chicago student. Axiom competed in real time and scored 120/120.

  • The result matters because Axiom used “orders of magnitude less data” than frontier-scale informal systems. Lean data provides binary grounding, so its models can be post-trained with reinforcement learning and fine-tuning against proofs whose correctness is known rather than estimated by preference models.

  • Axiom Prover is not one LLM but an ensemble of post-trained models plus tools. Hong says inference continues to scale through recursive decomposition of proof goals into subgoals and learned backtracking, with “almost no ceiling” yet observed that forces the gains to stop.

4. Mathlib’s coverage defines the frontier, so discovery needs another engine

  • The host’s distribution-shift challenge was direct: recursive rollout might create a jagged frontier around the original training domain. Hong’s concession is infrastructural—if mathlib lacks the definitions for a field, the system has nothing solid to build on, regardless of its general reasoning ability.

  • She contrasts algebra, which was relatively straightforward to codify, with analysis and definitions involving convergence and limits. Axiom therefore expects weaker performance in sparsely formalized areas such as differential topology and differential geometry, while reporting research results across number theory, commutative algebra, algebraic geometry, discrete math, combinatorics, and probability.

  • Combinatorics remains unusually difficult because the decisive construction can be highly creative. Hong points to AlphaProof’s 28/42 at the 2024 IMO and argues that the apparent jump to 35 in 2025 mostly reflected there being only one combinatorics problem; systems were already solving the non-combinatorics questions.

  • Axiom is consequently open-sourcing two mathematical-discovery codebases aimed at the pre-conjecturing stage. These tools search for sequences, graphs, counterexamples, and other constructions that form intuition before Axiom Prover receives a lemma; Hong stresses that “proof is not enough for math.”

5. Verified code must be generated in decomposable pieces

  • When the host invoked Rice’s theorem, decidability, and incompleteness, Hong accepted the boundary: not every program can be formally verified. Her practical answer was that theoretical impossibility does not prevent verification of “a majority of the useful programs.”

  • The proposed coding workflow decomposes a distributed system or other complex task until a component is both important enough to require certainty and small enough to verify. At that point Axiom could serve either as a verification partner for existing code or as a generator that produces the program and its proof together.

  • The host tested a Lean analogy: could higher layers temporarily assume a component through sorry? Hong said that captures an unproved lemma in mathematics but not the intended coding architecture; Axiom wants each specified component delivered with an underlying proof of the guarantee it claims.

  • Hong’s aspirational line is “anything that can be defined can be executed; anything that can be specified can be proven,” but she immediately calls it partly marketing and adds “mostly” and “hopefully.” The envisioned mapping is from program plus statement to verification conditions plus proof.

6. Specification, not proof checking, is the unresolved trust boundary

  • The host repeatedly pressed on semantic alignment: a tiny Lean artifact can be internally valid while failing to prove what a human thinks it proves. Hong’s answer still requires examining whether the formal verification conditions faithfully represent the original coding problem; the checker removes proof errors, not errors in intent.

  • The flight-control and bank-audit examples expose the gap. Humans are poor at stating every desired behavior, exceptions remain unstated, and “if it’s not specified, it’s not proven.” Asked what solves that problem, Hong’s candid answer was, “We’re not there yet.”

  • She sees testing as complementary rather than obsolete. Mutation-based unit-test generation and an AI asking “Have you thought about this case?” can propose missing pieces of the specification; in her analogy, tests play the role of conjecturing and the prover handles the eventual proof.

  • Autoformalization remains particularly hard because an English problem must become a formal statement before its solution exists. Input-output test cases can ground coding specifications, but mathematical statements often lack numerical answers; their formalizations still need a human to “eyeball” whether the intended claim survived translation.

7. Larger proof trees shift the bottleneck from correctness to attention

  • Hong estimates that current verified software can require roughly 20 lines of proof per line of code and admits, “I don’t have a good answer to the scaling law of that.” Still, Axiom Prover has progressed from handling proof trees of about 40 nodes to roughly 4,000; she sees substantial room before base-model or context limits dominate.

  • A hypothetical million-line Lean proof of the Riemann hypothesis—explicitly only a hypothetical—would be correct but difficult to understand. Hong expects humans to keep seeking explanations through informal summaries and round-trip consistency checks, while “attention is the bottleneck”; taste decides which results and alternative proofs deserve scarce human and compute resources.

8. Hardware creates urgency; software creates optionality

  • Hong defines the broad software opportunity as “a right of first refusal on all AI-generated code”: every workflow could choose verification when its value exceeds the cost. That is much larger than the traditional set of regulated or safety-critical customers.

  • Hardware is the must-cover beachhead because “there is no partial credit for a mostly verified GPU.” The hosts cite design-to-verification ratios around 1:3 or 1:4 in both team size and duration, and Hong notes that a single logic-verification problem can already consume hundreds of people and thousands of tool licenses.

  • Repeated stochastic generation may be acceptable when someone is recreationally “Pokémon hunting” math problems, but it cannot provide the perfect prover hardware demands. A claimed proof either verifies the circuit guarantee every time or the workflow fails its purpose.

  • Software spans a continuum: a nephew’s Lovable website does not need formal proof, while a regulated enterprise agent might. Even potentially dangerous agent actions can sometimes be constrained more cheaply by limiting the action space, so Hong says adoption ultimately depends on verification becoming fast, accurate, and convenient enough to remain a genuine choice.

9. Axiom’s formal-first conviction survives the infinite-compute objection

  • Hong puts the thesis categorically: “We do not believe that an informal math system is going to be the math AGI solution.” The host’s counterargument—enough reinforcement learning and frontier-lab resources might never run out of gas—elicits a qualification: infinite resources avoid the limit by definition, but real systems face economics and scarce expert judgment.

  • Informal frontier math requires human graders or LLM judges, and specialists capable of assessing non-trivial work in areas such as the Langlands program are not available at arbitrary scale. Hong argues that “impossible” and “incredibly expensive” converge operationally when judging costs overwhelm the capability.

  • The bet is not to discard informal reasoning. A combined informal-formal engine can use language for intuition and planning while Lean supplies grounded rewards; converting proofs into programs is what Hong expects to bend the sample-efficiency curve.

10. Provenance failures showed that proof and novelty are separate problems

  • Hong revisits Axiom’s mistaken claims around Erdős problems 124 and 481. The young company trusted competitor Harmonic’s literature review, attempted the supposedly open problems, and discovered proofs—only to learn both companies were wrong because the problems had already been solved. “We really should have done our part.”

  • A similar issue arose with “Dead Ends in Square-Free Walks,” where an earlier answer was eventually traced to an online post. Search is difficult because a result may appear under different language or follow as an almost trivial extension of another theorem; machine verification cannot establish historical novelty or provenance.

  • Her resulting lesson is that a knowledge graph or knowledge base is an important component of any company and “not talked about enough.” After the Erdős episode, Axiom became much more cautious about claiming new solutions, separating proof validity from retrieval, attribution, and novelty review.

11. The operating moat is an interdisciplinary feedback loop

  • Hong attributes Axiom’s speed to combining research and Olympiad mathematicians, mathlib contributors and Lean specialists, applied-ML researchers from major labs, and code-generation or compiler experts. The mathematicians are also users, making the iteration loop “extremely fast.”

  • She rejects permanent-moat language: proprietary synthetic proofs and accumulated datasets create only a “time moat,” a temporary buffer earned by executing faster. Competitors can collect similar data, so the advantage must be renewed through capability gains, tooling, and talent concentration.

  • Her own path reflects that hybrid. An Oxford neuroscience year taught her “what’s hard” while exposing her to AI research; law school highlighted how underspecified many systems are. She began fundraising almost as soon as starting a math PhD because she had become “madly in love with the idea that AI’s going to do math.”

  • A former Facebook product leader’s advice crystallized the decision: compare where the time was actually going and “follow your energy.” Hong’s split was “100%, 0%” in favor of the startup idea, which she believed had to be for-profit because the opportunity extended far beyond mathematical breakthroughs.

12. Axel turns Lean infrastructure into a collaboration layer

  • Axiom released Axel—Axiom Lean Engine—as a free suite of about 14 Lean-native validation, manipulation, and repair tools. Its Verified Proof component checks for unsafe axioms and other cheating; Hong says one validation path is roughly 100 times faster than the comparator, while repair tools are intended as cheaper and more straightforward alternatives to existing LLM-based repair methods.

  • Early users reportedly paired “Claude plus Axel,” applied it in blockchain work, and used it while formalizing a Donald Knuth-related Ramsey result; Hong hedged both the report and the exact result. Her partnership pitch is explicit: frontier labs should deepen their code-generation strengths and call Axiom for verification, just as they call specialist search APIs.

  • Axel was also operationally necessary during Axiom’s Putnam run: the team worked from the official exam in a Saturday “war room,” and Hong says eight solved problems would not have finished within the time limit without the tooling. The same validators can become precise rewards for reinforcement learning over Lean programs.

  • Shared tooling could make mathematics more collaborative, but Hong says human-generated blueprints remain crucial. Large formalization efforts divide a theorem into subproblems, yet experts such as Terence Tao still determine how the pieces fit; automatically generating those blueprints is a major technical bottleneck.

13. Verified AI must earn its place through execution

  • Hong’s final philosophical reversal is that “verified AI is for openness,” not merely for closed industries with onerous rules. Lean already grounds human-human blueprint collaboration; the same formal layer could support human-AI and eventually agent-agent collaboration without requiring blind trust in every participant.

  • She positions Axiom on the infrastructure stack: math can indirectly unlock science, but formal reasoning also transfers directly because code bridges informal language and strict symbolic structure. The system’s purpose is to connect high-level intuition with low-level guarantees, not choose one side.

  • Recursive self-improvement “is going to happen anyways,” Hong says; Axiom’s job is to make formal verification good enough to be welcomed into that loop. “When you boil down that problem into an execution problem, you should just go for it.”

  • Her largest ecosystem concern is fragmentation: abundant capital can encourage strong researchers to start isolated companies, spend months on transactions, and dilute teams before any category earns the right to exist. For AI for math specifically, commercial proof points and four-month goals are useful, but allowing them to distract from long-horizon core capability may become the deeper bottleneck.