Entrepreneurs
2 Curated Dialogues
李严冰
Key Views & Dialogues
AI’s Biggest Deployment Barrier Isn’t the Model, It’s Operations | A Conversation with Datadog Chief Product Officer 李严冰
Li Yanbing says AI’s scaling bottleneck has shifted to operations, trust, and token costs exceeding budgets, making observability relevant to business ROI. She says leading AI companies need Datadog’s observability, and models trained on its operational data approach frontier quality at least an order of magnitude lower cost; data leaks and exposed API keys remain adoption risks.
View summary (6)
- 李严冰’s central view is that the biggest obstacle to deploying and scaling AI is how to operate and govern it. Enterprise concerns have shifted from whether AI works to whether it can be trusted and controlled, and then to token costs blowing past budget. The real questions are whether AI delivers correct results, remains controllable and trustworthy, and generates business ROI. Observability is the key to answering them.
- Datadog’s market cap plunged with SaaS stocks early in the year, but the company was among the first to rebound, doubling year to date. Her case: the world’s 10 largest AI companies all need Datadog for observability, and the market consensus is now that AI needs more observability.
- Asked about Datadog’s moat, she points to three layers: operational complexity, data, and proprietary intelligence. Drawing on her experience at Aurora, she says driving involves just 3 controls—accelerate, brake, and steer—while operating large-scale production systems is far more complex than autonomous driving. Datadog has the world’s largest operational dataset, and its proprietary models trained on observability data come close to frontier-model quality at least an order of magnitude lower cost.
- A top AI lab once asked whether it could buy Datadog’s labeled operational data. The request shows that even frontier labs lack depth in specialized domains. She says post-training is now common and lets companies turn their own data into a moat; last year, Datadog acquired RL company Adaptive ML to accelerate its investment in this area.
- While preparing next year’s R&D or AI budget, Datadog found spending growth far exceeded expectations; engineers’ coding-agent costs could be one of its largest budget items. The company can tie token use to outcomes including PR velocity, product stability, feature shipping, and product security—and assess whether spending translates into engineering velocity.
- The enterprise AI risk she worries about isn’t a “world-ending” headline; it’s amateur agents getting the basics wrong. Tools built through vibe coding by non-engineers in sales or HR may use tokens inefficiently or overlook security, creating risks such as leaking business data or exposing API keys. That is a major barrier to wider enterprise AI adoption.
Silicon Valley Coordinates x Datadog Chief Product Officer | HYSTA Chair 李严冰: AI Deployment Enters the ROI Era
AI deployment is shifting from proving feasibility to measuring governance, trust, ROI, and token budgets, making observability central to scaling. Datadog’s moat combines operational complexity, proprietary data, and vertical models near frontier quality at least an order of magnitude cheaper. CLI and Slack expansion broadens its footprint, but amateur agents leaking data or API keys remain an adoption risk.
View summary (6)
- 李严冰判断，AI deployment has moved from proving whether it can be used to measuring whether it can be governed, trusted, and generate ROI. Enterprises must verify that outputs are correct, safe, and reliable while controlling token costs and total budgets that have far exceeded expectations; she argues that observability capable of explaining what AI is doing, how entities relate to one another, and what value it ultimately creates is becoming critical to scaling deployment.
- 李严冰 sees “AI needs greater observability” as a major opportunity for Datadog to emerge from the SaaS valuation trough. She says the company’s market cap has doubled since the start of the year to an all-time high, and that all of the world’s top 10 AI companies rely on Datadog; the market once worried that AI would replace observability, but the consensus has now flipped to “AI actually needs greater observability” （人工智能实际上需要更高的可观测性）.
- The product boundary is expanding from web dashboards to every workflow involving humans and AI agents. Datadog historically built rich interfaces around human users; going forward, it emphasizes that “wherever we work, our tools should be there too”: engineers should be able to invoke observability from the CLI while coding, and teams should be able to do the same from Slack as they collaborate.
- With frontier models from OpenAI and others potentially completing more tasks autonomously, 李严冰 sees operational complexity, domain expertise, proprietary data, and vertical models as Datadog’s moat. She compares the situation with autonomous driving: a vehicle has only 3 control points—acceleration, braking, and steering—while large-scale software and hardware infrastructure becomes far more complex once AI agents are added; she says Datadog’s specialized models are close in quality to top frontier models, but cost “at least an order of magnitude” less.
- The future will not be dominated by a single frontier model across every use case; post-training and enterprise data will become sources of differentiation. One leading AI lab even asked whether Datadog could label and sell its operational data, underscoring how little specialized-domain accumulation general-purpose models still have; Datadog also acquired reinforcement-learning company AdaptiveML last year to accelerate its internal model investments.
- Coding agents may account for the largest share of Datadog’s internal AI investment, but the real KPI is engineering output, not token consumption. The company links usage to PR velocity, product stability, feature delivery, and security improvements; the more immediate risk comes from employee-built “amateur-grade” agents that could leak business data or API keys, not a doomsday scenario in which “AI kills humans.”