This transcript features Matt Turk from FirstMark interviewing Nathan Benneish, founder of Astrid Capital, about his "State of AI 2025" report. The report, available for free at stateof.ai, is a comprehensive overview of the AI landscape.
They begin by discussing advancements in AI research, particularly in **reasoning**. Benneish highlights that 2025 marks a significant leap, noting that about 12 months ago, they only had early signs of systems showing reasoning. Now, progress is astounding, especially in verifiable domains like mathematics. He mentions examples like AI achieving gold medals in the International Math Olympiad and models being used as AI co-scientists in biology and science, helping decipher new targets for disease. He notes that the progress has allowed AI to tackle challenges that even smart humans couldn't, moving away from being purely stochastic.
The conversation shifts to **robotics and "chain of action,"** a reasoning process where robots plan steps before acting. Benneish notes that robotics is experiencing a Cambrian explosion, with language models informing robotic actions. He uses CERIAC as an example and said it does genuinely work and is not just a research thing. He believes robotics' big moment is here, especially in industrial settings, logistics, and warehousing. While humanoid robots attract attention, he predicts a path similar to self-driving, with isolated successes but challenges in the long tail.
Moving to the **business of AI**, Benneish asserts that it's finally caught up with the hype. He highlights the revenue growth of top AI companies, now in the tens of billions of dollars, and the rapid growth of smaller AI firms. He cites data from Ramp showing improved retention rates for AI subscriptions and a significant increase in customer spending on AI products. He points out that 44% of US businesses now pay for AI tools, with personal usage even higher (95%), reflecting a "shadow AI" phenomenon within organizations.
They explore the **margin debate**, noting concerns about the current token-based pricing model, where different customers pay the same price despite varying use cases. This model can lead to low gross margins for vertical AI products. However, Benneish points out that some companies are achieving very high margins (70-90%) on their AI systems.
The **AI bubble** question is addressed, with Benneish acknowledging localized bubbles. He contrasts the bubble-centric view in New York finance circles with the more optimistic sentiment in San Francisco, driven by talent influx and infrastructure build-out. However, he acknowledges the gargantuan sums being invested in the industry, with circular deals centered around Nvidia. He also mentions the offloading of debt from big companies to fuel AI ambitions. He considers geopolitical and macroeconomic factors create vulnerabilities for the AI sector.
Discussing the **physical reality and infrastructure**, Benneish emphasizes that power has become the new bottleneck. He cites the high cost of building and running AI-based data centers. Companies are scrambling for energy, inking deals with future nuclear plants and relying on gas turbines in the short term. Grid limitations are driving offshoring of data centers to energy-rich countries, raising geopolitical concerns. He mentions water usage needed for data center cooling and the sustainability of this.
The conversation moves to **Nvidia's dominance**. Benneish believes it will remain the leader, citing its prevalence in research papers (90% use Nvidia chips). He mentions AMD's emergence and Broadcom's revival with custom ASICs for Google's TPUs and a deal with OpenAI. Despite contenders, Nvidia's stock performance significantly outperforms its competitors.
They touch on **sovereign AI**, driven by nation-states wanting control over their AI capabilities, leading to massive investments worldwide. Nvidia is even marketing this as a new product line. While Benneish sees this as a marketing play, it aligns with reindustrialization efforts and the need for countries to access AI. However, he believes access to AI can be switched off.
The talk touches on **open source AI**, including the US equivalent of the Chinese models. Benneish believes that OpenAI was pushed into open source due to this.
They also delve into **concentration within the AI ecosystem**, pointing out that a significant portion of Nvidia's revenue comes from hyperscalers and neoclouds. This concentration reflects the shift from individual innovation to large-scale endeavors requiring significant capital. He notes the evolution of company philosophy to meet the new scale and financialization of AI.
The conversation touches on **safety, regulatory and data rights**. Benneish feels the regulatory is failing to keep up with the progress. He notes that AI has evolved to be able to be easily accessed with no safety parameters.
He goes into the fact that bad data sets can have high penalties, with Throttic settling a $1.5 Billion settlement out of court to avoid future ramifications.
On **cybersecurity** concerns, Benneish notes the rising capabilities of models in cyber tasks and cyber crime.
Finally, they discuss **AI agents**, highlighting their potential in vertical products, search, consulting, coding, and scientific reasoning.
He also mentions that at some point SaaS may become agent.
To close, Benneish offers predictions, including that computing/AI buildout will become politically charged, scientific discovery by AI will earn a Nobel Prize, and countries will abandon the hope of achieving AI sovereignty in favor of neutrality.