In a wide-ranging discussion, Pat Gelsinger, General Partner at Playground Global and former leader at Intel and VMware, shared his insights on the evolving landscape of technology in the AI digital age, highlighting new bottlenecks and areas ripe for innovation.
Gelsinger opened by emphasizing that "energy capacity equals economic capacity" in the AI era, predicting "more and more defaults happening on many of those data center projects because the energy won't be there." He noted the national energy capacity has flatlined or grown minimally, creating a significant headwind for AI expansion. He advocated for more baseload energy like nuclear and highlighted innovations in power delivery, such as 800-volt DC data centers and vertical GAN technology, aiming for single-step power conversion to improve efficiency. Fundamental changes to physics, like superconducting, are also on the horizon to overcome the plateauing power efficiency of CMOS.
Reflecting on his early career, Gelsinger recounted his journey at Intel, contributing to the 286, 386, and 486 processors. He explained how the 486 project essentially "created EDA" (Electronic Design Automation) by inventing Intel's Hardware Description Language (HDL) and collaborating with Berkeley to develop placement, routing, and timing management tools. He draws a parallel to today, suggesting that AI is now beginning to revolutionize chip design, exemplified by projects like Jalapeno, which uses AI for initial design principles.
However, new bottlenecks emerge when technology makes design easier. While AI can enable "awesome design" in three months, Gelsinger points out the subsequent "nine months of silicon processing time," including advanced packaging and integration into "rack-scale solutions" because "nothing's a chip anymore. It's a rack." He stressed the need to compress this time to "a month or two" to keep pace with rapidly evolving AI workloads.
A critical bottleneck is memory. Gelsinger candidly described High Bandwidth Memory (HBM) as a "hideous memory...it's just the best one that we've got." He lamented the lack of "major new memories" over the last 30 years, noting the industry has been stuck with DRAM, SRAM, and Flash. However, with AI being a "memory compute workload" and significant capital pouring into the memory sector, he declared that "memory innovation for the first time in 30 years is nigh upon us." This includes stacked memory solutions, new materials like ferroelectrics, and companies focused on bringing compute and memory closer together. He expressed skepticism about Processing-in-Memory (PIM) approaches, believing they constrain workloads. Regarding stacking, he foresees "nice three, four, five stacks" as a sweet spot rather than highly dense 16 or 32-layer stacks, due to manufacturing yield challenges.
The proliferation of AI inference accelerator chips, with "100 competing processor vendors," is a temporary phenomenon in Gelsinger's view. He predicted a convergence due to three reasons: the unsustainability of extreme compute heterogeneity as AI workloads evolve rapidly; the natural consolidation driven by capital markets, where only a few will achieve the necessary scale; and "winners will pick some winners," implying that major AI players will invest in specific hardware-software co-evolved platforms. He argued that extreme specialization is problematic because "the workloads are going to continue to moderate, and migrate so significantly."
Gelsinger reaffirmed his 25-year-old prediction of "the death of copper," stating that "all I.O. should go to optical." While the core compute-memory complex won't be optical, he sees a shift to optical for I/O in the 2028-2029 timeframe, driven by the need to scale large radix compute clusters and current limitations of copper. This will likely push network architectures towards more predictable, flow-based, circuit-switched optical networks (OCS), blurring the lines between scale-up and scale-out.
Finally, as the former CEO of VMware, Gelsinger addressed the resurgence of virtual machines (VMs) in the context of AI agents. He believes the VM abstraction is foundational and will be recreated for the "agent" era. The focus will shift from servicing hardware and humans to "servicing agents," requiring new embodiments for security, performance, abstraction, and migration – essentially, "V-motion for agents." The challenge lies in enabling humans to set policies and guardrails for these agent-centric virtual environments.