Pat Gelsinger: AI’s ‘headwind’ is not chips, but energy capacity

Pat Gelsinger: AI's 'headwind' is not chips, but energy capacity
Former Intel CEO Pat Gelsinger explains why the memory industry was historically a "terrible industry" and how AI has transformed its value.

ON THIS PAGE

Pat Gelsinger, former CEO of Intel, offers a unique perspective on the evolution of hardware and the future of computing. With a career spanning decades in the semiconductor industry, Gelsinger has witnessed firsthand the challenges and breakthroughs in chip design and manufacturing.

He highlights persistent bottlenecks, such as the nine-month silicon processing time, and the surprising stagnation in memory innovation over the past 30 years. These Big Ideas are drawn from Pat Gelsinger's interview with a16z.

  • AI transforms memory industry value. Pat Gelsinger explains that the memory industry was historically plagued by 'violent commoditization cycles,' which discouraged long-term R&D. However, the demands of AI workloads have fundamentally changed this dynamic, making the three major memory vendors among the top 20 most valuable companies globally, signaling a new era for memory innovation. ▶ 23:51

  • Mid-rise stacks for memory and compute. Pat Gelsinger predicts that the 'sweet spot' for practical memory and compute integration will be 'mid-rise' stacks of three to five layers. This is because manufacturing yield for individual layers must improve exponentially with increased stack dimensionality, making highly complex 16-32 layer designs impractical. ▶ 28:59

  • The 486 microprocessor's EDA legacy. The Intel 486 microprocessor was the first chip to implement modern Electronic Design Automation (EDA) techniques. This involved inventing tools such as the Intel hardware description language (HDL), its compiler, and automatic place and route systems, which were crucial for its design and manufacturing. ▶ 7:11

  • Persistent hardware bottlenecks. Pat Gelsinger identifies significant bottlenecks in hardware innovation, including the nine-month silicon processing time, limitations in memory bandwidth, and inadequate power and thermal simulation tools. These issues mean that even if a design can be completed quickly, its deployment can be significantly delayed, potentially leading to obsolescence. ▶ 10:02

  • Three decades of memory stagnation. Pat Gelsinger notes that despite his personal involvement in at least five new memory architectures, none have achieved widespread adoption over the past 30 years. The industry has largely relied on DRAM, SRAM, and flash memory, indicating a long period of stagnation in fundamental memory innovation. ▶ 23:07

  • Energy capacity as an AI headwind. Pat Gelsinger states that insufficient energy capacity will be a significant 'headwind' for AI development. The ability to power new data centers and millions of GPUs is becoming a limiting factor, with projects like Oracle's 'Comet' serving as early indicators of this challenge. ▶ 45:07

  • VMs for agents vs. humans. Pat Gelsinger explains that designing virtual machines (VMs) for agents, rather than humans, significantly alters their form factor and marketing. Agents require much faster startup times and are less patient than human users, necessitating a different optimization approach for VM offerings. ▶ 50:45

Watch the full original interview on YouTube

Make sense of what's next.

A clear-eyed digest of AI, products, and ideas worth understanding. Join the NextBigWhat newsletter.

Free. Unsubscribe anytime.

more AI news

Andrej Karpathy highlights AI capability gap as enterprise readiness lags

Andrej Karpathy emphasizes that only a small fraction of people, around 5,000, have fully grasped the potential of AI, indicating a growing gap in AI capabilities. Meanwhile, Box CEO Aaron Levie predicts the future of agent swarms in AI, though he notes that most enterprises are currently unprepared to implement such advanced technologies. This highlights the need for increased awareness and readiness among businesses to leverage AI effectively.

Meta AI launches Muse Wonder, advancing personal and professional agent capabilities

Meta AI Research has introduced Muse Wonder, a new frontier model designed for enhancing personal and professional agent functionalities. This innovative model features a Responsive Step and Repeat hero animation, showcasing its advanced capabilities. The development is set to influence how users interact with AI, potentially transforming productivity and user experience.

Google launches synth-id to identify AI-generated content

Google has introduced a standalone platform called SynthID Detector, designed to help users determine if online content was generated using Google AI or its partner tools. This initiative aims to enhance transparency and trust in digital content, amidst growing concerns about the authenticity of AI-generated materials. The tool reflects Google’s commitment to ethical AI usage and the accountability of content creators.

US halts green card access for major IT firms amid H-1B abuse claims

The US Department of Labor has suspended major tech companies, including Microsoft, Infosys, and Cognizant, from the green card program due to allegations of H-1B visa abuse. This decision impacts several prominent IT firms such as TCS, Wipro, and Capgemini, potentially affecting their ability to recruit foreign talent. The move underscores increasing scrutiny on visa practices within the tech industry.