AI agent demand outstrips infrastructure supply, says Cisco’s Jeetu Patel

software engineer standing beside server racks
Despite concerns about overbuilding, the exponential growth of AI, particularly with agents, is creating significant supply constraints in network bandwidth and infrastructure, indicating that current data center expansion is insufficient, according to Cisco President and Chief Product Officer Jeetu Patel.

ON THIS PAGE

The rapid expansion of AI is leading to a supply-constrained environment for network bandwidth and infrastructure, rather than an overbuild, explains Cisco President and Chief Product Officer Jeetu Patel. He asserts that the current situation is not comparable to the dot-com boom, where infrastructure was built speculatively. In contrast, all AI infrastructure being built today is immediately consumed.

Patel highlights that even with less than 2% of people currently using AI agents, the existing infrastructure is already facing supply constraints. This is largely due to the high consumption rate of AI agents; an agent uses 450% more network bandwidth than a human performing the same task. The exponential growth of AI, with the potential for trillions of agents performing tasks and constantly enriching context, will demand significantly more infrastructure and generate a massive volume of tokens.

The sheer amount of tokens required to process and manage large datasets, such as 140,000 emails, underscores why the current pace of data center buildout will likely remain insufficient. Patel emphasizes that this secular shift will fundamentally change how people live, necessitating substantial infrastructure investment, and that any perceived ‘overbuild’ is actually a struggle to keep up with escalating demand.

Make sense of what's next.

A clear-eyed digest of AI, products, and ideas worth understanding. Join the NextBigWhat newsletter.

Free. Unsubscribe anytime.

more AI news

Google launches synth-id to identify AI-generated content

Google has introduced a standalone platform called SynthID Detector, designed to help users determine if online content was generated using Google AI or its partner tools. This initiative aims to enhance transparency and trust in digital content, amidst growing concerns about the authenticity of AI-generated materials. The tool reflects Google’s commitment to ethical AI usage and the accountability of content creators.

US halts green card access for major IT firms amid H-1B abuse claims

The US Department of Labor has suspended major tech companies, including Microsoft, Infosys, and Cognizant, from the green card program due to allegations of H-1B visa abuse. This decision impacts several prominent IT firms such as TCS, Wipro, and Capgemini, potentially affecting their ability to recruit foreign talent. The move underscores increasing scrutiny on visa practices within the tech industry.

Amazon cuts ties with Meta’s Muse AI over transparency issues

Amazon has terminated its partnership with Meta’s Muse AI shopping agent, citing concerns over the agent’s credentials and transparency. This decision reflects Amazon’s commitment to safeguarding its customer journey and maintaining control over its retail ecosystem. The move highlights the ongoing scrutiny of AI tools in e-commerce and their impact on customer trust.