Agentic AI is the thing to pay attention to. This is when everything could go wrong: Sam Altman on rapid evolution of AI
"We're going to do a very powerful open source model." - Sam Altman.
“There are two views you can take, you can say ‘Oh man it’s doing everything I do What’s going to happen to me?’ Or you can say there is a new tool and I can do a lot more.”
In a wide-ranging conversation at TED, Sam Altman, CEO of OpenAI, discusses the latest advancements in artificial intelligence, including the impressive capabilities of Sora, the future of AI in various sectors, the critical considerations around AI safety, and his vision for a future shaped by increasingly intelligent machines.
The Astonishing Capabilities of Generative AI: OpenAI’s new image and video generation model, Sora, demonstrates remarkable abilities, even generating abstract concepts like the difference between intelligence and consciousness. This highlights the rapid progress in AI’s capacity to understand and create complex visual content, pushing the boundaries of what was previously thought possible.
This duality reflects the mix of apprehension and excitement surrounding such powerful advancements.
AI as a Powerful New Tool for Humanity: Instead of fearing AI as a replacement, it should be viewed as a powerful tool that can augment human capabilities and enable us to achieve much more. This perspective encourages a proactive approach to leveraging AI’s potential across various domains, fostering innovation and productivity.
This requires a mindset shift to embrace AI as a collaborator rather than a competitor.
Navigating the Economics of Creative Output in the Age of AI: The rise of AI image and video generators raises important questions about intellectual property and the future of creative work. New economic models will likely be needed to ensure that human creativity continues to be valued and incentivized in a world where AI can produce content with increasing ease. Altman acknowledges this, stating:
“The creative spirit of humanity is an incredibly important thing. We probably do need to figure out some sort of new model around the economics of creative output.”
The Importance of Guardrails in AI Development: While OpenAI aims to provide users with greater freedom in their interactions with AI models, there’s a critical need to establish clear boundaries to prevent misuse and real-world harm. This involves ongoing efforts to define safety lines and ensure responsible development and deployment of increasingly powerful AI systems. This delicate balance between freedom and safety is a central challenge in the field.
We will build the best product, not just the best model – Sam Altman
Open Source as a Key Component of the AI Ecosystem: Despite the significant investment required for large-scale AI models, OpenAI recognizes the important role of open source in fostering innovation and transparency within the AI community. They plan to release a very powerful open-source model, acknowledging the trade-offs and potential risks involved in making advanced AI technology widely accessible. This decision reflects a commitment to broader participation in AI’s advancement.
The Exponential Growth of AI Capabilities: The progress in AI is not linear but exponential, with models becoming significantly smarter and more capable at an accelerating pace. This rapid advancement necessitates a shift in focus from predicting a singular “AGI moment” to understanding and preparing for a continuous and transformative evolution of AI. In Altman’s words:
“More important than a when is AGI coming and what’s it you know what’s the definition of it it’s recognizing that we are in this unbelievable exponential curve.”
The Significance of Agentic AI: The next major shift in AI will be the emergence of agentic systems, where AI is set free to pursue projects autonomously, interacting with the internet and other systems to achieve goals. While this holds immense potential, it also presents the most significant safety challenges, requiring careful consideration of how to implement necessary guardrails.
“Agentic AI is the thing to pay attention to,” Altman warns. “This is when everything could go wrong as we give power to AI to go out onto the internet to do stuff.”
The Convergence of Safety and Capability in AI: As AI systems become more powerful, safety and capability are increasingly intertwined. A truly good and effective AI product must also be a safe product, as users will only trust and utilize agents that they believe will not cause harm or misuse their data. This necessitates a holistic approach to AI development where safety is not an afterthought but an integral component.
The Inevitability of Advanced AI Development: There’s a prevailing sense among leading AI developers that the advancement of AI is inevitable, driving a race to innovate and deploy these technologies as responsibly as possible. This belief underscores the need for proactive engagement and collaboration to shape the future of AI in a way that benefits humanity. The perceived inevitability adds a layer of urgency to discussions around ethical considerations and responsible development.
The Transformation of Software Development Through AI: AI is already having a profound impact on software development, with engineers reporting transformative experiences using new AI models. This suggests that AI will continue to revolutionize how software is created, leading to increased efficiency and the ability to tackle more complex projects. This shift signifies a fundamental change in the landscape of technology and engineering.
“I really believe that society figures out over time with some big mistakes along the way how to get technology right. This is like a discovery of fundamental physics that the world now knows about and it’s going to be part of our world.”
