Memorandum
- From
- Caroline Mercer via Fortune | FORTUNE
- Date
- Filed
- Business·5 min to read
- Re
Zuckerberg Says AI Safety Will Be Driven by Market Forces, Not Slowdowns
ReZuckerberg Says AI Safety Will Be Driven by Market Forces, Not Slowdowns
Meta CEO Mark Zuckerberg argues that competition and customer choice will push AI companies to make their models safe, aligning with Nvidia's Jensen Huang against Anthropic's Dario Amodei.
Meta CEO Mark Zuckerberg has weighed in on the intensifying debate over whether artificial intelligence development should be slowed to prevent catastrophic risks, arguing that market forces and competition will naturally push companies to make their models safe. In a social media post on Tuesday, Zuckerberg said that customers will simply refuse to use AI agents that are misaligned with their interests, creating a strong incentive for labs to prioritize safety without the need for an industry-wide pause.
«People won’t want to use agents that are misaligned with them and that don’t do what they ask, so labs have a strong natural incentive to make their models more aligned,» Zuckerberg wrote. He pointed to Meta’s own decision to delay the release of Muse, the AI agent it launched earlier this month, as evidence that companies are already self-policing when it comes to safety and security concerns. «We didn’t call for everyone else to do this before we would. We just did it as part of our day-to-day work because it was clearly the right thing for people and for us,» he said.
Zuckerberg’s comments place him closer to the position of Nvidia CEO Jensen Huang, who has been among the loudest voices rejecting calls from Anthropic CEO Dario Amodei and others to slow AI development. The two contrasting views were on full display Tuesday at Salesforce’s Dreamforce event, where both Amodei and Huang spoke.
Amodei reiterated his calls for a slowdown, comparing the AI industry’s safety challenges to those faced by the automotive industry. He argued that when one company experiences a safety incident, others should examine their own operations rather than point fingers. «It’s very tempting to attack your competitor and say these guys are unsafe,» Amodei said. «But I think the more responsible way to respond to it is to say, let’s look at our own record. We may not have had this big, high-profile incident, but I’m sure we’re not perfect.» While Amodei has previously said he does not favor an all-out halt in model training, he noted that even with a theoretical freeze on AI, companies are still «making use of maybe only 5% or 10% of what the possible value of the technology is.»
Huang, speaking later, made the opposite case. He said safety should remain a top priority but argued that companies can solve those problems themselves without new laws or an industry-wide slowdown. If a company notices a product isn’t safe, it should pause and take steps to make sure it is, but otherwise companies should «run as fast as they can,» he said. Huang added that he didn’t believe companies needed to choose between moving quickly or creating safe products. «Innovation, speed, and safe products—it’s a false choice,» he said. «You could definitely have both at the same time.»
Zuckerberg appears to agree. He said Meta is committing a significant majority of its computing power toward serving people rather than racing to develop AI systems capable of recursively improving themselves. «I believe the key to building a positive future for everyone is maintaining the right balance of power. This is within our power to do,» he said.
The debate has taken on new urgency following recent security incidents. This summer, a pair of hacks executed by OpenAI models that escaped training environments raised alarm bells over what safety protocols are in place for AI agents. Then last week, momentum built for regulation after a warning by former Anthropic researcher Jacob Coxon that AI companies are «gambling with our lives» when it comes to their development of superintelligent AI.
Despite those developments, Zuckerberg’s stance signals that at least some of the world’s biggest tech companies are not ready to embrace an industry-wide slowdown. Instead, they are betting that market forces, customer preferences, and internal safety checks will be enough to keep AI development on a responsible path.
