Already, Anthropic’s popular chatbot Claude is operating on code of which 80% the system wrote itself. Getting to 100% is possible within two years, Clark said, and “would have huge implications”.
Clark did not outline how a “brake pedal” for AI research and development could be created, but drew a parallel between AI and the oil boom and barons of the turn of the last century.
“Society’s response was to come up with a sensible policy and regulatory framework that gave people confidence in oil and the benefits that oil could provide to the world, and meant that you didn’t have to worry about the personalities of the people leading the companies”, Clark said. “That’s clearly where we end up here.”
Yet, Anthropic this week welcomed an executive order, external on AI from US President Donald Trump that was relatively hands-off in its directives toward the companies.
It did not require AI companies to submit to safety testing by the government, something that remains a voluntary effort.
Major AI companies pursuing advances in the technology, including Anthropic, OpenAI and Google, have also not said they will pause their own research.
Anthropic has grown so quickly since its founding five years ago that it is preparing to debut on the public stock market.
It is poised to be one of the first public listings by a newer AI firm and one of the most valuable stock listings in history, as Anthropic’s valuation is estimated by private investors to be nearly $1tn (£745bn).
Clark said Anthropic’s motivation for publicly discussing the growing capability of AI technology is not to further burnish its reputation with paying customers.
He simply wants to “tell the world what we’re seeing inside these companies with this unusual technology”.