Anthropic calls for global pause on AI development: system could begin self-improvement without human intervention

AI development company Anthropic is calling on leading AI labs to slow down their development pace. The company warns that artificial intelligence systems are advancing so rapidly that they may soon be capable of improving themselves without human assistance, posing a serious threat to society.

AI company Anthropic has issued a call for the world's leading AI labs to slow their development pace. According to the Wall Street Journal, the company warns that artificial intelligence systems are advancing so quickly that there is a risk of losing human control over their development.

Anthropic emphasizes that a particularly concerning scenario is one in which artificial intelligence becomes capable of independently improving itself, without any human intervention whatsoever. Such recursive self-improvement could lead to a situation where AI development accelerates in an unpredictable and uncontrolled manner.

The company believes that the current pace of development poses serious risks to society as a whole. Anthropic is calling on other major AI labs to join the call and consider how to ensure safer and more responsible artificial intelligence development before the technology reaches a point from which reversal becomes difficult or impossible.

Anthropic, one of the world's leading artificial intelligence development companies and known for its Claude models, has previously repeatedly drawn attention to AI safety issues. However, this latest call is notably sharper in scope and urgency compared to earlier warnings.