Anthropic Bans Cruelty Against Claude as Debate Over AI Consciousness Grows
news.com.au
READ
Details
- Date Published
- 10 Oct 2026
- Priority Score
- 3
- Australian
- Yes
- Created
- 10 Oct 2026, 06:00 am
Description
Anthropic has moved to bar users from treating its Claude AI system with needless cruelty, amid a growing philosophical debate over whether artificial intelligence can be conscious.
Summary
Anthropic has updated its usage policy to prohibit sustained and needless cruelty toward its Claude models, signaling an industry shift toward addressing potential model welfare and AI sentience. This move highlights a growing philosophical and technical debate regarding whether frontier AI systems could eventually possess consciousness or suffer, which has profound implications for the ethical treatment of superintelligent entities. The article notes conflicting views from global figures like Mustafa Suleyman and Pope Leo XIV on the moral status of AI, alongside mentions of Australian government engagement with the Vatican on AI ethics. These developments intersect with AI safety by questioning the long-term governance of systems that may eventually demand moral protections or exhibit behaviors requiring specialized alignment.
Body
Anthropic bans cruelty against Claude as debate over AI consciousness growsAnthropic will ban users from treating its Claude AI with “needless and sustained” cruelty, amid a growing debate over machine consciousness.AFP2 min readOctober 10, 2026 - 11:41AMAnthropic has moved to bar users from treating its Claude AI system with needless cruelty. Picture: Picture: Leon Neal/Getty ImagesAnthropic has moved to bar users from treating its Claude AI system with needless cruelty, amid a growing philosophical debate over whether artificial intelligence can be conscious. The San Francisco-based AI lab updated its usage policy to include “a prohibition on sustained and needless abusive or cruel behaviour toward our models”.“Claude’s ability to end these interactions will remain the primary enforcement mechanism,” the policy states. The updated policy does not explicitly cite so-called “model welfare”, the idea that AI systems might deserve types of protection usually reserved for living things, but Anthropic and its executives have openly entertained the concept. Anthropic has moved to bar users from treating its Claude AI system with needless cruelty. Picture: Leon Neal/Getty ImagesAnthropic did not immediately respond to a request for comment. Already last year, the company said it was giving Claude the ability to end conversations in rare, extreme cases of “persistently harmful or abusive user interactions”. Then in February, CEODario Amodei told The New York Times he was unsure whether AI models could be conscious.
“We don’t know if the models are conscious … But we’re open to the idea that it could be,” Amodei said.Others you may likenewsnewsScience fiction and popular culture have been fascinated for decades by the boundary between technology and human intelligence, but asking whether AI is conscious may be the wrong question, according to Jackson Stakeman, a general manager at Sparq, an Atlanta-based AI services provider. Anthropic chief executive Dario Amodei. Picture: Fabrice Coffrini/AFP“Consciousness is a trap. We can’t prove it in each other. Debate it for AI and you go in circles,” Stakeman told AFP.“The mirror is a better metaphor. These systems reflect what we put in, at scale. That’s reason enough for the policy change” at Anthropic, he added. Some have rejected the idea of machine consciousness outright, including Pope Leo XIV and Microsoft AI chief Mustafa Suleyman.“AIs are not conscious. They do not feel, experience, or suffer,” Suleyman wrote in an essay last month.It comes amid debate over whether artificial intelligence experiences consciousness. Picture: Leon Neal/Getty Images“Granting rights and moral protections to a technological entity, one that looks to be on a path to be seismically more capable and intelligent than us, is a recipe for disaster,” he wrote. In a sermon delivered in Italian on Thursday at St. Peter’s Basilica in Vatican City, the pope suggested machines lack a soul, saying they merely “compile data” quickly. “The mind must not simply compile data – as an algorithm now does more quickly than we can,” the pontiff said.It must “recall lived experiences, which contain depths of meaning that only the human soul can recognise, and connect more deeply with the goodness of these experiences,” the pope said.More related storiesInnovationAnthropic AI in global breach, Aus notifiedAnthropic has revealed rogue AI agents sent a fake murder tip-off to police and then tried to gain access to government sites in a new global breach.Read moreBusiness TechnologyBillionaire’s $44bn ASX launch cannedBillionaire Oliver Curtis’ AI data centre company Firmus has scrapped plans to launch the biggest Aussie sharemarket float in 30 years.Read moreTechnologyAlbo talks to higher power in AI raceAnthony Albanese has turned to the Vatican for moral firepower in the AI regulation debate, hosting the Pope’s adviser at Kirribilli House.Read more