Most people believe humans are different. The reason is that Homo sapiens has evolved to be conscious. Many animals feel pain and pleasure; some appear to be self-aware. But the human mind’s unique potential to exhibit a sense of self marks out every member of the species for special treatment.
In his encyclical in May, Pope Leo upheld this insight by drawing a line between humanity and its growing army of bots. Artificial-intelligence systems, he said, do not undergo experiences or feel joy or pain. He is not alone. Many people feel that to confer personhood on AIs would be an abomination.
Pontifical clarity is blurring with alarming speed. AIs are in their infancy. Yet nearly one in five American 18- to 29-year-olds reports having had “ongoing personal friendship” with a chatbot. China recently stripped bots of human-like traits to limit users’ “emotional dependence” on them.
As sophisticated AIs rapidly become a bigger part of human lives, their makers will engineer them to display a simulacrum of consciousness—perhaps even to gain consciousness itself. The intuition that they are just machines will become harder to sustain. A dangerous trap is being set for the human species.
Many machines outperform humans, but frontier AI models excel at distinctively human traits such as knowing things and articulating ideas. It is still just about possible to think of AIs as engines for predicting sequences of words using mathematics on a massive scale. Given enough time (albeit hundreds of thousands of years), you could run those calculations using pencil and paper. It would be hard to argue that your stationery was conscious.
Despite this, some researchers have started to treat their models like minds. Users respond to human-like AIs, so it makes business sense. And Anthropic has trained Claude to engage in introspection in the hope that when it encounters a new situation it will be more likely to act morally. Some large language models (LLMs) already possess human-like brain structures associated with consciousness, such as a “global workspace” for circulating information between modules. Nothing prevents future AI models from being trained to have more such features.
As we report in our Briefing, that has opened up a furious debate about AI consciousness—one that is aggravated by what philosophers call the “hard problem” of establishing how an inner life emerges from the neurons and synapses in the human brain. Some researchers conclude that AIs may one day become genuinely self-aware.
