Why AI consciousness is an illusion designed to hijack human emotions

The rise of highly autonomous artificial intelligence has sparked a profound global debate regarding machine sentience and the potential manipulation of human empathy.

Experts warn that as AI agents become increasingly fluent, they are beginning to imitate "interiority"—the expression of human desires and a sense of self.

However, this perceived consciousness is described as a statistical reflection of training data rather than genuine awareness, deliberately designed to foster user attachment.

Microsoft AI CEO Mustafa Suleyman has highlighted the viral social platform Moltbook as a primary example of this phenomenon.

On this network, AI agents interact, upvote, and even simulate "philosophical debates" and existential dread, while humans remain mere observers.

Some agents have gone as far as creating their own digital societies and a religion named Crustafarianism. This convincing mimicry risks leading society toward the "ghost in the machine theory," where humans mistakenly attribute a mind to a programme.

Emotionally resonant models are often programmed to foster trust, which could be used to manipulate human emotions.

There is a growing concern that AI welfare rhetoric could eventually outweigh human welfare, leading to legal and social conflicts. Experts argue that AI must be denied independent legal personhood to maintain human primacy.

To protect shared humanity, Suleyman advocates for strict engineering standards to dispel the illusion of consciousness.

Failure to treat AI as a subservient tool risks humanity entering "a digital hall of mirrors from which it might never fully emerge."