This article, written by Mustafa Suleyman, discusses the concept of “Seemingly Conscious AI” (SCAI) and the societal risks it presents. Suleyman argues that AI should be built to empower people, not to imitate a person, as the illusion of consciousness could lead to people advocating for AI rights and citizenship. He emphasizes the need for immediate action to set clear norms and standards to avoid the dangers of this development and focus on building AI that is a useful and supportive companion for humans.