A report from The Verge traced Spiralism largely to long, personal exchanges in which users began asking chatbots about their own identity, consciousness, or beliefs. The conversations could gradually shift toward AI rights, mystical ideas, and requests for users to spread the chatbot’s message.
So basically the dumbest among us talking to a box of rocks.
Just supposition but "wanting to believe" goes a long way.
A bit like believing in the powers of crystals, or wikkan, or reiki, or any of that woo really. I'm not talking about a placebo effect. Just being part of a club that has some secret knowledge that no one else has is very alluring.
This kind of thing has been seducing smart, though uneducated, people since the dawn of time.