The other day I was helping an elderly family member purchase something from the Internet. They were talking to a chat bot. One of the automated replies was a voice recording. There was not much "AI" in it, just a bunch of spam in Whatsapp all the time telling them to purchase all sorts of products. They were added to multiple "group chats" where only admins could send messages (i.e. a spam fest). But what worried me was that because the automated messages are never marked as such, I wasn't sure if they were perfectly aware that they were talking to a bot, since it seemed they were tried to have a conversation, saying hello and explaining things. Maybe that's just they think that's how bots work, and, loosely, the bot responds appropriately, by ignoring almost everything all the time and just spamming more.

I found it repulsive on a visceral level.

Add AI to this and I'll need to start praying to God to give me the restraint of not breaking other people's smartphones.