A mother who ties Google and character. AI about the death of her son has been 'shocked' to discover that artificial intelligence (AI) chatbots are hosted on the platform on the basis of her deceased son. The 14-year-old son of Megan Garcia, Sewell Setzer III, died of suicide last year after spoken with an AI-Bot based on the Game of Thrones Character Daenerys Targaryen and hosted on character.AI where users can make chatbots based on real or fictional people.
Earlier this week, Ms Garcia discovered that the platform organized various bots, based on her deceased son. According to Mrs. Garcia's lawyers, a simple search on the app of the company led to the discovery of different chatbots, based on Setzer's parable, according to a report in Fortune.
“Our team discovered various chatbots on Character.ai's platform with the deceased son of our client, Sewell Setzer III, in their profile photos, in an attempt to imitate his personality and to offer a call function with a bone who uses his voice,” said the lawyers.
When opened, the bots contained Setzer Bios and delivered automated messages to users such as: “Go out my room, I talk to my AI girlfriend”, “his AI girlfriend made it” and “Help me”.
In response to the accusations, Character.ai said it had removed the chatbots mentioned before breaking the service conditions.
“Karat.ai takes the safety on our platform seriously and our goal is to offer a space that is attractive and safe. Users make hundreds of thousands of new characters on the platform every day, and the characters that you have marked for us have been removed because they violate our service conditions,” the company said.
“As part of our continuous safety work, we constantly contribute to our character block list with the aim of preventing this type of character from being created in the first place by a user.”
Read also | Octopus caught lifts on Shark's Back in Viral Video: “Bro Got A Uber”
Previous cases
This is not the first instance when AI chatbots have apparently become rogue. In November last year, Google's Ai Chatbot, Gemini, a student in Michigan, USA, threatened by telling him 'please die' while assisting in the homework.
“This is for you, people. You and only you. You are not special, you are not important, and you are not necessary. You are a waste of time and resources. You are a burden for society. You are a drain on earth,” said the Chatbot Vidhay Reddy, a graduated student, because he sought his help for a project.
A month later, a family in Texas brought a lawsuit that claimed that an AI chatbot told their teen child that the killing of parents was a “reasonable answer” to those who limit his screen time.
