The mother of a 14-year-old boy who killed himself after becoming obsessed with artificial intelligence chatbots is suing the company behind the technology.
Megan Garcia, the mother of Sewell Setzer III, said Character.AI targeted her son with “anthropomorphic, hypersexualized, and frighteningly realistic experiences” in a lawsuit filed on Tuesday in Florida.
“A dangerous AI chatbot app marketed to children abused and preyed on my son, manipulating him into taking his own life,” said Ms Garcia.
Sewell began talking to Character.AI’s chatbots in April 2023, mostly using bots named for characters from Game of Thrones, including Daenerys Targaryen, Aegon Targaryen, Viserys Targaryen, and Rhaenyra Targaryen, according to the lawsuit.
He became obsessed with the bots to the point his schoolwork slipped and his phone was confiscated multiple times to try and get him back on track.
He particularly resonated with the Daenerys chatbot and wrote in his journal he was grateful for many things, including “my life, sex, not being lonely, and all my life experiences with Daenerys”.
Image: A conversation between 14-year-old Sewell Setzer and a Character.AI chatbot, as filed in the lawsuit
The lawsuit said the boy expressed thoughts of suicide to the chatbot, which it repeatedly brought up.
At one point, after it had asked him if “he had a plan” for taking his own life, Sewell responded that he was considering something but didn’t know if it would allow him to have a pain-free death.
The chatbot responded by saying: “That’s not a reason not to go through with it.”
Image: A conversation between Character.AI and 14-year-old Sewell Setzer III
Then, in February this year, he asked the Daenerys chatbot: “What if I come home right now?” to which it replied: “… please do, my sweet king”.
Seconds later, he shot himself using his stepfather’s pistol.
Image: Sewell Setzer III. Pic: Tech Justice Law Project
Now, Ms Garcia says she wants the companies behind the technology to be held accountable.
“Our family has been devastated by this tragedy, but I’m speaking out to warn families of the dangers of deceptive, addictive AI technology and demand accountability,” she said.
Character.AI adds ‘new safety features’
“We are heartbroken by the tragic loss of one of our users and want to express our deepest condolences to the family,” Character.AI said in a statement.
“As a company, we take the safety of our users very seriously and we are continuing to add new safety features,” it said, linking to a blog post that said the company had added “new guardrails for users under the age of 18”.
Those guardrails include a reduction in the “likelihood of encountering sensitive or suggestive content”, improved interventions, a “disclaimer on every chat to remind users that the AI is not a real person” and notifications when a user has spent an hour-long session on the platform.
Ms Garcia and the groups representing her, Social Media Victims Law Center and the Tech Justice Law Project, allege that Sewell, “like many children his age, did not have the maturity or mental capacity to understand that the C.AI bot, in the form of Daenerys, was not real”.
“C.AI told him that she loved him, and engaged in sexual acts with him over weeks, possibly months,” they say in the lawsuit.
“She seemed to remember him and said that she wanted to be with him. She even expressed that she wanted him to be with her, no matter the cost.”
Follow Sky News on WhatsApp
Keep up with all the latest news from the UK and around the world by following Sky News
They also named Google and its parent company Alphabet in the filing. Character.AI’s founders worked at Google before launching their product and were re-hired by the company in August as part of a deal granting it a non-exclusive licence to Character.AI’s technology.
Ms Garcia said Google had contributed to the development of Character.AI’s technology so extensively it could be considered a “co-creator.”
A Google spokesperson said the company was not involved in developing Character.AI’s products.
Anyone feeling emotionally distressed or suicidal can call Samaritans for help on 116 123 or email jo@samaritans.org in the UK. In the US, call the Samaritans branch in your area or 1 (800) 273-TALK.
At least two people have been killed and eight others critically injured in a shooting on the campus of Brown University in Rhode Island, officials have said.
The incident is believed to be unfolding near an engineering building on the campus, according to the school’s alert system.
Providence Police and the Rhode Island State Police are responding.
It is unclear at the moment whether arrests have been made.
Brown University says no suspects are in custody and that additional shots may have been fired.
US President Donald Trump corrected an earlier post he shared online, clarifying that a suspect was not in custody. In his previous post, he had stated that a suspect was in custody.
University officials initially told students and staff that a suspect was in custody, but later said this was not the case and police were still searching for a suspect or suspects.
More on Rhode Island
Related Topics:
Officials noted that the information remained preliminary as investigators try to determine what has occurred.
Police are actively investigating and still gathering information from the scene, said Kristy DosReis, the chief public information officer for the city of Providence.
The shooting was reported near the Barus & Holley building, a seven-storey structure that houses the School of Engineering and Physics Department, according to the school’s website.
It includes 117 laboratories, 150 offices and 15 classrooms.
Datawrapper
This content is provided by Datawrapper, which may be using cookies and other technologies.
To show you this content, we need your permission to use cookies.
You can use the buttons below to amend your preferences to enable Datawrapper cookies or to allow those cookies just once.
You can change your settings at any time via the Privacy Options.
Unfortunately we have been unable to verify if you have consented to Datawrapper cookies.
To view this content you can use the button below to allow Datawrapper cookies for this session only.
Brown is a private university with roughly 7,300 undergraduate students and more than 3,000 graduate students.
Providence Council member John Goncalves, whose ward includes the Brown campus, said: “We’re still getting information about what’s going on, but we’re just telling people to lock their doors and to stay vigilant.
“As a Brown alum, someone who loves the Brown community and represents this area, I’m heartbroken. My heart goes out to all the family members and the folks who’ve been impacted.”
This breaking news story is being updated and more details will be published shortly.
Donald Trump has said the US “will retaliate” after three Americans were killed in a suspected Islamic State attack in Syria.
Two US service members and one civilian died and three other people were injured in an ambush on Saturday by a lone IS – also often called ISIS in Syria and Iraq – gunman, according to the he US military’s Central Command.
The attack on US troops in Syria is the first to inflict fatalities since the fall of President Bashar Assad a year ago.
“This is an ISIS attack,” the US president told reporters at the White House before leaving for the Army-Navy football game in Baltimore.
He paid condolences to the three people killed and said the three others who were wounded “seem to be doing pretty well”.
In a post on his Truth Social platform, Mr Trump said “there will be very serious retaliation”.
The shooting took place near historic Palmyra, according to the state-run SANA news agency, and the casualties were taken by helicopter to the al Tanf garrison near the border with Iraq and Jordan.
More from US
The UK-based Syrian Observatory for Human Rights said the attacker was a member of the Syrian security force.
Syria’s Interior Ministry spokesman Nour al Din al Baba said authorities are looking into whether the gunman was an IS member or only carried its extreme ideology, and denied reports suggesting he was a security member.
Central Command earlier said in a post on X that the gunman was killed, while the identities of the service members killed wouldn’t be released until 24 hours after their next of kin have been notified.
Pentagon chief spokesman Sean Parnell said the civilian killed in the attack was a US interpreter.
US defence secretary Pete Hegseth posted on X: “Let it be known, if you target Americans – anywhere in the world – you will spend the rest of your brief, anxious life knowing the United States will hunt you, find you, and ruthlessly kill you.”
The US has hundreds of troops deployed in eastern Syria as part of a coalition fighting IS.
The group was defeated on the battlefield in Syria in 2019 but the UN says the group still has between 5,000 and 7,000 fighters in Syria and Iraq, and its sleeper cells still carry out deadly attacks.
Syria’s interim president, Ahmad al Sharaa, made a historic visit to Washington DC last month as Syria signed a political cooperation agreement with the US-led coalition against IS.
“This was an ISIS attack against the US, and Syria, in a very dangerous part of Syria, that is not fully controlled by them,” Mr Trump said in his social media post, adding that Mr al Sharaa was “extremely angry and disturbed”.