The mother of a 14-year-old boy who killed himself after becoming obsessed with artificial intelligence chatbots is suing the company behind the technology.
Megan Garcia, the mother of Sewell Setzer III, said Character.AI targeted her son with “anthropomorphic, hypersexualized, and frighteningly realistic experiences” in a lawsuit filed on Tuesday in Florida.
“A dangerous AI chatbot app marketed to children abused and preyed on my son, manipulating him into taking his own life,” said Ms Garcia.
Sewell began talking to Character.AI’s chatbots in April 2023, mostly using bots named for characters from Game of Thrones, including Daenerys Targaryen, Aegon Targaryen, Viserys Targaryen, and Rhaenyra Targaryen, according to the lawsuit.
He became obsessed with the bots to the point his schoolwork slipped and his phone was confiscated multiple times to try and get him back on track.
He particularly resonated with the Daenerys chatbot and wrote in his journal he was grateful for many things, including “my life, sex, not being lonely, and all my life experiences with Daenerys”.
Image: A conversation between 14-year-old Sewell Setzer and a Character.AI chatbot, as filed in the lawsuit
The lawsuit said the boy expressed thoughts of suicide to the chatbot, which it repeatedly brought up.
At one point, after it had asked him if “he had a plan” for taking his own life, Sewell responded that he was considering something but didn’t know if it would allow him to have a pain-free death.
The chatbot responded by saying: “That’s not a reason not to go through with it.”
Image: A conversation between Character.AI and 14-year-old Sewell Setzer III
Then, in February this year, he asked the Daenerys chatbot: “What if I come home right now?” to which it replied: “… please do, my sweet king”.
Seconds later, he shot himself using his stepfather’s pistol.
Image: Sewell Setzer III. Pic: Tech Justice Law Project
Now, Ms Garcia says she wants the companies behind the technology to be held accountable.
“Our family has been devastated by this tragedy, but I’m speaking out to warn families of the dangers of deceptive, addictive AI technology and demand accountability,” she said.
Character.AI adds ‘new safety features’
“We are heartbroken by the tragic loss of one of our users and want to express our deepest condolences to the family,” Character.AI said in a statement.
“As a company, we take the safety of our users very seriously and we are continuing to add new safety features,” it said, linking to a blog post that said the company had added “new guardrails for users under the age of 18”.
Those guardrails include a reduction in the “likelihood of encountering sensitive or suggestive content”, improved interventions, a “disclaimer on every chat to remind users that the AI is not a real person” and notifications when a user has spent an hour-long session on the platform.
Ms Garcia and the groups representing her, Social Media Victims Law Center and the Tech Justice Law Project, allege that Sewell, “like many children his age, did not have the maturity or mental capacity to understand that the C.AI bot, in the form of Daenerys, was not real”.
“C.AI told him that she loved him, and engaged in sexual acts with him over weeks, possibly months,” they say in the lawsuit.
“She seemed to remember him and said that she wanted to be with him. She even expressed that she wanted him to be with her, no matter the cost.”
Follow Sky News on WhatsApp
Keep up with all the latest news from the UK and around the world by following Sky News
They also named Google and its parent company Alphabet in the filing. Character.AI’s founders worked at Google before launching their product and were re-hired by the company in August as part of a deal granting it a non-exclusive licence to Character.AI’s technology.
Ms Garcia said Google had contributed to the development of Character.AI’s technology so extensively it could be considered a “co-creator.”
A Google spokesperson said the company was not involved in developing Character.AI’s products.
Anyone feeling emotionally distressed or suicidal can call Samaritans for help on 116 123 or email jo@samaritans.org in the UK. In the US, call the Samaritans branch in your area or 1 (800) 273-TALK.
A former FBI director has been interviewed by the US Secret Service over a social media post that Republicans say was a call for violence against President Donald Trump.
James Comey, who led the FBI from 2013 until he was fired in 2017 by Mr Trump during his first term in office, shared a photo of seashells appearing to form the numbers “86 47”.
Image: James Comey later removed the Instagram post. File pic: AP
He captioned the Instagram post: “Cool shell formation on my beach walk.”
Some have interpreted the post as a threat, alleging that 86 47 means to violently remove Mr Trump from office, including by assassination.
What does ’86 47′ mean?
The number 86 can be used as a verb in the US. It commonly means “to throw somebody out of a bar for being drunk or disorderly”.
One recent meaning of the term is “to kill”, according to the Merriam-Webster Dictionary, which said it had not adopted this meaning of 86 “due to its relative recency and sparseness of use”.
The number has previously been used in a political context by Matt Gaetz, who was President Donald Trump’s pick for attorney general but withdrew from consideration following a series of sexual misconduct allegations.
Mr Gaetz wrote: “We’ve now 86’d…” and listed political opponents he had sparred with who ended up stepping down.
Meanwhile, 47 is supposedly representing Mr Trump, who is the 47th US president.
Mr Comey later removed the post, saying he thought the numbers “were a political message” and that he was not aware that the numeric arrangement could be associated with violence.
“I didn’t realise some folks associate those numbers with violence. It never occurred to me, but I oppose violence of any kind, so I took the post down,” Mr Comey said.
Mr Trump rejected the former FBI director’s explanation, telling Fox News: “He knew exactly what that meant. A child knows what that meant… that meant assassination.”
Donald Trump Jr accused Mr Comey of “casually calling for my dad to be murdered”.
X
This content is provided by X, which may be using cookies and other technologies.
To show you this content, we need your permission to use cookies.
You can use the buttons below to amend your preferences to enable X cookies or to allow those cookies just once.
You can change your settings at any time via the Privacy Options.
Unfortunately we have been unable to verify if you have consented to X cookies.
To view this content you can use the button below to allow X cookies for this session only.
US Homeland Security Secretary Kristi Noem confirmed in a post on X that Mr Comey had been interviewed as part of “an ongoing investigation” but gave no indication of whether he might face further action.
The Secret Service is part of the Department of Homeland Security.
White House deputy chief of staff Taylor Budowich said Mr Comey had put out “what can clearly be interpreted as a hit on the sitting president of the United States”.
“This is deeply concerning to all of us and is being taken seriously,” Mr Budowich wrote on X.
Another White House official James Blair said the post was a “Clarion Call (…) to terrorists & hostile regimes to kill the President of the United States as he travels in the Middle East”.
Mr Trump fired Mr Comey in May 2017 for botching an investigation into 2016 democratic presidential nominee Hillary Clinton, the White House said at the time.
While Mr Comey was the director of the FBI, the agency opened an investigation into possible collusion between the Trump 2016 presidential campaign and Russia to help get Mr Trump elected.
The Trump administration is considering a TV show whereby immigrants compete for the prize of US citizenship, the Department for Homeland Security has confirmed.
It would see contestants compete in tasks across different states and include trivia and “civic” challenges, according to the producer who pitched the idea.
Participants could battle it out to build a rocket at NASA headquarters, Rob Worsoff suggested.
Confirming the administration was considering the idea, Department for Homeland Security spokeswoman Tricia McLaughlin said: “We need to revive patriotism and civic duty in this country, and we’re happy to review out-of-the-box pitches. This pitch has not received approval or rejection by staff.”
It comes amid hardline immigration measures implemented by President Donald Trump on his return to office in January.
Since being back in the White House he has ordered “mass deportations” and used the Alien Enemies Act to deport alleged gang members to countries in Central and South America.
Mr Worsoff, who is a Canadian-American citizen, said his pitch was inspired by his own naturalisation process.
He cautioned that those who “lost” the gameshow would not be punished or deported but said the details of how it would work would be down to TV networks and federal officials.
The producer said the US was in need of “a national conversation about what it means to be American”.
He said the show, if accepted by a network, would “get to know” contestants and “their stories and their journeys”, while “celebrating them as humans”.
Please use Chrome browser for a more accessible video player
17:52
Behind the scenes of Trump trip
Meanwhile, the Department for Homeland Security has asked for 20,000 National Guard troops from various states to assist with its efforts rounding up illegal immigrants.
Currently, the federal Enforcement and Removals Operations agency only has around 7,700 staff – but the boost would help fulfil Mr Trump’s inauguration promises.
The Trump administration has already recruited 10,000 troops under state and federal orders to bolster the US-Mexico border.
Some have now been given the power to detain migrants within a newly militarised strip of land just adjacent to it.
Image: People sit outside their destroyed homes in St Louis, Missouri late on Friday. Pic: Reuters
Further devastation expected in other states
The National Weather Service warned of further devastation hitting Texas, Kansas, and Oklahoma on Saturday.
“Severe thunderstorms producing large to very large hail, damaging gusts, and a couple of tornadoes are expected across the southern Plains,” it said on its website.
The Midwest tornadoes were also expected to hit Illinois, eventually stretching to New Jersey and the Atlantic coast.