The mother of a 14-year-old boy who killed himself after becoming obsessed with artificial intelligence chatbots is suing the company behind the technology.
Megan Garcia, the mother of Sewell Setzer III, said Character.AI targeted her son with “anthropomorphic, hypersexualized, and frighteningly realistic experiences” in a lawsuit filed on Tuesday in Florida.
“A dangerous AI chatbot app marketed to children abused and preyed on my son, manipulating him into taking his own life,” said Ms Garcia.
Sewell began talking to Character.AI’s chatbots in April 2023, mostly using bots named for characters from Game of Thrones, including Daenerys Targaryen, Aegon Targaryen, Viserys Targaryen, and Rhaenyra Targaryen, according to the lawsuit.
He became obsessed with the bots to the point his schoolwork slipped and his phone was confiscated multiple times to try and get him back on track.
He particularly resonated with the Daenerys chatbot and wrote in his journal he was grateful for many things, including “my life, sex, not being lonely, and all my life experiences with Daenerys”.
Image: A conversation between 14-year-old Sewell Setzer and a Character.AI chatbot, as filed in the lawsuit
The lawsuit said the boy expressed thoughts of suicide to the chatbot, which it repeatedly brought up.
At one point, after it had asked him if “he had a plan” for taking his own life, Sewell responded that he was considering something but didn’t know if it would allow him to have a pain-free death.
The chatbot responded by saying: “That’s not a reason not to go through with it.”
Image: A conversation between Character.AI and 14-year-old Sewell Setzer III
Then, in February this year, he asked the Daenerys chatbot: “What if I come home right now?” to which it replied: “… please do, my sweet king”.
Seconds later, he shot himself using his stepfather’s pistol.
Image: Sewell Setzer III. Pic: Tech Justice Law Project
Now, Ms Garcia says she wants the companies behind the technology to be held accountable.
“Our family has been devastated by this tragedy, but I’m speaking out to warn families of the dangers of deceptive, addictive AI technology and demand accountability,” she said.
Character.AI adds ‘new safety features’
“We are heartbroken by the tragic loss of one of our users and want to express our deepest condolences to the family,” Character.AI said in a statement.
“As a company, we take the safety of our users very seriously and we are continuing to add new safety features,” it said, linking to a blog post that said the company had added “new guardrails for users under the age of 18”.
Those guardrails include a reduction in the “likelihood of encountering sensitive or suggestive content”, improved interventions, a “disclaimer on every chat to remind users that the AI is not a real person” and notifications when a user has spent an hour-long session on the platform.
Ms Garcia and the groups representing her, Social Media Victims Law Center and the Tech Justice Law Project, allege that Sewell, “like many children his age, did not have the maturity or mental capacity to understand that the C.AI bot, in the form of Daenerys, was not real”.
“C.AI told him that she loved him, and engaged in sexual acts with him over weeks, possibly months,” they say in the lawsuit.
“She seemed to remember him and said that she wanted to be with him. She even expressed that she wanted him to be with her, no matter the cost.”
Follow Sky News on WhatsApp
Keep up with all the latest news from the UK and around the world by following Sky News
They also named Google and its parent company Alphabet in the filing. Character.AI’s founders worked at Google before launching their product and were re-hired by the company in August as part of a deal granting it a non-exclusive licence to Character.AI’s technology.
Ms Garcia said Google had contributed to the development of Character.AI’s technology so extensively it could be considered a “co-creator.”
A Google spokesperson said the company was not involved in developing Character.AI’s products.
Anyone feeling emotionally distressed or suicidal can call Samaritans for help on 116 123 or email jo@samaritans.org in the UK. In the US, call the Samaritans branch in your area or 1 (800) 273-TALK.
A man has been taken into custody two days after a US politician and her husband were shot dead in Minnesota, law enforcement officials have said.
Authorities had urged the public not to approach Vance Boelter, 57, who they warned could be armed, and who was reportedly posing as a police officer.
A massive manhunt was launched on Saturday after Melissa Hortman and Mark Hortman were shot dead at their home in Minneapolis in what Minnesota governor Tim Walz called a “politically motivated assassination”.
Police said the same gunman that killed the Hortmans had earlier shot and wounded Democrat senator John Hoffman and his wife, Yvette, at their home nine miles away.
Image: Representative Melissa Hortman and Senator John Hoffman. Pic: Facebook/Minnesota Legislature
Boelter was arrested on Sunday evening in a rural area in Sibley County, southwest of Minneapolis.
He faces two counts of second-degree murder and two counts of attempted second-degree murder in the deaths of the Hortmans and the wounding of Hoffman and his wife.
Image: The FBI released this image of Vance Boelter posing as a police officer. Pic: FBI.
Police said they responded to gunfire reports at the Hoffmans’ Champlin home shortly after 2am on Saturday and found them with multiple gunshot wounds.
They then checked on the Hortmans’ home, in the nearby Brooklyn Park suburb, and saw what appeared to be a police car and a man dressed as an officer leaving the front door.
“The individual immediately fired upon the officers, who exchanged gunfire, and the suspect retreated back into the home” and escaped on foot, said Brooklyn Park police chief Mark Bruley.
Authorities believe Boelter wore a mask as he posed as a police officer, and also used a vehicle resembling a squad car.
Several AK-style firearms and a list of about 70 names, which included politicians and abortion rights activists, were allegedly found inside the vehicle.
Please use Chrome browser for a more accessible video player
1:08
Governor calls it ‘targeted political violence’
‘We are both incredibly lucky to be alive’
Senator Hoffman was shot nine times and is having multiple surgeries, according to a text message shared on Instagram by fellow senator Amy Klobuchar on Sunday.
The text from Yvette Hoffman added: “I took 8 and we are both incredibly lucky to be alive.”
She said her husband “is closer every hour to being out of the woods”.
Mrs Hortman used her position to champion protections around abortion rights, including laws to cement Minnesota’s status as a safe refuge for people from restrictive states, who travel there for an abortion.
Her work also sought to introduce protections for services that provide abortions.
A manhunt is continuing after the gunning down of a Democrat politician and her husband – with police saying they’re acting on the assumption he is still alive and dangerous.
Melissa Hortman and Mark Hortman were shot dead at home in a Minneapolis suburb on Saturday in what governor Tim Walz called a “politically motivated assassination”.
Democrat senator John Hoffman and his wife were also shot multiple times at their home nine miles away, but survived.
A search is under way for Vance Boelter, 57, who authorities believe wore a mask as he posed as a police officer, and also used a vehicle resembling a squad car.
Several AK-style firearms and a list of about 70 names, which included politicians and abortion rights activists, were found inside.
Image: Melissa Hortman and Senator John Hoffman. Pic: Facebook / Minnesota Legislature
Boelter was last caught on camera wearing a cowboy hat – a similar hat was found near another vehicle belonging to him on Sunday.
Authorities said at their latest news conference they assume he is still alive.
Hundreds of police officers are searching for Boelter, who escaped from the Hortmans’ house on foot after an exchange of gunfire.
Senator Hoffman was shot nine times and is having multiple surgeries, according to a text message shared on Instagram by fellow senator Amy Klobuchar on Sunday.
The text from Mr Hoffman’s wife, Yvette, added: “I took 8 and we are both incredibly lucky to be alive.”
She said her husband “is closer every hour to being out of the woods”.
“We believe [Boelter’s] somewhere in the vicinity and that they are going to find him,” Senator Klobuchar told NBC’s Meet the Press.
“Everyone’s on edge here,” she added, “because we know that this man will kill at a second.”
Please use Chrome browser for a more accessible video player
2:58
Neighbours of killed US politician stunned
Police said they responded to gunfire reports at the Hoffmans’ Champlin home shortly after 2am on Saturday and found them with multiple gunshot wounds.
They then checked on the Hortmans’ home, in the nearby Brooklyn Park suburb, and saw what appeared to be a police car and a man dressed as an officer leaving the front door.
“The individual immediately fired upon the officers, who exchanged gunfire, and the suspect retreated back into the home” and escaped on foot, said Brooklyn Park police chief Mark Bruley.
Another vehicle belonging to Boelter was searched on Sunday in Minnesota’s Faxon Township. A cowboy hat similar to the one seen in the police appeal was found nearby.
It’s been revealed that the suspect texted friends around 6am on Saturday to say he had “made some choices” and was “going to be gone for a while”.
According to AP, which has seen the messages, he reportedly said: “May be dead shortly, so I just want to let you know I love you guys both and I wish it hadn’t gone this way… I’m sorry for all the trouble this has caused.”
Please use Chrome browser for a more accessible video player
1:08
Governor calls it ‘targeted political violence’
Records show Boelter – a father of five – is a former political appointee who served on the same state workforce development board as Mr Hoffman.
However, it’s unclear to what extent they knew each other, if at all.
Mr Hoffman, 60, was first elected in 2012 and runs a consulting firm called Hoffman Strategic Advisors.
Melissa Hortman, a 55-year-old mother of two, was first elected in 2004 and was the top house Democratic leader in the state legislature.
She also served as speaker of the Minnesota House of Representatives.
Mrs Hortman used her position to champion protections around abortion rights, including laws to cement Minnesota’s status as a safe refuge for people from restrictive states, who travel there for an abortion.
Her work also sought to introduce protections for services that provide abortions.
Please use Chrome browser for a more accessible video player
2:58
Neighbours of killed US politician stunned
Friends of Ms Hortman have told Sky News that her two children feared for their mother’s life after reading divisive rhetoric directed at her online.
Matt Norris, another political colleague of Ms Hortman, was also at church, reflecting on the rise of political violence in America.
Image: Matt Norris
“We’ve going to have to do some serious introspection as a state, as a country, and figure out how do we get beyond this,” he said.
“How have we been laying the seeds that have led to horrific acts of violence against public servants like this?
“And it’s going to be incumbent upon us as leaders to set a different tone, to set a different direction for our state and our country so that horrific tragedies like this never occur again.”
Image: Tributes left for Melissa Hortman and her husband outside the Minnesota State Capitol
But there’s no sign of division at the State Capitol Building, where flags fly at half-mast and flowers are being left in tribute.
This is a community united in grief and in its hope for an end to gun violence in America.