‘A gut punch’: Character.AI criticised over ‘horrific’ Brianna Ghey and Molly Russell chatbots
The NSPCC is warning an AI company that allowed users to create chatbots imitating murdered teenager Brianna Ghey and her mother pursued “growth and profit at the expense of safety and decency”.
Character.AI, which last week was accused of “manipulating” a teenage boy into taking his own life, also allowed users to create chatbots imitating teenager Molly Russell.
Molly took her own life aged 14 in November 2017 after viewing posts related to suicide, depression and anxiety online.
The chatbots were discovered during an investigation by The Telegraph newspaper.
“This is yet another example of how manipulative and dangerous the online world can be for young people,” said Esther Ghey, the mother of Brianna Ghey, and called on those in power to “protect children” from “such a rapidly changing digital world”.
According to the report, a Character.AI bot with a slight misspelling of Molly’s name and using her photo, told users it was an “expert on the final years of Molly’s life”.
“It’s a gut punch to see Character.AI show a total lack of responsibility and it vividly underscores why stronger regulation of both AI and user generated platforms cannot come soon enough,” said Andy Burrows, who runs the Molly Rose Foundation, a charity set up by the teenager’s family and friends in the wake of her death.
Read more:
Southport stabbings suspect faces terror charge
Avoid Halloween horror of tooth decay, surgeons say
Why budget will be a difficult sell for Reeves
The NSPCC has now called on the government to implement its “promised AI safety regulation” and ensure the “principles of safety by design and child protection are at its heart”.
“It is appalling that these horrific chatbots were able to be created and shows a clear failure by Character.AI to have basic moderation in place on its service,” said Richard Collard, associate head of child safety online policy at the charity.
Keep up with all the latest news from the UK and around the world by following Sky News
Character.AI told Sky News the characters were user-created and removed as soon as the company was notified.
“Character.AI takes safety on our platform seriously and moderates Characters both proactively and in response to user reports,” said a company spokesperson.
“We have a dedicated Trust & Safety team that reviews reports and takes action in accordance with our policies.
“We also do proactive detection and moderation in a number of ways, including by using industry-standard blocklists and custom blocklists that we regularly expand. We are constantly evolving and refining our safety practices to help prioritise our community’s safety.”
Anyone feeling emotionally distressed or suicidal can call Samaritans for help on 116 123 or email jo@samaritans.org in the UK. In the US, call the Samaritans branch in your area or 1 (800) 273-TALK
A woman who was stabbed to death in north London has been named by police – as a man was arrested on suspicion of murder.
Pamela Munro, 45, was found with a stab wound and died at the scene in Ayley Croft, Enfield, on Saturday evening, the Metropolitan Police said.
A 29-year-old man was arrested on suspicion of murder on Monday and is in custody, the force added.
Detective Chief Inspector Neil John said: “Investigating officers have worked relentlessly across the weekend to investigate the circumstances around Pamela’s death.
“We continue to support her family who are understandably devastated.”
Police at the scene at Ayley Croft in Enfield
Read more from Sky News:
Fresh appeal over student’s murder
100 firefighters battle flats blaze
The Met Police has asked anyone with information or who was driving through Ayley Court between 6.30pm and 7.30pm on Saturday and may have dashcam footage to contact the force.
A “British man” has died after being beaten and set on fire by a mob in Ecuador, according to reports by media in the South American country.
According to reports, the man – who has not been officially identified – had been detained by police after being accused of being involved in a fatal shooting.
Ecuadorian news outlet Ecuavisa reported that the man had been taken to a police station Playas del Cuyabeno, a remote village in the Amazon rainforest.
While there, a group broke into the station and took the man away. He was then set on fire in the street, it is reported, and died from his burns.
The incident reportedly happened in the Playas del Cuyabeno area of Sucumbios province
Another local report, from EXTRA.ec, said that specialist police units had been slow to arrive due to the geographical conditions of the area – which is accessible by river.
Read more from Sky News:
IDF finds ‘failings’ over attack on aid workers
Pope blesses Easter crowds from popemobile
According to reports, police officers at the station apparently decided they could not intervene when the mob arrived out of concerns for their own safety.
It is understood the UK Foreign Office is following up reports about the incident and working with local authorities to confirm the details.
-
Sports2 years ago‘Storybook stuff’: Inside the night Bryce Harper sent the Phillies to the World Series
-
Sports1 year agoStory injured on diving stop, exits Red Sox game
-
Sports1 year agoGame 1 of WS least-watched in recorded history
-
Sports2 years agoMLB Rank 2023: Ranking baseball’s top 100 players
-
Sports4 years ago
Team Europe easily wins 4th straight Laver Cup
-
Environment2 years agoJapan and South Korea have a lot at stake in a free and open South China Sea
-
Environment2 years agoGame-changing Lectric XPedition launched as affordable electric cargo bike
-
Business3 years agoBank of England’s extraordinary response to government policy is almost unthinkable | Ed Conway