AI driving ‘explosion’ of fake nudes as victims say the law is failing them
Campaigners are warning the use of artificial intelligence (AI) to create realistic but fake nude images of real women is becoming “normalised”.
It’s also an increasing concern in schools. A recent survey by Internet Matters found 13% of teenagers have had an experience with nude deepfakes, while the NSPCC told Sky News “a new harm is developing”.
Ofcom will later this month introduce codes of practice for internet companies to clamp down on the illegal distribution of fake nudes, but Sky News has met two victims of this relatively new trend, who say the law needs to go further.
Earlier this year, social media influencer and former Love Island contestant, Cally Jane Beach, 33, was horrified when she discovered someone had used AI to turn an underwear brand photograph of her into a nude and it was being shared online.
The original image had been uploaded to a site that uses software to digitally transform a clothed picture into a naked picture.
She told Sky News: “It looked so realistic, like nobody but me would know. It was like looking at me, but also not me.”
She added: “There shouldn’t be such a thing. It’s not a colouring book. It’s not a bit of fun. It’s people’s identity and stripping their clothes off.”
An underwear ad that Cally Jane Beach did was manipulated into a nude image
When Cally reported what had happened to the police, she struggled to get them to treat it as a crime.
“They didn’t really know what they could do about it, and because the site that hosted the image was global, they said that it’s out of their jurisdiction,” she said.
In November, Assistant Chief Constable Samantha Miller, of the National Police Chiefs’ Council, addressed a committee of MPs on the issue and concluded “the system is failing”, with a lack of capacity and inconsistency of practice across forces.
ACC Miller told the women and equalities committee she’d recently spoken to a campaigner who was in contact with 450 victims and “only two of them had a positive experience of policing”.
The government says new legislation outlawing the generation of AI nudes is coming next year, although it is already illegal to make fake nudes of minors.
Meanwhile, the problem is growing with multiple apps available for the purpose of unclothing people in photographs. Anyone can become a victim, although it is nearly always women.
Professor Clare McGlynn, an expert in online harms, said: “We’ve seen an exponential rise in the use of sexually explicit deepfakes. For example, one of the largest, most notorious websites dedicated to this abuse receives about 14 million hits a month.
“These nudify apps are easy to get from the app store, they’re advertised on Tik Tok, So, of course, young people are downloading them and using them. We’ve normalised the use of these nudify apps.”
‘Betrayed by my best friend’
Sky News spoke to “Jodie” (not her real name) from Cambridge who was tipped off by an anonymous email that she appeared to be in sex videos on a pornographic website.
“The images that I posted on Instagram and Facebook, which were fully clothed, were manipulated and turned into sexually explicit material,” she said.
Alex Woolf avoided jail and was told to pay £100 to each of his 15 victims
Jodie began to suspect someone she knew was posting pictures and encouraging people online to manipulate them.
Then she found a particular photograph, taken outside King’s College in Cambridge, that only one person had.
It was her best friend, Alex Woolf. She had airdropped the picture to him alone.
Woolf, who once won BBC young composer of the year, was later convicted of offences against 15 women, mostly because of Jodie’s perseverance and detective work.
Even then, his conviction only related to the offensive comments attached to the images, because while it’s illegal to share images – it’s not a crime to ask others to create them.
Jodie identified Woolf as he was the only one she’d sent this photo to
He was given a suspended sentence and ordered to pay £100 to each of his victims.
Jodie believes it’s imperative new laws are introduced to outlaw making and soliciting these types of images.
“My abuse is not your fun,” she said.
“Online abuse has the same effect psychologically that physical abuse does. I became suicidal, I wasn’t able to trust those closest to me because I had been betrayed by my best friend. And the effect of that on a person is monumental.”
‘A scary, lonely place’
A survey in October by Teacher Tap found 7% of teachers answered yes to the question: “In the last 12 months, have you had an incident of a student using technology to create a fake sexually graphic image of a classmate?”
In their campaigning both Cally and Jodie have come across examples of schoolgirls being deep faked.
Cally said: “It is used as a form of bullying because they think it’s funny. But it can have such a mental toll, and it must be a very scary and lonely place for a young girl to be dealing with that.”
Read more from Sky News:
Paedophile who made AI abuse images jailed for 18 years
Google’s AI chatbot Gemini tells user to ‘please die‘
Sex offenders using virtual reality to abuse children
The NSPCC said it has had calls about nude deepfakes to its helpline.
The charity’s policy manager for child safety online, Rani Govender, said the pictures can be used as “part of a grooming process” or as a form of blackmail, as well as being passed around by classmates “as a form of bullying and harassment”.
“Children become scared, isolated and they worry they won’t be believed that the images are created by someone else,” Ms Govender said.
She added: “This is a new harm, and it is developing, and it will require new measures from the government with child protection as a priority.”
Alex Davies-Jones, under-secretary of state for victims, told MPs in November: “We’ve committed to making an offence of creating a deepfake illegal and we will be legislating for that this session.”
For campaigners like Jodie and Cally the new laws can’t come soon enough. However, they worry they won’t have strong enough clauses around banning the soliciting of content and ensuring images are removed once they’ve been discovered.
Anyone feeling emotionally distressed or suicidal can call Samaritans for help on 116 123 or email jo@samaritans.org in the UK. In the US, call the Samaritans branch in your area or 1 (800) 273-TALK.
It’s like The Godfather, one reformed drug trafficker tells me.
The mythical gangster film centred on an organised crime dynasty locked in a transfer of power.
Communities in Scotland currently have a front row seat to a new war of violence, torture, and taunts as feuding drug lords and notorious families grapple for control of Glasgow and Edinburgh.
There have been more than a dozen brutal attacks over the past six weeks – ranging from fire bombings to attacks on children and gun violence.
A firebomb attack in Scotland
Victims left for dead, businesses up in flames
Gangsters have filmed themselves setting fire to buildings and homes connected to the associates and relatives of their bitter rivals.
The main aim, they boast, is to “exterminate” the opposition.
The taunting footage, accompanied by the song Keep On Running by The Spencer Davis Group, has been plastered over social media as part of a deliberate game of goading.
A 12-year-old boy and 72-year-old woman were left for dead when teenagers wearing balaclavas burst into a home in north Glasgow.
Garages and businesses have gone up in flames. Shots were fired at an Edinburgh house.
Signals are being sent of who wants control of Scotland’s dark criminal underworld.
A firebomb attack that saw a man throw an incendiary device through a building window
The fire attack set to the song Keep On Running by The Spencer Davis Group
What’s caused the gang war?
The former director of the Scottish Crime and Drug Enforcement Agency, Graeme Pearson, explains how a “vacuum of leadership” is playing a part.
Last October, Glasgow-based cocaine kingpin Jamie Stevenson, known as The Iceman, was jailed after orchestrating a £100m cocaine shipment stashed in banana boxes from South America.
The mob leader was one of Britain’s most wanted, running his business like another on-screen criminal enterprise: The Sopranos.
The 59-year-old fugitive went on the run before eventually being hunted and apprehended by police while out jogging in the Netherlands.
Jamie Stevenson. Pic: Police Scotland
Pic: Crown Office
‘Old scores to settle’
But paranoia was running rife about how this notorious gangster could be brought down. Was there a grass? Was it one of their own?
It further fuelled divisions and forced new alliances to be forged across Scotland’s organised criminal networks.
It wasn’t until The Iceman case came to court that it was revealed an encrypted messaging platform, known as EncroChat, had been infiltrated by law enforcement.
It ultimately led to Stevenson pleading guilty.
Ex-senior drug enforcement officer Mr Pearson told Sky News: “It is a complex picture because you have got people who are in prison who still want to have influence outside and look after what was their business.
“On the outside you’ve got wannabes who are coming forward, and they think this is an opportunity for them, and you have got others have old scores to settle that they could not settle when crime bosses were around.”
Read more from Sky News:
Scientists find strongest evidence yet of aliens
Widow has ‘no regrets’ over helping husband’s suicide
Graeme Pearson
Mr Pearson describes a toxic mix swirling to create outbursts of violence unfolding in Scotland.
He concluded: “All that mixes together – and the greed for the money that comes from drugs, and from the kudos that comes from being a ‘main man’, and you end up with competition, violence, and the kind of incidents we have seen over the past four to six weeks.”
New wave of violence ‘barbaric’
Glasgow man Mark Dempster is a former addict, dealer, and drug smuggler who is now an author and respected counsellor helping people quit drinking and drugs.
He describes the “jostle for power” as not a new concept among Glasgow’s high profile gangland families.
Mark Dempster
“There is always going to be someone new who wants to control the markets. It is like The Godfather. There is no difference between Scotland, Albania, or India,” he said.
Mr Dempster suggests a shift in tactics in Glasgow and Edinburgh in recent weeks, with 12-year-olds being viciously attacked in the middle of the night.
“It is barbaric. When young people, children, get pulled into the cross fire. It takes it to a different level.
“At least with the old mafiosa they had an unwritten rule that no children, no other family members. You would deal directly with the main people that were your opposition.”
Police Scotland is racing to get control of the situation, but declined to speak to Sky News about its ongoing operation.
It has been suggested 100 officers are working on this case, with “arrests imminent”.
But this is at the very sharp end of sophisticated criminal empires where the police are not feared, there are fierce vendettas and, clearly, power is up for grabs.
UK
Laws may need to be bolstered to crack down on exploitation of child ‘influencers’, senior MP suggests
Laws may need to be strengthened to crack down on the exploitation of child “influencers”, a senior Labour MP has warned.
Chi Onwurah, chair of the science, technology and innovation committee, said parts of the Online Safety Act – passed in October 2023 – may already be “obsolete or inadequate”.
Politics latest: Follow live updates
Experts have raised concerns that there is a lack of provision in industry laws for children who earn money through brand collaborations on social media when compared to child actors and models.
This has led to some children advertising in their underwear on social media, one expert has claimed.
Those working in more traditional entertainment fields are safeguarded by performance laws, which strictly govern the hours a minor can work, the money they earn and who they are accompanied by.
The Child Influencer Project, which has curated the world’s first industry guidelines for the group, has warned of a “large gap in UK law” which is not sufficiently filled by new online safety legislation.
Official portrait of Chi Onwurah.
Pic: UK Parlimeant
The group’s research found that child influencers could be exposed to as many as 20 different risks of harm, including to dignity, identity, family life, education, and their health and safety.
Ms Onwurah told Sky News there needs to be a “much clearer understanding of the nature of child influencers ‘work’ and the legal and regulatory framework around it”.
She said: “The safety and welfare of children are at the heart of the Online Safety Act and rightly so.
“However, as we know in a number of areas the act may already be obsolete or inadequate due to the lack of foresight and rigour of the last government.”
Victoria Collins, the Liberal Democrat spokesperson for science, innovation and technology, agreed that regulations “need to keep pace with the times”, with child influencers on social media “protected in the same way” as child actors or models.
“Liberal Democrats would welcome steps to strengthen the Online Safety Act on this front,” she added.
‘Something has to be done’
MPs warned in 2022 that the government should “urgently address the gap in UK child labour and performance regulation that is leaving child influencers without protection”.
They asked for new laws on working hours and conditions, a mandate for the protection of the child’s earnings, a right to erasure and to bring child labour arrangements under the oversight of local authorities.
However, Dr Francis Rees, the principal investigator for the Child Influencer Project, told Sky News that even after the implementation of the Online Safety Act, “there’s still a lot wanting”.
“Something has to be done to make brands more aware of their own duty of care towards kids in this arena,” she said.
Dr Rees added that achieving performances from children on social media “can involve extremely coercive and disruptive practices”.
“We simply have to do more to protect these children who have very little say or understanding of what is really happening. Most are left without a voice and without a choice.”
Read more from Sky News:
Four killed as cable car crashes to ground near Naples
Two dead and five injured in shooting at Florida university
The researcher pointed to one particular instance, in which children were advertising an underwear brand on social media.
She said: “The kids in the company’s own marketing material or their own media campaigns are either pulling up the band of the underwear underneath their clothing, or they’re holding the underwear up while they’re fully clothed.
“But whenever you look at any of the sponsored content produced by families with children – mum, dad, and child are in their underwear.”
Dr Rees said it is “night and day” in terms of how companies are behaving when they have responsibility for the material, versus “the lack of responsibility once they hand it over to parents with kids”.
-
Sports2 years ago‘Storybook stuff’: Inside the night Bryce Harper sent the Phillies to the World Series
-
Sports1 year agoStory injured on diving stop, exits Red Sox game
-
Sports1 year agoGame 1 of WS least-watched in recorded history
-
Sports2 years agoMLB Rank 2023: Ranking baseball’s top 100 players
-
Sports4 years ago
Team Europe easily wins 4th straight Laver Cup
-
Environment2 years agoJapan and South Korea have a lot at stake in a free and open South China Sea
-
Environment2 years agoGame-changing Lectric XPedition launched as affordable electric cargo bike
-
Business3 years agoBank of England’s extraordinary response to government policy is almost unthinkable | Ed Conway