Warning to UK politicians over risk of audio deepfakes that could derail the general election
As AI deepfakes cause havoc during other elections, experts warn the UK’s politicians should be prepared.
“Just tell me what you had for breakfast”, says Mike Narouei, of ControlAI, recording on his laptop. I speak for around 15 seconds, about my toast, coffee and journey to their offices.
Within seconds, I hear my own voice, saying something entirely different.
Follow the latest updates on the election
In this case, words I have written: “Deepfakes can be extremely realistic and have the ability to disrupt our politics and damage our trust in the democratic process.”
Tamara Cohen’s voice being turned into a deepfake
We have used free software, it hasn’t taken any advanced technical skills, and the whole thing has taken next to no time at all.
This is an audio deepfake – video ones take more effort to produce – and as well as being deployed by scammers of all kinds, there is deep concern, in a year with some two billion people going to the polls, in the US, India and dozens of other countries including the UK, about their impact on elections.
Sir Keir Starmer fell victim to one at last year’s Labour Party conference, purportedly of him swearing at staff. It was quickly outed as a fake. The identity of who made it has never been uncovered.
London mayor Sadiq Khan was also targeted this year, with fake audio of him making inflammatory remarks about Remembrance weekend and calling for pro-Palestine marches going viral at a tense time for communities. He claimed new laws were needed to stop them.
Ciaran Martin, the former director of the UK’s National Cyber Security Centre, told Sky News that expensively made video fakes can be less effective and easier to debunk than audio.
“I’m particularly worried right now about audio, because audio deepfakes are spectacularly easy to make, disturbingly easy”, he said. “And if they’re cleverly deployed, they can have an impact.”
Those which have been most damaging, in his view, are an audio deepfake of President Biden, sent to voters during the New Hampshire primaries in January this year.
A “robocall” with the president’s voice told voters to stay at home and “save” their votes for the presidential election in November. A political consultant later claimed responsibility and has been indicted and fined $6m (£4.7m).
Read more:
The digital election in India
Time running out for regulators to tackle AI threat
Biden to unveil sweeping AI regulations
Ciaran Martin, the former NCSC director
Mr Martin, now a professor at the Blavatnik School of Government at Oxford University, said: “It was a very credible imitation of his voice and anecdotal evidence suggests some people were tricked by that.
“Not least because it wasn’t an email they could forward to someone else to have a look at, or on TV where lots of people were watching. It was a call to their home which they more or less had to judge alone.
“Targeted audio, in particular, is probably the biggest threat right now, and there’s no blanket solution, there’s no button there that you can just press and make this problem go away if you are prepared to pay for it or pass the right laws.
“What you need, and the US did this very well in 2020, is a series of responsible and well-informed eyes and ears throughout different parts of the electoral system to limit and mitigate the damage.”
He says there is a risk to hyping up the threat of deepfakes, when they have not yet caused mass electoral damage.
A Russian-made fake broadcast of Ukrainian TV, he said, featuring a Ukrainian official taking responsibility for a terrorist attack in Moscow, was simply “not believed”, despite being expensively produced.
The UK government has passed a National Security Act with new offences of foreign interference in the country’s democratic processes.
The Online Safety Act requires tech companies to take such content down, and meetings are being regularly held with social media companies during the pre-election period.
Democracy campaigners are concerned that deepfakes could be used not just by hostile foreign actors, or lone individuals who want to disrupt the process – but political parties themselves.
Polly Curtis is chief executive of the thinktank Demos, which has called on the parties to agree to a set of guidelines for the use of AI.
Polly Curtis, the chief executive of Demos
She said: “The risk is that you’ll have foreign actors, you’ll have political parties, you’ll have ordinary people on the street creating content and just stirring the pot of what’s true and what’s not true.
“We want them to come together and agree together how they’re going to use these tools at the election. We want them to agree not to create generative AI or amplify it, and label it when it is used.
“This technology is so new, and there are so many elections going on, there could be a big misinformation event in an election campaign that starts to affect people’s trust in the information they’ve got.”
Deepfakes have already been targeted at major elections.
Last year, within hours before polls closed in the Slovakian presidential election, an audio fake of one of the candidates claiming to have rigged the election went viral. He was heavily defeated and his pro-Russian opponent won.
The UK government established a Joint Election Security Preparations Unit earlier this year – with Whitehall officials working with police and security agencies – to respond to threats as they emerge.
Keep up with all the latest news from the UK and around the world by following Sky News
A UK government spokesperson said: “Security is paramount and we are well-prepared to ensure the integrity of the election with robust systems in place to protect against any potential interference.
“The National Security Act contains tools to tackle deepfake election threats and social media platforms should also proactively take action against state-sponsored content aimed at interfering with the election.”
A Labour spokesperson said: “Our democracy is strong, and we cannot and will not allow any attempts to undermine the integrity of our elections.
“However, the rapid pace of AI technology means that government must now always be one step ahead of malign actors intent on using deepfakes and disinformation to undermine trust in our democratic system.
“Labour will be relentless in countering these threats.”
All 14 children arrested on suspicion of manslaughter after a boy died in a fire have been released on police bail, officers said.
Layton Carr, 14, was found dead near the site of a fire at Fairfield industrial park in the Bill Quay area of Gateshead on Friday.
Northumbria Police said on Saturday that they had arrested 11 boys and three girls in connection with the incident.
In an update on Sunday, a Northumbria Police spokesman said: “All those arrested have since been released on police bail pending further inquiries.”
Please use Chrome browser for a more accessible video player
Teenager dies in industrial estate fire
Firefighters raced to the industrial site shortly after 8pm on Friday, putting out the blaze a short time later.
Police then issued an appeal for Carr, who was believed to be in the area at that time.
In a statement on Saturday, the force said that “sadly, following searches, a body believed to be that of 14-year-old Layton Carr was located deceased inside the building”.
David Thompson, headteacher of Hebburn Comprehensive School, where Layton was a pupil, said the school community was “heartbroken”.
Mr Thompson described him as a “valued and much-loved member of Year 9” and said he would be “greatly missed by everyone”.
He added that the school’s “sincere condolences” were with Layton’s family and that the community would “rally together to support one another through this tragedy”.
A fundraising page on GoFundMe has been set up to help Layton’s mother pay for funeral costs.
Pic: Gofundme
Organiser Stephanie Simpson said: “The last thing Georgia needs to stress trying to pay for a funeral for her Boy Any donations will help thank you.”
One tribute in a Facebook post read: “Can’t believe I’m writing this my nephew RIP Layton 💔 forever 14 you’ll be a massive miss, thinking of my sister and 2 beautiful nieces right now.”
Detective Chief Inspector Louise Jenkins, of Northumbria Police, also said: “This is an extremely tragic incident where a boy has sadly lost his life.”
She added that the force’s “thoughts are with Layton’s family as they begin to attempt to process the loss of their loved one”.
They are working to establish “the full circumstances surrounding the incident” and officers will be in the area to “offer reassurance to the public”, she added.
A cordon remains in place at the site while police carry out enquiries.
Football bodies could be forced to pay towards the care costs of ex-players who have been diagnosed with brain conditions, under proposals set to be considered by MPs.
Campaigners are drafting amendments to the Football Governance Bill, which would treat conditions caused by heading balls as an “industrial injuries issue”.
The proposals seek to require the football industry to provide the necessary financial support.
Campaigners say existing support is not fit for purpose, including the Brain Health Fund which was set up with an initial £1m by the Professional Footballers’ Association (PFA), supported by the Premier League.
But the Premier League said the fund has supported 121 families with at-home adaptations and care home fees.
From England‘s 1966 World Cup-winning team, both Jack and Bobby Charlton died with dementia, as did Martin Peters, Ray Wilson and Nobby Stiles.
Neil Ruddock speaks to Sky’s Rob Harris outside parliament
Ex-players, including former Liverpool defender Neil Ruddock, went to parliament last week to lobby MPs.
Ruddock told Sky News he had joined campaigners “for the families who’ve gone through hell”.
“A professional footballer, greatest job in the world, but no one knew the dangers, and that’s scary,” he said.
“Every time someone heads a ball it’s got to be dangerous to you. You know, I used to head 100 balls a day in training. I didn’t realise that might affect my future.”
A study co-funded by the PFA and the Football Association (FA) in 2019 found footballers were three and a half times more likely to die of a neurodegenerative disease than members of the public of the same age.
‘In denial’
Among those calling on football authorities to contribute towards the care costs of ex-players who have gone on to develop conditions such as Alzheimer’s and dementia is Labour MP Chris Evans.
Mr Evans, who represents Caerphilly in South Wales, hopes to amend the Bill to establish a care and financial support scheme for ex-footballers and told a recent event in parliament that affected ex-players “deserve to be compensated”.
Greater Manchester Mayor Andy Burnham, who helped to draft the amendment, said the game was “in denial about the whole thing”.
Mr Burnham called for it to be seen as “an industrial injuries issue in the same way with mining”.
In January, David Beckham lent his support to calls for greater support for footballers affected by dementia.
One of the amendments says that “the industry rather than the public should bear the financial burden”.
Read more from Sky News:
Woman missing for more than 60 years found ‘alive and well’
Meghan posts new photo of Prince Harry amid backlash
A spokesperson for the FA said it was taking a “leading role in reviewing and improving the safety of our game” and that it had “already taken many proactive steps to review and address potential risk factors”.
An English Football League spokesperson said it was “working closely with other football bodies” to ensure both professional and grassroots football are “as safe as it can be”.
The PFA and Premier League declined to comment.
UK
Terror arrests came in context of raised warnings about Iran, with ongoing chaos in its own backyard
These are two separate and unrelated investigations by counter-terror officers.
But the common thread is nationality – seven out of the eight people arrested are Iranian.
And that comes in the context of increased warnings from government and the security services about Iranian activity on British soil.
Please use Chrome browser for a more accessible video player
Counter terror officers raid property
Last year, the director general of MI5, Ken McCallum, said his organisation and police had responded to 20 Iran-backed plots presenting potentially lethal threats to British citizens and UK residents since January 2022.
He linked that increase to the ongoing situation in Iran’s own backyard.
“As events unfold in the Middle East, we will give our fullest attention to the risk of an increase in – or a broadening of – Iranian state aggression in the UK,” he said.
The implication is that even as Iran grapples with a rapidly changing situation in its own region, having seen its proxies, Hezbollah in Lebanon and Hamas in Gaza, decimated and itself coming under Israeli attack, it may seek avenues further abroad.
The government reiterated this warning only a few weeks ago, with security minister Dan Jarvis addressing parliament.
“The threat from Iran sits in a wider context of the growing, diversifying and evolving threat that the UK faces from malign activity by a number of states,” Jarvis said.
“The threat from states has become increasingly interconnected in nature, blurring the lines between: domestic and international; online and offline; and states and their proxies.
“Turning specifically to Iran, the regime has become increasingly emboldened, asserting itself more aggressively to advance their objectives and undermine ours.”
Read more:
Anybody working for Iran in UK must register or face jail, government announces
As part of that address, Jarvis highlighted the National Security Act 2023, which “criminalises assisting a foreign intelligence service”, among other things.
So it was notable that this was the act used in one of this weekend’s investigations.
The suspects were detained under section 27 of the same act, which allows police to arrest those suspected of being “involved in foreign power threat activity”.
Those powers are apparently being put to use.
-
Sports3 years ago‘Storybook stuff’: Inside the night Bryce Harper sent the Phillies to the World Series
-
Sports1 year agoStory injured on diving stop, exits Red Sox game
-
Sports2 years agoGame 1 of WS least-watched in recorded history
-
Sports2 years agoMLB Rank 2023: Ranking baseball’s top 100 players
-
Sports4 years ago
Team Europe easily wins 4th straight Laver Cup
-
Environment2 years agoJapan and South Korea have a lot at stake in a free and open South China Sea
-
Environment2 years agoGame-changing Lectric XPedition launched as affordable electric cargo bike
-
Business3 years agoBank of England’s extraordinary response to government policy is almost unthinkable | Ed Conway