Warning to UK politicians over risk of audio deepfakes that could derail the general election
As AI deepfakes cause havoc during other elections, experts warn the UK’s politicians should be prepared.
“Just tell me what you had for breakfast”, says Mike Narouei, of ControlAI, recording on his laptop. I speak for around 15 seconds, about my toast, coffee and journey to their offices.
Within seconds, I hear my own voice, saying something entirely different.
Follow the latest updates on the election
In this case, words I have written: “Deepfakes can be extremely realistic and have the ability to disrupt our politics and damage our trust in the democratic process.”
Tamara Cohen’s voice being turned into a deepfake
We have used free software, it hasn’t taken any advanced technical skills, and the whole thing has taken next to no time at all.
This is an audio deepfake – video ones take more effort to produce – and as well as being deployed by scammers of all kinds, there is deep concern, in a year with some two billion people going to the polls, in the US, India and dozens of other countries including the UK, about their impact on elections.
Sir Keir Starmer fell victim to one at last year’s Labour Party conference, purportedly of him swearing at staff. It was quickly outed as a fake. The identity of who made it has never been uncovered.
London mayor Sadiq Khan was also targeted this year, with fake audio of him making inflammatory remarks about Remembrance weekend and calling for pro-Palestine marches going viral at a tense time for communities. He claimed new laws were needed to stop them.
Ciaran Martin, the former director of the UK’s National Cyber Security Centre, told Sky News that expensively made video fakes can be less effective and easier to debunk than audio.
“I’m particularly worried right now about audio, because audio deepfakes are spectacularly easy to make, disturbingly easy”, he said. “And if they’re cleverly deployed, they can have an impact.”
Those which have been most damaging, in his view, are an audio deepfake of President Biden, sent to voters during the New Hampshire primaries in January this year.
A “robocall” with the president’s voice told voters to stay at home and “save” their votes for the presidential election in November. A political consultant later claimed responsibility and has been indicted and fined $6m (£4.7m).
Read more:
The digital election in India
Time running out for regulators to tackle AI threat
Biden to unveil sweeping AI regulations
Ciaran Martin, the former NCSC director
Mr Martin, now a professor at the Blavatnik School of Government at Oxford University, said: “It was a very credible imitation of his voice and anecdotal evidence suggests some people were tricked by that.
“Not least because it wasn’t an email they could forward to someone else to have a look at, or on TV where lots of people were watching. It was a call to their home which they more or less had to judge alone.
“Targeted audio, in particular, is probably the biggest threat right now, and there’s no blanket solution, there’s no button there that you can just press and make this problem go away if you are prepared to pay for it or pass the right laws.
“What you need, and the US did this very well in 2020, is a series of responsible and well-informed eyes and ears throughout different parts of the electoral system to limit and mitigate the damage.”
He says there is a risk to hyping up the threat of deepfakes, when they have not yet caused mass electoral damage.
A Russian-made fake broadcast of Ukrainian TV, he said, featuring a Ukrainian official taking responsibility for a terrorist attack in Moscow, was simply “not believed”, despite being expensively produced.
The UK government has passed a National Security Act with new offences of foreign interference in the country’s democratic processes.
The Online Safety Act requires tech companies to take such content down, and meetings are being regularly held with social media companies during the pre-election period.
Democracy campaigners are concerned that deepfakes could be used not just by hostile foreign actors, or lone individuals who want to disrupt the process – but political parties themselves.
Polly Curtis is chief executive of the thinktank Demos, which has called on the parties to agree to a set of guidelines for the use of AI.
Polly Curtis, the chief executive of Demos
She said: “The risk is that you’ll have foreign actors, you’ll have political parties, you’ll have ordinary people on the street creating content and just stirring the pot of what’s true and what’s not true.
“We want them to come together and agree together how they’re going to use these tools at the election. We want them to agree not to create generative AI or amplify it, and label it when it is used.
“This technology is so new, and there are so many elections going on, there could be a big misinformation event in an election campaign that starts to affect people’s trust in the information they’ve got.”
Deepfakes have already been targeted at major elections.
Last year, within hours before polls closed in the Slovakian presidential election, an audio fake of one of the candidates claiming to have rigged the election went viral. He was heavily defeated and his pro-Russian opponent won.
The UK government established a Joint Election Security Preparations Unit earlier this year – with Whitehall officials working with police and security agencies – to respond to threats as they emerge.
Keep up with all the latest news from the UK and around the world by following Sky News
A UK government spokesperson said: “Security is paramount and we are well-prepared to ensure the integrity of the election with robust systems in place to protect against any potential interference.
“The National Security Act contains tools to tackle deepfake election threats and social media platforms should also proactively take action against state-sponsored content aimed at interfering with the election.”
A Labour spokesperson said: “Our democracy is strong, and we cannot and will not allow any attempts to undermine the integrity of our elections.
“However, the rapid pace of AI technology means that government must now always be one step ahead of malign actors intent on using deepfakes and disinformation to undermine trust in our democratic system.
“Labour will be relentless in countering these threats.”
The last blast furnaces left operating in Britain could see their fate sealed within days, after their Chinese owners took the decision to cut off the crucial supply of ingredients keeping them running.
Jingye, the owner of British Steel in Scunthorpe, has, according to union representatives, cancelled future orders for the iron ore, coal and other raw materials needed to keep the furnaces running.
The upshot is that they may have to close next month – even sooner than the earliest date suggested for its closure.
Read more: Thousands of jobs at risk as British Steel consults unions over closure
The fate of the blast furnaces – the last two domestic sources of virgin steel, made from iron ore rather than recycled – is likely to be determined in a matter of days, with the Department for Business and Trade now actively pondering nationalisation.
The upshot is that even as Britain contends with a trade war across the Atlantic, it is now working against the clock to secure the future of steelmaking at Scunthorpe.
The talks between the government and Jingye broke down last week after the Chinese company, which bought British Steel out of receivership in 2020, rejected a £500m offer of public money to replace the existing furnaces with electric arc furnaces.
The sum is the same one it offered to Tata Steel, which has shut down the other remaining UK blast furnaces in Port Talbot and is planning to build electric furnaces – which have far lower carbon emissions.
These steel workers could soon be out of work
However, the owners argue that the amount is too little to justify extra investment at Scunthorpe, and said last week they were now consulting on the date of shutting both the blast furnaces and the attached steelworks.
Since British Steel is the main provider of steel rails to Network Rail – as well as other construction steels available from only a few sites in the world – the closure would leave the UK more reliant on imports for critical infrastructure sites.
However, since the site belongs to its Chinese owners, a decision to nationalise the site would involve radical steps government officials are wary of taking.
They also fear leaving taxpayers exposed to a potentially loss-making business for the long run.
The dilemma has been heightened by the sharp turn in geopolitical sentiment following Donald Trump’s return to the White House.
The incipient trade war and threatened cut in American support to Europe have sparked fresh calls for countries to act urgently to secure their own supplies of critical materials, especially those used for defence and infrastructure.
Read more:
Car manufacturers fined £461m for collusion
There were no winners from Trump’s tariff gameshow
Gareth Stace, head of UK Steel, the industry lobby group, said: “Talks seem to have broken down between government and British Steel.
“My advice to government is: please, Jonathan Reynolds, Business Secretary, get back round that negotiating table, thrash out a deal, and if a deal can’t be found in the next few days, then I fear for the very future of the sector, but also here for Scunthorpe steelworks.”
British Steel declined to comment.
UK
Prince Andrew’s Pitch@Palace branded ‘crude attempt to enrich himself’ as Chinese spy documents set to be released
Prince Andrew’s efforts to make money from his Pitch@Palace project have been branded as a “crude attempt to enrich himself” at the expense of “unsuspecting tech founders”, as new documents may shed more light on what he and his team have been attempting to sell.
Today is the deadline for documents to be released relating to Prince Andrew‘s former senior adviser Dominic Hampshire and his interactions with the alleged Chinese spy Yang Tengbo.
In February, an immigration tribunal heard how the intelligence services had contacted Mr Hampshire about Mr Yang back in 2022. Mr Yang helped set up Pitch@Palace China, a branch of the duke’s scheme to help young entrepreneurs.
The alleged Chinese spy, Yang Tengbo, has links with Prince Andrew
Yang Tengbo. Pic: Pitch@Palace
Judges banned Mr Yang from the UK, saying his association with a senior royal had made Prince Andrew “vulnerable” and posed a threat to national security. Mr Yang challenged that decision at the Special Immigration Appeals Commission (SIAC).
Since that hearing, media organisations have applied for certain documents relating to the case and Mr Hampshire’s support for Mr Yang to be made public. SIAC agreed to release some information of public interest. It is hoped they may include more details on deals that he was trying to do on behalf of Prince Andrew.
So what do we know about potential deals for Pitch@Palace so far?
In February, Sky News confirmed that palace officials had a meeting last summer with tech funding company StartupBootcamp to discuss a potential tie-up between them and Prince Andrew relating to his Pitch@Palace project.
The palace wasn’t involved in the fine details of a deal but wanted guarantees to make sure it wouldn’t impact the Royal Family in the future. Sky News understands from one source that the price being discussed for Pitch was around £750,000 – there are, however, reports that a deal may have stalled.
Photos we found on the Chinese Chamber of Commerce website show an event held in Asia between StartupBootcamp and Innovate Global, believed to be an offshoot of Pitch.
Please use Chrome browser for a more accessible video player
Who is alleged Chinese spy, Yang Tengbo?
Documents, released in relation to the investigations into Mr Tengbo, have also shown how much the duke has always seen Pitch as a way of potentially making money. One document from 21 August 2021 clearly states “the duke needed money at the time, and saw the relationships with China through Pitch as one possible source of funding”.
But Prince Andrew’s apparent intention to use Pitch to make money has led to concerns about whether he is unfairly using the contacts and information he gained when he was a working royal.
Norman Baker, former MP and author of books on royal finances, believes it is “a crude attempt to enrich himself” and goes against what the tech entrepreneurs thought they were signing up for.
Read more:
Who is Yang Tenbo?
Virginia Giuffre says she has days to live
Emails between Andrew and Epstein revealed
He told Sky News: “The data given by these business people was given on the basis it was an official operation and not something for Prince Andrew, and so in my view, Prince Andrew had no right legally or morally to take the data which has been collected, a huge amount of data, and sell it…
“And quite clearly if you’re going to sell it off to StartupBootcamp, that is not what people had in mind. The entrepreneurs who joined Pitch@Palace did not do so to enrich Prince Andrew,” he said.
Rich Wilson was one tech entrepreneur who was approached at the start of Pitch@Palace to sign up, but he stepped away when he spotted a clause in the contract saying they’d be entitled to 2% equity in any funding he secured.
He feels Prince Andrew is continuing to use those he made a show of supporting.
He said: “It makes me feel sick. I think it’s terrible – that he is continuing to exploit unsuspecting tech founders in this way. A lot of them, I’m quite grey and old in the tooth now, I saw it coming, but clearly most didn’t. And a lot of them were quite young.
“It’ll be their first venture and you’re learning on the trot, so to speak. So to take advantage of people in such a major way – that’s an awful, sickening thing to do.”
We approached StartupBootcamp who said they had no comment to make, and the Duke of York’s office did not respond.
With reports that a deal may have stalled, it could be a big setback for the duke – especially with questions still about how he’ll continue to pay for his home on the Windsor estate now that the King no longer gives him financial support.
-
Sports2 years ago‘Storybook stuff’: Inside the night Bryce Harper sent the Phillies to the World Series
-
Sports12 months agoStory injured on diving stop, exits Red Sox game
-
Sports1 year agoGame 1 of WS least-watched in recorded history
-
Sports2 years agoMLB Rank 2023: Ranking baseball’s top 100 players
-
Sports4 years ago
Team Europe easily wins 4th straight Laver Cup
-
Environment2 years agoJapan and South Korea have a lot at stake in a free and open South China Sea
-
Environment2 years agoGame-changing Lectric XPedition launched as affordable electric cargo bike
-
Business3 years agoBank of England’s extraordinary response to government policy is almost unthinkable | Ed Conway