As AI deepfakes cause havoc during other elections, experts warn the UK’s politicians should be prepared.
“Just tell me what you had for breakfast”, says Mike Narouei, of ControlAI, recording on his laptop. I speak for around 15 seconds, about my toast, coffee and journey to their offices.
Within seconds, I hear my own voice, saying something entirely different.
In this case, words I have written: “Deepfakes can be extremely realistic and have the ability to disrupt our politics and damage our trust in the democratic process.”
Image: Tamara Cohen’s voice being turned into a deepfake
We have used free software, it hasn’t taken any advanced technical skills, and the whole thing has taken next to no time at all.
This is an audio deepfake – video ones take more effort to produce – and as well as being deployed by scammers of all kinds, there is deep concern, in a year with some two billion people going to the polls, in the US, India and dozens of other countries including the UK, about their impact on elections.
London mayor Sadiq Khan was also targeted this year, with fake audio of him making inflammatory remarks about Remembrance weekend and calling for pro-Palestine marches going viral at a tense time for communities. He claimed new laws were needed to stop them.
Advertisement
Ciaran Martin, the former director of the UK’s National Cyber Security Centre, told Sky News that expensively made video fakes can be less effective and easier to debunk than audio.
“I’m particularly worried right now about audio, because audio deepfakes are spectacularly easy to make, disturbingly easy”, he said. “And if they’re cleverly deployed, they can have an impact.”
Those which have been most damaging, in his view, are an audio deepfake of President Biden, sent to voters during the New Hampshire primaries in January this year.
A “robocall” with the president’s voice told voters to stay at home and “save” their votes for the presidential election in November. A political consultant later claimed responsibility and has been indicted and fined $6m (£4.7m).
Mr Martin, now a professor at the Blavatnik School of Government at Oxford University, said: “It was a very credible imitation of his voice and anecdotal evidence suggests some people were tricked by that.
“Not least because it wasn’t an email they could forward to someone else to have a look at, or on TV where lots of people were watching. It was a call to their home which they more or less had to judge alone.
“Targeted audio, in particular, is probably the biggest threat right now, and there’s no blanket solution, there’s no button there that you can just press and make this problem go away if you are prepared to pay for it or pass the right laws.
“What you need, and the US did this very well in 2020, is a series of responsible and well-informed eyes and ears throughout different parts of the electoral system to limit and mitigate the damage.”
He says there is a risk to hyping up the threat of deepfakes, when they have not yet caused mass electoral damage.
A Russian-made fake broadcast of Ukrainian TV, he said, featuring a Ukrainian official taking responsibility for a terrorist attack in Moscow, was simply “not believed”, despite being expensively produced.
The UK government has passed a National Security Act with new offences of foreign interference in the country’s democratic processes.
The Online Safety Act requires tech companies to take such content down, and meetings are being regularly held with social media companies during the pre-election period.
Democracy campaigners are concerned that deepfakes could be used not just by hostile foreign actors, or lone individuals who want to disrupt the process – but political parties themselves.
Polly Curtis is chief executive of the thinktank Demos, which has called on the parties to agree to a set of guidelines for the use of AI.
Image: Polly Curtis, the chief executive of Demos
She said: “The risk is that you’ll have foreign actors, you’ll have political parties, you’ll have ordinary people on the street creating content and just stirring the pot of what’s true and what’s not true.
“We want them to come together and agree together how they’re going to use these tools at the election. We want them to agree not to create generative AI or amplify it, and label it when it is used.
“This technology is so new, and there are so many elections going on, there could be a big misinformation event in an election campaign that starts to affect people’s trust in the information they’ve got.”
Deepfakes have already been targeted at major elections.
Last year, within hours before polls closed in the Slovakian presidential election, an audio fake of one of the candidates claiming to have rigged the election went viral. He was heavily defeated and his pro-Russian opponent won.
The UK government established a Joint Election Security Preparations Unit earlier this year – with Whitehall officials working with police and security agencies – to respond to threats as they emerge.
Follow Sky News on WhatsApp
Keep up with all the latest news from the UK and around the world by following Sky News
A UK government spokesperson said: “Security is paramount and we are well-prepared to ensure the integrity of the election with robust systems in place to protect against any potential interference.
“The National Security Act contains tools to tackle deepfake election threats and social media platforms should also proactively take action against state-sponsored content aimed at interfering with the election.”
A Labour spokesperson said: “Our democracy is strong, and we cannot and will not allow any attempts to undermine the integrity of our elections.
“However, the rapid pace of AI technology means that government must now always be one step ahead of malign actors intent on using deepfakes and disinformation to undermine trust in our democratic system.
“Labour will be relentless in countering these threats.”
England and Scotland fans have found out where their World Cup group games will be played when the tournament kicks off in June.
England, who are in Group L, will begin their tournament against Croatia in Dallas at 4pm EST (9pm BST) on 17 June. They will then go on to face Ghana in Boston at 4pm EST (9pm BST) on 23 June and Panama in New Jersey, New York, at 5pm EST (10pm BST) on 27 June.
Scotland are in Group C, and their first match will be against Haiti in Boston at 9pm EST on 13 June (2am GMT the following morning).
They will go up against Morocco also in Boston at 6pm EST (11pm GMT) on 19 June and then Brazil in Miami at 6pm EST (11pm GMT) on 24 June.
Fans are expected to rush to sort their travel and accommodation plans now that they know where and when the matches take place.
Please use Chrome browser for a more accessible video player
2:44
England and Scotland learn World Cup fate
Wales and Northern Ireland have yet to find out if they will qualify.
Wales must face a play-off against Bosnia and Herzegovina in Cardiff, then either Italy or Northern Ireland, if they are victorious.
If they beat these play-off opponents, they will secure their place in Group B alongside Canada, Qatar and Switzerland.
However, Northern Ireland will also be vying to guarantee their spot in the same group if they can beat Italy and then either Wales or Bosnia and Herzegovina.
This breaking news story is being updated and more details will be published shortly.
England are in Group L along with Croatia, Panama and Ghana. Their first match will be against Croatia, who beat them in the semi-finals of the 2018 World Cup in Russia.
Image: Pic: Reuters
Scotland’s first match will be against Haiti, in Group C.
Brazil and Morocco are the other Group C teams – both countries were also in the same opening group as Scotland in the 1998 World Cup in France.
Image: Trump and Infantino at the World Cup draw
Wales have yet to find out if they will qualify as they must face a play-off against Bosnia and Herzegovina in Cardiff, and then either Italy or Northern Ireland, if they are victorious.
If they can overcome these play-off opponents then they will secure their place in Group B along with Canada, Qatar and Switzerland. But Northern Ireland will also be vying and hoping to guarantee their spot in the same group if they can beat Italy and then either Wales or Bosnia and Herzegovina.
Please use Chrome browser for a more accessible video player
1:20
‘Bring it on!’: Scotland fans react to World Cup draw
The Republic of Ireland also need to get through the play-offs first and are paired against the Czech Republic for their semi-final. Should Ireland win that match, they will need to beat either North Macedonia or Denmark to get to the finals where an opening group containing joint hosts Mexico, South Africa and South Korea awaits.
This was a World Cup draw like no other. Crafted less for the teams but for one man.
The choice of venue. The creation of a new trophy. The closing music act.
Donald Trump was lavished with the adulation he craves by FIFA President Gianni Infantino and feels others unfairly deny him.
Knowing how much being overlooked by the Nobel Committee hurt the US president, there was Mr Infantino with FIFA’s newly-created Peace Prize to hand over. And a medal for Mr Trump to wear.
“This is truly one of the great honours of my life,” he said. “And beyond awards, Gianni and I were discussing this. We saved millions and millions of lives.”
This was all on the stage in front of an audience who turned up to find out who they will be playing at the World Cup.
England handed an undaunting route past Croatia, Panama and Ghana. Scotland paired with newcomers Haiti before tricky reunions from their last men’s World Cup in 1998 against Brazil and Morocco.
More on Donald Trump
Related Topics:
Image: Pic: Reuters
But the show before the draw could even begin – presided over by Rio Ferdinand – took almost as long as a football match, at 87 minutes after the noon kick-off was delayed.
There was a walk of self-promotion to complete – “I guess they have to wait” – before taking his seat in the Kennedy Center. Or the Trump Kennedy Center as the president takes to calling the venue picked 1.5 miles from the White House.
Please use Chrome browser for a more accessible video player
0:35
England manager Thomas Tuchel reacts to draw
“It was falling apart,” he said, delaying the walk into the auditorium. “And now it’s, it’s pretty much back.”
Mr Infantino could only watch on, beaming, at his friend.
“We had a dead country,” Mr Trump went on, “and now we have the hottest country anywhere in the world”.
There was the awkwardness of being reminded, before receiving the peace accolade, about threats to launch military strikes on Venezuela to stop the drugs trade.
“I did settle eight wars, and we have a ninth coming,” he swatted away the question. “Which nobody’s ever done before. But I want to really save lives. I don’t need prizes.”
But FIFA knew how much he wanted more gold for the collection with the prize.
Image: Donald Trump and FIFA president Gianni Infantino. Pic: Reuters
Image: Pic: Reuters
And for all the mockery and disdain targeted at FIFA, how many sports would relish having the US president spend several hours attending a procedural event determining the placing of teams in groups for a tournament?
How many would dish out the same flattery to secure direct lines to the leader of the nation staging their championship?
Many have benefited from Mr Trump’s stardust and swagger being attached to this spectacle.
Even Port Vale’s most famous fan – Robbie Williams – secured a walk-on role, exceeding his profile this side of the Pond.
And the Village People are reaping the rewards of becoming the unlikeliest of Trump hype acts.
The festivities ended with eyes fixed back up to the presidential seating and the YMCA dance being performed.
This was an afternoon that dispelled any pretence that FIFA keeps a distance from politics. It was unapologetically political. But few speak out in the FIFA world as the redistributed wealth keeps rolling back in their direction.
It would be easy to forget this isn’t entirely America’s World Cup. They’re sharing hosting with Canada and Mexico.
Please use Chrome browser for a more accessible video player
1:20
‘Bring it on!’: Scotland fans react to World Cup draw
And eventually the spotlight was ceded to their leaders – very briefly – as Mexican President Claudia Sheinbaum and Canadian Prime Minister Mark Carney drew out their countries’ names.
But it did live up to FIFA’s mantra that football can unite the world.
The neighbours were brought together here on a snowy day in Washington. And tensions – often stoked by Mr Trump with Canada and Mexico – thawed in the name of football.