Connect with us

Published

on

As AI deepfakes cause havoc during other elections, experts warn the UK’s politicians should be prepared.

“Just tell me what you had for breakfast”, says Mike Narouei, of ControlAI, recording on his laptop. I speak for around 15 seconds, about my toast, coffee and journey to their offices.

Within seconds, I hear my own voice, saying something entirely different.

Follow the latest updates on the election

In this case, words I have written: “Deepfakes can be extremely realistic and have the ability to disrupt our politics and damage our trust in the democratic process.”

Tamara Cohen's voice being turned into a deepfake
Image:
Tamara Cohen’s voice being turned into a deepfake

We have used free software, it hasn’t taken any advanced technical skills, and the whole thing has taken next to no time at all.

This is an audio deepfake – video ones take more effort to produce – and as well as being deployed by scammers of all kinds, there is deep concern, in a year with some two billion people going to the polls, in the US, India and dozens of other countries including the UK, about their impact on elections.

More on Artificial Intelligence

Sir Keir Starmer fell victim to one at last year’s Labour Party conference, purportedly of him swearing at staff. It was quickly outed as a fake. The identity of who made it has never been uncovered.

London mayor Sadiq Khan was also targeted this year, with fake audio of him making inflammatory remarks about Remembrance weekend and calling for pro-Palestine marches going viral at a tense time for communities. He claimed new laws were needed to stop them.

Ciaran Martin, the former director of the UK’s National Cyber Security Centre, told Sky News that expensively made video fakes can be less effective and easier to debunk than audio.

“I’m particularly worried right now about audio, because audio deepfakes are spectacularly easy to make, disturbingly easy”, he said. “And if they’re cleverly deployed, they can have an impact.”

Those which have been most damaging, in his view, are an audio deepfake of President Biden, sent to voters during the New Hampshire primaries in January this year.

A “robocall” with the president’s voice told voters to stay at home and “save” their votes for the presidential election in November. A political consultant later claimed responsibility and has been indicted and fined $6m (£4.7m).

Read more:
The digital election in India
Time running out for regulators to tackle AI threat
Biden to unveil sweeping AI regulations

Ciaran Martin, the former NCSC director
Image:
Ciaran Martin, the former NCSC director

Mr Martin, now a professor at the Blavatnik School of Government at Oxford University, said: “It was a very credible imitation of his voice and anecdotal evidence suggests some people were tricked by that.

“Not least because it wasn’t an email they could forward to someone else to have a look at, or on TV where lots of people were watching. It was a call to their home which they more or less had to judge alone.

“Targeted audio, in particular, is probably the biggest threat right now, and there’s no blanket solution, there’s no button there that you can just press and make this problem go away if you are prepared to pay for it or pass the right laws.

“What you need, and the US did this very well in 2020, is a series of responsible and well-informed eyes and ears throughout different parts of the electoral system to limit and mitigate the damage.”

He says there is a risk to hyping up the threat of deepfakes, when they have not yet caused mass electoral damage.

A Russian-made fake broadcast of Ukrainian TV, he said, featuring a Ukrainian official taking responsibility for a terrorist attack in Moscow, was simply “not believed”, despite being expensively produced.

The UK government has passed a National Security Act with new offences of foreign interference in the country’s democratic processes.

The Online Safety Act requires tech companies to take such content down, and meetings are being regularly held with social media companies during the pre-election period.

Democracy campaigners are concerned that deepfakes could be used not just by hostile foreign actors, or lone individuals who want to disrupt the process – but political parties themselves.

Polly Curtis is chief executive of the thinktank Demos, which has called on the parties to agree to a set of guidelines for the use of AI.

Polly Curtis, the chief executive of Demos
Image:
Polly Curtis, the chief executive of Demos

She said: “The risk is that you’ll have foreign actors, you’ll have political parties, you’ll have ordinary people on the street creating content and just stirring the pot of what’s true and what’s not true.

“We want them to come together and agree together how they’re going to use these tools at the election. We want them to agree not to create generative AI or amplify it, and label it when it is used.

“This technology is so new, and there are so many elections going on, there could be a big misinformation event in an election campaign that starts to affect people’s trust in the information they’ve got.”

Deepfakes have already been targeted at major elections.

Last year, within hours before polls closed in the Slovakian presidential election, an audio fake of one of the candidates claiming to have rigged the election went viral. He was heavily defeated and his pro-Russian opponent won.

The UK government established a Joint Election Security Preparations Unit earlier this year – with Whitehall officials working with police and security agencies – to respond to threats as they emerge.

Follow Sky News on WhatsApp
Follow Sky News on WhatsApp

Keep up with all the latest news from the UK and around the world by following Sky News

Tap here

A UK government spokesperson said: “Security is paramount and we are well-prepared to ensure the integrity of the election with robust systems in place to protect against any potential interference.

“The National Security Act contains tools to tackle deepfake election threats and social media platforms should also proactively take action against state-sponsored content aimed at interfering with the election.”

A Labour spokesperson said: “Our democracy is strong, and we cannot and will not allow any attempts to undermine the integrity of our elections.

“However, the rapid pace of AI technology means that government must now always be one step ahead of malign actors intent on using deepfakes and disinformation to undermine trust in our democratic system.

“Labour will be relentless in countering these threats.”

Continue Reading

Politics

US eyes quantum computing investments amid rising national security stakes

Published

on

By

US eyes quantum computing investments amid rising national security stakes

US eyes quantum computing investments amid rising national security stakes

Washington is considering direct investments in US quantum computing companies as it seeks to keep pace with China’s tech capabilities.

Continue Reading

Politics

Despite gov’t shutdown, crypto market structure bill ‘90% there’ — Coinbase CEO

Published

on

By

Despite gov’t shutdown, crypto market structure bill ‘90% there’ — Coinbase CEO

Despite gov’t shutdown, crypto market structure bill ‘90% there’ — Coinbase CEO

The remaining “10%” of issues center mainly on DeFi, which Brian Armstrong says lawmakers are addressing carefully to preserve innovation.

Continue Reading

Politics

PM has ‘confidence’ in Jess Phillips after grooming survivors demanded her resignation

Published

on

By

PM has 'confidence' in Jess Phillips after grooming survivors demanded her resignation

Sir Keir Starmer has backed his under-fire safeguarding minister to continue leading the government’s efforts to set up a national inquiry into grooming gangs after four survivors demanded her resignation.

The prime minister said on Thursday that Jess Phillips has “devoted vast parts of her life and career” to tackling violence against women and girls, and has “confidence in her”, despite the turmoil that has beset the process.

All four survivors who quit the government’s grooming gangs inquiry panel said they will consider returning to the process if Ms Phillips resigns.

Politics latest: ‘Progress’ that returning small boat migrant was identified

However, five other survivors on the panel have written to Sir Keir to say they will only stay if Ms Phillips remains.

They said she had remained impartial, had listened to feedback and her previous experience to reduce violence against women and girls and her “clear passion and commitment is important to us”.

In contrast to the four who have quit, who accused Ms Phillips of trying to expand the inquiry’s scope beyond grooming gangs, the five said it needs to be widened to focus on child sexual exploitation as a whole to ensure survivors who do not fit “the generalised stereotype” are not excluded.

More on Grooming Gangs

In response to the demand for Ms Phillips to quit, Sir Keir said: “The safeguarding minister has huge experience in issues relating to violence against women and girls. She’s devoted vast parts of her life and career to that, and so I do have confidence in her and Louise Casey in leading this project.”

Speaking to ITV Meridian, the prime minister also sought to reassure the victims of grooming, saying: “It’s really important that the national inquiry gets to the truth. All survivors deserve answers to their questions.”

“It is very important that I say to all survivors that I give my personal assurance that this inquiry will go wherever it needs to go, the scope will not be changed.”

It is understood Downing Street has reached out to the four survivors who quit the government’s process this week.

Please use Chrome browser for a more accessible video player

Starmer defended Phillips at PMQs on Wednesday

Samantha, one of the survivors who wrote the letter saying they would only stay if Ms Phillips remains, told Sky News: “We shouldn’t be falling apart right now, we should be working together.

“Jess has only ever been fair and honest with us, she’s told us as much as she possibly can within her capacity.

“She’s provided a lot of support over the phone and in-person to a lot of us survivors behind the scenes, which people don’t see about Jess.

“So I do still want her to be part of this inquiry up until the end.”

A government source told Sky News the government will be talking to all survivors on the panel about their concerns and opinions on the type of person they want to chair the inquiry, after the leading candidate dropped out following concerns from survivors over his background as a police officer.

The government will move as fast as possible, they said, but it will likely take months to appoint the right chair.

Why four survivors quit the inquiry

The four women who resigned this week expressed concerns about how the process of selecting a chair and setting the terms of reference of the national inquiry into grooming gangs is being run.

They wrote on Wednesday to Home Secretary Shabana Mahmood, calling for Ms Phillips to step down and all survivors to be consulted on appointing a senior judge as chair with no major conflicts of interest.

Ms Phillips told parliament on Tuesday that suggestions that the scope of the inquiry was to be expanded from just grooming gangs were “categorically untrue”.

But leaked consultation documents and texts between the safeguarding minister and survivor Fiona Goddard show the survivors’ concerns that the scope would be expanded were valid.

Please use Chrome browser for a more accessible video player

Shadow Housing Secretary Sir James Cleverly told Sky News that he can’t see how Jess Phillips can stay in post

The survivors’ letter says: “Being publicly contradicted and dismissed by a government minister when you are a survivor telling the truth takes you right back to that feeling of not being believed all over again.

“It is a betrayal that has destroyed what little trust remained.”

They have demanded that the scope of the inquiry remain “laser-focused” on grooming gangs and called for victims to be free to speak to support networks without fear of reprisal.

Fiona Goddard and Kemi Badenoch speaking during a press conference earlier this year
Pic PA
Image:
Fiona Goddard and Kemi Badenoch speaking during a press conference earlier this year
Pic PA

The letter to Ms Mahmood says: “Her [Ms Phillips’] conduct over the last week has shown she is unfit to oversee a process that requires survivors to trust the government. Her departure would signal you are serious about accountability and changing direction.”

The survivors describe their demands as “the absolute bare minimum for survivors to trust that this inquiry will be different from every other process that has let us down”.

Please use Chrome browser for a more accessible video player

Minister for Children and Families, Josh MacAlister told Sky News Jess Phillips will not be resigning

Frontrunner quits over ‘toxicity’

The letter was sent hours after one of the frontrunners to become chair of the inquiry withdrew, blaming “vested interests” and “political opportunism and point-scoring”.

Ex-police chief and child protection specialist Jim Gamble told the home secretary in a letter there was a “highly charged and toxic environment” around the appointment process and victims “deserve better”.

The other, Annie Hudson, a former social worker, said earlier this week she no longer wanted to be considered after intense media coverage.

Please use Chrome browser for a more accessible video player

‘Everyone should park their interests’

The prime minister launched the inquiry into grooming gangs after an audit by Baroness Louise Casey showed the scale of the problem.

It is understood that the government is exploring a range of other candidates and will provide an update in due course.

A Home Office spokesperson said: “The grooming gang scandal was one of the darkest moments in this country’s history.

“That is why this government is committed to a full, statutory, national inquiry to uncover the truth. It is the very least that the victims of these hideous crimes deserve.

“We are disappointed that candidates to chair that inquiry have withdrawn. This is an extremely sensitive topic, and we have to take the time to appoint the best person suitable for the role.

“The home secretary has been clear – there will be no hiding place for those who abused the most vulnerable in our society.”

Continue Reading

Trending