Three years ago in Detroit, Robert Williams arrived home from work to find the police waiting at his front door, ready to arrest him for a crime he hadn’t committed.
Facial recognition technology used by officers had mistaken Williams for a suspect who had stolen thousands of dollars worth of watches.
The system linked a blurry CCTV image of the suspect with Williams in what is considered to be the first known case of wrongful arrest owing to the use of the AI-based technology.
The experience was “infuriating”, Mr Williams said.
“Imagine knowing you didn’t do anything wrong… And they show up to your home and arrest you in your driveway before you can really even get out the car and hug and kiss your wife or see your kids.”
Mr Williams, 45, was released after 30 hours in custody, and has filed a lawsuit, which is ongoing, against Detroit’s police department asking for compensation and a ban on the use of facial recognition software to identify suspects.
Image: Robert Williams with his family
There are six known instances of wrongful arrest in the US, and the victims in all cases were black people.
Artificial intelligence reflects racial bias in society, because it is trained on real-world data.
A US government study published in 2019 found that facial recognition technology was between 10 and 100 times more likely to misidentify black people than white people.
Advertisement
This is because the technology is trained on predominantly white datasets. This is because it doesn’t have as much information on what people of other races look like, so it’s more likely to make mistakes.
There are growing calls for that bias to be addressed if companies and policymakers want to use it for future decision-making.
One approach to solving the problem is to use synthetic data, which is generated by a computer to be more diverse than real-world datasets.
Chris Longstaff, vice president for product management at Mindtech, a Sheffield-based start-up, said that real-world datasets are inherently biased because of where the data is drawn from.
“Today, most of the AI solutions out there are using data scraped from the internet, whether that is from YouTube, Tik Tok, Facebook, one of the typical social media sites,” he said.
As a solution, Mr Longstaff’s team have created “digital humans” based on computer graphics.
These can vary in ethnicity, skin tone, physical attributes and age. The lab then combines some of this data with real-world data to create a more representative dataset to train AI models.
One of Mindtech’s clients is a construction company that wants to improve the safety of its equipment.
The lab uses the diverse data it has generated to train the company’s autonomous vehicles to recognise different types of people on the construction site so it can stop moving if someone is in their way.
Image: Some CCTV cameras are now fitted with facial recognition technology. File pic
Toju Duke, a responsible AI advisor and former programme manager at Google, said that using computer-generated, or “synthetic,” data to train AI models has its downsides.
“For someone like me, I haven’t travelled across the whole world, I haven’t met anyone from every single culture and ethnicity and country,” he said.
“So there’s no way I can develop something that would represent everyone in the world and that could lead to further offences.
“So we could actually have synthetic people or avatars that could have a mannerism that could be offensive to someone else from a different culture.”
The problem of racial bias is not unique to facial recognition technology, it has been recorded across different types of AI models.
Spreaker
This content is provided by Spreaker, which may be using cookies and other technologies.
To show you this content, we need your permission to use cookies.
You can use the buttons below to amend your preferences to enable Spreaker cookies or to allow those cookies just once.
You can change your settings at any time via the Privacy Options.
Unfortunately we have been unable to verify if you have consented to Spreaker cookies.
To view this content you can use the button below to allow Spreaker cookies for this session only.
The vast majority of AI-generated images of “fast food workers” showed people with darker skin tones, even though US labour market figures show that the majority of fast food workers in the country are white, according to a Bloomberg experiment using Stability AI’s image generator earlier this year.
The company said it is working to diversify its training data.
A spokesperson for the Detroit police department said it has strict rules for using facial recognition technology and considers any match only as an “investigative lead” and not proof that a suspect has committed a crime.
“There are a number of checks and balances in place to ensure ethical use of facial recognition, including: use on live or recorded video is prohibited; supervisor oversight; and weekly and annual reporting to the Board of Police Commissioners on the use of the software,” they said.
Donald Trump begins bulldozing much of the White House as his plans to build a mega ballroom begin – without planning permission, nor true clarity as to how it’s all being funded.
There are aesthetic questions, historical questions and ethical questions. We dig into what they are.
And – who is the young Democratic socialist about to become New York City’s first Muslim mayor? We tell you everything you need to know about Zohran Mamdani.
You can also watch all episodes on our YouTube channel – and watch David Blevins’ digital video on the White House ballroom here.
Email us on trump100@sky.uk with your comments and questions.
Analysis: Escalation will test Trump and Carney’s relationship
Trump turning once again on America’s closest ally Canada just proves how flippant his trade decisions are.
The smooth-talking confidence of Prime Minister Mark Carney persuaded Canadians to vote for him in this year’s election.
He certainly ran on a pitch to stand up to Trump, but his recent dealings with the US president have largely been diplomatic and cordial.
Carney was last in the Oval Office just over two weeks ago, and the pair laughed off Trump’s obsession with Canada becoming the “51st state”.
But now it’s a single advert from the government of Ontario that has triggered Trump to pause all trade talks between the two, calling its anti-tariff stance “egregious” on his social media platform Truth Social.
The advert uses Ronald Reagan’s voice to attack tariff policy – arguing trade barriers “hurt every American worker and consumer… markets shrink, and collapse, businesses and industries shut down and millions of people lose their jobs”.
But now, the Ronald Reagan Foundation has said the ad “misrepresents” his words – and they did not give their permission to use it.
Mere hours before Trump’s post, Carney was prodding Trump jokingly to bet on the outcome of the baseball World Series.
Given this latest escalation by the President tonight, their next interaction will be far from a laughing matter.
Vladimir Putin has described Donald Trump’s sanctions against two major oil firms as an “unfriendly act”.
However, the Russian president has insisted the tightened restrictions won’t affect the nation’s economy, a claim widely contradicted by most analysts.
In a major policy shift, Mr Trump imposed sanctions against Rosneft and Lukoil – Russia’s biggest oil companies – on Wednesday.
Please use Chrome browser for a more accessible video player
2:08
Will US sanctions on Russian oil hurt the Kremlin?
The White House said this was because of “Russia’s lack of serious commitment to a peace process to end the war in Ukraine”.
Putin has now warned the move could disrupt the global oil markets, and lead to higher prices for consumers worldwide.
A meeting between the two leaders had been proposed in Budapest, but Mr Trump said he had decided to cancel the talks because “it didn’t feel right to me”.
Speaking from the Oval Office, he had told reporters: “I have good conversations. And then, they don’t go anywhere. They just don’t go anywhere.”
More on Donald Trump
Related Topics:
Giving a speech in Moscow yesterday, Putin said “dialogue is always better than war” – but warned that Russia will never bow to pressure from abroad.
Earlier, his long-term ally Dmitry Medvedev had described Mr Trump as a “talkative peacemaker” who had now “fully embarked on the warpath against Russia”.
Please use Chrome browser for a more accessible video player
2:43
Why did Trump sanction Russian oil?
Oil prices have witnessed a sizeable jump since the sanctions were announced, with Brent crude rising by 5% – the biggest daily percentage gains since the middle of June.
In other developments, Lithuania has claimed that two Russian military aircraft briefly entered its airspace yesterday.
A Su-30 fighter and Il-78 refuelling tanker were in the NATO member’s territory for 18 seconds, and Spanish jets were scrambled in response to the incident.
Russia’s defence ministry denied this – and said its planes did not violate the borders of any other country during a “training flight” in the Kaliningrad region.
Please use Chrome browser for a more accessible video player
0:47
Zelenskyy tells Sky News ‘ceasefire is still possible’
Volodymyr Zelenskyy attended a European Council summit in Brussels to discuss the war in Ukraine – and said the meeting had delivered “good results”.
He said Ukraine had secured political support for frozen Russian assets and “their maximum use” to defend against Russian aggression, adding the EU would “work out all the necessary details”.
Mr Zelenskyy thanked the bloc for approving its 19th sanctions package against Russia earlier today, and work was already beginning on a 20th.
European leaders are going to arrive in London later today for a “critical” meeting of the “Coalition of the Willing” – with the goal of discussing “how they can pile pressure on Putin as he continues to kill innocent civilians with indiscriminate attacks across Ukraine”.
Please use Chrome browser for a more accessible video player
0:43
How will the Russian oil sanctions affect petrol costs?
Prime Minister Sir Keir Starmer said: “The only person involved in this conflict who does not want to stop the war is President Putin, and his depraved strikes on young children in a nursery this week make that crystal clear.
“Time and again we offer Putin the chance to end his needless invasion, to stop the killing and recall his troops, but he repeatedly rejects those proposals and any chance of peace.
“From the battlefield to the global markets, as Putin continues to commit atrocities in Ukraine we must ratchet up the pressure on Russia and build on President Trump’s decisive action.”