Doctors are using unapproved AI software to record patient meetings, investigation reveals
Doctors are using AI software that does not meet minimum standards to record and transcribe patient meetings, according to a Sky News investigation.
NHS bosses have demanded GPs and hospitals stop using artificial intelligence software that could breach data protection rules and put patients at risk.
A warning sent out by NHS England this month came just weeks after the same body wrote to doctors about the benefits of using AI for notetaking – to allow them more time to concentrate on patients – using software known as Ambient Voice Technology, or “AVT”.
Health Secretary Wes Streeting will next week put AI at the heart of the reform plan to save the NHS in the 10-year plan for the health service in England.
But there is growing controversy around software that records, transcribes and summarises patient conversations using AI.
In April, NHS England wrote to doctors to sell the benefits of AVT and set out minimum national standards.
However, in a letter seen by Sky News, NHS bosses wrote to doctors to warn that unapproved software that breached minimum standards could harm patients.
The 9 June letter, from the national chief clinical information officer of NHS England, said: “We are now aware of a number of AVT solutions which, despite being non-compliant … are still being widely used in clinical practice.
“Several AVT suppliers are approaching NHS organisations … many of these vendors have not complied with basic NHS governance standards.
“Proceeding with non-compliant solutions risks clinical safety, data protection breaches, financial exposure, and fragmentation of broader NHS digital strategy.”
Sky News has previously revealed the danger of AI “hallucinations”, where the technology makes up answers then lies about them, which could prove dangerous in a healthcare setting.
Please use Chrome browser for a more accessible video player
Is ChatGPT reliable despite its ‘hallucinations’?
NHS England sets minimum standards but does not tell NHS trusts and healthcare providers which software providers to use.
Sky News can now reveal there is growing pressure on NHS England and similar bodies to be more proactive.
Dr David Wrigley, deputy chair of the British Medical Association’s GP committee, said: “Undoubtedly, as a GP myself and my 35,000 colleagues, we’ve got responsibilities here – but in such a rapidly developing market when we haven’t got the technical knowledge to look into this.
“We need that help and support from those who can check that the products are safe, check they’re secure, that they’re suitable for use in the consulting room, and NHS England should do that and help and support us.”
Dr Wrigley continued: “We’re absolutely in favour of tech and in favour of taking that forward to help NHS patients, help my colleagues in their surgeries.
“But it’s got to be done in a safe and secure way because otherwise we could have a free for all – and then data could be lost, it could be leaking out, and that just isn’t acceptable.
“So we are not dinosaurs, we’re very pro-AI, but it has to be a safe, secure way.”
The head of the NHS Confederation says the letter is ‘a really significant moment’
The spectre of dozens of little-known but ambitious AI companies lobbying hospitals and surgeries to get their listening products installed worries some healthcare professionals.
There are huge profits to be made in this technological arms race, but the question being asked is whether hundreds of different NHS organisations can really be expected to sift out the sharks.
Matthew Taylor, chief executive of the NHS Confederation, said the letter was “a really significant moment”.
He said it was right for the NHS to experiment, but that it needed to be clearer what technology does and does not work safely.
“My own view is that the government should help in terms of the procurement decisions that trusts make and should advise on which AI systems – as we do with other forms of technology that we use in medicine – which ones are safe,” Mr Taylor said.
“We’ll need [government] to do a bit more to guide the NHS in the best way to use this.”
When pressed whether in the short term that actually makes it sound like it could be quite dangerous, Mr Taylor replied: “What you’ve seen with ambient voice technology is that kind of ‘let a thousand flowers bloom’ approach has got its limits.”
Please use Chrome browser for a more accessible video player
Godfather of AI warns of its dangers
Earlier this year, the health secretary appeared to suggest unapproved technology was being used – but celebrated it as a sign doctors were enthusiastic for change.
Mr Streeting said: “I’ve heard anecdotally down the pub, genuinely down the pub, that some clinicians are getting ahead of the game and are already using ambient AI to kind of record notes and things, even where their practice or their trust haven’t yet caught up with them.
“Now, lots of issues there – not encouraging it – but it does tell me that contrary to this, ‘Oh, people don’t want to change, staff are very happy and they are really resistant to change’, it’s the opposite. People are crying out for this stuff.”
Read more from Sky News:
National investigation launched into maternity services
Every baby in the UK to receive DNA testing
GP Anil Mehta says the AI software helps cut paperwork and patients are ‘extremely reassured’
Doctors who use AI that complies with national standards already say there are big benefits.
Anil Mehta, a doctor in the health secretary’s Ilford constituency, told Sky News he backed his MP’s drive for more AI technology in healthcare.
“I spend 30% of my week doing paperwork,” he said. “So I think once I’ve explained all of those features of what we’re doing, patients are extremely reassured. And I haven’t faced anybody that’s not wanted to have me do this.
He added: “(I) think that consultation with your doctor is extremely confidential, so that’s not changed at all.
“That remains confidential – so whether it’s a vulnerable adult, a vulnerable child, teenager, young child with a parent, I think the concept of that confidentiality remains.”
An NHS spokesperson said: “Ambient Voice Technology has the potential to transform care and improve efficiency and in April, the NHS issued guidance to support its use in a safe and secure way.
“We are working with NHS organisations and suppliers to ensure that all Ambient Voice Technology products used across the health service continue to be compliant with NHS standards on clinical safety and data security.”
Victims of grooming gangs and modern slavery are being denied compensation by a government scheme because of their criminal records, Sky News has learned.
Analysis of official figures by Sky News’ Data & Forensics team shows more than 11,000 victims of crime over the last decade have been denied payouts because of their unspent convictions, including children.
The Criminal Injuries Compensation Authority can award money to victims of violent crime, including sexual abuse.
It is the only government compensation scheme for victims – for those unable to work due to injuries, the money can be vital.
But, if an applicant has a criminal record, they are automatically refused compensation with limited exceptions.
Those with unspent convictions sometimes receive reduced sums.
Sky News has found that at least 130 children with criminal records have received reduced awards over the last 10 years, including 50 victims of sex abuse, four victims of brain damage, and one child who lost sight in an eye.
This rule on unspent convictions is based on the idea that public funds should only compensate blameless victims of crime and not, for example, a gang member who was injured in a fight.
But many argue the policy punishes those who have been forced to offend by exploiters, as well as victims of child sexual abuse.
‘I was frustrated that I wasn’t being believed’
Arthur Sherry, 43, from Perranporth in Cornwall was regularly abused by his babysitter from the age of five, including suffering rape.
In 2008, he reported it to Devon and Cornwall Police, alongside two other victims. He alleges the police did not believe him, and charges were not brought against his abuser.
Arthur Sherry, who was abused as a child, says he was denied compensation because of his criminal record
Arthur became angry and descended into addiction as a “coping mechanism”, becoming suicidal, and was repeatedly arrested for minor offences, such as making false calls to the emergency services.
“I wasn’t getting support from any agencies, and no one asked me, ‘Why is this man ringing the emergency services all the time?'”
“It was a cry for help. I was frustrated that I wasn’t being believed.”
Eventually, Arthur’s abuser, Shaun Burton, was convicted of multiple offences against children, including 11 counts of indecency with a child in relation to Mr Sherry.
But when Arthur, who suffers from complex PTSD, subsequently tried to make a claim through the Criminal Injuries Compensation Authority in 2013, it was rejected because of his criminal record and because he submitted his application beyond CICA’s time limit.
He was not allowed to appeal the decision.
Arthur, aged 12 in the picture, was regularly abused by his babysitter, Shaun Burton, from the age of five
Many survivors of grooming gangs have criminal records due to being exploited and coerced.
While the government recently announced plans to disregard child prostitution convictions for these victims, many are urging authorities to go further and pardon all related offences.
Former victims’ commissioner Dame Vera Baird said: “They were not exercising their own free will and voluntarily committing crime, so there should be a discretion to look at that and say, ‘No, that wasn’t their fault’.
“They should get compensation for all the evil that was done to them by that gang.”
In 2022, the Independent Inquiry into Child Sexual Abuse recommended that the government amend the Criminal Injuries Compensation Scheme so that “applicants with unspent convictions are not automatically excluded where offences are likely to be linked to the circumstances of their sexual abuse as a child”.
The government has refused to act on this recommendation.
However, Labour MP Sarah Champion has tabled an amendment to the upcoming Victims and Courts Bill, hoping to implement it, as well as widen eligibility to the scheme.
“Victims are seen as running a cannabis farm and get a conviction, before it actually turns out that they were a victim of modern slavery.
“These people, who are very clearly recognised as victims and survivors, aren’t getting the money that’s owed to them. The system is broken and the ministers need to get rid of it.”
‘I was frustrated that I wasn’t being believed,’ Arthur tells Sky News’ Alice Porter
Read more from Sky News:
Wintry blast ‘could be a dry run for a cold December’
What does Trump’s Gaza peace plan look like?
A government spokesperson said: “Last year, more than £164m was paid out under the Criminal Injuries Compensation Scheme to victims, and we are going further by removing the time limit for civil personal injury claims and doubling Home Office funding for services supporting adult victims and survivors of child sexual abuse.
“Changes to the way we compensate victims have been considered by successive governments, and our priority must always be to treat all victims of violence equally.”
Devon and Cornwall Police said: “Tackling sexual offending is a key priority for Devon & Cornwall Police and we are working hard to bring offenders to justice.
“We take reports of all sexual offences seriously and will carry out thorough investigations into reports, looking at all viable lines of enquiry.”
Nathan Gill was at Manchester airport, about to board a flight to Russia, when accepting bribes finally caught up with him.
Gill, the former leader of Reform UK Wales and a one-time member of the European Parliament, who on Friday was jailed for 10-a-half-years, was stopped by police before boarding and had his phone seized in 2021.
While they interrogated him, his home in Anglesey was raided, with detectives discovering more electronics and cash piles of €5,000 (£4,400) and $5,000 (£3,800) respectively.
Nathan Gill being questioned. Pic: Met Police
The evidence on Gill’s phone would damn him – he was in contact with a pro-Russian politician in Ukraine, Oleg Voloshyn, and had agreed to boost pro-Russia viewpoints in exchange for money.
Voloshyn would dictate the statement, and Gill would repeat it – in some cases, almost word for word – in the media or the European Parliament.
In one instance, Gill appeared on the now-banned Ukrainian TV channel, 112 Ukraine, which was known for its pro-Russian stance.
In the interview, he was critical of the Ukrainian decision to open criminal proceedings against Viktor Medvedchuk, the owner of the television channel and a personal friend of Vladimir Putin.
Nathan Gill. Pic: Met Police
Speaking to the outlet, he said he was “very concerned” about the investigation, and wondered whether it was meant to silence “opposition politicians”.
Prosecutors said messages on Gill’s phone showed that this was at his paymaster’s instruction, with Voloshyn offering a “reward” if he would say that it was unacceptable to persecute a person for their political convictions.
Read more:
Reform UK’s former Wales leader jailed
Trump’s 28-point Ukraine peace plan in full
Voloshyn also offered the MEP €2,000 (£1,750) if he would express concern that Mr Medvedchuk could no longer mediate with Russia on Ukraine’s behalf, the court heard.
He added that “V” – understood to be Mr Medvedchuk – did not believe Ukrainian President Volodymyr Zelenskyy had “true intentions to pursue a peace agenda”, prosecutors said.
Bundles of cash were recovered from Gill’s home. Pic: Met Police
Sure enough, Gill appeared on 112 Ukraine saying it was “very sad” that Mr Medvedchuk felt he no longer had Mr Zelensky’s backing to act as a mediator with Russia, and suggested that using him “would be a sensible thing to do”.
The messages traded in innuendo, referring to the exchange of “Xmas gifts” or “postcards” instead of money.
But as the pair grew more comfortable with each other, they bargained more explicitly, with the sum of “£5k” quoted for Gill’s work.
Dominic Murphy, head of Counter Terrorism Command at the Met Police, said Gill had also offered access to other MEPs.
“This is where we get into that slightly odd situation where it feels very much like a real effort to undermine democracy here,” he said.
“This is Nathan Gill reaching out to individuals that he knows, who are Brits, who might be willing to be paid to go and make speeches.”
Commander Murphy declined to name names, but said there was an ongoing investigation and that other people had been spoken to.
None of the pro-Brexit MEPs Gill allegedly approached have been interviewed under caution.
Pic: Met Police
Police confirmed there was no evidence to suggest Reform UK leader Nigel Farage was involved.
Gill was stopped at Manchester Airport on 13 September 2021, under schedule 3 of the Counter Terrorism and Borders Security Act 2019.
He offered police no explanation for his actions and answered no comment in a March 2022 police interview.
But the 52-year-old is believed to have had financial problems.
Mr Murphy added that while Gill appeared to have pro-Russian sympathies, he was primarily motivated by money.
The ex-MEP has been jailed for 10-and-a-half years after pleading guilty to eight counts of bribery between December 2018 and July 2019.
Following an investigation by counter-terrorism police, officers said they believe Gill likely took a minimum of £40,000 in cash and was offering to introduce other British MEPs so they could be bribed.
Voloshyn was picked up by the authorities on a trip to the US in 2021, which enabled the FBI to discover his end of the conversation.
He is now believed to be in Russia, but has been sanctioned by the UK government over allegations of trying to destabilise Ukraine.
Nathan Gill pleaded guilty to eight counts of bribery over pro-Russian statements. Including to media outlet 112 Ukraine. Pic: Met Police
He remains wanted in both Britain and Ukraine.
A Reform UK spokesman said: “Mr Gill’s actions were reprehensible, treasonous and unforgivable.
“We are glad that justice has been served and fully welcome the sentence Nathan Gill has received.”
Mr Farage, the Reform UK leader, said: “An investigation into Russian and Chinese influence over British politics would be welcome.”
The MP for Clacton previously described his former colleague as a “bad apple” and said he was “shocked” after Gill pleaded guilty to eight counts of bribery.
He said: “Any political party can find in their midst all sorts of terrible people.
“You can never, ever guarantee 100% that everyone you meet in your life, you shake hands with in the pub, is a good person.”
-
Sports2 years agoStory injured on diving stop, exits Red Sox game
-
Sports3 years ago‘Storybook stuff’: Inside the night Bryce Harper sent the Phillies to the World Series
-
Sports2 years agoGame 1 of WS least-watched in recorded history
-
Sports3 years agoButton battles heat exhaustion in NASCAR debut
-
Sports3 years agoMLB Rank 2023: Ranking baseball’s top 100 players
-
Sports4 years ago
Team Europe easily wins 4th straight Laver Cup
-
Environment3 years agoJapan and South Korea have a lot at stake in a free and open South China Sea
-
Environment1 year agoHere are the best electric bikes you can buy at every price level in October 2024