As a fourth-year ophthalmology resident at Emory University School of Medicine, Riley Lyons biggest responsibilities include triage: When a patient comes in with an eye-related complaint, Lyons must make an immediate assessment of its urgency. Use Our Content
It can be republished for free. Are you covered by Medi-Cal?
We want to hear about your experiences and, with your permission, may incorporate your story into our coverage. Please tell us what it has been like for you as you have sought and received care, including the good and the bad, the obstacles and the successes.Share Your Story
He often finds patients have already turned to Dr. Google. Online, Lyons said, they are likely to find that any number of terrible things could be going on based on the symptoms that they’re experiencing.
So, when two of Lyons fellow ophthalmologists at Emory came to him and suggested evaluating the accuracy of the AI chatbot ChatGPT in diagnosing eye-related complaints, he jumped at the chance.
In June, Lyons and his colleagues reported in medRxiv, an online publisher of health science preprints, that ChatGPT compared quite well to human doctors who reviewed the same symptoms and performed vastly better than the symptom checker on the popular health website WebMD. And despite the much-publicized hallucination problem known to afflict ChatGPT its habit of occasionally making outright false statements the Emory study reported that the most recent version of ChatGPT made zero grossly inaccurate statements when presented with a standard set of eye complaints.
The relative proficiency of ChatGPT, which debuted in November 2022, was a surprise to Lyons and his co-authors. The artificial intelligence engine is definitely an improvement over just putting something into a Google search bar and seeing what you find, said co-author Nieraj Jain, an assistant professor at the Emory Eye Center who specializes in vitreoretinal surgery and disease.
But the findings underscore a challenge facing the health care industry as it assesses the promise and pitfalls of generative AI, the type of artificial intelligence used by ChatGPT: The accuracy of chatbot-delivered medical information may represent an improvement over Dr. Google, but there are still many questions about how to integrate this new technology into health care systems with the same safeguards historically applied to the introduction of new drugs or medical devices.
The smooth syntax, authoritative tone, and dexterity of generative AI have drawn extraordinary attention from all sectors of society, with some comparing its future impact to that of the internet itself. In health care, companies are working feverishly to implement generative AI in areas such as radiology and medical records. Email Sign-Up
Subscribe to KFF Health News' free Morning Briefing. Your Email Address Sign Up
When it comes to consumer chatbots, though, there is still caution, even though the technology is already widely available and better than many alternatives. Many doctors believe AI-based medical tools should undergo an approval process similar to the FDAs regime for drugs, but that would be years away. Its unclear how such a regime might apply to general-purpose AIs like ChatGPT.
There’s no question we have issues with access to care, and whether or not it is a good idea to deploy ChatGPT to cover the holes or fill the gaps in access, it’s going to happen and it’s happening already, said Jain. People have already discovered its utility. So, we need to understand the potential advantages and the pitfalls.
The Emory study is not alone in ratifying the relative accuracy of the new generation of AI chatbots. A report published in Nature in early July by a group led by Google computer scientists said answers generated by Med-PaLM, an AI chatbot the company built specifically for medical use, compare favorably with answers given by clinicians.
AI may also have better bedside manner. Another study, published in April by researchers from the University of California-San Diego and other institutions, even noted that health care professionals rated ChatGPT answers as more empathetic than responses from human doctors.
Indeed, a number of companies are exploring how chatbots could be used for mental health therapy, and some investors in the companies are betting that healthy people might also enjoy chatting and even bonding with an AI friend. The company behind Replika, one of the most advanced of that genre, markets its chatbot as, The AI companion who cares. Always here to listen and talk. Always on your side.
We need physicians to start realizing that these new tools are here to stay and they’re offering new capabilities both to physicians and patients, said James Benoit, an AI consultant. While a postdoctoral fellow in nursing at the University of Alberta in Canada, he published a study in February reporting that ChatGPT significantly outperformed online symptom checkers in evaluating a set of medical scenarios. They are accurate enough at this point to start meriting some consideration, he said.
Still, even the researchers who have demonstrated ChatGPTs relative reliability are cautious about recommending that patients put their full trust in the current state of AI. For many medical professionals, AI chatbots are an invitation to trouble: They cite a host of issues relating to privacy, safety, bias, liability, transparency, and the current absence of regulatory oversight.
The proposition that AI should be embraced because it represents a marginal improvement over Dr. Google is unconvincing, these critics say.
That’s a little bit of a disappointing bar to set, isn’t it? said Mason Marks, a professor and MD who specializes in health law at Florida State University. He recently wrote an opinion piece on AI chatbots and privacy in the Journal of the American Medical Association. I don’t know how helpful it is to say, Well, let’s just throw this conversational AI on as a band-aid to make up for these deeper systemic issues, he said to KFF Health News.
The biggest danger, in his view, is the likelihood that market incentives will result in AI interfaces designed to steer patients to particular drugs or medical services. Companies might want to push a particular product over another, said Marks. The potential for exploitation of people and the commercialization of data is unprecedented.
OpenAI, the company that developed ChatGPT, also urged caution.
OpenAIs models are not fine-tuned to provide medical information, a company spokesperson said. You should never use our models to provide diagnostic or treatment services for serious medical conditions.
John Ayers, a computational epidemiologist who was the lead author of the UCSD study, said that as with other medical interventions, the focus should be on patient outcomes.
If regulators came out and said that if you want to provide patient services using a chatbot, you have to demonstrate that chatbots improve patient outcomes, then randomized controlled trials would be registered tomorrow for a host of outcomes, Ayers said.
He would like to see a more urgent stance from regulators.
One hundred million people have ChatGPT on their phone, said Ayers, and are asking questions right now. People are going to use chatbots with or without us.
At present, though, there are few signs that rigorous testing of AIs for safety and effectiveness is imminent. In May, Robert Califf, the commissioner of the FDA, described the regulation of large language models as critical to our future, but aside from recommending that regulators be nimble in their approach, he offered few details.
In the meantime, the race is on. In July, The Wall Street Journal reported that the Mayo Clinic was partnering with Google to integrate the Med-PaLM 2 chatbot into its system. In June, WebMD announced it was partnering with a Pasadena, California-based startup, HIA Technologies Inc., to provide interactive diital health assistants. And the ongoing integration of AI into both Microsofts Bing and Google Search suggests that Dr. Google is already well on its way to being replaced by Dr. Chatbot.
This article was produced by KFF Health News, which publishes California Healthline, an editorially independent service of the California Health Care Foundation. Related Topics California Health Industry States Georgia Contact Us Submit a Story Tip
A new study has linked an unexplained LHAASO detection to a pulsar-powered X-ray nebula, confirming it as a rare PeVatron capable of accelerating particles to extreme energies. The discovery is a major step toward solving the long-standing mystery of galactic cosmic rays. Researchers are now combining X-ray, gamma-ray and neutrino observations to trace these powerful …
Airline passengers have been warned of potential travel disruption after Airbus identified a “significant number” A320 planes impacted by a software issue.
In a statement, the plane maker said: “Analysis of a recent event involving an A320 Family aircraft has revealed that intense solar radiation may corrupt data critical to the functioning of flight controls.
“Airbus has consequently identified a significant number of A320 Family aircraft currently in-service which may be impacted.”
Image: File pic: iStock
It is understood the incident that triggered an unexpected repair involved a JetBlue flight from Cancun, Mexico, to Newark, New Jersey, on 30 October, which suffered a sharp loss of altitude which injured several passengers.
An Airbus spokesperson told Sky News the necessary software change would affect up to 6,000 planes.
They added that for most of the affected aircraft, the required software update would take 2-3 hours. However, some aircrafts would need new hardware to be able to adopt the required software and that those aircraft would be affected for longer.
Travel expert, Simon Calder, said the situation was “very concerning” but that he had full faith in the safety procedures of Airbus and airlines. He went on to say that “aviation remains extraordinarily safe.”
More from UK
However, he warned that customers may not be entitled to cash compensation if affected by delays, as the issue would be considered out of the control of airlines.
EasyJet, British Airways, Aer Lingus, Lufthansa, American Airlines, Delta and Wizz Air are all affected by the issue.
Airbus told Sky News that it had proactively asked the European Union Aviation Safety Agency (EASA) to issue an air worthiness directive for the affected aircraft.
The issue is affecting A319, A320 and the A321 models. The company said the issue is only affecting A320s that are in service, not aircraft that are due to be delivered.
The UK Civil Aviation Authority said it is likely to mean some disruption and cancellation to flights.
Image: Airbus requested that EASA issue an air worthiness directive. Pic: Reuters
Some airlines will be more affected than others, Colombian airline Avianca has announced that it will close ticket sales for 10 days due to the issue.
In a statement, easyJet said: “As we are expecting this to result in some disruption, we will inform customers directly about any changes to our flying programme tomorrow and will do all possible to minimise the impact.”
American Airlines said the Airbus software issue would impact 340 aircraft and it expects some operational delays due to a major software change requirement.
The airline added that it expects the vast majority of the updates to be completed by “today or tomorrow”, and that they are “intently focused” on limiting cancellations.
Wizz Air said some of its flights over the weekend may be affected, while Air India said the issue could lead to delays.
Indigo, an Indian airline which operates over 150 A320s, said it was proactively completing mandated updates on the affected aircraft.
British Airways told Sky News that only three of its aircraft where affected and that the required fixes will be carried out overnight and are not expected to disrupt its operations.
Aer Lingus is in a similar position, with a limited number of aircraft impacted. The Airline doesn’t expect there to be significant operational disruption, but is taking “immediate steps to complete the required software installations”.
In October, the Airbus A320 family broke a major milestone when it overtook Boeing’s 737 to become the most-delivered jetliner in history.
This breaking news story is being updated and more details will be published shortly.
Famous names affected by prostate cancer have spoken of their disappointment after mass screening for the illness was not recommended for use on the NHS.
The National Screening Committee (NSC), comprised of doctors and economists, told the government that screening is “likely to cause more harm than good”.
Its decision means the NHS is unlikely to offer mass screening for men over the age of 45.
Six-time Olympic gold-medallist Sir Chris Hoy, former Prime Minister David Cameron, Sir Stephen Fry, actor and author Tony Robinson and journalist Dermot Murnaghan, who have all been diagnosed with the disease, spoke out after today’s decision.
Image: David Cameron, Dermot Murnaghan and Sir Chris Hoy were among those who spoke out. Pic: PA/Shutterstock/AP
In a draft recommendation, the committee said the reason it was “not recommending whole population screening using the prostate specific antigen (PSA) test was that it was likely to cause more harm than good”.
Instead, it proposes a targeted screening programme every two years for men with specific genetic mutations, known as BRCA-1 and BRCA-2, between the ages of 45 and 61.
But Sir Chris, who confirmed last year that his prostate cancer diagnosis was terminal, with doctors giving him two to four years to live, criticised the move.
The former Team GB cyclist, who confirmed in February 2024 that he was undergoing treatment, said: “I am extremely disappointed and saddened by the recommendation announced by the National Screening Committee today to rule against national screening for men at high risk of prostate cancer.
“More than 12,000 men are dying of prostate cancer every year; it is now the UK’s most common cancer in men, with black men at double the risk, along with men with a family history, like myself.
“While introducing regular checks for men carrying the BRCA genes is a very small step forward, it is not enough. I know, first hand, that by sharing my story following my own diagnosis two years ago, many, many lives have been saved.
“Early screening and diagnosis saves lives. I am determined to continue to use my platform to raise awareness, encourage open discussion, raise vital funds for further research and support, and to campaign for change.”
Image: Sir Chris Hoy. Picture: PA
His views were echoed by Lord Cameron, who this month announced he was treated for prostate cancer last year.
Lord Cameron said in a post on X: “I am disappointed by today’s recommendation on prostate cancer screening from the National Committee.
“Targeted screening is a natural first step – but the recommendation today is far too targeted, not including black men or men with a family history, both high-risk groups.
“Prostate cancer is the most common cancer among British men. We are letting down too many men if we don’t push for a wider screening programme that includes all high-risk groups – and not just the men involved, but their families too, who risk losing a loved one unnecessarily. As I know all too well, prostate cancer can be symptomless early on.
“That’s why screening is so essential – catching the cancers early when they can be more effectively and successfully treated, like in my own case.”
Image: Former British Prime Minister David Cameron said he was treated for prostate cancer last year. (AP Photo/Alex Brandon)
Sir Tony, journalist Mr Murnaghan and retired footballer Les Ferdinand also voiced their disappointment after the decision.
Sir Tony, 79, who starred as Baldrick in Blackadder, said: “I’m bitterly disappointed. Getting an early diagnosis for prostate cancer could save your life, but we still have no screening programme for it in the UK.
“I was lucky I found my cancer early, but nearly 10,000 men a year are diagnosed too late for a cure, and that’s just not right.”
Please use Chrome browser for a more accessible video player
5:25
Why prostate cancer screening not being expanded
Broadcaster Mr Murnaghan, 67, added: “With prostate cancer cases higher than they’ve ever been, and the disease dominating the national conversation, I really thought we were heading to an exciting moment here.
“I’m so disappointed that the committee has decided not to recommend screening – it felt about time progress was made for men.”
He added in a statement shared with Sky News: “An acceptable halfway house, would perhaps be to extend screening to black men – and those with a known history of cancer in their family. But clearly a full nationwide screening programme would be best.”
Sir Stephen, who is a Prostate Cancer Research ambassador who revealed in 2018 he had undergone surgery after being diagnosed with the disease, said: “I’m deeply disappointed by today’s news. Men in the UK deserve so much better. Prostate cancer remains the second biggest cancer killer of men in this country, with more than 12,000 dying every year.
“The only way we will make a dent in that appalling statistic is by catching prostate cancer early, before symptoms appear – and the best way to do that is through a screening programme. I hope the country sees sense.”
Image: Retired footballer Les Ferdinand also voiced his concerns over the decision. Pic: Reuters
Mr Ferdinand, whose grandfather died from prostate cancer, added: “I’ve seen members of my family survive prostate cancer, because their cancer was found in time.
“Without a national screening programme, the responsibility to find prostate cancer early and in time for a cure rests entirely on men’s shoulders, and it shouldn’t be this way.
“Black men are at double the risk of prostate cancer and twice as likely to die, and something has to be done.”
Please use Chrome browser for a more accessible video player
3:39
Prostate cancer decision ‘a massive mistake’
Colin McFarlane, an actor who was diagnosed with prostate cancer in 2023, told Sky News presenter Jonathan Samuels the decision was a “massive mistake”.
“I’ve been diagnosed with prostate cancer, but I’m not having any treatment. I have something called active surveillance, so every three months I have a PSA blood test, and then once a year I have an MRI,” he said.
McFarlane said black men over the age of 45 are at high risk, and “should be invited for screening”. He added: “I personally think men over 50 should be invited for screening, because they’re also at risk. I’m concerned now for all the black men out there who are high risk.”
NSC added it did not recommend extensive screening for black men due to a current lack of evidence and data.
The committee also does not recommend targeted screening for men with a family history of the disease, who are also at a higher risk of prostate cancer.
Image: The National Screening Committee is comprised of doctors and economists. File pic: iStock
Health Secretary Wes Streeting said he would consider the findings ahead of March’s final decision, adding that he wanted to see earlier diagnosis and quicker treatment, but that needed to be balanced against “the harms that wider screening could cause to men”.
Prostate cancer symptoms and treatment
According to the NHS, prostate cancer is most common in men over the age of 50 from a black African or Caribbean background.
Its severity is determined by whether it spreads to other parts of the body.
It does not usually have any signs or symptoms at first, but later signs can include back, hip or pelvis pain, or difficulty maintaining an erection.
Problems urinating can also be a sign of other prostate problems.
Treatments for prostate cancer include surgery, radiotherapy and hormone therapy.
However, the NHS says it does not always require treatment.
Professor Sir Mike Richards, a former national cancer director and chairman of the NSC, told a briefing that modelling on PSA shows “whole population screening may lead to a small reduction in prostate cancer deaths, but the very high levels of overdiagnoses” means the harms outweigh the benefits.
Experts are also waiting to see data from a large trial launched by Prostate Cancer UK last week into whether combining PSA with other tests, such as rapid MRI scans, may lead to recommending population-wide screening.
The trial is looking at the most promising screening techniques available, including PSA blood tests, genetic tests and 10-minute MRI scans, and whether they can be combined for a national screening programme.
The results will be ready within two years, it is hoped.
Mr Streeting added: “In the meantime, we will keep making progress on cutting cancer waiting times and investing in research into prostate cancer detection – in the last 12 months, 193,000 more patients received a diagnosis for suspected cancer on time.
“We are also providing funding to the £42m TRANSFORM trial, which has the potential to revolutionise prostate cancer screening, cutting out harmful side effects and making screening far more accurate.”