Large artificial intelligence models will only get “crazier and crazier” unless more is done to control what information they are trained on, according to the founder of one of the UK’s leading AI start-ups.
Emad Mostaque, CEO of Stability AI, argues continuing to train large language models like OpenAI’s GPT4 and Google’s LaMDA on what is effectively the entire internet, is making them too unpredictable and potentially dangerous.
“The labs themselves say this could pose an existential threat to humanity,” said Mr Mostaque.
Today Sir Antony Seldon, headteacher of Epsom College, told Sky News’s Sophy Ridge on Sunday that AI could be could be “invidious and dangerous”.
Image: ‘Painting of Edinburgh Castle’ generated by artificial intelligence tool Stable Diffusion, whose founder warns not all internet users will be able to distinguish between real and AI images. Pic: Stable Diffusion
Image: An image of ‘print of fruits in green and orange’ generated by artificial intelligence tool Stable Diffusion, which converts text to images. Pic: Stable Diffusion
“When the people making [the models] say that, we should probably have an open discussion about that,” added Mr Mostaque.
But AI developers like Stability AI may have no choice in having such a discussion. Much of the data used to train their powerful text-to-image AI products was also “scraped” from the internet.
More on Artificial Intelligence
Related Topics:
That includes millions of copyright images that led to legal action against the company – as well as big questions about who ultimately “owns” the products that image- or text-generating AI systems create.
His firm collaborated on the development of Stable Diffusion, one of the leading text-to-image AIs. Stability AI has just launched a new model called Deep Floyd that it claims is the most advanced image-generating AI yet.
Advertisement
Image: A ‘photo of a fuzzy cute owl drinking very dark beer’ created by AI. Pic: DeepFloyd
Image: A photo-realistic style image of a ‘playful furry fox working as a pilot’ created by artificial intelligence. Pic: DeepFloyd
A necessary step in making the AI safe, explained Daria Bakshandaeva, senior researcher at Stability AI, was to remove illegal, violent and pornographic images from the training data.
If the AI sees harmful or explicit images during its training, it could recreate them in its output. To avoid this, the developers remove these images from the training data, so the AI cannot “imagine” how they would look.
But it still took two billion images from online sources to train it. Stability AI says it is actively working on new datasets to train AI models that respect people’s rights to their data.
Stability AI is being sued in the US by photo agency Getty Images for using 12 million of its images as part of the dataset used to train its model. Stability AI has responded that rules around “fair use” of the images means no copyright has been infringed.
But the concern isn’t just about copyright. Increasing amounts of data available on the web whether it’s pictures, text or computer code is being generated by AI.
“If you look at coding, 50% of all the code generated now is AI generated, which is an amazing shift in just over one year or 18 months,” said Mr Mostaque.
And text-generating AIs are creating increasing amounts of online content, even news reports.
Image: Image of ‘England wins men’s football world cup in 2026’ generated by artificial intelligence tool Stable Diffusion, which converts text to image, shows that the tool does not always get it spot on. Pic: Stable Diffusion
Please use Chrome browser for a more accessible video player
8:58
Sir Anthony Seldon highlights benefits and risks of AI
US company News Guard, which verifies online content, recently found 49 almost entirely AI generated “fake news” websites online being used to drive clicks to advertising content.
“We remain really concerned about an average internet users’ ability to find information and know that it is accurate information,” said Matt Skibinski, managing director at NewsGuard.
AIs risk polluting the web with content that’s deliberately misleading and harmful or just rubbish. It’s not that people haven’t been doing that for years, it’s just that now AI’s might end up being trained on data scraped from the web that other AIs have created.
All the more reason to think hard now about what data we use to train even more powerful AIs.
“Don’t feed them junk food,” said Mr Mostaque. “We can have better free range organic models right now. Otherwise, they’ll become crazier and crazier.”
A good place to start, he argues, is making AIs that are trained on data, whether it’s text or images or medical data, that is more specific to the users it’s being made for. Right now, most AIs are designed and trained in California.
“I think we need our own datasets or our own models to reflect the diversity of humanity,” said Mr Mostaque.
“I think that will be safer as well. I think they’ll be more aligned with human values than just having a very limited data set and a very limited set of experiences that are only available to the richest people in the world.”
An alleged attack by the Manchester Arena bomb plotter on prison officers at a high-security jail “will stick with” those impacted “for the rest of their lives”, a former officer and colleague of the victims has said.
He was serving his sentence in a separation unit, known as a “jail within a jail”, after being found guilty of 22 counts of murder for helping his brother Salman Abedi carry out a suicide bombing at an Ariana Grande concert in 2017.
The attack has raised fresh questions about the safety of prison staff.
Inmates inside separation units had access to cooking facilities, which has now been suspended.
Image: Abedi was moved back to Belmarsh after the alleged attack
‘It will stick with them for life’
Matthew, who only wants to be referred to by his first name, worked with the officers who were hospitalised following the attack.
“I’ve spoken to ex-colleagues who I’m still friends with,” he told Sky News.
“They’ve not discussed the specifics of the incident, but they’ve said it will stick with them for the rest of their lives.”
Matthew broke down as he described the “obscene” and “ludicrous” levels of violence that staff face inside prison.
He’s worked at a number of different jails.
“I’ve been there when you’re mopping your colleagues’ blood… when you’ve seen a serious assault, and you don’t know if they’re gonna be OK, and then 10 minutes later, you’ve got to get back on with your day, you’ve got to carry on running the regime,” he said.
“It is difficult, and it is awful.”
Image: Matthew worked with the officers who were hospitalised
‘No adequate protection’
There were 10,496 assaults against prison staff in England and Wales in the 12 months to September – a 19% rise on the previous year.
“The reality is there’s no adequate protections for prison staff, and that’s a great frustration,” the general secretary of the Prison Officers’ Association union, Steve Gillan, told Sky News.
Having visited HMP Frankland earlier in the week, and spoken to many of the officers who were involved, Mr Gillan described the mood among colleagues as one of “anger, frustration, and sadness”.
The association, which represents prison officers, is calling for a “reset” – and for staff to be given stab-proof vests and tasers in “certain circumstances”.
Unwary travellers returning from the EU risk having their sandwiches and local delicacies, such as cheese, confiscated as they enter the UK.
The luggage in which they are carrying their goodies may also be seized and destroyed – and if Border Force catch them trying to smuggle meat or dairy products without a declaration, they could face criminal charges.
This may or may not be bureaucratic over-reaction.
It’s certainly just another of the barriers EU and UK authorities are busily throwing up between each other and their citizens – at a time when political leaders keep saying the two sides should be drawing together in the face of Donald Trump’s attacks on European trade and security.
Image: Keir Starmer’s been embarking on a reset with European leaders. Pic: Reuters
The ban on bringing back “cattle, sheep, goat, and pig meat, as well as dairy products, from EU countries into Great Britain for personal use” is meant “to protect the health of British livestock, the security of farmers, and the UK’s food security.”
There are bitter memories of previous outbreaks of foot and mouth disease in this country, in 1967 and 2001.
In 2001, there were more than 2,000 confirmed cases of infection resulting in six million sheep and cattle being destroyed. Footpaths were closed across the nation and the general election had to be delayed.
In the EU this year, there have been five cases confirmed in Slovakia and four in Hungary. There was a single outbreak in Germany in January, though Defra, the UK agriculture department, says that’s “no longer significant”.
Image: Authorities carry disinfectant near a farm in Dunakiliti, Hungary. Pic: Reuters
Better safe than sorry?
None of the cases of infection are in the three most popular countries for UK visitors – Spain, France, and Italy – now joining the ban. Places from which travellers are most likely to bring back a bit of cheese, salami, or chorizo.
Could the government be putting on a show to farmers that it’s on their side at the price of the public’s inconvenience, when its own measures on inheritance tax and failure to match lost EU subsidies are really doing the farming community harm?
Many will say it’s better to be safe than sorry, but the question remains whether the ban is proportionate or even well targeted on likely sources of infection.
Image: No more gourmet chorizo brought back from Spain for you. File pic: iStock
A ‘Brexit benefit’? Don’t be fooled
The EU has already introduced emergency measures to contain the disease where it has been found. Several thousand cattle in Hungary and Slovenia have been vaccinated or destroyed.
The UK’s ability to impose the ban is not “a benefit of Brexit”. Member nations including the UK were perfectly able to ban the movement of animals and animal products during the “mad cow disease” outbreak in the 1990s, much to the annoyance of the British government of the day.
Since leaving the EU, England, Scotland and Wales are no longer under EU veterinary regulation.
Northern Ireland still is because of its open border with the Republic. The latest ban does not cover people coming into Northern Ireland, Jersey, Guernsey, or the Isle of Man.
Rather than introducing further red tape of its own, the British government is supposed to be seeking closer “alignment” with the EU on animal and vegetable trade – SPS or “sanitary and phytosanitary” measures, in the jargon.
Image: A ban on cheese? That’s anything but cracking. Pic: iStock
UK can’t shake ties to EU
The reasons for this are obvious and potentially make or break for food producers in this country.
The EU is the recipient of 67% of UK agri-food exports, even though this has declined by more than 5% since Brexit.
The introduction of full, cumbersome, SPS checks has been delayed five times but are due to come in this October. The government estimates the cost to the industry will be £330m, food producers say it will be more like £2bn.
With Brexit, the UK became a “third country” to the EU, just like the US or China or any other nation. The UK’s ties to the European bloc, however, are much greater.
Half of the UK’s imports come from the EU and 41% of its exports go there. The US is the UK’s single largest national trading partner, but still only accounts for around 17% of trade, in or out.
The difference in the statistics for travellers are even starker – 77% of trips abroad from the UK, for business, leisure or personal reasons, are to EU countries. That is 66.7 million visits a year, compared to 4.5 million or 5% to the US.
And that was in 2023, before Donald Trump and JD Vance’s hostile words and actions put foreign visitors off.
Please use Chrome browser for a more accessible video player
1:40
Trump: ‘Europe is free-loading’
More bureaucratic botheration
Meanwhile, the UK and the EU are making travel between them more bothersome for their citizens and businesses.
This October, the EU’s much-delayed EES or Entry Exit System is due to come into force. Every foreigner will be required to provide biometric information – including fingerprints and scans – every time they enter or leave the Schengen area.
From October next year, visitors from countries including the UK will have to be authorised in advance by ETIAS, the European Travel and Authorisation System. Applications will cost seven euros and will be valid for three years.
Since the beginning of this month, European visitors to the UK have been subject to similar reciprocal measures. They must apply for an ETA, an Electronic Travel Authorisation. This lasts for two years or until a passport expires and costs £16.
The days of freedom of movement for people, goods, and services between the UK and its neighbours are long gone.
The British economy has lost out and British citizens and businesses suffer from greater bureaucratic botheration.
Nor has immigration into the UK gone down since leaving the EU. The numbers have actually gone up, with people from Commonwealth countries, including India, Pakistan and Nigeria, more than compensating for EU citizens who used to come and go.
Image: Editor’s note: Hands off my focaccia sandwiches with prosciutto! Pic: iStock
Will European reset pay off?
The government is talking loudly about the possible benefits of a trade “deal” with Trump’s America.
Meanwhile, minister Nick Thomas Symonds and the civil servant Mike Ellam are engaged in low-profile negotiations with Europe – which could be of far greater economic and social significance.
The public will have to wait to see what progress is being made at least until the first-ever EU-UK summit, due to take place on 19 May this year.
Hard-pressed British food producers and travellers – not to mention young people shut out of educational opportunities in Europe – can only hope that Sir Keir Starmer considers their interests as positively as he does sucking up to the Trump administration.
A 41-year-old man from Penylan has been charged with murder, preventing lawful and decent burial of a dead body and assaulting a person occasioning them actual bodily harm.
A 48-year-old woman from London has been charged with preventing a lawful and decent burial of a dead body and conspiring to pervert the course of justice.
They both appeared at Cardiff Magistrates’ Court on Saturday.
“This brings our search for Paria to a sad and tragic end,” said Detective Chief Inspector Matt Powell.
“Paria’s family, all those who knew her, and those in her local community, will be deeply saddened and shocked by these latest developments.
“Family liaison officers are continuing to support Paria’s family.”