Connect with us

Published

on

ChatGPT eats cannibals

ChatGPT hype is starting to wane, with Google searches for “ChatGPT” down 40% from its peak in April, while web traffic to OpenAI’s ChatGPT website has been down almost 10% in the past month. 

This is only to be expected — however GPT-4 users are also reporting the model seems considerably dumber (but faster) than it was previously.

One theory is that OpenAI has broken it up into multiple smaller models trained in specific areas that can act in tandem, but not quite at the same level.

AI tweet

But a more intriguing possibility may also be playing a role: AI cannibalism.

The web is now swamped with AI-generated text and images, and this synthetic data gets scraped up as data to train AIs, causing a negative feedback loop. The more AI data a model ingests, the worse the output gets for coherence and quality. It’s a bit like what happens when you make a photocopy of a photocopy, and the image gets progressively worse.



While GPT-4’s official training data ends in September 2021, it clearly knows a lot more than that, and OpenAI recently shuttered its web browsing plugin. 

A new paper from scientists at Rice and Stanford University came up with a cute acronym for the issue: Model Autophagy Disorder or MAD.

“Our primary conclusion across all scenarios is that without enough fresh real data in each generation of an autophagous loop, future generative models are doomed to have their quality (precision) or diversity (recall) progressively decrease,” they said. 

Essentially the models start to lose the more unique but less well-represented data, and harden up their outputs on less varied data, in an ongoing process. The good news is this means the AIs now have a reason to keep humans in the loop if we can work out a way to identify and prioritize human content for the models. That’s one of OpenAI boss Sam Altman’s plans with his eyeball-scanning blockchain project, Worldcoin.  

Tom Goldstein

Is Threads just a loss leader to train AI models?

Twitter clone Threads is a bit of a weird move by Mark Zuckerberg as it cannibalizes users from Instagram. The photo-sharing platform makes up to $50 billion a year but stands to make around a tenth of that from Threads, even in the unrealistic scenario that it takes 100% market share from Twitter. Big Brain Daily’s Alex Valaitis predicts it will either be shut down or reincorporated into Instagram within 12 months, and argues the real reason it was launched now “was to have more text-based content to train Meta’s AI models on.”

ChatGPT was trained on huge volumes of data from Twitter, but Elon Musk has taken various unpopular steps to prevent that from happening in the future (charging for API access, rate limiting, etc).

Zuck has form in this regard, as Meta’s image recognition AI software SEER was trained on a billion photos posted to Instagram. Users agreed to that in the privacy policy, and more than a few have noted the Threads app collects data on everything possible, from health data to religious beliefs and race. That data will inevitably be used to train AI models such as Facebook’s LLaMA (Large Language Model Meta AI).
Musk, meanwhile, has just launched an OpenAI competitor called xAI that will mine Twitter’s data for its own LLM.

CounterSocial
Various permissions required by social apps (CounterSocial)

Religious chatbots are fundamentalists

Who would have guessed that training AIs on religious texts and speaking in the voice of God would turn out to be a terrible idea? In India, Hindu chatbots masquerading as Krishna have been consistently advising users that killing people is OK if it’s your dharma, or duty.

At least five chatbots trained on the Bhagavad Gita, a 700-verse scripture, have appeared in the past few months, but the Indian government has no plans to regulate the tech, despite the ethical concerns. 

“It’s miscommunication, misinformation based on religious text,” said Mumbai-based lawyer Lubna Yusuf, coauthor of the AI Book. “A text gives a lot of philosophical value to what they are trying to say, and what does a bot do? It gives you a literal answer and that’s the danger here.” 

Read also


Features

This is how to make — and lose — a fortune with NFTs


Features

Crypto Indexers Scramble to Win Over Hesitant Investors

AI doomers versus AI optimists

The world’s foremost AI doomer, decision theorist Eliezer Yudkowsky, has released a TED talk warning that superintelligent AI will kill us all. He’s not sure how or why, because he believes an AGI will be so much smarter than us we won’t even understand how and why it’s killing us — like a medieval peasant trying to understand the operation of an air conditioner. It might kill us as a side effect of pursuing some other objective, or because “it doesn’t want us making other superintelligences to compete with it.”

He points out that “Nobody understands how modern AI systems do what they do. They are giant inscrutable matrices of floating point numbers.” He does not expect “marching robot armies with glowing red eyes” but believes that a “smarter and uncaring entity will figure out strategies and technologies that can kill us quickly and reliably and then kill us.” The only thing that could stop this scenario from occurring is a worldwide moratorium on the tech backed by the threat of World War III, but he doesn’t think that will happen.

In his essay “Why AI will save the world,” A16z’s Marc Andreessen argues this sort of position is unscientific: “What is the testable hypothesis? What would falsify the hypothesis? How do we know when we are getting into a danger zone? These questions go mainly unanswered apart from ‘You can’t prove it won’t happen!’”

Microsoft boss Bill Gates released an essay of his own, titled “The risks of AI are real but manageable,” arguing that from cars to the internet, “people have managed through other transformative moments and, despite a lot of turbulence, come out better off in the end.”

“It’s the most transformative innovation any of us will see in our lifetimes, and a healthy public debate will depend on everyone being knowledgeable about the technology, its benefits, and its risks. The benefits will be massive, and the best reason to believe that we can manage the risks is that we have done it before.”

Data scientist Jeremy Howard has released his own paper, arguing that any attempt to outlaw the tech or keep it confined to a few large AI models will be a disaster, comparing the fear-based response to AI to the pre-Enlightenment age when humanity tried to restrict education and power to the elite.

Read also


Features

Why Virtual Reality Needs Blockchain: Economics, Permanence and Scarcity


Features

Crypto Indexers Scramble to Win Over Hesitant Investors

“Then a new idea took hold. What if we trust in the overall good of society at large? What if everyone had access to education? To the vote? To technology? This was the Age of Enlightenment.”

His counter-proposal is to encourage open-source development of AI and have faith that most people will harness the technology for good.

“Most people will use these models to create, and to protect. How better to be safe than to have the massive diversity and expertise of human society at large doing their best to identify and respond to threats, with the full power of AI behind them?”

OpenAI’s code interpreter

GPT-4’s new code interpreter is a terrific new upgrade that allows the AI to generate code on demand and actually run it. So anything you can dream up, it can generate the code for and run. Users have been coming up with various use cases, including uploading company reports and getting the AI to generate useful charts of the key data, converting files from one format to another, creating video effects and transforming still images into video. One user uploaded an Excel file of every lighthouse location in the U.S. and got GPT-4 to create an animated map of the locations. 

All killer, no filler AI news

— Research from the University of Montana found that artificial intelligence scores in the top 1% on a standardized test for creativity. The Scholastic Testing Service gave GPT-4’s responses to the test top marks in creativity, fluency (the ability to generate lots of ideas) and originality.

— Comedian Sarah Silverman and authors Christopher Golden and Richard Kadreyare suing OpenAI and Meta for copyright violations, for training their respective AI models on the trio’s books. 

— Microsoft’s AI Copilot for Windows will eventually be amazing, but Windows Central found the insider preview is really just Bing Chat running via Edge browser and it can just about switch Bluetooth on

Anthropic’s ChatGPT competitor Claude 2 is now available free in the UK and U.S., and its context window can handle 75,000 words of content to ChatGPT’s 3,000 word maximum. That makes it fantastic for summarizing long pieces of text, and it’s not bad at writing fiction. 

Video of the week

Indian satellite news channel OTV News has unveiled its AI news anchor named Lisa, who will present the news several times a day in a variety of languages, including English and Odia, for the network and its digital platforms. “The new AI anchors are digital composites created from the footage of a human host that read the news using synthesized voices,” said OTV managing director Jagi Mangat Panda.

Andrew Fenton

Andrew Fenton

Based in Melbourne, Andrew Fenton is a journalist and editor covering cryptocurrency and blockchain. He has worked as a national entertainment writer for News Corp Australia, on SA Weekend as a film journalist, and at The Melbourne Weekly.

Continue Reading

Politics

Hundreds of NHS quangos to be axed – as plans unveiled for health funding to be linked to patient feedback

Published

on

By

Hundreds of NHS quangos to be axed - as plans unveiled for health funding to be linked to patient feedback

NHS funding could be linked to patient feedback under new plans, with poorly performing services that “don’t listen” penalised with less money.

As part of the “10 Year Health Plan” to be unveiled next week, a new scheme will be trialled that will see patients asked to rate the service they received – and if they feel it should get a funding boost or not.

It will be introduced first for services that have a track record of very poor performance and where there is evidence of patients “not being listened to”, the government said.

This will create a “powerful incentive for services to listen to feedback and improve patients’ experience”, it added.

Sky News understands that it will not mean bonuses or pay increases for the best performing staff.

NHS payment mechanisms will also be reformed to reward services that keep patients out of hospital as part of a new ‘Year of Care Payments’ initiative and the government’s wider plan for change.

Please use Chrome browser for a more accessible video player

Do you want AI listening in on chats with your doctor?

Speaking to The Times, chief executive of the NHS Confederation Matthew Taylor expressed concerns about the trial.

He told the newspaper: “Patient experience is determined by far more than their individual interaction with the clinician and so, unless this is very carefully designed and evaluated, there is a risk that providers could be penalised for more systemic issues, such as constraints around staffing or estates, that are beyond their immediate control to fix.”

He said that NHS leaders would be keen to “understand more about the proposal”, because elements were “concerning”.

Read more from Sky News
Amber health heat alert issued
Patient died ‘unexpectedly’ after NHS cyber attack
Doctors told to stop using unapproved AI

Health Secretary Wes Streeting said: “We will reward great patient care, so patient experience and clinical excellence are met with extra cash. These reforms are key to keeping people healthy and out of hospital, and to making the NHS sustainable for the long-term as part of the Plan for Change.”

In the raft of announcements in the 10 Year Health Plan, the government has said 201 bodies responsible for overseeing and running parts of the NHS in England – known as quangos – will be scrapped.

These include Healthwatch England, set up in 2012 to speak out on behalf of NHS and social care patients, the National Guardian’s Office, created in 2015 to support NHS whistleblowers, and the Health Services Safety Investigations Body (HSSIB).

The head of the Royal College of Nursing described the move as “so unsafe for patients right now”.

Professor Nicola Ranger said: “Today, in hospitals across the NHS, we know one nurse can be left caring for 10, 15 or more patients at a time. It’s not safe. It’s not effective. And it’s not acceptable.

“For these proposed changes to be effective, government must take ownership of the real issue, the staffing crisis on our wards, and not just shuffle people into new roles. Protecting patients has to be the priority and not just a drive for efficiency.”

Elsewhere, the new head of NHS England Sir Jim Mackey said key parts of the NHS appear “built to keep the public away because it’s an inconvenience”.

“We’ve made it really hard, and we’ve probably all been on the end of it,” he told the Daily Telegraph.

“The ward clerk only works nine to five, or they’re busy doing other stuff; the GP practice scrambles every morning.”

Continue Reading

Politics

Carrie Johnson admitted to hospital over ‘severe dehydration’

Published

on

By

Carrie Johnson admitted to hospital over 'severe dehydration'

Carrie Johnson – the wife of former prime minister Boris Johnson – has revealed she was admitted to hospital with severe dehydration, as she offered advice to other breastfeeding mothers in the hot weather.

Mrs Johnson, 37, posted a picture of herself and her newborn daughter Poppy Eliza Josephine on Friday in a hospital bed.

“Being hospitalised for two nights for severe dehydration was not on my postpartum bingo card,” she captioned the Instagram post.

Mrs Johnson urged other “breastfeeding mums” to make sure they eat and drink enough “in this heat”, especially those who are “clusterfeeding”.

Poppy was born on 21 May, becoming the couple’s fourth child after their son Frank, born in July 2023, daughter Romy, born in December 2021, and son Wilfred, born in April 2020.

Boris Johnson with his new daughter Poppy Eliza Josephine Johnson. Pic: Carrie Johnson/Instagram
Image:
Boris Johnson with newborn daughter Poppy Eliza Josephine Johnson. Pic: Carrie Johnson/Instagram

In a separate Instagram story, Mrs Johnson described an “honestly brutal week”.

“Mastitis (me), reflux (her), dehydration (me). What a pair we are!,” she said.

“But thank you for all the kind messages, especially all the brilliant advice on reflux. Really appreciate it and made me feel way less alone going thru (sic) it all. And as ever, thanks to our amazing NHS.”

Carrie and Boris Johnson outside Number 10 Downing Street after his resignation in 2022. Pic: PA
Image:
Carrie and Boris Johnson after his resignation in 2022. Pic: PA

Read more from Sky News:
Hundreds of NHS quangos to be axed
‘Most effective’ protection to avoid sunburn (and it isn’t suncream)

The NHS recommends drinking plenty of fluids while breastfeeding – and avoiding caffeine and alcohol to stop their effects being passed on to the baby.

Having a drink nearby when mothers stop to feed is advised, as is water, lower-fat milk, and low-sugar drinks.

The UK Health Security Agency (UKHSA) has issued an amber heat health alert for the next four days.

Although not a public weather warning, it advises health and social care organisations of possible dangers to their patients and facilities.

Temperatures could reach 34C on Monday – with a 20% chance of beating the hottest June day on record of 35.6C from 1976.

The likelihood of record-breaking temperatures could increase over the weekend as the day approaches.

Continue Reading

Politics

Fixing welfare a ‘moral imperative’, Starmer says, after government U-turn

Published

on

By

Fixing welfare a 'moral imperative', Starmer says, after government U-turn

Sir Keir Starmer has said fixing the UK’s welfare system is a “moral imperative” after the government’s U-turn.

The prime minister faced a significant rebellion over plans to cut sickness and disability benefits as part of a package he said would shave £5bn off the welfare bill and get more people into work.

The government has since offered concessions ahead of a vote in the Commons on Tuesday, including exempting existing Personal Independence Payment claimants (PIP) from the stricter new criteria, while the universal credit health top-up will only be cut and frozen for new applications.

Speaking at Welsh Labour’s annual conference in Llandudno, North Wales, on Saturday, Sir Keir said: “Everyone agrees that our welfare system is broken, failing people every day.

“Fixing it is a moral imperative, but we need to do it in a Labour way, conference, and we will.”

Please use Chrome browser for a more accessible video player

Starmer defends welfare U-turn

Sir Keir also warned of a “backroom stitch up” between the Conservatives, Reform UK and Plaid Cymru ahead of next year’s Senedd elections.

He said such a deal would mark a “return to the chaos and division of the last decade”.

But opposition parties have hit back at the prime minister’s “imaginary coalitions”, with Plaid Cymru accusing Labour of “scraping the barrel”.

Reform UK said the NHS “isn’t safe in Labour’s hands” and people are “left waiting in pain” while ministers “make excuses”.

Voters in Wales will head to the polls next May and recent polls suggest Labour are in third place, behind Reform and Plaid.

Labour have been the largest party at every Senedd election since devolution began in 1999.

Conservative Party leader Kemi Badenoch has not ruled out making deals with Plaid Cymru or Reform at the Senedd election.

Read more:
This has been the PM’s most damaging U-turn yet
Is Starmer at the mercy of his MPs?

At the conference, the prime minister was joined on stage by Wales Secretary Jo Stevens, First Minister Eluned Morgan and deputy leader of Welsh Labour Carolyn Harries.

He described Baroness Morgan as a “fierce champion for Wales” and “the best person to lead Wales into the future”.

Sir Keir said the £80m transition board to support Port Talbot steelworkers after the closure of the plant’s blast furnaces was a result of “two Labour governments working together for the people of Wales”.

He described Nigel Farage as a “wolf in Wall Street clothing” who has “no idea what he’s talking about” on the issue.

👉 Click here to listen to Electoral Dysfunction on your podcast app 👈

The PM said the Reform UK leader “isn’t interested in Wales” and has no viable plan for the blast furnaces at Port Talbot.

“When you ask him about Clacton, he thinks he’s running in the 2.10 at Ascot,” Sir Keir joked.

“He’s a wolf in Wall Street clothing.”

Mr Farage has said his party wants to restart the blast furnaces at Port Talbot.

Around 20 tractors were parked on the promenade in Llandudno ahead of the speech, as farmers gathered outside the conference to stage a protest.

It was later followed by a pro-Palestine demonstration of around 200 people, with around a dozen counter-protestors also in attendance.

Continue Reading

Trending