Every day this week we’re highlighting one genuine, no bullsh*t, hype free use case for AI in crypto. Today it’s the potential for using AI for smart contract auditing and cybersecurity, we’re so near and yet so far.
AI artwork for the ChatGPT written TurboToad memecoin. (Twitter)
One of the big use cases for AI and crypto in the future is in auditing smart contracts and identifying cybersecurity holes. There’s only one problem — at the moment, GPT-4 sucks at it.
Coinbase tried out ChatGPT’s capabilities for automated token security reviews earlier this year, and in 25% of cases, it wrongly classified high-risk tokens as low-risk. James Edwards, the lead maintainer for cybersecurity investigator Librehash, believes OpenAI isn’t keen on having the bot used for tasks like this.
“I strongly believe that OpenAI has quietly nerfed some of the bot’s capabilities when it comes to smart contracts for the sake of not having folks rely on their bot explicitly to draw up a deployable smart contract,” he says, explaining that OpenAI likely doesn’t want to be held responsible for any vulnerabilities or exploits.
This isn’t to say AI has zero capabilities when it comes to smart contracts. AI Eye spoke with Melbourne digital artist Rhett Mankind back in May. He knew nothing at all about creating smart contracts, but through trial and error and numerous rewrites, was able to get ChatGPT to create a memecoin called Turbo that went on to hit a $100 million market cap.
gm ☕️
As someone with zero Solidity proficiency, I had an already efficient smart contract tailored to my own needs by AI.
I dumped @Azuki‘s smart contract into GPT-4 and had it ask me relevant questions.
But as CertiK Chief Security Officer Kang Li points out, while you might get something working with ChatGPT’s help, it’s likely to be full of logical code bugs and potential exploits:
“You write something and ChatGPT helps you build it but because of all these design flaws it may fail miserably when attackers start coming.”
So it’s definitely not good enough for solo smart contract auditing, in which a tiny mistake can see a project drained of tens of millions — though Li says it can be “a helpful tool for people doing code analysis.”
Richard Ma from blockchain security firm Quantstamp explains that a major issue at present with its ability to audit smart contracts is that GPT -4’s training data is far too general.
“Because ChatGPT is trained on a lot of servers and there’s very little data about smart contracts, it’s better at hacking servers than smart contracts,” he explains.
So the race is on to train up models with years of data of smart contract exploits and hacks so it can learn to spot them.
“There are newer models where you can put in your own data, and that’s partly what we’ve been doing,” he says.
“We have a really big internal database of all the different types of exploits. I started a company more than six years ago, and we’ve been tracking all the different types of hacks. And so this data is a valuable thing to be able to train AI.”
Race is on to create AI smart contract auditor
Edwards is working on a similar project and has almost finished building an open-source WizardCoder AI model that incorporates the Mando Project repository of smart contract vulnerabilities. It also uses Microsoft’s CodeBert pretrained programming languages model to help spot problems.
According to Edwards, in testing so far, the AI has been able to “audit contracts with an unprecedented amount of accuracy that far surpasses what one could expect and would receive from GPT-4.”
The bulk of the work has been in creating a custom data set of smart contract exploits that identify the vulnerability down to the lines of code responsible. The next big trick is training the model to spot patterns and similarities.
“Ideally you want the model to be able to piece together connections between functions, variables, context etc, that maybe a human being might not draw when looking across the same data.”
While he concedes it’s not as good as a human auditor just yet, it can already do a strong first pass to speed up the auditor’s work and make it more comprehensive.
“Sort of help in the way LexisNexis helps a lawyer. Except even more effective,” he says.
Don’t believe the hype
Near founder Illia Polushkin is an expert in both AI and blockchain.
Near co-founder Illia Polushkin explains that smart contract exploits are often bizarrely niche edge cases, that one in a billion chance that results in a smart contract behaving in unexpected ways.
But LLMs, which are based on predicting the next word, approach the problem from the opposite direction, Polushkin says.
“The current models are trying to find the most statistically possible outcome, right? And when you think of smart contracts or like protocol engineering, you need to think about all the edge cases,” he explains.
Polushkin says that his competitive programming background means that when Near was focused on AI, the team developed procedures to try to identify these rare occurrences.
“It was more formal search procedures around the output of the code. So I don’t think it’s completely impossible, and there are startups now that are really investing in working with code and the correctness of that,” he says.
But Polushkin doesn’t think AI will be as good as humans at auditing for “the next couple of years. It’s gonna take a little bit longer.”
The most engaging reads in blockchain. Delivered once a
week.
Andrew Fenton
Based in Melbourne, Andrew Fenton is a journalist and editor covering cryptocurrency and blockchain. He has worked as a national entertainment writer for News Corp Australia, on SA Weekend as a film journalist, and at The Melbourne Weekly.
It might feel like it’s been even longer for the prime minister at the moment, but it’s been a whole year since Sir Keir Starmer’s Labour Party won a historic landslide, emphatically defeating Rishi Sunak’s Conservatives and securing a 174-seat majority.
Over that time, Sir Keir and his party have regularly reset or restated their list of milestones, missions, targets and pledges – things they say they will achieve while in power (so long as they can get all their policies past their own MPs).
We’ve had a look at the ones they have repeated most consistently, and how they are going so far.
Overall, it amounts to what appears to be some success on economic metrics, but limited progress at best towards many of their key policy objectives.
From healthcare to housebuilding, from crime to clean power, and from small boats to squeezed budgets, here are nine charts that show the country’s performance before and after Labour came to power, and how close the government are to achieving their goals.
Image: Sir Keir Starmer has been in office for a year. Pic Reuters
Cost of living
On paper, the target that Labour have set themselves on improving living standards is by quite a distance the easiest to achieve of anything they have spoken about.
They have not set a specific number to aim for, and every previous parliament on record has overseen an increase in real terms disposable income.
The closest it got to not happening was the last parliament, though. From December 2019 to June 2024, disposable income per quarter rose by just £24, thanks in part to the energy crisis that followed Russia’s invasion of Ukraine.
By way of comparison, there was a rise of almost £600 per quarter during the five years following Thatcher’s final election victory in 1987, and over £500 between Blair’s 1997 victory and his 2001 re-election.
After the first six months of the latest government, it had risen by £144, the fastest start of any government going back to at least 1954. As of March, it had fallen to £81, but that still leaves them second at this stage, behind only Thatcher’s third term.
VERDICT: Going well, but should have been more ambitious with their target
Get inflation back to 2%
So, we have got more money to play with. But it might not always feel like that, as average prices are still rising at a historically high rate.
Inflation fell consistently during the last year and a half of Rishi Sunak’s premiership, dropping from a peak of 11.1% in October 2022 to exactly 2% – the Bank of England target – in June 2024.
It continued to fall in Labour’s first couple of months, but has steadily climbed back up since then and reached 3.4% in May.
When we include housing costs as well, prices are up by 4% in the last year. Average wages are currently rising by just over 5%, so that explains the overall improvement in living standards that we mentioned earlier.
But there are signs that the labour market is beginning to slow following the introduction of higher national insurance rates for employers in April.
If inflation remains high and wages begin to stagnate, we will see a quick reversal to the good start the government have made on disposable income.
VERDICT: Something to keep an eye on – there could be a bigger price to pay in years to come
‘Smash the gangs’
One of Starmer’s most memorable promises during the election campaign was that he would “smash the gangs”, and drastically reduce the number of people crossing the Channel to illegally enter the country.
More than 40,000 people have arrived in the UK in small boats in the 12 months since Labour came to power, a rise of over 12,000 (40%) compared with the previous year.
VERDICT: As it stands, it looks like “the gangs” are smashing the government
Reduce NHS waits
One of Labour’s more ambitious targets, and one in which they will be relying on big improvements in years to come to achieve.
Starmer says that no more than 8% of people will wait longer than 18 weeks for NHS treatment by the time of the next election.
When they took over, it was more than five times higher than that. And it still is now, falling very slightly from 41.1% to 40.3% over the 10 months that we have data for.
So not much movement yet. Independent modelling by the Health Foundation suggests that reaching the target is “still feasible”, though they say it will demand “focus, resource, productivity improvements and a bit of luck”.
VERDICT: Early days, but current treatment isn’t curing the ailment fast enough
Halve violent crime
It’s a similar story with policing. Labour aim to achieve their goal of halving serious violent crime within 10 years by recruiting an extra 13,000 officers, PCSOs and special constables.
Recruitment is still very much ongoing, but workforce numbers have only been published up until the end of September, so we can’t tell what progress has been made on that as yet.
We do have numbers, however, on the number of violent crimes recorded by the police in the first six months of Labour’s premiership. There were a total of 1.1m, down by 14,665 on the same period last year, a decrease of just over 1%.
That’s not nearly enough to reach a halving within the decade, but Labour will hope that the reduction will accelerate once their new officers are in place.
VERDICT: Not time for flashing lights just yet, but progress is more “foot patrol” than “high-speed chase” so far
Build 1.5m new homes
One of Labour’s most ambitious policies was the pledge that they would build a total of 1.5m new homes in England during this parliament.
There has not yet been any new official data published on new houses since Labour came to power, but we can use alternative figures to give us a sense of how it’s going so far.
A new Energy Performance Certificate is granted each time a new home is built – so tends to closely match the official house-building figures – and we have data up to March for those.
Those numbers suggest that there have actually been fewer new properties added recently than in any year since 2015-16.
Labour still have four years to deliver on this pledge, but each year they are behind means they need to up the rate more in future years.
If the 200,000 new EPCs in the year to March 2025 matches the number of new homes they have delivered in their first year, Labour will need to add an average of 325,000 per year for the rest of their time in power to achieve their goal.
VERDICT: Struggling to lay solid foundations
Clean power by 2030
Another of the more ambitious pledges, Labour’s aim is for the UK to produce 95% of its energy from renewable sources by 2030.
They started strong. The ban on new onshore wind turbines was lifted within their first few days of government, and they delivered support for 131 new renewable energy projects in the most recent funding round in September.
But – understandably – it takes time for those new wind farms, solar farms and tidal plants to be built and start contributing to the grid.
In the year leading up to Starmer’s election as leader, 54% of the energy on the UK grid had been produced by renewable sources in the UK.
That has risen very slightly in the year since then, to 55%, with a rise in solar and biomass offsetting a slight fall in wind generation.
The start of this year has been unusually lacking in wind, and this analysis does not take variations in weather into account. The government target will adjust for that, but they are yet to define exactly how.
VERDICT: Not all up in smoke, but consistent effort is required before it’s all sunshine and windmills
Fastest economic growth in the G7
Labour’s plan to pay for the improvements they want to make in all the public services we have talked about above can be summarised in one word: “growth”.
The aim is for the UK’s GDP – the financial value of all the goods and services produced in the country – to grow faster than any other in the G7 group of advanced economies.
Since Labour have been in power, the economy has grown faster than European rivals Italy, France and Germany, as well as Japan, but has lagged behind the US and Canada.
The UK did grow fastest in the most recent quarter we have data for, however, from the start of the year to the end of March.
VERDICT: Good to be ahead of other similar European economies, but still a way to go to overtake the North Americans
No tax rises
Without economic growth, it will be difficult to keep to one of Chancellor Rachel Reeves’ biggest promises – that there will be no more tax rises or borrowing for the duration of her government’s term.
Paul Johnson, director of the Institute for Fiscal Studies, said last month that she is a “gnat’s whisker” away from being forced to do that at the autumn budget, looking at the state of the economy at the moment.
That whisker will have been shaved even closer by the cost implications of the government’s failure to get its full welfare reform bill through parliament earlier this week.
Please use Chrome browser for a more accessible video player
5:03
One year of Keir: A review of Starmer’s first 12 months in office
But the news from the last financial year was slightly better than expected. Total tax receipts for the year ending March 2025 were 35% of GDP.
That’s lower than the previous four years, and what was projected after Jeremy Hunt’s final Conservative budget, but higher than any of the 50 years before that.
The Office for Budget Responsibility (OBR) still projects it to rise in future years though, to a higher level than the post-WWII peak of 37.2%.
The OBR – a non-departmental public body that provides independent analysis of the public finances – has also said in the past few days that it is re-examining its methodology, because it has been too optimistic with its forecasts in the past.
If the OBR’s review leads to a more negative view of where the economy is going, Rachel Reeves could be forced to break her promise to keep the budget deficit from spiralling out of control.
VERDICT: It’s going to be difficult for the Chancellor to keep to her promise
OVERALL VERDICT: Investment and attention towards things like violent crime, the NHS and clean energy are yet to start bearing fruit, with only minuscule shifts in the right direction for each, but the government is confident that what’s happened so far is part of its plans.
Labour always said that the house-building target would be achieved with a big surge towards the back end of their term, but they won’t be encouraged by the numbers actually dropping in their first few months.
Where they are failing most dramatically, however, appears to be in reducing the number of migrants making the dangerous Channel crossing on small boats.
The economic news, particularly that rise in disposable income, looks more healthy at the moment. But with inflation still high and growth lagging behind some of our G7 rivals, that could soon start to turn.
The Data and Forensics team is a multi-skilled unit dedicated to providing transparent journalism from Sky News. We gather, analyse and visualise data to tell data-driven stories. We combine traditional reporting skills with advanced analysis of satellite images, social media and other open source information. Through multimedia storytelling we aim to better explain the world while also showing how our journalism is done.
Gunnar Strömmer reportedly said that Swedish authorities had confiscated more than $8.3 million worth of criminal profits since a law related to seizures was passed in 2024.