LISBON, Portugal — Tech giants are increasingly investing in the development of so-called “sovereign” artificial intelligence models as they seek to boost competitiveness by focusing more on local infrastructure.
Data sovereignty refers to the idea that people’s data should be stored on infrastructure within the country or continent they reside in.
“Sovereign AI is a relatively new term that’s emerged in the last year or so,” Chris Gow, IT networking giant Cisco’s Brussels-based EU public policy lead, told CNBC.
Currently, many of the biggest large language models (LLMs), like OpenAI’s ChatGPT and Anthropic’s Claude, use data centers based in the U.S. to store data and process requests via the cloud.
This has led to concern from politicians and regulators in Europe, who see dependence on U.S. technology as harmful to the continent’s competitiveness — and, more worryingly, technological resilience.
Where did ‘AI sovereignty’ come from?
The notion of data and technological sovereignty is something that has previously been on Europe’s agenda. It came about, in part, as a result of businesses reacting to new regulations.
The European Union’s General Data Protection Regulation, for example, requires companies to handle user data in a secure, compliant way that respects their right to privacy. High-profile cases in the EU have also raised doubts over whether data on European citizens can be transferred across borders safely.
The European Court of Justice in 2020 invalidated an EU-U.S. data-sharing framework, on the grounds that the pact did not afford the same level of protection as guaranteed within the EU by the General Data Protection Regulation (GDPR). Last year the EU-U.S. Data Privacy Framework was formed to ensure that data can flow safely between the EU and U.S.
These political development have ultimately resulted in a push toward localization of cloud infrastructure, where data is stored and processed for many online services.
Filippo Sanesi, global head of marketing and operations at OVHCloud, said the French cloud firm is seeing lots of demand for its European-located infrastructure, as they “understand the value of having their data in Europe, which are subject to European legislation.”
“As this concept of data sovereignty becomes more mature and people understand what it means, we see more and more companies understanding the importance of having your data locally and under a specific jurisdiction and governance,” Sanesi told CNBC. “We have a lot of data,” he added. “This data is sovereign in specific countries, under specific regulations.”
“Now, with this data, you can actually make products and services for AI, and those services should then be sovereign, should be controlled, deployed and developed locally by local talent for the local population or businesses.”
The AI sovereignty push hasn’t been driven forward by regulators — at least, not yet, according to Cisco’s Gow. Rather, it’s come from private companies, which are opening more data centers — facilities containing vast amounts of computing equipment to enable cloud-based AI tools — in Europe, he said.
Sovereign AI is “more driven by the industry naming it that, than it is from the policymakers’ side,” Gow said. “You don’t see the ‘AI sovereignty’ terminology used on the regulator side yet.”
Countries are pushing the idea of AI sovereignty because they recognize AI is “the future” and a “massively strategic technology,” Gow said.
Governments are focusing on boosting their domestic tech companies and ecosystems, as well as the all-important backend infrastructure that enables AI services.
“The AI workload uses 20 times the bandwidth of a traditional workload,” Gow said. It’s also about enabling the workforce, according to Gow, as firms need skilled workers to be successful.
Most important of all, however, is the data. “What you’re seeing is quite a few attempts from that side to think about training LLMs on localized data, in language,” Gow said.
The aim of the Italia project is to store results in a given jurisdiction and rely on data from citizens within that region so that results produced by the AI systems there are more grounded in local languages, culture and history.
“Sovereign AI is about reflecting the values of an organization or, equally, the country that you’re in and the values and the language,” David Hogan, EMEA head of enterprise sales for chipmaking giant Nvidia, told CNBC.
“The core challenge is that most of the frontier models today have been trained primarily on Western data generally,” Hogan added.
In Denmark for example, where Nvidia has a major presence, officials are concerned about vital services such as health care and telecoms being delivered by AI systems that aren’t “reflective” of local Danish culture and values, according to Hogan.
On Wednesday, Denmark laid out a landmark white paper outlining how companies can use AI in compliance with the incoming EU AI Act — the world’s first major AI law. The document is meant to serve as a blueprint for other EU nations to follow and adopt.
“If you’re in a European country that’s not one of the major language countries that’s spoken internationally, probably less than 2% of the data is trained on your language — let alone your culture,” Hogan said.
How regulation fueled a mindset shift
That’s not to say regulations haven’t proven an important factor in getting tech giants to think more about building localized AI infrastructure within Europe.
OVHCloud’s Sanesi said regulations like the EU’s GDPR catalyzed a lot of the interest in onshoring the processing of data in a given region.
The concept of AI sovereignty is also getting buy-in from local European tech firms.
Earlier this week, Berlin-headquartered search engine Ecosia and its Paris-based peer Qwant announced a joint venture to develop a European search index from scratch, aiming to serve improved French and German language results.
Meanwhile, French telecom operator Orange has said it’s in discussions with a number of foundational AI model companies about building a smartphone-based “sovereign AI” model for its customers that more accurately reflects their own language and culture.
“It wouldn’t make sense to build our own LLMs. So there’s a lot of discussion right now about, how do we partner with existing providers to make it more local and safer?” Bruno Zerbib, Orange’s chief technology officer, told CNBC.
“There are a lot of use cases where [AI data] can be processed locally [on a phone] instead of processed on the cloud,” Zerbib added. Orange hasn’t yet selected a partner for these sovereign AI model ambitions.
Eric Glyman and Karim Atiyeh, cofounders of corporate card startup Ramp
Financial technology startup Ramp is letting some employees and early investors cash out in a new deal that values the company at $13 billion.
The New York company announced the $150 million deal Monday. Khosla Ventures, Thrive Capital and General Catalyst were among the entities that bought shares in the round. The financing marks a step up from Ramp’s peak valuation of $8.1 billion in 2022. Ramp also raised a so-called down round that pegged the company’s price closer to $5.8 billion in 2023. The rebound in value shows some renewed investor appetite for high-growth startups, even in an era of higher interest rates.
The deal is also the latest in a string of private companies letting employees cash out shares and lowering the pressure on themselves to go public.
Stripe last week announced a tender offer that valued the company at $91.5 billion, helping its valuation rebound close to its peak of $95 billion. Co-founder and President John Collison told CNBC that Stripe has “no near-term IPO plans.” DataBricks and OpenAI have also announced major secondary rounds in the last six months.
Ramp is a financial software company that uses AI. The company issues credit cards and automates expenses and accounting. It competes with Brex, American Express and Concur in some arenas. CEO Eric Glyman said a bulk of Ramp’s customers are trying to cut overhead expenses in an era of corporate belt-tightening.
“Our core value proposition is helping businesses achieve more with less and spend less, which went from a-nice-to-have to truly the difference between whether you would exist or not in 2022 and 2023,” Glyman told CNBC.
The company serves 30,000 businesses in the U.S. including Anduril, Barry’s and Poshmark. Ramp plans to focus on enterprise expansion going forward, Glyman said.
Ramp is using artificial intelligence to automate a lot of its technology, Glyman said. The startup now powers over $55 billion in annualized purchase volume across card transactions and bill payments, up from $10 billion in January 2023, according to Glyman. Ramp makes money off of interchange fees on credit cards plus higher-margin software subscriptions.
As for an initial public offering, Glyman said there isn’t a “timeline in place.” But it is “something we’re thinking a lot about.” He said the company was burning less than $2 million per month on average last year, reducing its need to raise new capital.
“There isn’t what you would typically see with a strong need for the capital infusion an IPO would provide,” Glyman said. “That said, companies that are seeking to stand the test of time often pursue going public.”
Amazon is bringing its palm-scanning payment system to a Whole Foods store in Seattle, the first of many planned future locations to roll out the technology.
Amazon
Patients at NYU Langone Health facilities will soon be able to check in for appointments using Amazon’spalm-scanning technology, the company announced Monday.
The contactless service, called Amazon One, can identify patients “securely and quickly,” according to a release. NYU Langone said the technology will help it speed up sign-ins, alleviate administrative strain on staff, and reduce errors and wait times.
For a health system that handles more than 10 million patient visits each year, every minute counts. With Amazon One, NYU Langone anticipates it will be able to cut the time patients spend at their front desks from about two to three minutes to less than a minute, Andrew Rubin, NYU Langone senior vice president of clinical affairs, told CNBC.
“That’s both a positive experience for the patient to be able to actually get in faster, and requires less work on our part having to authenticate who the patient is,” Rubin said.
Amazon will not store or access any of patients’ health data or personal information beyond their palm prints, NYU Langone said. Participation is voluntary, and patients can opt out at any time.
More CNBC health coverage
NYU Langone operates six hospitals and more than 320 outpatient facilities, and it’s the first health-care organization to ever deploy Amazon One. The collaboration has been about nine months in the making, said Nader Mherabi, NYU Langone’s chief digital and information officer.
Amazon said it plans to explore additional applications for Amazon One within health care in the future, such as credentialing for access to high-security areas and shared computer systems.
The company introduced Amazon One at its Go cashierless stores in 2020, and it rolled out to all Whole Foods Market locations in 2023. NYU Langone will be the largest third-party deployment of Amazon One to date.
The service will be available at NYU Langone sites in the New York metro area starting next week, and it will expand to other locations this year.
Amazon and NYU Langone did not disclose terms of the deal.
Bitcoin rose as high as $95,000, while the smaller coins rocketed double digits.
It was welcome news to investors, who have been anxious for cryptocurrencies to come out of their consolidation. Last week, bitcoin fell under the key $90,000 level for the first time in three months to, at one point, 25% below its January all-time high. That break below support put it at risk of a bigger slide toward $70,000. Losses in smaller, riskier coins have been even steeper.
“The weekend news is exactly the type of catalyst investors have been looking for to feel reassured about follow through from the U.S. administration with respect to its crypto friendly policies,” Joel Kruger, market strategist at LMAX Group, told CNBC. “Now that we’ve already seen a healthy correction in February, this sets the stage for the start to the next leg higher for crypto assets.”
Investors this week will be watching for clues about the direction of the reserve plans. White House AI and crypto czar David Sacks teased in a post on X that there would be “more to come” at the first White House Crypto Summit, scheduled to take place this Friday.
How long prices stay elevated may depend on the details disclosed at the event.
Don’t miss these cryptocurrency insights from CNBC Pro: