China is looking to challenge the U.S. in artificial intelligence. China’s tech giants have launched their own AI models.
Niphon | Istock | Getty Images
China’s race to develop smarter-than-human artificial intelligence may put it ahead of the U.S., but such ground-breaking technology could also risk lessening the stronghold that the ruling Communist Party has over the world’s second-largest economy.
That’s the view of prominent AI scientist Max Tegmark, who told CNBC artificial general intelligence (AGI) is closer than we think and the narrative of a geopolitical battle between the U.S. and China racing to build the smartest AI is a “suicide race.”
While there is no singular definition of AGI, it is broadly taken to refer to AI that can outsmart humans.
Applications like ChatGPT — that allow users to prompt a chatbot for answers — have exploded in popularity. But many AI companies are racing to develop the next level, with AI that has human-level intelligence.
Sam Altman, the CEO of OpenAI, has said that AGI could be achieved by 2025. While there are other major names in the tech sector who also think AGI is close, many others think true AGI is still very far away.
As well as competition between technology companies, there is also the geopolitical battle taking place between the U.S. and China for dominance in realms from AI to chips. While this is often portrayed as a race to be first to the latest technology, Tegmark said this is not the right framing.
“I think of this battle, this geopolitical battle to build AGI first as a ‘hopium war’,” Tegmark told CNBC in an interview last month. ” I call it the ‘hopium war’ because it’s fueled by … delusional hope that we can control AGI.”
Tegmark is the president of the Future of Life Institute, a thinktank which penned a letter last year calling for AI labs to pause the development of advanced AI systems. The letter was signed by major tech names including Tesla CEO Elon Musk. Tegmark’s concern is that AI is advancing rapidly with very few guardrails in place, and no way to control it should it begin to outsmart humans.
“We are much closer to building AGI than figuring out how to control it. And that means that the AGI race is not an arms race, it’s a suicide race,” Tegmark said.
Is China worried about AGI?
China has little incentive to build AGI, according to Tegmark. The AI scientist recalled a story in which Elon Musk told him about a “high level meeting” the Tesla boss had with Chinese government officials in early 2023. Musk said to the Chinese government that if AGI is built, China “will not be controlled by the Communist Party, but by the super intelligence,” Tegmark said.
“[Musk] got a very strong reaction. Some of them, really hadn’t thought about that, and with less than a month from that, China came out with their first AI regulations,” Tegmark said, referencing new regulation governing generative AI.
China’s ministry of foreign affairs was not immediately available for comment on the anecdote. CNBC also contacted Tesla for a response from Musk.
“The U.S. doesn’t need to convince China to not build AGI. Even if the U.S. didn’t exist, the Chinese government would have an incentive to not build it because they want to be in control,” Tegmark said.
“[The] last thing they want is to lose that control.”
China’s approach to AI
AI is a strategic priority for the Chinese government. The country’s biggest firms such as Alibaba, Huawei and Tencent have been developing their own AI models. The capabilities of those models are also advancing.
China was also among the first countries in the world to bring in regulation around various aspects of AI. The country’s internet is heavily censored and any information that appears to go against Beijing’s ideology is blocked. OpenAI’s ChatGPT is banned and it is well-noted that chatbots in China won’t answer questions related to politics and topics deemed sensitive by the Communist Party.
The country’s approach to AI is therefore an attempt to push innovation while also balancing its own interests. When it comes to AGI, China is likely to pursue a similar approach, according to analysts.
“I would not count on China to limit its own AI capabilities due to fears that such technologies would threaten Party rule. Similar predictions were made about the internet, they all proved to be false,” Kendra Schaefer, a partner at consultancy Trivium China,” told CNBC.
“China will attempt to dominate AGI while creating a techno-regulatory apparatus that limits what AGI is permitted to do domestically.”
U.S.-China AI battle
Despite Tegmark’s view that the the race to build AGI is a “hopium war,” geopoltiics remains front and center between the U.S. and China when it comes to development of the technology.
“Right now, China is viewing AI through a dual-lens: geopolitical power and domestic growth,” said Abishur Prakash, founder and geopolitical strategist at Toronto-based strategy advisory firm, The Geopolitical Business.
“With AI, China hopes to shift the balance of power around the globe, like creating a new export model. And, in parallel, China wants to power its economy in new ways, from government efficiency to business applications,” Prakash told CNBC.
The U.S. has pursued a policy of attempting to restrict China’s access to key technologies, mainly semiconductors like those designed by Nvidia, that are required to train more advanced AI models. China has responded by attempting to build its homegrown chip industry.
Will the U.S. and China partner on AI rules?
Technologists have warned of some of the risks and dangers when AGI does finally arrive. One theory is that without guardrails, AI will be able to improve itself and design new systems independently.
Tegmark believes that any such risks will be realized by both the U.S. and China, which will force both countries’ governments to individually come up with rules around AI safety.
“So my optimistic path forward is the U.S. and China unilaterally impose national safety standards to prevent their own companies from doing harm and building uncontrollable AGI, not to appease the rivals superpowers, but just to protect themselves,” Tegmark said.
“After that happens though, there’s this really interesting stage where the U.S. and China will be like, wait, how can we guarantee that North Korea doesn’t build AGI or someone else? And then the U.S. and China have an incentive now to push the rest of the world to join them into an AGI moratorium.”
Indeed, governments are already trying to work together to figure out how to create regulations and frameworks around AI. Last year, the U.K. hosted an AI safety summit, which the U.S. and China were both in attendance, to discuss potential guardrails around the technology.
But regulation and rules around AI are currently fragmented. This year, the European Union enacted the AI Act, the first major law globally governing the technology. China has its own set of rules, while many other countries have not yet moved to create any regulation.
Tegmark’s hope of co-ordination around AI safety is echoed by others.
“When the dangers of competition are greater than the rewards, nations will ideally be motivated to come together and mutually self-regulate,” Trivium China’s Schaefer said.
“Indeed, some Chinese policymakers have advocated for getting out ahead of that potential issue and establishing an international governance body under the UN – similar to the International Atomic Energy Agency – so there is desire on Beijing’s side to establish a global governance body,” she said.
Nvidia CEO Jensen Huang attends a roundtable discussion at the Viva Technology conference dedicated to innovation and startups at Porte de Versailles exhibition center in Paris on June 11, 2025.
Sarah Meyssonnier | Reuters
Nvidia announced Tuesday that it hopes to resume sales of its H20 general processing units to clients in China, saying that the U.S. government had assured the company would be granted licenses.
Nvidia’s sales of the H20 chips, which had been designed specifically to keep them out of export controls on China, were halted in April.
“The U.S. government has assured NVIDIA that licenses will be granted, and NVIDIA hopes to start deliveries soon,” the company said in a statement.
This comes against the backdrop of a preliminary trade deal between Washington and Beijing last month that sought China to resume rare earth exports and the U.S. to relax tech export controls.
Nvidia CEO Jensen Huang in recent months has ramped up his lobbying against export controls, arguing that they inhibited American tech leadership. In May, Huang said chip restrictions had already cut Nvidia’s China market share nearly in half.
Huang also announced a new “fully compliant” GPU, NVIDIA RTX PRO, saying it was ideal for smart factories and logistics.
The potential change in U.S. stance follows a meeting between Huang and U.S. President Donald Trump last week.
In his meeting with Trump and U.S. policymakers, Huang had reaffirmed Nvidia’s support for the administration’s job creation and onshoring efforts, as well as the aim for America to lead in global AI, the company said.
Meanwhile, in Beijing, it was confirmed that Huang has met with government and industry officials to discuss the benefits of AI and ways for researchers to advance safe and secure AI for the benefit of all.
In this photo illustration, a man seen holding a smartphone with the logo of US artificial intelligence company Cognition AI Inc. in front of website.
Timon Schneider | SOPA Images | Sipa USA | AP
Artificial intelligence startup Cognition announced it’s acquiring Windsurf, the AI coding company that lost its CEO and several other senior employees to Google just days earlier.
Cognition said on Monday that it will purchase Windsurf’s intellectual property, product, trademark, brand and talent, but didn’t disclose terms of the deal. It’s the latest development in an AI talent war, as companies like Meta, Google and OpenAI fiercely compete for top engineers and researchers.
OpenAI had been in talks to acquire Windsurf for about $3 billion in April, but the deal fell apart, and Google said on Friday that it hired Windsurf’s co-founder and CEO Varun Mohan. Google is paying $2.4 billion in licensing fees and for compensation, as CNBC previously reported.
“Every new employee of Cognition will be treated the same way as existing employees: with transparency, fairness, and deep respect for their abilities and value,” Cognition CEO Scott Wu wrote in a memo to employees on Monday. “After today, our efforts will be as a united and aligned team. There’s only one boat and we’re all in it together.”
Cognition didn’t immediately respond to CNBC’s request for comment. Windsurf directed CNBC to Cognition.
Cognition is best known for its AI coding agent named Devin, which is designed to help engineers build software faster. As of March, the startup had raised hundreds of millions of dollars at a valuation of close to $4 billion, according to a report from Bloomberg.
Both companies are backed by Peter Thiel’s Founders Fund. Other investors in Windsurf include Greenoaks, Kleiner Perkins and General Catalyst.
“I’m overwhelmed with excitement and optimism, but most of all, gratitude,” Jeff Wang, the interim CEO of Windsurf, wrote in a post on X on Monday. “Trying times reveal character, and I couldn’t be prouder of how every single person at Windsurf showed up these last three days for each other and for our users.”
Wu said that the acquisition ensures all Windsurf employees are “treated with respect and well taken care of in this transaction.” All employees will participate financially in the deal, have vesting cliffs waived for their work to date and receive fully accelerated vesting for their, according to the memo.
“There’s never been a more exciting time to build,” Wu wrote.
The Grok logo is being displayed on a smartphone with Xai visible in the background in this photo illustration on April 1, 2024.
Jonathan Raa | Nurphoto | Getty Images
The European Union on Monday called in representatives from Elon Musk‘s xAI after the company’s social network X, and chatbot Grok, generated and spread anti-semitic hate speech, including praise for Adolf Hitler, last week.
A spokesperson for the European Commission told CNBC via e-mail that a technical meeting will take place on Tuesday.
xAI did not immediately respond to a request for comment.
Sandro Gozi, a member of Italy’s parliament and member of the Renew Europe group, last week urged the Commission to hold a formal inquiry.
“The case raises serious concerns about compliance with the Digital Services Act (DSA) as well as the governance of generative AI in the Union’s digital space,” Gozi wrote.
X was already under a Commission probe for possible violations of the DSA.
Read more CNBC tech news
Grok also generated and spread offensive posts about political leaders in Poland and Turkey, including Polish Prime Minister Donald Tusk and Turkish President Recep Erdogan.
Over the weekend, xAI posted a statement apologizing for the hateful content.
“First off, we deeply apologize for the horrific behavior that many experienced. … After careful investigation, we discovered the root cause was an update to a code path upstream of the @grok bot,” the company said in the statement.
Musk and his xAI team launched a new version of Grok Wednesday night amid the backlash. Musk called it “the smartest AI in the world.”
xAI works with other businesses run and largely owned by Musk, including Tesla, the publicly traded automaker, and SpaceX, the U.S. aerospace and defense contractor.
Despite Grok’s recent outburst of hate speech, the U.S. Department of Defense awarded xAI a $200 million contract to develop AI. Anthropic, Google and OpenAI also received AI contracts.