China’s AI balancing act — beating the U.S. but keeping the tech from threatening Beijing’s rule

Published

12 months ago

December 2, 2024

admin

China is looking to challenge the U.S. in artificial intelligence. China’s tech giants have launched their own AI models.

Niphon | Istock | Getty Images

China’s race to develop smarter-than-human artificial intelligence may put it ahead of the U.S., but such ground-breaking technology could also risk lessening the stronghold that the ruling Communist Party has over the world’s second-largest economy.

That’s the view of prominent AI scientist Max Tegmark, who told CNBC artificial general intelligence (AGI) is closer than we think and the narrative of a geopolitical battle between the U.S. and China racing to build the smartest AI is a “suicide race.”

While there is no singular definition of AGI, it is broadly taken to refer to AI that can outsmart humans.

Applications like ChatGPT — that allow users to prompt a chatbot for answers — have exploded in popularity. But many AI companies are racing to develop the next level, with AI that has human-level intelligence.

Sam Altman, the CEO of OpenAI, has said that AGI could be achieved by 2025. While there are other major names in the tech sector who also think AGI is close, many others think true AGI is still very far away.

As well as competition between technology companies, there is also the geopolitical battle taking place between the U.S. and China for dominance in realms from AI to chips. While this is often portrayed as a race to be first to the latest technology, Tegmark said this is not the right framing.

“I think of this battle, this geopolitical battle to build AGI first as a ‘hopium war’,” Tegmark told CNBC in an interview last month. ” I call it the ‘hopium war’ because it’s fueled by … delusional hope that we can control AGI.”

Tegmark is the president of the Future of Life Institute, a thinktank which penned a letter last year calling for AI labs to pause the development of advanced AI systems. The letter was signed by major tech names including Tesla CEO Elon Musk. Tegmark’s concern is that AI is advancing rapidly with very few guardrails in place, and no way to control it should it begin to outsmart humans.

“We are much closer to building AGI than figuring out how to control it. And that means that the AGI race is not an arms race, it’s a suicide race,” Tegmark said.

Is China worried about AGI?

China has little incentive to build AGI, according to Tegmark. The AI scientist recalled a story in which Elon Musk told him about a “high level meeting” the Tesla boss had with Chinese government officials in early 2023. Musk said to the Chinese government that if AGI is built, China “will not be controlled by the Communist Party, but by the super intelligence,” Tegmark said.

“[Musk] got a very strong reaction. Some of them, really hadn’t thought about that, and with less than a month from that, China came out with their first AI regulations,” Tegmark said, referencing new regulation governing generative AI.

China’s ministry of foreign affairs was not immediately available for comment on the anecdote. CNBC also contacted Tesla for a response from Musk.

“The U.S. doesn’t need to convince China to not build AGI. Even if the U.S. didn’t exist, the Chinese government would have an incentive to not build it because they want to be in control,” Tegmark said.

“[The] last thing they want is to lose that control.”

China’s approach to AI

AI is a strategic priority for the Chinese government. The country’s biggest firms such as Alibaba, Huawei and Tencent have been developing their own AI models. The capabilities of those models are also advancing.

China was also among the first countries in the world to bring in regulation around various aspects of AI. The country’s internet is heavily censored and any information that appears to go against Beijing’s ideology is blocked. OpenAI’s ChatGPT is banned and it is well-noted that chatbots in China won’t answer questions related to politics and topics deemed sensitive by the Communist Party.

The country’s approach to AI is therefore an attempt to push innovation while also balancing its own interests. When it comes to AGI, China is likely to pursue a similar approach, according to analysts.

“I would not count on China to limit its own AI capabilities due to fears that such technologies would threaten Party rule. Similar predictions were made about the internet, they all proved to be false,” Kendra Schaefer, a partner at consultancy Trivium China,” told CNBC.

“China will attempt to dominate AGI while creating a techno-regulatory apparatus that limits what AGI is permitted to do domestically.”

U.S.-China AI battle

Despite Tegmark’s view that the the race to build AGI is a “hopium war,” geopoltiics remains front and center between the U.S. and China when it comes to development of the technology.

“Right now, China is viewing AI through a dual-lens: geopolitical power and domestic growth,” said Abishur Prakash, founder and geopolitical strategist at Toronto-based strategy advisory firm, The Geopolitical Business.

Underestimating China in the AI 'multi-decade arms race' would be a mistake: Analyst

“With AI, China hopes to shift the balance of power around the globe, like creating a new export model. And, in parallel, China wants to power its economy in new ways, from government efficiency to business applications,” Prakash told CNBC.

The U.S. has pursued a policy of attempting to restrict China’s access to key technologies, mainly semiconductors like those designed by Nvidia, that are required to train more advanced AI models. China has responded by attempting to build its homegrown chip industry.

Will the U.S. and China partner on AI rules?

Technologists have warned of some of the risks and dangers when AGI does finally arrive. One theory is that without guardrails, AI will be able to improve itself and design new systems independently.

Tegmark believes that any such risks will be realized by both the U.S. and China, which will force both countries’ governments to individually come up with rules around AI safety.

“So my optimistic path forward is the U.S. and China unilaterally impose national safety standards to prevent their own companies from doing harm and building uncontrollable AGI, not to appease the rivals superpowers, but just to protect themselves,” Tegmark said.

“After that happens though, there’s this really interesting stage where the U.S. and China will be like, wait, how can we guarantee that North Korea doesn’t build AGI or someone else? And then the U.S. and China have an incentive now to push the rest of the world to join them into an AGI moratorium.”

Indeed, governments are already trying to work together to figure out how to create regulations and frameworks around AI. Last year, the U.K. hosted an AI safety summit, which the U.S. and China were both in attendance, to discuss potential guardrails around the technology.

But regulation and rules around AI are currently fragmented. This year, the European Union enacted the AI Act, the first major law globally governing the technology. China has its own set of rules, while many other countries have not yet moved to create any regulation.

Tegmark’s hope of co-ordination around AI safety is echoed by others.

“When the dangers of competition are greater than the rewards, nations will ideally be motivated to come together and mutually self-regulate,” Trivium China’s Schaefer said.

“Indeed, some Chinese policymakers have advocated for getting out ahead of that potential issue and establishing an international governance body under the UN – similar to the International Atomic Energy Agency – so there is desire on Beijing’s side to establish a global governance body,” she said.

Technology

Figure AI sued by whistleblower who warned that startup’s robots could ‘fracture a human skull’

Published

7 hours ago

November 21, 2025

admin

$Figure AI sued by whistleblower who warned that startup's robots could 'fracture a human skull'$

Startup Figure AI is developing general-purpose humanoid robots.

Figure AI

Figure AI, an Nvidia-backed developer of humanoid robots, was sued by the startup’s former head of product safety who alleged that he was wrongfully terminated after warning top executives that the company’s robots “were powerful enough to fracture a human skull.”

Robert Gruendel, a principal robotic safety engineer, is the plaintiff in the suit filed Friday in a federal court in the Northern District of California. Gruendel’s attorneys describe their client as a whistleblower who was fired in September, days after lodging his “most direct and documented safety complaints.”

The suit lands two months after Figure was valued at $39 billion in a funding round led by Parkway Venture Capital. That’s a 15-fold increase in valuation from early 2024, when the company raised a round from investors including Jeff Bezos, Nvidia, and Microsoft.

In the complaint, Gruendel’s lawyers say the plaintiff warned Figure CEO Brett Adcock and Kyle Edelberg, chief engineer, about the robot’s lethal capabilities, and said one “had already carved a ¼-inch gash into a steel refrigerator door during a malfunction.”

The complaint also says Gruendel warned company leaders not to “downgrade” a “safety road map” that he had been asked to present to two prospective investors who ended up funding the company.

Gruendel worried that a “product safety plan which contributed to their decision to invest” had been “gutted” the same month Figure closed the investment round, a move that “could be interpreted as fraudulent,” the suit says.

The plaintiff’s concerns were “treated as obstacles, not obligations,” and the company cited a “vague ‘change in business direction’ as the pretext” for his termination, according to the suit.

Gruendel is seeking economic, compensatory and punitive damages and demanding a jury trial.

Figure didn’t immediately respond to a request for comment. Nor did attorneys for Gruendel.

The humanoid robot market remains nascent today, with companies like Tesla and Boston Dynamics pursuing futuristic offerings, alongside Figure, while China’s Unitree Robotics is preparing for an IPO. Morgan Stanley said in a report in May that adoption is “likely to accelerate in the 2030s” and could top $5 trillion by 2050.

Read the filing here: