China is looking to challenge the U.S. in artificial intelligence. China’s tech giants have launched their own AI models.
Niphon | Istock | Getty Images
China’s race to develop smarter-than-human artificial intelligence may put it ahead of the U.S., but such ground-breaking technology could also risk lessening the stronghold that the ruling Communist Party has over the world’s second-largest economy.
That’s the view of prominent AI scientist Max Tegmark, who told CNBC artificial general intelligence (AGI) is closer than we think and the narrative of a geopolitical battle between the U.S. and China racing to build the smartest AI is a “suicide race.”
While there is no singular definition of AGI, it is broadly taken to refer to AI that can outsmart humans.
Applications like ChatGPT — that allow users to prompt a chatbot for answers — have exploded in popularity. But many AI companies are racing to develop the next level, with AI that has human-level intelligence.
Sam Altman, the CEO of OpenAI, has said that AGI could be achieved by 2025. While there are other major names in the tech sector who also think AGI is close, many others think true AGI is still very far away.
As well as competition between technology companies, there is also the geopolitical battle taking place between the U.S. and China for dominance in realms from AI to chips. While this is often portrayed as a race to be first to the latest technology, Tegmark said this is not the right framing.
“I think of this battle, this geopolitical battle to build AGI first as a ‘hopium war’,” Tegmark told CNBC in an interview last month. ” I call it the ‘hopium war’ because it’s fueled by … delusional hope that we can control AGI.”
Tegmark is the president of the Future of Life Institute, a thinktank which penned a letter last year calling for AI labs to pause the development of advanced AI systems. The letter was signed by major tech names including Tesla CEO Elon Musk. Tegmark’s concern is that AI is advancing rapidly with very few guardrails in place, and no way to control it should it begin to outsmart humans.
“We are much closer to building AGI than figuring out how to control it. And that means that the AGI race is not an arms race, it’s a suicide race,” Tegmark said.
Is China worried about AGI?
China has little incentive to build AGI, according to Tegmark. The AI scientist recalled a story in which Elon Musk told him about a “high level meeting” the Tesla boss had with Chinese government officials in early 2023. Musk said to the Chinese government that if AGI is built, China “will not be controlled by the Communist Party, but by the super intelligence,” Tegmark said.
“[Musk] got a very strong reaction. Some of them, really hadn’t thought about that, and with less than a month from that, China came out with their first AI regulations,” Tegmark said, referencing new regulation governing generative AI.
China’s ministry of foreign affairs was not immediately available for comment on the anecdote. CNBC also contacted Tesla for a response from Musk.
“The U.S. doesn’t need to convince China to not build AGI. Even if the U.S. didn’t exist, the Chinese government would have an incentive to not build it because they want to be in control,” Tegmark said.
“[The] last thing they want is to lose that control.”
China’s approach to AI
AI is a strategic priority for the Chinese government. The country’s biggest firms such as Alibaba, Huawei and Tencent have been developing their own AI models. The capabilities of those models are also advancing.
China was also among the first countries in the world to bring in regulation around various aspects of AI. The country’s internet is heavily censored and any information that appears to go against Beijing’s ideology is blocked. OpenAI’s ChatGPT is banned and it is well-noted that chatbots in China won’t answer questions related to politics and topics deemed sensitive by the Communist Party.
The country’s approach to AI is therefore an attempt to push innovation while also balancing its own interests. When it comes to AGI, China is likely to pursue a similar approach, according to analysts.
“I would not count on China to limit its own AI capabilities due to fears that such technologies would threaten Party rule. Similar predictions were made about the internet, they all proved to be false,” Kendra Schaefer, a partner at consultancy Trivium China,” told CNBC.
“China will attempt to dominate AGI while creating a techno-regulatory apparatus that limits what AGI is permitted to do domestically.”
U.S.-China AI battle
Despite Tegmark’s view that the the race to build AGI is a “hopium war,” geopoltiics remains front and center between the U.S. and China when it comes to development of the technology.
“Right now, China is viewing AI through a dual-lens: geopolitical power and domestic growth,” said Abishur Prakash, founder and geopolitical strategist at Toronto-based strategy advisory firm, The Geopolitical Business.
“With AI, China hopes to shift the balance of power around the globe, like creating a new export model. And, in parallel, China wants to power its economy in new ways, from government efficiency to business applications,” Prakash told CNBC.
The U.S. has pursued a policy of attempting to restrict China’s access to key technologies, mainly semiconductors like those designed by Nvidia, that are required to train more advanced AI models. China has responded by attempting to build its homegrown chip industry.
Will the U.S. and China partner on AI rules?
Technologists have warned of some of the risks and dangers when AGI does finally arrive. One theory is that without guardrails, AI will be able to improve itself and design new systems independently.
Tegmark believes that any such risks will be realized by both the U.S. and China, which will force both countries’ governments to individually come up with rules around AI safety.
“So my optimistic path forward is the U.S. and China unilaterally impose national safety standards to prevent their own companies from doing harm and building uncontrollable AGI, not to appease the rivals superpowers, but just to protect themselves,” Tegmark said.
“After that happens though, there’s this really interesting stage where the U.S. and China will be like, wait, how can we guarantee that North Korea doesn’t build AGI or someone else? And then the U.S. and China have an incentive now to push the rest of the world to join them into an AGI moratorium.”
Indeed, governments are already trying to work together to figure out how to create regulations and frameworks around AI. Last year, the U.K. hosted an AI safety summit, which the U.S. and China were both in attendance, to discuss potential guardrails around the technology.
But regulation and rules around AI are currently fragmented. This year, the European Union enacted the AI Act, the first major law globally governing the technology. China has its own set of rules, while many other countries have not yet moved to create any regulation.
Tegmark’s hope of co-ordination around AI safety is echoed by others.
“When the dangers of competition are greater than the rewards, nations will ideally be motivated to come together and mutually self-regulate,” Trivium China’s Schaefer said.
“Indeed, some Chinese policymakers have advocated for getting out ahead of that potential issue and establishing an international governance body under the UN – similar to the International Atomic Energy Agency – so there is desire on Beijing’s side to establish a global governance body,” she said.
The two new features, announced Monday in a post during the Cannes Lions festival, will help brands better leverage discussions on the platform. The company said the tools are powered by an engine called Reddit Community Intelligence that turns “posts and comments into structured intelligence.”
Reddit announced a “listening tool” called Reddit Insights, which shares real-time insights with marketers to help them identify trends and launch campaigns. The other tool, called Conversation Summary Add-ons, allows brands to show “positive” user content under their ads.
“These are tools for a new era of community marketing, one where brands can tap into Reddit’s authenticity and connect meaningfully with high-intent communities around the world,” the company wrote.
Read more CNBC tech news
The company said Publicis served as the exclusive alpha tester for Reddit Insights, while Lucid and Jackbox Games were among the early testers for Conversation Summary Add-Ons.
Companies across industries are betting on new ways to harness AI to improve advertising campaigns and better engage with users. These new tools are transforming the industry while also putting pressure on some advertising stalwarts.
The industry is also currently navigating a bumpy environment spurred by the trade war with China.
During the recent earnings season, many companies warned of sluggish advertising sales in certain regions due to a rocky macroeconomic environment. Recent developments, however, have suggested a cooling of tensions between the U.S. and China.
Last month, Reddit posted strong sales and upbeat guidance. The company has benefited from recent changes to Google search and internal site improvements, which include convincing logged-out users to open accounts. Logged-in accounts are more beneficial to advertisers.
European defense technology startup Helsing on Tuesday said that it’s raised 600 million euros ($693.6 million) in a bumper new round of funding.
The investment was led by Prima Materia, the venture capital firm founded by Spotify CEO Daniel Ek and by Shakil Khan, an early investor in the popular music streaming app. Ek is also chairman of Helsing.
Existing investors Lightspeed Venture Partners, Accel, Plural, General Catalyst and Saab also put money in, alongside new investors BDT & MSD Partners.
Defense and the technology behind it have become a hot area for investors lately, amid major global conflicts, including the Ukraine war to Israel-Gaza. Last week saw a further escalation of war in the Middle East as Israel launched a series of airstrikes against Iran.
In 2024, venture funding in Europe’s defense, security and resilience sector reached an all-time high of $5.2 billion, according to a recent report from the NATO Innovation Fund. The sector grew 30% in the past two years, outperforming the broader VC market, which saw a 45% decline over the same period.
Founded in 2021, Helsing sells software that uses artificial intelligence technology to analyze large amounts of sensor and weapons system data from the battlefield to inform military decisions in real time. Last year, the startup also began manufacturing its own line of military drones, called HX-2.
Helsing, which operates in the U.K., Germany and France, said it would use the fresh cash to invest in Europe’s “technological sovereignty” — which refers to attempts to onshore the development and production of critical technologies, such as AI.
“As Europe rapidly strengthens its defence capabilities in response to evolving geopolitical challenges, there is an urgent need for investments in advanced technologies that ensure its strategic autonomy and security readiness,” Ek said in a statement out Tuesday.
Helsing did not disclose its new valuation following the latest financing round, which is subject to “certain approvals,” according to a statement. The firm was previously valued at around 5 billion euros in a 450 million euro funding round led by General Catalyst last year.
Sword Health, a startup focused on helping people deal with pain through digital services, is expanding into mental health and has raised additional capital to fuel its growth.
The 10-year-old company is introducing Mind, which uses a combination of artificial intelligence, hardware and human mental health professionals to treat patients with mild depression and anxiety. Sword said Mind will help users access care whenever they need it, rather than during sporadic, hourlong appointments.
“It’s really a breakthrough in terms of how we address mental health, and this is only possible because we have AI,” Sword CEO Virgílio Bento told CNBC in an interview.
Also on Tuesday, Sword announced a $40 million funding round, led by General Catalyst, in a deal that values the company at $4 billion. The fresh cash will support Sword’s efforts to grow through acquisitions, as well as its global expansion and AI model development, the company said.
The round included participation from Khosla Ventures, Comcast Ventures and other firms. Sword had raised a total of more than $450 million as of September, according to PitchBook.
The financing lands as the digital health market shows signs of recovery following a difficult post-Covid stretch, when rising inflation, higher interest rates and a return to in-person activities led to a dramatic retreat in the industry.
Earlier this month, Omada Health, which offers virtual care programs to supports patients with chronic conditions such as diabetes and hypertension, held its Nasdaq debut, though the stock is trading below its initial public offering price. Weeks before that, digital physical therapy provider Hinge Healthhit the New York Stock Exchange. The shares are trading a few dollars above their offer price.
Sword, which was founded in Portugal and is now based in New York, offers tools for digital physical therapy, pelvic health and movement health to help patients manage pain from home and avoid other treatments such as opioids and surgery. Patients can sign up for Sword if it’s supported by their employer or their health plan.
Mind users will receive a wrist wearable called the “M-band” that can measure environmental and physiological signals such as heart rate, sleep and the lighting in a user’s environment. Mind also includes access to an AI Care agent and human mental health professionals, who can deliver services such as traditional talk therapy.
Bento said a human is always involved with a patient’s care, and that AI is not making clinical decisions.
For example, if a patient has an anxiety attack, Sword’s AI will recognize that and could ask a clinician to approve some physical activity for later that day to help with recovery. The clinician would either approve the physical activity that the AI suggested, or override it and propose something else.
“You have an anxiety issue today, and the way you’re going to manage is to talk about it one week from now? That just doesn’t work,” Bento said. “Mental health should be always on, where you have a problem now, and you can have immediate help in the moment.”
Bento said Sword has some clients that have been on a waiting list for Mind, and the startup has been testing the offering with some of its design partners. He said early users have approved of Mind’s personalized approach and convenience.
“We believe that it is really the future of how mental health is going to be delivered in the future, by us and by other companies,” Bento said. “AI plays a very important role, but the use of AI — and I think this is very important — needs to be used in a very smart way.”
Disclosure: Comcast, the parent of Comcast Ventures, is the owner of NBCUniversal, parent company of CNBC.