OpenAI and Anthropic, the two most richly valued artificial intelligence startups, have agreed to let the U.S. AI Safety Institute test their new models before releasing them to the public, following increased concerns in the industry about safety and ethics in AI.
The institute, housed within the Department of Commerce at the National Institute of Standards and Technology (NIST), said in a press release that it will get “access to major new models from each company prior to and following their public release.”
The group was established after the Biden-Harris administration issued the U.S. government’s first-ever executive order on artificial intelligence in October 2023, requiring new safety assessments, equity and civil rights guidance and research on AI’s impact on the labor market.
“We are happy to have reached an agreement with the US AI Safety Institute for pre-release testing of our future models,” OpenAI CEO Sam Altman wrote in a post on X. OpenAI also confirmed to CNBC on Thursday that, in the past year, the company has doubled its number of weekly active users from late last year to 200 million. Axios was first to report on the number.
The news comes a day after reports surfaced that OpenAI is in talks to raise a funding round valuing the company at more than $100 billion. Thrive Capital is leading the round and will invest $1 billion, according to a source with knowledge of the matter who asked not to be named because the details are confidential.
Anthropic, founded by ex-OpenAI research executives and employees, was most recently valued at $18.4 billion. Anthropic counts Amazon as a leading investor, while OpenAI is heavily backed by Microsoft.
The agreements between the government, OpenAI and Anthropic “will enable collaborative research on how to evaluate capabilities and safety risks, as well as methods to mitigate those risks,” according to Thursday’s release.
Jason Kwon, OpenAI’s chief strategy officer, told CNBC in a statement that, “We strongly support the U.S. AI Safety Institute’s mission and look forward to working together to inform safety best practices and standards for AI models.”
Jack Clark, co-founder of Anthropic, said the company’s “collaboration with the U.S. AI Safety Institute leverages their wide expertise to rigorously test our models before widespread deployment” and “strengthens our ability to identify and mitigate risks, advancing responsible AI development.”
A number of AI developers and researchers have expressed concerns about safety and ethics in the increasingly for-profit AI industry. Current and former OpenAI employees published an open letter on June 4, describing potential problems with the rapid advancements taking place in AI and a lack of oversight and whistleblower protections.
“AI companies have strong financial incentives to avoid effective oversight, and we do not believe bespoke structures of corporate governance are sufficient to change this,” they wrote. AI companies, they added, “currently have only weak obligations to share some of this information with governments, and none with civil society,” and they can not be “relied upon to share it voluntarily.”
Days after the letter was published, a source familiar to the mater confirmed to CNBC that the FTC and the Department of Justice were set to open antitrust investigations into OpenAI, Microsoft and Nvidia. FTC Chair Lina Khan has described her agency’s action as a “market inquiry into the investments and partnerships being formed between AI developers and major cloud service providers.”
On Wednesday, California lawmakers passed a hot-button AI safety bill, sending it to Governor Gavin Newsom’s desk. Newsom, a Democrat, will decide to either veto the legislation or sign it into law by Sept. 30. The bill, which would make safety testing and other safeguards mandatory for AI models of a certain cost or computing power, has been contested by some tech companies for its potential to slow innovation.
Chinese e-commerce behemoth Alibaba on Friday beat profit expectations in its September quarter, but sales fell short as sluggishness in the world’s second-largest economy hit consumer spending.
Alibaba said net income rose 58% year on year to 43.9 billion yuan ($6.07 billion) in the company’s quarter ended Sept. 30, on the back of the performance of its equity investments. This compares with an LSEG forecast of 25.83 billion yuan.
“The year-over-year increases were primarily attributable to the mark-to-market changes from our equity investments, decrease in impairment of our investments and increase in income from operations,” the company said of the annual profit jump in its earnings statement.
Revenue, meanwhile, came in at 236.5 billion yuan, 5% higher year on year but below an analyst forecast of 238.9 billion yuan, according to LSEG data.
The company’s New York-listed shares have gained ground this year to date, up more than 13%. The stock fell more than 2% in morning trading on Friday, after the release of the quarterly earnings.
Sales sentiment
Investors are closely watching the performance of Alibaba’s main business units, Taobao and Tmall Group, which reported a 1% annual uptick in revenue to 98.99 billion yuan in the September quarter.
The results come at a tricky time for Chinese commerce businesses, given a tepid retail environment in the country. Chinese e-commerce group JD.com also missed revenue expectations on Thursday, according to Reuters.
Markets are now watching whether a slew of recent stimulus measures from Beijing, including a five-year 1.4 trillion yuan package announced last week, will help resuscitate the country’s growth and curtail a long-lived real estate market slump.
The impact on the retail space looks promising so far, with sales rising by a better-than-expected 4.8% year on year in October, while China’s recent Singles’ Day shopping holiday — widely seen as a barometer for national consumer sentiment — regained some of its luster.
Alibaba touted “robust growth” in gross merchandise volume — an industry measure of sales over time that does not equate to the company’s revenue — for its Taobao and Tmall Group businesses during the festival, along with a “record number of active buyers.”
“Alibaba’s outlook remains closely aligned with the trajectory of the Chinese economy and evolving regulatory policies,” ING analysts said Thursday, noting that the company’s Friday report will shed light on the Chinese economy’s growth momentum.
The e-commerce giant’s overseas online shopping businesses, such as Lazada and Aliexpress, meanwhile posted a 29% year-on-year hike in sales to 31.67 billion yuan.
Cloud business accelerates
Alibaba’s Cloud Intelligence Group reported year-on-year sales growth of 7% to 29.6 billion yuan in the September quarter, compared with a 6% annual hike in the three-month period ended in June. The slight acceleration comes amid ongoing efforts by the company to leverage its cloud infrastructure and reposition itself as a leader in the booming artificial intelligence space.
“Growth in our Cloud business accelerated from prior quarters, with revenues from public cloud products growing in double digits and AI-related product revenue delivering triple-digit growth. We are more confident in our core businesses than ever and will continue to invest in supporting long-term growth,” Alibaba CEO Eddie Wu said in a statement Friday.
Stymied by Beijing’s sweeping 2022 crackdown on large internet and tech companies, Alibaba last year overhauled the division’s leadership and has been shaping it as a future growth driver, stepping up competition with rivals including Baidu and Huawei domestically, and Microsoft and OpenAI in the U.S.
Alibaba, which rolled out its own ChatGPT-style product Tongyi Qianwen last year, this week unveiled its own AI-powered search tool for small businesses in Europe and the Americas, and clinched a key five-year partnership to supply cloud services to Indonesian tech giant GoTo in September.
Speaking at the Apsara Conference in September, Alibaba’s Wu said the company’s cloud unit is investing “with unprecedented intensity, in the research and development of AI technology and the building of its global infrastructure,” noting that the future of AI is “only beginning.”
Correction: This article has been updated to reflect that Alibaba’s Cloud Intelligence Group reported quarterly revenue of 29.6 billion yuan in the September quarter.
Elon Musk listens as US President-elect Donald Trump speaks during a House Republicans Conference meeting at the Hyatt Regency on Capitol Hill on November 13, 2024 in Washington, DC.
Allison Robbert | Getty Images
Elon Musk’s artificial intelligence company xAI is raising up to $6 billion at a $50 billion valuation, according to CNBC’s David Faber.
Sources told Faber that the funding, which should close early next week, is a combination of $5 billion expected from sovereign funds in the Middle East and $1 billion from other investors, some of whom may want to re-up their investments.
The money will be used to acquire 100,000 Nvidia chips, per sources familiar with the situation. Tesla‘s Full Self Driving is expected to rely on the new Memphis supercomputer.
Musk’s AI startup, which he announced in July 2023, seeks to “understand the true nature of the universe,” according to its website. Last November, X.AI released a chatbot called Grok, which the company said was modeled after “The Hitchhiker’s Guide to the Galaxy.” The chatbot debuted with two months of training and had real-time knowledge of the internet, the company claimed at the time.
With Grok, X.AI aims to directly compete with companies including ChatGPT creator OpenAI, which Musk helped start before a conflict with co-founder Sam Altman led him to depart the project in 2018. It will also be vying with Google’s Bard technology and Anthropic’s Claude chatbot.
Now that Donald Trump is President-elect, Elon Musk is beginning to actively work with the new administration on its approach to AI and tech more broadly, as part of Trump’s inner circle in recent weeks.
Trump plans to repeal President Biden’s executive order on AI, according to his campaign platform, stating that it “hinders AI Innovation, and imposes Radical Leftwing ideas on the development of this technology” and that “in its place, Republicans support AI Development rooted in Free Speech and Human Flourishing.”
Amazon logo on a brick building exterior, San Francisco, California, August 20, 2024.
Smith Collection | Gado | Archive Photos | Getty Images
Amazon representatives met with the House China committee in recent months to discuss lawmaker concerns over the company’s partnership with TikTok, CNBC confirmed.
A spokesperson for the House Select Committee on the Chinese Communist Party confirmed the meeting, which centered on a shopping deal between Amazon and TikTok announced in August. The agreement allows users of TikTok, owned by China’s ByteDance, to link their account with Amazon and make purchases from the site without leaving TikTok.
“The Select Committee conveyed to Amazon that it is dangerous and unwise for Amazon to partner with TikTok given the grave national security threat the app poses,” the spokesperson said. The parties met in September, according to Bloomberg, which first reported the news.
Representatives from Amazon and TikTok did not immediately respond to CNBC’s request for comment.
TikTok’s future viability in the U.S. is uncertain. In April, President Joe Biden signed a law that requires ByteDance to sell TikTok by Jan. 19. If TikTok fails to cut ties with its parent company, app stores and internet hosting services would be prohibited from offering the app.
President-elect Donald Trump could rescue TikTok from a potential U.S. ban. He promised on the campaign trail that he would “save” TikTok, and said in a March interview with CNBC’s “Squawk Box” that “there’s a lot of good and there’s a lot of bad” with the app.
In his first administration, Trump had tried to implement a TikTok ban. He changed his stance around the time he met with billionaire Jeff Yass. The Republican megadonor’s trading firm, Susquehanna International Group, owns a 15% stake in ByteDance, while Yass has a 7% stake in the company, NBC and CNBC reported in March.
— CNBC’s Jonathan Vanian contributed to this report.