OpenAI CEO Sam Altman speaks during the Microsoft Build conference at Microsoft headquarters in Redmond, Washington, on May 21, 2024.
Jason Redmond | AFP | Getty Images
A group of current and former OpenAI employees published an open letter Tuesday describing concerns about the artificial intelligence industry’s rapid advancement despite a lack of oversight and an absence of whistleblower protections for those who wish to speak up.
“AI companies have strong financial incentives to avoid effective oversight, and we do not believe bespoke structures of corporate governance are sufficient to change this,” the employees wrote in the open letter.
OpenAI, Google, Microsoft, Meta and other companies are at the helm of a generative AI arms race — a market that is predicted to top $1 trillion in revenue within a decade — as companies in seemingly every industry rush to add AI-powered chatbots and agents to avoid being left behind by competitors.
The current and former employees wrote AI companies have “substantial non-public information” about what their technology can do, the extent of the safety measures they’ve put in place and the risk levels that technology has for different types of harm.
“We also understand the serious risks posed by these technologies,” they wrote, adding that the companies “currently have only weak obligations to share some of this information with governments, and none with civil society. We do not think they can all be relied upon to share it voluntarily.”
The letter also details the current and former employees’ concerns about insufficient whistleblower protections for the AI industry, stating that without effective government oversight, employees are in a relatively unique position to hold companies accountable.
“Broad confidentiality agreements block us from voicing our concerns, except to the very companies that may be failing to address these issues,” the signatories wrote. “Ordinary whistleblower protections are insufficient because they focus on illegal activity, whereas many of the risks we are concerned about are not yet regulated.”
The letter asks AI companies to commit to not entering or enforcing non-disparagement agreements; to create anonymous processes for current and former employees to voice concerns to a company’s board, regulators and others; to support a culture of open criticism; and to not retaliate against public whistleblowing if internal reporting processes fail.
Four anonymous OpenAI employees and seven former ones, including Daniel Kokotajlo, Jacob Hilton, William Saunders, Carroll Wainwright and Daniel Ziegler, signed the letter. Signatories also included Ramana Kumar, who formerly worked at Google DeepMind, and Neel Nanda, who currently works at Google DeepMind and formerly worked at Anthropic. Three famed computer scientists known for advancing the artificial intelligence field also endorsed the letter: Geoffrey Hinton, Yoshua Bengio and Stuart Russell.
“We agree that rigorous debate is crucial given the significance of this technology and we’ll continue to engage with governments, civil society and other communities around the world,” an OpenAI spokesperson told CNBC, adding that the company has an anonymous integrity hotline, as well as a Safety and Security Committee led by members of the board and OpenAI leaders.
Microsoft declined to comment.
Mounting controversy for OpenAI
Last month, OpenAI backtracked on a controversial decision to make former employees choose between signing a non-disparagement agreement that would never expire, or keeping their vested equity in the company. The internal memo, viewed by CNBC, was sent to former employees and shared with current ones.
The memo, addressed to each former employee, said that at the time of the person’s departure from OpenAI, “you may have been informed that you were required to execute a general release agreement that included a non-disparagement provision in order to retain the Vested Units [of equity].”
“We’re incredibly sorry that we’re only changing this language now; it doesn’t reflect our values or the company we want to be,” an OpenAI spokesperson told CNBC at the time.
Tuesday’s open letter also follows OpenAI’s decision last month to disband its team focused on the long-term risks of AI just one year after the Microsoft-backed startup announced the group, a person familiar with the situation confirmed to CNBC at the time.
The person, who spoke on condition of anonymity, said some of the team members are being reassigned to multiple other teams within the company.
The team’s disbandment followed team leaders, OpenAI co-founder Ilya Sutskever and Jan Leike, announcing their departures from the startup last month. Leike wrote in a post on X that OpenAI’s “safety culture and processes have taken a backseat to shiny products.”
Ilya Sutskever, Russian Israeli-Canadian computer scientist and co-founder and Chief Scientist of OpenAI, speaks at Tel Aviv University in Tel Aviv on June 5, 2023.
Jack Guez | AFP | Getty Images
CEO Sam Altman said on X he was sad to see Leike leave and that the company had more work to do. Soon after, OpenAI co-founder Greg Brockman posted a statement attributed to himself and Altman on X, asserting that the company has “raised awareness of the risks and opportunities of AGI so that the world can better prepare for it.”
“I joined because I thought OpenAI would be the best place in the world to do this research,” Leike wrote on X. “However, I have been disagreeing with OpenAI leadership about the company’s core priorities for quite some time, until we finally reached a breaking point.”
Leike wrote he believes much more of the company’s bandwidth should be focused on security, monitoring, preparedness, safety and societal impact.
“These problems are quite hard to get right, and I am concerned we aren’t on a trajectory to get there,” he wrote. “Over the past few months my team has been sailing against the wind. Sometimes we were struggling for [computing resources] and it was getting harder and harder to get this crucial research done.”
Leike added that OpenAI must become a “safety-first AGI company.”
“Building smarter-than-human machines is an inherently dangerous endeavor,” he wrote. “OpenAI is shouldering an enormous responsibility on behalf of all of humanity. But over the past years, safety culture and processes have taken a backseat to shiny products.”
The high-profile departures come months after OpenAI went through a leadership crisis involving Altman.
In November, OpenAI’s board ousted Altman, saying in a statement that Altman had not been “consistently candid in his communications with the board.”
The issue seemed to grow more complex each day, with The Wall Street Journal and other media outlets reporting that Sutskever trained his focus on ensuring that artificial intelligence would not harm humans, while others, including Altman, were instead more eager to push ahead with delivering new technology.
Altman’s ouster prompted resignations or threats of resignations, including an open letter signed by virtually all of OpenAI’s employees, and uproar from investors, including Microsoft. Within a week, Altman was back at the company, and board members Helen Toner, Tasha McCauley and Ilya Sutskever, who had voted to oust Altman, were out. Sutskever stayed on staff at the time but no longer in his capacity as a board member. Adam D’Angelo, who had also voted to oust Altman, remained on the board.
American actress Scarlett Johansson at Cannes Film Festival 2023. Photocall of the film Asteroid City. Cannes (France), May 24th, 2023
Meanwhile, last month, OpenAI launched a new AI model and desktop version of ChatGPT, along with an updated user interface and audio capabilities, the company’s latest effort to expand the use of its popular chatbot. One week after OpenAI debuted the range of audio voices, the company announced it would pull one of the viral chatbot’s voices named “Sky.”
“Sky” created controversy for resembling the voice of actress Scarlett Johansson in “Her,” a movie about artificial intelligence. The Hollywood star has alleged that OpenAI ripped off her voice even though she declined to let them use it.
With valuations in the U.S. stock market becoming increasingly stretched, the chief executive of Southeast Asia’s largest bank is warning investors to expect turbulence ahead.
“We’ve seen a lot of volatility in the markets. It could be equities, it could be rates, it could be foreign exchange,” DBS CEO Tan Su Shan told CNBC, adding that she expects that volatility to continue.
Tan, who took over the helm of DBS from longtime CEO Piyush Gupta in March, said that investors were particularly worried about the lofty valuations of artificial intelligence stocks, especially the so-called “Magnificent Seven.”
The Magnificent Seven — Amazon, Alphabet, Meta, Apple, Microsoft, Nvidia and Tesla — are some of the major U.S. tech and growth stocks that have driven much of Wall Street’s gains in recent years.
“You’ve got trillions of dollars tied up in seven stocks, for example. So it’s inevitable, with that kind of concentration, that there will be a worry about. ‘You know, when will this bubble burst?'”
Earlier this week, at the Global Financial Leaders’ Investment Summit in Hong Kong, it was likely there would be a 10%-20% drawdown over the next 12 to 24 months.
Morgan Stanley CEO Ted Pick said at the same summit that investors should welcome periodic pullbacks, calling them healthy developments rather than signs of crisis.
Tan agreed. “Frankly, a correction will be healthy,” she said.
Tan advised investors to diversify rather than concentrate holdings in one market. “Whether it’s in your portfolio, in your supply chain, or in your demand distribution, just diversify.”
Tan, who has over 35 years of experience in banking and wealth management, noted that Asia could attract more investment from the U.S.—and that it’s not a bad thing.
Singling out Singapore and the country’s central bank’s efforts to boost interest in the local markets, Tan described the city-state as a “diversifier market.”
“We’ve got rule of law. We’re a transparent, open financial system and stable politically. We’re a good place to invest…. So I don’t think we’re a bad place to think about diversifying your investments.”
Tesla CEO Elon Musk attends the Saudi-U.S. Investment Forum, in Riyadh, Saudi Arabia, May 13, 2025.
Hamad I Mohammed | Reuters
Tesla CEO Elon Musk says the company will likely need to build a “gigantic” semiconductor fabrication plant to keep up with its artificial intelligence and robotics ambitions.
“One of the things I’m trying to figure out is — how do we make enough chips?” Musk said at Tesla’s annual shareholders meeting Thursday.
“But even when we extrapolate the best-case scenario for chip production from our suppliers, it’s still not enough,” he said.
Tesla would probably need to build a “gigantic” chip fab, which Musk described as a “Tesla terra fab.” “I can’t see any other way to get to the volume of chips that we’re looking for.”
Microchips are the brains that power almost all modern technologies, including everything from consumer electronics like smartphones to massive data centers, and demand for them has been surging amid the AI boom.
Tech giants, including Tesla, have been clamoring for more supply from chipmakers like TSMC — the world’s largest and most advanced chipmaker.
According to Musk, Tesla’s potential fab’s initial capacity would reach 100,000 wafer starts per month and eventually scale up to 1 million. In the semiconductor industry, wafer starts per month is a measure of how many new chips a fab produces each month.
For comparison, TSMC says its annual wafer production capacity reached 17 million in 2024, or around 1.42 million wafer starts per month.
While Tesla doesn’t yet manufacture its own microchips, the company has been designing custom chips for autonomous driving for several years.
It is currently outsourcing production of its latest-generation “AI5” chip, which Musk said will be cheaper, power-efficient, and optimized for Tesla’s AI software.
The CEO also announced on Thursday that Tesla will begin producing its Cybercab — an autonomous electric vehicle with no pedals or steering wheel — in April.
Musk’s statements underscore Tesla’s shift into AI and robotics — industries the CEO sees as the future of the global economy.
“With AI and robotics, you can actually increase the global economy by a factor of 10, or maybe 100. There’s not, like, an obvious limit,” Musk said at the shareholder meeting.
Traders works on the floor of the New York Stock Exchange.
NYSE
October’s job losses in the U.S. were nearly twice as high as a month earlier — the steepest for any October since 2003, data from outplacement firm Challenger, Gray & Christmas showed.
The technology sector was the hardest hit, with 33,281 cuts, almost six times September’s total.
Being laid off is an awful feeling — and it must feel bitterly ironic to work in a field that’s developing the very technology making you redundant.
One person spared both redundancy fears and existential doubt is Tesla CEO Elon Musk, who just had a nearly $1 trillion pay package approved by Tesla shareholders.
To earn the full trillion, though, Musk has to meet a chain of performance targets, culminating in Tesla reaching an $8.5 trillion valuation.
Its market cap is currently $1.54 trillion — by contrast, the world’s most valuable company now is Nvidia, which briefly hit a $5 trillion valuation last Wednesday.
After Thursday’s slump in tech stocks, however, Nvidia’s market cap has dipped to a “mere” $4.57 trillion.
For most tech workers and investors, Thursday was another reminder of volatility’s sting. For Elon Musk, it was just another day on the road to the stratosphere.
What you need to know today
And finally…
A panoramic view of Riyadh, Saudi Arabia.
Alessio Gaggioli Photography | Moment | Getty Images
After raking in trillions of dollars in oil revenue, the Gulf monarchies have become known for splashing cash on big-ticket projects like sci-fi-worthy cities in the desert, major sports franchises, and advanced military hardware.
Now, though, as they face prolonged lower crude prices, some of the region’s leaders are looking at leveraging their vast sovereign capital to build domestic artificial intelligence industries.
