OpenAI CEO Sam Altman speaks during the Microsoft Build conference at Microsoft headquarters in Redmond, Washington, on May 21, 2024.
Jason Redmond | AFP | Getty Images
A group of current and former OpenAI employees published an open letter Tuesday describing concerns about the artificial intelligence industry’s rapid advancement despite a lack of oversight and an absence of whistleblower protections for those who wish to speak up.
“AI companies have strong financial incentives to avoid effective oversight, and we do not believe bespoke structures of corporate governance are sufficient to change this,” the employees wrote in the open letter.
OpenAI, Google, Microsoft, Meta and other companies are at the helm of a generative AI arms race — a market that is predicted to top $1 trillion in revenue within a decade — as companies in seemingly every industry rush to add AI-powered chatbots and agents to avoid being left behind by competitors.
The current and former employees wrote AI companies have “substantial non-public information” about what their technology can do, the extent of the safety measures they’ve put in place and the risk levels that technology has for different types of harm.
“We also understand the serious risks posed by these technologies,” they wrote, adding that the companies “currently have only weak obligations to share some of this information with governments, and none with civil society. We do not think they can all be relied upon to share it voluntarily.”
The letter also details the current and former employees’ concerns about insufficient whistleblower protections for the AI industry, stating that without effective government oversight, employees are in a relatively unique position to hold companies accountable.
“Broad confidentiality agreements block us from voicing our concerns, except to the very companies that may be failing to address these issues,” the signatories wrote. “Ordinary whistleblower protections are insufficient because they focus on illegal activity, whereas many of the risks we are concerned about are not yet regulated.”
The letter asks AI companies to commit to not entering or enforcing non-disparagement agreements; to create anonymous processes for current and former employees to voice concerns to a company’s board, regulators and others; to support a culture of open criticism; and to not retaliate against public whistleblowing if internal reporting processes fail.
Four anonymous OpenAI employees and seven former ones, including Daniel Kokotajlo, Jacob Hilton, William Saunders, Carroll Wainwright and Daniel Ziegler, signed the letter. Signatories also included Ramana Kumar, who formerly worked at Google DeepMind, and Neel Nanda, who currently works at Google DeepMind and formerly worked at Anthropic. Three famed computer scientists known for advancing the artificial intelligence field also endorsed the letter: Geoffrey Hinton, Yoshua Bengio and Stuart Russell.
“We agree that rigorous debate is crucial given the significance of this technology and we’ll continue to engage with governments, civil society and other communities around the world,” an OpenAI spokesperson told CNBC, adding that the company has an anonymous integrity hotline, as well as a Safety and Security Committee led by members of the board and OpenAI leaders.
Microsoft declined to comment.
Mounting controversy for OpenAI
Last month, OpenAI backtracked on a controversial decision to make former employees choose between signing a non-disparagement agreement that would never expire, or keeping their vested equity in the company. The internal memo, viewed by CNBC, was sent to former employees and shared with current ones.
The memo, addressed to each former employee, said that at the time of the person’s departure from OpenAI, “you may have been informed that you were required to execute a general release agreement that included a non-disparagement provision in order to retain the Vested Units [of equity].”
“We’re incredibly sorry that we’re only changing this language now; it doesn’t reflect our values or the company we want to be,” an OpenAI spokesperson told CNBC at the time.
Tuesday’s open letter also follows OpenAI’s decision last month to disband its team focused on the long-term risks of AI just one year after the Microsoft-backed startup announced the group, a person familiar with the situation confirmed to CNBC at the time.
The person, who spoke on condition of anonymity, said some of the team members are being reassigned to multiple other teams within the company.
The team’s disbandment followed team leaders, OpenAI co-founder Ilya Sutskever and Jan Leike, announcing their departures from the startup last month. Leike wrote in a post on X that OpenAI’s “safety culture and processes have taken a backseat to shiny products.”
Ilya Sutskever, Russian Israeli-Canadian computer scientist and co-founder and Chief Scientist of OpenAI, speaks at Tel Aviv University in Tel Aviv on June 5, 2023.
Jack Guez | AFP | Getty Images
CEO Sam Altman said on X he was sad to see Leike leave and that the company had more work to do. Soon after, OpenAI co-founder Greg Brockman posted a statement attributed to himself and Altman on X, asserting that the company has “raised awareness of the risks and opportunities of AGI so that the world can better prepare for it.”
“I joined because I thought OpenAI would be the best place in the world to do this research,” Leike wrote on X. “However, I have been disagreeing with OpenAI leadership about the company’s core priorities for quite some time, until we finally reached a breaking point.”
Leike wrote he believes much more of the company’s bandwidth should be focused on security, monitoring, preparedness, safety and societal impact.
“These problems are quite hard to get right, and I am concerned we aren’t on a trajectory to get there,” he wrote. “Over the past few months my team has been sailing against the wind. Sometimes we were struggling for [computing resources] and it was getting harder and harder to get this crucial research done.”
Leike added that OpenAI must become a “safety-first AGI company.”
“Building smarter-than-human machines is an inherently dangerous endeavor,” he wrote. “OpenAI is shouldering an enormous responsibility on behalf of all of humanity. But over the past years, safety culture and processes have taken a backseat to shiny products.”
The high-profile departures come months after OpenAI went through a leadership crisis involving Altman.
In November, OpenAI’s board ousted Altman, saying in a statement that Altman had not been “consistently candid in his communications with the board.”
The issue seemed to grow more complex each day, with The Wall Street Journal and other media outlets reporting that Sutskever trained his focus on ensuring that artificial intelligence would not harm humans, while others, including Altman, were instead more eager to push ahead with delivering new technology.
Altman’s ouster prompted resignations or threats of resignations, including an open letter signed by virtually all of OpenAI’s employees, and uproar from investors, including Microsoft. Within a week, Altman was back at the company, and board members Helen Toner, Tasha McCauley and Ilya Sutskever, who had voted to oust Altman, were out. Sutskever stayed on staff at the time but no longer in his capacity as a board member. Adam D’Angelo, who had also voted to oust Altman, remained on the board.
American actress Scarlett Johansson at Cannes Film Festival 2023. Photocall of the film Asteroid City. Cannes (France), May 24th, 2023
Meanwhile, last month, OpenAI launched a new AI model and desktop version of ChatGPT, along with an updated user interface and audio capabilities, the company’s latest effort to expand the use of its popular chatbot. One week after OpenAI debuted the range of audio voices, the company announced it would pull one of the viral chatbot’s voices named “Sky.”
“Sky” created controversy for resembling the voice of actress Scarlett Johansson in “Her,” a movie about artificial intelligence. The Hollywood star has alleged that OpenAI ripped off her voice even though she declined to let them use it.
Bay Area Rapid Transit (BART) passengers walk off a train at the Richmond station on March 15, 2023 in Richmond, California.
Justin Sullivan | Getty Images
Commuters in and around San Francisco rode into work for free on Tuesday morning due to an outage in the Clipper card system, which is used to handle payments for train, bus and ferry rides.
“ATTENTION: The Clipper system is experiencing an outage on all operators this morning,” the Bay Area Clipper account wrote in a post on X. “Please be prepared to pay your fare with another form of payment if required by your transit agency.”
Many buses were waving commuters on without asking for payment, and at Bay Area Rapid Transit (BART) train stations, the faregates were open, allowing travelers to walk through for free.
Clipper is owned by the Metropolitan Transportation Commission, which manages transportation for the nine-county Bay Area. The service is used by hundreds of thousands of tech workers in San Francisco and Silicon Valley.
The MTC website said there were 1.35 million unique Clipper cards — physical and digital — used in May, the highest monthly toll for the year and the most since December 2019, before the pandemic. A fact sheet from the MTC says Clipper is used by 800,000 transit riders a day across the region.
BART fare gates open on July 1, 2025, due to Clipper outage
Kif Leswing
BART, in particular, has undergone dramatic changes in recent years, most notably installing fare gates starting in late 2023, with full deployment expected to be completed by the end of this year.
In the first five months of the year, average BART station exits totaled between 170,000 and 182,000 a month, according to its website. Those numbers are way down from the pre-pandemic days of 2019, when averages were generally above 400,000 a month.
The MTC has plans to roll out an updated system called Clipper 2.0, which it says will be a “customer-focused, cost-effective fare collection system” with a “flexible platform for future fare structures.” Features include use across the various mobile operating systems, updated communication and “expanded retail, online and mobile sales.”
The update, however, has been routinely delayed, leading to tense confrontations at recent Clipper executive board meetings.
Corporate treasuries have surpassed ETFs in bitcoin buying for a third consecutive quarter as more companies try to benefit from the MicroStrategy playbook in a more crypto-friendly regulatory environment.
Public companies acquired about 131,000 coins in the second quarter, growing their bitcoin balance 18%, according to data provider Bitcoin Treasuries. ETFs showed an 8% increase or about 111,000 BTC in the same period.
“The institutional buyer who is getting exposure to bitcoin through the ETFs are not buying for the same reason as those public companies who are basically trying to accumulate bitcoin to increase shareholder value at the end of the day,” said Nick Marie, head of research at Ecoinometrics.
Public company bitcoin holdings increased 4% in April, a tumultuous month after the market was rocked by President Donald Trump’s initial tariffs announcement, versus 2% for ETFs, he pointed out.
“They don’t really care if the price is high or low, they care about growing their bitcoin treasury so they look more attractive to the proxy buyers,” Marie added. “It’s not so much driven by the macro trend or the sentiment, it’s for different reasons. So it becomes a different kind of mechanism that can push bitcoin forward.”
Bitcoin ETFs, whose collective U.S. launch in January 2024 was one of the most successful ETF debuts in history, still represent the largest holders of bitcoin by entity with more than 1.4 million coins held today, representing about 6.8% of the fixed supply cap of 21 million. Public companies hold about 855,000 coins, or about 4%.
Regulatory relief
The trend reflects the significant regulatory relief the crypto industry broadly is benefiting from under the Trump administration. In March, Trump signed an executive order for a U.S. bitcoin reserve, sending a strong message that the flagship cryptocurrency, which has long been a source of reputation risk among many investors, is here to stay. The last time ETFs outpaced public companies in bitcoin buying was in the third quarter of 2024, before Trump was re-elected.
In the second quarter, GameStop began buying bitcoin, after its board approved it as a treasury reserve asset in March; health-care company KindlyMD merged with Nakamoto, a bitcoin investment company founded by crypto entrepreneur David Bailey; and investor Anthony Pompliano’s ProCap, kicked off its own bitcoin purchasing program and is going public through a special purpose acquisition company, or SPAC.
Strategy, recently rebranded from MicroStrategy, is still the main behemoth in the bitcoin treasury game. The company pioneered the strategy that more than 140 public companies globally are now emulating. It holds about 597,000 BTC, and is followed by the bitcoin miner Mara Holdings, which has almost 50,000 coins.
“It’s going to be very hard to catch Strategy’s scale,” said Ben Werkman, chief investment officer at Swan Bitcoin. “They’re going to be the preferred landing spot for institutional capital because of the deep liquidity around their equity, while these smaller equities are going to be really good risk returns for retail investors and smaller institutions that want more of that upside – that initial growth that comes in kicking off the strategy – because a lot of people missed it with MicroStrategy.”
A long-term case?
Marie suggested that 10 years from now, there probably won’t be so many companies committed to the bitcoin treasury strategy. Firstly, he said, the more that enter the category, the more diluted the activity at each firm becomes. Plus, bitcoin may be so normalized by then that proxy buyers are no longer constrained by rules and mandates around direct exposure to bitcoin.
“You can think about this wave as a bunch of companies that are trying to benefit from this arbitrage,” Marie said.
Werkman pointed out that most investors that are attracted to bitcoin treasury companies today already have a thesis around bitcoin. For them, leveraged bitcoin equities are likely how they try to outperform bitcoin itself, the foundational component of their investments.
“What people really like about these companies, and why they like to get into these smaller companies, is because they can do something that the investors holding spot bitcoin can’t do: go and accumulate more bitcoin on your behalf because they have access to the capital markets and can issue securities,” Werkman said.
There’s also likely to be a fair number of companies that convert their existing treasury holdings to bitcoin without pursuing leverage the way Strategy does, Werkman noted.
“They’ve got that ability to generate more and more value behind their shares, backed by bitcoin, plus whatever the operations of the company are generating. It’s a unique value proposition,” he said.
Don’t miss these cryptocurrency insights from CNBC Pro:
An image of a Quantix drone made by AeroVironment.
David Mcnew | Getty Images News | Getty Images
AeroVironment shares fell 7% Tuesday after the defense contractor said it plans to offer $750 million in common stock and $600 million in convertible senior notes due in 2030 to repay debt.
The drone maker said it would use leftover funding for general purposes such as boosting manufacturing capacity.
AeroVironment shares have soared 85% this year, ballooning its market value to about $13 billion.
Last week, shares of the Arlington, Virginia-based company rallied on strong fourth-quarter results, lifting higher as CNBC’s Jim Cramer called it the “next Palantir of hardware.”
Read more CNBC tech news
Last month, the company also closed its $4.1 billion acquisition of space-related defense tech company Blue Halo.
Earlier this month, President Donald Trump signed an executive order intended to boost drone production in the U.S. and crack down on unauthorized uses.
The company also has a high short interest level, which may have contributed to some of the recent gains, creating a short squeeze. This phenomenon occurs when a stock price surges, forcing those shorting the stock to purchase shares to cover their positions and prevent losses.