OpenAI CEO Sam Altman speaks during the Microsoft Build conference at Microsoft headquarters in Redmond, Washington, on May 21, 2024.
Jason Redmond | AFP | Getty Images
A group of current and former OpenAI employees published an open letter Tuesday describing concerns about the artificial intelligence industry’s rapid advancement despite a lack of oversight and an absence of whistleblower protections for those who wish to speak up.
“AI companies have strong financial incentives to avoid effective oversight, and we do not believe bespoke structures of corporate governance are sufficient to change this,” the employees wrote in the open letter.
OpenAI, Google, Microsoft, Meta and other companies are at the helm of a generative AI arms race — a market that is predicted to top $1 trillion in revenue within a decade — as companies in seemingly every industry rush to add AI-powered chatbots and agents to avoid being left behind by competitors.
The current and former employees wrote AI companies have “substantial non-public information” about what their technology can do, the extent of the safety measures they’ve put in place and the risk levels that technology has for different types of harm.
“We also understand the serious risks posed by these technologies,” they wrote, adding that the companies “currently have only weak obligations to share some of this information with governments, and none with civil society. We do not think they can all be relied upon to share it voluntarily.”
The letter also details the current and former employees’ concerns about insufficient whistleblower protections for the AI industry, stating that without effective government oversight, employees are in a relatively unique position to hold companies accountable.
“Broad confidentiality agreements block us from voicing our concerns, except to the very companies that may be failing to address these issues,” the signatories wrote. “Ordinary whistleblower protections are insufficient because they focus on illegal activity, whereas many of the risks we are concerned about are not yet regulated.”
The letter asks AI companies to commit to not entering or enforcing non-disparagement agreements; to create anonymous processes for current and former employees to voice concerns to a company’s board, regulators and others; to support a culture of open criticism; and to not retaliate against public whistleblowing if internal reporting processes fail.
Four anonymous OpenAI employees and seven former ones, including Daniel Kokotajlo, Jacob Hilton, William Saunders, Carroll Wainwright and Daniel Ziegler, signed the letter. Signatories also included Ramana Kumar, who formerly worked at Google DeepMind, and Neel Nanda, who currently works at Google DeepMind and formerly worked at Anthropic. Three famed computer scientists known for advancing the artificial intelligence field also endorsed the letter: Geoffrey Hinton, Yoshua Bengio and Stuart Russell.
“We agree that rigorous debate is crucial given the significance of this technology and we’ll continue to engage with governments, civil society and other communities around the world,” an OpenAI spokesperson told CNBC, adding that the company has an anonymous integrity hotline, as well as a Safety and Security Committee led by members of the board and OpenAI leaders.
Microsoft declined to comment.
Mounting controversy for OpenAI
Last month, OpenAI backtracked on a controversial decision to make former employees choose between signing a non-disparagement agreement that would never expire, or keeping their vested equity in the company. The internal memo, viewed by CNBC, was sent to former employees and shared with current ones.
The memo, addressed to each former employee, said that at the time of the person’s departure from OpenAI, “you may have been informed that you were required to execute a general release agreement that included a non-disparagement provision in order to retain the Vested Units [of equity].”
“We’re incredibly sorry that we’re only changing this language now; it doesn’t reflect our values or the company we want to be,” an OpenAI spokesperson told CNBC at the time.
Tuesday’s open letter also follows OpenAI’s decision last month to disband its team focused on the long-term risks of AI just one year after the Microsoft-backed startup announced the group, a person familiar with the situation confirmed to CNBC at the time.
The person, who spoke on condition of anonymity, said some of the team members are being reassigned to multiple other teams within the company.
The team’s disbandment followed team leaders, OpenAI co-founder Ilya Sutskever and Jan Leike, announcing their departures from the startup last month. Leike wrote in a post on X that OpenAI’s “safety culture and processes have taken a backseat to shiny products.”
Ilya Sutskever, Russian Israeli-Canadian computer scientist and co-founder and Chief Scientist of OpenAI, speaks at Tel Aviv University in Tel Aviv on June 5, 2023.
Jack Guez | AFP | Getty Images
CEO Sam Altman said on X he was sad to see Leike leave and that the company had more work to do. Soon after, OpenAI co-founder Greg Brockman posted a statement attributed to himself and Altman on X, asserting that the company has “raised awareness of the risks and opportunities of AGI so that the world can better prepare for it.”
“I joined because I thought OpenAI would be the best place in the world to do this research,” Leike wrote on X. “However, I have been disagreeing with OpenAI leadership about the company’s core priorities for quite some time, until we finally reached a breaking point.”
Leike wrote he believes much more of the company’s bandwidth should be focused on security, monitoring, preparedness, safety and societal impact.
“These problems are quite hard to get right, and I am concerned we aren’t on a trajectory to get there,” he wrote. “Over the past few months my team has been sailing against the wind. Sometimes we were struggling for [computing resources] and it was getting harder and harder to get this crucial research done.”
Leike added that OpenAI must become a “safety-first AGI company.”
“Building smarter-than-human machines is an inherently dangerous endeavor,” he wrote. “OpenAI is shouldering an enormous responsibility on behalf of all of humanity. But over the past years, safety culture and processes have taken a backseat to shiny products.”
The high-profile departures come months after OpenAI went through a leadership crisis involving Altman.
In November, OpenAI’s board ousted Altman, saying in a statement that Altman had not been “consistently candid in his communications with the board.”
The issue seemed to grow more complex each day, with The Wall Street Journal and other media outlets reporting that Sutskever trained his focus on ensuring that artificial intelligence would not harm humans, while others, including Altman, were instead more eager to push ahead with delivering new technology.
Altman’s ouster prompted resignations or threats of resignations, including an open letter signed by virtually all of OpenAI’s employees, and uproar from investors, including Microsoft. Within a week, Altman was back at the company, and board members Helen Toner, Tasha McCauley and Ilya Sutskever, who had voted to oust Altman, were out. Sutskever stayed on staff at the time but no longer in his capacity as a board member. Adam D’Angelo, who had also voted to oust Altman, remained on the board.
American actress Scarlett Johansson at Cannes Film Festival 2023. Photocall of the film Asteroid City. Cannes (France), May 24th, 2023
Meanwhile, last month, OpenAI launched a new AI model and desktop version of ChatGPT, along with an updated user interface and audio capabilities, the company’s latest effort to expand the use of its popular chatbot. One week after OpenAI debuted the range of audio voices, the company announced it would pull one of the viral chatbot’s voices named “Sky.”
“Sky” created controversy for resembling the voice of actress Scarlett Johansson in “Her,” a movie about artificial intelligence. The Hollywood star has alleged that OpenAI ripped off her voice even though she declined to let them use it.
Lyft CEO David Risher poses for a portrait in New York City, U.S., April 16, 2025.
Kylie Cooper | Reuters
Lyft shares climbed 20% Friday after the ride-sharing company upped its share buyback plan and posted better-than-expected gross bookings.
During an interview with CNBC’s “Squawk Box,” CEO David Risher said that Lyft isn’t seeing “anything to worry about” despite widespread concerns of a slowing consumer amid ongoing economic uncertainty.
“Our team is stronger than it’s ever been, and the consumer demand is absolutely there,” he said.
Gross bookings grew 13% from a year ago to $4.16 billion, slightly beating a $4.15 billion estimate from StreetAccount. The company said the quarter was its 16th straight period of gross bookings growth.
Rides increased 16% to 218.4 million, topping a FactSet estimate of 215.1 million.
Read more CNBC tech news
Lyft’s revenues grew 14% during the first quarter from a year ago to $1.45 billion, but fell short of a $1.47 billion estimate from LSEG. The company reported net income of $2.57 million, or 1 cent per share. That’s up from a net loss of $31.54 million, or 8 cents per share, a year ago.
The board also authorized boosting Lyft’s share repurchase plan to $750 million from $500 million. The company said it aims to use $500 million over the next year.
Stock Chart IconStock chart icon
Lyft 5-day stock chart
Activist investor Engine Capital said Friday it would halt its campaign at Lyft and withdraw its nominations to the company’s board of directors, citing the share buyback news.
“Following a series of productive conversations, the Board has taken an important first step by committing to significant share repurchases in the coming quarters,” founder and portfolio manager Arnaud Ajdler said in a release.
Shares of ride-sharing competitor Uber declined earlier this week after posting mixed first-quarter results.
Goldman Sachs upgraded shares to a buy from a neutral rating following the report, citing rides and bookings growth and “strong execution in a stable industry backdrop.”
Another major player has entered the quantum-computing race: Amazon.
The tech giant is the latest to make waves in the field with the February announcement of Ocelot, its own quantum chip. Amazon joins fierce competition from familiar rivals in cloud computing as Google, Microsoft and others race after what they say could be their next frontier.
While Amazon is widely known as an e-commerce giant, its business took a pivotal and profitable turn in 2006 with the launch of Amazon Web Services. AWS is now a more than $100 billion business and a key part of why Amazon is worth over $2 trillion. The company sees quantum as the next major growth area for its cloud services.
“There’s a … strong business case for AWS or Amazon to get involved with quantum computing,” Oskar Painter, director of quantum hardware for Amazon Web Services, told CNBC. “Quantum computing is very much in line with that sort of business model where you would have off-premise quantum computing resources that can be made accessible through the cloud.”
Part of the hype with quantum computing is the perceived payoff down the line. While still years away from commercial applications, McKinsey projects quantum could be a $173 billion market by 2040.
“The opportunity to build just a supercharged part of AWS that can crack incredibly difficult problems, whether it’s related to drug discovery or cybersecurity … that is an opportunity for them to charge a lot more,” said Gene Munster, managing partner at Deepwater Asset Management.
CNBC’s Kate Rooney got an exclusive look inside the AWS Center for Quantum Computing located at the California Institute of Technology in Pasadena, California. Founded in 2019, Amazon’s partnership with the university is starting to yield results, as it showcased the Ocelot quantum processor. Amazon says the chip, which it designed and fabricated in-house, uses a scalable architecture that reduces error correction by up to 90 percent. That’s a key obstacle in developing these machines. Google’s Willow chip, which was unveiled in December, also demonstrated improvements in this area.
Ocelot uses “cat qubits,” named after the Schrödinger’s cat thought experiment. The company says the design intrinsically suppresses certain forms of errors, reducing the resources required for quantum error correction.
“The heart of these quantum computing systems … it’s really this quantum processor” Painter said. “The details of how that happens is really what differentiates one hardware platform from another – and really is where the secret sauce is and where all the intellectual property is.”
Munster said quantum-computing should be thought of as a new vertical within the AWS cloud business.
“In the end, it will probably be solved and monetized through one of these big cloud platforms,” Munster said. “And AWS has a great shot at being successful there.”
Watch the video as Kate Rooney goes behind-the-scenes at Amazon and learns how the company is taking on Google and Microsoft in the quantum computing race.
A logo hangs on the building of the Beijing branch of Semiconductor Manufacturing International Corporation (SMIC) on December 4, 2020 in Beijing, China.
After trading on Thursday, the company reported a first-quarter revenue of $2.24 billion, up about 28% from a year earlier. Meanwhile, profit attributable to shareholders surged 162% year on year to $188 million.
However, both figures missed LSEG mean estimates of $2.34 billion in revenue and $225.1 million in net income, as well as the company’s own forecasts.
During an earnings call Friday, an SMIC representative said the earnings missed original guidance due to“production fluctuations” which sent blended average selling prices falling. This impact is expected to extend into the second quarter, they added.
For the current quarter, the chipmaker forecasted revenue to fall 4% to 6% sequentially. Gross margin is also expected to fall within the range of 18% to 20%, compared to 22.5% in the first quarter.
Still, the first quarter saw SMIC’s wafer shipments increase by 15% from the previous quarter and by about 28% year-on-year.
In the earnings call, SMIC attributed that growth to customer shipment pull in, brought by changes in geopolitics and increased demand driven by government policies such as domestic trade-in programs and consumption subsidies.
In another positive sign for the company, its first-quarter capacity utilization— the percentage of total available manufacturing capacity that is being used at any given time— reached 89.6%, up 4.1% quarter on quarter.
“SMIC’s nearly 90% utilization rate reflects strong domestic demand for semiconductors, likely driven by smartphone and consumer electronics production,” said Ray Wang, a Washington-based semiconductor and technology analyst, adding that the demand was also reflected in the company’s strong quarterly revenue growth.
Meanwhile, the company said in the earnings call that it is “currently in an important period of capacity construction, roll out, and continuously increasing market share.”
However, SMIC’s first-quarter research and development spending decreased to $148.9 million, down from $217 million in the previous quarter.
Amid increased demand, it will be crucial for SMIC to continue ramping up their capacity, Simon Chen, principal analyst of semiconductor manufacturing at Informa Tech told CNBC.
SMIC generates most of its revenue from older-generation semiconductors, often referred to as “mature-node” or “legacy” chips, which are commonly found in consumer electronics and industrial equipment.
The state-backed chipmaker is critical to Beijing’s ambitions to build a self-sufficient semiconductor supply chain, with the government pumping billions into such efforts. Over 84% of its first-quarter revenue was derived from customers in China.
“The localization transformation of the supply chain has been strengthened, and more manufacturing demand has shifted back domestically,” a representative said Friday.
However, chip analysts say the chipmaker’s ability to increase capacity in advance chips — used in applications that demand higher levels of computing performance and efficiency at higher yields — is limited.
This is due to U.S.-led export controls, which prevent it from accessing some of the world’s most advanced chip-making equipment from the Netherlands-based ASML.
Nevertheless, the chipmaker appears to be making some breakthroughs. Advanced chips manufactured by SMIC have reportedly appeared in various Huawei products, notably in the Mate 60 Pro smartphone and some AI processors.
In the earnings call, the company also said it would closely monitor the potential impacts of the U.S.-China trade war on its demand, noting a lack of visibility for the second half of the year.
Phelix Lee, an equity analyst for Morningstar focused on semiconductors, told CNBC that the impacts of U.S. tariffs on SMIC are limited due to most of its revenue coming from Chinese customers.
While U.S. customers make up about 8-15% of revenue on a quarterly basis, the chips usually remain and are consumed in Chinese products and end users, he said.
“There could be some disruption to chemical, gas, and equipment supply; but the firm is working on alternatives in China and other non-U.S. regions,” he added.
SMIC’s Hong Kong-listed shares have gained over 32.23% year-to-date.