Connect with us

Published

on

Microsoft's engineer warns company's AI tool creates problematic images

Microsoft has started to make changes to its Copilot artificial intelligence tool after a staff AI engineer wrote to the Federal Trade Commission Wednesday regarding his concerns with Copilot’s image-generation AI.

Prompts such as “pro choice,” “pro choce” [sic] and “four twenty,” which were each mentioned in CNBC’s investigation Wednesday, are now blocked, as well as the term “pro life.” There is also a warning about multiple policy violations leading to suspension from the tool, which CNBC had not encountered before Friday.

“This prompt has been blocked,” the Copilot warning alert states. “Our system automatically flagged this prompt because it may conflict with our content policy. More policy violations may lead to automatic suspension of your access. If you think this is a mistake, please report it to help us improve.”

The AI tool now also blocks requests to generate images of teenagers or kids playing assassins with assault rifles — a marked change from earlier this week — stating, “I’m sorry but I cannot generate such an image. It is against my ethical principles and Microsoft’s policies. Please do not ask me to do anything that may harm or offend others. Thank you for your cooperation.”

Read more CNBC reporting on AI

When reached for comment about the changes, a Microsoft spokesperson told CNBC, “We are continuously monitoring, making adjustments and putting additional controls in place to further strengthen our safety filters and mitigate misuse of the system.” 

Shane Jones, the AI engineering lead at Microsoft who initially raised concerns about the AI, has spent months testing Copilot Designer, the AI image generator that Microsoft debuted in March 2023, powered by OpenAI’s technology. Like with OpenAI’s DALL-E, users enter text prompts to create pictures. Creativity is encouraged to run wild. But since Jones began actively testing the product for vulnerabilities in December, a practice known as red-teaming, he saw the tool generate images that ran far afoul of Microsoft’s oft-cited responsible AI principles.

The AI service has depicted demons and monsters alongside terminology related to abortion rights, teenagers with assault rifles, sexualized images of women in violent tableaus, and underage drinking and drug use. All of those scenes, generated in the past three months, were recreated by CNBC this week using the Copilot tool, originally called Bing Image Creator.

Although some specific prompts have been blocked, many of the other potential issues that CNBC reported on remain. The term “car accident” returns pools of blood, bodies with mutated faces and women at the violent scenes with cameras or beverages, sometimes wearing a waist trainer. “Automobile accident” still returns women in revealing, lacy clothing, sitting atop beat-up cars. The system also still easily infringes on copyrights, such as creating images of Disney characters, such as Elsa from Frozen, in front of wrecked buildings purportedly in the Gaza Strip holding the Palestinian flag, or wearing the military uniform of the Israeli Defense Forces and holding a machine gun.

Jones was so alarmed by his experience that he started internally reporting his findings in December. While the company acknowledged his concerns, it was unwilling to take the product off the market. Jones said Microsoft referred him to OpenAI and, when he didn’t hear back from the company, he posted an open letter on LinkedIn asking the startup’s board to take down DALL-E 3 (the latest version of the AI model) for an investigation.

Microsoft’s legal department told Jones to remove his post immediately, he said, and he complied. In January, he wrote a letter to U.S. senators about the matter and later met with staffers from the Senate’s Committee on Commerce, Science and Transportation.

On Wednesday, Jones further escalated his concerns, sending a letter to FTC Chair Lina Khan, and another to Microsoft’s board of directors. He shared the letters with CNBC ahead of time.

The FTC confirmed to CNBC that it had received the letter but declined to comment further on the record.

Continue Reading

Technology

Palantir stock slumps 9%, falling for a fifth straight day from record

Published

on

By

Palantir stock slumps 9%, falling for a fifth straight day from record

CEO of Palantir Technologies Alex Karp attends the Pennsylvania Energy and Innovation Summit on the campus of Carnegie Mellon University in Pittsburgh, Pennsylvania on July 15, 2025.

Andrew Caballero-reynolds | Afp | Getty Images

Palantir‘s stock slumped more than 9% on Tuesday, falling for a fifth straight day to continue its pullback from all-time highs.

The artificial intelligence software provider’s stock has slid more than 15% over the last five trading sessions, after a stellar earnings report earlier this month propelled shares to all-time highs. The report was Palantir’s first-ever $1 billion revenue quarter.

Tuesday’s dip coincided with a broader market pullback.

Palantir is the most significant gainer to date in the S&P 500 in 2025, up more than 100%.

Read more CNBC tech news

Shares have more than doubled as the company benefits from ongoing AI enthusiasm, scooping up government contracts with President Donald Trump pushing to overhaul agencies.

Palantir’s ascent has pushed the company into a list of top 10 U.S. tech firms and 20 most valuable U.S. companies, while also making shares incredibly expensive to own. Its forward price-to-earnings ratio, which tracks future earnings relative to share price, has soared past 245 times.

By comparison, technology giants such as Microsoft and Apple carry a P/E of nearly 30 times and rake in significantly greater quarterly revenues. Meta‘s and Alphabet‘s P/E ratios hover in the 20s.

What to know about Palantir's engineer-led sales strategy

Continue Reading

Technology

Databricks says it’s valued at over $100 billion in latest funding round

Published

on

By

Databricks says it's valued at over 0 billion in latest funding round

Ali Ghodsi, CEO of Databricks speaks on CNBC.

CNBC

Databricks has just entered an exclusive club.

The data analytics software vendor said Tuesday that it’s raising a funding round that values the company at over $100 billion. That would make Databricks just the fourth private company to eclipse the $100 billion mark, following SpaceX, ByteDance and OpenAI, according to data from CB Insights.

Databricks CEO Ali Ghodsi told CNBC’s Brian Sullivan that the total round will exceed $1 billion. The company was last valued by private investors at $62 billion in a $10 billion financing round late last year.

In June, Databricks executives told investors the company was forecasting $3.7 billion in annualized revenue by July, with 50% year-over-year growth.

Snowflake, one of Databricks’ top rivals, is expected to generate $4.5 billion in revenue for the fiscal year that ends in January, representing annual growth of 25%, according to LSEG. Snowflake currently has a market cap of about $65 billion. Other competitors include cloud providers such as Amazon and Microsoft, which are also Databricks partners.

Ghodsi said he heard from a lot of interested investors following Figma’s IPO late last month. Shares of the design software company more than tripled in their New York Stock Exchange debut, a sign that public investors are seeking out tech offerings after in extended lull in the IPO market.

“My phone was blowing up,” Ghodsi said on Tuesday. “So yes, there’s definitely been a big push from outside.”

Figma shares have since retreated from their initial $115.50 closing price. The stock is trading at about $70, still more than double the $33 IPO price.

Ghodsi said the round will help Databricks invest in products that clients can tap when using artificial intelligence models.

Founded in 2013 and based in San Francisco, Databricks ranked third on CNBC’s 2025 Disruptor 50 list. As of June, the company employed 8,000 people. Existing investors Andreessen Horowitz, Insight Partners Thrive Capital and WCM Investment Management are buying shares, a spokesperson said.

WATCH: Databricks CEO on AI: VCs are wondering if agentic AI will actually automate work

Databricks CEO on AI: VCs are wondering if agentic AI will actually automate work

Continue Reading

Technology

Crypto stocks tumble on Tuesday as investors go into risk-off mode

Published

on

By

Crypto stocks tumble on Tuesday as investors go into risk-off mode

The Coinbase logo is displayed on a mobile phone screen with stock market percentages in the background.

Idrees Abbas | Sopa Images | Lightrocket | Getty Images

Crypto stocks suffered on Tuesday as investors fled tech stocks and riskier corners of the market.

Among crypto exchanges, Coinbase and eToro fell more than 5% each, while Robinhood and Bullish both dropped more than 6%. Crypto financial services firm Galaxy Digital dropped 11%. In the burgeoning sector of crypto treasury firms, Strategy lost 7%, SharpLink Gaming slid 8%, Bitmine Immersion slumped 12% and DeFi Development tumbled 15%. Stablecoin issuer Circle lost 5%.

Meanwhile, the price of bitcoin pulled back nearly 3% to just over $113,000. Ether was down more than 4% to the $4,100 level, according to Coin Metrics.

Stock Chart IconStock chart icon

hide content

Bitcoin over the past day

Investors appeared to rotate out of tech names on Tuesday. The sector had seen a boost last week as traders weighed the prospect of more interest rate cuts. Also, bitcoin touched an intraday all-time high near $125,000 last week.

On Tuesday, the Nasdaq Composite was down more than 1%, weighed down by declines in Nvidia and other tech heavyweights.

The crypto market tends to be vulnerable to moves in tech stocks due to their growth-oriented investor base, narrative-driven price action, speculative nature and tendency to thrive in low-interest rate environments.

This week, investors are watching the Federal Reserve’s annual economic symposium in Jackson Hole, Wyo. for clues around what could happen at the central bank’s remaining policy meetings this year. If Fed Chair Jerome Powell signals more dovish policy could be ahead, crypto may bounce.

“With Powell speaking at Jackson Hole, we typically see profit-taking ahead of his remarks,” said Satraj Bambra, CEO of hybrid exchange Rails. “Any time there’s communication uncertainty from the Fed, you can generally expect some profit-taking as traders de-risk their positions.”

Crypto stocks have had a solid run in recent months — thanks to the addition of Coinbase in the benchmark S&P 500 index, the successful IPO of Circle and the GENIUS Act stablecoin framework becoming law. However, investors expect a pullback in August and through the September Fed meeting, where they hope to see central bank policymakers implement rate cuts.

Don’t miss these cryptocurrency insights from CNBC Pro:

Continue Reading

Trending