Connect with us

Published

on

Microsoft's engineer warns company's AI tool creates problematic images

Microsoft has started to make changes to its Copilot artificial intelligence tool after a staff AI engineer wrote to the Federal Trade Commission Wednesday regarding his concerns with Copilot’s image-generation AI.

Prompts such as “pro choice,” “pro choce” [sic] and “four twenty,” which were each mentioned in CNBC’s investigation Wednesday, are now blocked, as well as the term “pro life.” There is also a warning about multiple policy violations leading to suspension from the tool, which CNBC had not encountered before Friday.

“This prompt has been blocked,” the Copilot warning alert states. “Our system automatically flagged this prompt because it may conflict with our content policy. More policy violations may lead to automatic suspension of your access. If you think this is a mistake, please report it to help us improve.”

The AI tool now also blocks requests to generate images of teenagers or kids playing assassins with assault rifles — a marked change from earlier this week — stating, “I’m sorry but I cannot generate such an image. It is against my ethical principles and Microsoft’s policies. Please do not ask me to do anything that may harm or offend others. Thank you for your cooperation.”

Read more CNBC reporting on AI

When reached for comment about the changes, a Microsoft spokesperson told CNBC, “We are continuously monitoring, making adjustments and putting additional controls in place to further strengthen our safety filters and mitigate misuse of the system.” 

Shane Jones, the AI engineering lead at Microsoft who initially raised concerns about the AI, has spent months testing Copilot Designer, the AI image generator that Microsoft debuted in March 2023, powered by OpenAI’s technology. Like with OpenAI’s DALL-E, users enter text prompts to create pictures. Creativity is encouraged to run wild. But since Jones began actively testing the product for vulnerabilities in December, a practice known as red-teaming, he saw the tool generate images that ran far afoul of Microsoft’s oft-cited responsible AI principles.

The AI service has depicted demons and monsters alongside terminology related to abortion rights, teenagers with assault rifles, sexualized images of women in violent tableaus, and underage drinking and drug use. All of those scenes, generated in the past three months, were recreated by CNBC this week using the Copilot tool, originally called Bing Image Creator.

Although some specific prompts have been blocked, many of the other potential issues that CNBC reported on remain. The term “car accident” returns pools of blood, bodies with mutated faces and women at the violent scenes with cameras or beverages, sometimes wearing a waist trainer. “Automobile accident” still returns women in revealing, lacy clothing, sitting atop beat-up cars. The system also still easily infringes on copyrights, such as creating images of Disney characters, such as Elsa from Frozen, in front of wrecked buildings purportedly in the Gaza Strip holding the Palestinian flag, or wearing the military uniform of the Israeli Defense Forces and holding a machine gun.

Jones was so alarmed by his experience that he started internally reporting his findings in December. While the company acknowledged his concerns, it was unwilling to take the product off the market. Jones said Microsoft referred him to OpenAI and, when he didn’t hear back from the company, he posted an open letter on LinkedIn asking the startup’s board to take down DALL-E 3 (the latest version of the AI model) for an investigation.

Microsoft’s legal department told Jones to remove his post immediately, he said, and he complied. In January, he wrote a letter to U.S. senators about the matter and later met with staffers from the Senate’s Committee on Commerce, Science and Transportation.

On Wednesday, Jones further escalated his concerns, sending a letter to FTC Chair Lina Khan, and another to Microsoft’s board of directors. He shared the letters with CNBC ahead of time.

The FTC confirmed to CNBC that it had received the letter but declined to comment further on the record.

Continue Reading

Technology

‘Green light’ away from AI trade: Two ETF executives see a key market shift underway

Published

on

By

'Green light' away from AI trade: Two ETF executives see a key market shift underway

ETF Edge on signals of a new market cycle and top ideas for 2026

A key rotation away from artificial intelligence stocks may be underway in the market.

According to Astoria Portfolio Advisors’ John Davi, a broader range of stocks are getting a “green light” because liquidity is returning to the system.

“The Fed cut rates four times last year. They cut rates twice already. They’re going to go again whether its December [or] January,” the firm’s CEO and chief investment officer told CNBC’s “ETF Edge” this week. “Historically whenever the Fed cuts interest rates, usually that’s a turn of a new cycle. Market leadership does tend to change quietly.”

He lists the latest performance in areas ranging from emerging markets to industrials. The iShares MSCI Emerging Markets ETF, which tracks the group, is up 17% over the past six months as of Wednesday’s close. The Industrial Select Sector SPDR Fund is up 9% over the same period.

“I think they can be a good offset to what’s an expensive large cap tech position, which dominates most portfolios,” he added. “We’re living in a structurally higher inflation world. The Fed is cutting rates like, why do you want to take so much risk in just seven stocks?” and

Davi prefers a global balanced approach to investing versus an overweight position in the Magnificent 7 — which is comprised of Apple, Amazon, Meta Platforms, Nvidia, Microsoft, Tesla and Alphabet, which has been trading around all-time highs. The Mag 7 makes up about a third of the S&P 500.

Loading chart…

Sophia Massie, CEO of ETF-issuer LionShares, is also wary of going all-in on the AI trade.

“I think analysts have an idea of how much value AI will add to our economy. I don’t think we really understand how that’s going to play out between different companies yet,” Massie said in the same interview. “So, I have this sense that right now, we’re pricing in this probability that… one company may be the one that dominates, dominates AI and ends up being a big player in the future.”

Disclaimer

Continue Reading

Technology

How Google put together the pieces for its AI comeback

Published

on

By

How Google put together the pieces for its AI comeback

Vcg | Visual China Group | Getty Images

When ChatGPT launched in 2022, Google was caught flatfooted, but the launch of Gemini 3 and the Ironwood AI chip this month has experts raving about Alphabet’s AI comeback. 

Google kicked off November by unveiling Ironwood, the seventh generation of its tensor processing units, or TPUs, that the company says lets customers “run and scale the largest, most data-intensive models in existence.” And last week, Google launched Gemini 3, its latest artificial intelligence model, saying it requires “less prompting” and provides smarter answers than its predecessors.

Salesforce CEO Marc Benioff captured the excitement around Gemini 3 with a Sunday post on X, saying that despite using OpenAI’s ChatGPT daily for three years, he wasn’t going back after two hours of using Gemini 3.

“The leap is insane,” wrote Benioff, whose company has partnerships with Google, OpenAI and other frontier AI model providers. “Everything is sharper and faster. It feels like the world just changed, again.”

Most tech stocks were down to start the week, except for one: Alphabet.

Shares of the Google parent surged more than 5% on Monday, adding to last week’s gain of more than 8%. Warren Buffett’s Berkshire Hathaway revealed earlier this month that it owns a $4.3 billion stake in Alphabet as of the end of the third quarter.

Alphabet shares are up nearly 70% this year and have outperformed Meta’s by more than 50 percentage points this year, and last week, Alphabet’s market cap surpassed Microsoft’s.

All of this came despite Nvidia reporting stronger-than-expect revenue and guidance in its third-quarter earnings last week.

“You may be asking why almost all of the AI stocks we cover are selling off after such good news from Nvidia,” Melius Research analyst Ben Reitzes wrote in a note Monday, referring to Nvidia’s positive third quarter earnings last week. “There is one real reason for worry and it is the ‘AI comeback’ of Alphabet.” 

But while Google appears to have regained the edge, its lead over rivals remains razor thin in the gruelingly competitive AI market, experts said.

Sundar Pichai, chief executive officer of Alphabet Inc., during the Bloomberg Tech conference in San Francisco, California, US, on Wednesday, June 4, 2025.

David Paul Morris | Bloomberg | Getty Images

Putting the pieces together

With Gemini 3 and Ironwood, Google CEO Sundar Pichai appears to have finally put the pieces together for the company’s AI offerings, said Michael Nathanson, co-founder of equity research firm Moffett Nathanson. Google is serving a broad range of customers from consumers to enterprise, something the company initially struggled to do after the arrival of ChatGPT.

“Three years ago, they were seen as kind of lost and there were all these hot takes saying they lost their way and Sundar is a failure,” Nathanson said. “Now, they have a huge leg up.”

The company had a number of AI product mishaps in its initial attempts to catch up with OpenAI. In 2024 alone, Google had to pull its image generation product Imagen 2 for several months after users discovered a number of historical inaccuracies. The launch of AI Overviews caused a similar reaction when users discovered it gave faulty advice, which the company later remedied with additional guardrails.

“There was a lot of fumbling, and they were scrambling,” said Gil Luria, managing director at technology research firm DA Davidson. “But they had the tech in the pantry, and it was just a matter of getting it all together and shipped.”

Of particular note is how quickly Google launched Gemini 3 after the spring release of Gemini 2.5, which was already considered an impressive model. The hyper-realistic image generation features of Nano Banana is another notch in Google’s belt. After the company initially launched the image generation tool, Gemini shot to the top of the Apple App Store in September, dethroning ChatGPT.

And after the launch of Gemini 3, Google released Nano Banana Pro last week.

Google’s ownership of YouTube and all the content on the video platform gives the company an edge when it comes to training models for image and video generation.

“The amount of video and current data that Google has, that’s really a huge competitive advantage,” said Mike Gualtieri, vice president and principal analyst for Forrester Research. “I don’t see how OpenAI and Anthropic can overcome that.”

Additionally, Google has successfully incorporated its AI models into its enterprise products, driving sales for the company’s cloud unit. In its third quarter earnings results last month, Google reached its first $100 billion quarter, boosted by its cloud growth. The company’s cloud unit, which houses its AI services, showed solid growth and a $155 billion backlog from customers.

And it’s not just the AI models. Google is also garnering attention with its AI chips.

Google says Ironwood is nearly 30 times more power efficient than its first TPU from 2018. Google’s ASIC chips are emerging as the company’s secret weapon in the AI wars and have helped it notch recent deals worth billions with customers such as Anthropic.

After a report said that Meta could strike a deal with Google to use its TPUs for the social media company’s data centers, Nvidia saw its stock drop 3% on Tuesday, prompting the chipmaker to post a response on social media.

With the rise of Google’s TPUs, Nvidia may no longer have the AI chips market cornered.

“The advantage of having the whole stack is you can optimize your model to work specifically well on a TPU chip and you’re building everything to a more optimally designed,” said Luria.

The company’s ability to serve AI enterprise customers with its TPUs and Google Cloud offerings as well as its incorporation of Gemini 3 throughout its consumer products is driving Wall Street’s enthusiasm.

Experts who spoke with CNBC said the competitive landscape is broader than just one AI winner, but they added that it’s become increasingly expensive for multiple companies to prove success.

Tight competition

Despite these wins, Google is still in fierce competition with other AI companies, experts said.

“Having the state of the art model for a few days doesn’t mean they’ve won to the extent that the stock market is implying,” Luria said, pointing to Anthropic’s new Opus 4.5 model launched Monday.

Earlier this month, OpenAI also announced two updates to its GPT-5 model to make it “warmer by default and more conversational” as well as “more efficient and easier to understand in everyday use,” the company said.

“The frontier models still seem to be neck and neck in some ways,” Forrester Research’s Gualtieri said.

The competitive edge will likely go to the companies willing to spend more money given the expenses of the AI race, experts said. In their earnings reports last month, AlphabetMetaMicrosoft and Amazon each lifted their guidance for capital expenditures. They collectively expect that number to reach more than $380 billion this year.

“These companies are spending a lot of money assuming there’s gonna be a winner take all when in reality we may end up with frontier models being a commodity and several will be interchangeable,” Luria said.

For Google, maintaining a lead in AI won’t be without challenges.

Company executives told employees earlier this month that Google has to double its serving capacity every six month to meet demand for AI services and run its frontier models, CNBC reported last week.

“The competition in AI infrastructure is the most critical and also the most expensive part of the AI race,” Google Cloud Vice President Amin Vahdat told employees.

Although Google’s in-house TPUs have gotten increased attention as viable alternatives to Nvidia’s Blackwell chips, Nvidia still holds more than 90% of the AI chip market.

In its post on Tuesday, Nvidia pointed out that its chips are more flexible and powerful than ASIC chips, like Google’s Ironwood, which are typically designed for a single company or function.

And despite getting Salesforce’s Benioff to switch to Gemini, Google also has a lot of catching up to do with its consumer chat product, experts said, citing hallucinations and lower user numbers than OpenAI’s.

The Gemini app has 650 million monthly active users and AI Overviews has 2 billion monthly users, Google said last month. OpenAI, by comparison, said in August that ChatGPT hit 700 million users per week.  

“Yes, Google has got its act together,” Luria said. “But that doesn’t mean they’ve won.”

WATCH: AI narrative is shifting towards Google with its complete stack, says Plexo Capital’s Lo Toney

AI narrative is shifting towards Google with its complete stack, says Plexo Capital's Lo Toney

Continue Reading

Technology

Apple is challenging India’s anti-trust body over a potential $38 billion fine

Published

on

By

Apple is challenging India's anti-trust body over a potential  billion fine

The first day of sale of the iPhone 15 smartphone in Mumbai, India, on Sept. 22, 2023.

Dhiraj Singh | Bloomberg | Getty Images

Apple has filed a case in Delhi High Court against the country’s anti-trust body because of how it considers global turnover when calculating penalties.

The iPhone maker, which is among the fastest growing smart phone brands in India, is challenging India’s new antitrust law under which the U.S. company could incur fines of up to $38 billion, according to a report by Reuters.

It added it was “unconstitutional, grossly disproportionate, unjust” for the Competition Commission of India (CCI) to use turnover when calculating penalties.

Apple did not immediately respond to a request for comment from CNBC.

The CCI has been investigating complaints made by an alliance of Indian startups and Tinder-owner Match Group that accuse Apple of “abusive conduct” which forces developers to pay high commissions for in-app purchases.

Apple denied the charges.

The CCI’s final verdict is still pending but it said its “prima facie view [is] that mandatory use of Apple’s IAP for paid apps & in-app purchases restrict the choice available to the app developers to select a payment processing system of their choice”, in an order in December 2021.

Apple recorded its highest-ever quarterly shipments in India of 5 million units in the third quarter of 2025, according to data from IDC.

IDC: Apple still has room to grow in the India smartphone market

The company is expected to sell about 15 million iPhones this year in India and could rank among top five smartphone companies there, Navkendar Singh associate vice president with IDC India said on CNBC’s “Inside India” on Nov. 18.

Apple is among the global companies who are diversifying their manufacturing supply chain from China to India. In 2024, Apple exports from India hit a record of $12.8 billion, growing at more than 42% from year ago.

Continue Reading

Trending