From Gmail to Word, your privacy settings and AI are entering into a new relationship
The Microsoft 365 website on a laptop arranged in New York, US, on Tuesday, June 25, 2024.
Bloomberg | Bloomberg | Getty Images
The beginning of the year is a great time to do some basic cyber hygiene. We’ve all been told to patch, change passwords, and update software. But one concern that has been increasingly creeping to the forefront is the sometimes quiet integration of potentially privacy-invading AI into programs.
“AI’s rapid integration into our software and services has and should continue to raise significant questions about privacy policies that preceded the AI era,” said Lynette Owens, vice president, global consumer education at cybersecurity company Trend Micro. Many programs we use today — whether it be email, bookkeeping, or productivity tools, and social media and streaming apps — may be governed by privacy policies that lack clarity on whether our personal data can be used to train AI models.
“This leaves all of us vulnerable to uses of our personal information without the appropriate consent. It’s time for every app, website, or online service to take a good hard look at the data they are collecting, who they’re sharing it with, how they’re sharing it, and whether or not it can be accessed to train AI models,” Owens said. “There’s a lot of catch up needed to be done.”
Where AI is already inside our daily online lives
Owens said the potential issues overlap with most of the programs and applications we use on a daily basis.
“Many platforms have been integrating AI into their operations for years, long before AI became a buzzword,” she said.
As an example, Owens points out that Gmail has used AI for spam filtering and predictive text with its “Smart Compose” feature. “And streaming services like Netflix rely on AI to analyze viewing habits and recommend content,” Owens said. Social media platforms like Facebook and Instagram have long used AI for facial recognition in photos and personalized content feeds.
“While these tools offer convenience, consumers should consider the potential privacy trade-offs, such as how much personal data is being collected and how it is used to train AI systems. Everyone should carefully review privacy settings, understand what data is being shared, and regularly check for updates to terms of service,” Owens said.
One tool that has come in for particular scrutiny is Microsoft’s connected experiences, which has been around since 2019 and comes activated with an optional opt-out. It was recently highlighted in press reports — inaccurately, according to the company as well as some outside cybersecurity experts that have taken a look at the issue — as a feature that is new or that has had its settings changed. Leaving the sensational headlines aside, privacy experts do worry that advances in AI can lead to the potential for data and words in programs like Microsoft Word to be used in ways that privacy settings do not adequately cover.
“When tools like connected experiences evolve, even if the underlying privacy settings haven’t changed, the implications of data use might be far broader,” Owens said.
A spokesman for Microsoft wrote in a statement to CNBC that Microsoft does not use customer data from Microsoft 365 consumer and commercial applications to train foundational large language models. He added that in certain instances, customers may consent to using their data for specific purposes, such as custom model development explicitly requested by some commercial customers. Additionally, the setting enables cloud-backed features many people have come to expect from productivity tools such as real-time co-authoring, cloud storage and tools like Editor in Word that provide spelling and grammar suggestions.
Default privacy settings are an issue
Ted Miracco, CEO of security software company Approov, said features like Microsoft’s connected experiences are a double-edged sword — the promise of enhanced productivity but the introduction of significant privacy red flags. The setting’s default-on status could, Miracco said, opt people into something they aren’t necessarily aware of, primarily related to data collection, and organizations may also want to think twice before leaving the feature on.
“Microsoft’s assurance provides only partial relief, but still falls short of mitigating some real privacy concern,” Miracco said.
Perception can be its own problem, according to Kaveh Vadat, founder of RiseOpp, an SEO marketing agency.
“Having the default to enablement shifts the dynamic significantly,” Vahdat said. “Automatically enabling these features, even with good intentions, inherently places the onus on users to review and modify their privacy settings, which can feel intrusive or manipulative to some.”
His view is that companies need to be more transparent, not less, in an environment where there is a lot of distrust and suspicion regarding AI.
Companies including Microsoft should emphasize default opt-out rather than opt-in, and might provide more granular, non-technical information about how personal content is handled because perception can become a reality.
“Even if the technology is completely safe, public perception is shaped not just by facts but by fears and assumptions — especially in the AI era where users often feel disempowered,” he said.
Default settings that enable sharing make sense for business reasons but are bad for consumer privacy, according to Jochem Hummel, assistant professor of information systems and management at Warwick Business School at the University of Warwick in England.
Companies are able to enhance their products and maintain competitiveness with more data sharing as the default, Hummel said. However, from a user standpoint, prioritizing privacy by adopting an opt-in model for data sharing would be “a more ethical approach,” he said. And as long as the additional features offered through data collection are not indispensable, users can choose which aligns more closely with their interests.
There are real benefits to the current tradeoff between AI-enhanced tools and privacy, Hummel said, based on what he is seeing in the work turned in by students. Students who have grown up with web cameras, lives broadcast in real-time on social media, and all-encompassing technology, are often less concerned about privacy, Hummel said, and are embracing these tools enthusiastically. “My students, for example, are creating better presentations than ever,” he said.
Managing the risks
In areas such as copyright law, fears about massive copying by LLMs have been overblown, according to Kevin Smith, director of libraries at Colby College, but AI’s evolution does intersect with core privacy concerns.
“A lot of the privacy concerns currently being raised about AI have actually been around for years; the rapid deployment of large language model trained AI has just focused attention on some of those issues,” Smith said. “Personal information is all about relationships, so the risk that AI models could uncover data that was more secure in a more ‘static’ system is the real change we need to find ways to manage,” he added.
In most programs, turning off AI features is an option buried in the settings. For instance, with connected experiences, open a document and then click “file” and then go to “account” and then find privacy settings. Once there, go to “manage settings” and scroll down to connected experiences. Click the box to turn it off. Once doing so, Microsoft warns: “If you turn this off, some experiences may not be available to you.” Microsoft says leaving the setting on will allow for more communication, collaboration, and AI served-up suggestions.
In Gmail, one needs to open it, tap the menu, then go to settings, then click the account you want to change and then scroll to the “general” section and uncheck the boxes next to the various “Smart features” and personalization options.
As cybersecurity vendor Malwarebytes put it in a blog post about the Microsoft feature: “turning that option off might result in some lost functionality if you’re working on the same document with other people in your organization. … If you want to turn these settings off for reasons of privacy and you don’t use them much anyway, by all means, do so. The settings can all be found under Privacy Settings for a reason. But nowhere could I find any indication that these connected experiences were used to train AI models.”
While these instructions are easy enough to follow, and learning more about what you have agreed to is probably a good option, some experts say the onus should not be on the consumer to deactivate these settings. “When companies implement features like these, they often present them as opt-ins for enhanced functionality, but users may not fully understand the scope of what they’re agreeing to,” said Wes Chaar, a data privacy expert.
“The crux of the issue lies in the vague disclosures and lack of clear communication about what ‘connected’ entails and how deeply their personal content is analyzed or stored,” Chaar said. “For those outside of technology, it might be likened to inviting a helpful assistant into your home, only to learn later they’ve taken notes on your private conversations for a training manual.”
The decision to manage, limit, or even revoke access to data underscores the imbalance in the current digital ecosystem. “Without robust systems prioritizing user consent and offering control, individuals are left vulnerable to having their data repurposed in ways they neither anticipate nor benefit from,” Chaar said.
SpaceX CEO Elon Musk attends a cabinet meeting held by U.S. President Donald Trump at the White House on March 24, 2025.
Win McNamee | Getty Images
Tesla shares fell almost 6% on Monday, a day ahead of the electric vehicle company’s first-quarter earnings report, as analysts fret over “ongoing brand erosion.”
The stock closed at $227.50 leaving it less than $6 above its low for the year on April 8. The shares are now down 44% for the year after wrapping up their worst quarter since 2022 in March. It’s the 12th time this year the stock has dropped by at least 5% in a single session.
CEO Elon Musk’s many distractions outside of Tesla, especially his role within the Trump administration, are in focus, along with the company’s progress on a long-delayed robotaxi and self-driving technology for its existing cars.
In the online forum that Tesla uses to solicit investor inquiries in advance of its earnings calls, more than 300 questions were submitted pertaining to Tesla’s self-driving systems, around 200 came in about the company’s Optimus humanoid robots in development, and more than 160 questions poured in about Musk individually. One investor asked, “What steps has the board of directors taken to mitigate the brand damage caused by Elon’s political activities?”
After spending $290 million to help return Trump to the White House, Musk is now leading an initiative to slash tens of thousands of federal jobs, sell off or end leases for federal office buildings, and reduce U.S. government capacity.
Musk’s politics and antics have elicited a massive backlash in Europe and parts of the U.S. This year, the company has been hit with waves of protests, boycotts and some criminal activity that targeted Tesla vehicles and facilities in response to Musk.
Earlier this month, Tesla reported 336,681 vehicle deliveries in the first quarter, a 13% decline from the same period a year earlier.
The company is expected to report revenue of $21.24 billion for the first quarter, according to LSEG, which would mark a slight drop from the same period last year. Analysts expect earnings per share of 40 cents. Investors will be paying particularly close attention to any commentary about Trump’s widespread tariffs and the potential impact on revenue and earnings as the year progresses.
Oppenheimer analysts wrote in a note out Monday that “ongoing brand erosion” for Tesla in the U.S. and Europe is weighing on sales already, but a “bigger issue for the company is potential weakness in China demand and margin impact due to the Trump tariffs.”
They wrote that competition in China, coupled with “nationalistic” consumer trends there, could “drive sales toward domestic brands.” Tesla would then have to export more of its China-made cars, which could lead to “downward pressure on pricing,” the Oppenheimer analysts said.
Caliber, a research firm that tracks how U.S. consumer sentiment is shifting around major brands, found that only 27% of its survey respondents in March would consider purchasing a Tesla, compared to 46% in January 2022.
Wedbush Securities analyst Dan Ives, a longtime Tesla bull, is hoping for a “turnaround vision” from Musk on Tuesday’s earnings call.
“Tesla has now unfortunately become a political symbol globally of the Trump Administration/DOGE,” he wrote, noting that “Tesla’s stock has been crushed since Trump stepped back into the White House.”
Ives estimated 15% to 20% “permanent demand destruction for future Tesla buyers due to the brand damage Musk has created” by working for Trump.
Late last week, Barclays maintained the equivalent of a sell rating and slashed its price target on Tesla to $275 from $325, citing a “confusing set-up” on the first-quarter with “weak fundamentals.” The firm said it could see a positive reaction if Musk is more focused on his automaker, and depending on what the company discloses about an anticipated “FSD event,” referring to Tesla’s Full Self-Driving offering.
Tesla said in announcing its reporting date that, in addition to earnings, it will provide a “live company update,” language the company hasn’t typically used in disclosures.
WATCH: Why investors are divided on Tesla’s turn to robots and self-driving cars
CEO of Alphabet and Google Sundar Pichai meets Polish Prime Minister at the Chancellery in Warsaw, Poland on March 29, 2022.
Mateusz Wlodarczyk | Nurphoto | Getty Images
As Google heads back to the courtroom Monday, the company is arguing that the U.S. needs the company in its full form to take on chief adversary China and uphold national security in the process.
The remedies trial in Washington, D.C., follows a judge’s ruling in August that Google has held a monopoly in its core market of internet search, the most-significant antitrust ruling in the tech industry since the case against Microsoft more than 20 years ago.
The Justice Department has called for Google to divest its Chrome browser unit and open its search data to rivals. Google said in a blog post on Monday that such a move is not in the best interest of the country as the global battle for supremacy in artificial intelligence rapidly intensifies. In the first paragraph of the post, Google named China’s DeepSeek as an emerging AI competitor.
The DOJ’s proposal would “hamstring how we develop AI, and have a government-appointed committee regulate the design and development of our products,” Lee-Anne Mulholland, Google’s vice president of regulatory affairs, wrote in the post. “That would hold back American innovation at a critical juncture. We’re in a fiercely competitive global race with China for the next generation of technology leadership, and Google is at the forefront of American companies making scientific and technological breakthroughs.”
Google is one of a number of U.S. tech companies trying to fend off the Trump administration’s antirust pursuits, most of which is held over from the Biden administration. Google lost a separate antitrust case last week, when a federal judge ruled Thursday that Google held illegal monopolies in online advertising markets due to its position between ad buyers and sellers.
Meta is currently in court against the Federal Trade Commission, which has alleged that the company monopolizes the social networking market and shouldn’t have been able to acquire Instagram and WhatsApp. Amazon also faces an FTC lawsuit for allegedly maintaining an illegal monopoly. And beyond antitrust, Trump’s FTC on Monday sued Uber, accusing the ride-hailing company of deceptive billing and cancellation practices tied to its subscription service.
It’s the type of enforcement actions the tech industry was hoping to avoid when President Trump took office in January. Google, Meta, Amazon and Uber — and top executives from some — publicly donated to Trump’s inaugural fund, part of a widespread corporate effort to cozy up to the incoming administration.
For Google, the search remedies trial will determine the consequences of the guilty verdict from August. The three-week trial will end on May 9. Judge Amit Mehta is expected to make his ruling in August, at which point Google plans to file an appeal.
“At trial we will show how DOJ’s unprecedented proposals go miles beyond the Court’s decision, and would hurt America’s consumers, economy, and technological leadership,” Mulholland wrote.
Google plans to argue that Chrome provides freedom. The browser helps people access the web, and its open source code is used by other companies. One of the DOJ’s proposals is that Google open its search data, such as search queries, clicks and results to other companies.
That would “introduce not just cybersecurity and even national security risks, but also increase the cost of your devices,” Google said.
A central part of Google”s challenge is to strike a balance between being seen as essential to American innovation, but not so essential that other companies can’t compete, particularly when it comes to AI.
Google will likely tout how it’s fueled AI innovation for years and will point to the “Transformers” research paper, which provided technical architecture used in AI chatbots like OpenAI’s ChatGPT, Perplexity and Anthropic.
The DOJ has said that in search, “Google’s agreements continue to insulate Google’s monopoly.” The department plans to bring testimony from Nick Turley, ChatGPT’s head of product, and Perplexity Chief Business Officer Dmitry Shevelenko.
In a blog post on Monday, Perplexity said that “the remedy isn’t breakup,” but rather that consumers should have more choice. The company said phone makers should be able to offer their customers an assortment of search options “without fearing financial penalties or access restrictions.”
“Consumers deserve the best products, not just the ones that pay the most for placement,” Perplexity wrote. “This is the only remedy that ensures consumer choice can determine the winners.”
WATCH: Google, Meta fight antitrust cases in same courthouse
Amazon CEO Andy Jassy speaks at a company event in New York on Feb. 26, 2025.
Michael Nagle | Bloomberg | Getty Images
Amazon has delayed some commitments around new data center leases, Wells Fargo analysts said Monday, the latest sign that economic concerns may be affecting tech companies’ spending plans.
A week ago, a Microsoft executive said the software company was slowing down or temporarily holding off on advancing early build-outs. Amazon Web Services and Microsoft are the leading providers of cloud infrastructure, and both have ramped up their capital expenditures in recent quarters to meet the demands of the generative artificial intelligence boom.
“Over the weekend, we heard from several industry sources that AWS has paused a portion of its leasing discussions on the colocation side (particularly international ones),” Wells Fargo analysts wrote in a note. They added that “the positioning is similar to what we’ve heard recently from MSFT,” in that both companies are reeling in some new projects but not canceling signed deals.
Tech stocks have been under pressure across the board his year as President Donald Trump’s proposals for widespread tariffs raised the prospect for dramatically higher costs on imports of equipment while also threatening to slow the economy. Cloud infrastructure providers have been aggressively announcing plans to collectively spend hundreds of billions of dollars securing Nvidia’s graphics processing units, or GPUs, and building new data centers.
That was before the announcement on tariffs earlier this month. Microsoft and Amazon both report quarterly results next week. Their stock prices were down on Monday, bringing Amazon’s decline for the year to 25% and Microsoft’s drop to 15%.
An AWS spokesperson did not immediately provide a comment. Earlier this month, Amazon CEO Andy Jassy told CNBC’s Andrew Ross Sorkin that he did not see the company cutting down on data center construction.
Wells Fargo has a hold rating on Amazon shares.
-
Sports2 years ago‘Storybook stuff’: Inside the night Bryce Harper sent the Phillies to the World Series
-
Sports1 year agoStory injured on diving stop, exits Red Sox game
-
Sports1 year agoGame 1 of WS least-watched in recorded history
-
Sports2 years agoMLB Rank 2023: Ranking baseball’s top 100 players
-
Sports4 years ago
Team Europe easily wins 4th straight Laver Cup
-
Environment2 years agoJapan and South Korea have a lot at stake in a free and open South China Sea
-
Environment2 years agoGame-changing Lectric XPedition launched as affordable electric cargo bike
-
Business3 years agoBank of England’s extraordinary response to government policy is almost unthinkable | Ed Conway