Depending on where you work, there’s a significant chance that artificial intelligence is analyzing your messages on Slack, Microsoft Teams, Zoom and other popular apps.
Huge U.S. employers such as Walmart, Delta Air Lines, T-Mobile, Chevron and Starbucks, as well as European brands including Nestle and AstraZeneca, have turned to a seven-year-old startup, Aware, to monitor chatter among their rank and file, according to the company.
Jeff Schumann, co-founder and CEO of the Columbus, Ohio-based startup, says the AI helps companies “understand the risk within their communications,” getting a read on employee sentiment in real time, rather than depending on an annual or twice-per-year survey.
Using the anonymized data in Aware’s analytics product, clients can see how employees of a certain age group or in a particular geography are responding to a new corporate policy or marketing campaign, according to Schumann. Aware’s dozens of AI models, built to read text and process images, can also identify bullying, harassment, discrimination, noncompliance, pornography, nudity and other behaviors, he said.
Aware’s analytics tool — the one that monitors employee sentiment and toxicity — doesn’t have the ability to flag individual employee names, according to Schumann. But its separate eDiscovery tool can, in the event of extreme threats or other risk behaviors that are predetermined by the client, he added.
CNBC didn’t receive a response from Walmart, T-Mobile, Chevron, Starbucks or Nestle regarding their use of Aware. A representative from AstraZeneca said the company uses the eDiscovery product but it doesn’t use analytics to monitor sentiment or toxicity. Delta told CNBC that it uses Aware’s analytics and eDiscovery for monitoring trends and sentiment as a way to gather feedback from employees and other stakeholders, and for legal records retention in its social media platform.
It doesn’t take a dystopian novel enthusiast to see where it could all go very wrong.
Jutta Williams, co-founder of AI accountability nonprofit Humane Intelligence, said AI adds a new and potentially problematic wrinkle to so-called insider risk programs, which have existed for years to evaluate things like corporate espionage, especially within email communications.
Speaking broadly about employee surveillance AI rather than Aware’s technology specifically, Williams told CNBC: “A lot of this becomes thought crime.” She added, “This is treating people like inventory in a way I’ve not seen.”
Employee surveillance AI is a rapidly expanding but niche piece of a larger AI market that’s exploded in the past year, following the launch of OpenAI’s ChatGPT chatbot in late 2022. Generative AI quickly became the buzzy phrase for corporate earnings calls, and some form of the technology is automating tasks in just about every industry, from financial services and biomedical research to logistics, online travel and utilities.
Aware’s revenue has jumped 150% per year on average over the past five years, Schumann told CNBC, and its typical customer has about 30,000 employees. Top competitors include Qualtrics, Relativity, Proofpoint, Smarsh and Netskope.
By industry standards, Aware is staying quite lean. The company last raised money in 2021, when it pulled in $60 million in a round led by Goldman Sachs Asset Management. Compare that with large language model, or LLM, companies such as OpenAI and Anthropic, which have raised billions of dollars each, largely from strategic partners.
‘Tracking real-time toxicity’
Schumann started the company in 2017 after spending almost eight years working on enterprise collaboration at insurance company Nationwide.
Before that, he was an entrepreneur. And Aware isn’t the first company he’s started that’s elicited thoughts of Orwell.
In 2005, Schumann founded a company called BigBrotherLite.com. According to his LinkedIn profile, the business developed software that “enhanced the digital and mobile viewing experience” of the CBS reality series “Big Brother.” In Orwell’s classic novel “1984,” Big Brother was the leader of a totalitarian state in which citizens were under perpetual surveillance.
“I built a simple player focused on a cleaner and easier consumer experience for people to watch the TV show on their computer,” Schumann said in an email.
At Aware, he’s doing something very different.
Every year, the company puts out a report aggregating insights from the billions — in 2023, the number was 6.5 billion — of messages sent across large companies, tabulating perceived risk factors and workplace sentiment scores. Schumann refers to the trillions of messages sent across workplace communication platforms every year as “the fastest-growing unstructured data set in the world.”
When including other types of content being shared, such as images and videos, Aware’s analytics AI analyzes more than 100 million pieces of content every day. In so doing, the technology creates a company social graph, looking at which teams internally talk to each other more than others.
“It’s always tracking real-time employee sentiment, and it’s always tracking real-time toxicity,” Schumann said of the analytics tool. “If you were a bank using Aware and the sentiment of the workforce spiked in the last 20 minutes, it’s because they’re talking about something positively, collectively. The technology would be able to tell them whatever it was.”
Aware confirmed to CNBC that it uses data from its enterprise clients to train its machine-learning models. The company’s data repository contains about 6.5 billion messages, representing about 20 billion individual interactions across more than 3 million unique employees, the company said.
When a new client signs up for the analytics tool, it takes Aware’s AI models about two weeks to train on employee messages and get to know the patterns of emotion and sentiment within the company so it can see what’s normal versus abnormal, Schumann said.
“It won’t have names of people, to protect the privacy,” Schumann said. Rather, he said, clients will see that “maybe the workforce over the age of 40 in this part of the United States is seeing the changes to [a] policy very negatively because of the cost, but everybody else outside of that age group and location sees it positively because it impacts them in a different way.”
But Aware’s eDiscovery tool operates differently. A company can set up role-based access to employee names depending on the “extreme risk” category of the company’s choice, which instructs Aware’s technology to pull an individual’s name, in certain cases, for human resources or another company representative.
“Some of the common ones are extreme violence, extreme bullying, harassment, but it does vary by industry,” Schumann said, adding that in financial services, suspected insider trading would be tracked.
For instance, a client can specify a “violent threats” policy, or any other category, using Aware’s technology, Schumann said, and have the AI models monitor for violations in Slack, Microsoft Teams and Workplace by Meta. The client could also couple that with rule-based flags for certain phrases, statements and more. If the AI found something that violated a company’s specified policies, it could provide the employee’s name to the client’s designated representative.
This type of practice has been used for years within email communications. What’s new is the use of AI and its application across workplace messaging platforms such as Slack and Teams.
Amba Kak, executive director of the AI Now Institute at New York University, worries about using AI to help determine what’s considered risky behavior.
“It results in a chilling effect on what people are saying in the workplace,” said Kak, adding that the Federal Trade Commission, Justice Department and Equal Employment Opportunity Commission have all expressed concerns on the matter, though she wasn’t speaking specifically about Aware’s technology. “These are as much worker rights issues as they are privacy issues.”
Schumann said that though Aware’s eDiscovery tool allows security or HR investigations teams to use AI to search through massive amounts of data, a “similar but basic capability already exists today” in Slack, Teams and other platforms.
“A key distinction here is that Aware and its AI models are not making decisions,” Schumann said. “Our AI simply makes it easier to comb through this new data set to identify potential risks or policy violations.”
Privacy concerns
Even if data is aggregated or anonymized, research suggests, it’s a flawed concept. A landmark study on data privacy using 1990 U.S. Census data showed that 87% of Americans could be identified solely by using ZIP code, birth date and gender. Aware clients using its analytics tool have the power to add metadata to message tracking, such as employee age, location, division, tenure or job function.
“What they’re saying is relying on a very outdated and, I would say, entirely debunked notion at this point that anonymization or aggregation is like a magic bullet through the privacy concern,” Kak said.
Additionally, the type of AI model Aware uses can be effective at generating inferences from aggregate data, making accurate guesses, for instance, about personal identifiers based on language, context, slang terms and more, according to recent research.
“No company is essentially in a position to make any sweeping assurances about the privacy and security of LLMs and these kinds of systems,” Kak said. “There is no one who can tell you with a straight face that these challenges are solved.”
And what about employee recourse? If an interaction is flagged and a worker is disciplined or fired, it’s difficult for them to offer a defense if they’re not privy to all of the data involved, Williams said.
“How do you face your accuser when we know that AI explainability is still immature?” Williams said.
Schumann said in response: “None of our AI models make decisions or recommendations regarding employee discipline.”
“When the model flags an interaction,” Schumann said, “it provides full context around what happened and what policy it triggered, giving investigation teams the information they need to decide next steps consistent with company policies and the law.”
Meta CEO Mark Zuckerberg appears at the Meta Connect event in Menlo Park, California, on Sept. 25, 2024.
David Paul Morris | Bloomberg | Getty Images
Meta’s AI assistant now has 1 billion monthly active users across the company’s family of apps, CEO Mark Zuckerberg said Wednesday at the company’s annual shareholder meeting.
The “focus for this year is deepening the experience and making Meta AI the leading personal AI with an emphasis on personalization, voice conversations and entertainment,” Zuckerberg said.
The artificial intelligent assistant’s 1 billion milestone comes after the company in April released a standalone app for the tool.
The plan is for Meta to keep growing the product before building a business around it, Zuckerberg said on Wednesday. As Meta AI improves overtime, Zuckerberg said “there will be opportunities to either insert paid recommendations” or offer “a subscription service so that people can pay to use more compute.”
In February, CNBC reported that Meta was planning to debut a standalone Meta AI app during the second quarter and test a paid-subscription service akin to rival chat apps like OpenAI’s ChatGPT.
“It may seem kind of funny that a billion monthly actives doesn’t seem like it’s at scale for us, but that’s where we’re at,” Zuckerberg told shareholders.
During the Meta shareholder meeting, investors voted on 14 different items related to the company’s business, nine of which were shareholder proposals covering topics such as child safety, greenhouse gas emissions and a proposed bitcoin treasury assessment.
Shareholder proposal 8, for example, was submitted by JLens, which is an investment advisor and affiliate of the Anti-Defamation League, and called for Meta to prepare an annual report detailing and addressing hate content, including antisemitism, on its services following January policy changes that relaxed content-moderation guidelines.
Early voting results on Wednesday showed the proposals that Meta’s board did not recommend were unlikely to pass, including one calling for the company to end its dual-class share structure, which gives Zuckerberg significant voting power. Meanwhile, the voting items that the board favored, including those pertaining to approving the company’s board of director nominees and an equity incentive plan, were likely to pass, based on the preliminary results.
Meta said final polling results will be released within four business days on the company’s website and the U.S. Securities and Exchange Commission.
Salesforce CEO Marc Benioff participates in an interview at the World Economic Forum in Davos, Switzerland, on Jan. 22, 2025.
Chris Ratcliffe | Bloomberg | Getty Images
Salesforce shares were volatile in extended trading on Wednesday after the sales and customer service software maker reported upbeat fiscal first-quarter results and guidance.
Here’s how the company performed relative to LSEG consensus:
Earnings per share: $2.58 adjusted vs. 2.54 expected
Revenue: $9.83 billion vs. $9.75 billion expected
Salesforce’s revenue grew 7.6% year over year in the quarter, which ended on April 30, according to a statement. Net income of $1.54 billion, or $1.59 per share, was basically flat compared with $1.53 billion, or $1.56 per share, a year ago.
President Donald Trump announced sweeping tariffs on goods imported into the U.S. in early April. Co-founder and CEO Marc Benioff sounded positive about the company’s results for the quarter anyway, pointing to its plan, announced on Tuesday, to buy data management company Informatica for $8 billion.
It would be Salesforce’s priciest acquisition since the $27.1 billion Slack deal in 2021. Slack marked the top end of the buyouts Salesforce had made under Benioff. Activist investors raised concerns about all the spending, in addition to slowing revenue growth.
Salesforce sprung into action, slashing 10% of its headcount. Benioff proclaimed that the board’s mergers and acquisitions committee had been disbanded. The company’s finance chief at the time said it would reach a margin expansion goal two years early. And Salesforce started paying dividends to shareholders.
Initial reception to the Informatica announcement was generally favorable. “Salesforce is paying a reasonable multiple for the asset, in our view, and the deal should be more easily digested by investors than some of the company’s large deals in the past (i.e. Slack),” Stifel analysts led by J. Parker Lane wrote in a note to clients. The investment bank has a buy rating on Salesforce shares.
During the fiscal first quarter, Salesforce introduced the AgentExchange marketplace for artificial intelligence agents.
Management sees $2.76 to $2.78 in adjusted earnings per share on $10.11 billion to $10.16 billion in revenue for the fiscal second quarter. Analysts polled by LSEG had expected $2.73 in adjusted earnings per share on $10.01 billion in revenue.
Salesforce bumped up its full-year forecast. It called for $11.27 to $11.33 in adjusted earnings per share and $41.0 billion to $41.3 billion in revenue, implying revenue growth between 8% and 9%. The LSEG consensus included net income of $11.16 per share and $40.82 billion in revenue. The guidance in February was $11.09 to $11.17 in adjusted earnings per share, with $40.5 billion to $40.9 billion in revenue.
As of Wednesday’s close, the stock had slipped about 18% so far in 2025, while the S&P index was unchanged.
Executives will discuss the results with analysts on a conference call starting at 5 p.m. ET.
This is breaking news. Please check back for updates.
HP reported second-quarter results that beat analysts’ estimates for revenue but missed on earnings and guidance, in part due to President Donald Trump’s sweeping tariffs. Shares sank 15% after the report.
Here’s how the company did versus analysts’ estimates compiled by LSEG:
Earnings per share: 71 cents adjusted vs. 80 cents expected
Revenue: $13.22 billion vs. $13.14 billion expected.
Revenue for the quarter increased 3.3% from $12.8 billion in the same period last year. HP reported net income of $406 million, or 42 cents per share, down from $607 million, or 61 cents per share, a year ago.
For its third quarter, HP said it expects to report adjusted earnings of 68 cents to 80 cents per share, missing the average analyst estimate of 90 cents, according to LSEG. Full-year adjusted earnings will be within the range of $3 to $3.30 per share, while analysts were expecting $3.49 per share.
HP said its outlook “reflects the added cost driven by the current U.S. tariffs,” as well as the associated mitigations.
“While results in the quarter were impacted by a dynamic regulatory environment, we responded quickly to accelerate the expansion of our manufacturing footprint and further reduce our cost structure,” HP CEO Enrique Lores said in a statement.
Lores told CNBC’s Steve Kovach that HP has increased production in Vietnam, Thailand, India, Mexico and the U.S. By the end of June, Lores said the company expects nearly all of its products sold in North America will be built outside of China.
“Through our actions, we expect to fully mitigate the increased trade-related costs by Q4,” Lores said in the interview.
HP will hold its quarterly call with investors at 5 p.m. ET.