Connect with us

Published

on

Mark Zuckerberg, chief executive officer of Meta Platforms Inc., left, arrives at federal court in San Jose, California, US, on Tuesday, Dec. 20, 2022. 

David Paul Morris | Bloomberg | Getty Images

Toward the end of 2022, engineers on Meta’s team combating misinformation were ready to debut a key fact-checking tool that had taken half a year to build. The company needed all the reputational help it could get after a string of crises had badly damaged the credibility of Facebook and Instagram and given regulators additional ammunition to bear down on the platforms.

The new product would let third-party fact-checkers like The Associated Press and Reuters, as well as credible experts, add comments at the top of questionable articles on Facebook as a way to verify their trustworthiness.

related investing news

How artificial intelligence could threaten major industries and business models

CNBC Pro

But CEO Mark Zuckerberg’s commitment to make 2023 the “year of efficiency” spelled the end of the ambitious effort, according to three people familiar with the matter who asked not to be named due to confidentiality agreements.

Over multiple rounds of layoffs, Meta announced plans to eliminate roughly 21,000 jobs, a mass downsizing that had an outsized effect on the company’s trust and safety work. The fact-checking tool, which had initial buy-in from executives and was still in a testing phase early this year, was completely dissolved, the sources said.

A Meta spokesperson did not respond to questions related to job cuts in specific areas and said in an emailed statement that “we remain focused on advancing our industry-leading integrity efforts and continue to invest in teams and technologies to protect our community.”

Across the tech industry, as companies tighten their belts and impose hefty layoffs to address macroeconomic pressures and slowing revenue growth, wide swaths of people tasked with protecting the internet’s most-populous playgrounds are being shown the exits. The cuts come at a time of increased cyberbullying, which has been linked to higher rates of adolescent self-harm, and as the spread of misinformation and violent content collides with the exploding use of artificial intelligence.

In their most recent earnings calls, tech executives highlighted their commitment to “do more with less,” boosting productivity with fewer resources. Meta, Alphabet, Amazon and Microsoft have all cut thousands of jobs after staffing up rapidly before and during the Covid pandemic. Microsoft CEO Satya Nadella recently said his company would suspend salary increases for full-time employees.

The slashing of teams tasked with trust and safety and AI ethics is a sign of how far companies are willing to go to meet Wall Street demands for efficiency, even with the 2024 U.S. election season — and the online chaos that’s expected to ensue — just months away from kickoff. AI ethics and trust and safety are different departments within tech companies but are aligned on goals related to limiting real-life harm that can stem from use of their companies’ products and services.

“Abuse actors are usually ahead of the game; it’s cat and mouse,” said Arjun Narayan, who previously served as a trust and safety lead at Google and TikTok parent ByteDance, and is now head of trust and safety at news aggregator app Smart News. “You’re always playing catch-up.”

For now, tech companies seem to view both trust and safety and AI ethics as cost centers.

Twitter effectively disbanded its ethical AI team in November and laid off all but one of its members, along with 15% of its trust and safety department, according to reports. In February, Google cut about one-third of a unit that aims to protect society from misinformation, radicalization, toxicity and censorship. Meta reportedly ended the contracts of about 200 content moderators in early January. It also laid off at least 16 members of Instagram’s well-being group and more than 100 positions related to trust, integrity and responsibility, according to documents filed with the U.S. Department of Labor.

Andy Jassy, chief executive officer of Amazon.Com Inc., during the GeekWire Summit in Seattle, Washington, U.S., on Tuesday, Oct. 5, 2021.

David Ryder | Bloomberg | Getty Images

In March, Amazon downsized its responsible AI team and Microsoft laid off its entire ethics and society team – the second of two layoff rounds that reportedly took the team from 30 members to zero. Amazon didn’t respond to a request for comment, and Microsoft pointed to a blog post regarding its job cuts.

At Amazon’s game streaming unit Twitch, staffers learned of their fate in March from an ill-timed internal post from Amazon CEO Andy Jassy.

Jassy’s announcement that 9,000 jobs would be cut companywide included 400 employees at Twitch. Of those, about 50 were part of the team responsible for monitoring abusive, illegal or harmful behavior, according to people familiar with the matter who spoke on the condition of anonymity because the details were private.

The trust and safety team, or T&S as it’s known internally, was losing about 15% of its staff just as content moderation was seemingly more important than ever.

In an email to employees, Twitch CEO Dan Clancy didn’t call out the T&S department specifically, but he confirmed the broader cuts among his staffers, who had just learned about the layoffs from Jassy’s post on a message board.

“I’m disappointed to share the news this way before we’re able to communicate directly to those who will be impacted,” Clancy wrote in the email, which was viewed by CNBC.

‘Hard to win back consumer trust’

A current member of Twitch’s T&S team said the remaining employees in the unit are feeling “whiplash” and worry about a potential second round of layoffs. The person said the cuts caused a big hit to institutional knowledge, adding that there was a significant reduction in Twitch’s law enforcement response team, which deals with physical threats, violence, terrorism groups and self-harm.

A Twitch spokesperson did not provide a comment for this story, instead directing CNBC to a blog post from March announcing the layoffs. The post didn’t include any mention of trust and safety or content moderation.

Narayan of Smart News said that with a lack of investment in safety at the major platforms, companies lose their ability to scale in a way that keeps pace with malicious activity. As more problematic content spreads, there’s an “erosion of trust,” he said.

“In the long run, it’s really hard to win back consumer trust,” Narayan added.

While layoffs at Meta and Amazon followed demands from investors and a dramatic slump in ad revenue and share prices, Twitter’s cuts resulted from a change in ownership.

Almost immediately after Elon Musk closed his $44 billion purchase of Twitter in October, he began eliminating thousands of jobs. That included all but one member of the company’s 17-person AI ethics team, according to Rumman Chowdhury, who served as director of Twitter’s machine learning ethics, transparency and accountability team. The last remaining person ended up quitting.

The team members learned of their status when their laptops were turned off remotely, Chowdhury said. Hours later, they received email notifications. 

“I had just recently gotten head count to build out my AI red team, so these would be the people who would adversarially hack our models from an ethical perspective and try to do that work,” Chowdhury told CNBC. She added, “It really just felt like the rug was pulled as my team was getting into our stride.”

Part of that stride involved working on “algorithmic amplification monitoring,” Chowdhury said, or tracking elections and political parties to see if “content was being amplified in a way that it shouldn’t.”

Chowdhury referenced an initiative in July 2021, when Twitter’s AI ethics team led what was billed as the industry’s first-ever algorithmic bias bounty competition. The company invited outsiders to audit the platform for bias, and made the results public. 

Chowdhury said she worries that now Musk “is actively seeking to undo all the work we have done.”

“There is no internal accountability,” she said. “We served two of the product teams to make sure that what’s happening behind the scenes was serving the people on the platform equitably.”

Twitter did not provide a comment for this story.

Ad giant IPG advises brands to pause Twitter advertising after Musk takeover

Advertisers are pulling back in places where they see increased reputational risk.

According to Sensor Tower, six of the top 10 categories of U.S. advertisers on Twitter spent much less in the first quarter of this year compared with a year earlier, with that group collectively slashing its spending by 53%. The site has recently come under fire for allowing the spread of violent images and videos.

The rapid rise in popularity of chatbots is only complicating matters. The types of AI models created by OpenAI, the company behind ChatGPT, and others make it easier to populate fake accounts with content. Researchers from the Allen Institute for AI, Princeton University and Georgia Tech ran tests in ChatGPT’s application programming interface (API), and found up to a sixfold increase in toxicity, depending on which type of functional identity, such as a customer service agent or virtual assistant, a company assigned to the chatbot.

Regulators are paying close attention to AI’s growing influence and the simultaneous downsizing of groups dedicated to AI ethics and trust and safety. Michael Atleson, an attorney at the Federal Trade Commission’s division of advertising practices, called out the paradox in a blog post earlier this month.

“Given these many concerns about the use of new AI tools, it’s perhaps not the best time for firms building or deploying them to remove or fire personnel devoted to ethics and responsibility for AI and engineering,” Atleson wrote. “If the FTC comes calling and you want to convince us that you adequately assessed risks and mitigated harms, these reductions might not be a good look.” 

Meta as a bellwether

For years, as the tech industry was enjoying an extended bull market and the top internet platforms were flush with cash, Meta was viewed by many experts as a leader in prioritizing ethics and safety.

The company spent years hiring trust and safety workers, including many with academic backgrounds in the social sciences, to help avoid a repeat of the 2016 presidential election cycle, when disinformation campaigns, often operated by foreign actors, ran rampant on Facebook. The embarrassment culminated in the 2018 Cambridge Analytica scandal, which exposed how a third party was illicitly using personal data from Facebook.

But following a brutal 2022 for Meta’s ad business — and its stock price — Zuckerberg went into cutting mode, winning plaudits along the way from investors who had complained of the company’s bloat.

Beyond the fact-checking project, the layoffs hit researchers, engineers, user design experts and others who worked on issues pertaining to societal concerns. The company’s dedicated team focused on combating misinformation suffered numerous losses, four former Meta employees said.

Prior to Meta’s first round of layoffs in November, the company had already taken steps to consolidate members of its integrity team into a single unit. In September, Meta merged its central integrity team, which handles social matters, with its business integrity group tasked with addressing ads and business-related issues like spam and fake accounts, ex-employees said.

In the ensuing months, as broader cuts swept across the company, former trust and safety employees described working under the fear of looming layoffs and for managers who sometimes failed to see how their work affected Meta’s bottom line.

For example, things like improving spam filters that required fewer resources could get clearance over long-term safety projects that would entail policy changes, such as initiatives involving misinformation. Employees felt incentivized to take on more manageable tasks because they could show their results in their six-month performance reviews, ex-staffers said.

Ravi Iyer, a former Meta project manager who left the company before the layoffs, said that the cuts across content moderation are less bothersome than the fact that many of the people he knows who lost their jobs were performing critical roles on design and policy changes.

“I don’t think we should reflexively think that having fewer trust and safety workers means platforms will necessarily be worse,” said Iyer, who’s now the managing director of the Psychology of Technology Institute at University of Southern California’s Neely Center. “However, many of the people I’ve seen laid off are amongst the most thoughtful in rethinking the fundamental designs of these platforms, and if platforms are not going to invest in reconsidering design choices that have been proven to be harmful — then yes, we should all be worried.”

A Meta spokesperson previously downplayed the significance of the job cuts in the misinformation unit, tweeting that the “team has been integrated into the broader content integrity team, which is substantially larger and focused on integrity work across the company.”

Still, sources familiar with the matter said that following the layoffs, the company has fewer people working on misinformation issues.

Meta Q1 earnings were a 'tour de force', says Wedgewood's David Rolfe

For those who’ve gained expertise in AI ethics, trust and safety and related content moderation, the employment picture looks grim.

Newly unemployed workers in those fields from across the social media landscape told CNBC that there aren’t many job openings in their area of specialization as companies continue to trim costs. One former Meta employee said that after interviewing for trust and safety roles at Microsoft and Google, those positions were suddenly axed.

An ex-Meta staffer said the company’s retreat from trust and safety is likely to filter down to smaller peers and startups that appear to be “following Meta in terms of their layoff strategy.”

Chowdhury, Twitter’s former AI ethics lead, said these types of jobs are a natural place for cuts because “they’re not seen as driving profit in product.”

“My perspective is that it’s completely the wrong framing,” she said. “But it’s hard to demonstrate value when your value is that you’re not being sued or someone is not being harmed. We don’t have a shiny widget or a fancy model at the end of what we do; what we have is a community that’s safe and protected. That is a long-term financial benefit, but in the quarter over quarter, it’s really hard to measure what that means.” 

At Twitch, the T&S team included people who knew where to look to spot dangerous activity, according to a former employee in the group. That’s particularly important in gaming, which is “its own unique beast,” the person said.

Now, there are fewer people checking in on the “dark, scary places” where offenders hide and abusive activity gets groomed, the ex-employee added.

More importantly, nobody knows how bad it can get.

WATCH: CNBC’s interview with Elon Musk

Tesla CEO Elon Musk discusses the implications of A.I. on his children's future in the workforce

Continue Reading

Technology

Meta tried to buy Ilya Sutskever’s $32 billion AI startup, but is now planning to hire its CEO

Published

on

By

Meta tried to buy Ilya Sutskever's  billion AI startup, but is now planning to hire its CEO

When Meta CEO Mark Zuckerberg poached Scale AI founder Alexandr Wang last week as part of a $14.3 billion investment in the artificial intelligence startup, he was apparently just getting started.

Zuckerberg’s multibillion-dollar AI hiring spree has now turned to Daniel Gross, the CEO of Ilya Sutskever’s startup Safe Superintelligence, and former GitHub CEO Nat Friedman, according to sources with knowledge of the matter.

It’s not how Zuckerberg planned for a deal to go down.

Earlier this year, sources said, Meta tried to acquire Safe Superintelligence, which was reportedly valued at $32 billion in a fundraising round in April. Sutskever, who just launched the startup a year ago, shortly after leaving OpenAI, rebuffed Meta’s efforts, as well as the company’s attempt to hire him, said the sources, who asked not to be named because the information is confidential.

Soon after those talks ended, Zuckerberg started negotiating with Gross, the sources said. In addition to his role at Safe Superintelligence, Gross runs a venture capital firm with Friedman called NFDG, their combined initials.

Both men are joining Meta as part of the transaction, and will work on products under Wang, one source said. Meta, meanwhile, will get a stake in NFDG, according to multiple sources.

The Information was first to report on Meta’s plans to hire Gross and Friedman.

Gross, Friedman and Sutskever didn’t respond to CNBC’s requests for comment.

A Meta spokesperson said the company “will share more about our superintelligence effort and the great people joining this team in the coming weeks.”

Zuckerberg’s aggressive hiring tactics escalate an AI talent war that’s reached new heights of late. Meta, Google and OpenAI, along with a host of other big companies and high-valued startups, are racing to develop the most powerful large language models, and pushing towards artificial general intelligence (AGI), or AI that’s considered equal to or greater than human intelligence.

Last week, Meta agreed to pump $14.3 billion into Scale AI to bring on Wang and a few other top engineers while getting a 49% stake in the startup.

Altman said on the latest episode of the “Uncapped” podcast, which is hosted by his brother, that Meta has tried to lure OpenAI employees by offering signing bonuses as high as $100 million, with even larger annual compensation packages. Altman said “none of our best people have decided to take them up on that.”

“I’ve heard that Meta thinks of us as their biggest competitor,” Altman said on the podcast. “Their current AI efforts have not worked as well as they have hoped and I respect being aggressive and continuing to try new things.”

Meta didn’t respond to a request for comment on Altman’s remarks.

OpenAI, for its part, has gone to similar lengths, paying about $6.5 billion to hire iPhone designer Jony Ive and to acquire his nascent devices startup io.

Elsewhere, the founders of AI startup Character.AI were recruited back to Google last year in a multibillion-dollar deal, while DeepMind co-founder Mustafa Suleyman was brought on by Microsoft in a $650 million purchase of talent from Inflection AI.

In Gross, Zuckerberg is getting a longtime entrepreneur and AI investor. Gross founded the search engine Cue, which was acquired by Apple in 2013. He was a top executive at Apple and helped lead machine learning efforts and the development of Siri. He was later a partner at startup accelerator Y Combinator, before co‑founding Safe Superintelligence alongside Sutskever.

Friedman co-founded two startups before becoming the CEO of GitHub following Microsoft’s acquisition of the code-sharing platform in 2018.

NFDG has backed Coinbase, Figma, CoreWeave, Perplexity and Character.ai over the years, according to Pitchbook. It’s unclear what happens to its investment portfolio in a Meta deal, a source said.

WATCH: Zuckerberg, Altman feud for top AI talent

Continue Reading

Technology

Creators say they didn’t know Google uses YouTube to train AI

Published

on

By

Creators say they didn't know Google uses YouTube to train AI

Silhouettes of laptop and mobile device users are seen next to a screen projection of the YouTube logo.

Dado Ruvic | Reuters

Google is using its expansive library of YouTube videos to train its artificial intelligence models, including Gemini and the Veo 3 video and audio generator, CNBC has learned.

The tech company is turning to its catalog of 20 billion YouTube videos to train these new-age AI tools, according to a person who was not authorized to speak publicly about the matter. Google confirmed to CNBC that it relies on its vault of YouTube videos to train its AI models, but the company said it only uses a subset of its videos for the training and that it honors specific agreements with creators and media companies.

“We’ve always used YouTube content to make our products better, and this hasn’t changed with the advent of AI,” said a YouTube spokesperson in a statement. “We also recognize the need for guardrails, which is why we’ve invested in robust protections that allow creators to protect their image and likeness in the AI era — something we’re committed to continuing.”

Such use of YouTube videos has the potential to lead to an intellectual property crisis for creators and media companies, experts said.

While YouTube says it has shared this information previously, experts who spoke with CNBC said it’s not widely understood by creators and media organizations that Google is training its AI models using its video library.

YouTube didn’t say how many of the 20 billion videos on its platform or which ones are used for AI training. But given the platform’s scale, training on just 1% of the catalog would amount to 2.3 billion minutes of content, which experts say is more than 40 times the training data used by competing AI models.

The company shared in a blog post published in September that YouTube content could be used to “improve the product experience … including through machine learning and AI applications.” Users who have uploaded content to the service have no way of opting out of letting Google train on their videos. 

“It’s plausible that they’re taking data from a lot of creators that have spent a lot of time and energy and their own thought to put into these videos,” said Luke Arrigoni, CEO of Loti, a company that works to protect digital identity for creators. “It’s helping the Veo 3 model make a synthetic version, a poor facsimile, of these creators. That’s not necessarily fair to them.”

CNBC spoke with multiple leading creators and IP professionals, none were aware or had been informed by YouTube that their content could be used to train Google’s AI models.

Google DeepMind Veo 3.

Courtesy: Google DeepMind

The revelation that YouTube is training on its users’ videos is noteworthy after Google in May announced Veo 3, one of the most advanced AI video generators on the market. In its unveiling, Google showcased cinematic-level video sequences, including a scene of an old man on a boat and another showing Pixar-like animals talking with one another. The entirety of the scenes, both the visual and the audio, were entirely AI generated. 

According to YouTube, an average of 20 million videos are uploaded to the platform each day by independent creators by nearly every major media company. Many creators say they are now concerned they may be unknowingly helping to train a system that could eventually compete with or replace them.

“It doesn’t hurt their competitive advantage at all to tell people what kind of videos they train on and how many they trained on,” Arrigoni said. “The only thing that it would really impact would be their relationship to creators.”

Even if Veo 3’s final output does not directly replicate existing work, the generated content fuels commercial tools that could compete with the creators who made the training data possible, all without credit, consent or compensation, experts said.

When uploading a video to the platform, the user is agreeing that YouTube has a broad license to the content.

“By providing Content to the Service, you grant to YouTube a worldwide, non-exclusive, royalty-free, sublicensable and transferable license to use that Content,” the terms of service read.

“We’ve seen a growing number of creators discover fake versions of themselves circulating across platforms — new tools like Veo 3 are only going to accelerate the trend,” said Dan Neely, CEO of Vermillio, which helps individuals protect their likeness from being misused and also facilitates secure licensing of authorized content.

Neely’s company has challenged AI platforms for generating content that allegedly infringes on its clients’ intellectual property, both individual and corporate. Neely says that although YouTube has the right to use this content, many of the content creators who post on the platform are unaware that their videos are being used to train video-generating AI software.

Vermillio uses a proprietary tool called Trace ID to asses whether an AI-generated video has significant overlap with a human-created video. Trace ID assigns scores on a scale of zero to 100. Any score over 10 for a video with audio is considered meaningful, Neely said.

A video from YouTube creator Brodie Moss closely matched content generated by Veo 3. Using Vermillio’s Trace ID tool, the system attributed a score of 71 to the original video with the audio alone scoring over 90.

Vermillio

In one example cited by Neely, a video from YouTube creator Brodie Moss closely matched content generated by Veo 3. Trace ID attributed a score of 71 to the original video with the audio alone scoring over 90.

Some creators told CNBC they welcome the opportunity to use Veo 3, even if it may have been trained on their content.

“I try to treat it as friendly competition more so than these are adversaries,” said Sam Beres, a creator with 10 million subscribers on YouTube. “I’m trying to do things positively because it is the inevitable —but it’s kind of an exciting inevitable.”

Google includes an indemnification clause for its generative AI products, including Veo, which means that if a user faces a copyright challenge over AI-generated content, Google will take on legal responsibility and cover the associated costs.

YouTube announced a partnership with Creative Artists Agency in December to develop access for top talent to identify and manage AI-generated content that features their likeness. YouTube also has a tool for creators to request a video to be taken down if they believe it abuses their likeness.

However, Arrigoni said that the tool hasn’t been reliable for his clients.

YouTube also allows creators to opt out of third party training from select AI companies including Amazon, Apple and Nvidia, but users are not able to stop Google from training for its own models.

The Walt Disney Company and Universal filed a joint lawsuit last Wednesday against the AI image generator Midjourney, alleging copyright infringement, the first lawsuit of its kind out of Hollywood.

“The people who are losing are the artists and the creators and the teenagers whose lives are upended,” said Sen. Josh Hawley, R-Mo., in May at a Senate hearing about the use of AI to replicate the likeness of humans. “We’ve got to give individuals powerful enforceable rights and their images in their property in their lives back again or this is just never going to stop.”

Disclosure: Universal is part of NBCUniversal, the parent company of CNBC.

WATCH: Google buyouts highlight tech’s cost-cutting amid AI CapEx boom

Google buyouts highlight tech's cost-cutting amid AI CapEx boom

Continue Reading

Technology

Samsung aims to catch up to Chinese rivals for thin foldable phones as Apple said to enter the fray

Published

on

By

Samsung aims to catch up to Chinese rivals for thin foldable phones as Apple said to enter the fray

Samsung launched the Galaxy Z Fold6 at its Galaxy Unpacked event in Paris. The tech giant said the foldable device is thinner and lighter than its predecessor.

Arjun Kharpal | CNBC

Samsung will unveil a thinner version of its flagship foldable smartphone at a launch likely set to take place next month, as it battles Chinese rivals to deliver the slimmest devices to the market.

Folding phones, which have a single screen that can fold in half, came in focus when Samsung first launched such a device in 2019. But Chinese players, in particular Honor and Oppo, have since aggressively released foldables that are thinner and lighter than Samsung’s offerings.

Why are slim foldables important?

“With foldables, thinness has become more critical than ever because people aren’t prepared to accept the compromise for a thicker and heavier phone to get the real estate that a folding phone can deliver,” Ben Wood, chief analyst at CCS Insight, told CNBC on Thursday.

Honor, Oppo and other Chinese players have used their slim designs to differentiate themselves from Samsung.

Let’s look at a comparison: Samsung’s last foldable from 2024, the Galaxy Z Fold6, is 12.1 millimeter ~(0.48 inches) thick when folded and weighs 239 grams (8.43 oz). Oppo’s Find N5, which was released earlier this year, is 8.93 millimeters thick when closed and weighs 229 grams. The Honor Magic V3, which was launched last year, is 9.2 millimeters when folded and weighs 226 grams.

“Samsung needs to step up” in foldables, Wood said.

And that’s what the South Korean tech giant is planning to do at its upcoming launch, which is likely to take place next month.

“The newest Galaxy Z series is the thinnest, lightest and most advanced foldable yet – meticulously crafted and built to last,” Samsung said in a preview blog post about the phone earlier this month.

But the competition is not letting up. Honor is planning a launch on July 2 in China for its latest folding phone, the Magic V5.

“The interesting thing for Samsung, if they can approach the thinness that Honor has achieved it is will be a significant step up from predecessor, it will be a tangible step up in design,” Wood said.

Despite these advances by way of foldables, the market for the devices has not been as exciting as many had hoped.

CCS Insight said that foldables will account for just 2% of the overall smartphone market this year. Thinner phones may be one way to address the sluggish market, but consumer preferences would also need to change.

“There is a chance that by delivering much thinner foldables that are more akin to the traditional monoblock phone, it will provide an opportunity to turn consumer heads and get them to revisit the idea of having a folding device,” Wood said.

“However, I would caution foldables do remain problematic because in many cases consumers struggle to see why they need a folding device.”

Although the market remains small for foldables compared to traditional smartphones, noted analyst Ming-Chi Kuo of TF International Securities on Wednesday said Apple  — which has been notably absent from this product line-up — plans to make a folding iPhone starting next year.

Continue Reading

Trending