Connect with us

Published

on

Spotify, Reddit and X have all implemented age assurance systems to prevent children from being exposed to inappropriate content.

STR | Nurphoto via Getty Images

The global online safety movement has paved the way for a number of artificial intelligence-powered products designed to keep kids away from potentially harmful things on the internet.

In the U.K., a new piece of legislation called the Online Safety Act imposes a duty of care on tech companies to protect children from age-inappropriate material, hate speech, bullying, fraud, and child sexual abuse material (CSAM). Companies can face fines as high as 10% of their global annual revenue for breaches.

Further afield, landmark regulations aimed at keeping kids safer online are swiftly making their way through the U.S. Congress. One bill, known as the Kids Online Safety Act, would make social media platforms liable for preventing their products from harming children — similar to the Online Safety Act in the U.K.

This push from regulators is increasingly causing something of a rethink at several major tech players. Pornhub and other online pornography giants are blocking all users from accessing their sites unless they go through an age verification system.

Porn sites haven’t been alone in taking action to verify users ages, though. Spotify, Reddit and X have all implemented age assurance systems to prevent children from being exposed to sexually explicit or inappropriate materials.

Such regulatory measures have been met with criticisms from the tech industry — not least due to concerns that they may infringe internet users’ privacy.

Digital ID tech flourishing

At the heart of all these age verification measures is one company: Yoti.

Yoti produces technology that captures selfies and uses artificial intelligence to verify someone’s age based on their facial features. The firm says its AI algorithm, which has been trained on millions of faces, can estimate the age of 13 to 24-year-olds within two years of accuracy.

The firm has previously partnered with the U.K.’s Post Office and is hoping to capitalize on the broader push for government-issued digital ID cards in the U.K. Yoti is not alone in the identity verification software space — other players include Entrust, Persona and iProov. However, the company has been the most prominent provider of age assurance services under the new U.K. regime.

“There is a race on for child safety technology and service providers to earn trust and confidence,” Pete Kenyon, a partner at law firm Cripps, told CNBC. “The new requirements have undoubtedly created a new marketplace and providers are scrambling to make their mark.”

Yet the rise of digital identification methods has also led to concerns over privacy infringements and possible data breaches.

“Substantial privacy issues arise with this technology being used,” said Kenyon. “Trust is key and will only be earned by the use of stringent and effective technical and governance procedures adopted in order to keep personal data safe.”

Read more CNBC tech news

Rani Govender, policy manager for child safety online at British child protection charity NSPCC, said that the technology “already exists” to authenticate users without compromising their privacy.

“Tech companies must make deliberate, ethical choices by choosing solutions that protect children from harm without compromising the privacy of users,” she told CNBC. “The best technology doesn’t just tick boxes; it builds trust.”

Child-safe smartphones

The wave of new tech emerging to prevent children from being exposed to online harms isn’t just limited to software.

Earlier this month, Finnish phone maker HMD Global launched a new smartphone called the Fusion X1, which uses AI to stop kids from filming or sharing nude content or viewing sexually explicit images from the camera, screen and across all apps.

The phone uses technology developed by SafeToNet, a British cybersecurity firm focused on child safety.

Finnish phone maker HMD Global’s new smartphone uses AI to prevent children from being exposed nude or sexually explicit images.

HMD Global

“We believe more needs to be done in this space,” James Robinson, vice president of family vertical at HMD, told CNBC. He stressed that HMD came up with the concept for children’s devices prior to the Online Safety Act entering into force, but noted it was “great to see the government taking greater steps.”

The release of HMD’s child-friendly phone follows heightened momentum in the “smartphone-free” movement, which encourages parents to avoid letting their children own a smartphone.

Going forward, the NSPCC’s Govender says that child safety will become a significant priority for digital behemoths such as Google and Meta.

The tech giants have for years been accused of worsening mental health in children and teens due to the rise of online bullying and social media addiction. They in return argue they’ve taken steps to address these issues through increased parental controls and privacy features.

“For years, tech giants have stood by while harmful and illegal content spread across their platforms, leaving young people exposed and vulnerable,” she told CNBC. “That era of neglect must end.”

Continue Reading

Technology

Salesforce CEO confirms 4,000 layoffs ‘because I need less heads’ with AI

Published

on

By

Salesforce CEO confirms 4,000 layoffs ‘because I need less heads' with AI

Salesforce CEO Marc Benioff participates in an interview at the World Economic Forum in Davos, Switzerland, on Jan. 22, 2025.

Chris Ratcliffe | Bloomberg | Getty Images

Salesforce has cut 4,000 of its customer support roles, CEO Marc Benioff recently said while discussing how artificial intelligence has helped reduce the company headcount.

Benioff revealed the layoffs during an interview published Friday on The Logan Bartlett Show podcast.

“I’ve reduced it from 9,000 heads to about 5,000, because I need less heads,” Benioff said while discussing the impact of AI on Salesforce operations.

Salesforce has been on the front lines of the AI revolution and has built what it calls an “Agentforce” of customer service bots.

“Because of the benefits and efficiencies of Agentforce, we’ve seen the number of support cases we handle decline and we no longer need to actively backfill support engineer roles,” Salesforce said in a statement Tuesday to NBC Bay Area.

The layoffs come after Benioff over the summer announced AI is doing up to 50% of the work at Salesforce, which is based in San Francisco.

Laurie Ruettimann, a human resources consultant, said AI is affecting jobs in several industries.

“There have been layoffs all over America directly attributed to AI,” Ruettimann said, adding anyone who wants to stay employed or looking for work needs to learn new skills.

“If your network could get you a job, it would have done it already. It would have done it yesterday,” Ruettimann said. “It’s on you to expand your vision, to expand your horizons and to meet new people.”

Analyst Ed Zitron said AI is being blamed by tech companies that over hired during the pandemic. The companies are now looking to lure investors by claiming to be more efficient, Zitron said.

“It’s just a growth at all costs mindset,” Zitron said. “The only thing that’s important is growth, even if it ruins people’s lives. Even if it makes the company worse and provides an inferior product.”

Continue Reading

Technology

Apple shares rise after judge rules Google can continue preload deals in antitrust case

Published

on

By

Apple shares rise after judge rules Google can continue preload deals in antitrust case

Tim Cook, CEO of Apple Inc., during the Apple Worldwide Developers Conference at Apple Park campus in Cupertino, California, on June 9, 2025.

David Paul Morris | Bloomberg | Getty Images

Apple shares rose more than 3% in extended trading Tuesday after a federal judge ruled that Alphabet may continue making payments to preload Google Search onto the iPhone.

Although Apple wasn’t a party in the search monopoly trial, the judge was considering remedies that would bar Google from paying billions per year to Apple to be the default search engine on the Safari browser on iPhones, Macs and iPads.

“Google will not be barred from making payments or offering other consideration to distribution partners for preloading or placement of Google Search, Chrome, or its GenAI products,” Judge Amit Mehta wrote in his decision.

“Cutting off payments from Google almost certainly will impose substantial — in some cases, crippling — downstream harms to distribution partners, related markets, and consumers, which counsels against a broad payment ban,” the decision continued.

The landmark case focused on Google’s dominance of the general search market, Google’s violations of the Sherman Act and the barriers to entry that the search engine erected.

However, the judge said that Google will be barred from entering or maintaining “any exclusive contract” related to preloading its search engine or key apps on devices, specifying that Google can’t bundle its Android services with Google search or condition revenue share agreements on the acceptance of other Google apps or services.

The decision said that Apple’s deal with Google to be the default search engine was “exclusive” because it established Google as the default out-of-the-box search engine.

But while Mehta put restrictions on Google making payments to ensure its products receive exclusive distribution, he fell short of banning those payments entirely, leaving open the possibility that the two companies could strike a new deal. The remedies would limit any revenue-sharing agreement to one year, according to the Department of Justice.

Apple did not immediately respond for a request for comment.

“Now the Court has imposed limits on how we distribute Google services, and will require us to share Search data with rivals,” Google said in a blog post. “We have concerns about how these requirements will impact our users and their privacy, and we’re reviewing the decision closely.”

The U.S. Department of Justice filed its suit against Google in 2020, alleging that Google kept its share of the general search market by erecting strong barriers for challengers, such as its default search deals. The U.S. District Court in Washington ruled last August that Google violated Section 2 of the Sherman Act. Eddy Cue, Apple’s senior vice president of software and services, testified on Google’s behalf about potential remedies.

Tuesday’s filing was the first time the judge had detailed his proposed remedies.

Analysts previously said that it may take years before Apple is forced to make changes in response to a Google suit ruling. Google has said it will appeal the ruling, and analysts say any remedies trial could last for up to two years. Google can also appeal the outcome of the remedies trial, and the Supreme Court can choose take a look at it once appeals are exhausted.

Google CEO Sundar Pichai (L) and Apple CEO Tim Cook (R) listen as U.S. President Joe Biden speaks during a roundtable with American and Indian business leaders in the East Room of the White House on June 23, 2023 in Washington, DC.

Anna Moneymaker | Getty Images

Default agreements

While Google contracts with companies such as Samsung and browser-maker Mozilla to be the default search engine on their platforms, the most important and biggest such “default agreement” deal is with Apple. Google paid all partners $26 billion in total to be the default search engine in 2021, according to documents discussed in court.

Google paid because it funnels traffic from Apple’s 1 billion iPhone users to its search engine, and the revenue is critical for the growth of Apple’s services business, which investors love because it is so much more profitable than hardware sales.

In addition to the licensing payments, Apple says that it uses Google because it’s the best search engine and that its priority is to offer the best tools to its customers.

Apple also has options if it cannot make Google the default search engine. Earlier this year, for example, Apple’s Cue said in court as a witness for Google that the iPhone maker is also considering adding AI search engines as options to its software.

“Cue’s testimony establishes that Google’s high revenue share payments deterred Apple from trying to capture for itself all the advertising rents that flow through the Safari browser’s default search box,” the judge wrote in Tuesday’s filing.

Apple’s revenue from Google is reported in its financials as advertising revenue, which is reported as part of the company’s Services business, which also includes AppleCare warranties, cloud services like iCloud, and digital content like apps and Apple Music.

WATCH: Federal judge rules Google does not have to divest Chrome

Federal judge rules Google does not have to divest Chrome

Continue Reading

Technology

Waymo starts testing in Denver, Seattle in bid to expand robotaxi service across U.S.

Published

on

By

Waymo starts testing in Denver, Seattle in bid to expand robotaxi service across U.S.

Waymo partners with Uber to bring robotaxi service to Atlanta and Austin.

Uber Technologies Inc.

Alphabet’s Waymo unit will begin test drives of its robotaxis in Denver and Seattle this week, with humans behind the wheel, the company said Tuesday.

“We will begin driving manually before validating our technology and operations for fully autonomous services in the future,” a company spokesperson said in an email. Waymo announced the tests in blog posts.

The autonomous vehicle venture aims to expand its driverless, ride-hailing service across the U.S. after already launching commercial operations in Austin, Texas, as well as Atlanta, San Francisco, Phoenix and Los Angeles.

In some markets, including Austin and Atlanta, Waymo’s driverless rides can only be hailed through the Uber app. In others, riders must use the company’s stand-alone Waymo One app to book a robotaxi.

Safety drivers, who are employees of Waymo, will man the steering and braking behind the test vehicles in Denver and Seattle. The company is also running similar tests with its robotaxis in New York, having recently obtained permits in the biggest U.S. market.

The company’s test fleet in Denver and in Seattle will include a mix of their fully electric Jaguar iPace and Geely Zeekr AVs.

Waymo told CNBC that it will have up to a dozen cars each in Denver and Seattle to start testing.

Waymo’s primary competition on the global stage is Baidu-owned Apollo Go in China, which operates driverless ride-hailing services across Asia. Meanwhile, Tesla has obtained a permit to operate a ride-hailing business in Texas, and is testing a manned robotaxi service in Austin and another in San Francisco.

Don’t miss these insights from CNBC PRO

Waymo begins testing self-driving cars with human drivers in New York and Philadelphia

Continue Reading

Trending