Connect with us

Published

on

Generative AI has been a rare bright spot in a European tech market reeling from declining funding and a pullback in valuations.

Yuichiro Chino | Moment | Getty Images

The European Parliament has approved the bloc’s landmark rules for artificial intelligence, known as the EU AI Act, clearing a key hurdle for the first formal regulation of AI in the West to become law.

The rules are the first comprehensive regulations for AI, which has become a key battleground in the global tech industry, as companies compete for a leading role in developing the technology — particularly generative AI, which can generate new content from user prompts.

What generative AI is capable of, from producing music lyrics to generating code, has wowed academics, businesspeople, and even school students. But it has also led to worries around job displacement, misinformation, and bias.

During a critical Wednesday vote, the Parliament adopted the AI Act with 499 votes in favor, 28 against and 93 abstentions. The regulation is far from becoming law, but it is likely to be one of the first formal rules for the technology globally.

European Parliament members agreed to bring generative AI tools like ChatGPT under greater restrictions. Generative AI developers will be required to submit their systems for review before releasing them commercially.

The Parliament also decided to hold firm with a ban on real-time biometric identification systems, as well as controversial “social scoring” systems.

Human rights campaigners had expressed concern over an attempt by the European People’s Party to water down the ban. Lawmakers nevertheless pressed ahead with it and agreed to prohibit biometric surveillance from all public settings.

The laws have huge implications for developers of generative AI models, such as the Microsoft-backed OpenAI’s ChatGPT and Google’s Bard.

Jens-Henrick Jepenssen, senior director of public policy at Workday, said that the AI Act aims to “build safeguards on the development and use of these technologies to ensure we have an innovation-friendly environment for these technologies such that society can benefit from them.”

“Those are the right goals in my view,” he told CNBC after the vote.

The next stage is for negotiators at EU institutions, such as the EU executive body and 27 member states.

Earlier in the day, Github CEO Thomas Dohmke called on European regulators to listen to the private sector, as it pushed ahead with rules for AI.

“We encourage the European Union and the US government to move really fast and listen to those that built the technology, not only in the commercial business, but also in universities, in the open-source communities,” Dohmke told CNBC’s Arjun Kharpal.

It comes as countries around the world are looking to bring in rules and standards for AI.

On Monday, U.K. Prime Minister Rishi Sunak made a bold pitch to make the U.K. the “geographical home” of AI safety regulation. The government is also gearing up to hold a global summit on AI safety later this year.

WATCH: A.I. regulation is almost trying to move in parallel with innovation, Goldman Sachs says

A.I. regulation is almost trying to move in parallel with innovation, Goldman Sachs says

Continue Reading

Technology

OpenAI introduces safety models that other sites can use to classify harms

Published

on

By

OpenAI introduces safety models that other sites can use to classify harms

Sam Altman, CEO of OpenAI, attends the annual Allen and Co. Sun Valley Media and Technology Conference at the Sun Valley Resort in Sun Valley, Idaho, on July 8, 2025.

David A. Grogan | CNBC

OpenAI on Wednesday announced two reasoning models that developers can use to classify a range of online safety harms on their platforms. 

The artificial intelligence models are called gpt-oss-safeguard-120b and gpt-oss-safeguard-20b, and their names reflect their sizes. They are fine-tuned, or adapted, versions of OpenAI’s gpt-oss models, which the company announced in August. 

OpenAI is introducing them as so-called open-weight models, which means their parameters, or the elements that improve the outputs and predictions during training, are publicly available. Open-weight models can offer transparency and control, but they are different from open-source models, whose full source code becomes available for users to customize and modify.

Organizations can configure the new models to their specific policy needs, OpenAI said. And since they are reasoning models that show their work, developers will have more direct insight into how they arrive at a particular output. 

For instance, a product reviews site could develop a policy and use gpt-oss-safeguard models to screen reviews that might be fake, OpenAI said. Similarly, a video game discussion forum could classify posts that discuss cheating.

OpenAI developed the models in partnership with Robust Open Online Safety Tools, or ROOST, an organization dedicated to building safety infrastructure for AI. Discord and SafetyKit also helped test the models. They are initially available in a research preview, and OpenAI said it will seek feedback from researchers and members of the safety community.

As part of the launch, ROOST is establishing a model community for researchers and practitioners that are using AI models in an effort to protect online spaces.

The announcement could help OpenAI placate some critics who have accused the startup of commercializing and scaling too quickly at the expense of AI ethics and safety. The startup is valued at $500 billion, and its consumer chatbot, ChatGPT, has surpassed 800 million weekly active users. 

On Tuesday, OpenAI said it’s completed its recapitalization, cementing its structure as a nonprofit with a controlling stake in its for-profit business. OpenAI was founded in 2015 as a nonprofit lab, but has emerged as the most valuable U.S. tech startup in the years since releasing ChatGPT in late 2022.

“As AI becomes more powerful, safety tools and fundamental safety research must evolve just as fast — and they must be accessible to everyone,” ROOST President Camille François, said in a statement.

Eligible users can download the model weights on Hugging Face, OpenAI said.

WATCH: OpenAI finalizes recapitalization plan

OpenAI finalizes recapitalization plan

Continue Reading

Technology

Fiserv stock craters 44%, on pace for worst day ever after company slashes guidance

Published

on

By

Fiserv stock craters 44%, on pace for worst day ever after company slashes guidance

Cheng Xin | Getty Images News | Getty Images

Fiserv‘s stock plummeted 44% Wednesday and headed for its worst day ever after the fintech company cut its earnings outlook and shook up some of its leadership team.

“Our current performance is not where we want it to be nor where our stakeholders expect it to be,” wrote CEO Mike Lyons in a release.

For the full year, Fiserv now expects adjusted earnings of $8.50 to $8.60 a share for the year, down from a previous forecast of $10.15 and $10.30. Revenues are expected to grow 3.5% to 4%, versus a prior estimate of 10%.

Adjusted earnings came in at $2.04 per share, falling short of the LSEG estimate of $2.64. Revenues rose about 1% from a year ago to $4.92 billion, missing the $5.36 billion forecast. Net income grew to $792 million from $564 million in the year-ago period.

Along with the results, Fiserv announced a slew of executive and board changes.

Read more CNBC tech news

Beginning in December, operating chief Takis Georgakopoulos will serve as co-president with Dhivya Suryadevara, recent CEO of Optum Financial Services and Optum Insight at UnitedHealth Group. Fiserv also promoted Paul Todd to finance chief.

“We also have opportunities in front of us to improve our results and execution, and I am confident that these are the right leaders to help guide Fiserv to long-term success,” Lyons wrote in a separate release.

Fiserv also announced that Gordon Nixon, Céline Dufétel and Gary Shedlin would join its board at the beginning of 2026, with Nixon serving as independent chairman of the board. Shedlin is slated to lead the audit committee.

The Milwaukee, Wisconsin-based company also announced an action plan that Lyons said would better situate the company to “drive sustainable, high-quality growth” and reach its “full potential.”

Fiserv said it will move its stock from the NYSE to the Nasdaq next month, where it will trade under the ticker symbol “FISV.”

Fiserv did not immediately respond to CNBC’s request for comment.

Continue Reading

Technology

Character.AI to block romantic AI chats for minors a year after teen’s suicide

Published

on

By

Character.AI to block romantic AI chats for minors a year after teen's suicide

Cfoto | Future Publishing | Getty Images

Character.AI on Wednesday announced that it will soon shut off the ability for minors to have free-ranging chats, including romantic and therapeutic conversations, with the startup’s artificial intelligence chatbots.

The Silicon Valley startup, which allows users to create and interact with character-based chatbots, announced the move as part of an effort to make its app safer and more age-appropriate for those under 18.

Last year, 14-year-old Sewell Setzer III, committed suicide after forming sexual relationships with chatbots on Character.AI’s app. Many AI developers, including OpenAI and Facebook-parent Meta, have come under scrutiny after users have committed suicide or died after forming relationships with chatbots.

As part of its safety initiatives, Character.AI said on Wednesday that it will limit users under 18 to two hours of open-ended chats per day, and will eliminate those types of conversations for minors by Nov. 25.

“This is a bold step forward, and we hope this raises the bar for everybody else,” Character.AI CEO Karandeep Anand told CNBC.

Character.AI introduced changes to prevent minors from engaging in sexual dialogues with its chatbots in October 2024. The same day, Sewell’s family filed a wrongful death lawsuit against the company.

To enforce the policy, the company said it’s rolling out an age assurance function that will use first-party and third-party software to monitor a user’s age. The company is partnering with Persona, the same firm used by Discord and others, to help with verification.

In 2024, Character.AI’s founders and certain members of its research team joined Google DeepMind, the company’s AI unit DeepMind. It’s one of a number of such deals announced by leading tech companies to speed their development of AI products and services. The agreement called for Character.AI to provide Google with a non-exclusive license for its current large language model, or LLM, technology.

Since Anand took over as CEO in June, 10 months after the Google deal, Character.AI has added more features to diversify its offering from chatbot conversations. Those features include a feed for watching AI-generated videos as well as storytelling and roleplay formats.

Although Character.AI will no longer allow teenagers to engage in open-ended conversations on its app, those users will still have access to the app’s other offerings, said Anand, who was previously an executive at Meta.

Of the startup’s roughly 20 million monthly active users, about 10% are under 18. Anand said that percentage has declined as the app has shifted its focus toward storytelling and roleplaying.

The app makes money primarily through advertising and a $10 monthly subscription. Character.AI is on track to end the year with a run rate of $50 million, Anand said.

Additionally, the company on Wednesday announced that it will establish and fund an independent AI Safety Lab dedicated to safety research for AI entertainment. Character.AI didn’t say how much it will provide in funding, but the startup said it’s inviting other companies, academics, researchers and policy makers to join the nonprofit effort.

Regulatory pressure

Character.AI is one of many AI chatbot companies facing regulatory scrutiny on the matter of teens and AI companions.

In September, the Federal Trade Commission issued an order to seven companies including, Character.AI’s parent, as well as Alphabet, Meta, OpenAI and Snap, to understand the potential effects on children and teenagers.

On Tuesday, Senators Josh Hawley, R-Mo, and Richard Blumenthal, D-Conn, announced legislation to ban AI chatbot companions for minors. California Gov. Gavin Newsom signed a law earlier this month requiring chatbots to disclose they are AI and tell minors to take a break every three hours.

Why it’s time to take AI-human relationships seriously

Rival Meta, which also offers AI chatbots, announced safety features in October that will allow parents to see and manage how their teenagers are interacting with AI characters on the company’s platforms. Parents have the option to turn off one-on-one chats with AI characters completely and can block specific AI characters.

The matter of sexualized conversations with AI chatbots has come into focus as tech companies announce different approaches to dealing with the issue.

Earlier this month, Sam Altman announced that OpenAI would allow adult users to engage in erotica with ChatGPT later this year, saying that his company is “not the elected moral police of the world.”

Microsoft AI CEO Mustafa Suleyman said last week that the software company will not provide “simulated erotica,” describing sexbots as “very dangerous.” Microsoft is a key investor and partner to OpenAI.

The race to develop more realistic human-like AI companions has been growing in Silicon Valley since ChatGPT’s launch in late 2022. While some people are creating deep connections with AI characters, the speedy development presents ethical and safety concerns, especially for children and teenagers. 

“I have a six-year-old as well, and I want to make sure that she grows up in a safe environment with AI,” Anand said.

If you are having suicidal thoughts or are in distress, contact the Suicide & Crisis Lifeline at 988 for support and assistance from a trained counselor.

Continue Reading

Trending