Nvidia-backed AI startup Synthesia now lets you make multilingual video presentations using just your phone or webcam
Synthesia launched an option to make AI-generated avatars by recording footage of yourself with a webcam or your phone.
Synthesia
Synthesia, a British artificial intelligence startup, on Monday showed off a slew of new product updates including the ability to create your own Apple-style key presentations with AI avatars by using just a laptop webcam or your phone.
The seven-year-old firm, which is backed by Nvidia, said the new product updates will make it more of an all-encompassing video production suite for large companies, rather than just a platform that offers users the ability to create AI-generated avatars.
Among the new updates Synthesia is launching is the ability to produce AI avatars using webcams or a phone, “full body” avatars with hands and arms, and a screen recording tool that shows an AI avatar guiding you through what you’re watching.
What is Synthesia?
Synthesia, which says it’s used by nearly half of the Fortfune 500, uses AI avatars for all kinds of purposes.
These can range from creating tailored training videos to guide employees around certain processes, or generating promotional material that can be shown in the form of a video rather than an email or other textual communications.
But that hasn’t always been the case. According to co-founder and CEO Victor Riparbelli, in the first three years of the company’s story, Synthesia actually started out trying to sell its technology to Hollywood agencies and big-budget video production companies. The firm used computer vision for an AI dubbing tool that made mouth movements more lifelike for different languages.
“What we figured out was that the quality threshold to do anything with these guys was so big, no matter what we do, we’ll be a very small part of a much bigger process,” Riparbelli told CNBC in an interview at the firm’s London office.
“What was more interesting was the democratization aspect of: There are millions of people in the world who want to make video, but they’re not making video today because they don’t have the budget.”
In an Apple-style keynote, Synthesia’s CEO unveiled the firm’s new products, touting them as a more productivity-focused suite of tools for use by businesses, rather than just a platform that offers AI avatars.
Apple-style keynotes with a webcam
One of the biggest new features the firm showed off was an option to make AI-generated avatars by recording less than five minutes of footage using a webcam or your phone. You can also clone your voice to have the avatars speak in multiple different languages
Typically, to make an AI avatar using Synthesia’s platform, you have to go into a studio in-person. Human actors go into a recording booth, record their voice, and perform lines in front of a green screen on an actual filming set.
This is all training data to provide Synthesia’s AI algorithm with the facial and vocal nuances it needs to come up with humanlike avatars that speak in an expressive way. Earlier this year, Synthesia debuted new expressive avatars that can convey human emotions, including happiness, sadness, and frustration.
But now, Synthesia is introducing new software which will make it easier for users to produce a digital version of themselves from anywhere, using just a webcam and Synthesia’s software.
The company is also launching the ability to create full-body avatars. This is different to Synthesia’s current avatars, which are limited to just portrait view. Now, you can go into a studio with dozens of cameras, sensors and lights all around you to make avatars that can move their hands.
Generating hands is something that’s traditionally hard for AI to do — often because hands are only a small part of the human body and not typically the focus in visual content.
Synthesia also debuted the option to play videos of AI avatars speaking in any language they like, whether it’s English, French, German, or Chinese.
In the future, Synthesia says, it will be able to tailor AI avatars for different countries: For example, a Nigerian avatar running a user through a tutorial rather than an American.
Synthesia’s AI video assistant can produce summaries of entire articles and documents.
Synthesia
Synthesia also launched a new AI video assistant which can produce summaries of entire articles and documents. This could be a human resources specialist making a quick video explaining company benefits packages, for example.
Synthesia’s screen recording tool shows an AI avatar guiding you through what you’re watching.
Synthesia
Another big feature the company is rolling out is a new screen recording tool, which shows an AI avatar guiding you through what you’re watching.
Not chasing a ‘PR moment’
In CNBC’s interview with him, Riparbelli characterized what Synthesia is trying to do as an enterprise-focused product overhaul, which would make it more akin to giants like Microsoft, Salesforce, and Zoom in the enterprise category.
“The world has been blown away by this stuff for the last 12 to 18 to 24 months, which is awesome,” Riparbelli told CNBC.
“But now we have experimented a lot, and we have found out the right use cases for these technologies that have lasting business value. They’re not like just a short-term PR moment.”
“You need to do that business goal of reducing customer support tickets by showing videos instead of text; or sell by making videos instead of just sending out emails,” he added.
“Now people are creating workflows around that. They need better ways to achieve their business goals, not just an interface with AI models. That’s where we’re going as a company.”
Last year, Synthesia raised $90 million from investors including U.S. chipmaker Nvidia and venture capital firm Accel, in a funding round that valued it at $1 billion and giving it “unicorn” status.
The company’s competitors include AI video tools Veed, Colossyan, Elai, and HeyGen. And Chinese-owned social media app TikTok also recently debuted Symphony Assistant, a product that allows creators to make their own AI avatars.
The company makes money through a number of subscription pricing plans ranging from $22 for a “starter” plan and $67 for a “creator” plan, to custom “enterprise” plans where pricing is based on negotiations with Synthesia’s sales team.
Oracle stock dipped about 5% on Wednesday following a report that discussions with Blue Owl Capital on backing a $10 billion data center in Michigan had stalled, although the cloud company later disputed the report.
Blue Owl had been in talks with Oracle about funding a 1-gigawatt facility for OpenAI in Saline Township, Michigan, according to the Financial Times.
However, the plans fell through due to concerns about Oracle’s rising debt levels and extensive artificial intelligence spending, the FT reported, citing people familiar with the matter.
This comes as some investors raise red flags about the funding behind the rush to build ever more data centers.
The concern is that some hyperscalers are turning to private equity markets rather than funding the buildings themselves, and entering into lease agreements that could prove risky.
Blue Owl did look into the project, but pulled out due to unfavorable debt terms and the structure of repayments, according to a person familiar with the company’s plans who asked not to be named in order to discuss a confidential matter.
Blue Owl is still involved in two other Oracle sites, the person said.
The person added that Blue Owl was also concerned that local politics in Michigan would cause construction delays.
Oracle later responded to the FT report, saying the project was moving forward and that Blue Owl was not part of equity talks.
“Our development partner, Related Digital, selected the best equity partner from a competitive group of options, which in this instance was not Blue Owl. Final negotiations for their equity deal are moving forward on schedule and according to plan,” Oracle spokesperson Michael Egbert said in a statement.
The cloud company did not name the firm involved in current equity talks for the project.
CNBC has reached out to the FT for comment.
The FT said that Blackstone is in discussions to potentially replace Blue Owl Capital as a financial partner for the data center, although no deal has been signed yet.
Blue Owl Capital has been the primary investor in Oracle’s data center projects in the U.S., including a $15 billion center in Abilene, Texas, and an $18 billion site in New Mexico, the FT said.
“This appears to be a case where the deal simply wasn’t the right one, and seasoned investors understand that success does not require winning every transaction,” Evercore ISI analysts wrote in a note on Wednesday.
The bank added that digital infrastructure remains a “core growth vertical” for the Blue Owl, noting an upcoming digital infrastructure fund in 2026 that would add to its $7 billion fund announced in May.
Oracle has $248 billion in lease commitments for data centers and cloud capacity commitments over the next 15 to 19 years as of Nov. 30, the company said in its latest quarterly filing. That is up almost 148% from August.
In September, the cloud computing giant raised $18 billion in new debt, according to an SEC filing. That same month, OpenAI announced a $300 billion partnership with Oracle over the next five years.
By the end of November, the company owed over $124 billion, including operating lease liabilities, according to the filing.
Oracle shares are down about 50% from the high of $345.72 reached in September.
Read the full FT story here.
Year-to-date Oracle stock chart.
-
Sports2 years agoStory injured on diving stop, exits Red Sox game
-
Sports3 years ago‘Storybook stuff’: Inside the night Bryce Harper sent the Phillies to the World Series
-
Sports2 years agoGame 1 of WS least-watched in recorded history
-
Sports3 years agoButton battles heat exhaustion in NASCAR debut
-
Sports3 years agoMLB Rank 2023: Ranking baseball’s top 100 players
-
Sports4 years ago
Team Europe easily wins 4th straight Laver Cup
-
Environment3 years agoJapan and South Korea have a lot at stake in a free and open South China Sea
-
Environment1 year agoHere are the best electric bikes you can buy at every price level in October 2024