Cohere co-founder Nick Frosst is surrounded by chatter of artificial general intelligence, or AGI. He’s perfectly happy to stay out of the conversation.
Founded in 2019, by ex-Google AI researchers, Cohere is valued in the billions of dollars and is one of the more high-profile names in the world of generative AI, which has exploded since OpenAI debuted ChatGPT in late 2022.
But it’s not a company that’s well known among consumers, who have swarmed to chatbots and other tools from OpenAI, Google and Perplexity. Rather, Cohere is all about business.
“I’m in meetings with companies in health care, banking and IT all the time,” Frosst told CNBC in an interview this week. “The questions I get are about securely automating tasks like HR, payrolls, research and fraud detection to drive productivity. No one has ever asked me about achieving AGI, let alone ASI.”
The latter is short for artificial superintelligence, or AI that significantly surpasses human intelligence. OpenAI and Anthropic have both made it their goal to achieve it.
In its latest funding round in July, Cohere raised $500 million at a $5.5 billion valuation, more than doubling its valuation from the prior year. Investors in the company include Nvidia, AMD, Salesforce and Oracle.
While that would historically be a huge price tag for a company that’s not even five years old, it’s a fraction of what investors are paying for OpenAI, valued at $157 billion in a round announced in October, and Anthropic, which CNBC confirmed this week is in talks to raise funding at a $60 billion valuation.
Some of Cohere’s chief competitors in the AI arms race offer products for both consumers and businesses. OpenAI, for instance, launched ChatGPT Enterprise in 2023, and Anthropic rolled out Claude Enterprise in September.
Frosst said Cohere’s preference for the enterprise is centered around the idea that large language models are best at automating tedious tasks and “being a co-worker.”
“Really, it’s an automation tool,” Frosst said. “When I think about my personal life, there’s actually not a ton that I want to automate. I don’t want to write text messages to my friends faster. I don’t want to respond to emails more efficiently in my own life. But in my work life, I really, really do want to do that.”
Frosst said, “I want to be free to think creatively and not be bogged down.”
Shortly after closing its funding round in July, Cohere cut about 20 jobs. A company representative said at the time it was an “internal realignment” and that Cohere had a “clear vision for the future.”
That vision includes going all-in on AI agents.
While the term AI agents isn’t neatly defined, it’s generally meant to describe AI services that go a step beyond chatbots. Agents are typically designed for specific business functions, rather than general purpose, and can be customized on the big AI models.
They can perform multistep, complex tasks on a user’s behalf and generate their own to-do lists, so that users don’t have to walk them through the process step-by-step.
Staying capital efficient
On Thursday, Cohere debuted its early access program for its AI agent platform called North, which is focused on allowing users with any level of technical background to “instantly customize and deploy AI agents” and do so “with just a few clicks,” the company said in a press release. Users can search for information across their organizations in multiple languages and in divisions with programs that weren’t previously connected.
That includes summarizing questions and answers in HR, speeding up the amount of time spent on finance reports and automating some core business functions in customer support and IT.
Frosst said that the platform can be used in any industry, but the company plans to target finance and health care, where data privacy and regulation are paramount.
Martin Kon, Cohere’s operating chief, told CNBC in March that by staying focused on enterprise AI, the company is able to run efficiently and keep expen under control even amid a chip shortage, rising costs for Nvidia’s graphics processing units (GPUs) and ever-changing licensing fees for AI models.
Frosst says those dynamics are still at play, allowing Cohere to be “more capital-efficient,” which is increasingly “of interest to investors.” Rivals with popular consumer-facing AI products, he said, use a lot of compute on “consumer applications and science projects.”
Although the sales cycle for enterprise AI can be longer, Frosst said, “the recurring business we’ve been able to create is something that’s really resonating with investors now.”
Competition is stiff and the technology is quickly evolving.
In October, Anthropic said its AI agents had the ability to use a computer like a human would in order to complete complex tasks. The feature, called Computer Use, allows its technology to interpret what’s on a computer screen, select buttons, enter text, navigate websites and execute tasks through any software and real-time internet browsing.
OpenAI reportedly plans to introduce a similar feature soon. And last year, executives from Microsoft, Meta and Google regularly touted their goals to push AI assistants to become increasingly productive.
Even without a consumer business, Cohere has to spend heavily on Nvidia’s costly GPUs, which are in huge demand for companies that are training models and running big workloads. In Cohere’s early days, the company secured a reserve of Google chips to help it pretrain its models. Over the past year, Cohere has moved more toward Nvidia’s H100 GPUs.
“We’ve increased our spend on them, because they’re working really well,” Frosst said.
Tik Tok creators gather before a press conference to voice their opposition to the “Protecting Americans from Foreign Adversary Controlled Applications Act,” pending crackdown legislation on TikTok in the House of Representatives, on Capitol Hill in Washington, U.S., March 12, 2024.
Craig Hudson | Reuters
The Supreme Court on Friday will hear oral arguments in the case involving the future of TikTok in the U.S., which could ban the popular app as soon as next week.
The justices will consider whether the Protecting Americans from Foreign Adversary Controlled Applications Act, the law that targets TikTok’s ban and imposes harsh civil penalties for app “entities” that continue to carry the service after Jan.19, violates the U.S. Constitution’s free speech protections.
It’s unclear when the court will hand down a decision, and if China’s ByteDance continues to refuse to divest TikTok to an American company, it faces a complete ban nationwide.
What will change about the user experience?
The roughly 115 million U.S. TikTok monthly active users could face a range of scenarios depending on when the Supreme Court hands down a decision.
If no word comes before the law takes effect on Jan. 19 and the ban goes through, it’s possible that users would still be able to post or engage with the app if they already have it downloaded. However, those users would likely be unable to update or redownload the app after that date, multiple legal experts said.
Thousands of short-form video creators who generate income from TikTok through ad revenue, paid partnerships, merchandise and more will likely need to transition their businesses to other platforms, like YouTube or Instagram.
“Shutting down TikTok, even for a single day, would be a big deal, not just for people who create content on TikTok, but everyone who shares or views content,” said George Wang, a staff attorney at the Knight First Amendment Institute who helped write the institute’s amicus briefs on the case.
“It sets a really dangerous precedent for how we regulate speech online,” Wang said.
Who supports and opposes the ban?
Dozens of high-profile amicus briefs from organizations, members of Congress and President-elect Donald Trump were filed supporting both the government and ByteDance.
The government, led by Attorney General Merrick Garland, alleges that until ByteDance divests TikTok, the app remains a “powerful tool for espionage” and a “potent weapon for covert influence operations.”
Trump’s brief did not voice support for either side, but it did ask the court to oppose banning the platform and allow him to find a political resolution that allows the service to continue while addressing national security concerns.
The short-form video app played a notable role in both Trump and Democratic nominee Kamala Harris’ presidential campaigns in 2024, and it’s one of the most common news sources for younger voters.
In a September Truth Social post, Trump wrote in all caps Americans who want to save TikTok should vote for him. The post was quoted in his amicus brief.
What comes next?
It’s unclear when the Supreme Court will issue its ruling, but the case’s expedited hearing has some predicting that the court could issue a quick ruling.
The case will have “enormous implications” since TikTok’s user base in the U.S. is so large, said Erwin Chemerinsky, dean of Berkeley Law.
“It’s unprecedented for the government to prohibit platforms for speech, especially one so many people use,” Chemerinsky said. “Ultimately, this is a tension between free speech issues on the one hand and claims of national security on the other.”
Nvidia CEO Jensen Huang speaks about Project Digits personal AI supercomputer for researchers and students during a keynote address at the Consumer Electronics Show (CES) in Las Vegas, Nevada on January 6, 2025. Gadgets, robots and vehicles imbued with artificial intelligence will once again vie for attention at the Consumer Electronics Show, as vendors behind the scenes will seek ways to deal with tariffs threatened by US President-elect Donald Trump. The annual Consumer Electronics Show (CES) opens formally in Las Vegas on January 7, 2025, but preceding days are packed with product announcements. (Photo by Patrick T. Fallon / AFP) (Photo by PATRICK T. FALLON/AFP via Getty Images)
Patrick T. Fallon | Afp | Getty Images
Nvidia CEO Jensen Huang was greeted as a rock star this week CES in Las Vegas, following an artificial intelligence boom that’s made the chipmaker the second most-valuable company in the world.
At his nearly two-hour keynote on Monday kicking off the annual conference, Huang packed a 12,000-seat arena, drawing comparisons to the way Steve Jobs would reveal products at Apple events.
Huang concluded with an Apple-like trick: a surprise product reveal. He presented one of Nvidia’s server racks and, using some stage magic, held up a much smaller version, which looked like a tiny cube of a computer.
“This is an AI supercomputer,” Huang said, while donning an alligator skin leather jacket. “It runs the entire Nvidia AI stack. All of Nvidia’s software runs on this.”
Huang said the computer is called Project Digits and runs off a relative of the Grace Blackwell graphics processing units (GPUs) that are currently powering the most advanced AI server clusters. The GPU is paired with an ARM-based Grace central processing unit (CPU). Nvidia worked with Chinese semiconductor company MediaTek to create the system-on-a chip called GB10.
Formerly known as the Consumer Electronics Show, CES is typically the spot to launch flashy and futuristic consumer gadgets. At this year’s show, which started on Tuesday and wraps up on Friday, several companies announced AI integrations with appliances, laptops and even grills. Other major announcements included a laptop from Lenovo which has a rollable screen that can expand vertically. There were also new robots, including a Roomba competitor with a robotic arm.
Unlike Nvidia’s traditional GPUs for gaming, Project Digits isn’t targeting consumers. instead, it’s aimed at machine learning researchers, smaller companies, and universities that want to developed advanced AI but don’t have the billions of dollars to build massive data centers or buy enough cloud credits.
“There’s a gaping hole for data scientists and ML researchers and who are actively working, who are actively building something,” Huang said. “Maybe you don’t need a giant cluster. You’re just developing the early versions of the model, and you’re iterating constantly. You could do it in the cloud, but it just costs a lot more money.”
The supercomputer will cost about $3,000 when it becomes available in May, Nvidia said, and will be available from the company itself as well as some of its manufacturing partners. Huang said Project Digits is a placeholder name, indicating it may change by the time the computer goes on sale.
“If you have a good name for it, reach out to us,” Huang said.
Diversifying its business
It’s a dramatically different kind of product from the GPUs that have driven Nvidia’s historic boom in the past two years. OpenAI, which launched ChatGPT in late 2022, and other AI model creators like Anthropic have joined with large cloud providers in snapping up Nvidia’s data center GPUs because of their ability to power the most intensive models and computing workloads.
Data center sales accounted for 88% of Nvidia’s $35 billion in revenue in the most recent quarter.
Wall Street is focused on Nvidia’s ability to diversify its business so that it’s less reliant on a handful of customers buying massive AI systems.
The Nvidia Project Digits supercomputer during the 2025 CES event in Las Vegas, Nevada, US, on Wednesday, Jan. 8, 2025.
Bridget Bennett | Bloomberg | Getty Images
“It was a little scary to see Nvidia come out with something so good for so little in price,” Melius Research analyst Ben Reitzes wrote in a note this week. He said Nvidia may have “stolen the show,” due to Project Digits as well other announcements including graphics cards for gaming, new robot chips and a deal with Toyota.
Project Digits, which runs Linux and the same Nvidia software used on the company’s GPU server clusters, represents a huge increase in capabilities for researchers and universities, said David Bader, director of the Institute for Data Science at New Jersey Institute of Technology.
Bader, who has worked on research projects with Nvidia in the past, said the computer appears to be able to handle enough data and information to train the biggest and most cutting-edge models. He told CNBC Anthropic, Google, Amazon and others “would pay $100 million to build a super computer for training” to get a system with these sorts of capabilities.
For $3,000, users can soon get a product they can plug into a standard electrical outlet in their home or office, Bader said. It’s particularly exciting for academics, who have often left for private industry in order to access bigger and more powerful computers, he said.
“Any student who is able to have one of these systems that cost roughly the same as a high-end laptop or gaming laptop, they’ll be able to do the same research and build the same models,” Bader said.
Reitzes said the computer may be Nvidia’s first move into the $50 billion market for PC and laptop chips.
“It’s not too hard to imagine it would be easy to just do it all themselves and allow the system to run Windows someday,” Reitzes wrote. “But I guess they don’t want to step on too many toes.”
Huang didn’t rule out that possibility when asked about it by Wall Street analysts on Tuesday.
He said that MediaTek may be able to sell the GB10 chip to other computer makers in the market. He made sure to leave some mystery in the air.
Alice Weidel, co-leader of the far-right Alternative for Germany (AfD) political party, arrives to speak to the media with AfD co-leader Tino Chrupalla shortly after the AfD leadership confirmed Weidel as the party’s candidate for chancellor on December 07, 2024 in Berlin, Germany.
Maryam Majd | Getty Images
Elon Musk used his social network X to promote Germany’s far-right Alternative for Germany party, known as AfD, hosting a live discussion Thursday with party leader Alice Weidel, a candidate for chancellor, ahead of a general election on Feb. 23.
“I’m really strongly recommending that people vote for AfD,” Musk, who is CEO of Tesla and SpaceX in addition to his role at X, said about a half hour into the conversation. “That’s my strong recommendation.”
The AfD has been classified as a “suspected extremist organization” by German domestic intelligence services. The party’s platform calls for rigid asylum laws, mass deportations, cuts to social and welfare support in Germany, and the reversal of restrictions on combustion engine vehicles.
Thierry Breton, former European Union commissioner for the internal market, said in a Jan. 4 post on X directed at Weidel: “As a European citizen concerned with the proper use of systemic platforms authorized to operate in the EU … especially to protect our democratic rules against illegal or misbehavior during election times, I believe it’s crucial to remind you” that a live discussion on X would give AfD and Weidel “a significant and valuable advantage over your competitors.”
While AfD has amassed about 20% of public support, according to reporting from broadcaster DW, the party is unlikely to form part of a coalition government, as most other parties have vowed not to work with it.
AfD previously protested the build-out of Tesla’s electric vehicle factory outside Berlin, in part because the factory would provide jobs to people who were not German citizens.
Musk’s earlier endorsements of AfD, including tweets complimenting the party and an editorial in a German newspaper, have enraged European government officials. Musk, the wealthiest person in the world, has also endorsed far-right and anti-establishment candidates and causes in the U.K.
Political leaders in France, Germany, Norway and the U.K. denounced his influence, NBC News previously reported, warning that Musk should not involve himself in their countries’ elections.
Musk, who was one of President-elect Donald Trump’s top backers in November’s election, previously promoted Trump in a live-streamed discussion on X. Before that, he hosted a conversation with Florida Gov. Ron DeSantis, who lost to Trump in the Republican primary.
Weidel during Thursday’s talk asked Musk about what Trump might do to bring Russia’s war in Ukraine to a conclusion, as the president-elect has suggested he could quickly do.
Musk demurred.
“To be clear this is up to President Trump, he is commander and chief, so it’s really up to him,” Musk said. “I don’t want to speak for him but you know I do think that there is a path to a resolution but it does require strong leadership in the United States to get this done.”
Musk also weighed in on what he thought should be done in Gaza, which has been under attack from Israel since Hamas’ deadly incursion into Israel on Oct. 7, 2023.
“There’s no choice but to eliminate those who wish to eliminate the state of Israel, you know Hamas essentially,” Musk said. “Then, the second step is to fix the education so that Palestinians are not trained from when they are children to hate and want the death of Israel.”
“Then, the third thing, which is also very important, is to make the Palestinian areas prosperous.”