Connect with us

Published

on

For about a quarter century, Nvidia has been leading the revolution in computer graphics, becoming a beloved brand by gamers along the way.

Nvidia dominates the market for graphics processing units (GPUs), which it entered in 1999 with the GeForce 256. Gaming brought in over $9 billion in revenue for Nvidia last year despite a recent downturn.

But Nvidia’s latest earnings beat points to a new phenomenon in the GPU business. The technology is now at the center of the boom in artificial intelligence.

“We had the good wisdom to go put the whole company behind it,” CEO Jensen Huang told CNBC in an interview last month. “We saw early on, about a decade or so ago, that this way of doing software could change everything. And we changed the company from the bottom all the way to the top and sideways. Every chip that we made was focused on artificial intelligence.”

As the engine behind large language models (LLMs) like ChatGPT, Nvidia is finally reaping rewards for its early investment in AI. That’s helped to cushion the blow from broader semiconductor industry struggles tied to U.S.-China trade tensions and a global chip shortage

Not that Nvidia is immune to geopolitical concerns. In October, the U.S. introduced sweeping new rules that banned exports of leading-edge AI chips to China. Nvidia counts on China for about one-quarter of its revenue, including sales of its popular AI chip, the A100.

“It was a turbulent month or so as the company went upside down to reengineer all of our products so that it’s compliant with the regulation and yet still be able to serve the commercial customers that we have in China,” Huang said. “We’re able to serve our customers in China with the regulated parts, and delightfully support them.”

AI will be a major focus of Nvidia’s annual GTC developer conference taking place from March 20-23. Ahead of the conference, CNBC sat down with Huang at Nvidia’s headquarters in Santa Clara, California, to discuss the company’s role at the heart of the explosion in generative AI.

“We just believed that someday something new would happen, and the rest of it requires some serendipity,” Huang said, when asked whether Nvidia’s fortunes are the result of luck or prescience. “It wasn’t foresight. The foresight was accelerated computing.”

GPUs are Nvidia’s primary business, accounting for more than 80% of revenue. Typically sold as cards that plug into a PC’s motherboard, they add computing power to central processing units (CPUs) built by companies like AMD and Intel.

Now, tech companies scrambling to compete with ChatGPT are publicly boasting about how many of Nvidia’s roughly $10,000 A100s they have. Microsoft said the supercomputer developed for OpenAI used 10,000 of them.

Nvidia Founder and CEO Jensen Huang shows CNBC’s Katie Tarasov a Hopper H100 SXM module in Santa Clara, CA, on February 9, 2023.

Andrew Evers

“It’s very easy to use their products and add more computing capacity,” said Vivek Arya, semiconductor analyst for Bank of America Securities. “Computing capacity is basically the currency of the valley right now.”

Huang showed us the company’s next-generation system called H100, which has already started to ship. The H stands for Hopper.

“What makes Hopper really amazing is this new type of processing called transformer engine,” Huang said, while holding a 50-pound server board. “The transformer engine is the T of GPT, generative pre-trained transformer. This is the world’s first computer designed to process transformers at enormous scale. So large language models are going to be much, much faster and much more cost effective.”

Huang said he “hand-delivered” to ChatGPT maker OpenAI “the world’s very first AI supercomputer.”

Not afraid to bet it all

Today, Nvidia is among the world’s 10 most valuable tech companies, with a market cap of close to $600 billion. It has 26,000 employees and a newly built polygon-themed headquarters. It’s also one of the few Silicon Valley giants with a founder of 30 years still at the helm.

Huang, 60, immigrated to the U.S. from Taiwan as a kid and studied engineering at Oregon State University and Stanford. In the early 1990s, Huang and fellow engineers Chris Malachowsky and Curtis Priem used to meet at a Denny’s and talk about dreams of enabling PCs with 3D graphics.

The trio launched Nvidia out of a condo in Fremont, California, in 1993. The name was inspired by NV for “next version” and Invidia, the Latin word for envy. They hoped to speed up computing so much that everyone would be green with envy — so they chose the envious green eye as the company logo.

Nvidia founders Curtis Priem, Jensen Huang and Chris Malachowsky pose at the company’s Santa Clara, California, headquarters in 2020.

Nvidia

“They were one among tens of GPU makers at that time,” Arya said. “They are the only ones, them and AMD actually, who really survived because Nvidia worked very well with the software community, with the developers.”

Huang’s ambitions and preference for impossible-seeming ventures have pushed the company to the brink of bankruptcy a handful of times.

“Every company makes mistakes and I make a lot of them,” said Huang, who was one of Time magazine’s most influential people in 2021. “Some of them put the company in peril, especially in the beginning, because we were small and we’re up against very, very large companies and we’re trying to invent this brand-new technology.”

In the early 2010s, for example, Nvidia made an unsuccessful move into smartphones with its Tegra line of processors. The company then exited the space. 

In 1999, after laying off the majority of its workforce, Nvidia released what it claims was the world’s first official GPU, the GeForce 256. It was the first programmable graphics card that allowed custom shading and lighting effects. By 2000, Nvidia was the exclusive graphics provider for Microsoft’s first Xbox. In 2006, the company made another huge bet, releasing a software toolkit called CUDA.

“For 10 years, Wall Street asked Nvidia, ‘Why are you making this investment? No one’s using it.’ And they valued it at $0 in our market cap,” said Bryan Catanzaro, vice president of applied deep learning research at Nvidia. He was one of the only employees working on AI when he joined Nvidia in 2008. Now, the company has thousands of staffers working in the space.

“It wasn’t until around 2016, 10 years after CUDA came out, that all of a sudden people understood this is a dramatically different way of writing computer programs,” Catanzaro said. “It has transformational speedups that then yield breakthrough results in artificial intelligence.”

Although AI is growing rapidly, gaming remains Nvidia’s primary business. In 2018, the company used its AI expertise to make its next big leap in graphics. The company introduced GeForce RTX based on what it had learned in AI.

“In order for us to take computer graphics and video games to the next level, we had to reinvent and disrupt ourselves, change literally what we invented altogether,” Huang said. “We invented this new way of doing computer graphics, ray tracing, basically simulating the pathways of light and simulate everything with generative AI. And so we compute one pixel and we imagine with AI the other seven.”

‘Boom-or-bust cycle’

Taiwan Semiconductor Manufacturing Company’s U.S. office space in San Jose, CA, in 2021.

Katie Tarasov

Investors are right to be concerned about that level of dependence on a Taiwanese company. The U.S. passed the CHIPS Act last summer, which sets aside $52 billion to incentivize chip companies to manufacture on U.S. soil.

“The biggest risk is really U.S.-China relations and the potential impact of TSMC. If I’m a shareholder in Nvidia, that’s really the only thing that keeps me up at night,” said C.J. Muse, an analyst at Evercore. “This is not just a Nvidia risk, this is a risk for AMD, for Qualcomm, even for Intel.”

TSMC has said it’s spending $40 billion to build two new chip fabrication plants in Arizona. Huang told CNBC that Nvidia will “absolutely” use TSMC’s Arizona fabs to make its chips.

Then there are questions about demand and how many of the new use cases for GPUs will continue to show growth. Nvidia saw a spike in demand when crypto mining took off because GPUs became core to effectively competing in that market. The company even created a simplified GPU just for crypto. But with the cratering of crypto, Nvidia experienced an imbalance in supply and demand.

“That has created problems because crypto mining has been a boom-or-bust cycle,” Arya said. “Gaming cards go out of stock, prices get bid up, and then when the crypto mining boom collapses, then there is a big crash on the gaming side.”

Nvidia caused major sticker shock among some gamers last year by pricing its new 40-series GPUs far higher than the previous generation. Now there’s too much supply and, in the most recent quarter, gaming revenue was down 46% from a year earlier.

Competition is also increasing as more tech giants design their own custom-purpose chips. Tesla and Apple are doing it. So are Amazon and Google.

“The biggest question for them is how do they stay ahead?” Arya said. “Their customers can be their competitors also. Microsoft can try and design these things internally. Amazon and Google are already designing these things internally.”

For his part, Huang says that such competition is good.

“The amount of power that the world needs in the data center will grow,” Huang said. “That’s a real issue for the world. The first thing that we should do is: every data center in the world, however you decide to do it, for the goodness of sustainable computing, accelerate everything you can.”

In the car market, Nvidia is making autonomous-driving technology for Mercedes-Benz and others. Its systems are also used to power robots in Amazon warehouses, and to run simulations to optimize the flow of millions of packages each day.

Huang describes it as the “omniverse.”

“We have 700-plus customers who are trying it now, from [the] car industry to logistics warehouses to wind turbine plants,” Huang said. “It represents probably the single greatest container of all of Nvidia’s technology: computer graphics, artificial intelligence, robotics and physics simulation, all into one. And I have great hopes for it.”

Continue Reading

Technology

Waymo begins offering freeway robotaxi rides in San Francisco, LA and Phoenix

Published

on

By

Waymo begins offering freeway robotaxi rides in San Francisco, LA and Phoenix

Watch: Waymo launches paid robotaxi rides on freeways

Waymo robotaxis will now take passengers on freeways in three major U.S. cities, marking a major milestone for the driverless, ride-hailing company.

Alphabet-owned Waymo on Wednesday said it will begin offering those types of trips in the San Francisco, Phoenix and Los Angeles markets “when a freeway route is meaningfully faster.” The Google sister company will gradually extend freeway trips to more riders and locations over time.

Although Waymo’s driverless cars have previously taken passengers on smaller highways and side streets, Wednesday’s expansion marks the first time the company will take payment from public riders to go on freeways with higher speed limits.

“Freeway driving is one of those things that’s very easy to learn, but very hard to master when we’re talking about full autonomy without a human driver as a backup, and at scale,” Waymo co-CEO Dmitri Dolgov said at a press event ahead of the announcement. “It took time to do it properly.”

Waymo vehicles will generally travel up to a freeway’s maximum posted speed limit, which is 65 mph in many cases, the company said. However, a spokesperson confirmed, the robotaxis may sometimes go a few miles over the limit for safety purposes in extraordinary circumstances.

Freeway operations required expanded operational protocols, including coordination with safety officials at the California Highway Patrol and the Arizona Department of Public Safety, Waymo said. The company also installed additional infrastructure needed to charge its fleet of electric robotaxis given the freeway expansion.

Over the last year, Waymo has offered select Alphabet employees robotaxi freeway rides around San Francisco, Los Angeles and Phoenix in preparation for Wednesday’s launch, said Waymo Product Manager Jacopo Sannazzaro.

The company has been testing on freeways for more than a decade in total, he added. Besides testing on public roads and closed courses, Waymo also conducts testing in simulation to determine how its vehicles will respond to both typical and hard-to-replicate events, like merging onto freeways, lane-splitting motorcyclists or another car flipping over.

CNBC took a freeway test ride in a Waymo in the San Francisco Bay Area, from YouTube’s offices in San Bruno to San Mateo and back. The ride went on and off ramps along the California 101 seamlessly, with no incidents.

Waymo’s continued expansion

After already launching its robotaxi service in Austin, Texas, San Francisco, Phoenix and Los Angeles, Waymo has also announced plans to expand to Miami, San Diego and Washington, D.C., in 2026. The company is also testing its vehicles in New York City, Tokyo and plans to begin offering rides to the public in London next year.

Waymo on Wednesday also announced that it’s expanding its service footprint in the San Francisco Bay Area to San Jose. That includes rides to and from San Jose Mineta International Airport, marking the company’s second international airport destination. The SJC airport plans were first announced in September.

In 2023, Waymo launched at Phoenix Sky Harbor International Airport, which has become its most popular destination in the Phoenix metropolitan service area.

The company expanded its service in March to include an additional 27 square miles of coverage in the region, including cities like Mountain View and Palo Alto. After the Wednesday expansion, Waymo now offers service in about 260 square miles of Silicon Valley.

Would-be Waymo competitor Tesla also takes passengers to and from SJC. Customers can hail a ride via Tesla’s “Robotaxi” app, but that name is not precisely descriptive. Tesla only operates a car service with human drivers on board, not a commercial robotaxi service like Waymo’s, due to a mix of technical limits and permit requirements in California.

Continue Reading

Technology

AMD’s Lisa Su dismisses AI spending fears as stock rallies on growth projections: ‘It’s the right gamble’

Published

on

By

AMD's Lisa Su dismisses AI spending fears as stock rallies on growth projections: 'It's the right gamble'

AMD CEO Lisa Su dismisses AI spending fears: 'It's the right gamble'

Advanced Micro Devices‘ CEO Lisa Su shut down concerns over Big Tech’s elevated spending during an interview with CNBC’s “Squawk Box” on Wednesday and said investing in more computing will accelerate the pace of innovation.

“I don’t think it’s a big gamble,” she said. “I think it’s the right gamble.”

Many of AMD’s hyperscaler customers over the last 12 months have beefed up spending as the technology reaches an “inflection point” and companies can see the return on that spending, Su added.

Su’s comments come as tech’s megacaps announced more than $380 billion in AI spending in their latest earnings reports as the firms race to build out infrastructure to support soaring demand.

Read more CNBC tech news

On Tuesday, Su told analysts that AMD expects revenues to grow 35% per year over the next three to five years due to “insatiable” AI chip demand.

Shares were last up more than 7%.

Concerns of a potential AI bubble have jolted markets in recent sessions as Wall Street raises concerns that valuations have gotten too high.

Stock Chart IconStock chart icon

hide content

AMD 5-year stock chart.

Continue Reading

Technology

Coinbase moves incorporation to Texas from Delaware, following Musk’s lead

Published

on

By

Coinbase moves incorporation to Texas from Delaware, following Musk's lead

Brian Armstrong, chief executive officer of Coinbase Global Inc., speaks during the Messari Mainnet summit in New York, on Thursday, Sept. 21, 2023.

Michael Nagle | Bloomberg | Getty Images

Coinbase is following Tesla out of Delaware and into Texas.

Paul Grewal, Coinbase’s chief legal officer, wrote in a Wall Street Journal op-ed on Wednesday that the crypto exchange is moving its state of incorporation, a year after Elon Musk did the same with his electric vehicle maker. Musk also reincorporated his rocket maker SpaceX from Delaware to Texas.

“Delaware’s legal framework once provided companies with consistency. But no more,” Grawal wrote, pointing to recent “unpredictable outcomes” in the Delaware Chancery Court.

A handful of notable names, including Dropbox, TripAdvisor and venture firm Andreessen Horowitz have announced departures from Delaware. It’s a move that was championed by Musk following a Delaware Chancery Court ruling that ordered Tesla to rescind the CEO’s 2018 pay package, worth about $56 billion in options.

“If your company is still incorporated in Delaware, I recommend moving to another state as soon as possible,” Musk wrote in a post on X in February 2024, when he filed to change SpaceX’s incorporation state.

Read more CNBC tech news

Last week, Tesla shareholders voted to approve Musk’s more recent pay package, which could be worth up to $1 trillion.

Delaware has long been the dominant state for U.S. companies to incorporate due to its flexible corporate code and expert judiciary, and is seen as balancing the rights of executives and shareholders. A Texas state law allows corporations to limit shareholder lawsuits against insiders for breach of fiduciary duty. 

Coinbase and Andreessen Horowitz, an early backer, currently face a lawsuit in Delaware concerning the sale of shares in the crypto company tied to its public listing in 2021.

Like Musk, Coinbase CEO Brian Armstrong was a major contributor to President Donald Trump’s 2024 campaign for the White House.

— CNBC’s Lora Kolodny contributed to this report.

WATCH: Delaware Gov. Matt Meyer says laws didn’t change as a result of Musk

Delaware Gov. Matt Meyer: Our corporate laws did not change as a result of Elon Musk's Tesla case

Continue Reading

Trending