Connect with us

Published

on

Lisa Su displays an AMD Instinct MI300 chip as she delivers a keynote address at CES 2023 in Las Vegas, Nevada, Jan. 4, 2023.

David Becker | Getty Images

Meta, OpenAI, and Microsoft said at an AMD investor event Wednesday they will use AMD’s newest AI chip, the Instinct MI300X. It’s the biggest sign so far that technology companies are searching for alternatives to the expensive Nvidia graphics processors that have been essential for creating and deploying artificial intelligence programs such as OpenAI’s ChatGPT.

If AMD’s latest high-end chip is good enough for the technology companies and cloud service providers building and serving AI models when it starts shipping early next year, it could lower costs for developing AI models and put competitive pressure on Nvidia’s surging AI chip sales growth.

“All of the interest is in big iron and big GPUs for the cloud,” AMD CEO Lisa Su said Wednesday.

AMD says the MI300X is based on a new architecture, which often leads to significant performance gains. Its most distinctive feature is that it has 192GB of a cutting-edge, high-performance type of memory known as HBM3, which transfers data faster and can fit larger AI models.

Su directly compared the MI300X and the systems built with it to Nvidia’s main AI GPU, the H100.

“What this performance does is it just directly translates into a better user experience,” Su said. “When you ask a model something, you’d like it to come back faster, especially as responses get more complicated.”

The main question facing AMD is whether companies that have been building on Nvidia will invest the time and money to add another GPU supplier. “It takes work to adopt AMD,” Su said.

AMD on Wednesday told investors and partners that it had improved its software suite called ROCm to compete with Nvidia’s industry standard CUDA software, addressing a key shortcoming that had been one of the primary reasons AI developers currently prefer Nvidia.

Price will also be important. AMD didn’t reveal pricing for the MI300X on Wednesday, but Nvidia’s can cost around $40,000 for one chip, and Su told reporters that AMD’s chip would have to cost less to purchase and operate than Nvidia’s in order to persuade customers to buy it.

Who says they’ll use the MI300X?

AMD MI300X accelerator for artificial intelligence.

On Wednesday, AMD said it had already signed up some of the companies most hungry for GPUs to use the chip. Meta and Microsoft were the two largest purchasers of Nvidia H100 GPUs in 2023, according to a recent report from research firm Omidia.

Meta said it will use MI300X GPUs for AI inference workloads such as processing AI stickers, image editing, and operating its assistant.

Microsoft’s CTO, Kevin Scott, said the company would offer access to MI300X chips through its Azure web service.

Oracle‘s cloud will also use the chips.

OpenAI said it would support AMD GPUs in one of its software products, called Triton, which isn’t a big large language model like GPT but is used in AI research to access chip features.

AMD isn’t forecasting massive sales for the chip yet, only projecting about $2 billion in total data center GPU revenue in 2024. Nvidia reported more than $14 billion in data center sales in the most recent quarter alone, although that metric includes chips other than GPUs.

However, AMD says the total market for AI GPUs could climb to $400 billion over the next four years, doubling the company’s previous projection. This shows how high expectations are and how coveted high-end AI chips have become — and why the company is now focusing investor attention on the product line.

Su also suggested to reporters that AMD doesn’t think that it needs to beat Nvidia to do well in the market.

“I think it’s clear to say that Nvidia has to be the vast majority of that right now,” Su told reporters, referring to the AI chip market. “We believe it could be $400 billion-plus in 2027. And we could get a nice piece of that.”

Continue Reading

Technology

Elon Musk’s Neuralink filed as ‘disadvantaged business’ before being valued at $9 billion

Published

on

By

Elon Musk's Neuralink filed as 'disadvantaged business' before being valued at  billion

Jonathan Raa | Nurphoto | Getty Images

Elon Musk’s health tech company Neuralink labeled itself a “small disadvantaged business” in a federal filing with the U.S. Small Business Administration, shortly before a financing round valued the company at $9 billion.

Neuralink is developing a brain-computer interface (BCI) system, with an initial aim to help people with severe paralysis regain some independence. BCI technology broadly can translate a person’s brain signals into commands that allow them to manipulate external technologies just by thinking.

Neuralink’s filing, dated April 24, would have reached the SBA at a time when Musk was leading the Trump administration’s Department of Government Efficiency. At DOGE, Musk worked to slash the size of federal agencies.

MuskWatch first reported on the details Neuralink’s April filing.

According to the SBA’s website, a designation of SDB means a company is at least 51% owned and controlled by one or more “disadvantaged” persons who must be “socially disadvantaged and economically disadvantaged.” An SDB designation can also help a business “gain preferential access to federal procurement opportunities,” the SBA website says. 

Musk, the world’s wealthiest person, is CEO of Tesla and SpaceX, in addition to his other businesses like artificial intelligence startup xAI and tunneling venture The Boring Company. In 2022, Musk led the $44 billion purchase of Twitter, which he later named X before merging it with xAI.

Jared Birchall, a Neuralink executive, was listed as the contact person on the filing from April. Birchall, who also manages Musk’s money as head of his family office, didn’t immediately respond to a request for comment.

Neuralink, which incorporated in Nevada, closed a $650 million funding round in early June at a $9 billion valuation. ARK Invest, Peter Thiel’s Founders Fund, Sequoia Capital and Thrive Capital were among the investors. Neuralink said the fresh capital would help the company bring its technology to more patients and develop new devices that “deepen the connection between biological and artificial intelligence.”

Under Musk’s leadership at DOGE, the initiative took aim at government agencies that emphasized diversity, equity and inclusion (DEI). In February, for example, DOGE and Musk boasted of nixing hundreds of millions of dollars worth of funding for the Department of Education that would have gone towards DEI-related training grants.

WATCH: DOGE cuts face congressional test

DOGE cuts face congressional test. Here's a breakdown

Continue Reading

Technology

Defense manufacturing startup Hadrian closes $260 million funding round led by Peter Thiel’s Founders Fund

Published

on

By

Defense manufacturing startup Hadrian closes 0 million funding round led by Peter Thiel's Founders Fund

Startup Hadrian raises $260 million to expand its AI-powered factories to meet soaring demand

Defense manufacturing startup Hadrian on Thursday announced the closing of $260 million Series C funding round led by Peter Thiel‘s Founders Fund and Lux Capital.

The machine parts company said it will use the funding to build a new 270,000 square foot factory in Mesa, Arizona, and expand its Torrance, California, location as it looks to beef up its shipbuilding and naval defense capabilities.

“What we really need in this country is this quantum leap above China’s manufacturing model,” said CEO Chris Power in an interview with CNBC’s Morgan Brennan. “It’s about supercharging the worker versus replacing them.”

Defense tech startups like Hadrian are disrupting the mainstay defense contracting industry, which is led by leaders such as Northrop Grumman and Lockheed Martin, and battling it out to boost U.S. defense production while scooping up Department of Defense contracts.

An overall view of the manufacturing line in a Hadrian Automation Inc. factory.

Courtesy: Hadrian Automation, Inc.

Hadrian said the Arizona space will be four times the size of its California facility and start operations by Christmas. The factory will create 350 local jobs. The Hawthrone, California-based company said it is working on four to five new facilities to support production over the next year to support Department of Defense needs.

Read more CNBC tech news

Hadrian said it uses robotics and artificial intelligence to automate factories that can “supercharge American workers.”

Power said demand is rapidly growing, but the lack of U.S.-based talent is a major hurdle to building American dominance in shipbuilding and submarines.

Using its tools, the company said it can train workers within 30 days, making them 10 times more productive. Its workforce includes ex-marines and former nurses who have never set foot in a factory.

An overall view of the manufacturing line in a Hadrian Automation Inc. factory.

Courtesy: Hadrian Automation, Inc.

“We have to do a lot more … but certainly we’re able to keep up with the scale right now, and grateful to our team and customers for letting us go and do that,” he said. “As a country, we have to treat this like a national security crisis, not just the economics of manufacturing.”

The fresh raise also includes investments from Andreessen Horowitz and new stakeholders such as Brad Gerstner’s Altimeter Capital.

The company closed a $92 million funding round in late 2023.

WATCH: Startup Hadrian raises $260 million to expand its AI-powered factories to meet soaring demand

An overall view of the manufacturing line in a Hadrian Automation Inc. factory.

Courtesy: Hadrian Automation, Inc.

The Kuka arm is seen at a Hadrian Automation Inc. factory.

Courtesy: Hadrian Automation, Inc.

Continue Reading

Technology

Amazon cuts some jobs in cloud computing unit as layoffs continue

Published

on

By

Amazon cuts some jobs in cloud computing unit as layoffs continue

Attendees walk through an exposition hall at AWS re:Invent, a conference hosted by Amazon Web Services, in Las Vegas on Dec. 3, 2024.

Noah Berger | Getty Images

Amazon is laying off some staffers in its cloud computing division, the company confirmed on Thursday.

“After a thorough review of our organization, our priorities, and what we need to focus on going forward, we’ve made the difficult business decision to eliminate some roles across particular teams in AWS,” Amazon spokesperson Brad Glasser said in a statement. “We didn’t make these decisions lightly, and we’re committed to supporting the employees throughout their transition.”

The company declined to say which units within Amazon Web Services were impacted, or how many employees will be let go as a result of the job cuts.

Reuters was first to report on the layoffs.

In May, Amazon reported a third straight quarterly revenue miss at AWS. Sales increased 17% to $29.27 billion in the first quarter, slowing from 18.9% in the prior period.

Amazon said the cuts weren’t primarily due to investments in artificial intelligence, but are a result of ongoing efforts to streamline the workforce and refocus on certain priorities. The company said it continues to hire within AWS.

Amazon CEO Andy Jassy has been on a cost-cutting mission for the past several years, which has resulted in more than 27,000 employees being let go since 2022. Job reductions have continued this year, though at a smaller scale than preceding years. Amazon’s stores, communications and devices and services divisions have been hit with layoffs in recent months.

AWS last year cut hundreds of jobs in its physical stores technology and sales and marketing units.

Last month, Jassy predicted that Amazon’s corporate workforce could shrink even further as a result of the company embracing generative AI.

“We will need fewer people doing some of the jobs that are being done today, and more people doing other types of jobs,” Jassy told staffers. “It’s hard to know exactly where this nets out over time, but in the next few years, we expect that this will reduce our total corporate workforce.”

WATCH: Amazon CEO says AI will change the workforce

AI will change the workforce, says Amazon CEO Andy Jassy

Continue Reading

Trending