Meta founder and CEO Mark Zuckerberg speaks during the Meta Connect event at Meta headquarters in Menlo Park, California, on Sept. 27, 2023.
Josh Edelson | AFP | Getty Images
Meta is spending billions of dollars on Nvidia’s popular computer chips, which are at the heart of artificial intelligence research and projects.
In an Instagram Reels post on Thursday, Zuckerberg said the company’s “future roadmap” for AI requires it to build a “massive compute infrastructure.” By the end of 2024, Zuckerberg said that infrastructure will include 350,000 H100 graphics cards from Nvidia.
Zuckerberg didn’t say how many of the graphics processing units (GPUs) the company has already purchased, but the H100 didn’t hit the market until late 2022, and that was in limited supply. Analysts at Raymond James estimate Nvidia is selling the H100 for $25,000 to $30,000, and on eBay they can cost over $40,000. If Meta were paying at the low end of the price range, that would amount to close to $9 billion in expenditures.
Additionally, Zuckerberg said Meta’s compute infrastructure will contain “almost 600k H100 equivalents of compute if you include other GPUs.” In December, tech companies like Meta, OpenAI and Microsoft said they would use the new Instinct MI300X AI computer chips from AMD.
Meta needs these heavy-duty computer chips as it pursues research in artificial general intelligence (AGI), which Zuckerberg said is a “long term vision” for the company. OpenAI and Google’s DeepMind unit are also researching AGI, a futuristic form of AI that’s comparable to human-level intelligence.
Meta’s chief scientist Yann LeCun stressed the importance of GPUs during a media event in San Francisco last month.
″[If] you think AGI is in, the more GPUs you have to buy,” LeCun said at the time. Regarding Nvidia CEO Jensen Huang, LeCun said “There is an AI war, and he’s supplying the weapons.”
In Meta’s third-quarter earnings report, the company said that total expenses for 2024 will be in the range of $94 billion to $99 billion, driven in part by computing expansion.
“In terms of investment priorities, AI will be our biggest investment area in 2024, both in engineering and computer resources,” Zuckerberg said on the call with analysts.
Zuckerberg said on Thursday that Meta plans to “open source responsibly” its yet-to-be developed “general intelligence,” an approach the company is also taking with its Llama family of large language models.
Meta is currently training Llama 3 and is also making its Fundamental AI Research team (FAIR) and GenAI research team work more closely together, Zuckerberg said.
Shortly after Zuckerberg’s post, LeCun said in a post on X, that “To accelerate progress, FAIR is now a sister organization of GenAI, the AI product division.”
Amazon logo on a brick building exterior, San Francisco, California, August 20, 2024.
Smith Collection | Gado | Archive Photos | Getty Images
Amazon representatives met with the House China committee in recent months to discuss lawmaker concerns over the company’s partnership with TikTok, CNBC confirmed.
A spokesperson for the House Select Committee on the Chinese Communist Party confirmed the meeting, which centered on a shopping deal between Amazon and TikTok announced in August. The agreement allows users of TikTok, owned by China’s ByteDance, to link their account with Amazon and make purchases from the site without leaving TikTok.
“The Select Committee conveyed to Amazon that it is dangerous and unwise for Amazon to partner with TikTok given the grave national security threat the app poses,” the spokesperson said. The parties met in September, according to Bloomberg, which first reported the news.
Representatives from Amazon and TikTok did not immediately respond to CNBC’s request for comment.
TikTok’s future viability in the U.S. is uncertain. In April, President Joe Biden signed a law that requires ByteDance to sell TikTok by Jan. 19. If TikTok fails to cut ties with its parent company, app stores and internet hosting services would be prohibited from offering the app.
President-elect Donald Trump could rescue TikTok from a potential U.S. ban. He promised on the campaign trail that he would “save” TikTok, and said in a March interview with CNBC’s “Squawk Box” that “there’s a lot of good and there’s a lot of bad” with the app.
In his first administration, Trump had tried to implement a TikTok ban. He changed his stance around the time he met with billionaire Jeff Yass. The Republican megadonor’s trading firm, Susquehanna International Group, owns a 15% stake in ByteDance, while Yass has a 7% stake in the company, NBC and CNBC reported in March.
— CNBC’s Jonathan Vanian contributed to this report.
A worker delivers Amazon packages in San Francisco on Oct. 24, 2024.
David Paul Morris | Bloomberg | Getty Images
Amazon on Thursday announced Prime members can access new fixed pricing for treatment of conditions like erectile dysfunction and men’s hair loss, its latest effort to compete with other direct-to-consumer marketplaces such as Hims & Hers Health and Ro.
Shares of Hims & Hers fell as much as 17% on Thursday, on pace for its worst day.
Amazon said in a blog post that Prime members can see the cost of a telehealth visit and their desired treatment before they decide to proceed with care for five common issues. Patients can access treatment for anti-aging skin care starting at $10 a month; motion sickness for $2 per use; erectile dysfunction at $19 a month; eyelash growth at $43 a month, and men’s hair loss for $16 a month by using Amazon’s savings benefit Prime Rx at checkout.
Amazon acquired primary care provider One Medical for roughly $3.9 billion in July 2022, and Thursday’s announcement builds on its existing pay-per-visit telehealth offering. Video visits through the service cost $49, and messaging visits cost $29 where available. Users can get treatment for more than 30 common conditions, including sinus infection and pink eye.
Medications filled through Amazon Pharmacy are eligible for discounted pricing and will be delivered to patients’ doors in standard Amazon packaging. Prime members will pay for the consultation and medication, but there are no additional fees, the blog post said.
Amazon has been trying to break into the lucrative health-care sector for years. The company launched its own online pharmacy in 2020 following its acquisition of PillPack in 2018. Amazon introduced, and later shuttered, a telehealth service called Amazon Care, as well as a line of health and wellness devices.
The company has also discontinued a secretive effort to develop an at-home fertility tracker, CNBC reported Wednesday.
Former U.S. Army intelligence analyst Chelsea Manning says censorship is still “a dominant threat,” advocating for a more decentralized internet to help better protect individuals online.
Her comments come amid ongoing tension linked to online safety rules, with some tech executives recently seeking to push back over content moderation concerns.
Speaking to CNBC’s Karen Tso at the Web Summit tech conference in Lisbon, Portugal, on Wednesday, Manning said that one way to ensure online privacy could be “decentralized identification,” which gives individuals the ability to control their own data.
“Censorship is a dominant threat. I think that it is a question of who’s doing the censoring, and what the purpose is — and also censorship in the 21st century is more about whether or not you’re boosted through like an algorithm, and how the fine-tuning of that seems to work,” Manning said.
“I think that social media and the monopolies of social media have sort of gotten us used to the fact that certain things that drive engagement will be attractive,” she added.
“One of the ways that we can sort of countervail that is to go back to the more decentralized and distribute the internet of the early ’90s, but make that available to more people.”
Nym Technologies Chief Security Officer Chelsea Manning at a press conference held with Nym Technologies CEO Harry Halpin in the Media Village to present NymVPN during the second day of Web Summit on November 13, 2024 in Lisbon, Portugal.
Asked how tech companies could make money in such a scenario, Manning said there would have to be “a better social contract” put in place to determine how information is shared and accessed.
“One of the things about distributed or decentralized identification is that through encryption you’re able to sort of check the box yourself, instead of having to depend on the company to provide you with a check box or an accept here, you’re making that decision from a technical perspective,” Manning said.
‘No longer secrecy versus transparency’
Manning, who works as a security consultant at Nym Technologies, a company that specializes in online privacy and security, was convicted of espionage and other charges at a court-martial in 2013 for leaking a trove of secret military files to online media publisher WikiLeaks.
She was sentenced to 35 years in prison, but was later released in 2017, when former U.S. President Barack Obama commuted her sentence.
Asked to what extent the environment has changed for whistleblowers today, Manning said, “We’re at an interesting time because information is everywhere. We have more information than ever.”
She added, “Countries and governments no longer seem to invest the same amount of time and effort in hiding information and keeping secrets. What countries seem to be doing now is they seem to be spending more time and energy spreading misinformation and disinformation.”
Manning said the challenge for whistleblowers now is to sort through the information to understand what is verifiable and authentic.
“It’s no longer secrecy versus transparency,” she added.