Yann LeCun, chief AI scientist at Meta, speaks at the Viva Tech conference in Paris, June 13, 2023.
Chesnot | Getty Images News | Getty Images
Meta’s chief scientist and deep learning pioneer Yann LeCun said he believes that current AI systems are decades away from reaching some semblance of sentience, equipped with common sense that can push their abilities beyond merely summarizing mountains of text in creative ways.
His point of view stands in contrast to that of Nvidia CEO Jensen Huang, who recently said AI will be “fairly competitive” with humans in less than five years, besting people at a multitude of mentally intensive tasks.
“I know Jensen,” LeCun said at a recent event highlighting the Facebook parent company’s 10-year anniversary of its Fundamental AI Research team. LeCun said the Nvidia CEO has much to gain from the AI craze. “There is an AI war, and he’s supplying the weapons.”
“[If] you think AGI is in, the more GPUs you have to buy,” LeCun said, about technologists attempting to develop artificial general intelligence, the kind of AI on par with human-level intelligence. As long as researchers at firms such as OpenAI continue their pursuit of AGI, they will need more of Nvidia’s computer chips.
Society is more likely to get “cat-level” or “dog-level” AI years before human-level AI, LeCun said. And the technology industry’s current focus on language models and text data will not be enough to create the kinds of advanced human-like AI systems that researchers have been dreaming about for decades.
“Text is a very poor source of information,” LeCun said, explaining that it would likely take 20,000 years for a human to read the amount of text that has been used to train modern language models. “Train a system on the equivalent of 20,000 years of reading material, and they still don’t understand that if A is the same as B, then B is the same as A.”
“There’s a lot of really basic things about the world that they just don’t get through this kind of training,” LeCun said.
Hence, LeCun and other Meta AI executives have been heavily researching how the so-called transformer models used to create apps such as ChatGPT could be tailored to work with a variety of data, including audio, image and video information. The more these AI systems can discover the likely billions of hidden correlations between these various kinds of data, the more they could potentially perform more fantastical feats, the thinking goes.
Some of Meta’s research includes software that can help teach people how to play tennis better while wearing the company’s Project Aria augmented reality glasses, which blend digital graphics into the real world. Executives showed a demo in which a person wearing the AR glasses while playing tennis was able to see visual cues teaching them how to properly hold their tennis rackets and swing their arms in perfect form. The kinds of AI models needed to power this type of digital tennis assistant require a blend of three-dimensional visual data in addition to text and audio, in case the digital assistant needs to speak.
These so-called multimodal AI systems represent the next frontier, but their development won’t come cheap. And as more companies such as Meta and Google parent Alphabet research more advanced AI models, Nvidia could stand to gain even more of an edge, particularly if no other competition emerges.
The AI hardware of the future
Nvidia has been the biggest benefactor of generative AI, with its pricey graphics processing units becoming the standard tool used to train massive language models. Meta relied on 16,000 Nvidia A100 GPUs to train its Llama AI software.
CNBC asked if the tech industry will need more hardware providers as Meta and other researchers continue their work developing these kinds of sophisticated AI models.
“It doesn’t require it, but it would be nice,” LeCun said, adding that the GPU technology is still the gold standard when it comes to AI.
Still, the computer chips of the future may not be called GPUs, he said.
“What you’re going to see hopefully emerging are new chips that are not graphical processing units, they are just neural, deep learning accelerators,” LeCun said.
LeCun is also somewhat skeptical about quantum computing, which tech giants such as Microsoft, IBM, and Google have all poured resources into. Many researchers outside Meta believe quantum computing machines could supercharge advancements in data-intensive fields such as drug discovery, as they’re able to perform multiple calculations with so-called quantum bits as opposed to conventional binary bits used in modern computing.
But LeCun has his doubts.
“The number of problems you can solve with quantum computing, you can solve way more efficiently with classical computers,” LeCun said.
“Quantum computing is a fascinating scientific topic,” LeCun said. It’s less clear about the “practical relevance and the possibility of actually fabricating quantum computers that are actually useful.”
Meta senior fellow and former tech chief Mike Schroepfer concurred, saying that he evaluates quantum technology every few years and believes that useful quantum machines “may come at some point, but it’s got such a long time horizon that it’s irrelevant to what we’re doing.”
“The reason we started an AI lab a decade ago was that it was very obvious that this technology is going to be commercializable within the next years’ time frame,” Schroepfer said.
Elon Musk walks on Capitol Hill on the day of a meeting with Senate Republican Leader-elect John Thune (R-SD), in Washington, U.S. December 5, 2024.
Benoit Tessier | Reuters
House Democrats Jim McGovern of Massachusetts and Rosa DeLauro of Connecticut say their Republican colleagues in Congress caved to the demands of Elon Musk, sinking a bipartisan government funding bill that would have regulated U.S. investments in China.
In a series of posts on X, McGovern said more could have been accomplished. The scrapped provision “would have made it easier to keep cutting-edge AI and quantum computing tech — as well as jobs — in America,” he wrote. “But Elon had a problem.”
Tesla, run by Musk, is the only foreign automaker to operate a factory in China without a local joint venture. Tesla also built a battery plant down the street from its Shanghai car factory this year, and aims to develop and sell self-driving vehicle technology in China.
“His bottom line depends on staying in China’s good graces,” McGovern wrote about Musk. “He wants to build an AI data center there too — which could endanger U.S. security. He’s been bending over backwards to ingratiate himself with Chinese leaders.”
SpaceX, Musk’s aerospace and defense contractor, has reportedly withheld its Starlink satellite internet service over Taiwan at the request of Chinese and Russian leaders. Taiwan is a self-ruling democracy that Beijing claims as its territory. Taiwan’s status is one of the biggest flashpoints in U.S.-China relations.
DeLauro, the top Democrat on the House Appropriations Committee, wrote in a letter to Congress on Friday that Musk needs “Chinese government approvals for his company’s projects in the country.” It’s concerning, that Musk “has ingratiated himself with Chinese Communist Party leadership,” she wrote.
In the letter, DeLauro referred to the Tesla and SpaceX CEO as “President” Musk, alluding to the fact that the world’s richest person began railing against the prior funding bill on Wednesday, before President-elect Donald Trump came out with a statement of his own.
Trump had wanted the GOP to sink the bill, and issue a new one that would raise the debt ceiling so he could avoid that fight during the start of his second term in office. The stopgap funding bill, which President Joe Biden signed on Saturday, did not include the two-year suspension of the U.S. debt limit that Trump was seeking.
Musk responded to DeLauro’s concerns by calling her an “awful creature” in a post on X.
After acquiring Twitter in 2022, Musk rebranded it X and used it to help propel Trump back into the White House, becoming a close adviser and major backer to the incoming president along the way.
Musk contributed $277 million to the Trump campaign and other Republican causes during the 2024 cycle, according to Federal Election Commission filings. Since the election in November, Musk has become a nearly constant presence at Trump’s side, including in meetings with foreign leaders.
Trump appointed Musk to co-lead a group that’s not yet formed, but will be tasked with finding ways to cut regulations, personnel and budgets.
Tesla CEO and X owner Elon Musk gestures behind protective glass during a rally for Republican presidential nominee and former U.S. president Donald Trump, at the site of the July assassination attempt against Trump, in Butler, Pennsylvania, U.S., October 5, 2024.
Carlos Barria | Reuters
Tesla CEO Elon Musk, a meagdonor and adviser to President-elect Donald Trump, is now seeking to influence Germany’s election, posting an endorsement on X of the country’s far-right Alternative for Germany (AfD) party.
In a post Thursday night, Musk wrote, “Only the AfD can save Germany.”
Musk, who has over 200 million listed followers on the site that he owns, made the comment while sharing a post from far-right influencer, Naomi Seibt, who claimed that Germany’s “presumptive next chancellor Friedrich Merz (CDU) is horrified by the idea that Germany should follow Elon Musk’s and Javier Milei’s example,” referring to the president of Argentina.
Seibt has a history of promoting white nationalist ideology, The Guardian previously reported, and has denied the validity of scientific consensus around climate change, namely that it’s driven by fossil fuel emissions.
In a post on X, Sen. Chris Murphy (D-Conn.) called Musk an “out of touch billionaire running the incoming Trump Administration” who “enthusiastically supports the neo-Nazi party in Germany.”
“The AfD’s mission is to rehabilitate the image of the Nazi movement,” Murphy wrote. He added that one of the party’s leaders has a license plate that’s “an open tribute to Hitler,” and another “described Judaism as the ‘inner enemy’ in Germany.”
Musk and Tesla’s investor relations team didn’t immediately respond to requests for comment.
On Friday, German Chancellor Olaf Scholz, a center-left Social Democrat, dismissed Musk’s claim that only the far-right party can “save Germany.”
Under Scholz’s leadership, Germany‘s left-wing coalition collapsed in November, and AfD is currently polling in second place ahead of February elections. Throughout Germany, where the AfD has placed highly in state elections, the other parties have generally refused to form coalitions with it.
Far right parties have also gained ground in the Netherlands, Austria, Finland and elsewhere. Many cheered Trump’s election, which Musk helped finance through $277 million in contributions to the campaign and related Republican causes.
Tesla’s stock is up about 75% since Trump’s victory, surpassing its prior all-time high from 2021 last week.
AfD has reportedly criticized Tesla and its factory outside of Berlin. The party claimed many of Tesla’s thousands of workers there commute in from Poland or Berlin, limiting the economic benefits to the local community in Brandeburg.
The AfD generally views electric vehicles as part of an ideological climate movement, and not good for Germany’s auto industry.
Europe has been a tough market for Tesla this year. According to data from the European Automobile Manufacturers Association, sales of Tesla cars declined 40.9% in November, exceeding the overall 9.5% dip in sales of battery electric vehicles.
Elsewhere in Euopre, Musk endorsed right-wing Italian Prime Minister Giorgia Meloni and has voiced support for Nigel Farage in the U.K, a populist politician and head of Reform UK. In South America, Musk endorsed and has a friendship with Argentina’s President Milei, a self-described anarcho-capitalist.
Bitcoin dipped below the $93,000 mark earlier in the day before trading above that price in volatile trade.
By around 8:26 ET, bitcoin was trading at $93,809.39, according to Coin Metrics, down around 8% from 24 hours before when it was priced above $102,000.
The cryptocurrency hit an all-time high above $108,000 just this week, but has since sold off aggressively.
The Federal Reserve rattled markets in recent days, as it signaled fewer interest rate cuts next year. Equity markets took a hit, filtering through to crypto assets.
The price of bitcoin price has more than doubled this year, supported by a number of factors including the launch of spot exchange-traded funds and the U.S. presidential election of Donald Trump. He has pledged pro-crypto policies and his victory at the polls helped propel bitcoin to its latest record high.
With some markets on edge due to the Fed, some of the steam has come out of assets that have seen big gains this year.
Tesla, which has been another big beneficiary of Trump’s win, continued its post-election slide with shares falling on Friday in premarket trade. Other big names like Nvidia were also lower during the session.
Bitcoin’s fall also dragged down other cryptocurrencies. Ether was down around 12%, and XRP plunged 10% from 24 hours prior, at around 8:27 a.m. ET.