Computer scientists are questioning whether Alphabet’s DeepMind will ever make A.I. more human-like

Published

4 years ago

June 18, 2021

admin

David Silver, leader of the reinforcement learning research group at DeepMind, being awarded an honorary “ninth dan” professional ranking for AlphaGo.

JUNG YEON-JE | AFP | Getty Images

Computer scientists are questioning whether DeepMind, the Alphabet-owned U.K. firm that’s widely regarded as one of the world’s premier AI labs, will ever be able to make machines with the kind of “general” intelligence seen in humans and animals.

In its quest for artificial general intelligence, which is sometimes called human-level AI, DeepMind is focusing a chunk of its efforts on an approach called “reinforcement learning.”

This involves programming an AI to take certain actions in order to maximize its chance of earning a reward in a certain situation. In other words, the algorithm “learns” to complete a task by seeking out these preprogrammed rewards. The technique has been successfully used to train AI models how to play (and excel at) games like Go and chess. But they remain relatively dumb, or “narrow.” DeepMind’s famous AlphaGo AI can’t draw a stickman or tell the difference between a cat and a rabbit, for example, while a seven-year-old can.

Despite this, DeepMind, which was acquired by Google in 2014 for around $600 million, believes that AI systems underpinned by reinforcement learning could theoretically grow and learn so much that they break the theoretical barrier to AGI without any new technological developments.

Researchers at the company, which has grown to around 1,000 people under Alphabet’s ownership, argued in a paper submitted to the peer-reviewed Artificial Intelligence journal last month that “Reward is enough” to reach general AI. The paper was first reported by VentureBeat last week.

In the paper, the researchers claim that if you keep “rewarding” an algorithm each time it does something you want it to, which is the essence of reinforcement learning, then it will eventually start to show signs of general intelligence.

“Reward is enough to drive behavior that exhibits abilities studied in natural and artificial intelligence, including knowledge, learning, perception, social intelligence, language, generalization and imitation,” the authors write.

“We suggest that agents that learn through trial and error experience to maximize reward could learn behavior that exhibits most if not all of these abilities, and therefore that powerful reinforcement learning agents could constitute a solution to artificial general intelligence.”

Not everyone is convinced, however.

Samim Winiger, an AI researcher in Berlin, told CNBC that DeepMind’s “reward is enough” view is a “somewhat fringe philosophical position, misleadingly presented as hard science.”

He said the path to general AI is complex and that the scientific community is aware that there are countless challenges and known unknowns that “rightfully instill a sense of humility” in most researchers in the field and prevent them from making “grandiose, totalitarian statements” such as “RL is the final answer, all you need is reward.”

DeepMind told CNBC that while reinforcement learning has been behind some of its most well-known research breakthroughs, the AI technique accounts for only a fraction of the overall research it carries out. The company said it thinks it’s important to understand things at a more fundamental level, which is why it pursues other areas such as “symbolic AI” and “population-based training.”

“In somewhat typical DeepMind fashion, they chose to make bold statements that grabs attention at all costs, over a more nuanced approach,” said Winiger. “This is more akin to politics than science.”

Stephen Merity, an independent AI researcher, told CNBC that there’s “a difference between theory and practice.” He also noted that “a stack of dynamite is likely enough to get one to the moon, but it’s not really practical.”

Ultimately, there’s no proof either way to say whether reinforcement learning will ever lead to AGI.

Rodolfo Rosini, a tech investor and entrepreneur with a focus on AI, told CNBC: “The truth is nobody knows and that DeepMind’s main product continues to be PR and not technical innovation or products.”

Entrepreneur William Tunstall-Pedoe, who sold his Siri-like app Evi to Amazon, told CNBC that even if the researchers are correct “that doesn’t mean we will get there soon, nor does it mean that there isn’t a better, faster way to get there.”

DeepMind’s “Reward is enough” paper was co-authored by DeepMind heavyweights Richard Sutton and David Silver, who met DeepMind CEO Demis Hassabis at the University of Cambridge in the 1990s.

“The key problem with the thesis put forth by ‘Reward is enough’ is not that it is wrong, but rather that it cannot be wrong, and thus fails to satisfy Karl Popper’s famous criterion that all scientific hypotheses be falsifiable,” said a senior AI researcher at a large U.S. tech firm, who wished to remain anonymous due to the sensitive nature of the discussion.

“Because Silver et al. are speaking in generalities, and the notion of reward is suitably underspecified, you can always either cherry pick cases where the hypothesis is satisfied, or the notion of reward can be shifted such that it is satisfied,” the source added.

“As such, the unfortunate verdict here is not that these prominent members of our research community have erred in any way, but rather that what is written is trivial. What is learned from this paper, in the end? In the absence of practical, actionable consequences from recognizing the unalienable truth of this hypothesis, was this paper enough?”

What is AGI?

While AGI is often referred to as the holy grail of the AI community, there’s no consensus on what AGI actually is. One definition is it’s the ability of an intelligent agent to understand or learn any intellectual task that a human being can.

But not everyone agrees with that and some question whether AGI will ever exist. Others are terrified about its potential impacts and whether AGI would build its own, even more powerful, forms of AI, or so-called superintelligences.

Ian Hogarth, an entrepreneur turned angel investor, told CNBC that he hopes reinforcement learning isn’t enough to reach AGI. “The more that existing techniques can scale up to reach AGI, the less time we have to prepare AI safety efforts and the lower the chance that things go well for our species,” he said.

Winiger argues that we’re no closer to AGI today than we were several decades ago. “The only thing that has fundamentally changed since the 1950/60s, is that science-fiction is now a valid tool for giant corporations to confuse and mislead the public, journalists and shareholders,” he said.

Fueled with hundreds of millions of dollars from Alphabet every year, DeepMind is competing with the likes of Facebook and OpenAI to hire the brightest people in the field as it looks to develop AGI. “This invention could help society find answers to some of the world’s most pressing and fundamental scientific challenges,” DeepMind writes on its website.

DeepMind COO Lila Ibrahim said on Monday that trying to “figure out how to operationalize the vision” has been the biggest challenge since she joined the company in April 2018.

Technology

Apple has its best week since July 2020 after White House visit

Published

21 hours ago

August 9, 2025

admin

Apple has its best week since July 2020 after White House visit

U.S. President Donald Trump and Apple CEO Tim Cook shake hands on the day they present Apple’s announcement of a $100 billion investment in U.S. manufacturing, in the Oval Office at the White House in Washington, D.C., U.S., August 6, 2025.

Jonathan Ernst | Reuters

Apple shares rose 13% this week, its largest weekly gain in more than five years, after CEO Tim Cook appeared with President Donald Trump in the White House on Wednesday.

Shares of the iPhone maker rose 4% to close at $229.35 per share on Friday for the company’s largest weekly gain since July 2020. The week’s move added over $400 billion to Apple’s market cap, which now sits at $3.4 trillion.

Apple is the third-most valuable company, behind Nvidia and Microsoft and ahead of Alphabet and Amazon.

At the White House on Wednesday, Cook appeared with Trump to announce Apple’s plans to spend $100 billion on American companies and American parts over the next four years.

Apple’s plans to buy more American chips pleased Trump, who said during the public meeting that because the company was building in the U.S., it would be exempt from future tariffs that could double the price of imported chips.

Investors had worried that some of Trump’s tariffs could substantially hurt Apple’s profitability. Apple warned in July that it expected over $1 billion in tariff costs in the current quarter, assuming no changes.

“Apple and Tim Cook delivered a masterclass in managing uncertainty after months and months of overhang relative to the potential challenges the company could face from tariffs,” JP Morgan analyst Samik Chatterjee wrote on Wednesday. He has an overweight rating on Apple’s stock.

Cook’s successful White House meeting also comes two weeks after Apple reported June quarter earnings in which overall revenue jumped 10% and iPhone sales grew by 13%.

WATCH: Santoli’s Last Word: Apple helps drive S&P higher

Technology

Tesla Robotaxi scores permit to run ride-hailing service in Texas

Published

1 day ago

August 8, 2025

admin

Tesla Robotaxi scores permit to run ride-hailing service in Texas

In an aerial view, the Tesla headquarters is seen in Austin, Texas, on July 24, 2025.

Brandon Bell | Getty Images

Tesla has been granted a permit to run a ride-hailing business in Texas, allowing the electric vehicle maker to compete against companies including Uber and Lyft.

Tesla Robotaxi LLC is licensed to operate a “transportation network company” until August 6, 2026, according to a listing on the website of the Texas Department of Licensing and Regulation, or TDLR. The permit was issued this week.

Elon Musk’s EV company has been running a limited ride-hailing service for invited riders in Austin since late June. The select few passengers have mostly been social media influencers and analysts, including many who generate income by posting Tesla fan content on platforms like X and YouTube.

The Austin fleet consists of Model Y vehicles equipped with Tesla’s latest partially automated driving systems. The company has been operating the cars with a valet, or human safety supervisor in the front passenger seat tasked with intervening if there are issues with the ride. The vehicles are also remotely supervised by employees in an operations center.

Musk, who has characterized himself as “pathologically optimistic,” said on Tesla’s earnings call last month that he believes Tesla could serve half of the U.S. population by the end of 2025 with autonomous ride-hailing services.

The Texas permit is the first to enable Tesla to run a “transportation network company.” TDLR said Friday that this kind of permit lets Tesla operate a ride-hailing business anywhere in the state, including with “automated motor vehicles,” and doesn’t require Tesla to keep a human safety driver or valet on board.

Tesla didn’t immediately respond to a request for comment.

As CNBC previously reported, Tesla robotaxis were captured on camera disobeying traffic rules in and around Austin after the company started its pilot program. None of the known incidents have been reported as causing injury or serious property damage, though they have drawn federal scrutiny.

Elon Musk confirms plan for Tesla robotaxis in Austin, Texas next month

In one incident, Tesla content creator Joe Tegtmeyer reported that his robotaxi failed to stop for a train crossing signal and lowering gate-arm, requiring a Tesla employee on board to intervene. The National Highway Traffic Safety Administration has discussed this incident with Tesla, a spokesperson for the regulator told CNBC by email.

Texas has historically been more permissive of autonomous vehicle testing and operations on public roads than have other states.

A new law signed by Texas Republican Gov. Greg Abbott goes into effect this year that will require AV makers to get approval from the state before starting driverless operations. The new law also gives the Texas Department of Motor Vehicles the authority to revoke permits if AV companies and their cars aren’t complying with safety standards.

Tesla’s AV efforts have faced a number of challenges across the country, including federal probes, product liability lawsuits and recalls following injurious or damaging collisions that occurred while drivers were using the company’s Autopilot and FSD (Full Self-Driving) systems.

A jury in a federal court in Miami last week determined that Tesla should hold 33% of the liability for a fatal Autopilot-involved collision.

And the California DMV has sued Tesla, accusing it of false advertising around its driver assistance systems. Tesla owners manuals say the Autopilot and FSD features in their cars are “hands on” systems that require a driver ready to steer or brake at any time. But Tesla and Musk have shared statements through the years saying that a Tesla can “drive itself.”

Since 2016, Musk has been promising that Tesla would soon be able to turn all of its existing EVs into fully autonomous vehicles with a simple, over-the-air software update. In 2019, he said the company would put 1 million robotaxis on the road by 2020, a claim that helped him raise $2 billion at the time from institutional investors.

Those promises never materialized and, in the robotaxi market, Tesla lags way behind competitors like Alphabet’s Waymo in the U.S. and Baidu’s Apollo Go in China.

Tesla shares are down 18% this year, by far the worst performance among tech’s megacaps.

WATCH: What we saw at Tesla’s robotaxi launch in Texas

We went to Texas for Tesla's robotaxi launch. Here's what we saw

Technology

Trade Desk tanks almost 40% on CFO departure, tariff concerns and competition from Amazon

Published

1 day ago

August 8, 2025

admin

Trade Desk tanks almost 40% on CFO departure, tariff concerns and competition from Amazon

Jeff Green, CEO of The Trade Desk.

Scott Mlyn | CNBC

Shares of The Trade Desk plummeted almost 40% on Friday and headed for their worst day on record after the ad-tech company announced the departure of its CFO and analysts expressed concerns about rising competition from Amazon.

The Trade Desk, which went public in 2016, suffered its steepest prior drop in February, when the shares fell 33% on a revenue miss. In its second-quarter earnings report late Thursday, the company beat expectations on earnings and revenue, but the results failed to impress investors.

The Trade Desk, which specializes in providing technology to companies that want to target users across the web, said finance chief Laura Schenkein is leaving the job and being replaced by Alex Kayyal, who has been working as a partner at Lightspeed Ventures.

While some analysts were uneasy about the sudden change in the top finance role, the bigger concern is Amazon’s growing role in the online ad market, as well as the potential impact of President Donald Trump’s tariffs on ad spending.

Amazon has emerged as a significant player in the digital advertising market in recent years, and is now third behind Google and Meta. Last week, Amazon reported a 23% increase in ad revenue for the second quarter to $15.7 billion, which beat estimates.