Connect with us

Published

on

This Cruise in San Francisco seemingly could not figure out how to pull aside on a narrow street to let a buss pass.

Matt Rosoff, CNBC

Cruise CEO and founder Kyle Vogt posted comments on Hacker News on Sunday responding to allegations that his company’s robotaxis aren’t really self-driving, but instead require frequent help from humans working in a remote operations center.

First, Vogt confirmed that the General Motors-owned company does have a remote assistance team, in response to a discussion under the header, “GM’s Cruise alleged to rely on human operators to achieve ‘autonomous’ driving.”

The CEO wrote, “Cruise AVs are being remotely assisted (RA) 2-4% of the time on average, in complex urban environments. This is low enough already that there isn’t a huge cost benefit to optimizing much further, especially given how useful it is to have humans review things in certain situations.”

CNBC confirmed with Cruise spokesperson Tiffany Testo that the comments were accurate and came from the company’s CEO.

Cruise recently took the drastic move of grounding all of its driverless operations following a collision that injured a pedestrian in San Francisco on October 2. The collision and Cruise’s disclosures around it led to state regulators stripping the company of its permits to operate driverless vehicles in California, unless there is a driver aboard.

The DMV previously said its decision was based on several factors, citing four regulations that allow suspension in the event “the Department determines the manufacturer’s vehicles are not safe for the public’s operation,” and “the manufacturer has misrepresented any information related to safety of the autonomous technology of its vehicles.”

As NBC News previously reported, California Department of Motor Vehicles accused Cruise of failing to show them a full video depicting the October 2 collision, during which a pedestrian was thrown into the path of the Cruise robotaxi by a human driver in a different car who hit her first.

During that incident, Cruise previously told NBC, its vehicle “braked aggressively before impact and because it detected a collision” but then tried to pull over and in the process pulled the pedestrian forward about 20 feet. 

Rival Waymo, which is owned by Google parent company Alphabet, continues to operate in the city.

How often do remote workers intervene?

A New York Times story followed last week diving into issues within Cruise that may have led to the safety issues, and setback for Cruise’s reputation and business. The story included a stat that at Cruise, workers intervened to help the company’s cars every 2.5 to five miles.

Vogt explained on Hacker News that the stat was a reference to how frequently Cruise robotaxis initiate a remote assistance session.

He wrote, “Of those, many are resolved by the AV itself before the human even looks at things, since we often have the AV initiate proactively and before it is certain it will need help. Many sessions are quick confirmation requests (it is ok to proceed?) that are resolved in seconds. There are some that take longer and involve guiding the AV through tricky situations. Again, in aggregate this is 2-4% of time in driverless mode.”

CNBC asked Cruise to confirm and provide further details on Monday.

The Cruise spokesperson wrote in an e-mail, that a “remote assistance” session is triggered roughly every four to five miles, not every 2.5 miles, in Cruise’s driverless fleet.

“Often times the AV proactively initiates these before it is certain it will need help such as when the AV’s intended path is obstructed (e.g construction blockages or detours) or if it needs help identifying an object,” she wrote. “Remote assistance is in session about 2-4% of the time the AV is on the road, which is minimal, and in those cases the RA advisor is providing wayfinding intel to the AV, not controlling it remotely.”

CNBC also asked Cruise for information about typical response time for remote operations, and how remote assistance workers at Cruise are trained.

“More than 98% of sessions are answered within 3 seconds,” the spokesperson said.

She added, “RA advisors undergo a background check and driving record check and must complete two weeks of comprehensive training prior to starting, consisting of classroom training, scenario-based exercises, live shadowing and knowledge-based assessments. Advisors also receive ongoing training and undergo supplemental training whenever there is a new feature or update. Regular reviews, refreshers and audits are conducted to ensure high performance.”

As far as the ratio of remote assistance advisors to driverless vehicles on the road, the Cruise spokesperson said, “During driverless operations there was roughly 1 remote assistant agent for every 15-20 driverless AVs.”

George Mason University professor and autonomous systems expert Missy Cummings, who was previously a safety advisor to the federal vehicle safety agency (NHTSA), told CNBC that whether or not the public still considers Cruise vehicles self-driving, it has been an “industry standard” for humans to be on call, monitoring the operations of drones, robotics, and now autonomous or semi-autonomous vehicles.

“I start to get concerned,” she said, “about how we’re using humans when we are using them. In other domains, we’ve seen issues where, for example, an air traffic controller maybe fell asleep on the job.”

Cummings also said it would be very important to understand whether Cruise vehicles involved in any collisions — especially in the October pedestrian collision — called back to remote operations for help. “I would like to know whether a human was notified at all and what the human’s actions were in the remote operations center.”

Cruise declined to say whether the October 2 incident triggered a remote assistant call, whether a human advisor made decisions to authorize the vehicle’s movement, or whether any Cruise employee had called 911.

The company spokesperson said, “We have initiated third-party reviews of the October 2 incident and are working with NHTSA on their investigation as well. In respect of those processes, we will await the findings of those reviews before commenting further.”

GM said last month that the company has lost roughly $1.9 billion on Cruise in the first nine months of this year, including $732 million in the third quarter alone.

Continue Reading

Technology

UK finance watchdog teams up with Nvidia to let banks experiment with AI

Published

on

By

UK finance watchdog teams up with Nvidia to let banks experiment with AI

Jakub Porzycki | Nurphoto | Getty Images

LONDON — Britain’s financial services watchdog on Monday announced a new tie-up with U.S. chipmaker Nvidia to let banks safely experiment with artificial intelligence.

The Financial Conduct Authority said it will launch a so-called Supercharged Sandbox that will “give firms access to better data, technical expertise and regulatory support to speed up innovation.”

Starting from October, financial services institutions in the U.K. will be allowed to experiment with AI using Nvidia’s accelerated computing and AI Enterprise Software products, the watchdog said in a press release.

The initiative is designed for firms in the “discovery and experiment phase” with AI, the FCA noted, adding that a separate live testing service exists for firms further along in AI development.

“This collaboration will help those that want to test AI ideas but who lack the capabilities to do so,” Jessica Rusu, the FCA’s chief data, intelligence and information officer, said in a statement. “We’ll help firms harness AI to benefit our markets and consumers, while supporting economic growth.”

The FCA’s new sandbox addresses a key issue for banks, which have faced challenges shipping advanced new AI tools to their customers amid concerns over risks around privacy and fraud.

Large language models from the likes of OpenAI and Google send data back to overseas facilities — and privacy regulators have raised the alarm over how this information is stored and processed. There have meanwhile been several instances of malicious actors using generative AI to scam people.

Nvidia is behind the graphics processing units, or GPUs, used to train and run powerful AI models. The company’s CEO, Jensen Huang, is expected to give a keynote talk at a tech conference in London on Monday morning.

Last year, HSBC’s generative AI lead, Edward Achtner, told a London tech conference he sees “a lot of success theater” in finance when it comes to artificial intelligence — hinting that some financial services firms are touting advances in AI without tangible product innovations to show for it.

He added that, while banks like HSBC have used AI for many years, new generative AI tools like OpenAI’s ChatGPT come with their own unique compliance risks.

Zopa CEO: Fintechs face challenges when it comes to scaling in the UK

Continue Reading

Technology

Sam Altman brings his eye-scanning identity verification startup to the UK

Published

on

By

Sam Altman brings his eye-scanning identity verification startup to the UK

Sam Altman’s identity verification venture World is launching its eye-scanning Orb product in the U.K.

World

LONDON — World, the biometric identity verification project co-founded by OpenAI CEO Sam Altman, is set to launch in the U.K. this week.

The venture, which uses a spherical eye-scanning device called the Orb to scan people’s eyes, will become available in London from Thursday and is planning to roll out to several other major U.K. cities — including Manchester, Birmingham, Cardiff, Belfast, and Glasgow — in the coming months.

The project aims to authenticate the identity of humans with its Orb device and prevent the fraudulent abuse of artificial intelligence systems like deep fakes.

It works by scanning a person’s face and iris and then creating a unique code to verify that the individual is a human and not an AI.

Once someone has created their iris code, they are then gifted some of World’s WLD cryptocurrency and can use an anonymous identifier called World ID to sign into various applications. It currently works with the likes of Minecraft, Reddit and Discord.

From ‘science project’ to reality

Adrian Ludwig, chief architect of Tools for Humanity, which is a core contributor to World, told CNBC on a call that the project is seeing significant demand from both enterprise users and governments as the threat of AI to defraud various services — from banking to online gaming — grows.

“The idea is no longer just something that’s theoretical. It’s something that’s real and affecting them every single day,” he said, adding that World is now transitioning “from science project to a real network.”

The venture recently opened up shop in the U.S. with six flagship retail locations including Austin, Atlanta, Los Angeles, Nashville, Miami and San Francisco. Ludwig said that looking ahead, the plan is to “increase the number of people who can be verified by an order of magnitude over the next few months.”

Ever since its initial launch as “Worldcoin” in 2021, Altman’s World has been plagued by concerns over how it could affect users’ privacy. The startup says it addresses these concerns by encrypting the biometric data collected and ensuring the original data is deleted.

On top of that, World’s verification system also depends on a decentralized network of users’ smartphones rather than the cloud to carry out individual identity checks.

Still, this becomes harder to do in a network with billions of users like Facebook or TikTok, for example. For now, World has 13 million verified users and is planning to scale that up.

Ludwig argues World is a scalable network as all of the computation and storage is processed locally on a user’s device — it’s only the infrastructure for confirming someone’s uniqueness that is handled by third-party providers.

Digital ID schemes

Ludwig says the way technology is evolving means it’s getting much easier for new AI systems to bypass currently available authentication methods such as facial recognition and CAPTCHA bot prevention measures.

Read more CNBC tech news

He sees World serving a pertinent need in the transition from physical to digital identity systems. Governments are exploring digital ID schemes to move away from physical cards.

However, so far, these attempts have been far from perfect.

One example of a major digital identity system is India’s Aadhaar. Although the initiative has seen widespread adoption, it has also been the target of criticisms for lax security and allegedly worsening social inequality for Indians.

“We’re beginning to see governments now more interested in how can we use this as a mechanism to improve our identity infrastructure,” Ludwig told CNBC. “Mechanisms to identify and reduce fraud is of interest to governments.”

The technologist added that World has been talking to various regulators about its identity verification solution — including the Information Commissioner’s Office, which oversees data protection in the U.K.

“We’ve been having lots of conversations with regulators,” Ludwig told CNBC. “In general, there’s been lots of questions: how do we make sure this works? How do we protect privacy? If we engage with this, does it expose us to risks?”

“All of those questions we’ve been able to answer,” he added. “It’s been a while since we’ve had a question asked we didn’t have an answer to.”

What's changed since Worldcoin rebranded to World Network?

Continue Reading

Technology

Tesla Optimus robotics vice president Milan Kovac is leaving the company

Published

on

By

Tesla Optimus robotics vice president Milan Kovac is leaving the company

Tesla displays Optimus next to two of its vehicles at the World Robot Conference in Beijing on Aug. 22, 2024.

CNBC | Evelyn

Tesla’s vice president of Optimus robotics, Milan Kovac, said on Friday that he’s leaving the company.

In a post on X, Kovac thanked Tesla CEO Elon Musk and reminisced about his tenure, which began in 2016.

“I want to thank @elonmusk from the bottom of my heart for his trust and teachings over the decade we’ve worked together,” Kovac wrote. “Elon, you’ve taught me to discern signal from noise, hardcore resilience, and many fundamental principles of engineering. I am forever grateful. Tesla will win, I guarantee you that.”

Tesla is developing Optimus with the aim of someday selling it as a bipedal, intelligent robot capable of everything from factory work to babysitting.

In a first-quarter shareholder deck, Tesla said it was on target for “builds of Optimus on our Fremont pilot production line in 2025, with wider deployment of bots doing useful work across our factories.”

During Tesla’s 2024 annual shareholder meeting, Musk characterized himself as “pathologically optimistic,” then claimed the humanoid robots would lift the company’s market cap to $25 trillion at an unspecified future date.

In recent weeks, Musk told CNBC’s David Faber that Tesla is now training its Optimus systems to do “primitive tasks,” like picking up objects, open a door or throw a ball.

Competitors in the space include Boston Dynamics, Agility Robotics, Apptronik, 1X and Figure.

Kovac had previously served as the company’s director of Autopilot software engineering. He rose to lead the company’s Optimus unit as vice president in 2022.

Musk personally thanked Kovac for his “outstanding contributions” to the business.

Tesla didn’t respond to a request for comment.

WATCH: Tesla panel talks impact of Musk’s feud with Trump

'Closing Bell Overtime' Tesla panel talks impact of Elon Musk's feud with Pres. Trump

Continue Reading

Trending