Hands-on with Meta’s Orion AR glasses prototype and the possible future of computing
Meta CEO Mark Zuckerberg presents Orion AR Glasses, as he makes a keynote speech during the Meta Connect annual event, at the company’s headquarters in Menlo Park, California, U.S. September 25, 2024.
Manuel Orbegozo | Reuters
The most impressive aspect of Meta’s Orion augmented-reality glasses has more to do with size and comfort than flashy computer graphics.
CNBC senior media and tech correspondent Julia Boorstin was able to use Orion this week at Meta’s annual Connect conference, and she was captivated by the prototype’s compact form relative to the various Meta Quest and Apple Vision Pro virtual reality headsets.
“What was really striking to me about these was that they were incredibly lightweight,” Boorstin said.
Meta CEO Mark Zuckerberg revealed the Orion glasses on Wednesday and pitched them as “a glimpse of a future that I think is going to be pretty exciting.” The glasses are black and thick framed and come with a wireless “puck” that allows the device to run apps like a holographic game of digital chess or ping-pong that appear as digital graphics spliced into the real world.
The experimental glasses are part of Zuckerberg’s multi-billion dollar plans to build the next-generation of personal computing for the so-called metaverse, a term used by Meta to describe people interacting with one another online in virtual 3D spaces.
While Orion is not capable of putting users in fully virtual worlds, the glasses can overlay digital graphics onto the real world. And unlike VR headsets that can be cumbersome to wear for extended periods, Boorstin said she found the Orion glasses to be a good fit.
“The form factor didn’t feel meaningfully different than wearing a pair of heavy, ordinary glasses, and they were not uncomfortable to wear,” she said.
Though the current incarnation of the Orion AR glasses could pass as a movie prop for the film “Revenge of the Nerds,” Boorstin said she believes they’re only going to get smaller as technology improves.
“This is the first generation — four years from now, how much smaller will they be?” Boorstin said.
CNBC’s Julia Boorstin tries out Meta’s new Orion AR glasses on Sept. 25th, 2024.
Stephen Desaulniers | CNBC
When wearing the AR glasses, Boorstin was able to see digital holograms displaying the visual icons of apps like Instagram, Facebook and some extras like a browser and a video game mixed with the surroundings inside a small office at Meta’s headquarters.
Boorstin saw those digital icons overlaid atop her real-world surroundings with her own eyes. That’s an improvement over “passthrough” techniques used by current VR devices. For passthrough, companies use cameras on the outside of their headsets to show users a digital representation of the real world blended with computer graphics through their device screens.
Orion is able to overlay digital imagery on the real world using a much more expensive method. Its lenses aren’t made from traditional glass or plastic but rather a refractive material called silicon-carbide. When the Orion’s miniaturized projectors, built-in to the arms of the glasses, beam light into the silicon-carbide lenses, users can see “holograms” in their field of vision, an experience Boorstin said “felt totally normal and very natural.”
When the holograms were turned off, “it felt as if you were wearing glasses or sunglasses, and it wasn’t distracting or nauseating,” Boorstin said.
Boorstin was able to open, close and scroll through the apps with the help of a wristband, that she said felt similar to an old, lightweight Fitbit.
“The wristband can sense your finger and hand movements, so your hand can be by your side,” Boorstin said, describing how her finger movements and gestures manipulated the digital icons. “I was surprised that it was so accurate and that I could figure out these hand motions, and it picked them up exactly.”
In one demo, the Orion glasses were able to identify various food ingredients, like chia seeds, that were spread out on a table. It then projected a suitable recipe that appeared digital above the real-world seeds. In another demo, Boorstin played a simple game of pong, except the video game graphics were projected onto a real-world desk in front of her.
One demo that really impressed her involved seeing her producer’s face digitally appear in front of her while he called from another room. The overall experience of the 3D video call “felt very clear” to Boorstin, who noticed that the graphic’s resolution would change depending on where she placed it within her field of vision. It was enough to startle her into questioning whether or not the producer could actually see her in real life since it appeared as if he was there in front of her (he could not).
“I could see him perfectly, and he could not see me,” Boorstin said. “But I could hear him, and it was like I was FaceTiming with him, but he was in my glasses.”
By experiencing Orion, Boorstin said she has a better sense of how Meta’s research and development is directly benefiting the company’s other products, like its Quest headsets and Ray-Ban smart glasses.
“They’ve been working so hard to make these components teeny, tiny, efficient, weightless,” she said.
Artificial intelligence robot looking at futuristic digital data display.
Yuichiro Chino | Moment | Getty Images
Businesses are turning to artificial intelligence tools to help them navigate real-world turbulence in global trade.
Several tech firms told CNBC say they’re deploying the nascent technology to visualize businesses’ global supply chains — from the materials that are used to form products, to where those goods are being shipped from — and understand how they’re affected by U.S. President Donald Trump’s reciprocal tariffs.
Last week, Salesforce said it had developed a new import specialist AI agent that can “instantly process changes for all 20,000 product categories in the U.S. customs system and then take action on them” as needed, to help navigate changes to tariff systems.
Engineers at the U.S. software giant used the Harmonized Tariff Schedule, a 4,400-page document of tariffs on goods imported to the U.S., to inform answers generated by the agent.
“The sheer pace and complexity of global tariff changes make it nearly impossible for most businesses to keep up manually,” Eric Loeb, executive vice president of government affairs at Salesforce, told CNBC. “In the past, companies might have relied on small teams of in-house experts to keep pace.”
Firms say that AI systems are enabling them to take decisions on adjustments to their global supply chains much faster.
Andrew Bell, chief product officer of supply chain management software firm Kinaxis, said that manufacturers and distributors looking to inform their response to tariffs are using his firm’s machine learning technology to assess their products and the materials that go into them, as well as external signals like news articles and macroeconomic data.
“With that information, we can start doing some of those simulations of, here is a particular part that is in your build material that has a significant tariff. If you switched to using this other part instead, what would the impact be overall?” Bell told CNBC.
‘AI’s moment to shine’
Trump’s tariffs list — which covers dozens of countries — has forced companies to rethink their supply chains and pricing, with the likes of Walmart and Nike already raising prices on some products. The U.S. imported about $3.3 trillion of goods in 2024, according to census data.
Uncertainty from the U.S. tariff measures “actually probably presents AI’s moment to shine,” Zack Kass, a futurist and former head of OpenAI’s go-to-market strategy, told CNBC’s Silvia Amaro at the Ambrosetti Forum in Italy last month.
“If you wonder how hard things could get without AI vis-a-vis automation, and what would happen in a world where you can’t just employ a bunch of people overnight, AI presents this alternative proposal,” he added.
Nagendra Bandaru, managing partner and global head of technology services at Indian IT giant Wipro, said clients are using the company’s agentic AI solutions “to pivot supplier strategies, adjust trade lanes, and manage duty exposure dynamically as policy landscapes evolve.”
Wipro says it uses a range of AI systems — both proprietary and supplied by third parties — from large language models to traditional machine learning and computer vision techniques to inspect physical assets in cross-border transit.
‘Not a silver bullet’
While it preferred to keep company names confidential, Wipro said that firms using its AI products to navigate Trump’s tariffs range from a Fortune 500 electronics manufacturer with factories in Asia to an automotive parts supplier exporting to Europe and North America.
“AI is a powerful enabler — but not a silver bullet,” Bandaru told CNBC. “It doesn’t replace trade policy strategy, it enhances it by transforming global trade from a reactive challenge into a proactive, data-driven advantage.”
AI was already a key investment priority for global firms prior to Trump’s sweeping tariff announcements on April. Nearly three-quarters of business leaders ranked AI and generative AI in their top three technologies for investment in 2025, according to a report by Capgemini published in January.
“There are a number of ways AI can assist companies dealing with the tariffs and resulting uncertainty. But any AI solution’s success will be predicated on the quality of the data it has access to,” Ajay Agarwal, partner at Bain Capital Ventures, told CNBC.
The venture capitalist said that one of his portfolio companies, FourKites, uses supply chain network data with AI to help firms understand the logistics impacts of adjusting suppliers due to tariffs.
“They are working with a number of Fortune 500 companies to leverage their agents for freight and ocean to provide this level of visibility and intelligence,” Agarwal said.
“Switching suppliers may reduce tariffs costs, but might increase lead times and transportation costs,” he added. “In addition, the volatility of the tariffs [has] severely impacted the rates and capacity available in both the ocean and the domestic freight networks.”
WATCH: Former OpenAI exec says tariffs ‘present AI’s moment to shine’
Technology
Amazon’s Zoox robotaxi unit issues second software recall in a month after San Francisco crash
A Zoox autonomous robotaxi in San Francisco, California, US, on Wednesday, Dec. 4, 2024.
David Paul Morris | Bloomberg | Getty Images
Amazon‘s Zoox robotaxi unit issued a voluntary recall of its software for the second time in a month following a recent crash in San Francisco.
On May 8, an unoccupied Zoox robotaxi was turning at low speed when it was struck by an electric scooter rider after braking to yield at an intersection. The person on the scooter declined medical attention after sustaining minor injuries as a result of the collision, Zoox said.
“The Zoox vehicle was stopped at the time of contact,” the company said in a blog post. “The e-scooterist fell to the ground directly next to the vehicle. The robotaxi then began to move and stopped after completing the turn, but did not make further contact with the e-scooterist.”
Zoox said it submitted a voluntary software recall report to the National Highway Traffic Safety Administration on Thursday.
A Zoox spokesperson said the notice should be published on the NHTSA website early next week. The recall affected 270 vehicles, the spokesperson said.
The NHTSA said in a statement it had received the recall notice and that the agency “advises road users to be cautious in the vicinity of vehicles because drivers may incorrectly predict the travel path of a cyclist or scooter rider or come to an unexpected stop.”
If an autonomous vehicle continues to move after contact with any nearby vulnerable road user, it risks causing harm or further harm. In the AV industry, General Motors-backed Cruise exited the robotaxi business after a collision in which one of its vehicles injured a pedestrian who had been struck by a human-driven car and was then rolled over by the Cruise AV.
Zoox’s May incident comes roughly two weeks after the company announced a separate voluntary software recall following a recent Las Vegas crash. In that incident, an unoccupied Zoox robotaxi collided with a passenger vehicle, resulting in minor damage to both vehicles.
The company issued a software recall for 270 of its robotaxis in order to address a defect with its automated driving system that could cause it to inaccurately predict the movement of another car, increasing the “risk of a crash.”
Amazon acquired Zoox in 2020 for more than $1 billion, announcing at the time that the deal would help bring the self-driving technology company’s “vision for autonomous ride-hailing to reality.”
While Zoox is in a testing and development stage with its AVs on public roads in the U.S., Alphabet’s Waymo is already operating commercial, driverless ride-hailing services in Phoenix, San Francisco, Los Angeles and Austin, Texas, and is ramping up in Atlanta.
Tesla is promising it will launch its long-delayed robotaxis in Austin next month, and, if all goes well, plans to expand after that to San Francisco, Los Angeles and San Antonio, Texas.
— CNBC’s Lora Kolodny contributed to this report.
-
Sports3 years ago‘Storybook stuff’: Inside the night Bryce Harper sent the Phillies to the World Series
-
Sports1 year agoStory injured on diving stop, exits Red Sox game
-
Sports2 years agoGame 1 of WS least-watched in recorded history
-
Sports2 years agoMLB Rank 2023: Ranking baseball’s top 100 players
-
Sports4 years ago
Team Europe easily wins 4th straight Laver Cup
-
Environment2 years agoJapan and South Korea have a lot at stake in a free and open South China Sea
-
Environment2 years agoGame-changing Lectric XPedition launched as affordable electric cargo bike
-
Business3 years agoBank of England’s extraordinary response to government policy is almost unthinkable | Ed Conway