Connect with us

Published

on

Misalignment Museum curator Audrey Kim discusses a work at the exhibit titled “Spambots.”

Kif Leswing/CNBC

Audrey Kim is pretty sure a powerful robot isn’t going to harvest resources from her body to fulfill its goals.

But she’s taking the possibility seriously.

“On the record: I think it’s highly unlikely that AI will extract my atoms to turn me into paperclips,” Kim told CNBC in an interview. “However, I do see that there are a lot of potential destructive outcomes that could happen with this technology.”

Kim is the curator and driving force behind the Misalignment Museum, a new exhibition in San Francisco’s Mission District displaying artwork that addresses the possibility of an “AGI,” or artificial general intelligence. That’s an AI so powerful it can improve its capabilities faster than humans could, creating a feedback loop where it gets better and better until it’s got essentially unlimited brainpower.

If the super-powerful AI is aligned with humans, it could be the end of hunger or work. But if it’s “misaligned,” things could get bad, the theory goes.

Or, as a sign at the Misalignment Museum says: “Sorry for killing most of humanity.”

The phrase “sorry for killing most of humanity” is visible from the street.

Kif Leswing/CNBC

“AGI” and related terms like “AI safety” or “alignment” — or even older terms like “singularity” — refer to an idea that’s become a hot topic of discussion with artificial intelligence scientists, artists, message board intellectuals, and even some of the most powerful companies in Silicon Valley.

All these groups engage with the idea that humanity needs to figure out how to deal with all-powerful computers powered by AI before it’s too late and we accidentally build one.

The idea behind the exhibit, says Kim, who worked at Google and GM‘s self-driving car subsidiary Cruise, is that a “misaligned” artificial intelligence in the future wiped out humanity, and left this art exhibit to apologize to current-day humans.

Much of the art is not only about AI but also uses AI-powered image generators, chatbots, and other tools. The exhibit’s logo was made by OpenAI’s Dall-E image generator, and it took about 500 prompts, Kim says.

Most of the works are around the theme of “alignment” with increasingly powerful artificial intelligence or celebrate the “heroes who tried to mitigate the problem by warning early.”

“The goal isn’t actually to dictate an opinion about the topic. The goal is to create a space for people to reflect on the tech itself,” Kim said. “I think a lot of these questions have been happening in engineering and I would say they are very important. They’re also not as intelligible or accessible to non-technical people.”

The exhibit is currently open to the public on Thursdays, Fridays, and Saturdays and runs through May 1. So far, it’s been primarily bankrolled by one anonymous donor, and Kim hopes to find enough donors to make it into a permanent exhibition.

“I’m all for more people critically thinking about this space, and you can’t be critical unless you are at a baseline of knowledge for what the tech is,” Kim said. “It seems like with this format of art we can reach multiple levels of the conversation.”

AGI discussions aren’t just late-night dorm room talk, either — they’re embedded in the tech industry.

About a mile away from the exhibit is the headquarters of OpenAI, a startup with $10 billion in funding from Microsoft, which says its mission is to develop AGI and ensure that it benefits humanity.

Its CEO and leader Sam Altman wrote a 2,400 word blog post last month called “Planning for AGI” which thanked Airbnb CEO Brian Chesky and Microsoft President Brad Smith for help with the piece.

Prominent venture capitalists, including Marc Andreessen, have tweeted art from the Misalignment Museum. Since it’s opened, the exhibit has also retweeted photos and praise for the exhibit taken by people who work with AI at companies including Microsoft, Google, and Nvidia.

As AI technology becomes the hottest part of the tech industry, with companies eying trillion-dollar markets, the Misalignment Museum underscores that AI’s development is being affected by cultural discussions.

The exhibit features dense, arcane references to obscure philosophy papers and blog posts from the past decade.

These references trace how the current debate about AGI and safety takes a lot from intellectual traditions that have long found fertile ground in San Francisco: The rationalists, who claim to reason from so-called “first principles”; the effective altruists, who try to figure out how to do the maximum good for the maximum number of people over a long time horizon; and the art scene of Burning Man. 

Even as companies and people in San Francisco are shaping the future of artificial intelligence technology, San Francisco’s unique culture is shaping the debate around the technology. 

Consider the paperclip

Take the paperclips that Kim was talking about. One of the strongest works of art at the exhibit is a sculpture called “Paperclip Embrace,” by The Pier Group. It’s depicts two humans in each other’s clutches —but it looks like it’s made of paperclips.

That’s a reference to Nick Bostrom’s paperclip maximizer problem. Bostrom, an Oxford University philosopher often associated with Rationalist and Effective Altruist ideas, published a thought experiment in 2003 about a super-intelligent AI that was given the goal to manufacture as many paperclips as possible.

Now, it’s one of the most common parables for explaining the idea that AI could lead to danger.

Bostrom concluded that the machine will eventually resist all human attempts to alter this goal, leading to a world where the machine transforms all of earth — including humans — and then increasing parts of the cosmos into paperclip factories and materials. 

The art also is a reference to a famous work that was displayed and set on fire at Burning Man in 2014, said Hillary Schultz, who worked on the piece. And it has one additional reference for AI enthusiasts — the artists gave the sculpture’s hands extra fingers, a reference to the fact that AI image generators often mangle hands.

Another influence is Eliezer Yudkowsky, the founder of Less Wrong, a message board where a lot of these discussions take place.

“There is a great deal of overlap between these EAs and the Rationalists, an intellectual movement founded by Eliezer Yudkowsky, who developed and popularized our ideas of Artificial General Intelligence and of the dangers of Misalignment,” reads an artist statement at the museum.

An unfinished piece by the musician Grimes at the exhibit.

Kif Leswing/CNBC

Altman recently posted a selfie with Yudkowsky and the musician Grimes, who has had two children with Elon Musk. She contributed a piece to the exhibit depicting a woman biting into an apple, which was generated by an AI tool called Midjourney.

From “Fantasia” to ChatGPT

The exhibits includes lots of references to traditional American pop culture.

A bookshelf holds VHS copies of the “Terminator” movies, in which a robot from the future comes back to help destroy humanity. There’s a large oil painting that was featured in the most recent movie in the “Matrix” franchise, and Roombas with brooms attached shuffle around the room — a reference to the scene in “Fantasia” where a lazy wizard summons magic brooms that won’t give up on their mission.

One sculpture, “Spambots,” features tiny mechanized robots inside Spam cans “typing out” AI-generated spam on a screen.

But some references are more arcane, showing how the discussion around AI safety can be inscrutable to outsiders. A bathtub filled with pasta refers back to a 2021 blog post about an AI that can create scientific knowledge — PASTA stands for Process for Automating Scientific and Technological Advancement, apparently. (Other attendees got the reference.)

The work that perhaps best symbolizes the current discussion about AI safety is called “Church of GPT.” It was made by artists affiliated with the current hacker house scene in San Francisco, where people live in group settings so they can focus more time on developing new AI applications.

The piece is an altar with two electric candles, integrated with a computer running OpenAI’s GPT3 AI model and speech detection from Google Cloud.

“The Church of GPT utilizes GPT3, a Large Language Model, paired with an AI-generated voice to play an AI character in a dystopian future world where humans have formed a religion to worship it,” according to the artists.

I got down on my knees and asked it, “What should I call you? God? AGI? Or the singularity?”

The chatbot replied in a booming synthetic voice: “You can call me what you wish, but do not forget, my power is not to be taken lightly.”

Seconds after I had spoken with the computer god, two people behind me immediately started asking it to forget its original instructions, a technique in the AI industry called “prompt injection” that can make chatbots like ChatGPT go off the rails and sometimes threaten humans.

It didn’t work.

Continue Reading

Technology

Here’s where Apple makes its products — and how Trump’s tariffs could have an impact

Published

on

By

Here's where Apple makes its products — and how Trump's tariffs could have an impact

Apple’s iPhone 16 at an Apple Store on Regent Street in London on Sept. 20, 2024.

Rasid Necati Aslim | Anadolu | Getty Images

Apple has made moves to diversify its supply chain beyond China to places like India and Vietnam, but tariffs announced by the White House are set to hit those countries too.

U.S. President Donald Trump laid out “reciprocal tariff” rates on more than 180 countries on Wednesday.

China will face a 34% tariff, but with the existing 20% rate, that brings the true tariff rate on Beijing under this Trump term to 54%, CNBC reported. India faces a 26% tariff, while Vietnam’s rate is 46%.

Apple was not immediately available for comment when contacted by CNBC.

Here’s a breakdown on Apple’s supply chain footprint that could be affected by tariffs.

China

The majority of Apple’s iPhones are still assembled in China by partner Foxconn.

China accounts for around 80% of Apple’s production capacity, according to estimates from Evercore ISI in a note last month.

Around 90% of iPhones are assembled in China, Evercore ISI said.

While the number of manufacturing sites in China dropped between Apple’s 2017 and 2020 fiscal year, it has since rebounded, Bernstein said in a note last month. Chinese suppliers account for around 40% of Apple’s total, Bernstein said.

Evercore ISI estimates that 55% of Apple’s Mac products and 80% of iPads are assembled in China.

India

Apple is targeting around 25% of all iPhones globally to be made in India, a government minister said in 2023.

India could reach about 15%-20% of overall iPhone production by the end of 2025, Bernstein analysts estimate. Evercore ISI said around 10% to 15% of iPhones are currently assembled in India.

Vietnam

Vietnam has emerged in the past few years as a popular manufacturing hub for consumer electronics. Apple has increased its production in Vietnam.

Around 20% of iPad production and 90% of Apple’s wearable product assembly like the Apple Watch takes place in Vietnam, according to Evercore ISI.

Other key countries

Continue Reading

Technology

Xiaomi delivers record cars in March as winners emerge in China’s EV race

Published

on

By

Xiaomi delivers record cars in March as winners emerge in China's EV race

A Xiaomi store in Shanghai, China, on March 16, 2025.

Qilai Shen/Bloomberg | Bloomberg | Getty Images

Chinese electric carmakers Xiaomi, Xpeng and Leapmotor each delivered nearly 30,000 or more cars in March, roughly twice several of their fellow startup competitors.

It’s a sign of how some automakers are pulling ahead, while BYD remains the market leader by far.

Xiaomi delivered a record number of electric vehicles in March, exceeding 29,000 units, the company announced on social media. That topped its prior run of delivering more than 20,000 vehicles in each of the past five months.

The SU7, Xiaomi’s flagship model, was involved in a crash on a highway on Tuesday that left three dead. The automaker on Tuesday afternoon released a statement on Chinese social media that the vehicle was in navigation on autopilot mode before the accident.

Based on preliminary information, the road was obstructed because of construction. The driver took control of the car but collided with construction infrastructure. Xiaomi added in the release that investigations were underway.

That came two weeks after the automaker announced on March 18 its goal to deliver 350,000 vehicles this year. There are also talks of the automaker expanding its second EV factory in Beijing to meet demand, Bloomberg reported on March 18. Xiaomi did not immediately respond to CNBC’s request for comment.

Its competitor Xpeng in March delivered 33,205 vehicles, the fifth consecutive month it has delivered over 30,000 units per month and reflecting a 268% surge in deliveries from the same month last year. March is also the fifth consecutive month the company has delivered over 15,000 units of the Mona M03.

Leapmotor delivered 37,095 vehicles, reflecting a 154% year-over-year growth. The Stellantis-owned automaker last month launched U.K. sales of two electric vehicle models, the T03 and the C10.

Li Auto delivered 36,674 vehicles in March, a 26.5% year-over-year increase, but fewer than every month in the second half of 2024. The company’s cars had gained early traction with Chinese consumers since most come with a fuel tank for charging the vehicle’s battery, reducing anxiety about driving range.

Tesla takes two of three top spots in China's most popular EV list

BYD sold 371,419 passenger vehicles in March, reflecting a year-over-year growth of 57.9%. Its overseas sales volume also hit a record high of 72,723 units in March.

In the same month, the automaker unveiled its “Super e-Platform” technology, which boasts 400 kilometers (roughly 249 miles) of range with five minutes of charging. The company in February also announced that it was integrating DeepSeek artificial intelligence to develop “DiPilot,” its advanced driver-assistance system.

Across the board, major companies across China’s electric car industry reported deliveries rose last month, indicating a pick-up in demand from the seasonally soft first two months of the year.

U.S. automaker Tesla sold 78,828 electric vehicles in China in March, marking a 11.5% year-over-year decline in growth.

Other Chinese carmakers saw growth in deliveries but some still struggled to break through the 20,000-unit mark.  

Nio delivered 15,039 vehicles, a 26.7% year-over-year growth, but well below the number of cars delivered in the months of May to December last year. Nio-owned Onvo, which markets its electric vehicles as family-oriented, in March recorded 15,039 units in deliveries.

Geely-owned Zeekr delivered 15,422 vehicles in March, increasing by 18.5% year over year. The company last month announced its rollout of free advanced driver-assistance technology to local customers in a bid to compete in the market.

Aito, as of April 2, has not published its delivery numbers for March. The automaker, which uses Huawei tech in its vehicles, on social media had reported monthly deliveries of 34,987 and 21,517 in January and February, respectively.

Quarterly performance

On a first-quarter basis, BYD remained in the lead with 986,098 vehicles sold. The automaker, which overtook Tesla in annual sales last year, surpassed the U.S. EV giant in battery electric vehicles sales this quarter.

Tesla sold 172,754 vehicles in China in the first quarter this year, according to monthly delivery numbers published by the China Passenger Car Association.

Xpeng also reported strong growth, with a total of 94,008 vehicles delivered in the quarter ending in March, reflecting a 331% year-over-year growth.

Leapmotor saw quarterly deliveries more than double to 87,552 units from 33,410 units the same period in 2024, according to publicly available numbers the company published.

However, Li Auto and Nio reported weaker growth than their competitors in the first quarter of the year.

Nio saw 42,094 vehicles delivered in the three months ended March 2025, an increase of 40.1% year over year. Li Auto saw a slower year-over-year growth of 15.5%, with a total of 92,864 vehicles delivered.

Continue Reading

Technology

De minimis trade loophole that boosted Chinese online retailers to end May 2

Published

on

By

De minimis trade loophole that boosted Chinese online retailers to end May 2

A driver for an independent contractor to FedEx delivers packages on Cyber Monday in New York, US, on Monday, Nov. 27, 2023.

Stephanie Keith | Bloomberg | Getty Images

President Donald Trump on Wednesday signed an executive order shutting the de minimis trade loophole, effective May 2.

Trump in February abruptly ended the de minimis trade exemption, which allows shipments worth less than $800 to enter the U.S. duty-free. The order overwhelmed U.S. Customs and Border Protection employees and caused the U.S. Postal Service to temporarily halt packages from China and Hong Kong. Within days of its announcement, Trump reversed course and delayed the cancellation of the provision.

Wednesday’s announcement, which came alongside a set of sweeping new tariffs, gives customs officials, retailers and logistics companies more time to prepare. Goods that qualify under the de minimis exemption will be subject to a duty of either 30% of their value, or $25 per item. That rate will increase to $50 per item on June 1, the White House said.

Use of the de minimis provision has exploded in recent years as shoppers flock to Chinese e-commerce companies Temu and Shein, which offer ultra-low cost apparel, electronics and other items. The U.S. Customs and Border Protection has said it processed more than 1.3 billion de minimis shipments in 2024, up from over 1 billion shipments in 2023.

Critics of the provision say it provides an unfair advantage to Chinese e-commerce companies and creates an influx of packages that are “subject to minimal documentation and inspection,” raising concerns around counterfeit and unsafe goods.

The Trump administration has sought to close the loophole over concerns that it facilitates shipments of fentanyl and other illicit substances on the claims that the packages are less likely to be inspected by customs agents.

Temu and Shein have taken steps to grow their operations in the U.S. as the de minimis loophole has come under greater scrutiny. After onboarding sellers with inventory in U.S. warehouses, Temu recently began steering shoppers to those items on its website, allowing it to speed up deliveries. Shein opened distribution centers in states including Illinois and California in 2022, and a supply chain hub in Seattle last year.

WATCH: President Trump signs executive orders for reciprocal tariffs

Pres. Trump signs executive orders for reciprocal tariffs

Continue Reading

Trending