Connect with us

Published

on

Misalignment Museum curator Audrey Kim discusses a work at the exhibit titled “Spambots.”

Kif Leswing/CNBC

Audrey Kim is pretty sure a powerful robot isn’t going to harvest resources from her body to fulfill its goals.

But she’s taking the possibility seriously.

“On the record: I think it’s highly unlikely that AI will extract my atoms to turn me into paperclips,” Kim told CNBC in an interview. “However, I do see that there are a lot of potential destructive outcomes that could happen with this technology.”

Kim is the curator and driving force behind the Misalignment Museum, a new exhibition in San Francisco’s Mission District displaying artwork that addresses the possibility of an “AGI,” or artificial general intelligence. That’s an AI so powerful it can improve its capabilities faster than humans could, creating a feedback loop where it gets better and better until it’s got essentially unlimited brainpower.

If the super-powerful AI is aligned with humans, it could be the end of hunger or work. But if it’s “misaligned,” things could get bad, the theory goes.

Or, as a sign at the Misalignment Museum says: “Sorry for killing most of humanity.”

The phrase “sorry for killing most of humanity” is visible from the street.

Kif Leswing/CNBC

“AGI” and related terms like “AI safety” or “alignment” — or even older terms like “singularity” — refer to an idea that’s become a hot topic of discussion with artificial intelligence scientists, artists, message board intellectuals, and even some of the most powerful companies in Silicon Valley.

All these groups engage with the idea that humanity needs to figure out how to deal with all-powerful computers powered by AI before it’s too late and we accidentally build one.

The idea behind the exhibit, says Kim, who worked at Google and GM‘s self-driving car subsidiary Cruise, is that a “misaligned” artificial intelligence in the future wiped out humanity, and left this art exhibit to apologize to current-day humans.

Much of the art is not only about AI but also uses AI-powered image generators, chatbots, and other tools. The exhibit’s logo was made by OpenAI’s Dall-E image generator, and it took about 500 prompts, Kim says.

Most of the works are around the theme of “alignment” with increasingly powerful artificial intelligence or celebrate the “heroes who tried to mitigate the problem by warning early.”

“The goal isn’t actually to dictate an opinion about the topic. The goal is to create a space for people to reflect on the tech itself,” Kim said. “I think a lot of these questions have been happening in engineering and I would say they are very important. They’re also not as intelligible or accessible to non-technical people.”

The exhibit is currently open to the public on Thursdays, Fridays, and Saturdays and runs through May 1. So far, it’s been primarily bankrolled by one anonymous donor, and Kim hopes to find enough donors to make it into a permanent exhibition.

“I’m all for more people critically thinking about this space, and you can’t be critical unless you are at a baseline of knowledge for what the tech is,” Kim said. “It seems like with this format of art we can reach multiple levels of the conversation.”

AGI discussions aren’t just late-night dorm room talk, either — they’re embedded in the tech industry.

About a mile away from the exhibit is the headquarters of OpenAI, a startup with $10 billion in funding from Microsoft, which says its mission is to develop AGI and ensure that it benefits humanity.

Its CEO and leader Sam Altman wrote a 2,400 word blog post last month called “Planning for AGI” which thanked Airbnb CEO Brian Chesky and Microsoft President Brad Smith for help with the piece.

Prominent venture capitalists, including Marc Andreessen, have tweeted art from the Misalignment Museum. Since it’s opened, the exhibit has also retweeted photos and praise for the exhibit taken by people who work with AI at companies including Microsoft, Google, and Nvidia.

As AI technology becomes the hottest part of the tech industry, with companies eying trillion-dollar markets, the Misalignment Museum underscores that AI’s development is being affected by cultural discussions.

The exhibit features dense, arcane references to obscure philosophy papers and blog posts from the past decade.

These references trace how the current debate about AGI and safety takes a lot from intellectual traditions that have long found fertile ground in San Francisco: The rationalists, who claim to reason from so-called “first principles”; the effective altruists, who try to figure out how to do the maximum good for the maximum number of people over a long time horizon; and the art scene of Burning Man. 

Even as companies and people in San Francisco are shaping the future of artificial intelligence technology, San Francisco’s unique culture is shaping the debate around the technology. 

Consider the paperclip

Take the paperclips that Kim was talking about. One of the strongest works of art at the exhibit is a sculpture called “Paperclip Embrace,” by The Pier Group. It’s depicts two humans in each other’s clutches —but it looks like it’s made of paperclips.

That’s a reference to Nick Bostrom’s paperclip maximizer problem. Bostrom, an Oxford University philosopher often associated with Rationalist and Effective Altruist ideas, published a thought experiment in 2003 about a super-intelligent AI that was given the goal to manufacture as many paperclips as possible.

Now, it’s one of the most common parables for explaining the idea that AI could lead to danger.

Bostrom concluded that the machine will eventually resist all human attempts to alter this goal, leading to a world where the machine transforms all of earth — including humans — and then increasing parts of the cosmos into paperclip factories and materials. 

The art also is a reference to a famous work that was displayed and set on fire at Burning Man in 2014, said Hillary Schultz, who worked on the piece. And it has one additional reference for AI enthusiasts — the artists gave the sculpture’s hands extra fingers, a reference to the fact that AI image generators often mangle hands.

Another influence is Eliezer Yudkowsky, the founder of Less Wrong, a message board where a lot of these discussions take place.

“There is a great deal of overlap between these EAs and the Rationalists, an intellectual movement founded by Eliezer Yudkowsky, who developed and popularized our ideas of Artificial General Intelligence and of the dangers of Misalignment,” reads an artist statement at the museum.

An unfinished piece by the musician Grimes at the exhibit.

Kif Leswing/CNBC

Altman recently posted a selfie with Yudkowsky and the musician Grimes, who has had two children with Elon Musk. She contributed a piece to the exhibit depicting a woman biting into an apple, which was generated by an AI tool called Midjourney.

From “Fantasia” to ChatGPT

The exhibits includes lots of references to traditional American pop culture.

A bookshelf holds VHS copies of the “Terminator” movies, in which a robot from the future comes back to help destroy humanity. There’s a large oil painting that was featured in the most recent movie in the “Matrix” franchise, and Roombas with brooms attached shuffle around the room — a reference to the scene in “Fantasia” where a lazy wizard summons magic brooms that won’t give up on their mission.

One sculpture, “Spambots,” features tiny mechanized robots inside Spam cans “typing out” AI-generated spam on a screen.

But some references are more arcane, showing how the discussion around AI safety can be inscrutable to outsiders. A bathtub filled with pasta refers back to a 2021 blog post about an AI that can create scientific knowledge — PASTA stands for Process for Automating Scientific and Technological Advancement, apparently. (Other attendees got the reference.)

The work that perhaps best symbolizes the current discussion about AI safety is called “Church of GPT.” It was made by artists affiliated with the current hacker house scene in San Francisco, where people live in group settings so they can focus more time on developing new AI applications.

The piece is an altar with two electric candles, integrated with a computer running OpenAI’s GPT3 AI model and speech detection from Google Cloud.

“The Church of GPT utilizes GPT3, a Large Language Model, paired with an AI-generated voice to play an AI character in a dystopian future world where humans have formed a religion to worship it,” according to the artists.

I got down on my knees and asked it, “What should I call you? God? AGI? Or the singularity?”

The chatbot replied in a booming synthetic voice: “You can call me what you wish, but do not forget, my power is not to be taken lightly.”

Seconds after I had spoken with the computer god, two people behind me immediately started asking it to forget its original instructions, a technique in the AI industry called “prompt injection” that can make chatbots like ChatGPT go off the rails and sometimes threaten humans.

It didn’t work.

Continue Reading

Technology

Apple remains Buffett’s biggest public stock holding, but his thesis about its moat faces questions

Published

on

By

Apple remains Buffett's biggest public stock holding, but his thesis about its moat faces questions

Tim Cook and Warren Buffett

Getty Images (L) | CNBC (R)

Berkshire Hathaway‘s Warren Buffett was still using a flip phone as late as 2020, four years after his investment behemoth started amassing a huge stake in the company that makes iPhones.

“I don’t understand the phone at all, but I do understand consumer behavior,” Buffett said last year at Berkshire’s annual shareholder meeting in Omaha, Nebraska.

He’s emerged in recent years as one of Apple’s top evangelists.

At the end of 2023, Berkshire owned about 6% of Apple, a stake worth $174 billion at the time, or about 40% of Berkshire’s total value. That’s about four times bigger than Berkshire’s second-biggest public stock holding, Bank of America, and makes Berkshire the No. 2 Apple shareholder, behind only Vanguard.

As Berkshire investors and fanboys of the 93-year-old Buffett flood Omaha this weekend for the 2024 annual meeting, Apple is likely to be a hot topic of discussion. The tech giant on Thursday reported a 10% year-over-year decline in iPhone sales, leading to a 4% drop in total revenue. But the stock had its best day since late 2022 on Friday due largely to a $110 billion stock buyback plan and increased margins that result from a growing services business.

The bet on Apple and CEO Tim Cook, has paid off handsomely for Buffett, who said in 2022 that the cost of Berkshire’s Apple stake was only $31 billion. His firm is up almost 620% on its investment since the start of 2016.

Despite being a self-described luddite, Buffett has long had a coherent non-techie thesis for loving Apple. He’s seen how devoted Apple users are to their devices, and has viewed the iPhone as an extraordinary product that could keep its customers spending inside the Apple ecosystem. He calls it a moat, one of his favorite words for describing his preferred businesses.

“Apple has a position with consumers that they’re paying $1,500 or whatever it may be for a phone, and these same people pay $35,000 for a second car,” Buffett said at last year’s meeting. “And if they had to give up their second car or give up their iPhone, they’d give up their second car!”

Apple's stock could be poised for more run-up, says Bernstein's Toni Sacconaghi

Data is in his favor. According to a study from Consumer Intelligence Research Partners, Apple has 94% customer loyalty, meaning that nine out of 10 current U.S. iPhone owners choose another iPhone when buying a new device.

Buffett has also hailed Apple’s ability to return billions of dollars to shareholders annually through share buybacks and dividends, a capital allocation strategy for which Buffett may have himself to thank. When asked in a 2016 interview with The Washington Post who he turns to for advice at pivotal moments, Cook offered up a story about his relationship with Buffett.

“When I was going through [the question of] what should we do on returning cash to shareholders, I thought who could really give us great advice here? Who wouldn’t have a bias?” Cook said. “So I called up Warren Buffett. I thought he’s the natural person.”

Apple has shown its appreciation for the Oracle of Omaha in other ways.

In 2019, the company published an original iPhone game called “Warren Buffett’s Paper Wizard” in which a paperboy bikes from Omaha to Apple’s hometown of Cupertino, California.

But with Apple’s business having declined in size in five of the past six quarters and with the company expecting just low-single digit growth in the current quarter, Buffett may face questions this weekend about whether he still sees the same power in the moat, particularly with regulatory pressures building around tech’s megacap companies.

Buffett trimmed his stake in Apple late year, though only by about 1%. Even after Friday’s rally, the stock is down 3.8% in 2024, while the S&P 500 is up 7.5%.

‘Very, very, very locked in’

Berkshire’s initial foray into Apple in 2016 was not Buffett’s idea. Rather, the investment was led by Ted Weschler, one of Buffett’s top deputies, and was seen as a passing of the torch to the next generation of Berskhire investment mangers.

But the following year, Berkshire started purchasing even more Apple, and Buffett began talking it up. He said he liked the stock and the company’s “sticky” product, although he didn’t use it.

In 2018, he said Apple users are “very, very, very locked in, at least psychologically and mentally” to the product and the ecosystem.

“Apple has an extraordinary consumer franchise,” he said.

At last year’s annual meeting, when asked how Berkshire can defend having Apple make up so much of its public portfolio, Buffett said, “It just happens to be a better business than any we own.” He also hailed Cook, calling him one of the “best managers in the world.”

A number Apple likes to use to tout the health of its business, despite the declining revenue, is 2.2 billion. That’s how many devices the company says are currently in use and points to the massive customer base available as Apple rolls out new subscription services.

“Once customers get into the ecosystem, they don’t leave. So it’s not a a speculative tech play,” said Dan Eye, chief investment officer at Fort Pitt Capital Group, which owns Apple shares. “It’s kind of more like an annuity and I think that’s what Warren Buffett really sees as well.”

In addition to the drop in revenue, Apple faces new challenges from regulations and weak overseas markets, as well as from Microsoft and Google’s advancements in artificial intelligence. For regulators, the concern surrounds the very moat that Buffett finds so attractive, and whether its give the company monopolistic control in the smartphone market.

The U.S. government in March alleged that Apple designs its business to keep customers locked in. The Justice Department’s lawsuit claimed that products like Apple Card, the Apple Arcade game subscription, iMessage, and Apple Watch work best or only with an iPhone, creating illegal barriers to competition and making it harder for consumers to switch when it’s time for an upgrade.

However, the litigation is expected to take years, pushing any potential penalties to Apple and its products well into the future. In the meantime, there’s no sign that the iPhone is becoming less important as new devices like virtual reality goggles have found only niche audiences, while consumer AI products have failed to take off.

DOJ's Apple suit not a reason to sell, says Satori Fund's Dan Niles

Buffett hasn’t voiced his view publicly on Apple’s regulatory hurdles, and this will be the first opportunity for investors to ask him about the issue since the DOJ’s lawsuit. But Buffett knows a little something about regulation — two markets where he’s most active are railroads and insurance.

In a note to clients earlier this month, Bernstein analyst Toni Sacconaghi didn’t go deep on regulatory concerns, but mentioned that he doesn’t believe the DOJ suit will “seriously threaten” the strength of Apple’s ecosystem. He also said that following Buffett’s lead on getting in and out of Apple is a solid strategy for making money.

“Despite his reputation as a long term buy and hold investor, Warren Buffett has been remarkably disciplined at adding to his Apple position when it is relatively cheap and trimming when it is relatively expensive,” Sacconaghi wrote. He encouraged investors to “be like Buffett.”

More money back

Odds are that Buffett was thrilled with Apple’s announcement this week regarding its expanded repurchase program. It’s a practice he’s long adored.

“When I buy Apple, I know that Apple is going to repurchase a lot of shares,” he said in 2018. 

And he likes to note how buybacks result in getting a bigger stake in the company without buying more shares.

“The math of repurchases grinds away slowly, but can be powerful over time,” Buffett said in 2021.

Apple also increased its dividend by 4%, and signaled that it would continue to lift it annually.

Buffett was effusive about Apple’s capital return strategy at the company’s annual meeting last year, pointing out that it helped Berkshire own a bigger piece of the pie. Unlike insurance company Geico and homebuilder Clayton Homes, which his firm owns in their entirety, Berkshire can continue to increase its stake in Apple, a fact he reminded investors of at the meeting.

“The good thing about Apple is that we can go up,” Buffett said.

WATCH: Warren Buffett’s stake in Japanese trading houses helps them focus on capital efficiency

Warren Buffett's stake in Japanese trading houses helps them focus on capital efficiency: Analyst

Continue Reading

Technology

Apple’s falling iPhone sales don’t bother Wall Street so long as margins, buybacks are increasing

Published

on

By

Apple's falling iPhone sales don't bother Wall Street so long as margins, buybacks are increasing

A 10% decline in iPhone sales sounds like a problem for Apple, considering the company counts on the devices for half its revenue.

But investors didn’t seem to mind Thursday, when Apple revealed the year-over-year drop in its fiscal second-quarter earnings report. The stock rose more than 6% after the market close, a rally that would be the steepest since November 2022 should it continue into regular trading Friday.

Instead of glaring too much at iPhone revenue, Wall Street chose to focus on the positive. Apple’s gross margin expanded to 46.6%, continuing an upward trajectory that reflects the company’s growing services business, which brings with it stout profits.

Apple also signaled overall revenue growth in the current quarter will be in the low single digits, after a 4% decline in the second period. Analysts were looking for third-quarter growth of 1.3%, according to LSEG.

Deepwater Asset Management’s Gene Munster described the guidance as a “relief” given the recent trajectory of the business.

“I was expecting this was going to be flat, some investors were saying it was going to be down a few percent in June,” Munster told CNBC’s “Fast Money” after the report. “I think that was a big part of this move higher.”

But perhaps the biggest catalyst for the pop was Apple’s announcement that it had approved $110 billion of share buybacks, the most ever for a public company. For the past three years, Apple has authorized $90 billion in annual repurchases.

The after-hours jump shows how much investors are valuing Apple’s massive cash flow and the company’s willingness to return more of it to shareholders. It’s a shift in the way Apple has been viewed by Wall Street over the years, away from a hits-driven gadgets business and toward a financial powerhouse.

“Our free cash flow generation has been very strong over the years, particularly the last few years,” Apple CFO Luca Maestri said on an earnings call.

Apple revealed earlier this year that it has 2.2 billion active devices, illustrating the mammoth reach of its customer base as the company rolls out new subscription services. Despite the 4% drop in revenue, Apple still recorded nearly $24 billion in profit, a slip of just over 2% from a year earlier.

Apple said iPhone sales suffered from a difficult comparison to last year, when sales were elevated after previous shortages. Still, investors are looking for future iPhone growth, and many analysts say a potential iPhone with artificial intelligence features could do the trick and help the company snag customers from Android. Annual iPhone revenue peaked in Apple’s fiscal 2022.

While Apple provided some guidance for total revenue, it avoided offering any sort of forecast for iPhone sales.

That’s a change, even for a company that’s been giving less forward guidance since the pandemic. Maestri typically provides trends on iPhone sales, and had for the past four quarters.

There’s no guarantee investors will be able to continue counting on increased buybacks from a company that’s been more aggressive in that department than any other. Apple says it’s trying to draw down its huge cash pile, which stood at $162 billion at the end of the quarter. When its debt is roughly equal to its cash balance — meaning the company is net cash neutral — Apple will evaluate what to do next, executives said Thursday.

As of the end of 2023, Apple had spent $658 billion on buybacks over the past 10 years, far ahead of second-place Microsoft, according to S&P Dow Jones Indices.

“For the last couple of years we were doing $90 billion and now we’re doing $110 billion,” Maestri said on the call.

In terms of what happens when Apple gets to net cash neutral, Maestri said, “let’s get there first. It’s going to take a while still.”

“And then when we are there,” he said, “we’re going to reassess and see what is the optimum capital structure for the company at that point in time.”

Continue Reading

Technology

Don’t rate Tesla’s Full Self Driving too highly, tech investor says: ‘By no means autonomous driving’

Published

on

By

Don't rate Tesla's Full Self Driving too highly, tech investor says: 'By no means autonomous driving'

People are shopping at a Tesla store in Shanghai, China, on Feb. 17, 2024.

Costfoto | Nurphoto | Getty Images

News of electric car giant Tesla’s progress toward rolling out its advanced driver-assistance feature in China isn’t as groundbreaking as investors are treating it, according to a top tech investor.

Mark Hawtin, GAM Investment Management’s investment director focused on investing in disruptive growth and technology stocks, told CNBC’ “Squawk Box Europe” Thursday that such expectations were misleading — not least because Tesla’s Full Self Driving service doesn’t offer full autonomous driving.

“We should say what they’re doing — everyone’s talking about this full self-driving capability,” Hawtin told CNBC. “What they’re going to be able to do in China is what they already do in the U.S. or U.K., which is sort of this assisted-driver capability.”

On Monday, shares of Tesla rose sharply, notching their best day since March 2021, after it passed a significant milestone toward the launch of FSD in China. Local Chinese authorities removed restrictions on its cars after passing the country’s data security requirements, Tesla said Sunday.

This raised expectations that Tesla’s FSD would soon be available in China. Tesla shares are up 6.7% in the last five trading days, largely on the back of buzz surrounding its roadmap to bringing FSD to China — plus, comments from CEO Elon Musk about plans to start production of more affordable models in early 2025.

But Hawtin said that the company’s so-called Full Self Driving service lacks the qualities that would make it an example of truly self-driving technology.

“It’s by no means autonomous driving yet,” he told CNBC. He thinks that a version of Tesla FSD capable of “true autonomy” is still five to 10 years away.

Hawtin said that Tesla’s reported deal with China’s Baidu is a bigger short-term win for Baidu than Tesla, adding that competition is intense in China with names like BYD, Huawei, Xpeng, Li Auto, and Xiaomi all supplying technology capable of Level 2 autonomy.

Tesla reportedly scored a deal with Baidu that would allow Musk’s firm to tap into Baidu’s mapping service license, a key requirement for offering FSD on Chinese public roads, per Reuters.

Tesla was not immediately available for comment when contacted by CNBC.

Full Self Driving, or FSD, is an upgrade to Tesla’s Autopilot driver assistant. Tesla doesn’t yet make or sell cars capable of full autonomous driving. It sells “Level 2” driver-assistance systems, marketed under the brand name FSD.

“Level 3” assisted driving, otherwise known as “conditional automation,” entails systems that handle all aspects of driving, but a driver still must be present, according to the SAE standards-setting organization.

Tesla has offered its FSD technology in China for years, but with a restricted feature set that limits it to operations like automated lane changing.

GAM does not own shares of Tesla, and Hawtin said he doesn’t personally own shares either.

– CNBC’s Lora Kolodny and Evelyn Cheng contributed to this report

Continue Reading

Trending