About four years ago, former Google CEO Eric Schmidt was appointed to the National Security Commission on Artificial Intelligence by the chairman of the House Armed Services Committee.
It was powerful perch. Congress tasked the new group with a broad mandate: to advise the US government on how to advance the development of artificial intelligence (AI), machine learning and other technologies to enhance the national security of the United States.
The mandate was simple: Congress directed the new body to advise on how to enhance American competitiveness on AI against its adversaries, build the AI workforce of the future and develop data and ethical procedures.
In short, the commission, which Schmidt soon took charge of as chairman, was tasked with coming up with recommendations for almost every aspect of a vital and emerging industry. The panel did far more under his leadership. It wrote proposed legislation that later became law and steered billions of dollars of taxpayer funds to industry he helped build — and that he was actively investing in while running the group.
If you’re going to be leading a commission that is steering the direction of government AI and making recommendations for how we should promote this sector and scientific exploration in this area, you really shouldn’t also be dipping your hand in the pot and helping yourself to AI investments.
Walter Shaub
Senior Ethics Fellow, Project on Government Oversight
His credentials, however, were impeccable given his deep experience in Silicon Valley, his experience advising the Defense Department, and a vast personal fortune estimated at about $20 billion dollars.
Five months after his appointment, Schmidt made a little-noticed private investment in an initial seed round of financing for a start-up company called Beacon, which uses AI in the company’s supply chain products for shippers who manage freight logistics, according to CNBC’s review of investment data in database Crunchbase.
There is no indication that Schmidt broke any ethics rules or did anything unlawful while chairing the commission. The commission was, by design, an outside advisory group of industry participants, and its other members included other well-known tech executives including Oracle CEO Safra Catz, Amazon Web Services CEO Andy Jassy and Microsoft Chief Scientific Officer Dr. Eric Horvitz, among others.
‘Conflict of interest’
Schmidt’s investment was just the first of a handful of direct investments he would make in AI start-up companies during his tenure as chairman of the AI commission.
“It’s absolutely a conflict of interest,” said Walter Shaub, a senior ethics fellow at the Project on Government Oversight, and the former director of the U.S. office of Government Ethics.
“That’s technically legal for a variety of reasons, but it’s not the right thing to do,” Shaub said.
Venture capital firms financed, in part, by Schmidt and his private family foundation also made dozens of additional investments in AI companies during Schmidt’s tenure, giving Schmidt an economic stake in the industry even as he developed new regulations and encouraged taxpayer financing for it. Altogether, Schmidt and entities connected to him made more than 50 investments in AI companies while he was chairman of the federal commission on AI. Information on his investments isn’t publicly available.
All that activity meant that, at the same time Schmidt was wielding enormous influence over the future of federal AI policy, he was also potentially positioning himself to profit personally from the most promising young AI companies.
Institutional issues
Schmidt’s conflict of interest is not unusual. The investments are an example of a broader issue identified by ethics reformers in Washington, DC: Outside advisory committees that are given significant sway over industries without enough public disclosure of potential conflicts of interest. “The ethics enforcement process in the executive branch is broken, it does not work,” said Craig Holman, a lobbyist on ethics, lobbying and campaign finance for Public Citizen, the consumer advocacy organization. “And so the process itself is partly to blame here.”
The federal government counts a total of 57 active federal advisory commissions, with members offering input on everything from nuclear reactor safeguards to environmental rules and global commodities markets.
For years, reformers have tried to impose tougher ethics rules on Washington’s sprawling network of outside advisory commissions. In 2010, then-President Barack Obama used an executive order to block federally registered lobbyists from serving on federal boards and commissions. But a group of Washington lobbyists fought back with a lawsuit arguing the new rule was unfair to them, and the ban was scaled back.
‘Fifth arm of government’
The nonprofit Project on Government Oversight has called federal advisory committees the “fifth arm of government” and has pushed for changes including additional requirements for posting conflict-of-interest waivers and recusal statements, as well as giving the public more input in nominating committee members. Also in 2010, the House passed a bill that would prohibit the appointment of commission members with conflicts of interest, but the bill died in the Senate.
“It’s always been this way,” Holman said. “When Congress created the Office of Government Ethics to oversee the executive branch, you know, they didn’t really want a strong ethics cop, they just wanted an advisory commission.” Holman said each federal agency selects its own ethics officer, creating a vast system of more than 4,000 officials. But those officers aren’t under the control of the Office of Government Ethics – there’s “no one person in charge,” he said.
Eric Schmidt during a news conference at the main office of Google Korea in Seoul on November 8, 2011.
Jung Yeon-je | Afp | Getty Images
People close to Schmidt say his investments were disclosed in a private filing to the U.S. government at the time. But the public and the news media had no access to that document, which was considered confidential. The investments were not revealed to the public by Schmidt or the commission. His biography on the commission’s website detailed his experiences at Google, his efforts on climate change and his philanthropy, among other details. But it did not mention his active investments in artificial intelligence.
A spokesperson for Schmidt told CNBC that he followed all rules and procedures in his tenure on the commission: “Eric has given full compliance on everything,” the spokesperson said.
But ethics experts say Schmidt simply should not have made private investments while leading a public policy effort on artificial intelligence.
“If you’re going to be leading a commission that is steering the direction of government AI and making recommendations for how we should promote this sector and scientific exploration in this area, you really shouldn’t also be dipping your hand in the pot and helping yourself to AI investments,” said Shaub of the Project on Government Oversight.
He said there were several ways Schmidt could have minimized this conflict of interest: He could have made the public aware of his AI investments, he could have released his entire financial disclosure report, or he could have made the decision not to invest in AI while he was chair of the AI commission.
Public interest
“It’s extremely important to have experts in the government,” Shaub said. “But it’s, I think, even more important to make sure that you have experts who are putting the public’s interests first.”
The AI commission, which Schmidt chaired until it expired in the fall of 2021, was far from a stereotypical Washington blue-ribbon commission issuing white papers that few people actually read.
Instead, the commission delivered reports which contained actual legislative language for Congress to pass into law to finance and develop the artificial intelligence industry. And much of that recommended language was written into vast defense authorization bills. Sections of legislative language passed, word for word, from the commission into federal law.
The commission’s efforts also sent millions of taxpayer dollars to priorities it identified. In just one case, the fiscal year 2023 National Defense Authorization Act included $75 million “for implementing the National Security Commission on Artificial Intelligence recommendations.”
At a commission event in September 2021, Schmidt touted the success of his team’s approach. He said the commission staff “had this interesting idea that not only should we write down what we thought, which we did, but we would have a hundred pages of legislation that they could just pass.” That, Schmidt said, was “an idea that had never occurred to me before but is actually working.”
$200 billion modification
Schmidt said one piece of legislation moving on Capitol Hill was “modified by $200 billion dollars.” That, he said, was “essentially enabled by the work of the staff” of the commission.
At that same event, Schmidt suggested that his staff had wielded similar influence over the classified annexes to national security related bills emanating from Congress. Those documents provide financing and direction to America’s most sensitive intelligence agencies. To protect national security, the details of such annexes are not available to the American public.
“We don’t talk much about our secret work,” Schmidt said at the event. “But there’s an analogous team that worked on the secret stuff that went through the secret process that has had similar impact.”
Asked whether classified language in the annex proposed by the commission was adopted in legislation that passed into law, a person close to Schmidt responded, “due to the classified nature of the NSCAI annex, it is not possible to answer this question publicly. NSCAI provided its analysis and recommendations to Congress, to which members of Congress and their staff reviewed and determined what, if anything, could/should be included in a particular piece of legislation.”
Beyond influencing classified language on Capitol Hill, Schmidt suggested that the key to success in Washington was being able to push the White House to take certain actions. “We said we need leadership from the White House,” Schmidt said at the 2021 event. “If I’ve learned anything from my years of dealing with the government, is the government is not run like a tech company. It’s run top down. So, whether you like it or not, you have to start at the top, you have to get the right words, either they say it, or you write it for them, and you make it happen. Right? And that’s how it really, really works.”
Industry friendly
The commission produced a final report with topline conclusions and recommendations that were friendly to the industry, calling for vastly increased federal spending on AI research and a close working relationship between government and industry.
The final report waived away concerns about too much government intervention in the private sector or too much federal spending.
“This is not a time for abstract criticism of industrial policy or fears of deficit spending to stand in the way of progress,” the commission concluded in its 2021 report. “In 1956, President Dwight Eisenhower, a fiscally conservative Republican, worked with a Democratic Congress to commit $10 billion to build the Interstate Highway System. That is $96 billion in today’s world.”
The commission didn’t go quite that big, though. In the end, it recommended $40 billion in federal spending on AI, and suggested it should be done hand in hand with tech companies.
“The federal government must partner with U.S. companies to preserve American leadership and to support development of diverse AI applications that advance the national interest in the broadest sense,” the commission wrote. “If anything, this report underplays the investments America will need to make.”
The urgency driving all of this, the commission said, is Chinese development of AI technology that rivals the software coming out of American labs: “China’s plans, resources, and progress should concern all Americans.”
China, the commission said, is an AI peer in many areas and a leader in others. “We take seriously China’s ambition to surpass the United States as the world’s AI leader within a decade,” it wrote.
But Schmidt’s critics see another ambition behind the commission’s findings: Steering more federal dollars toward research that can benefit the AI industry.
“If you put a tech billionaire in charge, any framing that you present them, the solution will be, ‘give my investments more money,’ and that’s indeed what we see,” said Jack Poulson, executive director of the nonprofit group Tech Inquiry. Poulson formerly worked as a research scientist at Google, but he resigned in 2018 in protest of what he said was Google bending to the censorship demands of the Chinese government.
Too much power?
To Poulson, Schmidt was simply given too much power over federal AI policy. “I think he had too much influence,” Poulson said. “If we believe in a democracy, we should not have a couple of tech billionaires, or, in his case, one tech billionaire, that is essentially determining US government allocation of hundreds of billions of dollars.”
The federal commission wound down its work on Oct. 1, 2021.
Four days later, on Oct. 5, Schmidt announced a new initiative called the Special Competitive Studies Project. The new entity would continue the work of the congressionally created federal commission, with many of the same goals and much of the same staff. But this would be an independent nonprofit and operate under the financing and control of Schmidt himself, not Congress or the taxpayer. The new project, he said, will “make recommendations to strengthen America’s long-term global competitiveness for a future where artificial intelligence and other emerging technologies reshape our national security, economy, and society.”
The CEO of Schmidt’s latest initiative would be the same person who had served as the executive director of the National Security Commission. More than a dozen staffers from the federal commission followed Schmidt to the new private sector project. Other people from the federal commission came over to Schmidt’s private effort, too: Vice Chair Robert Work, a former deputy secretary of defense, would serve on Schmidt’s board of advisors. Mac Thornberry, the congressman who appointed Schmidt to the federal commission in the first place, was now out of office and would also join Schmidt’s board of advisors.
They set up new office space just down the road from the federal commission’s headquarters in Crystal City, VA, and began to build on their work at the federal commission.
The new Special Competitive Studies Project issued its first report on Sept. 12. The authors wrote, “Our new project is privately funded, but it remains publicly minded and staunchly nonpartisan in believing technology, rivalry, competition and organization remain enduring themes for national focus.”
The report calls for the creation of a new government entity that would be responsible for organizing the government-private sector nexus. That new organization, the report says, could be based on the roles played by the National Economic Council or the National Security Council inside the White House.
It is not clear if the Project will disclose Schmidt’s personal holdings in AI companies. So far, it has not.
Asked if Schmidt’s AI investments will be disclosed by the Project in the future, a person close to Schmidt said, “SCSP is organized as a charitable entity, and has no relationship to any personal investment activities of Dr. Schmidt.” The person also said the project is a not-for-profit research entity that will provide public reports and recommendations. “It openly discloses that it is solely funded by the Eric and Wendy Schmidt Fund for Strategic Innovation.”
In a way, Schmidt’s approach to Washington is the culmination of a decade or more as a power player in Washington. Early on, he professed shock at the degree to which industry influenced policy and legislation in Washington. But since then, his work on AI suggests he has embraced that fact of life in the capital.
Obama donor
Schmidt first came to prominence on the Potomac as an early advisor and donor to the first presidential campaign of Barack Obama. Following the 2008 election, he served on Obama’s presidential transition and as a presidential advisor on science and technology issues. Schmidt had risen to the heights of power and wealth in Silicon Valley, but what he saw in the nation’s capital surprised him.
In a 2010 conversation with the Atlantic’s then Editor-in Chief James Bennet, Schmidt told a conference audience what he had learned in his first years in the nation’s capital. “The average American doesn’t realize how much the laws are written by lobbyists,” Schmidt said. “It’s shocking now, having spent a fair amount of time inside the system, how the system actually works. It is obvious that if the system is organized around incumbencies writing the laws, the incumbencies will benefit from the laws that are written.”
Bennet, pushing back, suggested that Google was already one of the greatest incumbent corporations in America.
“Well, perhaps,” Schmidt replied in 2010. “But we don’t write the laws.”
A sign is posted in front of the eBay headquarters in San Jose, California.
Justin Sullivan | Getty Images
Shares of eBay soared 8% Wednesday as Meta said it will allow some listings to show up on Facebook Marketplace, its popular platform connecting consumers for local item pickups and more.
EBay stock reached its highest level since November 2021.
The rollout will begin with a test in Germany, France and the United States, where buyers will be able to view listings directly on Marketplace and complete the rest of their transactions on eBay, Meta said in a release.
The partnership could provide a boost to eBay’s marketplace business, which has struggled to compete with e-commerce rivals like Amazon, Walmart, Temu and even Facebook’s own marketplace platform that lets users buy and sell items.
EBay has recently embraced niche categories like collectibles and luxury goods to try and keep buyers and sellers returning to its site. CEO Jamie Iannone told CNBC in an October interview that shoppers were coming to the site, known for its used and refurbished goods, as they sought out discounts amid a rocky macroeconomic environment.
Meta’s move is an attempt to appease the European Commission, the executive body of the European Union, after the regulator fined the company 797 million euros ($821 million) in November for tying its Marketplace product to the main Facebook app.
Read more CNBC tech news
At the time, the Commission said that Meta’s bundling of Marketplace with Facebook could mean competitors are effectively “foreclosed” given the distribution reach of the platform. Facebook counts more than 3 billion users globally.
The Commission also said that Meta imposes “unfair trading conditions” on other online classified ads service providers who advertise on its platforms, especially Facebook and Instagram. It added that these conditions allow Meta to use data generated from other advertisers to benefit Marketplace.
Meta appealed the ruling at the time, saying that it “ignores the realities of the thriving European market for online classified listing services.”
“While we disagree with and continue to appeal the European Commission’s decision on Facebook Marketplace, we are working quickly and constructively to build a solution which addresses the points raised,” the company said Wednesday.
EBay touted its integration with Facebook Marketplace as a way for the e-commerce site to “increase exposure to our sellers’ listings, on and off eBay, as part of our strategy to engage buyers and deepen customer loyalty.”
Facebook in 2023 announced a similar partnership with Amazon that lets users browse and purchase products without leaving the app.
An Amazon employee works to fulfill same-day orders during Cyber Monday, one of the company’s busiest days, at an Amazon fulfillment center in Orlando, Florida, on Dec. 2, 2024.
Miguel J. Rodriguez Carrillo | Getty Images
Amazon warehouse workers at a site in North Carolina will vote next month on whether to join a union, setting the stage for the company’s latest labor battle.
Workers at the Garner, North Carolina, facility will cast their ballots from Feb. 10 to Feb. 15, according to a Tuesday post on X by Carolina Amazonians United for Solidarity & Empowerment, the group seeking to organize staffers. Representatives from Amazon and the National Labor Relations Board didn’t immediately respond to requests for comment.
Known as CAUSE, the grassroots group led by current and former employees has been working to organize Amazon employees at the warehouse, which is located in a suburb about 10 miles south of Raleigh, for the past three years.
If the election is successful, the warehouse, known as RDU1, would be only the second Amazon site in the U.S. to unionize. Workers at Amazon’s largest warehouse in New York City voted to join the Amazon Labor Union in 2022, but the group struggled to negotiate a contract with Amazon, and last June, the ALU voted to affiliate with the Teamsters.
A handful of union elections were held at Amazon warehouses in the U.S. in recent years but employees have either rejected unionization or the results continue to be disputed in lengthy court battles. Last November, a federal labor judge ordered a third rerun election at an Amazon warehouse in Bessemer, Alabama, after ruling the company improperly interfered in the vote.
Read more CNBC Amazon coverage
CAUSE filed for a union election last month, saying in a press release that 30% of workers at the North Carolina site signed union authorization cards, which is the necessary threshold to trigger an NLRB vote. Organizers are seeking to boost wages and improve working conditions.
The union filing comes after Amazon delivery and warehouse workers went on strike at nine facilities last month to push the company to come to the bargaining table, according to the International Brotherhood of Teamsters, which represents the employees. The action was intended to snarl Amazon’s operations during the busiest holiday shopping period of the year, referred to as peak season. An Amazon representative told Reuters the company expected to see a limited impact on deliveries from the strike.
An artificial intelligence feature on iPhones is generating fake news alerts, stoking concerns about the technology’s ability to spread misinformation.
Last week, a feature recently launched by Apple that summarizes users’ notifications using AI, pushed out inaccurately summarized BBC News app notifications on the broadcaster’s story about the PDC World Darts Championship semi-final, falsely claiming British darts player Luke Littler had won the championship.
The incident happened a day before the actual tournament’s final, which Littler did go on to win.
Then, just hours after that incident occurred, a separate notification generated by Apple Intelligence, the tech giant’s AI system, falsely claimed that Tennis legend Rafael Nadal had come out as gay.
The BBC has been trying for about a month to get Apple to fix the problem. The British state broadcaster complained to Apple in December after its AI feature generated a false headline suggesting that Luigi Mangione, the man arrested following the murder of health insurance firm UnitedHealthcare CEO Brian Thompson in New York, had shot himself — which never happened.
Apple was not immediately available for comment when contacted by CNBC. On Monday, Apple told the BBC that it’s working on an update to resolve the problem by adding a clarification that shows when Apple Intelligence is responsible for the text displayed in the notifications. Currently, generated news notifications show up as coming directly from the source.
“Apple Intelligence features are in beta and we are continuously making improvements with the help of user feedback,” the company said in a statement shared with the BBC. Apple added that it’s encouraging users to report a concern if they view an “unexpected notification summary.”
The mistake was flagged on the social media app Bluesky by Ken Schwencke, a senior editor at investigative journalism site ProPublica.
CNBC has reached out to the BBC and New York Times for comment on Apple’s proposed solution to its AI feature’s misinformation issue.
AI’s misinformation problem
Apple touts its AI-generated notification summaries as an effective way to group and rewrite previews of news app notifications into a single alert on a users’ lock screen.
It’s a feature Apple says is designed to help users scan their notifications for key details and cut down on the overwhelming barrage of updates many smartphone users are familiar with.
However, this has resulted in what AI experts refer to as “hallucinations” — responses generated by AI that contain false or misleading information.
“I suspect that Apple will not be alone in having challenges with AI-generated content. We’ve already seen numerous examples of AI services confidently telling mistruths, so-called ‘hallucinations’,” Ben Wood, chief analyst at tech-focused market research firm CCS Insights, told CNBC.
In Apple’s case, because the AI is trying to consolidate notifications and condense them to show only a basic summary of information, it’s mashed the words together in a way that’s inaccurately characterized the events — but confidently presenting them as facts.
“Apple had the added complexity of trying to compress content into very short summaries, which ended up delivering erroneous messages,” Wood added. “Apple will undoubtedly seek to address this as soon as possible, and I’m sure rivals will be watching closely to see how it responds.”
Generative AI works by trying to figure out the best possible answer to a question or prompt inserted by a user, relying on vast quantities of data which its underlying large language models are trained on.
Sometimes the AI might not know the answer. But because it’s been programmed to always present a response to user prompts, this can result in cases where the AI effectively lies.
It’s not clear exactly when Apple’s resolution to the bug in its notification summarization feature will be fixed. The iPhone maker said to expect one to arrive in “the coming weeks.”