A ‘thirsty’ generative AI boom poses a growing problem for Big Tech
Dubai, UNITED ARAB EMIRATES — A global rush for the next wave of generative artificial intelligence is increasing public scrutiny on an often-overlooked but critically important environmental issue: Big Tech’s expanding water footprint.
Tech giants, including the likes of Microsoft and Alphabet-owned Google, have recently reported a substantial upswing in their water consumption and researchers say one of the main culprits is the race to capitalize on the next wave of AI.
Shaolei Ren, a researcher at the University of California, Riverside, published a study in April investigating the resources needed to run buzzy generative AI models, such as OpenAI’s ChatGPT.
Ren and his colleagues found that ChatGPT gulps 500 milliliters of water (roughly the amount of water in a standard 16-ounce bottle) for every 10 to 50 prompts, depending on when and where the AI model is deployed.
Hundreds of millions of monthly users all submitting questions on the popular chatbot quickly illustrates just how “thirsty” AI models can be.
The study’s authors warned that if the growing water footprint of AI models is not sufficiently addressed, the issue could become a major roadblock to the socially responsible and sustainable use of AI in the future.
People take part in a protest called by Uruguay’s Central Union (PIT-CNT) in “defense of water” against the handling of the national authorities with respect to the management of the shortage of drinking water reserves in Montevideo on May 31, 2023.
Eitan Abramovich | Afp | Getty Images
ChatGPT creator OpenAI, part owned by Microsoft, did not respond to a request to comment on the study’s findings.
“In general, the public is getting more knowledgeable and aware of the water issue and if they learn that the Big Tech’s are taking away their water resources and they are not getting enough water, nobody will like it,” Ren told CNBC via videoconference.
“I think we are going to see more clashes over the water usage in the coming years as well, so this type of risk will have to be taken care of by the companies,” he added.
‘A hidden cost’
Data centers are part of the lifeblood of Big Tech — and a lot of water is required to keep the power-hungry servers cool and running smoothly.
For Meta, its these warehouse-scale data centers that generate not only the highest percentage of its water use but also the lion’s share of its energy use and greenhouse gas emissions.
In July, protesters took to the streets of Uruguay’s capital to push back against Google’s plan to build a data center. The proposal sought to use vast quantities of water at a time when the South American country was suffering its worst drought in 74 years.
Google reportedly said at the time the project was still at an exploratory phase and stressed that sustainability remained at the heart of its mission.
With AI, we’re seeing the classic problem with technology in that you have efficiency gains but then you have rebound effects with more energy and more resources being used.
Somya Joshi
Head of division: global agendas, climate and systems at SEI
In Microsoft’s latest environmental sustainability report, the U.S. tech company disclosed that its global water consumption rose by more than a third from 2021 to 2022, climbing to nearly 1.7 billion gallons.
It means that Microsoft’s annual water use would be enough to fill more than 2,500 Olympic-sized swimming pools.
For Google, meanwhile, total water consumption at its data centers and offices came in at 5.6 billion gallons in 2022, a 21% increase on the year before.
Both companies are working to reduce their water footprint and become “water positive” by the end of the decade, meaning that they aim to replenish more water than they use.
It’s notable, however, that their latest water consumption figures were disclosed before the launch of their own respective ChatGPT competitors. The computing power needed to run Microsoft’s Bing Chat and Google Bard could mean significantly higher levels of water use over the coming months.
“With AI, we’re seeing the classic problem with technology in that you have efficiency gains but then you have rebound effects with more energy and more resources being used,” said Somya Joshi, head of division: global agendas, climate and systems at the Stockholm Environment Institute.
“And when it comes to water, we’re seeing an exponential rise in water use just for supplying cooling to some of the machines that are needed, like heavy computation servers, and large-language models using larger and larger amounts of data,” Joshi told CNBC during the COP28 climate summit in the United Arab Emirates.
“So, on one hand, companies are promising to their customers more efficient models … but this comes with a hidden cost when it comes to energy, carbon and water,” she added.
How are tech firms reducing their water footprint?
A spokesperson for Microsoft told CNBC that the company is investing in research to measure the energy and water use and carbon impact of AI, while working on ways to make large systems more efficient.
“AI will be a powerful tool for advancing sustainability solutions, but we need a plentiful clean energy supply globally to power this new technology, which has increased consumption demands,” a spokesperson for Microsoft told CNBC via email.
“We will continue to monitor our emissions, accelerate progress while increasing our use of clean energy to power datacenters, purchasing renewable energy, and other efforts to meet our sustainability goals of being carbon negative, water positive and zero waste by 2030,” they added.
Aerial view of the proposed site of the Meta Platforms Inc. data center outside Talavera de la Reina, Spain, on Monday, July 17, 2023. Meta is planning to build a 1 billion ($1.1 billion) data center which it expects to use about 665 million liters (176 million gallons) of water a year, and up to 195 liters per second during “peak water flow,” according to a technical report.
Paul Hanna | Bloomberg | Getty Images
Separately, a Google spokesperson told CNBC that research shows that while AI computing demand has dramatically increased, the energy needed to power this technology is rising “at a much slower rate than many forecasts have predicted.”
“We are using tested practices to reduce the carbon footprint of workloads by large margins; together these principles can reduce the energy of training a model by up to 100x and emissions by up to 1000x,” the spokesperson said.
“Google data centers are designed, built and operated to maximize efficiency – compared with five years ago, Google now delivers around 5X as much computing power with the same amount of electrical power,” they continued.
“To support the next generation of fundamental advances in AI, our latest TPU v4 [supercomputer] is proven to be one of the fastest, most efficient, and most sustainable ML [machine leanring] infrastructure hubs in the world.”
The U.S. has placed major chip export restrictions on Huawei and Chinese firms over the past few years. This has cut off companies’ access to critical semiconductors.
Jaap Arriens | Nurphoto | Getty Images
Taiwan has added China’s Huawei and SMIC to its trade blacklist in a move that further aligns it with U.S. trade policy and comes amid growing tensions with Beijing.
The two leading Chinese chip firms have been put on Taiwan’s “Strategic High-Tech Commodities Entity List,” along with many of their international subsidiaries.
Taiwan’s current regulations require licenses from regulators before domestic firms can ship products to parties named on the entity list.
In a statement on its website, Taiwan’s International Trade Administration said that Huawei and SMIC were among the 601 new foreign entities, blacklisted due to their involvement in arms proliferation activities and other national security concerns.
Huawei and SMIC are also on a U.S. trade blacklist and have been impacted by Washington’s sweeping controls on advanced chips. Companies such as contract chipmaker Taiwan Semiconductor Manufacturing Co already follow U.S. export restrictions.
However, the addition of Huawei and SMIC to the Taiwan blacklist is likely aimed at the reinforcement of this policy and a tightening of existing loopholes, Ray Wang, an independent semiconductor and tech analyst, told CNBC.
He added that the new domestic export controls could also raise the punishment for any potential breaches in the future.
TSMC had been embroiled in controversy in October last year when semiconductor research firm TechInsights found a TSMC-made chip in a Huawei AI training card.
Following the discovery, the U.S. Commerce Department ordered TSMC to halt Chinese clients’ access to chips used for AI services, according to a report from Reuters. TSMC could also reportedly face a $1 billion as penalty to settle a U.S. investigation into the matter.
Huawei has been working to create viable alternatives to Nvidia‘s general processing units used for AI. But, experts say the company’s advancement has been limited by export controls and a lack of scale and capabilities in the domestic chip ecosystem.
Still, Huawei is believed to have acquired several million GPU dies from TSMC for its AI chips by using previous loopholes before they were discovered, according to Paul Triolo, partner and senior vice president for China at advisory firm DGA-Albright Stonebridge Group.
A die refers to a small piece of silicon material that serves as the foundation for building processors and contains the intricate circuitry and components necessary to perform computations.
The Taiwanese government’s crackdown on exports to SMIC and Huawei also comes amid tense geopolitical tensions with Mainland China, which regards the democratically governed island as its own territory to be reunited by force, if necessary.
In April, the U.S. reaffirmed its commitment to support the existing status quo as China conducted large-scale military exercises off the coast of the island.
In statements reported by state media on Sunday, China’s top political adviser Wang Huning echoed Beijing’s position, calling for the promotion of national reunification with Taiwan and for resolute opposition to Taiwan independence.
An AI assistant on display at Mobile World Congress 2024 in Barcelona.
Angel Garcia | Bloomberg | Getty Images
Artificial intelligence is shaking up the advertising business and “unnerving” investors, one industry leader told CNBC.
“I think this AI disruption … unnerving investors in every industry, and it’s totally disrupting our business,” Mark Read, the outgoing CEO of British advertising group WPP, told CNBC’s Karen Tso on Tuesday.
The advertising market is under threat from emerging generative AI tools that can be used to materialize pieces of content at rapid pace. The past couple of years has seen the rise of a number of AI image generators, including OpenAI’s DALL-E, Google’s Veo and Midjourney.
In his first interview since announcing he would step down as WPP boss, Read said that AI is “going to totally revolutionize our business.”
“AI is going to make all the world’s expertise available to everybody at extremely low cost,” he said at London Tech Week. “The best lawyer, the best psychologist, the best radiologist, the best accountant, and indeed, the best advertising creatives and marketing people often will be an AI, you know, will be driven by AI.”
Read said that 50,000 WPP employees now use WPP Open, the company’s own AI-powered marketing platform.
“That, I think, is my legacy in many ways,” he added.
Structural pressure on creative parts of the ad business are driving industry consolidation, Read also noted, adding that companies would need to “embrace” the way in which AI would impact everything from creating briefs and media plans to optimizing campaigns.
A report from Forrester released in June last year showed that more than 60% of U.S. ad agencies are already making use of generative AI, with a further 31% saying they’re exploring use cases for the technology.
‘Huge transformation’
Read is not alone in this view. Advertising is undergoing a “huge transformation” due to the disruptive effects of AI, French advertising giant Publicis Groupe’s CEO Maurice Levy told CNBC at the Viva Tech conference in Paris.
He noted that AI image and video generation tools are speeding up content production drastically, while automated messaging systems can now achieve “personalization at scale like never before.”
However, the Publicis chief stressed that AI should only be considered a tool that people can use to augment their lives.
“We should not believe that AI is more than a tool,” he added.
And while AI is likely to impact some jobs, Levy ultimately thinks it will create more roles than it destroys.
“Will AI replace me, and will AI kill some jobs? I think that AI, yes, will destroy some jobs,” Levy conceded. However, he added that, “more importantly, AI will transform jobs and will create more jobs. So the net balance will be probably positive.”
This, he says, would be in keeping with the labor impacts of previous technological inventions like the internet and smartphones.
“There will be more autonomous work,” Levy added.
Still, Nicole Denman Greene, analyst at Gartner, warns brands should be wary of causing a negative reaction from consumers who are skeptical of AI’s impact on human creativity.
According to a Gartner survey from September, 82% of consumers said firms using generative AI should prioritize preserving human jobs, even if it means lower profits.
“Pivot from what AI can do to what it should do in advertising,” Greene told CNBC.
“What it should do is help create groundbreaking insights, unique execution to reach diverse and niche audiences, push boundaries on what ‘marketing’ is and deliver more brand differentiated, helpful and relevant personalized experiences, including deliver on the promise of hyper-personalization.”
-
Sports3 years ago‘Storybook stuff’: Inside the night Bryce Harper sent the Phillies to the World Series
-
Sports1 year agoStory injured on diving stop, exits Red Sox game
-
Sports2 years agoGame 1 of WS least-watched in recorded history
-
Sports2 years agoMLB Rank 2023: Ranking baseball’s top 100 players
-
Sports4 years ago
Team Europe easily wins 4th straight Laver Cup
-
Environment2 years agoJapan and South Korea have a lot at stake in a free and open South China Sea
-
Sports2 years agoButton battles heat exhaustion in NASCAR debut
-
Environment2 years agoGame-changing Lectric XPedition launched as affordable electric cargo bike