A large hallway with supercomputers inside a server room data center.
Luza Studios | E+ | Getty Images
The boom in artificial intelligence is ushering in an environmentally conscious shift in how data centers operate, as European developers face pressure to lower the water temperatures of their energy-hungry facilities to accommodate the higher-powered chips of firms such as tech giant Nvidia.
AI is estimated to drive a 160% growth in demand for data centers by 2030, research from Goldman Sachs shows — an increase that could come at a cost to Europe’s decarbonization goals, as the specialized chips used by AI firms are expected to hike the energy use of the data centers that deploy them.
High-powered chips — also known as graphics processing units, or GPUs — are essential for training and deploying large language models, which are a type of AI. These GPUs need high density computing power and produce more heat, which ultimately requires colder water to support reliable cooling of the chips.
AI can consume 120 kilowatts of energy in just one square meter of a data center, which is equivalent to the power consumption and heat dissipation of around 15 to 25 houses, according to Andrey Korolenko, chief product and infrastructure officer at Nebius, who referred specifically to the deployment of Nvidia’s Blackwell GB200 chip.
“This is extremely dense, and from the cooling standpoint of view you need different solutions,” he said.
The problem we’ve got with the chipmakers, is AI is now a space race run by the American market where land rights, energy access and sustainability are relatively low on the pecking order, and where market domination is key,” Winterson told CNBC
Michael Winterson
chair of the EUDCA
Michael Winterson, chair of the European Data Center Association (EUDCA), warned that lowering water temperatures will eventually “fundamentally drive us back to an unsustainable situation that we were in 25 years ago.”
“The problem we’ve got with the chipmakers is [that] AI is now a space race run by the American market where land rights, energy access and sustainability are relatively low on the pecking order, and where market domination is key,” Winterson told CNBC.
Major equipment suppliers in Europe say that U.S. chip designers are calling on them to lower their water temperatures to accommodate the hotter AI chips, according to Herbert Radlinger, managing director at NDC-GARBE.
“This is shocking news, because originally everybody from the engineering side expected to go for liquid cooling to run higher temperatures,” he told CNBC, referring to the technology of liquid cooling, which is said to be more efficient than the more traditional method of air cooling.
‘Evolution discussion’
Energy efficiency is high on the European Commission’s agenda, as it seeks to reach its goal of reducing energy consumption by 11.7% by 2030. The EU predicted in 2018 that energy consumption of data centers could rise 28% by 2030, but the advent of AI is expected to boost that number two or threefold in some countries.
Winterson said that lowering water temperatures is “fundamentally incompatible” with the EU’s recently launched Energy Efficiency Directive, which established a dedicated data base for data centers of a certain size to publicly report on their power consumption. The EUDCA has has been lobbying Brussels to consider these sustainability concerns.
Energy management firm Schneider Electric engages often with the EU on the topic. Many of the recent discussions have focused on different ways to source “prime power” for AI data centers and for the potential for more collaboration with utilities, said Steven Carlini, chief advocate of AI and data centers and vice president at Schneider Electric.
European Commission energy officials have also had exchanges with Nvidia to discuss energy consumption and the use of data centers with regard to the effectiveness of power use and that of chipsets.
CNBC has approached Nvidia and the Commission for comment.
“Cooling is the second-largest consumer of energy in the data center after the IT load,” Carlini told CNBC in emailed comments. “The energy use will rise but the PUE (Power Usage Effectiveness) may not rise with lower water temperatures despite the chillers having to work harder.”
Schneider Electric’s customers that are deploying Nvidia’s Blackwell GB200 super chip are asking for water temperatures of 20-24 degrees Celsius or between 68 and 75 degrees Fahrenheit, Carlini said.
He added that this compares to temperatures of around 32 degrees Celsius with liquid cooling, or of around 30 degrees Celsius that Meta has suggested for the water it supplies to the hardware.
Ferhan Gunen, vice president of data center operations for the U.K. at Equinix, told CNBC that there are a number of concerns about AI that Equinix has been discussing with its customers.
“They want to increase the density of their servers, which is, they want to have higher-power-using chips, or they want to have more servers,” she said, adding that the shift is not “clear cut.”
“It’s really an evolution discussion more than anything,” Gunen said.
Nvidia, which declined to comment on the cooling requirements of its chips, announced a new platform for its Blackwell GPUs earlier this year. It said that the architecture would enable organizations to run real-time generative AI on large language models at up to 25 times less cost and energy consumption compared to earlier technology.
Liquid cooling will require a “reconfiguration,” Gunen explained, adding that new data centers are already coming ready with this technology. “Yes, higher density will mean more power use, and will also mean more cooling requirement. But then the technology is changing, so you’re doing it differently. That’s why there is a balance in all of this,” she said.
Race for efficiency
Nebius, which has around $2 billion in cash on its balance sheet after splitting from Russia’s Yandex, has said it will be one of the first to bring Nvidia’s Blackwell platform to customers in 2025. The firmhas also announced plans to invest more than $1 billion onAI infrastructure in Europe by the middle of next year.
Nebius’ Korolenko said liquid cooling is a “first step,” where cost of ownership will initially be worse before improving over time.
“There’s a big push to deliver, but at the same time, when you go to scale, you will want to have the ability to choose, to be economical and not sacrifice too much. Power efficiency is important for the running costs. It’s always a high priority,” Korolenko said.
Even before a boom in demand for AI applications hit the market, the data center industry in Europe was struggling to keep pace with the growing digital sector.
Sicco Boomsma, managing director of ING’s TMT team, said those involved in the market are “very sensitive to power” and that while Europe’s focus is on infrastructure, the U.S. has focused more on expanding assets in Europe where power is available.
“There’s a tremendous amount of data center operators also coming from the U.S. that are aligning in order to ensure that their data center infrastructure is in line with the various goals that the EU has as well, such as being carbon neutral, such as being efficient, on water utilization, maintaining biodiversity.”
“It is a sort of a race where they want to demonstrate that their knowledge is leading to super efficient infrastructure,” he said.
On today’s episode of Quick Charge, I, for one, welcome our new insect overlords. I’d like to remind them that, as a trusted media personality, I can be helpful in rounding up others to toil in their underground sugar caves cobalt mines.
We’ve also got the world’s quickest police pursuit vehicle, an Amnesty International report highlighting Tesla and Mercedes’ efforts to improve worker conditions in the Congo, and an exploration of Trump voters’ love for solar power.
Today’s episode is sponsored by BLUETTI, a leading provider of portable power stations, solar generators, and energy storage systems. For a limited time, save up to 50% during BLUETTI’s exclusive Black Friday pre-sale, now through November 11. Learn more by clicking here.
New episodes of Quick Charge are recorded, usually, Monday through Thursday (and sometimes Sunday). We’ll be posting bonus audio content from time to time as well, so be sure to follow and subscribe so you don’t miss a minute of Electrek’s high-voltage daily news!
Got news? Let us know! Drop us a line at tips@electrek.co. You can also rate us on Apple Podcasts and Spotify, or recommend us in Overcast to help more people discover the show!
Donald Trump will push fossil fuels and undo renewable energy policies, but it ultimately won’t stop clean energy’s momentum.
Trump has always pushed for more oil drilling and fewer regulations, left the Paris Agreement in his first term as president, says he hates “windmills,” promised to scrap offshore wind on “day one” if he won the 2024 election, and calls climate change a “scam.” And now that he’s won, this is a direct threat to the US’s pledge to reach net zero by 2050. After all, federal policy directly impacts the pace of renewable energy growth, especially when it comes to incentives and research funding.
The Biden administration’s groundbreaking Inflation Reduction Act (IRA), which has spurred a clean energy boom, will be challenged under Trump. Because Republican states have received 80% of the IRA’s money with which they’ve built factories and created thousands of jobs, a complete IRA repeal is unlikely. What’s more probable is that the Republicans phase out tax credits earlier than planned or cap overall funding.
Federal financial support for innovative technologies and projects could also take a hit. Brendan Bell, COO of Aligned Climate Capital, who formerly led the US Department of Energy’s Loan Programs Office, told Electrek:
My partner Peter and I led the DOE Loan Program Office under President Obama. We supported the first utility-scale solar and storage projects, as well as early EV investments – including the first loan to Tesla.
Today, these technologies are commercialized and are propelling the clean energy transition. None of it would have been possible if these programs had been cut off 10 years ago.
Put simply, Trump can’t turn back the tide of clean energy – but he could delay tomorrow’s solutions and the birth of new industries.
BloombergNEF’s “2H 2024 US Clean Energy Market Outlook,” released at the end of October, examined the worst-case scenario, where control of both the Senate and the House leads to a full repeal of the IRA tax credits:
The wind, solar, and energy storage sectors jointly see a 17% drop in total new capacity additions over 2025-2035, with 927 gigawatts (GW) of cumulative build compared to 1,118GW in BNEF’s base case forecast. Wind sees the greatest fall in activity in this scenario with a 35% drop, followed by energy storage at 15% and solar at 13% relative to BNEF’s base case.
That’s a blow we can’t afford at a time when we need to reduce emissions by 50% from 2005 levels by 2030 to avoid climate disasters becoming even worse than they already are.
But all is not lost. The clean energy market isn’t solely driven by federal policy. Over the last decade, solar, wind, and EVs have become more cost-competitive and popular. State policies play a huge role too, and many states are committed to their own clean energy goals regardless of who sits in the White House. States like California, New York, and Washington have ambitious targets to combat climate change, and deep red Texas is No. 1 in the US for both solar and wind.
Corporations are also key players. Companies like Amazon, Google, and Walmart have committed to going 100% renewable, and they’re not about to reverse course. This demand keeps the market for renewables strong. Plus, there’s significant public support for clean energy jobs, and renewables create more employment opportunities than fossil fuels in many regions of the country.
JD Dillon, chief marketing officer of California-based solar tech manufacturer Tigo Energy (Nasdaq: TYGO), said to Electrek, “The march toward renewable clean energy is both inevitable and the right thing to do. In a perfect world, we would eliminate partisanship from the renewable energy conversation because everyone benefits from a cleaner environment and affordable energy. Unfortunately, none of us live in said perfect world.”
The US clean energy sector may slow down, but it’s hard to stop a train that has already left the station. What consequences this slower-moving train will have for the US and the world remains to be seen.
If you’re considering going solar, it’s always a good idea to get quotes from a few installers. To make sure you find a trusted, reliable solar installer near you that offers competitive pricing, check out EnergySage, a free service that makes it easy for you to go solar. It has hundreds of pre-vetted solar installers competing for your business, ensuring you get high-quality solutions and save 20-30% compared to going it alone. Plus, it’s free to use, and you won’t get sales calls until you select an installer and share your phone number with them.
Your personalized solar quotes are easy to compare online and you’ll get access to unbiased Energy Advisors to help you every step of the way. Get started here.
FTC: We use income earning auto affiliate links.More.
The world’s largest EV battery maker is advancing a new type of battery, promising higher energy density. According to a new local report, CATL is investing heavily while ramping up its workforce to bring all-solid-state EV batteries to market.
With trial production reportedly kicking off, we could see CATL launch all-solid-state EV batteries sooner than expected.
According to a new local report from LatePost (via CnEVPost), CATL has entered the trial production phase of 20 Ah samples. The news comes after the EV battery giant added over 1,000 workers to its R&D team this year.
The report claimed that CATL is now focused on the final Sulfide phase and has already commenced trial production of 20 Ah samples.
The company’s solution has an energy density of up to 500 Wh/kg for lithium ternary batteries, 40% more than current batteries. However, the report said charging speed and cycle life are not quite where they need to be.
At 20 Ah, the battery solution is finalized and ready for its next stage, production tech exploration.
CATL is advancing all-solid-state EV batteries
The report says after that it’s mainly manufacturing hurdles, that can be overcome with a bigger workforce.
In April, CATL’s chief scientist, Wu Kai, announced that the company had developed a verification platform for 10 Ah all-solid-state EV battery cells. Wu also said CATL aimed to produce all-solid-state EV batteries in small volumes in 2027, the first time the news was made public.
In September, the company’s chairman, Robin Zeng, said CATL’s research into the new battery tech was “second to none.”
Several companies, including Toyota, Mercedes-Benz, Stellantis, and others, are betting on solid-state EV batteries as the future.
According to data from CnEVPost, CATL is dominating the global EV battery market with a 36.7% share through September 2024.
China’s BYD is second with a 16.4% share of the market. BYD is also planning to launch solid-state batteries. At the September 2024 World New Energy Congress, BYD’s head scientist and engineer, Lian Yubo, said solid-state EV batteries could be widely used in five years.
FTC: We use income earning auto affiliate links.More.