Generative AI has made a significant impact across education, computing, medicine, entertainment, and more. However, all that progress comes with a hefty price tag. The amount of electricity these systems burn through, plus the insane amounts of water needed to keep them cool, is honestly outrageous.
For context, Microsoft and Google's electricity consumption in 2024 surpassed the power usage of over 100 countries. Similarly, OpenAI's GPT-4 AI model consumes up to 3 water bottles to generate 100 words.
Earlier this month, Microsoft shared an interesting concept that may potentially address the water concerns riddling the progression and advancement of AI. CEO Satya Nadella revealed that the tech giant uses a liquid loop in its data centers, which is filled once. As a result, the company's data centers' water consumption has reduced significantly, down to "what a single restaurant would use."
And now it looks like NVIDIA is taking a page from Microsoft’s playbook. Speaking at London Climate Week on Monday, a top executive suggested that water concerns tied to data center development could be addressed through the company's next-generation AI infrastructure.
The executive further disclosed that the company's new next-gen AI infrastructure can be fully cooled with a liquid warm enough to alleviate the need for additional chilling equipment (Axios).
According to NVIDIA's Chief Sustainability Officer, Josh Parker:
"The water consumption challenge for data centers is largely solved."
How does this liquid work? It’s basically a recirculated mix of water and propylene — think automotive antifreeze. It’s worth noting that the system can operate at temperatures up to 113 degrees Fahrenheit.
As such, this allows it to function reliably in hotter environments compared to older systems. In practical terms, data centers equipped with NVIDIA’s next-generation AI infrastructure will require significantly less water and energy for cooling, reducing both operational costs and environmental impact.
This announcement comes at a time when concerns over water and energy use are mounting, as data centers continue to expand into community corridors. Microsoft has seemingly embraced the "Community-First" AI infrastructure, which addresses some of the issues raised by communities themselves, including reducing its water consumption and promising not to increase electricity bills.
Elsewhere, Microsoft’s plan to build a $1 billion data center in Kenya came to an abrupt halt in early May after the government declined to commit to covering the annual capacity costs Microsoft had requested to run Azure in the region. President William Ruto remarked that the facility’s power demands would be so immense that it would effectively require “switching off half the country” to keep it operational.
Join us on Reddit at r/WindowsCentral to share your insights and discuss our latest news, reviews, and more.