Hi Guys,
Data centres are the foundation of our digital world, powering everything from cloud computing to AI. But this immense capability comes at a cost - substantial energy consumption, much of it tied to cooling systems. As demand for computing grows, so too does the urgency to find more efficient, sustainable solutions.
AI is shifting the energy narrative, driving smarter, leaner consumption
Data centres account for about 1% of the world’s total energy consumption, according to the International Energy Agency. With the rapid growth of AI, edge computing, and 5G networks, this figure is expected to rise. Cooling systems alone can consume 30% - 40% of a data centre’s energy, making them an essential area for improvement.
AI is changing this narrative by introducing intelligent, adaptable, and automated solutions that optimise conditions while minimising energy use. One major application is in energy efficiency optimisation. As AI workloads increase, data centres face rising energy demands and associated emissions. Data centre power consumption in South Africa is experiencing significant growth, driven by increasing demand for cloud services, data consumption, and digital infrastructure expansion.
AI-driven systems also respond to external environmental conditions in real time. They adjust cooling strategies based on current weather, humidity, and temperature, maintaining efficiency while adapting to changing surroundings. This flexibility helps data centres meet sustainability targets without compromising computing performance.
 |
| Tony Bartlett, Director of Data Centre Compute |
Cooling solutions: From air to liquid and beyond
To meet evolving demands, data centres are embracing a mix of cooling solutions:
1. Air cooling: Air cooling, a traditional method, uses fans, heat sinks, and air circulation to dissipate heat from crucial server components like processors and memory. Data centres have traditionally used air flow to cool servers; approximately 99% of data centres still use this approach in one form or another.1 Advanced techniques like hot/cold aisle configurations and intelligent fan zoning help optimise airflow and reduce energy use. It is cost-effective, easy to maintain, and widely compatible with most standard servers and racks, making it a convenient option. However, it is less energy-efficient, struggles to scale with high-density AI workloads, and heavily relies on HVAC systems, which can increase electricity consumption and carbon emissions. While suitable for many setups, air cooling may fall short as computational demands rise, often prompting a shift to more advanced solutions.
2. Liquid cooling: Direct liquid cooling (DLC) uses small heat exchangers known as cold plates to deliver liquid directly to heat-generating components, leveraging liquid’s superior thermal conductivity to efficiently dissipate heat. It supports higher-density server configurations, reduces noise by minimising fan use, and handles increased thermal loads with lower energy spikes. The South African data centre cooling market is estimated at $60 million in 2025, and is expected to reach $120 million by 2031, growing by a CAGR of 13.43% between 2025 and 2031.
Dell’s DLC enabled servers like the Dell PowerEdge XE9680L employ liquid cooling directly within critical components like CPUs and GPUs. Data centre liquid cooling solutions reduce cooling energy consumption by 40% - 50% and improve power usage effectiveness (PUE).2
A great example of this is Dawn, the UK’s fastest AI supercomputer, co-designed with Dell, Intel and the University of Cambridge with UK Research and Innovation. Equipped with advanced liquid cooling and GPU efficiencies, Dawn achieved a PUE of 1.14 - a testament to how AI-driven cooling can cut energy consumption while boosting computational performance.
Large commercial data centres in South Africa typically consume 12 – 20MW of power. Just like their international counterparts, local facilities are sophisticated in their approach to PUE and using the optimal mix of energy sources.
3. Hybrid cooling solutions with integrated rack scalable systems: Hybrid cooling combines elements of both air and liquid cooling systems. It involves direct-to-chip liquid cooling for high-priority components (like CPUs or GPUs) along with air cooling to manage ambient temperature and cool other components like memory. Even DLC-enabled racks of dense compute can generate intense air heat loads up to 80 kW per rack.
Traditional air-cooling approaches limit rack density and create space and power challenges, even with direct liquid cooling on CPUs and GPUs. Standard industry rear door heat exchangers rely on cold water from a power-hungry refrigerated chiller system to extract heat from the air before blowing chilled air into data centres.
Placing cold plates on additional server components can be done in a 100% DLC system, but that increases costs, dramatically reduces serviceability and configurability, and means that all the cooling system components must be replaced with each generation of new hardware.
The IR7000 is a Dell-engineered, multi-generational rack infrastructure based on the OCP standard Orv3 rack design, with additional enhancements that support a hybrid cooled infrastructure. With the addition of the new, industry-first Dell PowerCool Enclosed Rear Door Heat Exchanger (eRDHx) technology, the system captures 100% of IT heat to liquid by leveraging both direct-to-chip liquid cooling integrated into the IR7000 that is delivered by blind-mate quick disconnects, and heat to liquid for all remaining components.
Instead of sending cooled air out into the environment, the eRDHx uses unique high-performance fans to recirculate now-cooler air back to the front of the rack for continuous cooling. By completely enclosing rack airflow and recycling the air through the side channels of the IR7000, the eRDHx can operate at warmer water temperatures than standard RDHx. This increase in water temperature eliminates reliance on refrigeration systems to cool water, reducing cooling power consumption up to 60% versus other DLC racks with rear door heat exchangers.
AI and cooling: A smarter approach to energy efficiency
The demands on data centres are only growing, and so is the need for innovative cooling solutions. By adopting AI-powered cooling strategies, South African businesses can reduce energy consumption, cut operational costs, and meet their sustainability goals without compromising performance. Now is the time to embrace smarter, AI-enabled technologies that ensure data centres can power our digital world responsibly.
Article by By Tony Bartlett, Director of Data Centre Compute, Dell Technologies South Africa
Sources:
1 Based on Dell analysis in April 2025. Assumes 36°C facility water supply and ASHRAE A3 inlet server air compared to 20°C facility water supply and ASHRAE A3 inlet server air. Actual savings will vary.
The Life's Way Blog: https://www.thelifesway.com/
Join this channel to get access to the perks: https://www.youtube.com/channel/UCf-6P7TDOoCy8qCEQb7eUNw/join
If you like my content, please do support - https://www.patreon.com/TheLifesWay
Aum Namah Shivay!
Subscribe to my YOUTUBE Channel for historical tech, new gadgets, stationery, product reviews
and mystery unboxings. #TheLifesWay Link to other platforms - https://linktr.ee/thelifesway
Your Lifestyle and Technology Blog for the Last 12 Years!
