A 'fluid' way to cool high-density data centres : Page 2 of 2
By Gabey Goh November 17, 2014
Addressing the concerns
Lau was quick to point out that the two-phase immersion cooling system is intended for high-density HPC applications. If a data centre is only working with low-powered webservers, then the recommendation is to stick with air-cooling.
“With high density HPC applications, the amount of energy and costs required to use air cooling becomes extremely high. Also, not every data centre operator can choose to set up in a colder climate like Iceland to reduce cooling costs, especially in Asia where warmer and more humid climates dominate.
“So it comes to no surprise why PUEs are generally higher [here] than, for example, in North-America or Europe,” he said.
Use case aside, many commentators have expressed hesitation over the need to change the layout of equipment within a data centre, as current designs are based on vertical racks rather than horizontal ones, as required by the liquid immersion cooling technique.
There is also the concern over the added messiness involved with swapping out hardware, given the presence of liquid.
Lau welcomed the opportunity to address these “common misconceptions," noting that the company’s second generation design which won the DatacenterDynamics APAC (Asia Pacific) Award and Best Green ICT Award, was actually for a standard vertical rack deployment up to 225kW per rack.
“Technically, there is no fixed requirement to use horizontal racks instead of vertical ones, or to change equipment layouts. However, our next generation system will use flat rack tanks for improved efficiency by scaling to 500kW per rack, which would be difficult with vertical racks. Not everyone requires such densities and therefore horizontal racks,” he argued.
As for the perceived messiness involved, Lau agreed that this would be the case for oil immersion cooling, but Allied Control's system uses the 3M Novec fluid, and hardware comes out touch-dry almost instantly when pulling it out.
“At the Supercomputer Conference SC13 we immersed a standard US one-dollar paper bill for hours in 3M Novec and demonstrated that the one-dollar bill became immediately dry and was still like new when removing it from the fluid,” he claimed.
The fluid is also a high-precision cleaning agent and a fire-extinguishing agent, with Lau noting that it is so sensitive to delicate materials like paper, it has been installed in the US National Archive, home to the US Constitution and Declaration of Independence.
“Since the very same fluids are used to clean the inside of mobile phone screens or even hard disk platters, where even microscopic residues could cause head crashes, there is absolutely no reason to be afraid of messiness of any kind.
“We have even sold out-dated hardware which had been immersed in the liquid for about 10 months and customers were genuinely surprised, claiming they thought we were selling brand-new hardware to them,” he added.
Lau also pointed out that there might be much more accumulated dust and other dirt on hardware coming out of traditionally air-cooled systems, possibly even corrosion if air is not filtered properly in areas with high air pollution like in China and India.
In terms of maintenance, Lau believes it will not be a significant issue, and Allied Control is already working with 3M on establishing industry standards, with potential future integration into ASHRAE (formerly the American Society of Heating, Refrigerating and Air Conditioning Engineers) Liquid Cooling Guidelines.
He said that 3M is also offering a global reverse supply chain for companies which want to dispose of their fluids.
“But if handled properly, these fluids can be still resold to others even after decades, and there is actually an active second-hand market,” Lau said.
Adoption and what’s next
Mark Thiele (pic), senior vice president of Data Centre Tech at Switch Communications, believes that immersion cooling has its place, especially in HPC data centres and in homogeneous environments serving a single application, be it cloud or bitcoin mining.
“In five years I would guess maybe a 2-3% market share,” he said when asked about how pervasive immersion cooling systems would be in the market.
Allied Control's Lau noted that two-phase immersion cooling is indeed currently more suited to high performance computing applications paired with high density, and the market is moving towards solutions such as Allied Control’s as it becomes more difficult to cool their systems with other methods.
“Supercomputers were once the sole domain of governments only, but now even supermarkets are using big data analysis to crunch massive amounts of business data to aid critical company decisions and improve bottom-line results, and are therefore buying high density HPC systems,” he said.
Lau said that naturally, any new high performing technology would flourish most in a smaller market first where there is stronger demand.
“It will take some time until the mass market develops in the same direction. You can compare it with how Bill Gates of Microsoft claimed in 1981 that in terms of memory, ‘640KB ought to be enough for anybody’. Technology, in tandem with new demands and expectations, has changed drastically since then.
“But more importantly, the insatiable demand for more processing power is not growing linearly, but rather exponentially, akin to Moore’s Law of the number of transistors doubling approximately every two years. This means that we anticipate the demand for higher density and more effective and efficient datacentre cooling to grow at a similarly staggering rate,” he added.
In terms of hurdles to adoption, Lau admitted that currently cost is still a valid issue, making two-phase immersion cooling only attractive to high-density HPC applications.
The cost stems not from the hardware but rather from the cost of the fluids required.
“One way to mitigate that is to improve the ratio of fluid costs over hardware by designing for a higher density. We expect as well that fluid manufacturers will be able to decrease their costs with improved economies of scale,” said Lau.
He added that the company was also in discussions with a few hardware manufacturers which are intrigued by the possibilities and want to design much denser hardware, which wouldn’t be possible with any other cooling method.
“It will certainly take some time to get adopted by the wider market. Despite that, multiple extremely interested HPC data centre operators have approached us already regarding the purchase of systems, as they face immense problems with other cooling methods at their current densities,” he claimed.
Lau and his team are currently busy working on developing the “next generation” immersion-cooled data centre.
“It will be a containerised system at 1.4MW with the potential to even double to almost 3MW capacity within only 320 sq ft of floor space. This will certainly break all density records on the market by several hundred per cent, and yet be one of the most energy efficient,” he declared.
Lau said that it wasn’t just about making an impact on the industry that fuels the team’s efforts, but rather the larger picture of preserving the environment and improving lives.
“Many Asian countries share the same fate like Hong Kong with the majority of electricity still being produced by burning fossil fuels, so being more energy-efficient will inevitably contribute to lower carbon emissions.
“Also, by reducing space requirements, we hope to especially make a social impact on many crowded Asian cities like Hong Kong with sky-rocketing real estate prices, putting affordability of living space out of reach for many,” he added.
Data center issues hampering business strategy
Data centres in Malaysia and Singapore just too cool for words
For more technology news and the latest updates, follow @dnewsasia on Twitter or Like us on Facebook.