IBM has built a supercomputer that is
cooled by hot water.
IBM has shipped the
supercomputer, called “Aquasar,” to the Swiss Federal Institute of Technology
Zurich—or ETH Zurich—that
contains the new cooling system.
Aquasar, announced July 2, consumes up to 40 percent less
energy than a similar air-cooled machine, and by using waste heat to warm
buildings at the university, can reduce the system’s carbon footprint by up to
85 percent.
IBM officials said their
engineers in Switzerland
and Germany
began developing Aquasar as part of the company’s First-Of-A-Kind program.
Through the FOAK program, IBM scientists are
tasked with working with customers to find solutions to business problems.
In this case, the issue was power consumption and cooling. IBM
officials said that up to 50 percent of the energy consumption and carbon
footprint of an average air-cooled data center is generated by the system to
cool the computers, rather than the computers themselves.
The Aquasar compute cluster, which is fully operational, has a
combination of IBM BladeCenter blade
systems, some of which use the new hot-water cooling system, and others that
are air-cooled.
In all, Aquasar has three BladeCenter H chassis with a total of
33 BladeCenter QS22 servers—each of which is powered by two PowerXCell 8i
processors—and nine BladeCenter HS22 systems that contain two Intel Xeon 5500
series “Nehalem EP” chips.
Two of the BladeCenter H Chassis are water-cooled, with a total
of 22 BladeCenter QS22 and six HS22 servers.
Each system comes with a liquid cooler for each processor, as well
as input and output pipelines. The liquid coolers are attached directly to the
processor, which is cooled by water that is up to 60 degrees Celsius, or 140
degrees Fahrenheit. The system will keep the processors well below the maximum
temperature of 85 degrees Celsius, or 185 degrees Fahrenheit, according to IBM.
The water in the Aquasar system is hotter than that used in
typical liquid-cooled systems. IBM estimates
that water removes heat 4,000 more efficiently than air, and does a better job
of transporting that heat.
In the closed-circuit cooling system, the water that is heated
by the processor is run through a passive heat exchanger, which removes much of
the heat. That heat is then directed to the university’s heating system for use
to help keep the buildings warm.
Aquasar is part of a three-year research program called
"Direct use of waste heat from liquid-cooled supercomputers: the path to
energy saving, emission-high performance computers and data centers."
Along with ETH Zurich
and IBM Research-Zurich, ETH
Lausanne, also in Switzerland,
is part of the program.
According to IBM, Aquasar
can reach performances of 6 teraflops (trillion floating point operations per
second), with an energy efficiency of about 450 megaflops per watt.
The company estimates that 9 kilowatts of thermal power are fed
into the university’s building heating system.
“With Aquasar we achieved an important milestone on the way to
CO2-neutral data centers," Bruno Michel, manager of Advanced Thermal
Packaging at IBM Research–Zurich, said in a
statement. "The next step in our research is to focus on the performance
and characteristics of the cooling system, which will be measured with an
extensive system of sensors, in order to optimize it further."