Cray has launched the XC50, the latest iteration of its XC supercomputer line. The big change from the XC40 is the additional support for the new NVIDIA Tesla P100 GPUs, as well as the latest Xeon and Xeon Phi processors from Intel. Thanks to the more powerful silicon, the XC50 can scale to 500 petaflops.
The P100 expands the computational density of the XC line significantly. Each P100, offers about 5 peak teraflops of double precision performance -- 4.7 teraflops for the PCIe-only version, which is the one Cray is using. As a result, the company says a single XC50 cabinet can now deliver up to a petaflop of peak performance.*
Most of the rest of the XC50 feature set is inherited from the XC40 or even previous designs. These include the Aries Dragonfly network, the Cray Linux environment, the cooling subsystem, and the optional DataWarp I/O accelerator.
The first field test of the XC50 will be the Piz Daint supercomputer, installed at the Swiss National Supercomputing Centre (CSCS). Up until recently, Piz Daint was an XC30 system. Initially deployed in 2012 with Intel Xeon processors, its initial Linpack rating was 216 teraflops. In 2013, it was upgraded with NVIDIA K20x GPUs, bringing it up to 6.3 petaflops. Recently Piz Daint was converted to an XC50, an upgrade that pushed it all the way to 9.8 petaflops.
Most of those flops are the result of the new P100 GPUs, which replaced the original K20x accelerators. Despite the addition of Cori and Oakforest-PACS in the number 5 and 6 slots on the latest TOP500 list, Piz Daint maintains it number 8 position there thanks to the XC50 upgrade. It also keeps its status as the most powerful supercomputer in Europe – at least in the Linpack sense.
One other consequence of using the more energy-efficient P100 GPUs is that the new Piz Daint, despite providing 3.5 petaflops more computing power than the previous iteration, uses less power. And not just a little less. The upgraded system draws 1,312 kilowatts when running Linpack; the K20x-accelerated version drew 2,325 kilowatts.
That would give Piz Daint an energy-efficient rating of about 7.45 gigaflops per watt, which should be enough to earn it second place on the Green500 list, once those rankings are finalized. The only supercomputer greener is NVIDIA’s own DGX SATURNV, which is a cluster of DGX-1 servers, each one of which houses eight P100 GPUs. That machine delivers 9.46 gigaflops per watt.
Piz Daint is currently the only XC50 on the TOP500 list, but given the success of Cray’s XC line and the greater energy efficiencies possible from the latest hardware, we should see a lot more of them over the next 12 months.