History @ Los Alamos

Supercomputing

Roadrunner Supercomputer: First to Break the "Petaflop" Barrier

At 3:30 a.m. on May 26, 2008, Memorial Day, the "Roadrunner" supercomputer exceeded a sustained speed of 1 petaflop/s, or 1 million billion calculations per second. The sustained performance makes Roadrunner more than twice as fast as the current number 1 system on the TOP500 list. The best sustained performance to date is 74.5% efficiency, 1.026 petaflops.

"Petaflops" is computer jargon — peta signifying the number 1 followed by 15 zeros (sometimes called a quadrillion) and flops meaning "double-precision floating point operations per second."

Los Alamos held the fastest supercomputer title in 1993 with the Thinking Machines CM-5, and inaugurated the supercomputer era, assisting in the development of the Cray-1 in 1976. The Laboratory and IBM go all the way back to the first card-programmable calculators, used at Los Alamos in 1949. Los Alamos also housed serial number 1 of the IBM 704 in 1956.

The Roadrunner supercomputer, developed by IBM in partnership with the Laboratory and the National Nuclear Security Administration, uses commercially available hardware, including aspects of commercial game console and graphics technologies. Because of its off-the-shelf components, the computer costs significantly less than a one-of-a-kind machine. It also uses a Linux operating system.

The secret to its record-breaking performance is a unique hybrid design. Each compute node in this cluster consists of two AMD Opteron™ dual-core processors plus four PowerXCell 8i™ processors used as computational accelerators. The accelerators used in Roadrunner are a special IBM-developed variant of the Cell processor used in the Sony PlayStation® 3. The node-attached Cell accelerators are what make Roadrunner different than typical clusters.

The Lab and IBM have been working on Roadrunner since 2006, but collaboration on Cell dates back to 2002. The first phase of the project included delivery of an initial Opteron-only cluster that operates at a speed of 71 teraflops. This initial system has been in full production at Los Alamos for almost a year, and Laboratory researchers are using this machine for classified weapons applications. The full-scale Roadrunner machine operates more than 10 times faster than the current installed system.

Phase 2

Phase 2 of the Roadrunner project was completed in October 2007. Two external assessments, one by NNSA headquarters and one by an independent team of high performance computing experts, evaluated the machines' potential use for Laboratory applications, the Laboratory's ability to successfully manage the computing system, IBM's ability to deliver the product, and whether computer programs could be adapted to the new system.

Based on the positive outcome of the assessments, the Laboratory and NNSA decided to pursue the final phase of the Roadrunner project.

Final Phase

The powerful cluster of nodes will process information enabling the Laboratory to us Roadrunner for advanced physics and predictive simulations of complex scientific processes. Weapons science applications that can be processed by Roadrunner are applicable to all three of the U.S. Department of Energy weapons laboratories. The machine will also be well equipped to tackle the intricacies of modeling processes, ranging from the biomolecular to the cosmological. In addition, Los Alamos intends to purchase additional Roadrunner resources to support open science and technology applications.

The cost of all phases of the Roadrunner project is approximately $120 million. More than 200 Laboratory employees have been involved in this effort.