Cheyenne (supercomputer)

Supercomputer in Wyoming

The Cheyenne supercomputer at the NCAR-Wyoming Supercomputing Center (NWSC) in Cheyenne, Wyoming operated for seven years as one of the world's most powerful and energy-efficient computers from 2017 to 2024.[1] Ranked in November 2016 as the 20th most powerful computer in the world[2] and November 2023 as 159th[3] by its TOP500 rank, the 5.34-petaflops system[4] is capable of more than triple the amount of scientific computing[5] performed by NCAR's previous supercomputer, Yellowstone. It also is three times more energy efficient[6] than Yellowstone, with a peak computation rate of more than 3 billion calculations per second for every watt of power consumed.[7]

The National Science Foundation and the State of Wyoming through an appropriation to the University of Wyoming funded Cheyenne[8] to provide the United States with a major new tool to advance understanding of the atmospheric and related Earth system sciences.[9] High-performance computers such as Cheyenne allow researchers to run increasingly detailed models that simulate complex processes to estimate how they might unfold in the future. These predictions give resource managers and policy experts valuable information for planning ahead and mitigating risk.[10] Cheyenne's users advanced the knowledge needed for saving lives, protecting property, and enabling U.S. businesses to better compete in the global marketplace.[11]

Scientists across the country used Cheyenne to study phenomena ranging from weather and climate to wildfires, seismic activity, and airflows that generate power at wind farms. Their findings lay the groundwork for better protecting society from natural disasters, lead to more detailed projections of seasonal and longer-term weather and climate variability and change, and improve weather and water forecasts that are needed by economic sectors from agriculture and energy to transportation and tourism.[12]

The supercomputer's name was chosen to honor the people of Cheyenne, Wyoming, who supported the installation of the NWSC and its computers there.[9] The name also commemorates the 150th anniversary of the city, which was founded in 1867 and named for the Native American Cheyenne Nation.[12]

In April 2024, Cheyenne was listed for auction on a government surplus site, with bidding starting at $2,500.[13][14] After 27 bids, the auction closed on May 3, 2024 at a final bid of US$480,085.[15]

## Replacement

[edit]

Cheyennes' replacement 'Derecho' was announced on January 27, 2021. It is a 19.87 petaflop HPE Cray System capable of 20 quadrillion calculations per second, said to be 3.5 times faster than Cheyenne. It was scheduled to be operational in early 2022,[16] but officially launched on July 7, 2023.[17]

It has 2488 homogenous (CPU) compute nodes and 82 heterogenous (GPU) compute nodes, 382 NVidia A100 graphics processing units, and 692 terabytes of total memory.[18]

## System Description

[edit]

The Cheyenne supercomputer was built by Silicon Graphics International Corporation (SGI) in coordination with centralized file system and data storage components provided by DataDirect Networks (DDN). The SGI high-performance computer is a 5.34-petaflops system, meaning it can carry out 5.34 quadrillion calculations per second. The data storage system for Cheyenne was integrated with NCAR's existing GLobally Accessible Data Environment (GLADE) file system. The DDN storage provides an initial capacity of 20 petabytes, expandable to 40 petabytes with the addition of extra drives. This, combined with 16  petabytes of GLADE, totals 36 petabytes of high-speed storage[10] as of February 2017.

Cheyenne is an SGI ICE XA system with 4,032 dual-socket scientific computation nodes running 18-core 2.3-GHz Intel Xeon E5-2697v4 processors with 203 [now 315] terabytes of memory.[19] Interconnecting these nodes is a Mellanox EDR InfiniBand network with 9-D enhanced hypercube topology that performs with a latency of only 0.5 microseconds.[20] Cheyenne runs the SUSE Linux Enterprise Server 12 SP1 operating system.[19]

Cheyenne was integrated with many other high-performance computing resources in the NWSC. The central feature of this supercomputing architecture is its shared file system that streamlines science workflows by providing computation, analysis, and visualization work spaces common to all resources. This GLADE common data storage pool,[21] provides 36.4 petabytes of online disk capacity shared by the supercomputers, two data analysis and visualization (DAV) cluster computers,[22] data servers for both local and remote users, and a data archive with the capacity to store 320 petabytes of research data. High-speed networks connect this Cheyenne environment to science gateways,[23] data transfer services, remote visualization resources, Extreme Science and Engineering Discovery Environment (XSEDE)[24] sites, and partner sites around the world.

This integration of computing resources, file systems, data storage, and broadband networks allowed scientists to simulate future geophysical scenarios at high resolution, then analyze and visualize them on one computing complex. This improved scientific productivity by avoiding the delays associated with moving large quantities of data between separate systems. Further, this reduced the volume of data that needed to be transferred to researchers at their home institutions. Cheyenne made more than 1.2 billion core-hours available each year to researchers in the Earth system sciences.[20]

## References

[edit]

1. ^ Hosansky, David (January 12, 2024). ""An extraordinary success"". news.ucar.edu. NSF National Center for Atmospheric Research. Retrieved September 21, 2024.
2. ^ Feldman, Michael (January 30, 2017). "NCAR Launches Five-Petaflop Supercomputer". TOP500. Retrieved September 21, 2024.
3. ^ "TOP500 List - November 2023". top500.org. Retrieved September 21, 2024.
4. ^ Moss, Sebastian (February 2, 2017). "NCAR's 5.34-petaflop supercomputer 'Cheyenne' comes online". Data Centre Dynamics Ltd (DCD). Retrieved September 21, 2024.
5. ^ Video: Introduction to the Cheyenne Supercomputer, Inside HPC website. Retrieved 2017-02-28.
6. ^ Brennan, Charlie (February 4, 2017). "Boulder's NCAR boasts powerful new supercomputer at Wyoming site". Boulder Daily Camera. MediaNews Group. Retrieved September 21, 2024.
7. ^ Turbocharging Science, Communications of the ACM research journal website. Retrieved 2017-02-28.[dead link]
8. ^ Supercomputer Cheyenne starts operations, Wyoming Tribune Eagle newspaper website. Retrieved 2017-02-28.
9. ^ a b National Center for Atmospheric Research (January 31, 2017). "New Cheyenne supercomputer triples scientific capability with greater efficiency". phys.org. Retrieved September 21, 2024.
10. ^ a b NCAR announces new supercomputer named “Cheyenne” to be located in the North Range Business Park, Cheyenne LEADS website. Retrieved 2017-02-28.
11. ^ Staff Writers, Star-Tribune (5 February 2017). "New supercomputer starts work in Cheyenne". Casper Star-Tribune. Lee Enterprises. Retrieved September 21, 2024.
12. ^ a b Staff (January 30, 2017). "Cheyenne Supercomputer Triples Scientific Capability at NCAR". High-Performance Computing News Analysis | insideHPC. Retrieved September 21, 2024.
13. ^ Zuhair, Muhammad (2024-04-30). "Iconic "5.34 PFLOPs" Cheyenne Supercomputer Gets Listed On Government Auction, Currently Bidding At $10,000". Wccftech. Retrieved 2024-04-30.
14. ^ Moss, Sebastian (April 30, 2024). "US government puts retired Cheyenne supercomputer up for auction". Data Centre Dynamics Ltd (DCD). Retrieved September 21, 2024.
15. ^ "Personal Property Management System". gsaauctions.gov. Retrieved 2024-05-04.
16. ^ "New supercomputer in Wyoming to rank among world's fastest". AP. 27 January 2021. Retrieved 28 January 2021.
17. ^ "NCAR's new Derecho supercomputer launches operations | Computational and Information Systems Lab". www.cisl.ucar.edu. Retrieved 2024-04-30.
18. ^ "Documentation - Using Derecho". arc.ucar.edu. Retrieved 2024-04-30.
19. ^ a b Cheyenne - SGI ICE XA, Xeon E5-2697v4 18C 2.3GHz, Infiniband EDR, Top500 website. Retrieved 2017-02-28.
20. ^ a b Cheyenne: NCAR's Next-Generation Data-Centric Supercomputing Environment Archived 2017-04-27 at the Wayback Machine, CISL website. Retrieved 2017-02-28.
21. ^ Provide Centralized High-speed Data Storage Archived 2017-02-09 at the Wayback Machine, FY2016 CISL Annual Report. Retrieved 2017-02-28.
22. ^ Provide Data Analysis and Visualization Resources Archived 2017-02-09 at the Wayback Machine, FY2016 CISL Annual Report. Retrieved 2017-02-28.
23. ^ Provide Science Gateways and Data-sharing Services Archived 2017-02-09 at the Wayback Machine, FY2016 CISL Annual Report. Retrieved 2017-02-28.
24. ^ Overview of XSEDE Archived 2017-07-11 at the Wayback Machine, XSEDE website. Retrieved 2017-02-28.