U.S. flag An official website of the United States government.
Official websites use .gov

A .gov website belongs to an official government organization in the United States.

Secure .gov websites use HTTPS

A lock ( ) or https:// means you've safely connected to the .gov website. Share sensitive information only on official, secure websites.

i

Evaluating integration and performance of containerized climate applications on a Hewlett Packard Enterprise Cray system



Details

  • Journal Title:
    Concurrency and Computation: Practice and Experience
  • Personal Author:
  • NOAA Program & Office:
  • Description:
    SummaryContainers have taken over large swaths of cloud computing as the most convenient way of packaging and deploying applications. The features that containers offer for packaging and deploying applications translate to high performance computing (HPC) as well. At The National Oceanic and Atmospheric Administration, containers provide an easy way to build and distribute complex HPC applications, allowing faster collaboration, portability, and experiment computer environment reproducibility amongst the scientific community. The challenge arises when applications rely on message passing interface (MPI). This necessitates investigation into how to properly run these applications with their own unique requirements and produce performance on par with native runs. We investigate the MPI performance for benchmarks and containerized climate models for various containers covering selection of compiler and MPI library combinations from the Cray provided programming environments on the Cray XC supercomputer GAEA. Performance from the benchmarks and the climate models shows that for the most part containerized applications perform on par with the natively built applications when the system optimized Cray MPICH libraries are bound into the container, and the hybrid model containers have poor performance in comparison. We also describe several challenges and our solutions in running these containers, particularly challenges with heterogeneous jobs for the containerized model runs.
  • Source:
    Concurrency and Computation: Practice and Experience, 36(16)
  • DOI:
  • ISSN:
    1532-0626 ; 1532-0634
  • Format:
    pdf
  • Publisher:
    Wiley
  • Document Type:
    Journal Article-Accepted Manuscript
  • Rights Information:
    Accepted Manuscript
  • Rights Statement:
    The NOAA IR provides access to this content under the authority of the government's retained license to distribute publications and data resulting from federal funding. While users may legally access this content, the copyright owners retain rights that govern the reproduction, redistribution, and re-use of this work. The user is solely responsible for complying with applicable copyright law.
  • Compliance:
    Library
  • Main Document Checksum:
    urn:sha-512:4e09b5bf9d866acf52842d34f1c6eb3f615b820270284dfa32bfa60e3dac8865a46be9910d35cb204c549f3f3beddb6ef6615f149ccfbae4a29f120169ec1058
  • Download URL:
  • File Type:
    Filetype[PDF - 653.67 KB ]
PREVIOUS
ON THIS PAGE
Details
The NOAA IR serves as an archival repository of NOAA-published products including scientific findings, journal articles, guidelines, recommendations, or other information authored or co-authored by NOAA or funded partners. As a repository, the NOAA IR retains documents in their original published format to ensure public access to scientific information.
BACK TO TOP