Extreme event analysis in next generation simulation architectures

Stephen Hamilton, Randal Burns, Charles Meneveau, Perry Johnson, Peter Lindstrom, John Patchett, Alexander S. Szalay

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Numerical simulations present challenges because they generate petabyte-scale data that must be extracted and reduced during the simulation. We demonstrate a seamless integration of feature extraction for a simulation of turbulent fluid dynamics. The simulation produces on the order of 6 TB per timestep. In order to analyze and store this data, we extract velocity data from a dilated volume of the strong vortical regions and also store a lossy compressed representation of the data. Both reduce data by one or more orders of magnitude. We extract data from user checkpoints in transit while they reside on temporary burst buffer SSD stores. In this way, analysis and compression algorithms are designed to meet specific time constraints so they do not interfere with simulation computations. Our results demonstrate that we can perform feature extraction on a world-class direct numerical simulation of turbulence while it is running and gather meaningful scientific data for archival and post analysis.

Original languageEnglish (US)
Title of host publicationHigh Performance Computing - 32nd International Conference, ISC High Performance 2017, Proceedings
EditorsJulian M. Kunkel, Pavan Balaji, David Keyes, Rio Yokota
PublisherSpringer Verlag
Pages277-293
Number of pages17
ISBN (Print)9783319586663
DOIs
StatePublished - 2017
Event32nd International Conference, ISC High Performance, 2017 - Frankfurt, Germany
Duration: Jun 18 2017Jun 22 2017

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10266 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference32nd International Conference, ISC High Performance, 2017
Country/TerritoryGermany
CityFrankfurt
Period6/18/176/22/17

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science

Fingerprint

Dive into the research topics of 'Extreme event analysis in next generation simulation architectures'. Together they form a unique fingerprint.

Cite this