Interactive High-Performance Computing Workshops and BOFs
Third Workshop on Interactive High-Performance Computing
November 18, 2019, 9:00am-12:30pm, Room 506, Colorado Convention Center, Denver, Colorado
Held in conjunction with SC19: The International Conference for High Performance Computing, Networking, Storage and Analysis
Interactive exploration and analysis of large data sets, intelligent simulation workflows that combine interactive analysis and AI techniques with modeling and simulation, interactive preparation and debugging of large-scale scientific simulations, in-situ visualization, and application steering are all compelling scenarios for High Performance Computing sytems. However, a range of technical, organizational, and sociological challenges must be overcome to make these interactive workflows mainstream in HPC centers: What simulation scenarios or problem domains can benefit most from interactivity? How can we simplify the toolchain? What center policies are needed to support highly interactive workflows? The goal of this workshop is to bring together domain scientists, tool developers, and HPC center administrators to identify the scientific impact and technical challenges of highly interactive access to HPC resources.
Schedule
November 18, 9:00am-12:30pm
9:00-9:10 Welcome and Introduction
9:10-9:35 Accelerating Experimental Science Using Jupyter and NERSC HPC (Matthew L. Henderson, William Krinsman, Shreyas Cholia, Rollin Thomas, Trevor Slaton)
9:35-10:00 Interactive Supercomputing for Experimental Data-Driven Workflows (Sadaf R. Alam, Maxime Martinasso, Mark Klein, Siew Hoon (Cerlane) Leong)
10:00-10:30 Morning Break
10:30-10:55 Portals for Interactive Steering of HPC Workflows (Robert E. Settlage, Srijith Rajamohan, Kevin Lahmers, Alan Chalker, Eric Franz, Steve Gallo, David Hudak)
10:55-11:20 Pangeo Ecosystem, Interactive Computing Tools for Geosciences: Benchmark on HPC (Tina E. Odaka, Anderson Banihirwe, Guillaume Eynard-Bontemps, Aurelien Ponte, Guillaume Maze, Kevin Paul, Jared Baker, Ryan Abernathey) [slides]
11:20-12:20 Interactivity Use Case Panel Discussion
12:20-12:30 Wrap-up and next steps
Program Committee
Dr. Sadaf Alam, CSCS
Dr. Nicola Ferrier, Argonne National Laboratory
Dr. Peter Messmer, NVIDIA
Dr. Albert Reuther, MIT Lincoln Laboratory
Dr. Michael Ringenburg, Cray Inc.
Mr. John Stone, U. Illinois at Urbana-Champaign
Questions?
Send an email to wihpc19@gmail.com.
Past Workshops and BOFs
June 20, 2019, Frankfurt Marriott Hotel, Frankfurt, Germany
in conjunction with ISC High Performance 2019
Presentations and Slides
Links to slides for most talks are available by following the links below.
June 20, 2019, 14:00-18:00 (2-6pm)
14:00-14:10 Welcome and introduction, Mike Ringenburg (Cray) [slides]
14:10-14:35 Highly interactive, steered scientific workflows on HPC systems: optimizing design solutions, John Ossyra (University of Tennessee, Knoxville) [slides]
14:35-15:00 Open OnDemand: HPC for everyone, Robert Settlage (Virginia Tech) [slides]
15:00-15:25 Interactive HPC Runs Directly from the User's Own PC, Tuomas Eerola (Techila Technologies) [slides]
15:25-15:50 Scheduling Considerations for Leadership-Class Supercomputers, Jack Wells (Oak Ridge National Laboratory) [slides]
15:50-16:00 Additional Q&A
16:00-16:30 ISC Coffee Break
16:30-16:55 The role of interactive supercomputing in using HPC for urgent decision making, Nick Brown (Edinburgh Parallel Computing Centre) [slides]
16:55-17:20 Interactive Supercomputing: Challenges, Opportunities, and a Vision for the Future, Ben Robbins (Cray)
17:20-18:00 Discussion, Next Steps, and Wrap-up, Albert Reuther (MIT Lincoln Laboratory)
Submission Instructions
Extended abstracts (3 pages or less) should be mailed to wihpc19@gmail.com by May 14, 2019. Authors of selected abstracts will be invited to speak at the workshop and to submit full papers for publication in the ISC 2019 workshop proceedings with Springer. The proceedings will appear as post-conference workshop proceedings. The idea behind post-conference proceedings is that they give the authors the flexibility to adjust their contributions slightly based on the feedback given during the workshops.
Important Deadlines
Extended abstract submission deadline: 2019-05-14
Notifications: 2019-05-24
Workshop-ready paper deadline: 2019-06-14
Workshop: 2019-06-20
Camera-ready paper deadline (for post-conference proceedings): 2019-07-22
Program Committee
Dr. Nicola Ferrier, Argonne National Laboratory
Dr. Peter Messmer, NVIDIA
Dr. Albert Reuther, MIT Lincoln Laboratory
Dr. Michael Ringenburg, Cray Inc.
Mr. John Stone, U. Illinois at Urbana-Champaign
June 28, 2018, Marriott Frankfurt Hotel, Frankfurt, Germany
Alabaster 2 (Marriott Hotel, 2nd floor)
in conjunction with ISC High Performance 2018
Presentations and Slides
Thursday, June 28, 2 - 6pm, Alabaster 2
2:00–2:10 Introduction, Peter Messmer (NVIDIA)
2:10–2:35 Interactive HPC Requirements, Challenges, and Solutions for Cutting Edge Molecular Simulation Science Campaigns, John Stone (UIUC) [.pdf]
2:35–3:00 Interactive Distributed Deep Learning with Jupyter Notebooks Wahid Bhimji (NERSC) [.pdf]
3:00–3:25 Emerging interactive workflows for life sciences, Fernanda Foeretter (NVIDIA) [.pdf]
3:25-3:50 HPC in the Human Brain Project, Thomas Vierjahn (RWTHA) [.pdf]
3:50–4:10 Break
4:10–4:35 Opportunities and Challenges for Interactive Supercomputing, Mike Ringenburg (CRAY) [.pdf]
4:35–5:00 Lessons learned from a Decade of Providing Interactive, on-Demand High Performance to Scientists an Engineers, Albert Reuther (MIT Lincoln) [.pdf]
5:00–5:25 Lessons Learned - Enabling Interactive Supercomputing at JSC, Jens Henrik Goebbert (Julich) [.pdf]
5:25–6:00 Discussion & Summary, Peter Messmer (NVIDIA)
Program Committee
Dr. Peter Messmer, NVIDIA
Dr. Sadaf Alam, CSCS
Dr. Albert Reuther, MIT Lincoln Laboratory
Dr. Michael Ringenburg, Cray Inc.
Mr. John Stone, U. Illinois at Urbana-Champaign
BOF@SC17 (November 2017)
After the successful BOF at SC15, we hosted again a Birds-of-a-Feather session on Interactivity in Supercomputing.
The session consisted of talks from John Stone (UIUC), Thomas Schulthess (CSCS) and Mike Ringenburg (Cray) and demonstrated the breath of activities at all the levels of the HPC ecosystem.
One of the outcomes of the lively discussion was that there exists a range of solutions, but most of them are accessible only to a small group of users at a specific site. This fragmentation of the toolsets makes adoption even harder, but at the same time illustrates the importance of the problem.
The group agreed that there is a need for a workshop collecting the current state of the art in interactive HPC and to orchestrate future activities.
BOF@SC15 (November 2015)
At SC15 in Denver we hosted the first Birds-of-a-Feather session on Interactivity in Supercomputing. The goal of that session was to evaluate the interest in the HPC communities to utilize HPC resources in an interactive fashion.
The session consisted of talks from Stephen Jones (SpaceX), Paul Woodward (UMN), Thomas Schulthess (CSCS), and John Shalf (LBNL) presenting their views of the benefits and use-cases of interactivity of HPC systems, covering the perspectives of HPC center managers and domain scientists.
The subsequent discussion showed a tremendous interest from the user community. Not only were the potential uses highlighted, but also new use-cases emerged.