SuperCompCloud: 3rd Workshop on Interoperability of Supercomputing and Cloud Technologies

Held in conjunction with SuperComputing'20, The International Conference for High Performance Computing, Networking, Storage and Analysis, in cooperation with IEEE TCHPC

Conference Proceedings are available in partnership with IEEE TCHPC.

Time & Location

Held virtually as part of the SC20 conference platform on November 11 (Wednesday), 10:00 AM to 2:00 PM EST.

Please refer to the SC20 virtual announcement for up to date information. You must register as an SC20 workshop participant in order to attend, after logging into the "SC20 Virtual Platform" from the main conference page you can browse to the workshop in the schedule and select the "live stream" button.

Workshop Agenda

The workshop agenda is now published within the SC20 schedule in addition to the abbreviated version below (times listed as Eastern Standard Time). Presentations will included 5 minutes of live Q&A even when content is pre-recorded with presenters listed below.

• 10:00 AM Welcome and introduction

• 10:10 AM Exosphere - Bringing The Cloud Closer: Julian Pistorius and Chris Martin

• 10:30 AM SELVEDAS: A Data and Compute as a Service Workflow Demonstrator targeting Supercomputing Ecosystems: Leong Cerlane

• 10:50 AM Lightning Talk: Jetstream2: Accelerating Science and Engineering on Demand, David Y Hancock

• 11:00 AM Break

• 11:30 AM Performance Characteristics of Virtualized GPUs for Deep Learning: Scott Michael

• 11:50 AM FirecREST: a RESTful API to HPC systems: Koutsaniti Eirini

• 12:10 PM Leveraging Hybrid Cloud HPC with Multitier Reactive Programming: Daniel Sokolowski

• 12:30 PM Break

• 01:00 PM The "Geddes" Composable Platform - An Evolution of Community Clusters for a Composable World: Preston Smith

• 01:20 PM Archival Data Repository Services to Enable HPC and Cloud Workflows in a Federated Research e-Infrastructure: Dirk Pleiter

• 01:40 PM SuperCompCloud Closing remarks & ISC21 invite

• 01:55 PM Close

Workshop Abstract and Topics

Exascale computing initiatives are expected to enable breakthroughs for multiple scientific disciplines. Increasingly these systems may utilize cloud technologies, enabling complex and distributed workflows that can improve not only scientific productivity, but accessibility of resources to a wide range of communities. Such an integrated and seamlessly orchestrated system for supercomputing and cloud technologies is indispensable for experimental facilities that have been experiencing unprecedented data growth rates. While a subset of high performance computing (HPC) services have been available within a public cloud environments, petascale and beyond data and computing capabilities are largely provisioned within HPC data centres using traditional, bare-metal provisioning services to ensure performance, scaling and cost efficiencies. At the same time, on-demand and interactive provisioning of services that are commonplace in cloud environments, remain elusive for leading supercomputing ecosystems. This workshop aims at bringing together a group of experts and practitioners from academia, national laboratories, and industry to discuss technologies, use cases and best practices in order to set a vision and direction for leveraging high performance, extreme-scale computing and on-demand cloud ecosystems. Topics of interest include tools and technologies enabling scientists for adopting scientific applications to cloud interfaces, interoperability of HPC and cloud resource management and scheduling systems, cloud and HPC storage convergence to allow a high degree of flexibility for users and community platform developers, continuous integration/deployment approaches, reproducibility of scientific workflows in distributed environment, and best practices for enabling X-as-a-Service model at scale while maintaining a range of security constraints.

This workshop will cover topics related to interoperability of supercomputing and cloud computing, networking and storage technologies that are being leveraged by use cases and research infrastructure providers with a goal to improve productivity and reproducibility of extreme-scale scientific workflows:

• • Virtualization for HPC e.g. virtual machines, containers, etc.

  • Storage systems for HPC and cloud technologies

  • On-demand and interactivity with performance, scaling and cost efficiencies

  • Resource management and scheduling systems for HPC and cloud technologies

  • Software defined infrastructure for high-end computing, storage and networking

  • Application environment, integration and deployment technologies

  • Secure, high-speed networking for integrated HPC and cloud ecosystems

  • Extreme data and compute workflows and use cases

  • Research infrastructure deployment use cases

  • Resiliency and reproducibility of complex and distributed workflows

  • Isolation and security within shared HPC environments

  • X-as-a-Service technologies with performance and scalability

  • Workflow orchestration using public cloud and HPC data centre resources

  • Authentication, authorization and accounting interoperability for HPC and cloud ecosystems

  • Workforce development for integrated HPC and cloud environments

Important Dates

• • Technical Paper Submission Deadline: 11:59 PM GMT, August 21, 2020

  • Author Notification: September 18, 2020 September 25, 2020

  • Camera-ready Deadline: 11:59 PM GMT, October 12, 2020

  • IEEE Copyright Deadline: October 18, 2020

  • Workshop Date: November 11, 2020, 10 am-2 pm (Wednesday)

Paper Submission

Submissions will be done through the SC submission site (powered by Linklings): https://submissions.supercomputing.org

All submissions must be in English and should not exceed 6 pages using the IEEE conference format (double column, 10pt font). Submissions must be made as a single PDF file formatted for 8.5" x 11" (U.S. Letter) which includes all figures and references. Papers should not be submitted in parallel to any other conference or journal. For more details: https://www.ieee.org/conferences/publishing/templates.html

The submitted papers will go through a peer-review process and will be evaluated according to four main criteria: the relevance of the work, its technical soundness, its originality/novelty and the quality of the presentation. The workshop proceedings will be published through IEEE TCHPC and included in the IEEE Xplore digital library.

At least one of the authors of each accepted paper must register as a participant of the workshop and present the paper at the workshop, in order to have the paper published in the proceedings.

Authors should have received details to upload camera-ready versions to IEEE along with copyright agreement on October 12th to submit to IEEE by October 18th.

On October 29th presenters should have received communication regarding a technical check in preparation for the workshop, all presenters and moderators must schedule a time to do this with the virtual platform technical staff. Each individual meeting should take 15-20 minutes.

Workshop Committees

Organizing Committee

Organizing Committee (supercompcloud@googlegroups.com)

• • Sadaf Alam, Swiss National Supercomputing Center

  • François Tessier, Swiss National Supercomputing Center

  • David Y. Hancock, Indiana University

  • Winnona G. Snapp-Childs, Indiana University

  • John M. Lowe, Indiana University

Program Committee

• • Jacob Anders, CSIRO, Australia

  • Gabriel Antoniu, Inria, France

  • Blair Bethwaite, NZ eScience Infrastructure, New Zealand

  • Evan Bollig, Amazon Web Services, USA

  • Bruce D'Amora, IBM Research, USA

  • Jeremy Fischer, Indiana University, USA

  • Thorsten Hater, Forschungzentrum Juelich, Germany

  • Steve Quenette, Monash University, Australia

  • Timothy Randles, Los Alamos National Lab, USA

  • Pierre Riteau, StackHPC, UK

  • Kento Sato, Riken, Japan

  • Mallikarjun (Arjun) Shankar, Oak Ridge National Lab, USA

Committee members are currently being solicited and confirmed. If you would like to participate in the committee please contact the workshop organizers at supercompcloud@googlegroups.com.