SuperCompCloud: 6th Workshop on Interoperability of Supercomputing and Cloud Technologies

Held in conjunction with SC'22, The International Conference for High Performance Computing, Networking, Storage and Analysis. Full paper proceedings published via the IEEE Computer Society. 

Time & Location 

Monday, November 14, 2022 from 8:30 AM - 12:00 PM (CST) in Room C141 at the Dallas Convention Center.  

Please refer to the SC22 website for the most up to date information. 

Workshop Agenda - Sli.do Q&A -> # SC22_wksp128s1

Session I

8.30am - 8.45am Welcome

8.45am - 9.15am           Invited talk by Dr. Enol Fernández of the EGI Foundation [Slides]

9.15am - 9.40am           Paper: "Autoscaling of Containerized HPC Clusters in the Cloud", Greneche, Cerin.  [Slides]  [Pre-print]

9.40am - 9.50am           Lightning talk: "Software Resource Disaggregation for HPC with Serverless Computing", Copik, Chrapek, Calotoiu, Hoefler  [Slides]  [Extended Abstract]

9.50am - 10.00am Q&A Session I

10.00am - 10.30am Break

Session II

10.30am - 11.00am Invited talk: "Opportunities in serverless computing for the HPC world!" by Professor Devesh Tiwari of Northeastern University [Slides]

11.00am - 11.25am Paper: "Assessing the Current State of AWS Spot Market Forecastability", Caton, Baughman, Haas, Chard, Foster, Chard  [Slides]  [Pre-print]

11.25am - 11.35am Lightning talk: "DPU Solution for Container Overlay Networks", Njavro, Groves, Wright, Tau, West  [Slides]  [Extended Abstract]

11.35am - 12.00pm Q&A Session II & Closing

Workshop Abstract and Topics

Exascale computing initiatives are expected to enable breakthroughs for multiple scientific disciplines. Increasingly these systems may utilize cloud technologies, enabling complex and distributed workflows that can improve not only scientific productivity, but accessibility of resources to a wide range of communities. Such an integrated and seamlessly orchestrated system for supercomputing and cloud technologies is indispensable for experimental facilities that have been experiencing unprecedented data growth rates. While a subset of high performance computing (HPC) services have been available within a public cloud environments, petascale and beyond data and computing capabilities are largely provisioned within HPC data centres using traditional, bare-metal provisioning services to ensure performance, scaling and cost efficiencies. At the same time, on-demand and interactive provisioning of services that are commonplace in cloud environments, remain elusive for leading supercomputing ecosystems. This workshop aims at bringing together a group of experts and practitioners from academia, national laboratories, and industry to discuss technologies, use cases and best practices in order to set a vision and direction for leveraging high performance, extreme-scale computing and on-demand cloud ecosystems. Topics of interest include tools and technologies enabling scientists for adopting scientific applications to cloud interfaces, interoperability of HPC and cloud resource management and scheduling systems, cloud and HPC storage convergence to allow a high degree of flexibility for users and community platform developers, continuous integration/deployment approaches, reproducibility of scientific workflows in distributed environment, and best practices for enabling X-as-a-Service model at scale while maintaining a range of security constraints.

This workshop will cover topics related to interoperability of supercomputing and cloud computing, networking and storage technologies that are being leveraged by use cases and research infrastructure providers with a goal to improve productivity and reproducibility of extreme-scale scientific workflows:

• • Virtualization for HPC e.g. virtual machines, containers, etc.

  • Storage systems for HPC and cloud technologies

  • On-demand and interactivity with performance, scaling and cost efficiencies

  • Resource management and scheduling systems for HPC and cloud technologies

  • Software defined infrastructure for high-end computing, storage and networking

  • Application environment, integration and deployment technologies

  • Secure, high-speed networking for integrated HPC and cloud ecosystems

  • Extreme data and compute workflows and use cases

  • Research infrastructure deployment use cases

  • Resiliency and reproducibility of complex and distributed workflows

  • Isolation and security within shared HPC environments

  • X-as-a-Service technologies with performance and scalability

  • Workflow orchestration using public cloud and HPC data centre resources

  • Authentication, authorization and accounting interoperability for HPC and cloud ecosystems

  • Workforce development for integrated HPC and cloud environments

Important Dates

• • Technical Paper/Extended Abstract Submission Deadline: August 5: Extended to August 19 2022

  • Authors Notification: September 9, 2022

  • Camera-ready Deadline: October 14, 2022

  • Presentation material: October 28, 2022

  • Workshop Date: November 14, 2022

Full Paper and Extended Abstract Submission

Submissions will be done through the SC submission site (powered by Linklings): https://submissions.supercomputing.org 

All submissions must be in English and should fit in 6 to 8 pages using the IEEE conference format (double column, 10pt font). 2-page extended abstracts are also allowed. If an abstract is accepted, the full paper must be submitted by September 16. Submissions must be made as a single PDF file formatted for 8.5" x 11" (U.S. Letter) which includes all figures and references. Papers should not be submitted in parallel to any other conference or journal. For more details: https://www.ieee.org/conferences/publishing/templates.html 

The submitted papers will go through a peer-review process and will be evaluated according to four main criteria: the relevance of the work, its technical soundness, its originality/novelty and the quality of the presentation. The workshop proceedings will be published through IEEE Computer Society. The author submission site is open and designated contacts should be able to submit IEEE copyright release forms as well as final camera-ready papers. 

At least one of the authors of each accepted paper must register as a participant of the workshop and present the paper at the workshop, in order to have the paper published in the proceedings. The SC executive committee requests that presenters start their presentation with the provided slide template as a title slide. 

Workshop Committees 

Organizing Committee

Organizing Committee (supercompcloud@googlegroups.com)

• • David Y. Hancock, Indiana University

  • Winona G. Snapp-Childs, Indiana University

  • John M. Lowe, Indiana University

  • François Tessier, Inria

  • Maxime Martinasso, Swiss National Supercomputing Center

Program Committee

• • Joshua Bowden, Inria, France

  • Tim Robinson, CSCS, Switzerland

  • Kento Sato, RIKEN R-CCS, Japan

  • Dirk Pleiter, KTH Royal Institute of Technology, Germany

  • Steve Poole, Los Alamos National Laboratory, USA

  • Jeremy Fischer, Indiana University, USA

  • Evan Bollig, Amazon Web Services, USA

  • Victoria Stodden, University of Illinois, USA

  • Mallikarjun (Arjun) Shankar, ORNL, USA

  • Kevin Kissell, Google, USA

  • Blair Bethwaite, NZ eScience Infrastructure, New Zealand

  • Pierre Riteau, StackHPC Ltd, UK

Committee members are currently being solicited for future events. If you would like to participate in the committee please contact the workshop organizers at supercompcloud@googlegroups.com.