The Agenda
November 11- November 12, 2023, 9:00 AM to 5:30 PM
Meeting Room Name: Assembly Room at The Slate, Denver
November 11, Saturday
Registration - 8:30 AM - 9:00 AM - Badge Pick-Up
9:00 - 9:10
Welcome and Overview
Ritu Arora, Wayne State University
9:10 - 9:35
Measuring Performance and Usage – evolution of the measuring and monitoring of NSF supercomputing
Dr. Abani Patra, Tufts University
9:35 - 10:00
Measuring Success Metrics for a Software Project: Experience with the MVAPICH MPI Library Project
Dr. D.K. Panda, Ohio State University
10:00 - 11:00
Panel: Methods, Challenges, and Opportunities in Measuring the Impact of CI Projects
Panelists:
Dr. Marlon Pierce, National Science Foundation
Dr. Richard Gerber, National Energy Research Scientific Computing Center
Dr. David Bernholdt, Oak Ridge National Laboratory
Dr. Matthew Curry, Sandia National Laboratory
Moderator:
Sukrit Sondhi, Macmillan Learning
11:00 - noon
The Value Proposition of Campus High Performance Computing Facilities to Institutional Productivity - A Production Function Model; Author: Preston Smith
Evaluating ROI for Cyberinfrastructure with the International Integrated Reporting Framework; Winona Snapp-Childs, David L. Hart, Claudia M. Costa, Julie A. Wernert, Harmony E. Jankowski, John W. Towns, Craig A Stewart
The Data Analytics Framework for XDMoD; Aaron Weeden, Joseph P. White, Robert L. DeLeon, Ryan Rathsam, Nikolay A. Simakov, Conner Saeli, Thomas R. Furlani
noon- 12:10
Q&A with the presenters in the previous timeslot
12:10 - 1:15
Lunch Break and Forming Teams for Brainstorming Sessions (Multiple Groups Will be Formed)
1:15 - 2:15
Brainstorming session - Topic 1 (How do we build trust in the data related to the metrics for success?)
2:15 - 3:15
Brainstorming session - Topic 2 (What are the challenges related to gathering the metrics of success related to your projects?)
3:15 - 4:15
Brainstorming session - Topic 3 (How are we currently using the data related to our project metrics, to inform or revise, our processes/actions/decision-making?)
4:15 - 5:15
Brainstorming session - Topic 4 (What are the considerations for developing or improving on the "responsible metrics" for assessing the CI projects and defining benchmarks for success?)
5:15 - 5:30
Presentation preparations and Wrap-Up for the day
Moderators of each brainstorming session will lead the preparation of presentations that summarize their group discussions; presentations will be given on November 12, 2023
November 12, 2023, Sunday
9:00 - 9:15
Welcome Back and Overview
Ritu Arora, Wayne State University
10:15 - 11:15
A Framework of "Soft-Skills" Metrics for Cyberinfrastructure Projects and Virtual Organizations: A Preliminary Analysis of the XSEDE's Thriving Culture; Kerk Kee, Harmony Jankowski, Richard Knepper, Winona Snapp-Childs, Rhett Brady;
Measuring the impact of centralized high-performance computing with research collaboration networks; Gil Speyer, Dhruvil Shah, Rebecca Belshe, Jason Yalim
First Impressions of the Sapphire Rapids Processor with HBM for Scientific Workloads; Eva Siegmann, Robert J Harrison, David Carlson, Smeet Chheda, Anthony Curtis, Nikolay A Simakov
11:15 - 11:24
Q&A with the presenters in the previous timeslot
11:24 - 11:52
Evaluating Impact of an Online Self-Service Learning Platform for Application-Inspired Cloud DevOps Curriculum; Roshan Lal Neupane, Kiran Neupane, Hemanth Sai Yeddulapalli, Prasad Calyam
Feasibility of Application-Agnostic Speed and Cost Performance Metrics on an Example of Gromacs, a Molecular Dynamics Application; Nikolay A. Simakov, Robert L. Deleon
User Competence Metrics for Cyberinfrastructure: The Case of KnowCOVID-19 Science Gateway; Md Ashraful Goni, Roland Oruche, Minhaz Uddin, Opeyemi Lawal, Prasad Calyam, Kerk Kee
Towards Developing a Model for Assessing the Progress, Success, and Impacts of CyberInfrastructure (CI) Projects; Ritu Arora, Sukrit Sondhi
11:52 - 12:00
Q&A with the presenters in the previous timeslot
12:00 - 1:15
Lunch Break
1:15 - 1:45
Democratizing the Cyberinfrastructure Ecosystem
Dr. Sharon Geva, National Science Foundation
1:45 - 2:52
From Vision to Evaluation: A Metrics Framework for the ACCESS Allocations Service;David Hart, Stephen Deems, Laura Herriott
The Automation of NERSC Metrics; Mah Kadidia Konate, Rebecca Hartman–Baker, Richard Gerber
Assessing the Impact of a CyberTraining Project: Expanding the Metrics; Sandra Nite, Joshua Winchell, Maikel Pennings, Dhruva K Chakravorty, Keith Jackson
Metrics of success for LAPACK and <T>LAPACK; Weslley da Silva Pereira, Julien Langou
2:52 - 3:00
Q&A with the presenters in the previous timeslot
3:00 - 4:00
Taxonomy of CyberInfrastructure (CI) Projects - Overview and Discussion
Towards the Standardization of CI Metrics - Overview and Discussion
4:00 - 4:30
Wrap-Up and Call for Participation in Report Writing