November 11 - November 12, 2023
Metrics2023
Measuring Success of CyberInfrastructure Projects
in Denver, Colorado
Metrics for objectively assessing the progress and impact of CyberInfrastructure (CI) projects are important for not only obtaining the required resources for the long-term sustainability of the projects and community engagement but also for identifying issues and prioritizing the areas of improvement. As projects evolve over time, the metrics for measuring their progress and impact should also evolve.
Even though each CI project is unique, there are certain elements (such as, community engagement and training) that cross-cut across a vast majority of the projects. Hence, it is possible to define a set of metrics that can be relevant to a broad range of the CI projects for measuring their progress and impact.
The main goal of the Metrics2023 conference is to bring together colleagues from a diverse range of disciplines and organizations to network, collaborate, and work towards defining a taxonomy of CI projects and the appropriate metrics for their short-term and long-term evaluation. Towards this end, abstracts for presentations, and papers for publication in a special issue of Springer Nature Computer Science journal are invited.
Metrics for evaluating the projects related to the following areas are in the scope of this conference:
Software and data infrastructure (including infrastructure for AI, Quantum Computing, and CyberSecurity)
Hardware infrastructure design, development and deployment (for High Performance Computing, Data-Intensive Computing, Cloud Computing, Quantum Computing, Data Storage and Archival, and IoT)
Operations and maintenance (including, processes and practices such as, DevSecOps and ITIL)
Community building and customer service
Training, education, and outreach
Diversity, Equity, Inclusion, and Accessibility (DEIA)
Building virtual organizations
Topics of interest for papers and abstracts include, but are not limited to:
Case-studies on measuring success of projects including lessons learnt, design of the evaluation method, and data analysis
Evolution of the metrics as a project progresses through different project years and release cycles
Currently known best practices for tracking metrics
Tools for tracking the product use metrics and experiences related to their adoption
Challenges and opportunities in developing self-reporting software or data product/infrastructure
Problems and solutions related to gathering certain types of metrics
Benchmarking and performance evaluation techniques for hardware and software products
Methods and experiences related to measuring accuracy, precision, explainability, and fairness of results
Manual and automated methods for gathering quantitative and qualitative metrics
Methods and experiences related to measuring productivity of people
Methods for measuring the societal impact of projects
Literature review and survey of the methods for evaluating success of projects from the areas that are in the scope of the conference
New methods for analyzing success including the role and use of social-media
Taxonomy of CyberInfrastructure (CI) projects and associated metrics
Please review the CFP page of this website for information on submission deadlines and guidelines.
The conference agenda will include talks, panel/s, working sessions involving brainstorming in small groups, presentations from the working groups, and a closed-group report-writing session.
Excerpt of the Call for Papers and Call for Short-Talks
The Call for Papers (CFP), and the Call for Short-Talks is now open. The submissions for abstracts for short-talks will close on September 15, 2023, and the submissions for journal papers will close on October 1, 2023. Please check the CFP page of this website for details.
Call for Participation
We are pleased to invite you to participate in the Metrics2023 conference and request you to kindly confirm your participation by submitting the RSVP form by November 7, 2023, 5:00 PM CST. Our tentative venue can accommodate a limited number of people only and hence, we may need to adjust the deadline for submitting the RSVP form as needed. Therefore, please confirm your attendance as soon as you can.
Information on Registration for the Event
The registration fee for the event is $150. A link to collect the registration fee will be shared with those who RSVP. The participants from the United States higher education institutions can request for the registration fee waiver and their cost of participation (registration fee) will be covered through an NSF grant. Please select the appropriate option for requesting the registration fee waiver through the registration form. We are also able to offer travel awards to one-two early career colleagues from U.S. higher education institutions. All requests for travel award and registration fee waiver should be submitted by September 15, 2023 (through the RSVP form). Registrations will close on November 7, 2023 by 5:00 PM CST.
Talks: There will be invited talks, full-paper presentations (max. 20 minutes each), and short-talks (max. 7 minutes each).
Brainstorming sessions: Conference participants will be organized in small groups and each group will have a facilitator/moderator and a note taker. Each group will brainstorm on a set of questions/topics and share the summary of the discussions with all the participants.
Group Presentations: Each group will present the summary of their discussions.
Panels: There will be one or two panels on the topic of the conference.
Report writing: The conference committee will work on a report related to the topic of the event.
Proceedings: The proceedings (consisting of accepted full-papers) will be published in a special issue of the Springer Nature Computer Science journal. Please check the CFP page of this website for details.
The conference venue will be The Slate, Denver and it is at a short-distance from the Colorado Convention Center.
Let us know if you'll be attending!
The travel awards to the conference are sponsored by NSF award # 2314201.