Final Deliverable: Action Plans
I. Measurability Map
1. *Collect all the metrics that people are using now in ImpactStory, altmetric.com, PLOS, and let people vote on and add to them. Make sure that things we know about but that we haven't been able to calculate are also included:
- Ian will get the eLife editorial board to do this
- Lisa will try to do this eScholarship journal editorial boards and paper series admininistrators
- Juan will try to do this with Latin American publishers and editors
Scope-planning of tool is critical
2. Quickly build something for people to respond to in a simple manner.
- There are so many metrics, you need to make it manageable, i.e. grouping metrics so that they can be scanned; groups should be expandable to see details
- Data input
- What items
- How important
- Other supporting data
- Way to point to provenance
- Demographic characteristics of responders
e.g. Here's a measure (Ian's) what is the diffusion of a core idea of a paper
2.5 list of outputs/trackable artifacts/signals
3. Make sure you engage with all the different stakeholders;make sure to reach out to the funding community to see what metrics they are gathering
4. We recognize that in capturing information for the tool, we will find information about things that are currently immeasurable, so we will create a place for people to submit examples of those objects, in order to create a large collection that can be analyzed in order to move those types of objects into the "measurable" category.
5. Idea of a registry of metrics which serves as a central clearinghouse for openly describing all metrics being gathered, and that is extensible so that we can capture the aspects of those metrics that are important to different communities. On top of this, we may be able to create profiles of metrics that are important to different communities. Those profiles should be versionable so that we can see whether different communities evolve over time in their attitudes and use of metrics. Where this registry should live remains an open question, so we may possibly build this tomorrow and not worry about it.
II. Clusters, themes categories of User Stories
1. Collect use cases (a wiki - something more open than googledocs; a home). Seed with samples, offer a basic structure. Create awareness and communication.
2. Determine criteria for prioritization or a voting mechanism; some sort of model for ranking/sorting the collection.
3. Pass 'solved' use cases to the advocacy/ambassador group for their use in communication and outreach and apply ourselves further to expand these other use cases into well-documented, solid user stories.
Aim for presenting at Force 11 in March.
4. For hackathon >> challenge that by sunset tomorrow show us the iteration of use case 1, 2, 3
Alex - reverse engineer - for what they do tomorrow, ask what use case are you trying to solve?
Example -- Make it easy to find stuff:
- Add alt metrics for relevance in a discovery tool, how to utilize in a search tool
- which search too, where would it make sense to add that
- what is the simplest thing that could be done in one day to give a demonstration of, I want to find stuff based on alt metrics
5. Open challenge to the community solve a use case by 15th Feb - use cases that are not do-able in an afternoon: a grand challenge. Solve, create a YouTube video to show this.
III. “Crowdsource” binning of all science tweeters into categories and make dataset public
1. Renamed: classifying science-related tweets (and therefore Twitter users):
2. Assemble list of scientists
- ask Euan (altmetric.com) for his information, data, algorithm, etc.
- gather pre-existing lists
3. Create a simple web form (you or someone else can update your status)
4. Decide on classification (see below)
5. Make available as data dump, open API
- student (undergrad, grad)
- faculty (assist, assoc. prof)
- scientist (sr, jr)
- Field (esp. for academics)
IV. Target publishers, researchers and funders as ambassadors
1. Identify “ambassadors” in respective fields.
2. Make and present them with, use cases specific to their respective fields
3. Capitalize on appropriate and effective relationships [to best evangelize and advocate for altmetrics].
V. Broaden network around a charter