Embedded Files
What is the automated scoring tool and how was it developed?
What is the automated scoring tool and how was it developed?
The Entrepreneurial Mindset (EM) Concept Map (Cmap) Scoring Tool allows you to score a concept map using either a Traditional or Categorical scoring method, as described in Module 3. The default root concept is set to Entrepreneurial Mindset, but the root can be changed to score cmaps on other topics. The program was developed in 5 phases and is currently in beta testing.
Why are we referring to the tool as semi-automated? While the program can automatically generate scores using both the traditional and categorical method, properly operating the tool requires some manual preparation of the concept map files. Also, for the categorical scoring, assignment to categories is based on a codebook, and the tool provides an opportunity for user input for concepts that are not pre-assigned to a category.
Where can you get the scoring tool?
Where can you get the scoring tool?
The tool can be downloaded from github, which provides comprehensive instructions for how to run the program. The user guide includes illustrated instructions and examples, which we also walk through in the next section. There are also tips on how to customize the tool for different topics.
EM Cmap Scoring Tool on github
For more information on the SAST development and testing, you can also check out this study:
Rodriguez-Mejia, E., Cano-Morales, M. L., Jackson, A., Barrella, E., & Bodnar, C. A. (2025). Evaluation of a Semi-Automated Scoring Tool for Assessing Entrepreneurial Mindset Concept Maps. International Journal of Engineering Education, 41(1), 125-135. https://www.ijee.ie/latestissues/Vol41-1/12_ijee4534.pdf
Getting started with the Semi-Automated Tool
Getting started with the Semi-Automated Tool
Preparing cmap files for scoring with the tool
Preparing cmap files for scoring with the tool
Using the tool for Traditional or Categorical Scoring
Using the tool for Traditional or Categorical Scoring
Once you have installed the semi-automated scoring tool and prepared your cmap files for scoring, you are ready to test it out for scoring with the traditional and/or categorical scoring method. The next videos will walk you through using the scoring tool with two example concept maps. We encourage you to download the example cmaps and follow along.
Example Cmap 1 (less complex)
Example Cmap 2 (more complex)
Automated traditional scoring
Automated traditional scoring
As explained in Module 3 Scoring, the traditional method involves "counting components". The video will walk through a review of how to manually score concept maps and then will illustrate how the scoring tool automates that method.
Categorical Scoring Refresher
Categorical Scoring Refresher
Before testing the tool, practice scoring the two example cmaps by hand to get a better understanding of how the semi-automated tool applies the categorical method.
Categorical Scoring with the Semi-automated Tool
Categorical Scoring with the Semi-automated Tool
Try running the same two example cmaps through the software tool and compare the results to hand scoring.
This automated scoring tool was developed in Python by Martha Lucía Cano Morales and Eduardo Rodríguez Mejía, graduate students at Rowan University.
To acknowledge this work when you share the toolkit or its resources, please cite:
Barrella, E., Bodnar, C.A., Cano Morales, M.L., Carnasciali, M.I., Cruz, J., Dillon, H.E., Kecskemety, K., Jackson, A.M., Miskioglu, E., Rodríguez Mejía, E. (2023). EM Concept Map Toolkit. Licensed under CC BY-NC-SA
Page updated
Report abuse