Search this site
Embedded Files
EER Peer Reviewer Training Program
  • Mentored Reviewer Program
    • About
      • Descriptions
    • Apply to Participate
      • Mentee Application
    • Reviewer Resources
    • Become a JEE Reviewer
      • Reviewer Guidelines
      • About JEE
    • For Participants
      • Forms
        • Triad Feedback
      • Proposal Training
      • Orientation Videos
      • Monthly Discussion Sessions
  • Grant Proposal Mentored Reviewer Program
    • About
    • Project Timeline
  • Research
  • People
EER Peer Reviewer Training Program
  • Mentored Reviewer Program
    • About
      • Descriptions
    • Apply to Participate
      • Mentee Application
    • Reviewer Resources
    • Become a JEE Reviewer
      • Reviewer Guidelines
      • About JEE
    • For Participants
      • Forms
        • Triad Feedback
      • Proposal Training
      • Orientation Videos
      • Monthly Discussion Sessions
  • Grant Proposal Mentored Reviewer Program
    • About
    • Project Timeline
  • Research
  • People
  • More
    • Mentored Reviewer Program
      • About
        • Descriptions
      • Apply to Participate
        • Mentee Application
      • Reviewer Resources
      • Become a JEE Reviewer
        • Reviewer Guidelines
        • About JEE
      • For Participants
        • Forms
          • Triad Feedback
        • Proposal Training
        • Orientation Videos
        • Monthly Discussion Sessions
    • Grant Proposal Mentored Reviewer Program
      • About
      • Project Timeline
    • Research
    • People

JEE Mentored Reviewer Program

Roles and Responsibilities
Equity and Inclusivity in Reviewing
Structured Peer Review Form
Tips on Writing and Reviewing
Considerations of Research Quality
Other Resources for Peer Reviewers

Roles and Responsibilities

Council of Science Editors: CSE’s White Paper on Promoting Integrity in Scientific Journal Publications: 2.3 Reviewer Roles and Responsibilities (2012). Read More

Peer review is the principal mechanism by which the quality of research is judged. Most funding decisions in science and the academic advancement of scientists are based on peer-reviewed publications.

Because the number of scientific articles published each year continues to grow, the quality of the peer-review process and the quality of the editorial board are cited as primary influences on a journal’s reputation, impact factor, and standing in the field.

Scientific journals publishing peer-reviewed articles depend heavily on the scientific referees or reviewers who typically volunteer their time and expertise. In most circumstances, at least 2 reviewers are solicited to evaluate a manuscript; some journals request 3 reviews. This may be required in situations where review by a statistician is needed. In cases of controversy or strong disagreement regarding the merits of the work, an additional review may also be solicited or one of the journal’s editors might give an evaluation. More than 3 reviewers are sometimes used if reviewers from several fields are needed to obtain a thorough evaluation of a paper.

In addition to fairness in judgment and expertise in the field, peer reviewers have significant responsibilities toward authors, editors, and readers.



Equity and Inclusivity in Reviewing

Coley, B.C., Simmons, D.R. and Lord, S.M. (2021), Dissolving the margins: LEANING IN to an antiracist review process. Journal of Engineering Education. https://doi.org/10.1002/jee.20375. Read More

The foundation of any collective action, of any community, is language. It influences how we feel, react, and understand. Thus, dismantling racism starts with analyzing the language we use—especially since it says much about how we see people.

Tiffani L. Williams, Tiffani L. (2020). 'Underrepresented Minority' Considered Harmful, Racist Language. Communications of the ACM (BLOG@CACM). Read More

Structured Peer Review Form

Structured Peer Review Form. Read More

The Structured Peer Review form was developed as a way to begin thinking about a manuscript review in constructive ways. It is organized by strengths, weaknesses and suggestions to improve a manuscript. It also includes a list of the possible recommendations reviewers can make to editors (accept, reject, etc.), and prompts reviewers to justify their recommendation. A reviewer’s responses may be first impressions that change as they reflect on their review and the manuscript they are reviewing. While reviews do not have to follow this format, the Structured Peer Review form can serve as a good starting point.



Tips on Writing and Reviewing

Pratt, M. (2009). For the Lack of a Boilerplate: Tips on Writing Up (and Reviewing) Qualitative Research. Academy of Management Journal 2009, Vol. 52, No. 5, 856–862. Read More

Qualitative research is only one of the methods that are appropriate for our journal, but over the past several years we at AMJ have worked diligently to increase the number and quality of the qualitative research papers we review and publish. Just this year, one of our qualitative papers won the award “Best Paper in Organizational Behavior” from the OB Division of the Academy of Management (Margolis & Molinsky, 2008). Our efforts to increase high-quality qualitative work in the Journal stems, in part, from our mission to publish research that has the highest impact. Qualitative research certainly fits this bill, as work in this area has won multiple best paper awards in AMJ and Administrative Science Quarterly, and qualitative research was overrepresented (in terms of the total number of studies published) in AMJ’s survey regarding the most interesting management-related articles published in the past 100 years (Bartunek, Rynes, & Ireland, 2006).



Considerations of Research Quality

“Considerations of Research Quality in the Review of Interpretive Engineering Education Research Manuscripts” by Joachim Walther and Nicola Sochacka. Read More.

Theoretical validation concerns the fit between the social reality under investigation and the theory generated. Does the article clearly articulate / define the social reality (SR) / phenomenon under investigation in its naturea) and scopeb)?

Procedural validation concerns features of the research design that inherently improve the fit between the reality studied and the theory generated. Are the methodology and methods chosen inherently suited to elicit data and insight about the social reality of interest?

Communicative validation concerns the integrity of the interlocking processes of social construction with the relevant communication communities. Does the description of the data collection methods or instruments provide sufficient detail to indicate the data were authentically co‐constructed on participants’ own terms?

Pragmatic validation concerns the compatibility of theoretical constructs with empirical reality. Did the methods (framed by both theory and methodology) resonate in the research context and elicit data specific to the social reality of interest? (i.e., something that a generic line of inquiry would not have elicited?)


These guidelines are based on their research articles on research quality:
– Walther, J., Sochacka, N. W., & Kellam, N. N. (2013). Quality in interpretive engineering education research: Reflections on an example study. Journal of Engineering Education, 102(4), 626–659)
– Sochacka, N. W., Walther, J. and Pawley, A. L. (2018), Ethical Validation: Reframing Research Ethics in Engineering Education Research To Improve Research Quality. Journal of Engineering Education, 107(3): 362-379. doi:10.1002/jee.20222/

Other Resources for Peer Reviewers

Reviewer Resources

  • Publons Reviewer Academy – Become a Master of Peer Review

  • Wiley Reviewer Resources – Journal Reviewers

  • SAGE Publishing – How to Review Articles

  • AERA Reviewer Resources – AERA Journal Peer Reviewers

  • AERA Research Standards – Ensuring High-Quality Research

  • Sage Connection Insights – Articles Discussing Peer Review

  • Editor Resources – A Guide to Becoming a Peer Reviewer

  • Science Magazine – Learning the Ropes of Peer Reviewing

  • APA Style Guide – Overview of JARS

  • APA Style Standards – Reporting Quantitative Research

  • APA Style Qualitative – Reporting Qualitative Research

  • APA Style Mixed – Reporting Mixed Methods Research


Articles

  • The Role of Peer Review in Identity Development for Engineering Education Researchers – Anne Gardner & Keith Willey (2019) The role of peer review in identity development for engineering education researchers, European Journal of Engineering Education, 44:3, 347-359, DOI: 10.1080/03043797.2018.1500526


         JOURNAL OF EDUCATION ENGINEERING © 2020 
Google Sites
Report abuse
Page details
Page updated
Google Sites
Report abuse