Welcome one and all! This page is devoted to building the discussion items and resources for the NTLS Summit in January 2010 on the topic of performance assessment of new media literacy, digital media learning and performance, and 21st C skills, as acquired and demonstrated in digital media learning spaces such as MUVEs, games, simulations, and even traditional online courses, if traditional is a word that makes sense in the context of digital media and learning. This group will review the current state of assessment of digital media-based learning and will explore the near and long term potential for assessing higher order 21st Century knowledge and skills. The group will consider assessment "of" versus "for" learning and the use of digital media as both the delivery and reporting mechanism for embedded, authentic assessments. Building on Notes from the Aug 20 Call Broad areas for an exploratory seminar-like setting at the Summit will include: Frameworks, Theories and Ideas 1. Authentic Tasks
- linking task design and learning outcomes Stephanie Moore verified the utility of framing this discussion
with Wiggins ideas
See Fred Newmann's work on Authenticity - He says that authentic tasks meet 3 criteria:
See (Rule, 2006) attached for a brief overview David Merrill (may be contacted at AECT - Stephanie) 2. Assessing Product & Process Stiggins provides a framework for designing multi-source assessment (mutliple methods -) student role in self-assessment viz metacognition the need to tackle "dynamical system behavior" models and the issue of the representation of mental models 3. Purposes of assessment (some call these standards, competencies).
Partnership for 21st Century Skills (http://www.21stcenturyskills.org/)
Engineering Education (http://www.nae.edu/nae/naepcms.nsf/
Engineer of 2020 (http://www.nae.edu/nae/naepcms.nsf/weblinks/MKEZ-5Z5PKL?OpenDocument) New Media Literacy (http://newmedialiteracies.org/)
IEEE (will get from Michael's docs which will be posted here
4. Technologically Assisted Assessment
David Feldon mentioned NCCREST and their "psychometrics of
Sara Dexter's work on case-based reasoning, utilizing Mislevy's
David Gibson's work with Gerald Knezek and others on simSchool
How to represent the layers of the system (Kaufman model (Also see M. McLaughlin, D. Stone): (micro) learner, teacher, classroom, (mezzo)schools, district, (macro) national & state system (mega) cultural societal) - Hall Innovation Configurations Complexity and emergence 6. Policy vs practice Readings Readings are articles, books, and chapters that help form a bibliography of background and related readings that help define this area of interest. The readings may be so general that they do not directly realted to the topic, but are thought to be essential to understanding the topic. This is just alphabetical listing of bibliography, perhaps with annotations, to assist people in gaining access to a shared foundation of literature. Assessment Pellegrino, J., Chudowsky, N., & Glaser, R. (Eds.). (2001). Knowing what students know: The science and design of educational assessment. Washington, DC: National Academy Press. Games and Simulations Aldrich, C. (2005). Learning by doing : the essential guide to simulations, computer games, and pedagogy in e-learning and other educational experiences. San Francisco, CA: Jossey-Bass. Dede, C., Gibson, D., & Damon, T. (2007). Learning games and simulations (video podcast). 2007 National Educational Computing Conference Retrieved January 28, 2009, from http://www.kzowebcasting.com/podcasts/necc2007/NECC%20Live2-2.m4v Gee, J. (2004). What Video Games Have to Teach Us About Learning and Literacy. New York: Palgrave Macmillan. Gibson, D., Aldrich, C., & Prensky, M. (Eds.). (2006). Games and simulations in online learning. Hershey, PA: Idea Group, Inc. Galarneau, L., & Zibit, M. (2006). Multiplayer
online games as practice arenas for 21st century competencies. In D.
Gibson, C. Aldrich & M. Prensky (Eds.), Games and Simulations in
Online Learning: Research and Development Frameworks (pp. 59-88).
Hershey, PA: Idea Group Publishers. Girod, G., Girod, M., & Denton, J. (2006). Lessons learned modeling “connecting teaching and learning”. In D. Gibson, C. Aldrich & M. Prensky (Eds.), Games and simulations in online learning: Research & development frameworks. Hershey, PA: Idea Group. MIT. (2008). Augmented reality games. Retrieved Nov 13, 2008, from http://education.mit.edu/drupal/ Van Eck, R. (2006). Building artificially intelligent learning games. In D. Gibson, C. Aldrich & M. Prensky (Eds.), Games and simulations in online learning: Research & development frameworks. Hershey, PA: Idea Group. Gibson, D., Grasso, D., & Bongard, J. (2007). Games and simulations and the future of engineering: Engaging high school students in global challenges. 2007 Microsoft Game Days Conference Retrieved January 27, 2009, from http://www.globalchallengeaward.org/team_tools/globalresources/socialbalances/research_on_stem_education.html Prensky, M. (2001). Digital game-based learning. New York: McGraw-Hill. Shaffer, D. (2007). Epistemic games. Innovate, from http://horizon.unc.edu/innovate/articles/02106.htm Squire, K., & Jenkins, H. (2003). Harnessing the power of games in education. Insight, 3(5), 5-33. Machine Learning Assessment Systems Almond, R., Steinberg, L., & Mislevy, R. (2002). Enhancing the design and delivery of assessment systems: A four process architecture. The Journal of Technology, Learning, and Assessment, 1(5). Dexter, S. (2003). The Promise of Network-based Assessment for Supporting the Development of Teachers’ Technology Integration and Implementation Skills. Paper presented at the Society for Information Technology and Teacher Education 14th International Conference, New Orleans. Gibson, D. (2006). Elements of Network-Based Assessment. In D. Jonson & K. Knogrith (Eds.), Teaching Teachers to Use Technology (pp. 131-150). New York: Haworth Press. Mislevy, R. J., Steinberg, L. S., & Almond, R. G. (2003). On the structure of educational assessments. Measurement: Interdisciplinary Research and Perspectives, 1, 3-67. Stevens, R. (2006). Machine learning assessment systems for modeling patterns of student learning. In D. Gibson, C. Aldrich & M. Prensky (Eds.), Games and simulations in online learning: Research & development frameworks. Hershey, PA: Idea Group. Research Methods & Reports Research methods outline some of the major directions take thus far in the research on digital media-based performance assessment. Questions & Concerns for Discussion |