Performance Assessment Deliberations Thursday 9/30

This pad is for quick group collaboration during the Performance Assessment strand at NTLS - wiki

Archive of:

1. -panel for ISTE, AECT Conference panel (Jacksonville, FL), SITE Panel (meeting in nashville before) 
2. -discussion on instrument repository
3. -AECT handbook input
4. -what's out there document and how "we" (NTLC orgs) fit into the ecology
5. -Special issue on assessment, featured piece in each journal, etc. proof of concept piece would be very helpful
6. Assessment inside virtual environments (Dede)  & Digital Media Assessment Theory
7.  AACTE innovation and technology committee is putting out a book  on   TPACK, debating assessment chapter (call for cases before call  for   chapters) 
8. message to the hill performance assessment and PBL are critical to 21c learning
9. ***Commenting on Common Core Draft - (may give some of the most impact for our effort)

Brainstorm 3 things to say to Karen Cator: 

- Build collaborative data gathering networks - using simple standardized instruments and shared protocols, so we can all start to make one story  and enable robust modeling of the system.

- What is it we're measuring - attitudes and self-effacacy as precursors for other valued 21st C. outcomes

- Performance Assesment and Project-Based Learning as ciritical to 21st C. skills

- "Design Research" ~ Developmental Research on Performance Assessment

- Re-create a system like PT3 (collaborative exchanges among researchers, catalyzing ideas of things to develop meant to impact across sites, peer reviews by colleagues in the program helping comment on new ideas - the long-term impacts that transformed the professional societies and high ed institution; pushed higher ed into re-thinking, but the push did not last long enough to catalyze permanent change AND the world has moved on; pushed for simulatneous renewal and local collaboratives).

- Preparing teachers with explicit instruction as change agents - entrprenuerial teachers - field leaders - and also to use technology in project-based learning as well as bring their content area's most recent uses of technology into teaching.


POWERPOINT CAN BE FOUND HERE - at bottom of page

performance assessment and PBL are critical to 21c learning

Will get ppt file from Gerald

Problem with using student test scores to evaluate teachers 

Action research- teachers evaluating their own research 

Reliability = ceiling for validity 

Telling this story on the Hill 

Broader issue - cloud computing (is there a need for ownwership)
 Carrollton Farmer's Branch -

Potential Agenda: 
1: "pie in the sky" 
2: fundamentals - reliability, validity, instrumentation
3:  What are problems we haven't solved well yet? (TPACK) - this could be a  deliverable, wicked problems (we're going to change it to gnarly  problems) 

Rest of agenda for today: 
1-2 - get the fundamentals down before meeting with Engineering
2 - ? Joint meeting with Children's Engineering

Tomorrow - focus on TPACK Assessment in the AM

Could be a synthesizing activity 
New Handbok Coming out: Available FREE to members 
Handbook of Research on Educational Communications and Technology 
Measuring Technology Readiness and Skills - Rhonda Christensen and Gerald Knezek 
- Assessing 21st Century Skills
- Assessing different levels of technology readiness (macro, meso, micro) 
- Analysis tools and techniques 
- Chapter on TPACK in there as well

Maggie Neiss book on measuring TPACK -- performance assessment, not just survey instrument

Main goal of group meetings today/tomorrow: 3 overarching tasks/outcomes

Wide angle view of discussion topics: 

1. Global forces, complexity science & TPACK
2. Traditional: Doing better with what we know how to do.  (Christensen, Tyler-Wood, Knezek)
3. New Waves in Methodology
4. What is current and emerging ecology supporting performance assessment  and what role role can we play in the development

Suggested topics: 
  • -distinction between teacher performance and student performance
  • -high stakes assessments are not set up to measure performance assement (where is the "rub")
  • how do we look at what matters? how do we assess what matters? 
  • Problems with the use of student test scores to evaluate teachers: 


Smarter Balanced Assessment Consortium -
Also, check out

David's presentation on Digital Media Assessment Theory
Evidence centered design theory 
Situates evaluation between formal and summative
How do we examine processes and artifacts in new ways?

Carnegie investigating peer-to-peer university, pedagogy

STEM  and the key concepts of systems and optimizations are connected to  social studies-remember Science, Technology, & Sociery push in 80's -  STS 

National Educational Technology Plan draft introduced by Arne Duncan - speaks to assessment

Evidence-Centered Assessment Design Mislevy -

Reference for the cube model - 

Game Based assessment model UnityAnswers -
FAQ on UnityAnswers -

Gerald Knezek-
Artificial Intelligence - who is looking at how humans aquire knowledge. The idea that you're not worth anything until you get to expert is the wrong model. Perfection of forms. 
Benefits of prototyping - iterative design process
How do we assess wisdom? How are we getting at this? 

1)  ISTE Panel at ISTE-  proposals due October 13th
Philadelphia  June 26- 29  Theme:  Unlocking Potential

List of hyperlinks/resources Thursday AM

  • This page --
  • Problems with the use of student test scores to evaluate teachers: 

Where can we get Gerald and Rhonda's presentation?

Contact information
Please place your contact information here: 

John Mergendoller -
Dina Rosen
Becky Fisher -
Denise Schmidt -
Mary Herring -
Pamela Redmond -
Leigh Graves Wolf -
John Lee - 
Daniel Tillman --
Shelby Marshall --
Scott DeWitt -
Rhonda Christensen  -

Suggestions for Karen from "the cloud" 
-How would she use her culture building experience at Apple to build the educational technology culture we need? 
access and bandwidth and connectability of any device including student owned
Ask her to change the Obama blueprint for ESEA to fund national networks like #NWP. Also, more tech; fewer bubble tests.