Energy Concept Assessment (ECA)

Developed by Lin Ding

Purpose To measure to what extent specific implementations of the Matter & Interactions curriculum succeed in teaching students central energy concepts.
Format Pre/post, Multiple-choice
Duration 30-60 min
Focus Mechanics Content knowledge (energy principle, forms of energy, work and heat, absorption/emission spectrum, specifying appropriate systems)
Level Intro college
Login or Register to Download Downloads are restricted to high school and college faculty.

Sample questions from the ECA:



ECA Implementation and Troubleshooting Guide

Everything you need to know about implementing the ECA in your class.

Login or register to download the implementation guide.

L. Ding, Designing an Energy Assessment to Evaluate Student Understanding of Energy Topics, Ph.D., North Carolina State University, 2007.
RESEARCH VALIDATION
Silver Validation
This is the second highest level of research validation, corresponding to at least 5 of the validation categories below.

Research Validation Summary

Based on Research Into:

  • Student thinking

Studied Using:

  • Student interviews
  • Expert review
  • Appropriate statistical analysis

Research Conducted:

  • At multiple institutions
  • By multiple research groups
  • Peer-reviewed publication

The multiple-choice questions on the ECA were developed using test objectives that described the goals of the M&I course and expert review of the test objectives. Many of the multiple-choice options come from students’ ideas. The test questions were reviewed by experts and student interviews were conducted to ensure students were interpreting the questions correctly. Appropriate statistical analyses of reliability, difficulty and discrimination were conducted and reasonable values found for each. Questions were classified according to the revised Blooms taxonomy, and most were found to require application. A factor analysis found two factors: the first groups questions about the energy principle and basic forms of energy, the second includes questions about the graphical representation of gravitational/kinetic energy of a closed system. The ECA has been used with over 300 students at several institutions. There is one peer-reviewed publication presenting ECA data.

References

We don't have any translations of this assessment yet.

If you know of a translation that we don't have yet, or if you would like to translate this assessment, please contact us!

Login or register to download the answer key and an excel scoring and analysis tool for this assessment.


Typical Results

Typical scores on the ECA from Ding 2007:

The Energy Concept Assessment was developed specifically to test the understanding of students before and after instruction in a Matter and Interactions (M&I) physics course. M&I is a course for freshmen in physics that teaches a small number of fundamental principles and how to apply them in many different settings. Students in these courses typically perform only marginally better than random guessing on the pretest with an average score of 27.9% ± 8.3%. This likely means that many of these ideas are unfamiliar to incoming students.  However, students' post-test scores showed a marked improvement, with an average of 49.7% ± 12.1%. Undergraduate physics TAs, senior physics students, and physics graduate students perform better, with average scores of 61.1%, 58.2%, and 73.0%, respectively.

Further, the normalized gain for the M&I students in a first semester introductory course was 30.7% +/- 17.0% (std. dev.). 


Coming soon: The PhysPort Assessment Data Explorer

Start learning more from your tests.

  • Get 1-click statistics
  • Compare to students like yours
  • Get practical, personalized recommendations

Learn more!

The latest version of the ECA, released in 2007, is version 1. There was also a pilot version, which according to Ding, "... is not meant to be a readily usable assessment tool."

Related Teaching Method

Matter and Interactions