Developed by Suzanne White Brahmia, Alexis Olsho, Trevor I. Smith, Andrew Boudreaux, Philip Eaton, and Charlotte Zimmerman
To assess quantitative literacy over the span of students’ instruction in introductory physics.
|Format||Pre/post, Multiple-choice, Multiple-response|
|Focus||Scientific reasoning (proportional reasoning, reasoning with signed quantities, co-variational reasoning)|
This is the highest level of research validation, corresponding to all seven of the validation categories below.
Research Validation Summary
Based on Research Into:
- Student thinking
- Student interviews
- Expert review
- Appropriate statistical analysis
- At multiple institutions
- By multiple research groups
- Peer-reviewed publication
The multiple-choice questions on the PIQL were developed based on a bank of questions from previous work of some of the authors, items from mathematics education research, including some from the Precalculus Concept Assessment and some questions were newly developed by the authors. The questions were reviewed by experts and tested in student interviews, and revised. The PIQL was iteratively given as a pre- and post-test to introductory physics students over 8 terms, and revised. Statistical analysis of difficulty, discrimination and reliability were performed, and reasonable results found. A confirmatory factor analysis was performed to confirm the three-factor structure of the test (ratios and proportions, covariation, and signed quantities/negativity). The developers did not find evidence for this three factor structure, and followed up with an exploratory factor analysis, where they found a unidimensional structure. The PIQL has been given to over 2000 students at two institutions and the results are published in one peer-reviewed paper.
We don't have any translations of this assessment yet.
If you know of a translation that we don't have yet, or if you would like to translate this assessment, please contact us!
Login or register to download the answer key and an excel scoring and analysis tool for this assessment.
Figure 7 from Brahmia et al. 2021. Three snapshots of PIQL results in introductory course sequence: before mechanics “PreMech”, after mechanics but before electricity & magnetism “PostMech”, and after electricity & magnetism but before thermodynamics and waves “PostEM”. The data in Fig. 7 combine all four administrations of PIQL v2.2, including 2,758 data sets and 2,078 individuals. A one-way analysis of variance showed no significant difference between the four academic terms, F (3, 2754) = 1.6, p = 0.2. The PreMech mean and standard deviation are 9.6 ± 3.7 out of 20. Students’ PQL increases slightly with instruction, with mean scores 10.8 ± 4.3 for PostMech and 11.3 ± 4.5 for PostEM.
Coming soon: The PhysPort Assessment Data Explorer
Start learning more from your tests.
- Get 1-click statistics
- Compare to students like yours
- Get practical, personalized recommendations
The most recent version of the PIQL, released in 2021, is version 2.2.