This study examines the psychometric properties of a multiple-choice physics questionnaire using the framework of Classical Test Theory (CTT), with the aim of validating individual items and contributing to the development of a reliable item bank for research and assessment. The instrument was designed to investigate students’ conceptual understanding of fundamental physics topics and to identify common misconceptions or conceptual errors that may persist after formal instruction. The questionnaire is being developed within the T.I.M.E. project by Politecnico di Milano in collaboration with Doshisha University, Bauman Moscow State Technical University, and the University of Trento. The dataset includes responses from approximately 1,400 university students enrolled in engineering and science programs. This internationally diverse sample includes students from Italian, Japanese, and Russian institutions, enabling the analysis of response patterns across different educational contexts and exploring how prior schooling systems influence the persistence of physics misconceptions. Item analysis was conducted using standard CTT indicators, including item difficulty, discrimination indices, and distractor functioning. Particular attention was devoted to distractor performance to identify functional alternatives that capture specific incorrect reasoning patterns. Results indicate that ten of the twelve analyzed items include effective distractors and are well-constructed, while two items exhibit weak distractors that may require revision. These results represent a first step toward the construction of an updated international physics item bank, which could support both formative and summative assessment and enable comparative studies of physics learning across different educational systems.

Authors:
Andrea Fusari, Politecnico di Milano, Italy
Matteo Bozzi, Politecnico di Milano, Italy
Roberto Virzi, Politecnico di Milano, Italy
Marco Costigliolo, Politecnico di Milano, Italy
Gwenaëlle Guillerme, T.I.M.E. Association, France
Maurizio Zani, Politecnico di Milano, Italy

About the Presenter(s)
Andrea Fusari is a PhD candidate at Politecnico di Milano’s Physics Dept (ST2 group). A veteran physics teacher, he combines research and experience to significantly enhance physics learning across the entire educational spectrum.

Connect on Linkedin
https://www.linkedin.com/in/ andrea-fusari-6538a03b7

See this presentation on the full schedule – Thursday Schedule

Bookmark