Presentation from the PISA for Schools webinar on 19 November 2020. PISA for Schools: Item Analysis and Development project

1. Item Analysis and Development project

2. Why we are proposing the Item Analysis and Development project?
• Demand from partners in different countries:
• “Can we extract more information about students other than scores?”
• “How can we analyze item-level data? What can we obtain from it?”
• “Can the OECD support us on developing items for our national assessments/examinations?
1. Item-level data (how a student responded to an item) gives us insights on
the points with which students struggle.
2. Process of item development is a key activity to understand student proficiencies.
• Both “Item-level data analysis” and “item development”
leads us to better understanding of student proficiency levels.
• It will also provide insights for post assessment activities.

3. What is the Item Analysis and Development project?
• It is a capacity building project
• OECD to provide an opportunity to acquire practical skills on
item analysis and item development that enables participants to:
• administer scientific test development/management principles.
• perform deeper analysis of student data providing insights to improve practices and curricula.
• Participants to author new cognitive items (Mathematics, Reading, and Science)
under guides of OECD.
• OECD to provide learning materials during this project period,
and support participants of the project to achieve their assessment goals.
• Develop capacity through a peer learning process with all participants of this
international project.
• Mutual learning and experience exchange among participants.
• External expertise to work together with jointly with OECD and participants’ experts.

4. Continuous improvement cycle for item analysis and development
The project will run a continuous cycle of item analysis and development towards a better
understanding of student proficiency.
(results of the item analysis are reflected directly in the item development)
Item analysis;
Analyse into details of student
response data, and find points to
be examined in the next step.
Item development;
Make new items which provide
answers to the points raised in the
previous item analysis step.
Data collection (PBTS);
Collect student level response data
and accumulate evidence.

5. What will we do in the project?
• Produce and share learning materials to use during the project (and beyond!)

6. Item Analysis and Development project will
• provide participants with a capacity building opportunity to develop
item-level analysis and item development.
• lead participants to better understanding student performance
and their own large scale assessment/examinations.
Final comments
Thank you!
Expressions of interest are welcome for 2021
For more information please contact us:
PISAforSchools@oecd.org
tomoya.okubo@oecd.org