search

Advanced Search

Ariadne Pfad:

Inhalt

details

Title
PISA reading. Mode effects unveiled in short text responses
Authors
SourcePsychological test and assessment modeling 62 (2020) 1, S. 85-105 ZDB
Document  (1.317 KB) (formally and content revised edition)
License of the document In copyright
Keywords (German)
sub-discipline
Document typeArticle (journal)
ISSN2190-0493 ; 21900493
LanguageEnglish
Year of creation
review statusPeer-Reviewed
Abstract (English):Educational largescale assessments risk their temporal comparability when shifting from paper to computerbased assessment. A recent study showed how text responses have altered alongside PISA's mode change, indicating mode effects. Uncertainty remained, however, because it compared students from 2012 and 2015. We aimed at reproducing the findings in an experimental setting, in which n = 836 students answered PISA reading questions on computer, paper, or both. Text response features for information quantity and relevance were extracted automatically. Results show a comprehensive recovery of findings. Students incorporated more information into their text responses on computer than on paper, with some items being more affected than others. Regarding information relevance, we found less mode effect variance across items than the original study. Hints for a relationship between mode effect and gender across items could be reproduced. The study demonstrates the stability of linguistic feature extraction from text responses. (DIPF/Orig.)
other articles of this journal
Statistics
Checksums
Date of publication01.02.2021
CitationZehner, Fabian; Kroehne, Ulf; Hahnel, Carolin; Goldhammer, Frank: PISA reading. Mode effects unveiled in short text responses - In: Psychological test and assessment modeling 62 (2020) 1, S. 85-105 - URN: urn:nbn:de:0111-pedocs-203542 - DOI: 10.25656/01:20354
export files

share content at social platforms