Detailanzeige
Aufsatz (Zeitschrift) zugänglich unter
URN: urn:nbn:de:0111-pedocs-149795
DOI: 10.25656/01:14979; 10.1177/0013164415590022
URN: urn:nbn:de:0111-pedocs-149795
DOI: 10.25656/01:14979; 10.1177/0013164415590022
Titel |
Automatic coding of short text responses via clustering in educational assessment |
---|---|
Autoren | Zehner, Fabian; Sälzer, Christine ; Goldhammer, Frank |
Originalveröffentlichung | Educational and psychological measurement 76 (2016) 2, S. 280-303 |
Dokument | Volltext (602 KB) |
Lizenz des Dokumentes | Deutsches Urheberrecht |
Schlagwörter (Deutsch) | Antwort; Automatisierung; Codierung; Computerlinguistik; Leistungstest; Methode; PISA <Programme for International Student Assessment>; Software; Technologiebasiertes Testen; Testkonstruktion |
Teildisziplin | Empirische Bildungsforschung |
Dokumentart | Aufsatz (Zeitschrift) |
Sprache | Englisch |
Erscheinungsjahr | 2016 |
Begutachtungsstatus | Peer-Review |
Abstract (Englisch): | Automatic coding of short text responses opens new doors in assessment. We implemented and integrated baseline methods of natural language processing and statistical modelling by means of software components that are available under open licenses. The accuracy of automatic text coding is demonstrated by using data collected in the Programme for International Student Assessment (PISA) 2012 in Germany. Free text responses of 10 items with Formula responses in total were analyzed. We further examined the effect of different methods, parameter values, and sample sizes on performance of the implemented system. The system reached fair to good up to excellent agreement with human codings Formula Especially items that are solved by naming specific semantic concepts appeared properly coded. The system performed equally well with Formula and somewhat poorer but still acceptable down to Formula Based on our findings, we discuss potential innovations for assessment that are enabled by automatic coding of short text responses. (DIPF/Orig.) |
Statistik | Anzahl der Zugriffe auf dieses Dokument |
Prüfsummen | Prüfsummenvergleich als Unversehrtheitsnachweis |
Eintrag erfolgte am | 16.03.2018 |
Quellenangabe | Zehner, Fabian; Sälzer, Christine; Goldhammer, Frank: Automatic coding of short text responses via clustering in educational assessment - In: Educational and psychological measurement 76 (2016) 2, S. 280-303 - URN: urn:nbn:de:0111-pedocs-149795 - DOI: 10.25656/01:14979; 10.1177/0013164415590022 |