Download full text
(2.075Mb)
Citation Suggestion
Please use the following Persistent Identifier (PID) to cite this document:
https://nbn-resolving.org/urn:nbn:de:0168-ssoar-84954-9
Exports for your reference manager
Process data, the new frontier for assessment development: rich new soil or a quixotic quest?
[journal article]
Abstract This paper presents the concepts and observations in the author's keynote address at the May 2019 "Opportunity versus Challenge: Exploring Usage of Log-File and Process Data in International Large-Scale Assessments" conference in Dublin, Ireland. This paper recaps briefly some key points that emerge... view more
This paper presents the concepts and observations in the author's keynote address at the May 2019 "Opportunity versus Challenge: Exploring Usage of Log-File and Process Data in International Large-Scale Assessments" conference in Dublin, Ireland. This paper recaps briefly some key points that emerged at the December 2018 ETS symposium on process data in Washington, DC, and suggests some common terminology and concepts for facilitating future meaningful discussion. It then borrows some concepts from evolutionary biologists to take a critical look at process data and some of its ethical implications before turning to discuss major applications for and challenges of using process data and logfiles. The second half of this paper then maps out the terrain in which process data emerges as a "byproduct" of the shift from paper-and-pencil testing to digital-based assessments (DBA) and looks closely at how process data interacts with the development and operationalization of assessment systems. This interaction suggests new, fresh ways of improving national and international assessment system processes, and ultimately the measurement of cognitive skills, while venturing into the new frontiers opened with process data.... view less
Keywords
process; data; product; evolution; data quality; cognitive factors; coding; measurement
Classification
Methods and Techniques of Data Collection and Data Analysis, Statistical Methods, Computer Methods
Interactive, electronic Media
Free Keywords
process data; logfiles; spandrels of San Marco; by-product; paper-based assessments (PBA); digital-based assessments (DBA); cognitive processes; high and low performers; paradata; inputs; outputs; forensic purposes; research purposes; performance measure; PIAAC
Document language
English
Publication Year
2021
Page/Pages
p. 1-17
Journal
Large-scale Assessments in Education, 9 (2021)
Issue topic
Exploring Usage of Log-File and Process Data in International Large-Scale Assessments
DOI
https://doi.org/10.1186/s40536-020-00092-z
ISSN
2196-0739
Status
Published Version; peer reviewed