Download full text
(899.8Kb)
Citation Suggestion
Please use the following Persistent Identifier (PID) to cite this document:
https://nbn-resolving.org/urn:nbn:de:0168-ssoar-85084-7
Exports for your reference manager
Combining Clickstream Analyses and Graph-Modeled Data Clustering for Identifying Common Response Processes
[journal article]
Abstract Complex interactive test items are becoming more widely used in assessments. Being computer-administered, assessments using interactive items allow logging time-stamped action sequences. These sequences pose a rich source of information that may facilitate investigating how examinees approach an ite... view more
Complex interactive test items are becoming more widely used in assessments. Being computer-administered, assessments using interactive items allow logging time-stamped action sequences. These sequences pose a rich source of information that may facilitate investigating how examinees approach an item and arrive at their given response. There is a rich body of research leveraging action sequence data for investigating examinees’ behavior. However, the associated timing data have been considered mainly on the item-level, if at all. Considering timing data on the action-level in addition to action sequences, however, has vast potential to support a more fine-grained assessment of examinees’ behavior. We provide an approach that jointly considers action sequences and action-level times for identifying common response processes. In doing so, we integrate tools from clickstream analyses and graph-modeled data clustering with psychometrics. In our approach, we (a) provide similarity measures that are based on both actions and the associated action-level timing data and (b) subsequently employ cluster edge deletion for identifying homogeneous, interpretable, well-separated groups of action patterns, each describing a common response process. Guidelines on how to apply the approach are provided. The approach and its utility are illustrated on a complex problem-solving item from PIAAC 2012.... view less
Keywords
response behavior; cluster analysis; assessment center; data; test evaluation
Classification
Methods and Techniques of Data Collection and Data Analysis, Statistical Methods, Computer Methods
Free Keywords
action sequences; response times; complex problem solving; cluster editing; PIAAC 2012
Document language
English
Publication Year
2021
Page/Pages
p. 190-214
Journal
Psychometrika, 86 (2021) 1
Issue topic
Special Issue on Network Psychometrics in Action
DOI
https://doi.org/10.1007/s11336-020-09743-0
ISSN
1860-0980
Status
Published Version; peer reviewed