Download full text
(214.4Kb)
Citation Suggestion
Please use the following Persistent Identifier (PID) to cite this document:
https://doi.org/10.48541/dcr.v12.26
Exports for your reference manager
Dataset annotation in abusive language detection
[collection article]
This document is a part of the following document:
Challenges and perspectives of hate speech research
Abstract The last decade saw the rise of research in the area of hate speech and abusive language detection. A lot of research has been conducted, with further datasets being introduced and new models put forward. However, contrastive studies of the annotation of different datasets also revealed that some pr... view more
The last decade saw the rise of research in the area of hate speech and abusive language detection. A lot of research has been conducted, with further datasets being introduced and new models put forward. However, contrastive studies of the annotation of different datasets also revealed that some problematic issues remain. Theoretically ambiguous and misleading definitions between different studies make it more difficult to evaluate model reproducibility and generalizability and require additional steps for dataset standardization. To overcome these challenges, the field needs a common understanding of concepts and problems such that standard datasets and different compatible approaches can be developed, avoiding inefficient and redundant research. This article attempts to identify persistent challenges and develop guidelines to help future annotation tasks. Some of the challenges and guidelines identified and discussed in the article relate to concept subjectivity, focus on overt hate speech, dataset integrity and lack of ethical considerations.... view less
Keywords
data quality; content analysis; data; data preparation; communication research; language usage
Classification
Basic Research, General Concepts and History of the Science of Communication
Methods and Techniques of Data Collection and Data Analysis, Statistical Methods, Computer Methods
Free Keywords
dataset annotation; abusive language; hate speech
Collection Title
Challenges and perspectives of hate speech research
Editor
Strippel, Christian; Paasch-Colberg, Sünje; Emmer, Martin; Trebbe, Joachim
Document language
English
Publication Year
2023
City
Berlin
Page/Pages
p. 443-464
Series
Digital Communication Research, 12
ISSN
2198-7610
ISBN
978-3-945681-12-1
Status
Primary Publication; peer reviewed