Szczegóły publikacji

Opis bibliograficzny

Semi-supervised text annotation for hate speech detection using K-nearest neighbors and term frequency-inverse document frequency / Nur Heri Cahyana, Shoffan SAIFULLAH, Yuli Fauziah, Agus Sasmito Aribowo, Rafał DREŻEWSKI // International Journal of Advanced Computer Science and Applications (IJACSA) ; ISSN 2158-107X. — 2022 — vol. 13 no. 10, s. 147-151. — Bibliogr. s. 150-151, Abstr. — S. Saifullah - dod. afiliacja: Department of Informatics, Universitas Pembangunan Nasional Veteran Yogyakarta Yogyakarta, Indonesia


Autorzy (5)


Słowa kluczowe

K-NNnatural language processingTF-IDFsemisupervised learningtext annotation

Dane bibliometryczne

ID BaDAP143653
Data dodania do BaDAP2022-11-21
Tekst źródłowyURL
DOI10.14569/IJACSA.2022.0131020
Rok publikacji2022
Typ publikacjiartykuł w czasopiśmie
Otwarty dostęptak
Creative Commons
Czasopismo/seriaInternational Journal of Advanced Computer Science and Applications

Abstract

Sentiment analysis can detect hate speech using the Natural Language Processing (NLP) concept. This process requires annotation of the text in the labeling. However, when carried out by people, this process must use experts in the field of hate speech, so there is no subjectivity. In addition, if processed by humans, it will take a long time and allow errors in the annotation process for extensive data. To solve this problem, we propose an automatic annotation process with the concept of semi-supervised learning using the K-Nearest Neighbor algorithm. This process requires feature extraction of term frequency-inverse document frequency (TF-IDF) to obtain optimal results. KNN and TF-IDF were able to annotate and increase the accuracy of < 2% from the initial iteration of 57.25% to 59.68% in detecting hate speech. This process can annotate the initial dataset of 13169 with the distribution of 80:20 of training and testing data. There are 2370 labeled datasets; for testing, there are 1317 unannotated data; after preprocessing, there are 9482. The final results of the KNN and TF-IDF annotation processes have a length of 11235 for annotated data.

Publikacje, które mogą Cię zainteresować

artykuł
Using components of corpus linguistics and annotation tools in sign language teaching / Katarzyna BARCZEWSKA, Jakub GAŁKA, Dorota SZULC, Mariusz MĄSIOR, Rafał SAMBORSKI, Tomasz J. WILCZYŃSKI // International Journal of Modern Education and Computer Science ; ISSN 2075-0161. — 2016 — vol. 8 no. 2, s. 14–21. — Bibliogr. s. 20–21, Abstr.
fragment książki
K-nearest neighbor in assesing trends of Cameroonians most attractive communal and cultural diversity cities in Poland based on Natural Language Processing and artificial intelligence / Pascal Muam MAH, Gilly Njoh Amuzang, Michael Blake Somaah Itoe, Ning Frida Tah // W: Proceedings of the 41st International Business Information Management Association computer science conference (IBIMA) [Dokument elektroniczny] : 26-27 June 2023, Granada, Spain : theory and practice in modern computing: from artificial intelligence to computer security / ed. Khalid S. Soliman. — Wersja do Windows. — Dane tekstowe. — [Norristown] : International Business Information Management Association (IBIMA), cop. 2023. — (Proceedings of the... International Business Information Management Association Conference ; ISSN 2767-9640). — e-ISBN: 979-8-9867719-2-2. — S. [1–11]. — Tryb dostępu: https://ibima.org/wp-content/uploads/2023/08/paper-4.pdf [2023-08-11]. — Bibliogr. s. [10–11], Abstr. — Toż. w: S. 30--40. --- https://s.agh.edu.pl/qhDo5