Szczegóły publikacji

Opis bibliograficzny

Semi-supervised text annotation for hate speech detection using K-nearest neighbors and term frequency-inverse document frequency / Nur Heri Cahyana, Shoffan SAIFULLAH, Yuli Fauziah, Agus Sasmito Aribowo, Rafał DREŻEWSKI // International Journal of Advanced Computer Science and Applications (IJACSA) ; ISSN  2158-107X . — 2022 — vol. 13 no. 10, s. 147-151. — Bibliogr. s. 150-151, Abstr. — S. Saifullah - dod. afiliacja: Department of Informatics, Universitas Pembangunan Nasional Veteran Yogyakarta Yogyakarta, Indonesia

Autorzy (5)

Słowa kluczowe

kNNTF-IDFsemisupervised learningtext annotationnatural language processing

Dane bibliometryczne

ID BaDAP143653
Data dodania do BaDAP2022-11-21
Tekst źródłowyURL
DOI10.14569/IJACSA.2022.0131020
Rok publikacji2022
Typ publikacjiartykuł w czasopiśmie
Otwarty dostęptak
Creative Commons
Czasopismo/seriaInternational Journal of Advanced Computer Science and Applications

Abstract

Sentiment analysis can detect hate speech using the Natural Language Processing (NLP) concept. This process requires annotation of the text in the labeling. However, when carried out by people, this process must use experts in the field of hate speech, so there is no subjectivity. In addition, if processed by humans, it will take a long time and allow errors in the annotation process for extensive data. To solve this problem, we propose an automatic annotation process with the concept of semi-supervised learning using the K-Nearest Neighbor algorithm. This process requires feature extraction of term frequency-inverse document frequency (TF-IDF) to obtain optimal results. KNN and TF-IDF were able to annotate and increase the accuracy of < 2% from the initial iteration of 57.25% to 59.68% in detecting hate speech. This process can annotate the initial dataset of 13169 with the distribution of 80:20 of training and testing data. There are 2370 labeled datasets; for testing, there are 1317 unannotated data; after preprocessing, there are 9482. The final results of the KNN and TF-IDF annotation processes have a length of 11235 for annotated data.

Publikacje, które mogą Cię zainteresować

fragment książki
#154726Data dodania: 6.8.2024
Text annotation automation for hate speech detection using SVM-classifier based on feature extraction / Shoffan SAIFULLAH, Nur Heri Cahyana, Yuli Fauziah, Agus Sasmito Aribowo, Felix Andika DWIYANTO, Rafał DREŻEWSKI // W: ICSSET 2022 [Dokument elektroniczny] : 2nd International Conference Series on Science, Engineering, and Technology : 22 June 2022, Sidoarjo, Indonesia. — Wersja do Windows. — Dane tekstowe. — [Indonesia] : AIP Publishing, [2024]. — (AIP Conference Proceedings ; ISSN 0094-243X ; vol. 3167). — e-ISBN: 978-0-7354-5005-9. — S. 040003-1–040003-7. — Wymagania systemowe: Adobe Reader. — Bibliogr. s. 040003-5–040003-7, Abstr. — S. Saifullah - dod. afiliacja: University of Pembangunan Nasional Veteran Yogyakarta, Yogyakarta, Indonesia
artykuł
#151683Data dodania: 30.1.2024
Automated text annotation using a semi-supervised approach with meta vectorizer and machine learning algorithms for hate speech detection / Shoffan SAIFULLAH, Rafał DREŻEWSKI, Felix Andika DWIYANTO, Agus Sasmito Aribowo, Yuli Fauziah, Nur Heri Cahyana // Applied Sciences (Basel) [Dokument elektroniczny]. — Czasopismo elektroniczne ; ISSN 2076-3417. — 2024 — vol. 14 iss. 3 art. no. 1078, s. 1–19. — Wymagania systemowe: Adobe Reader. — Bibliogr. s. 17–19, Abstr. — Publikacja dostępna online od: 2024-01-26. — S. Saifullah - dod. afiliacja: Department of Informatics, Universitas Pembangunan Nasional Veteran Yogyakarta, Indonesia. — R. Dreżewski - dod. afiliacja: Artificial Intelligence Research Group (AIRG), Informatics Department, Faculty of Industrial Technology, Universitas Ahmad Dahlan, Indonesia. — F. A. Dwiyanto - dod. afiliacja: Department of Electrical Engineering, Universitas Negeri Malang, Malang, Indonesia