Transfer learning of pre-trained transformers for covid-19 hoax detection in indonesian language

LH Suadaa, I Santoso… - IJCCS (Indonesian Journal …, 2021 - journal.ugm.ac.id
LH Suadaa, I Santoso, ATB Panjaitan
IJCCS (Indonesian Journal of Computing and Cybernetics Systems), 2021journal.ugm.ac.id
Nowadays, internet has become the most popular source of news. However, the validity of
the online news articles is difficult to assess, whether it is a fact or a hoax. Hoaxes related to
Covid-19 brought a problematic effect to human life. An accurate hoax detection system is
important to filter abundant information on the internet. In this research, a Covid-19 hoax
detection system was proposed by transfer learning of pre-trained transformer models. Fine-
tuned original pre-trained BERT, multilingual pre-trained mBERT, and monolingual pre …
Abstract
Nowadays, internet has become the most popular source of news. However, the validity of the online news articles is difficult to assess, whether it is a fact or a hoax. Hoaxes related to Covid-19 brought a problematic effect to human life. An accurate hoax detection system is important to filter abundant information on the internet. In this research, a Covid-19 hoax detection system was proposed by transfer learning of pre-trained transformer models. Fine-tuned original pre-trained BERT, multilingual pre-trained mBERT, and monolingual pre-trained IndoBERT were used to solve the classification task in the hoax detection system. Based on the experimental results, fine-tuned IndoBERT models trained on monolingual Indonesian corpus outperform fine-tuned original and multilingual BERT with uncased versions. However, the fine-tuned mBERT cased model trained on a larger corpus achieved the best performance.
journal.ugm.ac.id
以上显示的是最相近的搜索结果。 查看全部搜索结果