Journals / Konya Journal of Engineering Sciences / 2022 / Cilt: 10 Sayı: 3

ADVANCED TURKISH FAKE NEWS PREDICTION WITH BIDIRECTIONAL ENCODER REPRESENTATIONS FROM TRANSFORMERS

Çift Yönlü Transformatör Kodlayıcı Temsilleriyle Gelişmiş Türkçe Sahte Haber Tahmini

Pages
750–761
Publication Date
2022-09-01
DOI
—
🏛️Bibliographic metadata and full text access for this article are provided via DergiPark.
DergiPark Record ↗
✨

AI Summary & Key Takeaways

AI Insight
⚡ TL;DR(Too Long; Didn't Read)

And we obtained 99.90 % accuracy in fake news identification which is a highly efficient model without substantial language pre-processing tasks.

📌 3 Key Takeaways

🎯
Objective & Hypothesis:The increasing usage of social media and internet generates a significant amount of information to be analyzed from various perspectives.
📊
Key Findings & Data:In particular, fake news is defined as the false news that is presented as factual news.
💡
Conclusion & Impact:And we obtained 99.90 % accuracy in fake news identification which is a highly efficient model without substantial language pre-processing tasks.
🔬Design:Modeling & Simulation
📍Scope:Comprehensive Sample
⚙️Variables:Makina öğrenmesi · Metin madenciliği · Çift yönlü transformatör kodlayıcı temsilleri (BERT)

Abstract

The increasing usage of social media and internet generates a significant amount of information to be analyzed from various perspectives. In particular, fake news is defined as the false news that is presented as factual news. Fake news are in general fabricated toward a manipulation aim. Fake news identification is in general a natural language analysis problem and machine learning algorithms are emerged as automated predictors. Well-known machine learning algorithms such as Naïve Bayes (NB) and Random Forest (RF) are successfully used for fake-news identification problem. Turkish is a morphologically rich language and it has agglutinative complexity that requires dense language pre-processing steps and feature selection. Recent neural language models such as Bidirectional Encoder Representations from Transformers (BERT) proposes an opportunity for Turkish-like morphologically rich languages a relatively straightforward pipeline in the solution of natural language problems. In this work, we compared NB, RF, Support Vector Machine (SVM), Naïve Bayes Multinomial (NBM) and Logistics Regression (LR) on top of correlation based feature selection and newly proposed Turkish-BERT (BERTurk) to identify Turkish fake news. And we obtained 99.90 % accuracy in fake news identification which is a highly efficient model without substantial language pre-processing tasks.

Özet

Sosyal medya ve internetin artan kullanımı, çeşitli açılardan analiz edilmesi gereken önemli miktarda bilgi üretmektedir. Bu bağlamda yalan haber, gerçek haber olarak sunulan asılsız haber olarak tanımlanmaktadır. Sahte haberler genellikle bir manipülasyon amacına yönelik olarak üretilir. Sahte haber tespiti, genel olarak bir doğal dil analiz problemidir ve otomatik tahmin ediciler olarak makine öğrenmesi algoritmaları kullanılmaktadır. Naïve Bayes ve Rastgele Orman gibi iyi bilinen makine öğrenme algoritmaları, sahte haber tanımlama sorunu için başarıyla kullanılmaktadır. Türkçe morfolojik olarak zengin bir dildir ve yoğun dil ön işleme adımları ve özellik seçimi gerektiren sondan eklemeli karmaşıklığa sahiptir. Transformer olarak bilinen Çift Yönlü Kodlayıcı Temsilleri (BERT) gibi son zamanlardaki sinirsel dil modelleri, Türkçe benzeri morfolojik olarak zengin diller için doğal dil problemlerinin çözümünde nispeten basit bir metot fırsatı sunmaktadır. Bu çalışmada, NB, RF, Destek Vektör Makinesi, Naïve Bayes Multinomial ve Lojistik Regresyon ile korelasyon tabanlı öznitelik seçimi ve yeni önerilen Türkçe-BERT (BERTurk) ile Türkçe yalan haberlerini tespit etmek için karşılaştırdık. Ön işleme adımları olmaksızın BERTurk ile sahte haber tanımlamada %99,90 doğruluk elde ettik.

🔖

Cite This Article

BOZUYLA, M. (2022). ADVANCED TURKISH FAKE NEWS PREDICTION WITH BIDIRECTIONAL ENCODER REPRESENTATIONS FROM TRANSFORMERS. Konya Journal of Engineering Sciences, Cilt: 10 Sayı: 3, 750–761. https://ajindex.com/articles/908985

📄 Full Text PDF Viewer

📄

PDF görüntüleyici hazırlanıyor...

References (8)

  1. Al-Yahya, M., Al-Khalifa, H., Al-Baity, H., Alsaeed, D., & Essam, A., 2021, "Arabic Fake News Detection: Comparative Study of Neural Networks and Transformer-Based Approaches", Complexity. Alim, A. A. A., Ayman, A., Praveen, K. D., & Myung, S. C., 2021, "Detecting Fake News using Machine Learning: A Systematic Literature Review", ArXiv Preprint ArXiv:2102.04458. Amjad, M., Sidorov, G., Zhila, A., Gelbukh, A., & Rosso, P., 2021, "Overview of the shared task on fake news detection in urdu at FIRE 2020",
  2. CEUR Workshop Proceedings. Bozuyla, M., & Özçift, A., 2022, "Developing a fake news identification model with advanced deep language transformers for Turkish COVID-19 misinformation data", Turkish Journal of Electrical Engineering & Computer Sciences, 30(3), 908–926.
  3. Conroy, N. J., Rubin, V. L., & Chen, Y., 2015, "Automatic deception detection: Methods for finding fake news", Proceedings of the Association for Information Science and Technology, 52(1), 1–4. D’Ulizia, A., Caschera, M. C., Ferri, F., & Grifoni, P., 2021, "Fake news detection: A survey of evaluation datasets", PeerJ Computer Science, 1–34. https://doi.org/10.7717/PEERJ-CS.518
  4. Dadgar, S. M. H., Araghi, M. S., & Farahani, M. M., 2016, "A novel text mining approach based on TF-IDF and support vector machine for news classification", 2016 IEEE International Conference on Engineering and Technology (ICETECH), 112–116.
  5. Dağli, İ., & Öztürk, A., 2021, "Görüntü Sınıflandırmada Derin Öğrenme Yöntemlerinin Karşılaştırılması", Konya Mühendislik Bilimleri Dergisi, 9(4), 872–888.
  6. Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K., 2019, "BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding", ArXiv Preprint ArXiv: 1810.04805v2, 4171–4186.
  7. Flynn, D. J., Nyhan, B., & Reifler, J., 2017, "The Nature and Origins of Misperceptions: Understanding False and Unsupported Beliefs About Politics", Political Psychology, 38, 127–150.
  8. Genç, Ş., & Surer, E., 2021, "ClickbaitTR: Dataset for clickbait detection from Turkish news sites and social media with a comparative analysis via machine learning algorithms", Journal of Information Science, 1–20, https://doi.org/10.1177/01655515211007746. Github, 2021, GitHub - sfkcvk/TurkishFakeNewsDataset: This is the reporsitory of Turkish fake news dataset which consists of Zaytung posts and Hurriyet news articles. Jahanbakhsh-Nagadeh, Z., Feizi-Derakhshi, M. R., & Sharifi, A., 2020, "A semi-supervised model for Persian rumor verification based on content info