08 January 2024 | Halyna Padalko, Vasil Chomko, Dmytro Chumachenko
This study presents a novel approach to fake news classification using LSTM-based deep learning models. The research focuses on developing and evaluating two models: a bidirectional LSTM (BiLSTM) and an attention-based BiLSTM. These models are designed to capture the complexities and nuances of language characteristic of fake news, thereby enhancing the accuracy and efficiency of fake news classification. The models were trained on an 80% subset of the WELFake dataset and tested on the remaining 20%. The evaluation metrics included Recall, Precision, F1-Score, Accuracy, and Loss. The attention-based BiLSTM model demonstrated superior performance, achieving an accuracy of 97.66% and outperforming other models in terms of key metrics. The study highlights the potential of integrating advanced deep learning techniques in fake news detection. The proposed models set new standards in the field, offering effective tools for combating misinformation. Limitations such as data dependency, potential for overfitting, and language and context specificity were acknowledged. The research underscores the importance of leveraging cutting-edge deep learning methodologies, particularly attention mechanisms, in fake news identification. The innovative models presented pave the way for more robust solutions to counter misinformation, thereby preserving the veracity of digital information. Future research should focus on enhancing data diversity, model efficiency, and applicability across various languages and contexts. The study also analyzed the bi-grams and tri-grams of the dataset, revealing patterns and trends in the language used in fake and real news. The results indicate that the attention-based BiLSTM model is highly effective in detecting fake news, with a high precision and recall, making it a promising tool for fake news classification.This study presents a novel approach to fake news classification using LSTM-based deep learning models. The research focuses on developing and evaluating two models: a bidirectional LSTM (BiLSTM) and an attention-based BiLSTM. These models are designed to capture the complexities and nuances of language characteristic of fake news, thereby enhancing the accuracy and efficiency of fake news classification. The models were trained on an 80% subset of the WELFake dataset and tested on the remaining 20%. The evaluation metrics included Recall, Precision, F1-Score, Accuracy, and Loss. The attention-based BiLSTM model demonstrated superior performance, achieving an accuracy of 97.66% and outperforming other models in terms of key metrics. The study highlights the potential of integrating advanced deep learning techniques in fake news detection. The proposed models set new standards in the field, offering effective tools for combating misinformation. Limitations such as data dependency, potential for overfitting, and language and context specificity were acknowledged. The research underscores the importance of leveraging cutting-edge deep learning methodologies, particularly attention mechanisms, in fake news identification. The innovative models presented pave the way for more robust solutions to counter misinformation, thereby preserving the veracity of digital information. Future research should focus on enhancing data diversity, model efficiency, and applicability across various languages and contexts. The study also analyzed the bi-grams and tri-grams of the dataset, revealing patterns and trends in the language used in fake and real news. The results indicate that the attention-based BiLSTM model is highly effective in detecting fake news, with a high precision and recall, making it a promising tool for fake news classification.