TLMOTE: A Topic-based Language Modelling Approach for Text Oversampling
DOI :
https://doi.org/10.32473/flairs.v35i.130676Mots-clés :
Text oversampling, TLMOTE, Language modelling, Topic modelling, Latent Dirichlet Allocation, Suggestion Mining, Sentiment analysis, SMS Spam detectionRésumé
Training machine learning and deep learning models on unbalanced datasets can lead to a bias portrayed by the models towards the majority classes. To tackle the problem of bias towards majority classes, researchers have presented various techniques to oversample the minority class data points. Most of the available state-of-the-art oversampling techniques generate artificial data points which cannot be comprehensibly understood by the reader, despite the synthetic data points generated being similar to the original minority class data points. In this work, we present Topic-based Language Modelling Approach for Text Oversampling (TLMOTE), a novel text oversampling technique for supervised learning from unbalanced datasets. TLMOTE improves upon previous approaches by generating data points which can be intelligibly understood by the reader, can relate to the main topics of the minority class, and introduces more variations to the synthetic data generated. We evaluate the efficacy of our approach on various tasks like Suggestion Mining SemEval 2019 Task 9 Subtasks A and B, SMS Spam Detection, and Sentiment Analysis. Experimental results verify that oversampling unbalanced datasets using TLMOTE yields a higher macro F1 score than with other oversampling techniques.
Téléchargements
Publié-e
Comment citer
Numéro
Rubrique
Licence
(c) Tous droits réservés Arjun Choudhry, Seba Susan, Anmol Bansal, Anubhav Sharma 2022
![Licence Creative Commons](http://i.creativecommons.org/l/by-nc/4.0/88x31.png)
Cette œuvre est sous licence Creative Commons Attribution - Pas d'Utilisation Commerciale 4.0 International.