Sentiment Analysis With Transformers Applied to Education: Systematic Review.

Authors

  • Anabel Pilicita Garrido Universidad Politécnica de Madrid.
  • Enrique Barra Universidad Politécnica de Madrid.

DOI:

https://doi.org/10.9781/ijimai.2025.02.008

Keywords:

Artificial Intelligence, Natural Language Processing, Sentiment Analysis in Education, Transformers, Systematic Review
Supporting Agencies
The authors would like to acknowledge the support of the FUN4DATE (PID2022-136684OB-C22) project funded by the Spanish Agencia Estatal de Investigación (AEI) 10.13039/501100011033.

Abstract

Sentiment analysis, empowered by artificial intelligence, can play a critical role in assessing the impact of cultural factors on the advancement of Open Science and artificial intelligence. Additionally, it can offer valuable insights into the open data gathered within educational contexts. This article presents a systematic review of the use of Transformers models in sentiment analysis in education. A systematic review approach was used to analyze 41 articles from recognized digital databases. The results of the review provide a comprehensive understanding of previous research related to the use of Transformers models in education for the task of sentiment analysis, their benefits, challenges, as well as future areas of research that can lay the foundation for a more sustainable and effective education system.

Downloads

Download data is not yet available.

References

T. Nasukawa and J. Yi, “Sentiment analysis: capturing favorability using natural language processing,” in Proceedings of the 2nd International Conference on Knowledge Capture, in K-CAP ’03. New York, NY, USA: Association for Computing Machinery, 2003, pp. 70–77. doi: 10.1145/945645.945658.

Z. Nanli, Z. Ping, L. Weiguo, and C. Meng, “Sentiment analysis: A literature review,” in 2012 International Symposium on Management of Technology (ISMOT), 2012, pp. 572–576. doi: 10.1109/ISMOT.2012.6679538.

H. Ruiz Martín, Aprendiendo a aprender: Mejora tu capacidad de aprender descubriendo cómo aprende tu cerebro, Vergara. 2020.

T. Shaik, X. Tao, C. Dann, H. Xie, Y. Li, and L. Galligan, “Sentiment analysis and opinion mining on educational data: A survey,” Natural Language Processing Journal, vol. 2, p. 100003, 2023, doi: https://doi.org/10.1016/j.nlp.2022.100003.

Z. Han, J. Wu, C. Huang, Q. Huang, and M. Zhao, “A review on sentiment discovery and analysis of educational big‐data,” Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, vol. 10, Jul. 11, 2019. doi: 10.1002/widm.1328.

C. Yan, J. Liu, W. Liu, and X. Liu, “Sentiment Analysis and Topic Mining Using a Novel Deep Attention-Based Parallel Dual-Channel Model for Online Course Reviews,” Cognitive Computation, vol. 15, no. 1, pp. 304–322, 2023. doi: 10.1007/s12559-022-10083-7.

B. Du, “Research on the factors influencing the learner satisfaction of MOOCs,” Education and Information Technologies, vol. 28, no. 2, pp. 1935–1955, 2023. doi: 10.1007/s10639-022-11269-0.

J. Vansina, “Oral Tradition as History,” University of Wisconsin Press, pp. 0–258, 1985.

J.-B. Michel et al., “Quantitative Analysis of Culture Using Millions of Digitized Books,” Science, vol. 331, no. 6014, pp. 176–182, Jan. 14, 2011. doi: 10.1126/science.1199644.

Costa Albert et al., “Your Morals Depend on Language,” PLoS ONE, vol. 9, no. 4, Public Library of Science, pp. 1–7, Aug. 2014. doi: 10.1371/journal.pone.0094842.

R. J. Lennox, D. Veríssimo, W. M. Twardek, C. R. Davis, and I. Jarić, “Sentiment analysis as a measure of conservation culture in scientific literature,” Conservation Biology, vol. 34, no. 2, pp. 462–471, 2020, doi: https://doi.org/10.1111/cobi.13404.

Ravi. Vatrapu, “Cultural Considerations in Computer Supported Collaborative Learning,” Research and Practice in Technology Enhanced Learning, vol. 03, no. 02, pp. 159–201, Jul. 2008. doi: 10.1142/S1793206808000501.

A. Vaswani et al., “Attention is All you Need,” in Advances in Neural Information Processing Systems, I. Guyon, U. Von Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett, Eds., Curran Associates, Inc., 2017.

M. Mansoori, H. Maliwal, S. Kotian, H. Kenkre, I. Saha, and P. Mishra, “A Systematic Survey on Computational agents for Mental Health Aid,” in 2022 IEEE 7th International conference for Convergence in Technology (I2CT), 2022, pp. 1–7. doi: 10.1109/I2CT54291.2022.9824269.

E. Oghu, E. Ogbuju, T. Abiodun, and F. Oladipo, “A Review of Sentiment Analysis Approaches for Quality Assurance in Teaching and Learning,” Bulletin of Social Informatics Theory and Application, vol. 6, no. 2, pp. 177–188, Jan. 2023, doi: https://doi.org/10.31763/businta.v6i2.581.

T. Shaik, X. Tao, C. Dann, H. Xie, Y. Li, and L. Galligan, “Sentiment analysis and opinion mining on educational data: A survey,” Natural Language Processing Journal, vol. 2, p. 100003, 2023, doi: https://doi.org/10.1016/j.nlp.2022.100003.

S. Saeedi, “Socially Aware Natural Language Processing with Commonsense Reasoning and Fairness in Intelligent Systems,” Western Michigan University, 2023.

P. P. Dakle et al., “Ner4Opt: Named Entity Recognition for Optimization Modelling from Natural Language,” in Integration of Constraint Programming, Artificial Intelligence, and Operations Research: 20th International Conference, Berlin, Heidelberg: Springer-Verlag, 2023, pp. 299–319. doi: 10.1007/978-3-031-33271-5_20.

T. Firoozi, H. Mohammadi, and M. J. Gierl, “Using Active Learning Methods to Strategically Select Essays for Automated Scoring,” Educational Measurement: Issues and Practice, vol. 42, no. 1, pp. 34–43, Dec. 2022, doi: 10.1111/emip.12537.

S. Prabhu, K. Akhila, and S. S, “A Hybrid Approach Towards Automated Essay Evaluation based on Bert and Feature Engineering,” in 2022 IEEE 7th International conference for Convergence in Technology (I2CT), 2022, pp. 1–4. doi: 10.1109/I2CT54291.2022.9824999.

M. A. Sayeed and D. Gupta, “Automate Descriptive Answer Grading using Reference based Models,” in 2022 OITS International Conference on Information Technology (OCIT), 2022, pp. 262–267. doi: 10.1109/OCIT56763.2022.00057.

E. Andersson, “Methods for increasing cohesion in automatically extracted summaries of Swedish news articles : Using and extending multilingual sentence transformers in the data-processing stage of training BERT models for extractive text summarization,” Linköping University, Department of Computer and Information Science, 2022.

L. Mo et al., “Incorporating Sentimental Trend into Gated Mechanism Based Transformer Network for Story Ending Generation,” Neurocomputing, vol. 453, Jan. 2021, doi: 10.1016/j.neucom.2021.01.040.

A. Singh and G. Josan, “Paraphrase Generation: A Review from RNN to Transformer based Approaches,” International Journal of Next-Generation Computing, Apr. 2022, doi: 10.47164/ijngc.v13i1.377.

I. Cid Rico and J. Pascual Espada, “Pretrained transformers models for extracting keywords in educational texts.” Accessed: Aug. 25, 2024. [Online]. Available: https://ssrn.com/abstract=4442925

M. U. Demirezen, O. Yilmaz, and E. Ince, “New models developed for detection of misconceptions in physics with artificial intelligence,” Neural Computing and Applications, vol. 35, no. 12, pp. 9225–9251, 2023. doi: 10.1007/s00521-023-08414-2.

B. Ahmed, M. Saad, and E. A. Refaee, “QQATeam at Qur’an QA 2022: Fine-Tunning Arabic QA Models for Qur’an QA Task,” in Proceedinsg of the 5th Workshop on Open-Source Arabic Corpora and Processing Tools with Shared Tasks on Qur’an QA and Fine-Grained Hate Speech Detection, Marseille, France: European Language Resources Association, Jun. 2022, pp. 130–135. Accessed: Aug. 25, 2024. [Online]. Available: https://aclanthology.org/2022.osact-1.16

A. Coenen et al., “Visualizing and measuring the geometry of BERT,” in Proceedings of the 33rd International Conference on Neural Information Processing Systems, Red Hook, NY, USA: Curran Associates Inc., 2019.

J. Chun, “SentimentArcs: A Novel Method for Self-Supervised Sentiment Analysis of Time Series Shows SOTA Transformers Can Struggle Finding Narrative Arcs,” ArXiv, 2021. Accessed: Feb. 03, 2025. [Online]. Available: https://doi.org/10.48550/arXiv.2110.09454

A. Nagarajan, S. Sen, J. R. Stevens, and A. Raghunathan, “Specialized Transformers: Faster, Smaller and more Accurate NLP Models,” in International Conference on Learning Representations, 2022. [Online]. Available: https://openreview.net/forum?id=aUoV6qhY_e

P. Bai, Y. Xia, and Y. Xia, “Fusing Knowledge and Aspect Sentiment for Explainable Recommendation,” IEEE Access, vol. 8, pp. 137150–137160, 2020, doi: 10.1109/ACCESS.2020.3012347.

Q. Dong, T. Sun, Y. Xu, X. Xu, M. Zhong, and K. Yan, “Network Public Opinion Sentiment Analysis based on Bert Model,” in 2022 IEEE 10th International Conference on Information, Communication and Networks (ICICN), 2022, pp. 662–666. doi: 10.1109/ICICN56848.2022.10006589.

P. Ekman et al., “Universals and cultural differences in the judgments of facial expressions of emotion,” Journal of Personality and Social Psychology, vol. 53, no. 4, pp. 712–717, 1987. doi: 10.1037/0022-3514.53.4.712.

C. E. Izard, D. Z. Libero, P. Putnam, and O. M. Haynes, “Stability of emotion experiences and their relations to traits of personality.,” Journal of Personality and Social Psychology, vol. 64, no. 5, pp. 847–860, 1993. doi: 10.1037/0022-3514.64.5.847.

O. Bruna, H. Avetisyan, and J. Holub, “Emotion models for textual emotion classification,” Journal of Physics: Conference Series, vol. 772, p. 012063, Nov. 2016. doi: 10.1088/1742-6596/772/1/012063.

J. Devlin, M. W. Chang, K. Lee, and K. Toutanova, “BERT: Pre-training of deep bidirectional transformers for language understanding,” in Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies - Proceedings of the Conference, Association for Computational Linguistics (ACL), 2019, pp. 4171–4186.

Y. Liu et al., “RoBERTa: A Robustly Optimized BERT Pretraining Approach,” in International Conference on Learning Representations, Jul. 2019. [Online]. Available: http://arxiv.org/abs/1907.11692

Z. Lan, M. Chen, S. Goodman, K. Gimpel, P. Sharma, and R. Soricut, “ALBERT: A Lite BERT for Self-supervised Learning of Language Representations,” in International Conference on Learning Representations, Sep. 2019. doi: 10.48550/arxiv.1909.11942.

Z. Yang, Z. Dai, Y. Yang, J. Carbonell, R. Salakhutdinov, and Q. V. Le, “XLNet: Generalized Autoregressive Pretraining for Language Understanding,” in Proceedings of the 33rd International Conference on Neural Information Processing Systems, Jun. 2019. [Online]. Available: http://arxiv.org/abs/1906.08237

V. Sanh, L. Debut, J. Chaumond, and T. Wolf, “DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter,” ArXiv, Oct. 02, 2019. Accessed: Jan. 20, 2024. [Online]. Available: http://arxiv.org/abs/1910.01108

N. Kitaev, Ł. Kaiser, and A. Levskaya, “Reformer: The Efficient Transformer,” in International Conference on Learning Representations, 2020. Accessed: Aug. 25, 2024. [Online]. Available: https://arxiv.org/abs/2001.04451

P. Budzianowski and I. Vulić, “Hello, It’s GPT-2 – How Can I Help You? Towards the Use of Pretrained Language Models for Task-Oriented Dialogue Systems,” in Proceedings of the 3rd Workshop on Neural Generation and Translation, 2019, pp. 15–22. doi: 10.18653/v1/D19-5602.

T. B. Brown et al., “Language Models are Few-Shot Learners,” in Advances in Neural Information Processing Systems, 2020, pp. 1877–1901. [Online]. Available: https://proceedings.neurips.cc/paper_files/paper/2020/file/1457c0d6bfcb4967418bfb8ac142f64a-Paper.pdf

G. Yenduri, B. R. Rajakumar, K. Praghash, and D. Binu, “Heuristic-Assisted BERT for Twitter Sentiment Analysis,” in International Journal of Computational Intelligence and Applications, 2021. doi: 10.1142/S1469026821500152.

X. Gong, W. Ying, S. Zhong, and S. Gong, “Text Sentiment Analysis Based on Transformer and Augmentation,” Frontiers in Psychology, vol. 13, Sep. 2022. doi: 10.3389/fpsyg.2022.906061.

N. Pahari and K. Shimada, “Multi-Task Learning Using BERT With Soft Parameter Sharing Between Layers,” in International Conference on Soft Computing and Intelligent Systems , 2022, pp. 1–6. doi: 10.1109/SCISISIS55246.2022.10001943.

S. Zanwar, D. Wiechmann, Y. Qiao, and E. Kerz, “Improving the Generalizability of Text-Based Emotion Detection by Leveraging Transformers with Psycholinguistic Features,” in Proceedings of the Fifth Workshop on Natural Language Processing and Computational Social Science, 2022, pp. 1–13. doi: 10.18653/v1/2022.nlpcss-1.1.

J. Shen, X. Liao, and Z. Tao, “Sentence-level sentiment analysis via BERT and BiGRU,” in 2019 International Conference on Image and Video Processing, and Artificial Intelligence, R. Su, Ed., in Society of Photo-Optical Instrumentation Engineers (SPIE) Conference Series, vol. 11321. Nov. 2019, p. 113212S. doi: 10.1117/12.2550215.

S. Mol and P. S. Sreeja, “FNDNLSTM: Fake News Detection on Social Media Using Deep Learning (DL) Techniques,” in New Opportunities for Sentiment Analysis and Information Processing, 2021, pp. 218–232. doi: 10.4018/978-1-7998-8061-5.ch012.

P. N. Begen and L. Vidiasova, “Development of an Algorithm for Fixing the Citizens’ Assessments of Digital Transformation Processes Based on Text Analysis,” in Proceedings of the 15th International Conference on Theory and Practice of Electronic Governance, in ICEGOV ’22. New York, NY, USA: Association for Computing Machinery, 2022, pp. 585–587. doi: 10.1145/3560107.3560203.

S. Li, W. Deng, and J. Hu, “Momentum Distillation Improves Multimodal Sentiment Analysis,” in Pattern Recognition and Computer Vision, S. Yu, Z. Zhang, P. C. Yuen, J. Han, T. Tan, Y. Guo, J. Lai, and J. Zhang, Eds., Cham: Springer International Publishing, 2022, pp. 423–435.

L. Bacco, A. Cimino, F. Dell’Orletta, and M. Merone, “Extractive Summarization for Explainable Sentiment Analysis using Transformers,” in Sixth International Workshop on Explainable Sentiment Mining and Emotion detection, 2021. [Online]. Available: https://openreview.net/forum?id=xB1deFXLaF9

X. Zhu, Y. Zhu, L. Zhang, and Y. Chen, “A BERT-based multi-semantic learning model with aspect-aware enhancement for aspect polarity classification,” Applied Intelligence, vol. 53, no. 4, pp. 4609–4623, Feb. 2023, doi: 10.1007/s10489-022-03702-1.

Z. Wu and D. C. Ong, “Context-Guided BERT for Targeted Aspect-Based Sentiment Analysis,” in Proceedings of the AAAI Conference on Artificial Intelligence, May 2021, pp. 14094–14102. doi: 10.1609/aaai.v35i16.17659.

J. Yang et al., “Multi-Applicable Text Classification Based on Deep Neural Network,” International Journal of Sensor Networks, vol. 40, no. 4, Inderscience Publishers, Geneva 15, CHE, pp. 277–286, Jan. 2022. doi: 10.1504/ijsnet.2022.127841.

Z. Yuan, W. Li, H. Xu, and W. Yu, “Transformer-Based Feature Reconstruction Network for Robust Multimodal Sentiment Analysis,” in Proceedings of the 29th ACM International Conference on Multimedia, in MM ’21. New York, NY, USA: Association for Computing Machinery, 2021, pp. 4400–4407. doi: 10.1145/3474085.3475585.

P. Howard et al., “Cross-Domain Aspect Extraction using Transformers Augmented with Knowledge Graphs,” in International Conference on Information and Knowledge Management, Proceedings, Association for Computing Machinery, Oct. 2022, pp. 780–790. doi: 10.1145/3511808.3557275.

C. Zhao, S. Wang, D. Li, X. Liu, X. Yang, and J. Liu, “Cross-Domain Sentiment Classification via Parameter Transferring and Attention Sharing Mechanism,” Information Sciences, vol. 578, no. C, Elsevier Science Inc., USA, pp. 281–296, Nov. 2021. doi: 10.1016/j.ins.2021.07.001.

J. Paul and A. R. Criado, “The art of writing literature review: What do we know and what do we need to know?,” International Business Review, vol. 29, no. 4, p. 101717, 2020, doi: https://doi.org/10.1016/j.ibusrev.2020.101717.

J. L. Callahan, “Writing Literature Reviews: A Reprise and Update,” Human Resource Development Review, vol. 13, no. 3, pp. 271–275, 2014, doi: 10.1177/1534484314536705.

M. Rodenes Adam, R. Salvador Vallés, G. I. Moncaleano Rodríguez, “E-learning: características y evaluación,” Ensayos de Economía, vol. 23, no. 43, pp. 143-160, 2013

Y. Zhou and M. Li, “Online Course Quality Evaluation Based on BERT,” in 2020 International Conference on Communications, Information System and Computer Engineering (CISCE), 2020, pp. 255–258. doi: 10.1109/CISCE50729.2020.00057.

C. Yan, J. Liu, W. Liu, and X. Liu, “Sentiment Analysis and Topic Mining Using a Novel Deep Attention-Based Parallel Dual-Channel Model for Online Course Reviews,” Cognitive Computation, vol. 15, no. 1, pp. 304–322, 2023, doi: 10.1007/s12559-022-10083-7.

D. Jatain, V. Singh, and N. Dahiya, “An exploration of the causal factors making an online course content popular & engaging,” International Journal of Information Management Data Insights, vol. 3, no. 2, p. 100194, 2023, doi: https://doi.org/10.1016/j.jjimei.2023.100194.

X. Li, H. Zhang, Y. Ouyang, X. Zhang, and W. Rong, “A Shallow BERT-CNN Model for Sentiment Analysis on MOOCs Comments,” in 2019 IEEE International Conference on Engineering, Technology and Education (TALE), 2019, pp. 1–6. doi: 10.1109/TALE48000.2019.9225993.

A. Koufakou, “Deep learning for opinion mining and topic classification of course reviews,” Education and Information Technologies, 2023. doi: 10.1007/s10639-023-11736-2.

H. Marfani, S. Hina, and H. Tabassum, “Analysis of Learners’ Sentiments on MOOC Forums using Natural Language Processing Techniques,” in 2022 3rd International Conference on Innovations in Computer Science & Software Engineering (ICONICS), 2022, pp. 1–8. doi: 10.1109/ICONICS56716.2022.10100401.

X. Pan, B. Hu, Z. Zhou, and X. Feng, “Are students happier the more they learn? – Research on the influence of course progress on academic emotion in online learning,” Interactive Learning Environments, pp. 1–21, 2022, doi: 10.1080/10494820.2022.2052110.

T. Liu, W. Hu, H. Guo, and Y. Li, “Sentiment Analysis of MOOC Reviews Based On Capsule Network,” in 2021 4th International Conference on Intelligent Autonomous Systems (ICoIAS), 2021, pp. 222–227. doi: 10.1109/ICoIAS53694.2021.00047.

L. Min, X. Miao, P. Bi, and F. He, “A Small amount of Labeled Data Chinese Online Course Review Target Extraction via ALBERT-IDCNN-CRF Model,” Journal of Physics: Conference Series, vol. 1651, no. 1, IOP Publishing, p. 012049, 2020. doi: 10.1088/1742-6596/1651/1/012049.

N. A. Khodeir, “Bi-GRU Urgent Classification for MOOC Discussion Forums Based on BERT,” IEEE Access, vol. 9, pp. 58243–58255, 2021, doi: 10.1109/ACCESS.2021.3072734.

S. Liu, S. Liu, Z. Liu, X. Peng, and Z. Yang, “Automated detection of emotional and cognitive engagement in MOOC discussions to predict learning achievement,” Computers & Education, vol. 181, p. 104461, 2022. doi: https://doi.org/10.1016/j.compedu.2022.104461.

Z. Liu, X. Kong, H. Chen, S. Liu, and Z. Yang, “MOOC-BERT: Automatically Identifying Learner Cognitive Presence From MOOC Discussion Data,” IEEE Transactions on Learning Technologies, vol. 16, no. 4, pp. 528–542, 2023, doi: 10.1109/TLT.2023.3240715.

Y. Qu, F. Li, L. Li, X. Dou, and H. Wang, “Can We Predict Student Performance Based on Tabular and Textual Data?,” IEEE Access, vol. 10, pp. 86008–86019, 2022, doi: 10.1109/ACCESS.2022.3198682.

N. Alkaabi, N. Zaki, H. Ismail, and M. Khan, “Detecting Emotions behind the Screen,” AI, vol. 3, no. 4, pp. 948–960, 2022, doi: 10.3390/ai3040056.

R. Sanchis-Font, M. J. Castro-Bleda, J.-Á. González, F. Pla, and L.-F. Hurtado, “Cross-Domain Polarity Models to Evaluate User eXperience in E-learning,” Neural Processing Letters, vol. 53, no. 5, pp. 3199–3215, 2021. doi: 10.1007/s11063-020-10260-5.

Y. Y. Dyulicheva, “Learning Analytics in MOOCs as an Instrument for Measuring Math Anxiety,” Voprosy Obrazovaniya Educational Studies Moscow, no. 4, pp. 132–147, 2021, doi: 10.17323/1814-9545-2021-4-243-265.

D. and T. D. and C. I. Nikolovski Vlatko and Kitanovski, “Case Study: Predicting Students Objectivity in Self-evaluation Responses Using Bert Single-Label and Multi-Label Fine-Tuned Deep-Learning Models,” in ICT Innovations 2020. Machine Learning and Applications, I. Dimitrova Vesna and Dimitrovski, Ed., Cham: Springer International Publishing, 2020, pp. 98–110.

B. Su and J. Peng, “Sentiment Analysis of Comment Texts on Online Courses Based on Hierarchical Attention Mechanism,” Applied Sciences, vol. 13, no. 7, 2023, doi: 10.3390/app13074204.

S. B. A. Prasad and R. P. K. Nakka, “Supervised Sentiment Analysis of Indirect Qualitative Student Feedback for Unbiased Opinion Mining,” Engineering Proceedings, vol. 59, no. 1, 2023, doi: 10.3390/engproc2023059015.

M. Alzaid and F. Fkih, “Sentiment Analysis of Students’ Feedback on E-Learning Using a Hybrid Fuzzy Model,” in Applied Sciences, 2023. doi: 10.3390/app132312956.

M. Y. Hameed, L. Al-Hindi, S. Ali, H. K. Jensen, and C. C. Shoults, “Broadening the Understanding of Medical Students’ Discussion of Radiology Online: A Social Listening Study of Reddit,” Current problems in diagnostic radiology, vol. 52, no. 5, p. 377—382, 2023. doi: 10.1067/j.cpradiol.2023.04.003.

R. Jyothsna, V. Rohini, and J. Paulose, “Sentiment Analysis of Stress Among the Students Amidst the Covid Pandemic Using Global Tweets,” in Ambient Intelligence in Health Care, T. Swarnkar, S. Patnaik, P. Mitra, S. Misra, and M. Mishra, Eds., Singapore: Springer Nature Singapore, 2023, pp. 317–324.

H. and Ö. O. and G. A. C. and K. B. and Ş. Ö. and A. F. P. Yldrm Elif and Yazgan, “Sentiment Analysis of Tweets on Online Education during COVID-19,” in Artificial Intelligence Applications and Innovations, L. and M. J. and D. M. Maglogiannis Ilias and Iliadis, Ed., Cham: Springer Nature Switzerland, 2023, pp. 240–251.

M. Mujahid et al., “Sentiment Analysis and Topic Modeling on Tweets about Online Education during COVID-19,” Applied Sciences, vol. 11, no. 18, 2021, doi: 10.3390/app11188438.

M. Zhou and H. Mou, “Tracking public opinion about online education over COVID-19 in China,” Educational Technology Research and Development, vol. 70, no. 3, pp. 1083–1104, Jun. 2022, doi: 10.1007/s11423-022-10080-5.

V. Duong, J. Luo, P. Pham, T. Yang, and Y. Wang, “The Ivory Tower Lost: How College Students Respond Differently than the General Public to the COVID-19 Pandemic,” in 2020 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM), 2020, pp. 126–130. doi: 10.1109/ASONAM49781.2020.9381379.

Y. Ren and X. Tan, “Research on the Method of Identifying Students’ Online Emotion Based on ALBERT,” in 2021 International Conference on Intelligent Computing, Automation and Applications (ICAA), 2021, pp. 646–650. doi: 10.1109/ICAA53760.2021.00118.

L. L. Maceda, A. A. Satuito, and M. B. Abisado, “Sentiment Analysis of Code-mixed Social Media Data on Philippine UAQTE using Fine-tuned mBERT Model,” International Journal of Advanced Computer Science and Applications, vol. 14, no. 7, 2023, doi: 10.14569/IJACSA.2023.0140777.

A. S. Mondal, Y. Zhu, K. K. Bhagat, and N. Giacaman, “Analysing user reviews of interactive educational apps: a sentiment analysis approach,” Interactive Learning Environments, vol. 32, no. 1, pp. 355-372, 2022, doi: 10.1080/10494820.2022.2086578.

S. Fouad and E. Alkooheji, “Sentiment Analysis for Women in STEM using Twitter and Transfer Learning Models,” in Proceedings - 17th IEEE International Conference on Semantic Computing, ICSC 2023, Institute of Electrical and Electronics Engineers Inc., 2023, pp. 227–234. doi: 10.1109/ICSC56153.2023.00045.

C. Álvarez-Álvarez and S. Falcon, “Students’ preferences with university teaching practices: analysis of testimonials with artificial intelligence,” Educational technology research and development, 2023, doi: 10.1007/s11423-023-10239-8.

Q. Qian and X. Chen, “A Multi-Modal Convolutional Neural Network Model for Intelligent Analysis of the Influence of Music Genres on Children’s Emotions,” Computational Intelligence and Neuroscience, vol. 2022, Jul. 2022. doi: 10.1155/2022/4957085.

M. Javaid, A. Haleem, R. P. Singh, S. Khan, and I. H. Khan, “Unlocking the opportunities through ChatGPT Tool towards ameliorating the education system,” BenchCouncil Transactions on Benchmarks, Standards and Evaluations, vol. 3, no. 2, p. 100115, 2023, doi: https://doi.org/10.1016/j.tbench.2023.100115.

M. Tubishat, F. Al-Obeidat, and A. Shuhaiber, “Sentiment Analysis of Using ChatGPT in Education,” in 2023 International Conference on Smart Applications, Communications and Networking (SmartNets), 2023, pp. 1–7. doi: 10.1109/SmartNets58706.2023.10215977.

L. Ding, “Online teaching emotion analysis based on GRU and nonlinear transformer algorithm,” PeerJ Computer Science, vol. 9, PeerJ Inc., 2023. doi: 10.7717/peerj-cs.1696.

A. Munshi et al., “Arabic Sentiment Analysis for Student Evaluation using Machine Learning and the AraBERT Transformer,” Engineering, Technology and Applied Science Research, vol. 13, no. 5, pp. 11945 – 11952, 2023, doi: 10.48084/etasr.6347.

C. Zhu, “Analysis of the Sentiment in the Evaluation Texts of University Students by Means of the Concept of Flexible Management,” International Journal of Emerging Technologies in Learning, vol. 18, no. 18, pp. 261–276, 2023, doi: 10.3991/ijet.v18i18.43505.

C.-Y. Chou and T.-Y. Chuang, “Aspect and Sentiment Classification Mechanisms of Student After-Class Self-Evaluated Comments: Investigation on Nonsense Data, Feature Extraction, and Classification Models,” Engineering Proceedings, vol. 38, no. 1, 2023, doi: 10.3390/engproc2023038043.

H. Setiawan, C. Fatichah, and A. Saikhu, “Multilabel Classification of Student Feedback Data Using BERT and Machine Learning Methods,” in 2023 14th International Conference on Information & Communication Technology and System (ICTS), 2023, pp. 147–152. doi: 10.1109/ICTS58770.2023.10330849.

D. Chowdary Attota and N. Dehbozorgi, “Towards Application of Speech Analysis in Predicting Learners’ Performance,” in 2022 IEEE Frontiers in Education Conference (FIE), 2022, pp. 1–5. doi: 10.1109/FIE56618.2022.9962701.

P. Gómez-Rey, E. Barbera, and F. Fernández-Navarro, “The impact of cultural dimensions on online learning,” Educational Technology & Society, vol. 19, pp. 225–238, Jan. 2016.

W. Jiang, “The relationship between culture and language,” ELT journal, vol. 54, no. 4, pp. 328–334, 2000.

M. M. Agüero-Torales, J. I. Abreu Salas, and A. G. López-Herrera, “Deep learning and multilingual sentiment analysis on social media data: An overview,” Applied Soft Computing, vol. 107, p. 107373, 2021. doi: https://doi.org/10.1016/j.asoc.2021.107373.

K. R. Mabokela, T. Celik, and M. Raborife, “Multilingual Sentiment Analysis for Under-Resourced Languages: A Systematic Review of the Landscape,” IEEE Access, vol. 11, pp. 15996–16020, 2023, doi: 10.1109/ACCESS.2022.3224136.

J. Deriu et al., “Leveraging Large Amounts of Weakly Supervised Data for Multi-Language Sentiment Classification,” in Proceedings of the 26th International Conference on World Wide, 2017. [Online]. Available: https://arxiv.org/abs/1703.02504

R. Shahini, H. Davis, and K. Borthwick, “Design recommendations to address cultural issues in multicultural MOOCs: a systematic literature review,” New educational landscapes: innovative perspectives in language learning and technology, pp. 55–66, 2019.

UNESCO, “UNESCO Recommendation on Open Science.” Accessed: Aug. 24, 2024. [Online]. Available: https://www.unesco.org/en/open-science/about

Downloads

Published

2025-03-01
Metrics
Views/Downloads
  • Abstract
    201
  • PDF
    212

How to Cite

Pilicita Garrido, A. and Barra, E. (2025). Sentiment Analysis With Transformers Applied to Education: Systematic Review. International Journal of Interactive Multimedia and Artificial Intelligence, 9(2), 72–83. https://doi.org/10.9781/ijimai.2025.02.008