A cognitive level evaluation method based on machine learning approach and Bloom of taxonomy for online assessments

Abstract

Adaptive online learning can be realized through the evaluation of the learning process. Monitoring and supervising learners’ cognitive levels and adjusting learning strategies can increasingly improve the quality of online learning. This analysis is made possible by real-time measurement of learners’ cognitive levels during the online learning process. However, most of the currently used techniques for evaluating cognitive levels rely on labour-intensive and time-consuming manual coding. In this study, we explore the machine learning (ML) algorithms and taxonomy of Bloom’s cognitive levels to explore features that affect learner’s cognitive level in online assessments and the ability to automatically predict learner’s cognitive level and thus, come up with a recommendation or pedagogical intervention to improve learner’s acquisition. The analysis of 15,182 learners’ assessments of a specific learning concept affirms the effectiveness of our approach. We attain an accuracy of 82.21% using ML algorithms. These results are very encouraging and have implications for how automated cognitive-level analysis tools for online learning will be developed in the future.