The Role of Learning Analytics in Evaluating Course Effectiveness

This study aims to examine the use of learning analytics in course evaluation within higher education institutions, in order to identify effective methodologies and best practices for leveraging data to improve educational effectiveness. Following the PRISMA guidelines, a systematic literature search was conducted in Scopus, yielding 34 relevant studies published between 2015 and 2024 for analysis. The results reveal six key categories of learning analytics applications: sentiment analysis, questionnaire analysis, engagement analysis, topic classification, predictive modelling, and performance analysis. The data sources for learning analytics applications primarily include questionnaires and learning management systems. While descriptive analysis was found to be the most commonly employed analytical technique, advanced techniques such as machine learning, artificial intelligence, and social network analysis are becoming more prominent. The studies addressed a wide range of elements associated with course evaluation, including course design, content quality, assignments, instructional strategies, workload, feedback mechanisms, and the integration of technology. These findings highlight the importance of adopting holistic approaches to capture the multifaceted nature of student experiences. This study also uncovers major limitations in the existing research, such as small sample sizes, potential biases due to the use of survey-based methods, and challenges in generalising findings across disciplines. These insights underscore the need for further research to enhance the methodologies used in course evaluations. This study contributes to advancing learning analytics practices and emphasises the importance of innovative approaches for evaluating and improving course effectiveness.