TY - JOUR
T1 - Learning analytics at low cost
T2 - At-risk student prediction with clicker data and systematic proactive interventions
AU - Choi, Samuel P.M.
AU - Lam, S. S.
AU - LI, Kam Cheong
AU - Wong, Billy T.M.
N1 - Funding Information:
The work described in this paper was partially supported by a grant from the Research Grants Council of the Hong Kong Special Administrative Region, China (UGC/IDS16/15).
Publisher Copyright:
© 2018, International Forum of Educational Technology and Society.
PY - 2018
Y1 - 2018
N2 - While learning analytics (LA) practices have been shown to be practical and effective, most of them require a huge amount of data and effort. This paper reports a case study which demonstrates the feasibility of practising LA at a low cost for instructors to identify at-risk students in an undergraduate business quantitative methods course. Instead of using tracking data from a learning management system as predictive variables, this study utilised clicker responses as formative assessments, together with student demographic data and summative assessments. This LA practice makes use of free cloud services, Google Forms and Google Sheets in particular for collecting and analysing clicker data. Despite a small dataset being used, the LA implementation was effective in identifying at-risk students at an early stage. A systematic proactive advising approach is proposed as an intervention strategy based on students' at-risk probability estimated by a prediction model. The result shows that the intervention success rate increases correspondingly with the number of interventions and the intervention effects on peer groups are far more successful than on individual students. Overall, the students' pass rate in the study was 7% higher than that for the whole course. Practical recommendations and concerns about using linear regression and logistic regression for classification are also discussed.
AB - While learning analytics (LA) practices have been shown to be practical and effective, most of them require a huge amount of data and effort. This paper reports a case study which demonstrates the feasibility of practising LA at a low cost for instructors to identify at-risk students in an undergraduate business quantitative methods course. Instead of using tracking data from a learning management system as predictive variables, this study utilised clicker responses as formative assessments, together with student demographic data and summative assessments. This LA practice makes use of free cloud services, Google Forms and Google Sheets in particular for collecting and analysing clicker data. Despite a small dataset being used, the LA implementation was effective in identifying at-risk students at an early stage. A systematic proactive advising approach is proposed as an intervention strategy based on students' at-risk probability estimated by a prediction model. The result shows that the intervention success rate increases correspondingly with the number of interventions and the intervention effects on peer groups are far more successful than on individual students. Overall, the students' pass rate in the study was 7% higher than that for the whole course. Practical recommendations and concerns about using linear regression and logistic regression for classification are also discussed.
KW - At-risk students
KW - Classroom response system
KW - Clicker
KW - Intervention
KW - Learning analytics
UR - http://www.scopus.com/inward/record.url?scp=85046071561&partnerID=8YFLogxK
M3 - Article
AN - SCOPUS:85046071561
SN - 1176-3647
VL - 21
SP - 273
EP - 290
JO - Educational Technology and Society
JF - Educational Technology and Society
IS - 2
ER -