An application of classification models to predict learner progression in tertiary education

Gray, G and McGuinness, C and Owende, P (2014) An application of classification models to predict learner progression in tertiary education. [Conference Proceedings]

Full text not available from this resource.
Official URL:


This paper reports on an application of classification models to identify college students at risk of failing in the first year of study. Data was gathered from three student cohorts in the academic years 2010 through 2012. Students within the cohorts were sampled from a range of academic disciplines (n=1074), and were diverse in their academic backgrounds and abilities. Metrics used included data that are typically available to colleges such as age, gender and prior academic performance. The study also considered psychometric indicators that can be assessed in the early stages after enrolment, specifically, personality, motivation and learning strategies. Six classification algorithms were considered. Model accuracy was assessed using cross validation and was compared to outcomes when models were applied to a subsequent academic year. It was found that mature students were more complex to model than younger students. Furthermore, 10-fold cross validation accurately estimated model performance when modeling younger students only, but over-estimated model accuracy when modeling mature students. © 2014 IEEE.

Item Type: Conference Proceedings
Additional Information: Conference code: 104621; Cited By :2; Export Date: 23 February 2015; References: (2012),, retention completion summary tables Tech Rep., 2012Mooney, O., Patterson, V., O'connor, M., Chantler, A., (2010) A Study of Progression in Higher Education: A Report by the Higher Education Authority, , Higher Education Authority, Ireland, Tech. Rep., October; (2013),, Education at a glance 2013, Higher education key facts ad figures 2011-12 January 2013Mislevy, R.J., Behrens, J.T., Dicerbo, K.E., Design and discovery in educational assessment: Evidence-centered design, psychometrics, and educational data mining (2012) Journal of Educational Data Mining, 4 (1), pp. 11-48; Moran, M.A., Crowley, M.J., The leaving certificate and first year university performance (1979) Journal of Statistical and Social Enquiry in Ireland, 24 (PART 1), pp. 231-266; Lent, R.W., Brown, S.D., Hackett, Toward a unifying social cognitive theory of career and academic interest, choice, and performance (1994) Journal of Vocational Behaviour, 45; Farsides, T., Woodfield, R., Individual differences and undergraduate academic success: The roles of personality, intelligence, and application (2003) Personality and Individual Differences, 34, pp. 1225-1243; Hembree, R., Correlates, causes, effects, and treatment of test anxiety (1988) Review of Education Research, 58, pp. 47-77; Cassidy, S., Exploring individual differences as determining factors in student academic achievement in higher education (2011) Studies in Higher Education, pp. 1-18; Nandagopal, K., Anders Ericsson, K., An expert performance approach to the study of individual differences in self-regulated learning activities in upper-level college students (2012) Learning and Individual Differences; Komarraju, M., Nadler, D., Self-efficacy and academic achievement. Why do implicit beliefs, goals, and effort regulation matter (2013) Learning and Individual Differences; Pardos, Z.A., Baker, R.S.J.D., Gowda, S.M., Heffernan, N.T., The sum is greater than the parts: Ensembling models of student knowledge in educational software (2011) SIGKDD Explorations, 13 (2); Barahate, S.R., Shelake, M., Vijay, A survey and future vision of data mining in educational field (2012) Second International Conference on Advanced Computing and Communication Technologies; Siemens, G., Baker, R.S.J.D., Learning analytics and educational data mining. Towards communication and collaboration (2012) Proceedings of the 2nd International Conference on Learning Analytics and Knowledge, pp. 252-254; Siemens, G., Learning analytics envisioning a research discipline and a domain of practice (2012) Proceedings of the 2nd International Conference on Learning Analytics and Knowledge, pp. 4-8; Chatti, M.A., Dychhoff, A.L., Schroeder, U., Thüs, H., A reference model for learning analytics (2012) International Journal of Technology Enhanced Learning. Special Issue on State of the Art in TEL; Schmitt, N., Oswald, F.L., Pleskac, T., Sinha, R., Zorzie, M., Prediction of four-year college student performance using cognitive and noncognitive predictors and the impact on demographic status of admitted students (2009) Journal of Applied Psychology; Flanagan, D.P., McGrew, K.S., Interpreting intelligence tests from contemporary gf-gc theory: Joint confirmatory factor analysis of the wj-r and kait in a non-white sample (1998) Journal of School Psychology, 36 (2), pp. 151-182; Sternberg, R., Intelligence as developing expertise (1999) Contemporary Educational Psychology, 24, pp. 359-375; Robbins, S.B., Lauver, K., Le, H., Davis, D., Langley, R., Do psychosocial and study skill factors predict college outcomes a meta analysis (2004) Psychological Bulletin, 130 (2), pp. 261-288; Goldberg, L.R., The development of markers for the big-five factor structure (1992) Psychological Assessment, 4 (1), pp. 26-42; Swanberg, A.B., Martinsen, O.L., Personality, approaches to learning and achievement (2010) Educational Psychology, 30 (1), pp. 75-88; Chamorro-Premuzic, T., Furnham, A., Personality, intelligence and approaches to learning as predictors of academic performance (2008) Personality and Individual Differences, 44, pp. 1596-1603; Kappe, R., Van Der Flier, H., Using multiple and specific criteria to assess the predictive validity of the big five personality factors on academic performance (2010) Journal of Research in Personality, 44, pp. 142-145; Kaufman, J.C., Agars, M.D., Lopez-Wagner, M.C., The role of personality and motivation in predicting early college academic success in non-traditional students at a hispanic-serving institution (2008) Learning and Individual Differences, 18, pp. 492-496; Diseth, Á., Self-efficacy, goal orientations and learning strategies as mediators between preceding and subsequent academic achievement (2011) Learning and Individual Differences, 21, pp. 191-195; Sins, P.H.M., Van Joolingen, W.R., Savelsbergh, E.R., Van Hout-Wolters, B., Motivation and performance within a collaborative computerbased modeling task: Relations between students' achievement goal orientation, self-efficacy, cognitive processing, and achievement (2008) Contemporary Educational Psychology, 33, pp. 58-77; Ning, H.K., Downing, K., The reciprocal relationship between motivation and self-regulation: A longitudinal study on academic performance (2010) Learning and Individual Differences, 20, pp. 682-686; Nasiriyan, A., Azar, H.K., Noruzy, A., Dalvand, M.R., A model of self-efficacy, task value, achievement goals, effort and mathematics achievement (2011) International Journal of Academic Research, 3 (2); Volet, S.E., Cognitive and affective variables in academic learning: The significance or direction and effort in students' goals (1996) Learning and Instruction, 7 (3), pp. 235-254; Bidjerano, T., Dai, D.Y., The relationship between the big-five model of personality and self-regulated learning strategies (2007) Learning and Individual Differences, 17, pp. 69-81;, ITB mission statementLance, C.E., Butts, M.M., Michels, L.C., The sources of four commonly reported cutoff criteria (2006) Organisational Research Methods, 9 (2), pp. 202-220; Cortina, J.M., What is coefficient alpha an examination of theory and applications (1993) American Psychological Association, 78 (1), pp. 98-104; Spector, P.E., (1992) Summated Rating Scale Construction. An Introduction, , ser. Sage University Papers Series. Quantitice Applications in the Social Sciences, 07-082. Sage Publications, Inc; Cooper, A.J., Smillie, L.D., Corr, P.J., A confirmatory factor analysis of the mini-ipip five-factor model personality scale (2010) Personality and Individual Differences, 48; Tavakol, M., Dennick, R., Making sense of cronbachs alpha (2011) International Journal of Medical Education; Duffin, D., Gray, G., Using ict to enable inclusive teaching practices in higher education (2009) AAATE, , Florence, Sept; Pintrich, P., Smith, D., Garcia, T., McKeachie, W., (1991) A Manual for the Use of the Motivated Strategies for Learning Questionnaire, , The Regents of the University of Michigan, Technical Report 91-B-004; Biggs, J., Kember, D., Leung, D., The revised two-factor study process questionnaire: R-spq-2f (2001) British Journal of Education Psychology, 71, pp. 133-149; O'leary, S., Lund, M., Ytre-Hauge, T.J., Holm, S.R., Naess, K., Dalland, L.N., McPhail, S.M., Pitfalls in the use of kappa when interpreting agreement between multiple raters in reliability studies Physiotherapy, (0). ,; Kundel, H.L., Polansky, M., Measurement of observer agreement (2003) Radiology, 228 (2), pp. 303-308; Gray, G., McGuinness, C., Owende, P., An investigation of psychometric measures for modelling academic performance in tertiary education (2013) Sixth International Conference on Educational Data Mining; Ng, A.Y., Jordon, M.I., On discriminative vs generative classifiers. a comparison of lofigistic regression and naive bayes (2001) NIPS, pp. 841-848; Tan, P.-N., Steinbach, M., Kumar, V., (2006) Introduction to Data Mining, , Boston, MA: Pearson Education, Inc
Uncontrolled Keywords: academic performance; classification; cross validation; educational data mining; learning styles; model evaluation; motivation; personality; self-regulated learning; Classification (of information); Data mining; Education computing; Mathematical models; Learning Style; Students
Depositing User: National Forum
Date Deposited: 08 Dec 2015 21:14
Last Modified: 08 Dec 2015 21:14

Actions (login required)

View Item View Item


Downloads per month over past year