Lynch, T., & Ghergulescu, I. (2016). An Evaluation Framework for Adaptive and Intelligent Tutoring Systems (pp. 1385–1390). Presented at the E-Learn: World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education, Association for the Advancement of Computing in Education (AACE).
Evaluation frameworks for adaptive and intelligent tutoring systems have largely focused on their prediction power or user experience. However, neither subjective or objective method alone is enough to assess all the properties of any given system, including effectiveness, efficiency and accuracy. This paper proposes an evaluation framework as well as evaluation recommendations for adaptive and intelligent learning systems. The evaluation framework incorporates objective and subjective measures in terms of learning effectiveness, learning efficiency, system accuracy, satisfaction, ease of use and learner engagement.