This study aims to evaluate the usability of the augmented reality-based Evoke Education System (EES) to improve service operations in educational settings. The EES uses an animated character (Moe) to interact with children in a classroom by reproducing their teacher's movements and speech.

This study uses a quantitative approach for the system usability evaluation. The ESS was evaluated by 71 children aged 6–8 years old, from two primary schools. After interacting with the EES, they completed a system usability questionnaire and participated in a knowledge acquisition test.

The knowledge acquisition test undertaken on the initial day showed statistically significant improvements for children taught with the EES, compared to children taught through traditional teaching approaches. However, the retest nine days later was not statistically significant (as only one school participated) due to low power. This study used confirmatory factor analysis (CFA), resulting in the identification of five essential factors (likeability, interactiveness, retention, effectiveness/attractiveness and satisfaction) that contribute to the EES's usability. The comparison with existing literature shows that these factors are consistent with the definition of system usability provided by the International Organization for Standardization and current academic literature in this field.

The findings presented in this study are based on the data from only two schools. The research can be extended by involving children from a greater number of schools. Mixed methods and qualitative research approaches can be used for future research in this area to generalise the results.

This study proposes an innovative augmented reality-based education system to help teachers deliver their key messages to the children in a fun way that can potentially increase their knowledge retention.