Trends in game learning analytics: A systematic review of the specialized literature

Authors

DOI:

https://doi.org/10.31391/S2007-7033(2022)0058-006

Keywords:

Análise de aprendizagem de jogos, Validação, Projeto, Implementação, Revisão sistemática

Abstract

A systematic review of the specialized literature was carried out with the meta-synthesis method to know the theoretical and empirical trends that can be found in the scientific literature about game learning analytics. The search was carried out in 17 databases and 153 results were obtained. After applying certain exclusion criteria, 17 scientific research articles were admitted for analysis. The information was classified in design, validation, and implementation trends. The design findings suggest a tendency to simulate real environments to validate, not only serious play, but also the learning obtained by applying pre- and post-test measurements. A varied implementation was observed between educational purposes, training, or support for people with disabilities. Likewise, predesigned games and author's games with individual interactions were used.

Downloads

Download data is not yet available.

Author Biographies

Mayra Yadira Mejía Sierra, Autonomous University of Queretaro

Estudiante del doctorado en Tecnología Educativa en la Universidad Autónoma de Querétaro. Líneas de investigación: game learning analytics. 

Alexandro Escudero-Nahón, Autonomous University of Queretaro

Research professor at the Autonomous University of Querétaro, Mexico

Ricardo Chaparro Sánchez, Autonomous University of Queretaro

Doctor en Innovación en Tecnología Educativa. Profesor en la Universidad Autónoma de Querétaro. Líneas de investigación: políticas, calidad y técnicas en tecnología educativa.

References

Abt, C. C. (1987). Serious games. EUA: University Press of America.

Alonso-Fernández, C., Calvo-Morata, A., Freire, M., Martínez-Ortiz, I. & Fernández-Manjón, B. (2020a). Evidence-based evaluation of a serious game to increase bullying awareness. Interactive Learning Environments, vol. 28, núm. 1, pp. 1-11. https://doi.org/10.1080/10494820.2020.1799031

Alonso-Fernández, C., Martínez-Ortiz, I., Caballero, R., Freire, M. & Fernández-Manjón, B. (2020b). Predicting students’ knowledge after playing a serious game based on learning analytics data: A case study. Journal of Computer Assisted Learning, vol. 36, núm. 3, pp. 350-358. https://doi.org/10.1111/jcal.12405

Alonso-Fernández, C., Pérez-Colado, I. J., Calvo-Morata, A., Freire, M., Ortiz, I. M. & Manjón, B. F. (2020c). Applications of Simva to simplify serious games validation and deployment. Revista Iberoamericana de Tecnologías del Aprendizaje, vol. 15, núm. 3, pp. 161-170. https://doi.org/10.1109/RITA.2020.3008117

Alonso-Fernández, C., Cano, A. R., Calvo-Morata, A., Freire, M., Martínez-Ortiz, I. & Fernández-Manjón, B. (2019). Lessons learned applying learning analytics to assess serious games. Computers in Human Behavior, vol. 99, núm. 9, pp. 301-309. https://doi.org/10.1016/j.chb.2019.05.036

Barry, D. M., Ogawa, N., Dharmawansa, A., Kanematsu, H., Fukumura, Y., Shirai, T., Yajima, K. & Kobayashi, T. (2015). Evaluation for students’ learning manner using eye blinking system in Metaverse. Procedia Computer Science, vol. 60, pp. 1195-1204. https://doi.org/10.1016/j.procs.2015.08.181

Calvo-Morata, A., Alonso-Fernández, C., Freire-Morán, M., Martínez-Ortiz, I. & Fernández-Manjón, B. (2019). Game learning analytics, facilitating the use of serious games in the class. Revista Iberoamericana de Tecnologías del Aprendizaje, vol. 14, núm. 4, pp. 168-176. https://doi.org/10.1109/RITA.2019.2952296

Calvo-Morata, A., Rotaru, D. C., Alonso-Fernández, C., Freire-Morán, M., Martínez-Ortiz, I., Fernández-Manjón, B., Alonso-Fernandez, C., Freire-Moran, M., Martinez-Ortiz, I. & Fernandez-Manjon, B. (2020). Validation of a cyberbullying serious game using game analytics. IEEE Transactions on Learning Technologies, vol. 13, núm. 1, pp. 186-197. https://doi.org/10.1109/TLT.2018.2879354

Cano, A. R., Fernández-Manjón, B. & García-Tejedor, Á. J. (2018). Using game learning analytics for validating the design of a learning game for adults with intellectual disabilities. British Journal of Educational Technology, vol. 49, núm. 4, pp. 659-672. https://doi.org/10.1111/bjet.12632

Capatina, A., Bleoju, G., Rancati, E. & Hoareau, E. (2018). Tracking precursors of learning analytics over serious game team performance ranking. Behaviour & Information Technology, vol. 37, núm. 10-11, pp. 1008-1020. https://doi.org/10.1080/0144929X.2018.1474949

Charleer, S., Verbert, K., Gutiérrez, F. & Gerling, K. (2018). Towards an open standard for gameplay metrics. CHI PLAY 2018-Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts (pp. 399-406). https://doi.org/10.1145/3270316.3271529

Cloude, E. B., Dever, D. A., Wiedbusch, M. D. & Azevedo, R. (2020). Quantifying scientific thinking using multichannel data with crystal island: Implications for individualized game-learning analytics. Frontiers in Education, vol. 5 (november), pp. 1-21. https://doi.org/10.3389/feduc.2020.572546

De Gloria, A. & Hutchison, D. (2013). Games and learning alliance (A. De Gloria [ed.], vol. 41, núm. 1). https://doi.org/10.1007/978-3-319-12157-4

Freire, M., Serrano-Laguna, Á., Iglesias, B. M., Martínez-Ortiz, I., Moreno-Ger, P. & Fernández-Manjón, B. (2016). Game learning analytics: Learning analytics for serious games in learning, design, and technology. En M. J. Spector, B. B. Lockee & M. D. Childress [eds.]. Learning, design, and technology. Springer, Cham. https://doi.org/10.1007/978-3-319-17727-4

Grijalva, P. K., Cornejo, G. E., Gómez, R., Real, K. P., Fernández, A., Gomez, R. R., Real, K. P. & Fernandez, A. (2019). Herramientas colaborativas para revisiones sistemáticas. Revista Espacios, vol. 40, núm. 45, p. 9. https://www.revistaespacios.com/a19v40n25/a19v40n25p09.pdf

Guzmán, M. A., Escudero-Nahón, A. y Canchola-Magdaleno, S. L. (2020). “Gamificación” de la enseñanza para ciencia, tecnología, ingeniería y matemáticas: cartografía conceptual. Sinéctica, Revista Electrónica de Educación, núm. 54, pp. 1-20. https://doi.org/10.31391/S2007-7033(2020)0054-002

Hallinger, P., Wang, R., Chatpinyakoop, C., Nguyen, V.-T. & Nguyen, U.-P. (2020). A bibliometric review of research on simulations and serious games used in educating for sustainability, 1997-2019. Journal of Cleaner Production, vol. 256, 120358. https://doi.org/10.1016/j.jclepro.2020.120358

Kaivo-oja, J. (2017). Towards better participatory processes in technology foresight: How to link participatory foresight research to the methodological machinery of qualitative research and phenomenology? Futures, vol. 86, pp. 94-106. https://doi.org/10.1016/j.futures.2016.07.004

Kanematsu, H., Kobayashi, T., Barry, D. M., Fukumura, Y., Dharmawansa, A. & Ogawa, N. (2014). Virtual STEM Class for nuclear safety education in Metaverse. Procedia Computer Science, vol. 35, pp. 1255-1261. https://doi.org/10.1016/j.procs.2014.08.224

Kuksa, I. & Childs, M. (2014). 8-Virtual worlds in education. En I. Kuksa & M. Childs (eds.). Making Sense of Space (pp. 101-118). Chandos Publishing. https://doi.org/10.1533/9781780634067.3.101

Leary, H. & Walker, A. (2018). Meta-analysis and meta-synthesis methodologies: Rigorously piecing together research. TechTrends, vol. 62, núm. 5, pp. 525-534. https://doi.org/10.1007/s11528-018-0312-7

Lew, C. & Saville, A. (2021). Game-based learning: Teaching principles of economics and investment finance through Monopoly. The International Journal of Management Education, vol. 19, núm. 3, 100567. https://doi.org/10.1016/j.ijme.2021.100567

Melo, S. A., Paes, A., Clua, E. W. G., Kohwalter, T. C. & Murta, L. G. P. (2019). Detecting long-range cause-effect relationships in game provenance graphs with graph-based representation learning. Entertainment Computing, vol. 32 (enero), 100318. https://doi.org/10.1016/j.entcom.2019.100318

Michael, D. & Chen, S. (2005). Serious games: Games that educate, train, and inform. Muska & Lipman/Premier-Trade. https://doi.org/10.5555/1051239

Nguyen, A., Gardner, L. A. & Sheridan, D. (2018). A framework for applying learning analytics in serious games for people with intellectual disabilities. British Journal of Educational Technology, vol. 49, núm. 4, pp. 673-689. https://doi.org/10.1111/bjet.12625

Niemelä, M., Kärkkäinen, T., Äyrämö, S., Ronimus, M., Richardson, U. & Lyytinen, H. (2020). Game learning analytics for understanding reading skills in transparent writing system. British Journal of Educational Technology, vol. 51, núm. 6, pp. 2376-2390. https://doi.org/10.1111/bjet.12916

Peddycord-Liu, Z., Cody, C., Kessler, S., Barnes, T., Lynch, C. F. & Rutherford, T. (2017). Using serious game analytics to inform digital curricular sequencing: What math objective should students play next? Proceedings of the Annual Symposium on Computer-Human Interaction in Play (pp. 195-204). https://doi.org/10.1145/3116595.3116620

Rotaru, D. C., García-Herranz, S., Morán, M. F., Martínez-Ortiz, I., Fernández-Manjón, B. & Carmen Díaz, M. (2018). Using game technology to automatize neuropsychological tests and research in active aging. ACM International Conference Proceeding Series (pp. 65-70). https://doi.org/10.1145/3284869.3284887

Ruipérez-Valiente, J. A. & Kim, Y. J. (2020). Effects of solo vs. collaborative play in a digital learning game on geometry: Results from a K12 experiment. Computers and Education, vol. 159 (octubre), 104008. https://doi.org/10.1016/j.compedu.2020.104008

Sterne, J. A., Hernán, M. A., Reeves, B. C., Savović, J., Berkman, N. D., Viswanathan, M., Henry, D., Altman, D. G., Ansari, M. T., Boutron, I., Carpenter, J. R., Chan, A.-W., Churchill, R., Deeks, J. J., Hróbjartsson, A., Kirkham, J., Jüni, P., Loke, Y. K., Pigott, T. D. & Higgins, J. P. (2016). ROBINS-I: A tool for assessing risk of bias in non-randomised studies of interventions. BMJ, vol. 355, i4919. https://doi.org/10.1136/bmj.i4919

Tsikinas, S. & Xinogalos, S. (2020). Towards a serious games design framework for people with intellectual disability or autism spectrum disorder. Education and Information Technologies, vol. 25, núm. 4, pp. 3405-3423. https://doi.org/10.1007/s10639-020-10124-4

Xu, Y., Lau, Y., Cheng, L. J. & Lau, S. T. (2021). Learning experiences of game-based educational intervention in nursing students: A systematic mixed-studies review. Nurse Education Today, vol. 107, 105139. https://doi.org/10.1016/j.nedt.2021.105139

Zainuddin, Z., Chu, S. K. W., Shujahat, M. & Perera, C. J. (2020). The impact of gamification on learning and instruction: A systematic review of empirical evidence. Educational Research Review, vol. 30, 100326. https://doi.org/10.1016/j.edurev.2020.100326

Published

2022-02-12

Issue

Section

Essays (open section)