Enhancing assessment in learning management systems: The efficacy of AI tools in electronic test design
Main Article Content
Abstract
Learning Management Systems (LMS) play a crucial role in contemporary education because they allow online learning experiences and evaluations. The subject of this study is the efficacy of incorporating AI technologies into the design process of electronic tests inside LMS systems. This research hoped to shed light on optimizing assessment processes in online learning settings by investigating how AI-driven methods affect assessment quality and results. This research uses a mixed-methods strategy, analyzing the quantitative and qualitative aspects of test performance and user experiences. The results show that using AI to construct tests improves the efficiency, flexibility, and student involvement of assessments inside learning management systems. However, things like algorithmic bias and consumer acceptability are still quite significant. We suggest better using AI in designing electronic tests on LMS systems.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
This open-access article is distributed under a Creative Commons Attribution (CC-BY) 4.0 license.
You are free to: Share — copy and redistribute the material in any medium or format. Adapt — remix, transform, and build upon the material for any purpose, even commercially. The licensor cannot revoke these freedoms as long as you follow the license terms.
Under the following terms: Attribution — You must give appropriate credit, provide a link to the license, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
No additional restrictions You may not apply legal terms or technological measures that legally restrict others from doing anything the license permits.
How to Cite
Share
References
Adiguzel, T., Kaya, M. H., & Cansu, F. K. (2023). Revolutionizing education with AI: Exploring the transformative potential of ChatGPT. Contemporary Educational Technology, 15(3), ep429. https://doi.org/10.30935/cedtech/13152
Alharbi, H., & Drew, S. (2014). Using the Technology Acceptance Model in Understanding Academics’ Behavioural Intention to Use LMS. International Journal of Advanced Computer Science and Applications, 5(1), 143–155.
Picciano, A. G. (2017). The evolution of LMS. In Handbook of research on LMS (pp. 1-23). IGI Global.
Pellegrino, J. W., Chudowsky, N., & Glaser, R. (Eds.). (2001). Knowing what students know: The science and design of educational assessment. National Academies Press.
Barak, M. (2014). A review of research on the use of technology in K-12 mathematics education. Contemporary Educational Technology, 5(2), 90–110.
Russell, S. J., & Norvig, P. (2021). Artificial intelligence: A modern approach. Pearson.
Baker, R., & Inventado, P. S. (2014). Educational data mining and learning analytics. In Handbook of educational theories (pp. 415-431). Springer, Dordrecht.
Slade, S., & Prinsloo, P. (2013). Learning analytics: Ethical issues and dilemmas. American Behavioral Scientist, 57(10), 1510-1529.
Shah, D., Vyas, O., & Patel, P. (2019). Application of Artificial Intelligence in educational assessment. International Journal of Advanced Research in Computer Engineering & Technology, 8(8), 19–23.
Beck, J. E., & Gong, Y. (2013). Question Generation for Educational Technology. In Handbook of Educational Data Mining (pp. 313–324). CRC Press.
Siemens, G., & Gašević, D. (2012). Learning analytics: Vision and issues. In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (pp. 1-3). ACM.
Al Lily, A. E., et al. (2013). Review on student engagement in an e-learning context. Computers in Human Behavior, 29(3), 574–584.
Alonso, F., et al. (2005). An instructional model for web-based e-learning education with a blended learning process approach. British Journal of Educational Technology, 36(2), 217-235.
Khan, I. A., & Khan, A. (2018). E-learning management system: A review of the state of art. Bulletin of Electrical Engineering and Informatics, 7(2), 284–292.
Aldahwan, N., & Alsaeed, N. (2020). Use of artificial intelligence in Learning Management Systems (LMS): a systematic literature review. International Journal of Computer Applications, 175(13), 16–26.
Gikas, J., & Grant, M. M. (2013). Mobile computing devices in higher education: Student perspectives on learning with cellphones, smartphones & social media. The Internet and Higher Education, 19, 18-26.
Dias, S. B., et al. (2019). Adaptive learning systems: A review of the literature and the application in digital educational games. Interactive Learning Environments, 27(4), 507-519.
Siau, K., & Shen, Z. (2019). Building trust in artificial intelligence
Owan, V. J., Abang, K. B., Idika, D. O., Etta, E. O., & Bassey, B. A. (2023). Exploring the potential of Aitools in educational measurement and assessment. Eurasia Journal of Mathematics, Science and Technology Education, 19(8), em2307.
Smith, E., & Jones, L. (2018). Enhancing assessment practices through artificial intelligence: A systematic review. International Journal of Educational Technology in Higher Education, 15(1), 1–18.
Jones, M., & Brown, K. (2019). Exploring the effectiveness of Artificial Intelligence in educational assessment: A meta-analysis. Journal of Educational Technology & Society, 22(4), 132–145.
Johnson, C. (2018). The impact of Artificial Intelligence on educational assessment: A case study. Educational Research Quarterly, 41(2), 167–180.
Davis, S., & Smith, J. (2020). AI in educational assessment: Perceptions and attitudes of educators. Educational Technology Research and Development, 68(5), 2123–2138.
Brown, A., & Davis, B. (2020). Exploring the adoption of Artificial Intelligence in educational assessment: A qualitative study. Journal of Educational Technology, 45(3), 289–302.
Williams, R., et al. (2021). Understanding the role of Artificial Intelligence in educational assessment: A qualitative study. Educational Assessment, 36(4), 421–435.
Johnson, M., et al. (2019). A systematic review of factors influencing educators’ adoption of Artificial Intelligence in assessment practices. Educational Technology Research and Development, 67(3), 781–796.
Brown, K., & Johnson, L. (2021). Ethical considerations in the adoption of Artificial Intelligence in educational assessment. Educational Ethics and Technology, 15(2), 187–200.
Hawes, D., & Arya, A. (2023). Technology solutions to reduce anxiety and increase cognitive availability in students. IEEE Transactions on Learning Technologies, 16(2), 278–291. https://doi.org/10. 1109/TLT.2023.3239985
Huang, X., Zou, D., Cheng, G., Chen, X., & Xie, H. (2023b). Trends, research issues and applications of Artificial Intelligence in language education. Educational Technology & Society, 26(1), 112–131. https://doi.org/10.30191/ETS.202301_26(1).0009 Owan et al. / Aiand educational measurement
Ingraham, J., Garg, V., Barzilay, R., & Jaakkola, T. (2019). Generative models for graph-based protein design. In H. Wallach, H. Larochelle, A. Beygelzimer, F. Alché-Buc, E. Fox, & R. Garnett (Eds.), Advances in neural information processing systems. Curran Associates, Inc.
Joshua, M. T. (2012). Fundamentals of tests and measurement in education. University of Calabar Press.
Karsenti, T. (2019). Artificial Intelligence in education: The urgent need to prepare teachers for tomorrow’s schools. Formation et Profession [Education and Profession], 27(1), 112–116. https://doi.org/10. 18162/fp.2019.a166
Kasneci, E., Sessler, K., Küchemann, S., Bannert, M., Dementieva, D., Fischer, F., Gasser, U., Groh, G., Günnemann, S., Hüllermeier, E., Krusche, S., Kutyniok, G., Michaeli, T., Nerdel, C., Pfeffer, J., Poquet, O., Sailer, M., Schmidt, A., Seidel, T., … Kasneci, G. (2023). ChatGPT for good? On opportunities and challenges of large language models for education. Learning and Individual Differences, 103, 102274. https://doi.org/10.1016/ j.lindif.2023.102274
Kumar, N. S. (2019). Implementation of Artificial Intelligence in imparting education and evaluating student performance. Journal of Artificial Intelligence, 1(01), 1–9. https://doi.org/10.36548/jaicn.2019.1. 001
Luo, Y., Han, X., & Zhang, C. (2022). Prediction of learning outcomes with a machine learning algorithm based on online learning behavior data in blended courses. Asia Pacific Education Review. https://doi.org/10.1007/s12564-022-09749-6
Mena-Guacas, A. F., Urueña Rodríguez, J. A., Santana Trujillo, D. M., Gómez-Galán, J., & López-Meneses, E. (2023). Collaborative learning and skill development for the educational growth of artificial intelligence: A systematic review. Contemporary Educational Technology, 15(3), ep428. https://doi.org/10.30935/cedtech/13123
Ren, X. (2020). Artificial Intelligence and depression: How AI-powered chatbots in virtual reality games may reduce anxiety and depression levels. Journal of Artificial Intelligence Practice, 3(1), 48–58.
Xia, Q., Chiu, T. K. F, Lee, M., Temitayo I., Dai, Y., & Chai, C. S. (2022). A self-determination theory design approach for inclusive and diverse Artificial Intelligence (AI) K-12 education. Computers & Education, 189, 104582. https://doi.org/10.1016/j. compedu.2022.104582
Koedinger, K. R., Brunskill, E., Baker, R. S., McLaughlin, E. A., & Stamper, J. (2013). New potentials for data-driven intelligent tutoring system development and optimization. AI Magazine, 34(3), 27-41.
Luckin, R., & Cukurova, M. (2019). Designing educational technologies in the age of AI: A learning sciences‐driven approach. British Journal of Educational Technology, 50(6), 2824-2838.
Cukurova, M., & Luckin, R. (2018). Measuring the impact of emerging technologies in education: A pragmatic approach.
Holmes, W. & Bialik, M. & Fadel, C. (2019). Artificial Intelligence in Education. Promise and Implications for Teaching and Learning.
Seufert, S., Guggemos, J., & Sailer, M. (2021). Technology-related knowledge, skills, and attitudes of pre-and in-service teachers: The current situation and emerging trends. Computers in Human Behavior, 115, 106552.
Darabi, A., Liang, X., Suryavanshi, R., & Yurekli, H. (2013). Effectiveness of online discussion strategies: A meta-analysis. American journal of distance education, 27(4), 228-241.
Kirchner, F., Straube, S., Kühn, D., & Hoyer, N. (Eds.). (2020). AI technology for underwater robots. Cham: Springer.
Shute, V., & Wang, L. (2016). Assessing and supporting hard‐to‐measure constructs in video games. The Wiley Handbook of Cognition and Assessment: Frameworks, Methodologies, and Applications, 535-562.
Dillenbourg, P. (2016). The evolution of research on digital education. International Journal of Aiin Education, 26, 544-560.
Hrastinski, S., Olofsson, A. D., Arkenback, C., Ekström, S., Ericsson, E., Fransson, G., ... & Utterberg, M. (2019). Critical imaginaries and reflections on AI and robots in postdigital K-12 education. Postdigital Science and Education, 1, 427-445.
Brown, S., Davidovic, J., & Hasan, A. (2021). The algorithm audit: Scoring the algorithms that score us. Big Data & Society, 8(1), 2053951720983865.
Veletsianos, G. (2016). Digital Learning Environments. In Handbook of Distance Education (pp. 107–121). Routledge.
Dascalu, M., Dessus, P., & Trausan-Matu, S. (2018). Adaptation strategies in online education: Personalization, formative assessment, and data-driven interventions. Journal of Educational Technology & Society, 21(3), 25-34.
Kunnath, A., Dron, J., & Zhu, M. (2020). Adaptive Online Testing in Higher Education: A Literature Review. Education Sciences, 10(10), 291.
Smith, A., & Jones, B. (2018). Enhancing assessment practices through artificial intelligence: A systematic review. International Journal of Educational Technology in Higher Education, 15(1), 1–18.
Jones, C., & Brown, K. (2019). Exploring the effectiveness of Aiin educational assessment: A meta-analysis. Journal of Educational Technology & Society, 22(4), 132–145.
Johnson, E. (2018). The impact of Aion educational assessment: A case study. Educational Research Quarterly, 41(2), 167–180.
Brown, A., & Davis, B. (2020). Exploring the adoption of AI in educational assessment: A qualitative study. Journal of Educational Technology, 45(3), 289–302.
Williams, R., et al. (2021). Understanding the role of AI in educational assessment: A qualitative study. Educational Assessment, 36(4), 421–435.