An Interactive Video-Based Training Program and Its Impact on Acquiring the Skills of Prompt Engineering for Generative Artificial Intelligence for University Students

Document Type : Original Article

Author

Associate Professor of Information Technology and E-Learning College of Education - Department of Curricula and Teaching Methods - Umm Al-Qura University

Abstract

The current study aimed to measure the effect of a training program based on interactive video in acquiring prompt engineering skills for generative artificial intelligence for university students in the Kingdom of Saudi Arabia. The study seeks to highlight the importance of acquiring prompt engineering skills for those dealing with generative artificial intelligence systems and to research ways to learn them for academic progress and build professional capabilities to benefit from the enormous potential of artificial intelligence among learners particularly and all users in general. This study used the descriptive survey approach by analyzing educational literature and previous studies and coming up with a list of prompt engineering skills. The study relied on the experimental approach with its quasi-experimental design based on designing a training program based on interactive video. The study tools were an achievement test and an observation card. The results indicate that there are statistically significant differences at the significance level (α≥0.05) between the average scores of students in the experimental and control groups in the post-measurement of the cognitive aspect and the performance aspect related to prompt engineering skills among Umm Al-Qura University students in favor of the experimental group. The study recommends enriching the general and technical subjects with cognitive and practical learning objectives of prompt engineering skills.

Keywords

References

Abu Khutwa, S. A. (2022). Applications of artificial intelligence in education and their implications for educational technology research. The Scientific Journal of the Egyptian Society for Educational Computing, 10(2), 145–161.
Harasim, L., & Al-Atiyawi, S. (2020). Learning theories and their applications in e-learning. Journal of Educational Sciences, 32(2), 415–421.
Khamis, M. A. (2007). Educational computers and multimedia technologies. Cairo: Al-Sahab Publishing and Distribution.
Khamis, M. A. (2020). Modern trends in educational technology and research areas (Part 1). Cairo: The Arab Academic Center for Publishing and Distribution.
Al-Dosari, S. A., & Al-Mesaed, A. Z. (2019). The impact of interactive video on academic achievement among first-year secondary school students. The International Journal of Educational Research, 43(2), 153–179.
Al-Zaabout, S. E. (2021). Artificial intelligence: An educational approach from the perspective of literature and theories explaining artificial intelligence. The 12th International Scientific Conference.
Saad El-Din, M. (2024). The interaction between navigation level in e-training environments and cognitive style and its impact on developing technological thinking skills and the components of digital culture among graduate students. Educational Technology - Studies and Research, 137–194.
Daher, M., Heikal, S., & Salem, M. M. (2022). Requirements for employing artificial intelligence applications in pre-university education in Egypt. Journal of Education, 196(5), 317–368.
Al-Dowayan, M., & Fathy, A. (2019). The impact of different e-training styles (synchronous vs. asynchronous) on developing e-assessment design skills among secondary school teachers. Reading and Knowledge Journal: Ain Shams University - Faculty of Education - Egyptian Society for Reading and Knowledge, 209, 151–215.
Abdel-Hamid, A. T. (2014). E-learning and educational technology innovations. Cairo: Al-Asriya Library for Publishing and Distribution.
Abdel-Hafiz, S. S., Mohamed, A. R. K., & Farjoun, K. M. (2019). The impact of the interaction between the hyperlink style within online hypervideo and cognitive style on developing social communication skills among middle school students. Fayoum University Journal of Educational and Psychological Sciences, 13(2), 69–100.
Abdel-Aty, H. (2009). Standards for electronic educational discussion forums. Informatics Journal, 25. Ministry of Education, Saudi Arabia.
Azmi, N. J. (2018). Learning environments: Hyperlearning environments. Al-Huda Publishing and Distribution.
Al-Enezi, M. M., & Al-Otaibi, S. E. (2018). The use of blended learning in technical and vocational training from the perspective of female trainers at the Technical College for Girls in Riyadh. Arab Studies in Education and Psychology, 101, 165–189.
Al-Ghamdi, S., & Al-Frani, L. (2020). The reality of using artificial intelligence applications in special education schools in Jeddah from the perspective of female teachers and their attitudes towards them. The International Journal of Educational and Psychological Studies, 8(1), 57–76.
Mishaal, M., & Al-Eid, N. (2023). The reality of employing artificial intelligence applications in early childhood education from the perspective of female teachers in Shaqra Governorate, Saudi Arabia. Journal of Education, 198, 434–478.
Al-Yamahi, M. K. (2021). Artificial intelligence and education. Teacher’s Message, 57(1–2), 35–44.
Younis, S. S. (2022). The impact of the interaction between interactive infographic styles and mental capacity level on developing digital video production skills among secondary school teachers. Journal of Education, 193(1), 77–128.
المراجع الأجنبية:
Bandyopadhyay, T., Saha, S., & Pal, D. (2023). Beyond imitation: Exploring novelty in generative AI. International Journal of Advanced Research in Science, Communication and Technology. https://consensus.app/papers/beyond-imitation-exploring-novelty-generative-bandyopadhyay/111079fde973527cb72201acb9ab60a4/?utm_source=chatgpt
Bannister, P., Santamaría-Urbieta, A., & Alcalde-Peñalver, E. (2023). A systematic review of generative AI and (English medium instruction) higher education. Aula Abierta. https://consensus.app/papers/review-generative-english-medium-instruction-higher-bannister/b263ebfc3ccb57ae9d437dd571aacb5e/?utm_source=chatgpt
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., …  Zhang, Y. (2020). Language models are unsupervised multitask learners. arXiv preprint arXiv:2005.14165.
Castillo-Segura, P., Alario-Hoyos, C., Kloos, C. D., & Panadero, C. F. (2023). Leveraging the potential of generative AI to accelerate systematic literature reviews: An example in the area of educational technology. In 2023 World Engineering Education Forum - Global Engineering Deans Council (WEEF-GEDC) (pp. 1-8). https://consensus.app/papers/leveraging-potential-generative-accelerate-systematic-castillosegura/859b6a05e59555d5b686bd050d695cf4/?utm_source=chatgpt
Cattaneo, Alberto A.  P, van der Meij, Hans, Aprea, Carmela, Sauli, Florinda, & Zahn, Carmen. (2019). A model for designing hypervideo-based instructional scenarios. Interactive Learning Environments, 27(4), 508-529. doi:10.1080/10494820.2018.1486860
Cattaneo, Alberto A.  P, van der Meij, Hans, Aprea, Carmela, Sauli, Florinda, & Zahn, Carmen. (2019). A model for designing hypervideo-based instructional scenarios. Interactive Learning Environments, 27(4), 508-529. doi:10.1080/10494820.2018.1486860
Cattaneo, Alberto A. P., van der Meij, Hans, & Sauli, Florinda. (2018). An Empirical Test of Three Instructional Scenarios for Hypervideo Use in a Vocational Education Lesson. Computers in the Schools, 35(4), 249-267. doi:10.1080/07380569.2018.1531597
Clark, Ruth C., & Mayer, Richard E. (2011). E-learning and the science of instruction: proven guidelines for consumers and designers of multimedia learning (3rd ed.): Wiley.
Creswell, J.W. (2012). Educational Research: Planning, Conducting, and Evaluating Quantitative and Qualitative Research: Pearson.
Franceschelli, G., & Musolesi, M. (2023). Reinforcement learning for generative AI: State of the art, opportunities and open research challenges. ArXiv. https://consensus.app/papers/reinforcement-learning-generative-state-opportunities-franceschelli/cbd6b35fab4f566bae860903b22b3203/?utm_source=chatgpt
Giannakos, Michail N., Chorianopoulos, Konstantinos, & Chrisochoides, Nikos. (2021). Making Sense of Video Analytics: Lessons Learned from Clickstream Interactions, Attitudes, and Learning Outcome in a Video-Assisted Course. International Review of Research in Open and Distributed Learning, 16(1), 260-283. doi:https://doi.org/10.19173/irrodl.v16i1.1976
Gong, C., Jing, C., Chen, X., Pun, C.-M., Huang, G., Saha, A., et al. (2023). Generative AI for brain image computing and brain network computing: a review. Frontiers in Neuroscience, 17. https://consensus.app/papers/brain-image-computing-brain-network-computing-review-gong/f88a2a48e27f541b905a1e2b1d036c11/?utm_source=chatgpt.
Gong, C., Jing, C., Chen, X., Pun, C.-M., Huang, G., Saha, A., Nieuwoudt, M., Li, H.-X., Hu, Y., & Wang, S. (2023). Generative AI for brain image computing and brain network computing: A review. Frontiers in Neuroscience, 17. https://consensus.app/papers/brain-image-computing-brain-network-computing-review-gong/f88a2a48e27f541b905a1e2b1d036c11/?utm_source=chatgpt
Grilo, A. M., Ferreira, A. C., Ramos, M. P., Carolino, E., Pires, A. F., & Vieira, L. (2022). Effectiveness of educational videos on patient’s preparation for diagnostic procedures: Systematic review and Meta-Analysis. Preventive medicine reports, 28, 101895.‏
Herrington, Jan, Reeves, Thomas C., & Oliver, Ron. (2014) Authentic Learning Environments. In J. Michael Spector, M. David Merrill, Jan Elen, & M. J. Bishop (Eds.), Handbook of Research on Educational Communications and Technology (pp. 401-412). New York, NY: Springer New York.
Hwang, G. J., Xie, H., Wah, B. W., & Gašević, D. (2020). Vision, challenges, roles and research issues of Artificial Intelligence in Education. Computers and Education: Artificial Intelligence, 1, 100001.‏
Iftikhar, P., Kuijpers, M. V., Khayyat, A., Iftikhar, A., & De Sa, M. D. (2020). Artificial intelligence: a new paradigm in obstetrics and gynecology research and clinical practice. Cureus, 12(2).‏
Korinek, A. (2023). Generative AI for economic research: Use cases and implications for economists. Journal of Economic Literature. https://consensus.app/papers/economic-research-cases-implications-economists-korinek/ac037dfc9d7a5c2d9be63271473b339b/?utm_source=chatgpt
Köster, J. (2019). Video in the Age of Digital Learning: Springer International Publishing.
Landgrebe, J., & Smith, B. (2022). Why machines will never rule the world: artificial intelligence without fear. Routledge.‏
Maher, M., Weisz, J. D., Chilton, L. B., Geyer, W., & Strobelt, H. (2023). HAI-GEN 2023: 4th workshop on human-AI co-creation with generative models. In Companion Proceedings of the 28th International Conference on Intelligent User Interfaces. https://consensus.app/papers/haigen-2023-workshop-humanai-cocreation-generative-maher/71f8b8086b1b5e36b08d70cf522d1d24/?utm_source=chatgpt
Mayer, Richard E, & Pilegard, Celeste. (2014). Principles for managing essential processing in multimedia learning: Segmenting, pretraining, and modality principles. In The Cambridge handbook of multimedia learning (pp. 169-182): Cambridge University Press.
Paivio, A. (2014). Mind and Its Evolution: A Dual Coding Theoretical Approach: Taylor & Francis.
Potter, C. & Naidoo, G.(2012). Teacher development through distance education: contrasting visions of radio learning in south african primary schools, In J. Moore & A. Benson (Ed.), International Perspectives Of Distance Learning In Higher education, (pp. 54-108), Croatia: InTech Janeza Trdine.
Radcliffe, T., Lockhart, E., & Wetherington, J. (2024). Automated prompt engineering for semantic vulnerabilities in large language models. Authorea Preprints.‏
Rebuffel, P, Alicke, K.; Knut, D.; Görner, S.; Mori, L.;.; Reiter, S.; Samek, R. Succeeding in the AI Supply-Chain Revolution. 2021. Available online: https://www.mckinsey.com/industries/metals-and-mining/our-insights/succeeding-in-the-ai-supply-chain-revolution 
Rios-Campos, C., Luzuriaga Viteri, J. D. C., Palma Batalla, E. A., Castro, J., Bautista Núñez, J., Vega Calderón, E., Gómez Nicacio, F. J., & Pretell Tello, M. Y. (2023). Generative artificial intelligence. South Florida Journal of Development. https://consensus.app/papers/artificial-intelligence-rioscampos/e003f660600658bb85cefc8397f3a90f/?utm_source=chatgpt
Sauli, Florinda, Cattaneo, Alberto, & van der Meij, Hans. (2018). Hypervideo for educational purposes: a literature review on a multifaceted technological tool. Technology, Pedagogy and Education, 27(1), 115-134. doi:10.1080/1475939X.2017.1407357
Schacter, Daniel L, & Szpunar, Karl K. (2015). Enhancing attention and memory during video-recorded lectures. Scholarship of Teaching and Learning in Psychology, 1(1), 60.
Schmitt, B. (2023). Transforming qualitative research in phygital settings: The role of generative AI. Qualitative Market Research: An International Journal. https://consensus.app/papers/transforming-research-settings-role-generative-schmitt/0a0d3876d1f45369897861cf0860d9d9/?utm_source=chatgpt
Shaikh, S., Bendre, R., & Mhaske, S. (2023). The rise of creative machines: Exploring the impact of generative AI. ArXiv. https://consensus.app/papers/rise-creative-machines-exploring-impact-generative-shaikh/250b6d37d4135c18bc7e764fc5180686/?utm_source=chatgpt
Shokrollahi, Y., Yarmohammadtoosky, S., Nikahd, M. M., Dong, P., Li, X., & Gu, L. (2023). A comprehensive review of generative AI in healthcare. ArXiv. https://consensus.app/papers/comprehensive-review-generative-healthcare-shokrollahi/268db7e186c155469a38d8fd8855acd0/?utm_source=chatgpt
Sweller, J., Ayres, P., & Kalyuga, S. (2011). Cognitive Load Theory: Springer New York.
Taslibeyaz, Elif, Dursun, Onur Burak, & Karaman, Selcuk. (2017). Interactive video usage on autism spectrum disorder training in medical education. Interactive Learning Environments, 25(8), 1025-1034. doi:10.1080/10494820,2016,1242504
Xu, Z.; Li, J.; Topaz, M. ElCombo: Knowledge-Based Personalized Meal Recommendation System for Chinese Community-Dwelling Elders. In Proceedings of the 2023 IEEE 11th International Conference on Healthcare Informatics (ICHI), Houston, TX, USA, 26–29 June 2023; pp. 478–479.
Zhang, P., & Boulos, M. N. K. (2023). Generative AI in medicine and healthcare: Promises, opportunities and challenges. Future Internet. https://consensus.app/papers/medicine-healthcare-promises-opportunities-challenges-zhang/0a4b2f366283550ab8f0c54dbd3b2770/?utm_source=chatgpt
Zhang, Y. (2023). Generative AI has lowered the barriers to computational social sciences. ArXiv. https://consensus.app/papers/lowered-barriers-sciences-zhang/4619264a270e5878857ca27424aa76e6/?utm_source=chatgpt
Zhou, C., McCarthy, S. A., & Durbin, R. (2023). YaHS: yet another Hi-C scaffolding tool. Bioinformatics, 39(1), btac808.‏

Files

Share

How to cite

Statistics