Design of "Virtual Fusion"Cooking Experience Based on XR: Transplantation and Reconstruction of Game Mechanism in Real Skill Training
Abstract
At present, there are still some problems in the traditional cooking teaching mode, such as the boring explanation of theoretical knowledge, the non intuitive guidance of practical operation, and the serious disconnection between knowledge teaching and hands-on operation, which restrict the efficiency and experience of cooking learning. However, with the development of extended reality (XR) technology, the digital transformation of cooking teaching has ushered in a new opportunity. Based on the design concept of game, this paper proposes a new "virtual fusion" cooking experience system to solve the problem of the gap between knowledge transfer and actual operation in traditional cooking teaching. Through the three core modules of spatial perception, virtual real mapping and dynamic feedback, the system transforms abstract cooking knowledge into specific spatial action instructions. With the immersion characteristics of XR technology, the system transforms abstract cooking knowledge such as temperature control, food material processing and seasoning proportion into intuitive and landing spatial action instructions, so that beginners can master cooking skills in interesting interaction. Finally, this paper discusses the technical implementation path of the system and Its Enlightenment for the development of intelligent kitchen in the future.
References
- Califano, G., Zhang, T., & amp; Spence, C. (2026). When and Why Do Users Trust AI in the Kitchen? A Hybrid Modelling Approach to the Adoption of AI-Assisted Cooking. International Journal of Human–Computer Interaction, 42(1), 131–143. https: //doi.org/10.1080/10447318.2025.2505154
- Geng, G., et al. (2026). Engaging young minds: How smart augmented reality glasses transform learning experiences in AR smart glasses immersive virtual learning environments (AR smart glasses IVLE). Journal of Science Education and Technology, 1–20. https: //doi.org/10.1007/s10956-026-10299-4
- Latif, W. B., Yasin, I. M. Y., Rahaman, M. A., Forid, M. S., Islam, M. N., & Hossain, M. Z. (2024). Impact of augmented reality (AR) and virtual reality (VR) on interactive learning systems. Pac Journal of Advanced Engineering and Innovation, 1(1), 23–32. https: //doi.org/10.70818/pjaei.2024.v01i01.016
- Alice, I. G. C., Cristina, V. B., & Mariano, R. A. (2019). A virtual versus an augmented reality cooking task based-tools: A behavioral and physiological study on the assessment of executive functions. Frontiers in Psychology, 10, 2529. https: //doi.org/10.3389/fpsyg.2019.02529
- Cañada, Y., Torres, C. S., Martinez, A. J., et al. (2024). Characterization and assessment of executive functions through a virtual cooking task in euthymic patients with bipolar disorder. Journal of Psychiatric Research, 178, 349–358. https: //doi.org/10.1016/j.jpsychires.2024.08.007
- Yang, Y., Liu, M., Lyu, M., et al. (2025). Does healthy cooking lead to healthy choices? Exploring the impact of a virtual reality cooking game on healthy eating decisions. Games for Health Journal. https: //doi.org/10.1177/2161783X251378648
- JakuJakubow, L., Bouck, C. E., Norwine, L., et al. (2025). Enhancing independence: Non-immersive virtual reality for teaching cooking skills to high school students with intellectual disability. Journal of Special Education Technology, 40(2), 252–265. https: //doi.org/10.1177/01626434241277190
- Qiao, X., Ren, P., Dustdar, S., Liu, L., Ma, H., & Chen, J. (2019). Web AR: A promising future for mobile augmented reality—State of the art, challenges, and insights. Proceedings of the IEEE, 107(4), 651–666. https: //doi.org/10.1109/JPROC.2019.2895105
- Iftene, A., & Trandabă, D. (2020). Eye and voice control for an augmented reality cooking experience. Procedia Computer Science, 176, 1469–1478. https: //doi.org/10.1016/j.procs.2020.09.157
- Han-byul, J., Jang-Woon, K., Chil-Woo, L. (2007). Augmented reality cooking system using tabletop display interface. CEUR Workshop Proceedings, 260.
- Zhou, Q. W., Chen, H., & Gao, Y. (2022). Design and implementation of VR-based visual interactive system for Sichuan cuisine cooking. Modern Information Technology, 6(9), 19–21, 25.
- Bouck, E., Norwine, L., Jakubow, L., et al. (2025). Playing with food: Non-immersive virtual reality to teach food preparation. Journal of Developmental and Physical Disabilities, 1–19. https: //doi.org/10.1007/s10882-025-10028-6
- Junhao, X., JJC, K. J., Carol, O., et al. (2022). Trends of augmented reality for agri-food applications. Sensors, 22(21), 8333. https: //doi.org/10.3390/s22218333
- Reshma, K., Anusha, S. (2018). Real-time image tracking for augmented reality application. Journal of Computational and Theoretical Nanoscience, 15(6), 2471–2476. https: //doi.org/10.1166/jctn.2018.7491
- Janette, H., & Melanie, M. (2018). Developing 21st century competencies of marginalized students through the use of augmented reality (AR). LEARNing Landscapes, 11(1), 153–169. https: //doi.org/10.36510/learnland.v11i1.929