Designing Emotionally Adaptive Interfaces: Affective Ux Model For Enhancing Engagement In Gamified Learning Apps
DOI:
https://doi.org/10.51903/ijgd.v3i2.3098Keywords:
Affective UX, Gamified Learning, Emotionally Adaptive Interfaces, User Engagement, Affective ComputingAbstract
In the digital learning era, user engagement is shaped not only by functionality and aesthetics but also by how interfaces adapt to users’ emotional experiences. While gamified learning environments have become common, few designs systematically integrate affective computing principles to support real-time emotional adaptation. This study proposes an Affective UX Model that combines affective computing with user experience (UX) design to enhance emotional engagement in gamified educational interfaces. The research aims to explore how emotionally adaptive features can be designed, implemented, and evaluated within a learning context. Using a user-centered design (UCD) approach, the study employed mixed methods, including visual storytelling, interactive prototyping, and affective mapping via self-report measures and biometric tracking (facial expressions and heart rate variability). A gamified language-learning prototype was tested with 30 adolescent participants (aged 15–18) through usability and emotional response evaluations. Results show that empathetic avatars, responsive feedback, and adaptive difficulty adjustments significantly increased motivation, engagement, and emotional comfort. Participants reported a stronger sense of connection when system feedback matched their affective State and performance. The study contributes a validated conceptual framework for designing emotionally intelligent, human-centered educational interfaces, emphasizing how affective adaptivity enhances the quality of user experience and learning outcomes. The findings demonstrate that dynamic emotional adaptation can redefine engagement and inform future directions in emotionally responsive design research.
References
Alipour, M., Moghaddam, M. T., Vaidhyanathan, K., & Kjærgaard, M. B. (2023). Emoticontrol: Emotions-based Control of User-Interfaces Adaptations. Proceedings of the ACM on Human-Computer Interaction, 7, 1-29. https://doi.org/10.1145/3593227
Alomari, H. W., Ramasamy, V., Kiper, J. D., & Potvin, G. (2020). A User Interface (UI) and User Experience (UX) Evaluation Framework for Cyberlearning Environments in Computer Science and Software Engineering Education. Heliyon, 6(5). https://doi.org/10.1016/j.heliyon.2020.e03917
Amin, M. M., Cambria, E., & Schuller, B. W. (2023). Will Affective Computing Emerge from Foundation Models and General AI? A First Evaluation on ChatGPT. http://arxiv.org/abs/2303.03186
An, Y. (2020). Designing Effective Gamified Learning Experiences. International Journal of Technology in Education, 3(2), 62–69. https://ijte.net/index.php/ijte/article/view/1343
Bag, S., Srivastava, G., Bashir, M. M. Al, Kumari, S., Giannakis, M., & Chowdhury, A. H. (2022). Journey of Customers in This Digital Era: Understanding the Role of Artificial Intelligence Technologies in User Engagement and Conversion. Benchmarking, 29(7), 2074–2098. https://doi.org/10.1108/bij-07-2021-0415
Bintarto, J. (2023). UI/UX Design of E-Learning Applications AL MUNADI SMA Case Study With A User Centered Design Approach. International Journal of Graphic Design, 1(2), 14–22. https://journal.stekom.ac.id/index.php/ijgd/article/view/1797
Bird, M., McGillion, M., Chambers, E. M., Dix, J., Fajardo, C. J., Gilmour, M., Levesque, K., Lim, A., Mierdel, S., Ouellette, C., Polanski, A. N., Reaume, S. V., Whitmore, C., & Carter, N. (2021). A Generative Co-Design Framework for Healthcare Innovation: Development and Application of an End-User Engagement Framework. Research Involvement and Engagement, 7(1), 12. https://doi.org/10.1186/s40900-021-00252-7
Bitkina, O. V., Kim, H. K., & Park, J. (2020). Usability and User Experience of Medical Devices: An Overview of the Current State, Analysis Methodologies, and Future Challenges. International Journal of Industrial Ergonomics, 76, 102932. https://doi.org/10.1016/j.ergon.2020.102932
Brasoveanu, A., Moodie, M., & Agrawal, R. (2020). Textual Evidence for the Perfunctoriness of Independent Medical Reviews. CEUR Workshop Proceedings, 2657, 1–9. https://www.academia.edu/download/110116931/paper1.pdf
Braun, M., Weber, F., & Alt, F. (2022). Affective Automotive User Interfaces Reviewing the State of Driver Affect Research and Emotion Regulation in the Car. ACM Computing Surveys, 54(7), 1-26. https://doi.org/10.1145/3460938
Buchanan, R. (1992). Wicked Problems in Design Thinking. Design Issues, 8(2), 5–21. https://doi.org/10.2307/1511637
Cortiñas-Lorenzo, K., & Lacey, G. (2024). Toward Explainable Affective Computing: A Review. IEEE Transactions on Neural Networks and Learning Systems, 35(10), 13101–13121. https://doi.org/10.1109/tnnls.2023.3270027
Dağ, K., Çavuşoğlu, S., & Durmaz, Y. (2024). The Effect of Immersive Experience, User Engagement and Perceived Authenticity on Place Satisfaction in the Context of Augmented Reality. Library Hi Tech, 42(4), 1331–1346. https://doi.org/10.1108/lht-10-2022-0498
Deng, W. H., Lam, M. S., Cabrera, Á. A., Metaxa, D., Eslami, M., & Holstein, K. (2023). Supporting User Engagement in Testing, Auditing, and Contesting AI. Proceedings of the ACM Conference on Computer Supported Cooperative Work, CSCW, 556–559. https://doi.org/10.1145/3584931.3611279
Fischer, B., Peine, A., Östlund, B., & Heyn, P. C. (2020). The Importance of User Involvement: A Systematic Review of Involving Older Users in Technology Design. Gerontologist, 60(7), 513–523. https://doi.org/10.1093/geront/gnz163
Gold, J., & Ciorciari, J. (2020). A Review on the Role of the Neuroscience of Flow States in the Modern World. Behavioral Sciences, 10(9), 137. https://doi.org/10.3390/bs10090137
Hellín, C. J., Calles-Esteban, F., Valledor, A., Gómez, J., Otón-Tortosa, S., & Tayebi, A. (2023). Enhancing Student Motivation and Engagement through a Gamified Learning Environment. Sustainability, 15(19), 14119. https://doi.org/10.3390/su151914119
Kang, H., & Lou, C. (2022). AI Agency vs. Human Agency: Understanding Human-AI Interactions on TikTok and Their Implications for User Engagement. Journal of Computer-Mediated Communication, 27(5), 14. https://doi.org/10.1093/jcmc/zmac014
Kanuri, V. K., Hughes, C., & Hodges, B. T. (2024). Standing Out From the Crowd: When and Why Color Complexity in Social Media Images Increases User Engagement. International Journal of Research in Marketing, 41(2), 174–193. https://doi.org/10.1016/j.ijresmar.2023.08.007
Krishna Mandava, S. (2023). Emotion-Driven User Interface (UI) Adaptation Using Real-Time User Feedback. Journal of Data Acquisition and Processing, 38(1), 133. https://doi.org/10.5281/zenodo.7546452
Märtin, C., Bissinger, B. C., & Asta, P. (2023). Optimizing the Digital Customer Journey—Improving User Experience by Exploiting Emotions, Personas and Situations for Individualized User Interface Adaptations. Journal of Consumer Behaviour, 22(5), 1050–1061. https://doi.org/10.1002/cb.1964
Pei, G., Li, H., Lu, Y., Wang, Y., Hua, S., & Li, T. (2024). Affective Computing: Recent Advances, Challenges, and Future Trends. Intelligent Computing, 3(5), 76. https://doi.org/10.34133/icomputing.0076
Prasetya, D., Inayati, I., Utami, B., & Pertiwi, S. (2025). From Static To Sentient: Designing Emotionally Responsive Interfaces Using Affective Computing For UX Enhancement. International Journal of Graphic Design, 3(1), 120–136. https://doi.org/10.51903/ijgd.v3i1.2811
Prati, E., Peruzzini, M., Pellicciari, M., & Raffaeli, R. (2021). How to Include User Experience in the Design of Human-Robot Interaction. Robotics and Computer-Integrated Manufacturing, 68, 102072. https://doi.org/10.1016/j.rcim.2020.102072
Pushpakumar, R., Sanjaya, K., Rathika, S., Alawadi, A. H., Makhzuna, K., Venkatesh, S., & Rajalakshmi, B. (2023). Human-Computer Interaction: Enhancing User Experience in Interactive Systems. E3S Web of Conferences, 399, 04037. https://doi.org/10.1051/e3sconf/202339904037
Ratinho, E., & Martins, C. (2023). The Role of Gamified Learning Strategies in Student’s Motivation in High School and Higher Education: A Systematic Review. Heliyon, 9(8), 19033. https://doi.org/10.1016/j.heliyon.2023.e19033
Schuller, B., Mallol-Ragolta, A., Almansa, A. P., Tsangko, I., Amin, M. M., Semertzidou, A., Christ, L., & Amiriparian, S. (2024). Affective Computing Has Changed: The Foundation Model Disruption. http://arxiv.org/abs/2409.08907
Shahbaznezhad, H., Dolan, R., & Rashidirad, M. (2021). The Role of Social Media Content Format and Platform in Users’ Engagement Behavior. Journal of Interactive Marketing, 53(1), 47–65. https://doi.org/10.1016/j.intmar.2020.05.001
Steinert, S., & Friedrich, O. (2020). Wired Emotions: Ethical Issues of Affective Brain–Computer Interfaces. Science and Engineering Ethics, 26(1), 351–367. https://doi.org/10.1007/s11948-019-00087-2
Wang, E., Han, C., & Poon, J. (2022). RoViST: Learning Robust Metrics for Visual Storytelling. Findings of the Association for Computational Linguistics: NAACL 2022, 2691–2702. https://doi.org/10.18653/v1/2022.findings-naacl.206
Yaccob, N. S., Abd. Rahman, S. F., Azlan Mohamad, S. N., Abdul Rahim, A. A., Khalilah Abdul Rashid, K., Mohammed Abdulwahab Aldaba, A., Md Yunus, M., & Hashim, H. (2022). Gamifying ESL Classrooms through Gamified Teaching and Learning. Arab World English Journal, 8, 177–191. https://doi.org/10.24093/awej/call8.12
Yigitbas, E., Jovanovikj, I., Biermeier, K., Sauer, S., & Engels, G. (2020). Integrated Model-Driven Development of Self-Adaptive User Interfaces. Software and Systems Modeling, 19(5), 1057–1081. https://doi.org/10.1007/s10270-020-00777-7
Yunianto, I., & Wahyudi, W. (2024). Designing User Experience for a Mobile Application for Agricultural Product Marketing Using the Human-Centered Design Method. International Journal of Graphic Design, 2(2), 207–221. https://doi.org/10.51903/ijgd.v2i2.2123
Yunus, C. C. A., & Hua, T. K. (2021). Exploring a Gamified Learning Tool in the ESL Classroom: The Case of Quizizz. Journal of Education and E-Learning Research, 8(1), 103–108. https://doi.org/10.20448/journal.509.2021.81.103.108
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Adjeng Rahayu Dinata, Firli Hardiansyah, Juita Fitriana Sari
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
5.png)
