AI-Enhanced Generative Motion Design for Interactive Digital Storytelling

Azed Yayah Durrotun Nihayah; Joseflim  Marchel; Lawrence  Henry

doi:10.51903/ijgd.v4i1.2413

Authors

Azed Yayah Durrotun Nihayah Universitas Sains dan Teknologi Komputer, Semarang, Indonesia https://orcid.org/0009-0000-2388-1160
Joseflim Marchel Universitas Sains dan Teknologi Komputer, Semarang, Indonesia https://orcid.org/0009-0005-3850-5842
Lawrence Henry Department of Computer Science, University of Idaho, Moscow, United States.

DOI:

https://doi.org/10.51903/ijgd.v4i1.2413

Keywords:

generative design, motion graphics, artificial intelligence, interactive storytelling, digital media

Abstract

The increasing demand for dynamic digital content has positioned motion graphics as a key medium in contemporary visual communication. However, conventional motion design workflows remain largely static and production-oriented, limiting their capacity to support adaptive and interactive storytelling. This study introduces an AI-enhanced generative motion design framework that integrates generative visual formation, temporal animation logic, and user-driven interaction within a unified system. The framework embeds generative AI directly into the motion design process, enabling visual elements to evolve continuously in response to contextual input and user interaction. A three-layer architecture, comprising generative, motion, and interaction components, is implemented in a functional prototype to support non-linear and responsive narrative structures. The system is evaluated through a combination of structured observation and user-oriented assessment, involving 8 participants with backgrounds in digital media and design. The results indicate that the proposed approach produces visually coherent yet evolving motion graphics while supporting real-time responsiveness to user input. Compared with conventional workflows, the framework demonstrates greater adaptability and variability without compromising narrative consistency. These findings highlight the potential of integrating generative processes with motion and interaction to support adaptive visual storytelling.

References

Aberman, K., Weng, Y., Lischinski, D., Cohen-Or, D., & Chen, B. (2020). Unpaired motion style transfer from video to animation. ACM Transactions on Graphics, 39(4), 12. https://doi.org/10.1145/3386569.3392469

Akber, S. M. A., Kazmi, S. N., Mohsin, S. M., & Szczęsna, A. (2023). Deep Learning-Based Motion Style Transfer Tools, Techniques and Future Challenges. Sensors 2023, Vol. 23, Page 2597, 23(5), 2597. https://doi.org/10.3390/S23052597

Cai, A., Rick, S. R., Heyman, J., Zhang, Y., Filipowicz, A., Hong, M. K., Klenk, M., & Malone, T. (2023). DesignAID: Using Generative AI and Semantic Diversity for Design Inspiration. Proceedings of the ACM Collective Intelligence Conference, CI 2023, 1, 1–11. https://doi.org/10.1145/3582269.3615596

Cao, Y., Li, S., Liu, Y., Yan, Z., Dai, Y., Yu, P., & Sun, L. (2024). A Survey of AI-Generated Content (AIGC). ACM Computing Surveys, 57, 1–38. https://doi.org/10.1145/3704262

Cao, Y., Li, S., Yan, Z., Dai, Y., Yu, P., & Sun, L. (2023). A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPT. ArXiv, abs/2303.04226. https://doi.org/10.48550/arxiv.2303.04226

Feuerriegel, S., Hartmann, J., Janiesch, C., & Zschech, P. (2023). Generative AI. Business & Information Systems Engineering, 1–16. https://doi.org/10.1007/s12599-023-00834-7

He, J. (2024). Exploring style transfer algorithms in Animation: Enhancing visual. Entertainment Computing, 49, 100625. https://doi.org/10.1016/J.ENTCOM.2023.100625

Hu, L., Zhang, Z., Ye, Y., Xu, Y., & Xia, S. (2024). Diffusion-based Human Motion Style Transfer with Semantic Guidance. Computer Graphics Forum, 43(8), e15169. https://doi.org/10.1111/CGF.15169

Inie, N., Falk, J., & Tanimoto, S. (2023). Designing Participatory AI: Creative Professionals’ Worries and Expectations about Generative AI. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. https://doi.org/10.1145/3544549.3585657

Liu, Y., Luo, C., Tang, Z., Li, Y., Yang, Y., Ning, Y., Fan, L., Peng, J., & Zhang, Z. (2025). TC-Light: Temporally Coherent Generative Rendering for Realistic World Transfer. https://arxiv.org/pdf/2506.18904

Mishra, A., Brudy, F., Zhou, Q., Fitzmaurice, G., & Anderson, F. (2025). WhatIF: Branched Narrative Fiction Visualization for Authoring Emergent Narratives using Large Language Models. C and C 2025 - Proceedings of the 2025 Conference on Creativity and Cognition, 1, 590–605. https://doi.org/10.1145/3698061.3726933

Nihayah, A. Y. D., Priyadi, A., Yunianto, I., Hakim, F. N., Wahyudi, W., & Nafeeza, N. (2026). AI-Generated Narratives and Infographic Synthesis for Visualizing Climate Temperature Anomalies. Jurnal RESTI (Rekayasa Sistem Dan Teknologi Informasi), 10(1), 216–223. https://doi.org/10.29207/RESTI.V10I1.7060

Nishigori, K., & Takeda, H. (2025). Evaluating Narrative Coherence in Collaborative Storytelling with Generative AI. C and C 2025 - Proceedings of the 2025 Conference on Creativity and Cognition, 1, 443–447. https://doi.org/10.1145/3698061.3734393

Riedl, M., & Bulitko, V. (2012). Interactive Narrative: An Intelligent Systems Approach. AI Mag., 34, 67–77. https://doi.org/10.1609/aimag.v34i1.2449

Rizvić, S., Boskovic, D., & Mijatovic, B. (2024). Advanced interactive digital storytelling in digital heritage applications. Digit. Appl. Archaeol. Cult. Heritage, 33, 334. https://doi.org/10.1016/j.daach.2024.e00334

Saleh, Q., & Mansour, O. (2025). Motion Design in Digital Media: Its Impact on the Development of Visual Messages and User Interaction. Journal of Ecohumanism, 4(2), 1222–1232. https://doi.org/10.62754/JOE.V4I2.6434

Sheikh, A. (2025). Interactive Digital Narratives as Tools for Language Acquisition: Bridging Storytelling and Pedagogy in the 21st-century classroom. International Journal of English Literature and Social Sciences. https://doi.org/10.22161/ijels.104.90

Song, G. (2021). Application of Motion Graphics in Visual Communication Design. Journal of Physics: Conference Series, 1744. https://doi.org/10.1088/1742-6596/1744/4/042165

Su, J. (2024). Motion Graphic Design in Brand Identity: Enhancing the Interactive Experience. Proceedings of the 2024 International Conference on Artificial Intelligence, Digital Media Technology and Interaction Design. https://doi.org/10.1145/3726010.3726054

Van Der Nat, R., Bakker, P., & Müller, E. (2021). Navigating Interactive Story Spaces. The Architecture of Interactive Narratives in Online Journalism. Digital Journalism, 11, 1104–1129. https://doi.org/10.1080/21670811.2021.1960178

Wahid, R., Mero, J., & Ritala, P. (2023). Editorial: Written by ChatGPT, illustrated by Midjourney: generative AI for content marketing. Asia Pacific Journal of Marketing and Logistics. https://doi.org/10.1108/apjml-10-2023-994

Xing, K., Liang, H., Xu, D., Yin, Y., Plataniotis, K. N., Zhao, Y., & Wei, Y. (2025). TiP4GEN: Text to Immersive Panorama 4D Scene Generation. MM 2025 - Proceedings of the 33rd ACM International Conference on Multimedia, Co-Located with MM 2025, 9267–9276. https://doi.org/10.1145/3746027.3754704;SUBPAGE:STRING:BASIC

Xu, S. (2025). Facilitating Visual Media Exploration for Blind and Low Vision Users through AI-Powered Interactive Storytelling. Proceedings of ACM Conference (Conference’17), 1. https://doi.org/10.1145/nnnnnnn.nnnnnnn

Xu, S., Jin, X., Zhang, W., Qu, H., & Yan, Y. (2025). Branch Explorer: Leveraging Branching Narratives to Support Interactive 360° Video Viewing for Blind and Low Vision Users. UIST 2025 - Proceedings of the 38th Annual ACM Symposium on User Interface Software and Technology, 1, 18. https://doi.org/10.1145/3746059.3747791

Yu, J., Qin, Y., Che, H., Liu, Q., Wang, X., Wan, P., Zhang, D., Gai, K., Chen, H., & Liu, X. (2025). A Survey of Interactive Generative Video. https://arxiv.org/pdf/2504.21853

Yu, Y., Corino, G., & Phillips, M. (2025). Story Forge: A Card-Based Framework for AI-Assisted Interactive Storytelling. Electronics 2025, Vol. 14, Page 2955, 14(15), 2955. https://doi.org/10.3390/ELECTRONICS14152955

Zhao, Y. (2024). The synergistic effect of artificial intelligence on the evolution of visual communication in new media art. Heliyon, 10(18), e38008. https://doi.org/10.1016/j.heliyon.2024.e38008

Zheng, X., Qiao, X., Cao, Y., & Lau, R. (2019). Content-aware generative modeling of graphic design layouts. ACM Transactions on Graphics (TOG), 38, 1–15. https://doi.org/10.1145/3306346.3322971

Zhou, E., & Lee, D. (2024). Generative artificial intelligence, human creativity, and art. PNAS Nexus, 3. https://doi.org/10.1093/pnasnexus/pgae052

AI-Enhanced Generative Motion Design for Interactive Digital Storytelling

Authors

DOI:

Keywords:

Abstract

References

Downloads

Published

Issue

Section

License

How to Cite

menunew