Design Beyond Screen: A Primer for Designing Mobile Augmented Reality Storytelling Application

This research project explores and experiments with a design intervention – remediation of a print-based story into an augmented reality storytelling experience. The objective of this study is to reveal insights into the process of designing a mobile augmented reality storytelling application. This focuses on the main idea that examines how designing for screen (2D (two-dimensional) displays) is different than designing for augmented reality (360-degree view with perceived depth). The study experiments with interaction design process, method, and apparatus of creating an augmented reality mobile application, that creates engaging experiences for users. In doing so, the research intends to make an original contribution to knowledge within the disciplines of extended realities (XR) and human-computer interaction (HCI) by adopting a user-centred approach within the context of technological, phenomenological and the interaction design perspectives. The insights that emerge from this study are relevant and useful to other researchers and practitioners in XR and HCI. This practice-based study examines the design processes, are specific to the creation of mobile augmented reality storytelling experiences. The key outcome is to elicit knowledge through practice. The study lays the groundwork for determining what sorts of design constraints and interaction possibilities are presented by augmented reality as a storytelling medium. In this paper, we will present the early prototype, creative process, demonstrate our plan for conducting a user experience (UX) study for supporting the design process of the Augmented Reality (AR) prototype, and directions for future work.

(accepted and in-press – current UTAS entry to be updated with DOI)