Storytelling through a new lens 

Tom felt he had only scraped the surface of his creative niche at the end of his undergraduate studies at Te Herenga Waka—Victoria University of Wellington. A Master of Design Innovation provided the perfect platform to delve deeper into his craft. 

With a passion for world-building, Tom set out to enhance the immersive experience of Table-Top Role-Playing Games (TTRPGs) using mixed-reality devices (XR), in particular the Microsoft HoloLens 2 which projects virtual images into 3D space. The focus of his research was on Dungeons & Dragons (D&D), perhaps the most-renowned TTRPG. 

“I was drawn in by the breadth of interactive and storytelling opportunities that XR offered. 

“The Master of Design Innovation (MDI) was the best platform for this because it allowed me to explore a niche area that isn’t usually offered in other coursework.”

Traditionally a pen and paper medium, TTRPGs are games in which each participant assumes the role of a character who interacts with other characters within a fictional (more often fantasy) setting. Participants describe their characters’ actions through speech, which either succeed or fail according to the formal system of rules set by the game master. 

Without a predetermined narrative, the storytelling possibilities of TTRPGs are infinite, a trait that lends itself well to expansion into XR.  

The HoloLens is a headset or visor which allows users to experience 3D holographic images as though they are a part of their environment, changing the game, literally. 

“The best way to describe the experience is like using a Virtual Reality headset but grounded in your physical space. With XR, I can physically and visually experience D&D as a game, while also using 3D-projected virtual elements to assist the experience. 

“D&D players like the original experience so my goal is to not to replace the physical elements, but to provide opportunities to enhance immersion.” 

Tom used survey data from national D&D social groups and pages to determine which features of XR-TTRPGs to focus on and refine. 

“With any research, scope is probably the biggest enemy. You need to do the small things well then move beyond that. It’s easy to get lost in plenty of amazing ideas. Keep them in the back of your mind for later. 

“The [XR] technology is an infant and has a long way to come to be a worthy extension of the traditional and existing digital experiences.” 

In a traditional D&D game, players might be engaging in fantasy combat represented by plastic miniatures on a physical gameboard. Information about the characters’ abilities and rules of the game would usually be laid out on paper or in books for the players to refer to, a process which can interrupt the immersive experience.  

Tom describes how this ‘bookkeeping’ may be streamlined using XR, without disturbing the core qualities of the game. 

“Using the HoloLens, you can place that information in meaningful ways within the 3D space. The character's stats might be floating above their miniature on the table, or on a simplified user interface in front of you. This allows players to pack all the cumbersome material into one place so there is less clutter in the physical space.” 

XR can also remove the limitations that come with using physical game pieces, Tom says. The HoloLens would allow users to quickly generate 3D models and create new environments and characters for the players to experience. 

“The possibilities of XR just within TTRPGs are immense. It’s such an unusual space where we have to rethink our forms of interaction. Not only in games but also media, work, and our day-to-day living.” 

Tom is grateful for the passion and insight that his supervisors Dylan Horrocks and Byron Mallett brought to the table.  

“Byron did a wonderful job of making XR seem way more approachable than anticipated and was a fantastic library for ideas and inspiration. 

“Dylan ran a workshop with me and three others who were also undertaking TTRPG-related projects. Rather than a workshop, it just felt like a social group for games where we could bounce ideas off one another and try new things. 

During his studies Tom also had the opportunity to be involved as an illustrator for Story Box Ahi kā - nō rua, nō mango, nō runga i te rangi, a large-scale projection work commissioned by the Wellington City Council for its inaugural Matariki celebrations. His team, including Deputy Head of Te Kura Hoahoa—School of Design Innovation David Hakaraia, were finalists in the Toitanga category at the Best Design Awards 2022. 

The work was based on the parallel observance of Matariki by Ngāti Toa and Puanga by Te Āti Awa, the two mana whenua tribal authorities of Pōneke Wellington.  

“I had never worked on a professional collaborative project of a large scale before, so it was quite special seeing so many talented people producing amazing pieces of work in their niche. The scale and coordination allowed for the creation of something that would be unachievable alone.” 

Originally from Christchurch, it was during a road trip up north with his Dad that Tom fell in love with Wellington’s culture. This experience sealed his decision to study at Te Herenga Waka—Victoria University of Wellington. 

Tom is currently employed as a Research Assistant developing the design aspect of XR prototypes for gait training. He also works as a contracted illustrator and animator.