Overview
The project was a collaboration between TaikaBox and Moon, the latter I co-founded as the creative director. Collectively we submitted a tender to the Digital R&D Fund for the Arts in Wales, supported by Nesta, the Arts & Humanities Research Council and publicly funded by the National Lottery through the Arts Council of Wales.
The primary objective of the research was to create a digital choreographic system that allowed two different audience types to engage and collaborate in real-time performances.
The audience types were as follows:
- A theatre audience using a mobile phone or a compatible connected device.
- An online audience using a desktop computer, laptop, or tablet.
The research lasted approximately one year, with four test performances at various theatre locations across Wales.
Web-based browser vs. native app
Initially, we discussed developing a native application; however, considering the following factors, we decided to develop a web application:
- The plethora of mobile devices on the market.
- The advantageous time frame and ease of prototyping in HTML and Javascript.
- The potential requirement for the audience to download a mobile app, which would introduce friction to the user experience.
Learning to embrace failure
As designers and technologists we wanted to push technology to make the experience interactive, whilst our partners aims were to create a engaging and credible performance.
Our first research session took place at Sherman Cymru in Cardiff. The performance involved a large audience in a mid-scale theatre with up to 25 dancers on stage. Feedback from the event was polarised, with some audience members disliking it while others enjoying it. The majority perceived the experience as bewildering, a feeling compounded by the sheer volume of activity on stage and the complexity of the digital experience. Technical issues and audience expectations further contributed to this.
Use technology to solve problems
Based on the audience feedback, we went back to the drawing board. While the performance may have failed to address the original problem, we learned valuable lessons. The most obvious, use technology to solve problems, not create them.
Based on the feedback, we decided to focus on two things:
- Audience collaboration
- The purity of the performance
- Before the performance begins, the audience is invited to log onto the website and submit a story.
- Stories that pass moderation are projected onto the big screen at the back of the stage. Using their phones, the audience can vote for their favorite stories.
- The choreographer and dancers then take the most popular story and start to work on simple vignettes.
- The audience is invited to vote on certain characteristics, such as choosing dancers, determining the pace of the performance, or shaping the movements.
- The choreographer invites the audience to vote on whether a story development should continue. If the audience decides to move on, the process starts again.
The third test took place at Aberystwyth University and involved a smaller audience. An open dialogue with the audience and performers was established. The mobile device became a useful tool to facilitate ideas and capture feedback. This approach demystified the on-stage activities, while still engaging the audience as collaborators and co-creators.
The final test at Y Fwrness, Llanelli, involved streaming the performance online. A simple user UI was developed, enabling the online audience to:
- Contribute and vote on stories
- Watch a live video feed
- Vote on the development of each performance
Importantly, a 20-30 second latency was identified and built into the performance, allowing online participants time to participate.
Conclusion
While we simplified the overall concept following our initial failings, the subsequent performances proved to be highly successful. From our initial failures, we demonstrated the ability to use technology to increase audience engagement. As a result, Taika Box continues to incorporate the system into its work today.