Social Play in Immersive Gaming Environments

Project overview

Gaming drives forward the adoption of Natural User Interfaces (NUIs), particularly facilitated by the Microsoft Xbox Kinect. However, while there is substantial research into the user experience of NUIs in work-like computer tasks, very little research has examined NUI in the context of games and immersive environments. We believe that the game context of NUI is relevant to the use of these technologies due to different experiences when immersed or embodied.

Research under this project will generate knowledge about designing with NUIs in social games through multiple case studies that interrogate social play in games. The agenda of research is multi-modal in implementation, and aims to contribute a rich understanding regarding the relationship between game embodiment, immersion and interface design.

In addition to academic publications, the researchers aim to communicate results in game development blogs, host talks at game conventions, demonstrate and exemplify findings through videos, and develop a basic game that demonstrates the foundation of our design guidelines.

Social Voice

Voice is widely used in social gameplay, particularly competitive gameplay, as a communication modality between players where it has been shown to vastly improve player experience. However, when configured as an input device for play, voice is an extremely maligned and rarely used modality.  In this case study, we seek to understand the parameters of designing for voice interaction in multiplayer games through a study of existing practices, and through the evaluation of for-purpose experimental games.

This project is led by PhD student Fraser Allison, under the supervision of Martin Gibbs and Marcus Carter.

Social Gaze

EyePlay research seeks to understand how gaze detection technologies can provide new and novel player experiences. This project examines how gaze affects and can create social player experiences in multiplayer games, through exploring its detection and display.

This project is led by PhD student Joshua Newn, under the supervision of Frank Vetere, Eduardo Velloso and Marcus Carter.

Social Tabletop

Tabletop gaming is a highly social situation due to the configuration of players and the social interactions afforded by tabletop game pieces. This project examines non-digital tabletop games and their digitisations to identify opportunities for NUI technologies to afford social play. This project is led by PhD student Melissa Rogerson, under the supervision of Wally Smith and Martin Gibbs.

Social Minecraft

The sandbox-world builder game Minecraft is exceedingly popular, near ubiquitous in children between 8–12 and was recently purchased for $2billion dollars by Microsoft. This popularity, and its emphasis on creative world building, social interactions and cooperation have seen it adopted in schools and released as a standalone Minecraft for Education project. However, very little is known about the social play of Minecraft and how it can support opportunities for social learning. This project is led by PhD student Jane Movoa, under the supervision of Martin Gibbs and Marcus Carter.

Project team

  • Eduardo Velloso, Research Fellow, Microsoft Research Centre for SocialNUI, University of Melbourne
  • Frank Vetere
    Frank Vetere, Professor & Director, Microsoft Research Centre for SocialNUI, University of Melbourne
  • Martin Gibbs, Associate Professor, Department of Computing and Information Systems, University of Melbourne
  • Wally Smith, Senior Lecturer, Department of Computing and Information Systems, University of Melbourne
  • Fraser Allison, PhD Candidate, Microsoft Research Centre for SocialNUI, University of Melbourne
  • Joshua Newn, PhD Candidate, Microsoft Research Centre for SocialNUI, University of Melbourne
  • Melissa Rogerson, PhD Candidate, Microsoft Research Centre for SocialNUI, University of Melbourne
  • Jane Mavoa, PhD Candidate, Microsoft Research Centre for SocialNUI, University of Melbourne
  • Brandon Syiem, Masters Student, Microsoft Research Centre for SocialNUI, University of Melbourne
  • Robbie Fordyce, SocialNUI Researcher, Microsoft Research Centre for SocialNUI, University of Melbourne
  • Marcus Carter, Department of Media and Communications, University of Sydney

Contact details

Publications

Carter, M., Fordyce, R., Gibbs, M., Robertson, N., & Witkowski, E., (in press) eSports Spectatorship in Australia. In Proceedings of the 2016 DiGRA Australia Conference, Melbourne [PDF]

Velloso, E. (in press) Game Controller Research from the Lab into the Wild: The Case of Eye Tracking. In Proceedings of the 2016 DiGRA Australia Conference, Melbourne [PDF]

Velloso, E. & Carter, M. (2016) The Emergence of EyePlay: A Survey of Eye Interaction in Games. In Proceedings of the 2016 Annual Symposium on Computer-Human Interaction in Play (CHI Play 2016). Austin, TX, USA [PDF]

Newn, J., Velloso, E., Carter, M. & Vetere, F. (2016). Exploring the Effects of Gaze Awareness on Multiplayer Gameplay. In Proceedings of the 2016 Annual Symposium Extended Abstracts on Computer-Human Interaction in Play (CHI PLAY 2016). Austin, TX, USA [DOI] [PDF]

Newn, J., Velloso, E., Carter, M. & Vetere, F. (2016). Dynamically Exposing Gaze to Foster Playful Experiences in Multiplayer Gameplay. In CHI PLAY 2016 Workshop on Designing for Emotional Complexity in Games: The Interplay of Positive and Negative Affect. Austin, TX, USA [PDF]

Newn, J., Velloso, E., Carter, M. & Vetere, F. (In Press). Multimodal Segmentation of a Large Interactive Tabletop: Extending Interaction on Horizontal Surfaces with Gaze. In Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces (ISS 2016). Niagara Falls, ON, Canada [PDF]

Allison, F., Carter, M., & Gibbs, M. (In Press). A History of Voice Interaction in Games. In Proceedings of the First Joint International Conference of DiGRA and FDG [PDF]

Rogerson, M. J., Gibbs, M., & Smith, W. (2016) "I Love All the Bits": The Materiality of Boardgames. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI 2016), New York: ACM Press, pp. 3956–3969 [DOI]

Carter, M., Newn, J., Velloso, E., & Vetere, F. (2015) Remote Gaze and Gesture Tracking on the Microsoft Kinect: Investigating the Role of Feedback. In Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction (OzCHI 2015) New York: ACM Press, pp. 167–176 [DOI]

Allison, F., Carter, M., & Gibbs, M. (2015). Good Frustrations: The Paradoxical Pleasure of Fearing Death in DayZ. In Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction (OzCHI 2015) New York: ACM Press, pp. 119–123. [DOI]

Carter, M., Allison, F., Downs, J., & Gibbs, M. (2015). Player Identity Dissonance and Voice Interaction in Games. In Proceedings of the 2015 Annual Symposium on Computer-Human Interaction in Play (CHI Play 2015) New York: ACM Press, pp. 265–269 [DOI]

Rogerson, M. J., Gibbs, M., & Smith, W. (2015) Digitising Boardgames: Issues and Tensions, In Proceedings of the 2015 DiGRA International Conference. Lüneburg, Germany [PDF]

Carter, M., Nansen B., Gibbs, M. (2014) Screen Ecologies, Multi-Gaming and Designing for Different Registers of Engagement. In Proceedings of CHI Play, ACM Press, pp. 37–46. [PDF, DOI]

Media