Abstract

This is a practice talk for the International Workshop on Intelligent Digital Games for Empowerment and Inclusion held in conjunction with Intelligent User Interfaces conference.

Facial expressions play a crucial role in human interaction. Interactive digital games can help teaching people to both express and recognise them. Such interactive games can benefit from the ability to alter user expressions dynamically and in real-time. This is especially important for people that have an impaired ability to understand and display facial expression, such as people with Autism Spectrum Disorders.

In this talk, we present the Facial Affect Mapping Engine (FAME), a framework for mapping and manipulating facial expression in real-time across images and video streams. Our system is fully automatic, and takes advantage of several computationally inexpensive methods to work in real-time, on generic hardware. FAME presents new possibilities for the designers of intelligent interactive digital games.