Abstract

Marwa will present ‘Automatic Detection of Naturalistic Hand-over-Face Gesture Descriptors’:

One of the main factors that limit the accuracy of facial analysis systems is hand occlusion. As the face becomes occluded, facial features are either lost, corrupted or erroneously detected. Hand-over-face occlusions are considered not only very common but also very challenging to handle. Moreover, there is empirical evidence that some of these hand-over-face gestures serve as cues for recognition of cognitive mental states. In this paper, we detect hand-over-face occlusions and classify hand-over-face gesture descriptors in videos of natural expressions using multi-modal fusion of different state-of-the-art spatial and spatio-temporal features.

We show experimentally that we can successfully detect face occlusions with an accuracy of 83%. We also demonstrate that we can classify gesture descriptors (hand shape, hand action and facial region occluded) significantly higher than a naive baseline. To our knowledge, this work is the first attempt to automatically detect and classify hand-over-face gestures in natural expressions.

—-

Erroll will demonstrate NetBoards:

NetBoards are situated displays designed to fulfil and augment the role of non-digital personal noticeboards in the workplace. By replacing these with large, networked, touch-enabled displays, we replicate the existing physical systems’ flexibility and ease-of-use, while enabling more expressive content creation techniques and remote connectivity.

NOTE : This will be a very short presentation (~1 minute) as practice for a “Poster and Demo Madness session” at ITS 2014