DEICTIC: a Compositional and Declarative Gesture Description based on Hidden Markov Model

TitleDEICTIC: a Compositional and Declarative Gesture Description based on Hidden Markov Model
Publication TypeJournal Article
Year of Publication2019
AuthorsCarcangiu, A, Spano, LDavide, Fumera, G, Roli, F
JournalInternational Journal of Human-Computer Studies
Start Page113
ISSN Number1071-5819
KeywordsClassification, Compositional gesture modelling, Declarative gesture modelling, Gestures, Hidden Markov Models

The consumer-level devices tracking user's gestures eased the design and the implementation of interactive applications relying on body movements as input.

Gesture recognition based on computer vision and machine-learning mainly focus on accuracy and robustness. The resulting classifiers label precisely gestures after their performance, but they do not provide intermediate information during the execution. Human-Computer Interaction research focused instead on providing an easy and effective guidance for performing and discovering interactive gestures. The compositional approaches developed for solving such problem provide information on both the whole gesture and on its sub-parts, but they exploit heuristic techniques that have a low recognition accuracy. In this paper, we introduce DEICTIC, a compositional and declarative description for stroke gestures, which uses basic Hidden Markov Models (HMMs) to recognise meaningful predefined primitives (gesture sub-parts) and it composes them to recognise complex gestures. It provides information for supporting gesture guidance and it reaches an accuracy comparable with state-of-the-art approaches, evaluated on two datasets from the literature. Through a developer evaluation, we show that the implementation of a guidance system with DEICTIC requires an effort comparable to compositional approaches, while the definition procedure and the perceived recognition accuracy is comparable to machine learning approaches.

Citation Key1414
Refereed DesignationRefereed
Carcangiu_2019.pdf1.69 MB