MINT team

Tools and methods for gesture-based interaction

Leader: Laurent Grisoni



The MINT team focuses on gestural interaction, i.e. the use of gesture for human-computer interaction (HCI). The New Oxford American Dictionary defines gesture as a movement of part of the body, especially a hand or the head, to express an idea or meaning. In the particular context of HCI, we are more specifically interested in movements that a computing system can sense and respond to. A gesture can thus be seen as a function of time into a set of sensed dimensions that might include, but is not limited to positional information (the pressure exerted on a contact surface being an example of non-positional dimension).

Simple pointing gestures have long been supported by interactive graphics systems and the advent of robust and affordable sensing technologies has somewhat broadened the use of gestures. Swiping, rotating and pinching gestures are now commonly supported on touch-sensitive devices, for example. Yet the expressive power of the available gestures remains limited. The increasing diversity and complexity of computer-supported activities calls for more powerful gestural interactions. Our goal is to foster the emergence of these new interactions, to further broaden the use of gesture by supporting more complex operations. We are developing the scientific and technical foundations required to facilitate the design, implementation and evaluation of these interactions. Our interests include:

  • Gestures captured using held, worn or touched objects (e.g. a mouse, a glove or a touchscreen) or contactless perceptual technologies (e.g. computer vision);
  • Computational representations of these gestures;
  • Methods for characterizing and recognizing them;
  • Feedback mechanisms, and more particularly haptic ones;
  • Engineering tools to facilitate the implementation of gestural interaction techniques;
  • Evaluation methods to assess their usability.
  • Application domains such as those of virtual reality, creative/leisure activities, art and culture.

Cagan Arslan

Fusion de données pour l'interaction homme-machine

Olivier Capra

Interaction de présentation : Outils pour la modulation de l'expérience des spectateurs

Vincent Reynaert

Mid-air Gestural Interaction and Fatigue

Théo Voillemin

Système d'assistance gestuelle personnalisée en combinant des techniques de la vision par ordinateur et la réalité augmentée

Farzan Kalantari

Haptic Feedback Displays with Programmable Friction : Interaction and Texture Perception 2018-07-05

Hanaë Rateau

Exploring Interactive Sub-spaces for gestural midair interaction 2017-05-17

Jérémie Gilliot

Interactions multi-points indirectes sur grands écrans 2014-02-26

Elena-Gina Craciun

Nouvelles interfaces pour la simulation des opérations d'assemblage dans des environnements virtuels 2013-02-01

Jean-Philippe Deblonde

Exploitation de la dynamique du geste en IHM application aux fonctions de transfert pour le pointage et l'extraction d'événements discrets. 2012-09-28

Jeremy Ringard

Un modèle de conception dédié à l'interaction collaborative colocalisée 2011-10-07

Anthony Martinet

Etude de l'influence de la séparation des degrés de liberté pour la manipulation 3-D à l'aide de surfaces tactiles multipoints 2011-10-03

Quan Xu

Contribution à l'étude et au développement de techniques de gestion de fenêtres 2010-12-15

Haibo Wang

Communication around 3D models : face representation and gaze 2010-09-24

Qing Pan

Techniques d'interactions mixtes isotonique et élastique pour la sélection 2D et la navigation / manipulation 3D 2008-12-19

Guillaume Saupin

Vers la simulation interactive réaliste de corps déformables 2008-11-26

Radu-Daniel Vatavu

Real-Time acquisition of human gestures for interacting with virtual environments 2008-03-18

Adrien Theetten

Splines Dynamiques Géométriquement Exactes: simulation haute performance et interaction 2007-12-12

Géry Casiez

Du mouvement à l’interaction et au geste : études, techniques, outils et périphériques 2012-11-12

Other ' I2C : Interaction et Intelligence Collective ' teams