When the user feels that he or she is in trouble, he makes a particular hand gesture to Kompäi, who recognizes it so he can provide assistance.

This gesture recognition algorithm relies on the previous human detection, tracking and behaviour analysis algorithms developed during this project. These algorithms have been designed so that they can cope with real images observed by the modified Kompaï robot in a typical home environment.