Real time hand-face tracking using skin color and motion

Abstract

Human hand gestures and face expressions are a major tool for communicating ideas between people. Hand gestures may also account for the main part of the communication when other tools are not preferred or simply not available. First step for an automatic interpretation of these gestures and expressions is their segmentation and tracking. We have developed an algorithm to track hand motions in real time. Our algorithm is based on the motion and color features of the interested areas. A modified form of Adaptive Mean Shift method is used for tracking hands and face. A rule based system monitors the correctness of the segmentation and tracking.