About Us ICGers Projects Publications Useful Links Activities
 

Automatic Analysis and Synthesis of Human Hand Gestures from Image Sequence Using an Anatomy-Based Hand Model

INVESTIGATORS

Prof. Horace H. S. Ip,  Maria S. W. Lam


BRIEF DESCRIPTION

Hand motion analysis is important for various applications ranging from athletic performance analysis to advanced human-computer interaction.  Many researchers have attempted to track or simulate the real hand motion and/or recognize specific gesture from a series of hand movements.

The aim of this research is to investigate methods that drive an anatomical correct hand model which was previously constructed in the project "Dynamic Modelling of Human Limbs with Applications in Graphical Animation". A hand gesture coding system which we called Hand Action Coding System (HACS) is presented. It is used to codify hand motion in term of hand muscle activation commands. With HACS, the simulation allows specification of hand motion in a high level manner. The underlying computation complexities of motion simulation are separated from the high level motion descriptions. When humans want to perform some hand functions or hand gestures, the brain gives instructions and activates the corresponding hand muscles. HACS codifies hand gestures in terms of these hand muscle action units (HAU). When combined with our anatomy-based hand model, HACS ease the specification of complex hand gestures/motion animation sequence.
 

FUNDING AGENCY
N/A
PUBLICATIONS
  1. Horace H S Ip, Maria S W Lam, Ken C K Law, Sam C S Chan, "Animation of Hand Motion from Target Posture Images Using an Anatomy-Based Hierarchical Model", Computers & Graphics, vol. 25, no. 1, pp. 121-133, 2001.
  2. Horace H S Ip, Sam C. S. Chan and Maria S. W. Lam,  “Hand Gesture Animation from Static Postures Using an Anatomy-Based Model”, Proc. Computer Graphics International 2000, Geneva, Switzerland, pp. 29-36, June 19-24 2000.
  3. Horace H S Ip, Sam C. S. Chan and Maria S. W. Lam, “Hand Action Coding System for Hand Gesture Simulation”, Proc. of International Conference on Image and Graphics 2000, Tianjin, China, pp. 626-629, August 16-18 2000.
  4. Horace H S Ip, Sam C. S. Chan and Maria S. W. Lam, HACS: Hand Action Coding System for Anatomy-Based Synthesis of Hand Gestures, Proc. 1998 IEEE Int’l Conf. Systems, Man, and Cybernetics, San Diego, California, USA, pp. 1207-1212, Oct. 11-14 1998.


FIGURES OR IMAGES

Figure 1. Different views of the hand model.
 
 

Figure 2. The frontal view of postures "Open Palm",
ASL number "One" and ASL number "Two".
done by human hand.
 
 

Figure 3. Example simulated result of "Open Palm",
ASL number "One" and ASL number "Two".
done by the hand model.