First time here? Check out the FAQ!
answered 2013-04-05 14:10:20 -0600
You could try how the kalman tracker performs, based on your skin segmented hand regions.
http://docs.opencv.org/modules/video/doc/motion_analysis_and_object_tracking.html#kalmanfilter