Abstract: The present disclosure relates to system and method for gesture recognition for emulating a mouse for human machine interface wherein displacements, direction of displacements of cursor as also double click actions of mouse can be emulated by instinctive hand gestures. The method uses a marker as gesture interface and therefore does not depend on hand segmentation techniques, which suffer from deficiencies related to lighting conditions, variation of skin color from person to person and complexities of background.