Abstract: Techniques of allowing users of computer devices to interact with any augmented reality (AR) based multi-media information using simple and intuitive hand gestures are disclosed. According to one aspect of the present invention, an image capturing device (e.g., a video or photo camera) is used to generate images from which a pre-defined hand gesture is identified in a target image for displaying AR information. In addition, a hand trajectory may be detected from a sequence of images while the hand is moving with respect to the target. Depending on implementation, the target may be a marker or a markerless image.