Abstract: This disclosure relates generally to ROI marking, and more particularly to system and method for marking ROI in a media stream using touchless hand gesture interface such as headmount devices. In one embodiment, the method includes recognizing a pointing object representative of a gesture in frames of the media stream while capturing the media stream. The media stream comprises a scene captured from a first person view (FPV) of a user. Locus of the pointing object is detected in subsequent frames subsequent of the media stream to select a ROI in the media stream. The locus of the pointing object configures a bounding box around the ROI. The ROI is tracked in frames of the media stream occurring subsequent to the subsequent frames in the media stream. The bounding box is updated around the ROI based on the tracking, wherein the updated bounding box encloses the ROI.

Abstract: This disclosure relates generally to hand-gesture recognition, and more particularly to system and method for detecting interaction of 3D dynamic hand gestures with frugal AR devices. In one embodiment, a method for hand-gesture recognition includes receiving frames of a media stream of a scene captured from a FPV of a user using RGB sensor communicably coupled to a wearable AR device. The media stream includes RGB image data associated with the frames of the scene. The scene comprises a dynamic hand gesture performed by the user. Temporal information associated with the dynamic hand gesture is estimated from the RGB image data by using a deep learning model. The estimated temporal information is associated with hand poses of the user and comprises key-points identified on user's hand in the frames. Based on said temporal information, the dynamic hand gesture is classified into predefined gesture classes by using multi-layered LSTM classification network.

Abstract: This disclosure relates generally to hand-gesture recognition, and more particularly to system and method for detecting interaction of 3D dynamic hand gestures with frugal AR devices. In one embodiment, a method for hand-gesture recognition includes receiving frames of a media stream of a scene captured from a FPV of a user using RGB sensor communicably coupled to a wearable AR device. The media stream includes RGB image data associated with the frames of the scene. The scene comprises a dynamic hand gesture performed by the user. Temporal information associated with the dynamic hand gesture is estimated from the RGB image data by using a deep learning model. The estimated temporal information is associated with hand poses of the user and comprises key-points identified on user's hand in the frames. Based on said temporal information, the dynamic hand gesture is classified into predefined gesture classes by using multi-layered LSTM classification network.

Abstract: This disclosure relates generally to ROI marking, and more particularly to system and method for marking ROI in a media stream using touchless hand gesture interface such as headmount devices. In one embodiment, the method includes recognizing a pointing object representative of a gesture in frames of the media stream while capturing the media stream. The media stream comprises a scene captured from a first person view (FPV) of a user. Locus of the pointing object is detected in subsequent frames subsequent of the media stream to select a ROI in the media stream. The locus of the pointing object configures a bounding box around the ROI. The ROI is tracked in frames of the media stream occurring subsequent to the subsequent frames in the media stream. The bounding box is updated around the ROI based on the tracking, wherein the updated bounding box encloses the ROI.