Abstract: Described herein is a method for enabling human-to-computer three-dimensional hand gesture-based natural interactions from depth images provided by a range finding imaging system. The method enables recognition of simultaneous gestures from detection, tracking and analysis of singular points of interests on a single hand of a user and provides contextual feedback information to the user. The singular points of interest of the hand: include hand tip(s), fingertip(s), palm center and center of mass of the hand, and are used for defining at least one representation of a pointer. The point(s) of interest is/are tracked over time and are analyzed to enable the determination of sequential and/or simultaneous “pointing” and “activation” gestures performed by a single hand.

Abstract: Described herein is a method for enabling human-to-computer three-dimensional hand gesture-based natural interactions from depth images provided by a range finding imaging system. The method enables recognition of simultaneous gestures from detection, tracking and analysis of singular points of interests on a single hand of a user and provides contextual feedback information to the user. The singular points of interest of the hand: include hand tip(s), fingertip(s), palm centre and centre of mass of the hand, and are used for defining at least one representation of a pointer. The point(s) of interest is/are tracked over time and are analysed to enable the determination of sequential and/or simultaneous “pointing” and “activation” gestures performed by a single hand.

Abstract: Described herein is a method and a system for providing efficient and complementary natural multi-modal gesture based interaction with a computerized system which displays visual feedback information on a graphical user interface on an interaction surface. The interaction surface is within the frustum of an imaging device comprising a single sensing system. The system uses the single sensing system for detecting both touch gesture interactions with the interaction surface (120) and three-dimensional touch-less gesture interactions in areas or volumes above the interaction surface performed by hands of a user. Both types of interaction are associated contextually with an interaction command controlling the computerized system when the gesture has been detected.

Abstract: Described herein is a method for correcting defective depth values in depth map images. Defective values correspond to “noisy pixels” located on continuous flat surfaces and interpolated “flying pixels” located along an edge between a foreground object and a background object. The method comprising the steps of accessing a depth map of a scene which includes the foreground and background objects, detecting and identifying noisy and interpolated depth measurements within the depth map using a method, defining and applying a correction to each of the detected defective noisy and interpolated depth measurements using a specifically defined weighted correction factor. By providing the corrected defective depth values in depth map images, edges are sharpened in depth and continuous surfaces are flattened, enabling higher efficiency and robustness of further image processing.

Abstract: Described herein is a method and system for marker-less three-dimensional modelling, fitting and tracking of a skeletal representation of an object in a three-dimensional point cloud. In particular, it concerns the tracking of a human user skeletal representation with respect to time. The method comprises inputting a three-dimensional point cloud derived from a depth map; predetermining a set of control points representing the skeleton of the user, determining a start-up skeleton pose, obtaining an orthographic representation of the user 3D point cloud projected onto a grid by sampling the 3D point cloud with a predetermined static size, determining a set of curvature centers points approximating central axes of main parts of the user, determining the torso plane, and refining and/or defining the principal direction of the body.

Abstract: Described herein is a method for detecting, identifying and tracking hand, hand parts, and fingers on the hand (500) of a user within depth images of a three-dimensional scene. Arms of a user are detected, identified, segmented from the background of the depth images, and tracked with respect to time. Hands of the user are identified and tracked and the location and orientation of its parts, including the palm and the fingers (510, 520, 530, 540, 550) are determined and tracked in order to produce output information enabling gesture interactions.

Abstract: Described herein is a method for enabling human-to-computer three-dimensional hand gesture-based natural interactions from depth images provided by a range finding imaging system. The method enables recognition of simultaneous gestures from detection, tracking and analysis of singular points of interests on a single hand of a user and provides contextual feedback information to the user. The singular points of interest of the hand: include hand tip(s), fingertip(s), palm centre and centre of mass of the hand, and are used for defining at least one representation of a pointer. The point(s) of interest is/are tracked over time and are analysed to enable the determination of sequential and/or simultaneous “pointing” and “activation” gestures performed by a single hand.

Abstract: Described herein is a method for detecting, identifying and tracking hand, hand parts, and fingers on the hand (500) of a user within depth images of a three-dimensional scene. Arms of a user are detected, identified, segmented from the background of the depth images, and tracked with respect to time. Hands of the user are identified and tracked and the location and orientation of its parts, including the palm and the fingers (510, 520, 530, 540, 550) are determined and tracked in order to produce output information enabling gesture interactions.

Abstract: The present invention relates to a method for tracking at least one object in a sequence of frames, each frame comprising a pixel array, wherein a depth value is associated to each pixel. The method comprises grouping at least some of said pixels of each frame into several regions, grouping said regions into clusters (B1, . . . , B5) of interconnected regions; and determining that a cluster (B2, . . . , B5) which is adjacent to another cluster (B1) in a two-dimensional projection belongs to an object partially occluded by said other cluster (B1) if it has a different depth value than said other cluster (B1).

Abstract: Described herein is a method and system for marker-less three-dimensional modelling, fitting and tracking of a skeletal representation of an object in a three-dimensional point cloud. In particular, it concerns the tracking of a human user skeletal representation with respect to time. The method comprises inputting a three-dimensional point cloud derived from a depth map; predetermining a set of control points representing the skeleton of the user, determining a start-up skeleton pose, obtaining an orthographic representation of the user 3D point cloud projected onto a grid by sampling the 3D point cloud with a predetermined static size, determining a set of curvature centres points approximating central axes of main parts of the user, determining the torso plane, and refining and/or defining the principal direction of the body.

Abstract: Described herein is a method for correcting defective depth values in depth map images. Defective values correspond to “noisy pixels” located on continuous flat surfaces and interpolated “flying pixels” located along an edge between a foreground object and a background object. The method comprising the steps of accessing a depth map of a scene which includes the foreground and background objects, detecting and identifying noisy and interpolated depth measurements within the depth map using a method, defining and applying a correction to each of the detected defective noisy and interpolated depth measurements using a specifically defined weighted correction factor. By providing the corrected defective depth values in depth map images, edges are sharpened in depth and continuous surfaces are flattened, enabling higher efficiency and robustness of further image processing.

Abstract: The present invention relates to a method for tracking at least one object in a sequence of frames, each frame comprising a pixel array, wherein a depth value is associated to each pixel. The method comprises grouping at least some of said pixels of each frame into several regions, grouping said regions into clusters (B1, . . . , B5) of interconnected regions; and determining that a cluster (B2, . . . , B5) which is adjacent to another cluster (B1) in a two-dimensional projection belongs to an object partially occluded by said other cluster (B1) if it has a different depth value than said other cluster (B1).