Abstract: Described herein is a wireless remote control device (100) which can be used on the hand (150) of a user to provide both hardware-based control signals which can be associated with gesture-based control signals for enhanced gesture recognition systems. The device (100) comprises a housing (110) having a sensing unit having at least one control button (120, 130, 140) which is capable of generating a control signal for an associated computerized system. A computerized system utilizes information obtained from the control device (100) together with information obtained from a gesture recognition system to resolve any ambiguities due to, for example, occlusion of the hand performing the gesture or the hand being outside the field of view of an imaging system associated with the computerized system, and to trigger interactions within the gesture based interaction system.

Abstract: Described herein is a method for enabling human-to-computer three-dimensional hand gesture-based natural interactions. From depth images provided by a range finding imaging system, the method enables efficient and robust detection of a particular sequence of natural gestures including a beginning (start), and an ending (stop) of a predetermined type of natural gestures for delimiting the period during which a control (interaction) gesture is operating in an environment wherein a user is freely moving his hands. The invention is more particularly, although not exclusively, concerned by detection without any false positives nor delay, of intentionally performed natural gesture subsequent to a starting finger tip or hand tip based natural gesture so as to provide efficient and robust navigation, zooming and scrolling interactions within a graphical user interface up until the ending finger tip or hand tip based natural gesture is detected.

Abstract: Described herein is a method and sensor of processing time-of-flight (TOF) signals in a TOF camera system including an illumination unit and an imaging sensor. The method comprises illuminating the scene with light at a first frequency, detecting reflected light from at least one object in the scene at the first frequency, and determining a phase measurement using I and Q values. In addition, the scene is illuminated with light at a second frequency, the second frequency being 2?n of the first frequency where n=1, 2, . . . , etc., and the signs of I and Q values for both the first and second frequencies is used to determine the presence of aliasing in the phase measurement so that it can be corrected. The phase measurement is then corrected for aliasing and the effective range of the TOF camera system is extended by multiples of 2n. In addition, relative signal strength needs to be considered in accordance with the reflectivity of objects within the scene.

Abstract: Described herein is a method and system for marker-less three-dimensional modelling, fitting and tracking of a skeletal representation of an object in a three-dimensional point cloud. In particular, it concerns the tracking of a human user skeletal representation with respect to time. The method comprises inputting a three-dimensional point cloud derived from a depth map; predetermining a set of control points representing the skeleton of the user, determining a start-up skeleton pose, obtaining an orthographic representation of the user 3D point cloud projected onto a grid by sampling the 3D point cloud with a predetermined static size, determining a set of curvature centers points approximating central axes of main parts of the user, determining the torso plane, and refining and/or defining the principal direction of the body.

Abstract: The present invention relates to a color and non-visible light e.g. IR sensor, namely a multispectral sensor which can be used in a camera such as a TOF camera for depth measurement, reflectance measurement and color measurement, and for generation of 3D image data or 3D images as well as the camera itself and methods of operating the same.

Abstract: Described herein is a method for detecting, identifying and tracking hand, hand parts, and fingers on the hand (500) of a user within depth images of a three-dimensional scene. Arms of a user are detected, identified, segmented from the background of the depth images, and tracked with respect to time. Hands of the user are identified and tracked and the location and orientation of its parts, including the palm and the fingers (510, 520, 530, 540, 550) are determined and tracked in order to produce output information enabling gesture interactions.

Abstract: The present invention relates to a method for stabilizing a series of measurements of a physical variable captured by a digital sensor. This method comprises the steps of: capturing at least a first measurement, a second measurement, and a third measurement of said physical variable and storing each measurement in a digital memory. The first and second measurements are compared and, if a difference between the first measurement and the second measurement is below a predetermined threshold, the second measurement is replaced in the memory by a corrected second measurement where the difference with respect to said first measurement has been reduced using a first filtering strength.

Abstract: Described herein is a method for recognizing a human head in a source image. The method comprises detecting a contour of at least part of a human body in the source image, calculating a depth of the human body in the source image. From the source image, a major radius size and a minor radius size of an ellipse corresponding to a human head at the depth is calculated, and, for at least several of a set of pixels of the detected contour, generating in an accumulator array at least one segment of an ellipse centered on the position of the contour pixel and having the major and minor radius sizes. Positions of local intensity maxima in the accumulator array are selected as corresponding to positions of the human head candidates in the source image.

Abstract: Described herein is a user interface that provides contextual feedback, controls and interface elements on a display screen of an interactive three-dimensional imaging system. A user interacts with the interface to provide control signals in accordance with those recognized by the system to a makes use of at least one POI in a three-dimensional scene that is imaged by the imaging system to provide control signals for the user interface. Control signals are provided by means of gestures which are analyzed in real-time by gesture recognition processes that analyze statistical and geometrical properties of POI motion and trajectories.

Abstract: Described herein is a method of calibrating a three-dimensional imaging system. During calibration, a position and an orientation of the three-dimensional imaging system is determined with respect to a first parameter comprising a real world vertical direction (Vw) and to a second parameter comprising an origin of a three-dimensional scene captured by the imaging system. The first and second parameters are used to derive a calibration matrix (MC2w) which is used to convert measurements from a virtual coordinate system (Mc) of the three-dimensional imaging system into a real coordinate system (Mw) related to the real world. The calibration matrix (MC2w) is used to rectify measurements prior to signal processing. An inverse calibration matrix (Mw2c) is also determined. Continuous monitoring and adjustment of the setup of the three-dimensional imaging system is carried out and the calibration matrix (Mc2w) and its inverse (Mw2c) are adjusted accordingly.

Abstract: Described herein is a method for enabling human-to-computer three-dimensional hand gesture-based natural interactions from depth images provided by a range finding imaging system. The method enables recognition of simultaneous gestures from detection, tracking and analysis of singular points of interests on a single hand of a user and provides contextual feedback information to the user. The singular points of interest of the hand: include hand tip(s), fingertip(s), palm centre and centre of mass of the hand, and are used for defining at least one representation of a pointer. The point(s) of interest is/are tracked over time and are analysed to enable the determination of sequential and/or simultaneous “pointing” and “activation” gestures performed by a single hand.

Abstract: Described herein is a method for detecting, identifying and tracking hand, hand parts, and fingers on the hand (500) of a user within depth images of a three-dimensional scene. Arms of a user are detected, identified, segmented from the background of the depth images, and tracked with respect to time. Hands of the user are identified and tracked and the location and orientation of its parts, including the palm and the fingers (510, 520, 530, 540, 550) are determined and tracked in order to produce output information enabling gesture interactions.

Abstract: Described herein is a wireless remote control device (100) which can be used on the hand (150) of a user to provide both hardware-based control signals which can be associated with gesture-based control signals for enhanced gesture recognition systems. The device (100) comprises a housing (110) having a sensing unit having at least one control button (120, 130, 140) which is capable of generating a control signal for an associated computerised system. A computerised system utilises information obtained from the control device (100) together with information obtained from a gesture recognition system to resolve any ambiguities due to, for example, occlusion of the hand performing the gesture or the hand being outside the field of view of an imaging system associated with the computerised system, and to trigger interactions within the gesture based interaction system.

Abstract: The present invention relates to a method for tracking at least one object in a sequence of frames, each frame comprising a pixel array, wherein a depth value is associated to each pixel. The method comprises grouping at least some of said pixels of each frame into several regions, grouping said regions into clusters (B1, . . . , B5) of interconnected regions; and determining that a cluster (B2, . . . , B5) which is adjacent to another cluster (B1) in a two-dimensional projection belongs to an object partially occluded by said other cluster (B1) if it has a different depth value than said other cluster (B1).

Abstract: The invention relates to a method for providing distance information of a scene with a time-of-flight camera (1), comprising the steps of emitting a modulated light pulse towards the scene, receiving reflections of the modulated light pulse from the scene, evaluating a time-of-flight information for the received reflections of the modulated light pulse, and deriving distance information from the time-of-flight information for the received reflections, whereby a spread spectrum signal is applied to a base frequency of the modulation of the light pulse, and the time-of-flight information is evaluated under consideration of the a spread spectrum signal applied to the base frequency of the modulation of the light pulse. The invention further relates to a time-of-flight camera (1) for providing distance information from a scene, whereby the time-of-flight camera (1) performs the above method.

Abstract: Impinging electromagnetic radiation generates pairs of majority and minority carriers in a substrate. A spectrometer device for detection of electromagnetic radiation impinging on a substrate comprises means for generating, in the substrate, a majority carrier current; at least one detection region for collecting generated minority carriers, the minority carriers being directed under influence of the majority carrier current; and means for determining spectral information based on minority carriers collected at the at least one detection region.

Abstract: A method for measuring time of flight of radiation includes emitting modulated radiation (51) in response to a first modulation signal, projecting the modulated radiation (51) onto a scene (55), and receiving radiation, the received radiation including at least modulated radiation reflected by the scene (55). The received radiation (26, 27) is converted into a radiation induced electrical signal. The radiation induced electrical signal is mixed with a second modulation signal, thus generating a mixed signal, which is integrated, thus generating an integrated signal. When the integrated signal exceeds a threshold value (Vref), charge is injected into the integrated signal. The method includes applying changes to the first and/or second modulation signal at one or more moments in time, and measuring the integrated signal at one or more moments in time, thus obtaining at least one TOF pair difference signal (62).

Abstract: Described herein is a user interface that provides contextual feedback, controls and interface elements on a display screen of an interactive three-dimensional imaging system. A user interacts with the interface to provide control signals in accordance with those recognised by the system to a makes use of at least one POI in a three-dimensional scene that is imaged by the imaging system to provide control signals for the user interface. Control signals are provided by means of gestures which are analysed in real-time by gesture recognition processes that analyse statistical and geometrical properties of POI motion and trajectories.

Abstract: A videogame may include providing body position challenges to one or more players to assume various target body positions at, or within, a predetermined time. Body position challenges may be provided to the one or more players by displaying body position challenge representations that prompt the one or more players to assume body positions and/or execute one or more body movements or gestures corresponding to the body position challenges. The time may be indicated via various mechanisms associated with the display (as detailed below). At a given time or over a given time interval, the videogame system may compare the player's detected body position(s) and/or movement(s) to the body position challenges to determine a degree of match or mismatch based on various criteria. Based on the results of the comparison, the game may generate a score or other feedback for display.

Abstract: The present invention relates to a method for stabilising a series of measurements of a physical variable captured by a digital sensor. This method comprises the steps of: capturing at least a first measurement, a second measurement, and a third measurement of said physical variable and storing each measurement in a digital memory. The first and second measurements are compared and, if a difference between the first measurement and the second measurement is below a predetermined threshold, the second measurement is replaced in the memory by a corrected second measurement where the difference with respect to said first measurement has been reduced using a first filtering strength.