Abstract: Systems and methods for selecting an action associated with a power state transition of a head-mounted display (HMD) in the form of eyeglasses are disclosed. A signal may be received from a sensor on a nose bridge of the eyeglasses indicating if the HMD is in use. Based on the received signal, a first powers state for the HMD may be determined. Responsive to the determined first power state, an action associated with a power state transition of the HMD from an existing power state to the first power state may be selected. The action may be selected from among a plurality of actions associated with a plurality of state transitions. Also, the action may be a sequence of functions performed by the HMD including modifying an operating state of a primary processing component of the HMD and a detector of the HMD configured to image an environment.

Abstract: Systems and methods are disclosed for identifying objects captured by a depth camera by condensing classified image data into centroids of probability that captured objects are correctly identified entities. Output exemplars are processed to detect spatially localized clusters of non-zero probability pixels. For each cluster, a centroid is generated, generally resulting in multiple centroids for each differentiated object. Each centroid may be assigned a confidence value, indicating the likelihood that it corresponds to a true object, based on the size and shape of the cluster, as well as the probabilities of its constituent pixels.

Abstract: Systems and methods for selecting an action associated with a power state transition of a head-mounted display (HMD) in the form of eyeglasses are disclosed. A signal may be received from a sensor on a nose bridge of the eyeglasses indicating if the HMD is in use. Based on the received signal, a first powers state for the HMD may be determined. Responsive to the determined first power state, an action associated with a power state transition of the HMD from an existing power state to the first power state may be selected. The action may be selected from among a plurality of actions associated with a plurality of state transitions. Also, the action may be a sequence of functions performed by the HMD including modifying an operating state of a primary processing component of the HMD and a detector of the HMD configured to image an environment.

Abstract: Systems and methods for controlling a cursor on a display using a trackpad input device are disclosed. The systems and methods may be directed to controlling the cursor on a display separate from the trackpad input device, based on information identified about a motion of a trackpad input device or a computing device. A conversion factor may be determined to relate input to the trackpad input device with control of the cursor on the display in response to the input. The conversion factor can be adjusted when the motion information indicates that the trackpad input device or computing device is in motion. An input signal from an input to the trackpad input device may be smoothed by filtering out a mechanical vibration signal within the input signal. The input signal may also be smoothed by subtracting the absolute motion of the trackpad input device from the input signal.

Abstract: Disclosed are systems, methods, and devices for interfacing with a wearable heads-up display via a touch-operable input device. The wearable heads-up display may include a display element for receiving and displaying display information received from a processor, and may also include a wearable frame structure supporting the display element and having a side-arm extending away from the display element. In some embodiments, the display information may appear at least partially curved to a user. In some embodiments, only a portion of the display information is shown on the at least one display element. The side-arm may be configured to secure the heads-up display to a user's body in a manner such that the display element is disposed within a field of view of the user.

Abstract: Disclosed are systems, methods, and devices for interfacing with a wearable heads-up display via a touch-operable input device. The wearable heads-up display may include a display element for receiving and displaying display information received from a processor, and may also include a wearable frame structure supporting the display element and having a side-arm extending away from the display element. In some embodiments, the display information may appear at least partially curved to a user. In some embodiments, only a portion of the display information is shown on the at least one display element. The side-arm may be configured to secure the heads-up display to a user's body in a manner such that the display element is disposed within a field of view of the user.

Abstract: Methods and systems for unlocking a screen using eye tracking information are described. A computing system may include a display screen. The computing system may be in a locked mode of operation after a period of inactivity by a user. Locked mode of operation may include a locked screen and reduced functionality of the computing system. The user may attempt to unlock the screen. The computing system may generate a display of a moving object on the display screen of the computing system. An eye tracking system may be coupled to the computing system. The eye tracking system may track eye movement of the user. The computing system may determine that a path associated with the eye movement of the user substantially matches a path associated with the moving object on the display and switch to be in an unlocked mode of operation including unlocking the screen.

Abstract: A system and method are disclosed for recognizing and tracking a user's skeletal joints with a NUI system and further, for recognizing and tracking only some skeletal joints, such as for example a user's upper body. The system may include a limb identification engine which may use various methods to evaluate, identify and track positions of body parts of one or more users in a scene. In examples, further processing efficiency may be achieved by segmenting the field of view in smaller zones, and focusing on one zone at a time. Moreover, each zone may have its own set of predefined gestures which are recognized.

Abstract: A computing device may select a source tile from a source image. From the source tile, the computing device may select a first rectangular feature and a second rectangular feature. Based on the first and second rectangular features, the computing device may calculate a source feature vector. The computing device may also select a search area of a target image, and a target tile within the within the search area. Based on the target tile, the computing device may calculate a target feature vector. The computing device may determine that a difference between the source feature vector and the target feature vector is below an error threshold, and based on this determination, further determine a mapping between the source image and the target image. The computing device may then apply the mapping to the source image to produce a transformed source image.

Abstract: Systems and methods for controlling a cursor on a display using a trackpad input device are disclosed. The systems and methods may be directed to controlling the cursor on a display separate from the trackpad input device, based on information identified about a motion of a trackpad input device or a computing device. A conversion factor may be determined to relate input to the trackpad input device with control of the cursor on the display in response to the input. The conversion factor can be adjusted when the motion information indicates that the trackpad input device or computing device is in motion. An input signal from an input to the trackpad input device may be smoothed by filtering out a mechanical vibration signal within the input signal. The input signal may also be smoothed by subtracting the absolute motion of the trackpad input device from the input signal.

Abstract: Systems and methods for selecting an action associated with a power state transition of a head-mounted display (HMD) in the form of eyeglasses are disclosed. A signal may be received from a sensor on a nose bridge of the eyeglasses indicating if the HMD is in use. Based on the received signal, a first powers state for the HMD may be determined. Responsive to the determined first power state, an action associated with a power state transition of the HMD from an existing power state to the first power state may be selected. The action may be selected from among a plurality of actions associated with a plurality of state transitions. Also, the action may be a sequence of functions performed by the HMD including modifying an operating state of a primary processing component of the HMD and a detector of the HMD configured to image an environment.

Abstract: A system and method are disclosed for recognizing and tracking a user's skeletal joints with a NUI system. The system includes one or more experts for proposing one or more skeletal hypotheses each representing a user pose within a given frame. Each expert is generally computationally inexpensive. The system further includes an arbiter for resolving the skeletal hypotheses from the experts into a best state estimate for a given frame. The arbiter may score the various skeletal hypotheses based on different methodologies. The one or more skeletal hypotheses resulting in the highest score may be returned as the state estimate for a given frame. It may happen that the experts and arbiter are unable to resolve a single state estimate with a high degree of confidence for a given frame. It is a further goal of the present system to capture any such uncertainty as a factor in how a state estimate is to be used.

Abstract: A system and method are disclosed for recognizing and tracking a user's skeletal joints with a NUI system and further, for recognizing and tracking only some skeletal joints, such as for example a user's upper body. The system may include a limb identification engine which may use various methods to evaluate, identify and track positions of body parts of one or more users in a scene. In examples, further processing efficiency may be achieved by segmenting the field of view in smaller zones, and focusing on one zone at a time. Moreover, each zone may have its own set of predefined gestures which are recognized.

Abstract: Systems and methods are disclosed for identifying objects captured by a depth camera by condensing classified image data into centroids of probability that captured objects are correctly identified entities. Output exemplars are processed to detect spatially localized clusters of non-zero probability pixels. For each cluster, a centroid is generated, generally resulting in multiple centroids for each differentiated object. Each centroid may be assigned a confidence value, indicating the likelihood that it corresponds to a true object, based on the size and shape of the cluster, as well as the probabilities of its constituent pixels.