Abstract: An electronic device may be provided with electronic components such as a touch screen display. The touch screen display may be controlled based on information from a proximity sensor. The proximity sensor may have a light source that emits infrared light and a light detector that detects reflected infrared light. When the electronic device is in the vicinity of a user's head, the proximity sensor may produce data indicative of the presence of the user's head. Variations in proximity sensor output due to user hair color and smudges on the proximity sensor can be accommodated by using a dynamically adjustable proximity sensor data threshold in processing proximity sensor data. Proximity sensor data may be analyzed in real time to detect signal strength fluctuations that are indicative of the presence of low-reflectively dark hair on the user's head. Threshold adjustments may be based on the presence of dark hair.

Abstract: Negative pixel compensation in a touch sensor panel is disclosed. A method can compensate for a negative pixel effect in touch signal outputs due to poor grounding of an object touching the panel. To do so, the method can include determining at least one bound for a negative pixel compensation factor based on touch signal values, estimating the compensation factor within the determined bound based on the touch signal values that are negative, where the negative values indicate the presence of the negative pixel effect, and applying the estimated compensation factor to the touch signal outputs to compensate the touch signal values for the negative pixel effect.

Abstract: Sensor measurements are used to detect when a device incorporating the sensor is stationary. While the device is stationary, sensor measurements at a current device temperature are used to estimate model parameters. The model parameters can be used in a state estimator to provide an estimated attitude that can be provided to other applications. In some implementations, the estimated attitude can be used to mitigate interference in other sensor measurements.

Abstract: Negative pixel compensation in a touch sensor panel is disclosed. A method can compensate for a negative pixel effect in touch signal outputs due to poor grounding of an object touching the panel. To do so, the method can include determining at least one bound for a negative pixel compensation factor based on touch signal values, estimating the compensation factor within the determined bound based on the touch signal values that are negative, where the negative values indicate the presence of the negative pixel effect, and applying the estimated compensation factor to the touch signal outputs to compensate the touch signal values for the negative pixel effect.

Abstract: Reconstruction of an original touch image from a differential touch image is disclosed. Reconstruction can include aligning columns of the differential touch image relative to each other and aligning the image to a baseline DC value. The column and baseline alignment can be based on the differential image data indicative of no touch or hover, because such data can more clearly show the amount of alignment needed to reconstruct the original image. The reconstruction can be performed using the differential image data alone. The reconstruction can also be performed using the differential image data and common mode data indicative of the missing image column average.

Abstract: A device coupled with a magnetometer and an angular rate sensor can determine a heading of the device using magnetometer data. When the device receives a notification that the magnetometer data may be inaccurate, the device can determine the heading of the device using angular rate data. When the device determines that the magnetometer data are accurate, the device can resume determining the heading of the device using the magnetometer data.

Abstract: Methods, program products, and systems for gesture classification and recognition are disclosed. In general, in one aspect, a system can determine multiple motion patterns for a same user action (e.g., picking up a mobile device from a table) from empirical training data. The system can collect the training data from one or more mobile devices. The training data can include multiple series of motion sensor readings for a specified gesture. Each series of motion sensor readings can correspond to a particular way a user performs the gesture. Using clustering techniques, the system can extract one or more motion patterns from the training data. The system can send the motion patterns to mobile devices as prototypes for gesture recognition.

Abstract: Methods, program products, and systems of motion-based device operations are described. A mobile device can coordinate operations of a motion sensor and a proximity sensor. The mobile device can determine a gesture event using the motion sensor. The mobile device can determine a proximity event using the proximity sensor. The mobile device can use the gesture event and proximity event to confirm one another, and determine that the mobile device has moved in proximity to a target object following a specified gesture. Upon confirmation, the mobile device can perform a specified task.

Abstract: One embodiment may take the form of a method of operating a computing device to provide presence based functionality. The method may include operating the computing device in a reduced power state and collecting a first set of data from a first sensor. Based on the first set of data, the computing device determines if an object is within a threshold distance of the computing device and, if the object is within the threshold distance, the device activates a secondary sensor to collect a second set of data. Based on the second set of data, the device determines if the object is a person. If the object is a person, the device determines a position of the person relative to the computing device and executes a change of state in the computing device based on the position of the person relative to the computing device. If the object is not a person, the computing device remains in a reduced power state.

Abstract: Systems and methods for processing gesture-based user interactions within an interactive display area are provided. The display of one or more virtual objects and user interactions with the one or more virtual objects may be further provided. Multiple interactive areas may be created by partitioning an area proximate a display into multiple volumetric spaces or zones. The zones may be associated with respective user interaction capabilities. A representation of a user on the display may change as the ability of the user to interact with one or more virtual object changes.

Abstract: One embodiment may take the form of a method of operating a computing device in a reduced power state and collecting a first set of data from at least one sensor. Based on the first set of data, the computing device determines a probability that an object is within a threshold distance of the computing device and, if so, the device activates at least one secondary sensor to collect a second set of data. Based on the second set of data, the device determines if the object is a person. If it is a person, a position of the person relative to the computing device is determined and the computing device changes its state based on the position of the person. If the object is not a person, the computing device remains in a reduced power state.

Abstract: Systems and methods for processing gesture-based user interactions within an interactive display area are provided. The display of one or more virtual objects and user interactions with the one or more virtual objects may be further provided. Multiple interactive areas may be created by partitioning an area proximate a display into multiple volumetric spaces or zones. The zones may be associated with respective user interaction capabilities. A representation of a user on the display may change as the ability of the user to interact with one or more virtual object changes.

Abstract: A device coupled with a magnetometer and an angular rate sensor can determine a heading of the device using magnetometer data. When the device receives a notification that the magnetometer data may be inaccurate, the device can determine the heading of the device using angular rate data. When the device determines that the magnetometer data are accurate, the device can resume determining the heading of the device using the magnetometer data.

Abstract: Sensor measurements are used to detect when a device incorporating the sensor is stationary. While the device is stationary, sensor measurements at a current device temperature are used to estimate model parameters. The model parameters can be used in a state estimator to provide an estimated attitude that can be provided to other applications. In some implementations, the estimated attitude can be used to mitigate interference in other sensor measurements.

Abstract: Negative pixel compensation in a touch sensor panel is disclosed. A method can compensate for a negative pixel effect in touch signal outputs due to poor grounding of an object touching the panel. To do so, the method can include determining at least one bound for a negative pixel compensation factor based on touch signal values, estimating the compensation factor within the determined bound based on the touch signal values that are negative, where the negative values indicate the presence of the negative pixel effect, and applying the estimated compensation factor to the touch signal outputs to compensate the touch signal values for the negative pixel effect.

Abstract: A self-contained hardware and software system that allows reliable stereo vision to be performed. The vision hardware for the system, which includes a stereo camera and at least one illumination source that projects a pattern into the camera's field of view, may be contained in a single box. This box may contain mechanisms to allow the box to remain securely and stay in place on a surface such as the top of a display. The vision hardware may contain a physical mechanism that allows the box, and thus the camera's field of view, to be tilted upward or downward in order to ensure that the camera can see what it needs to see.

Abstract: Systems and methods for processing gesture-based user interactions with an interactive display are provided.

Abstract: An interactive video display system allows a physical object to interact with a virtual object. A light source delivers a pattern of invisible light to a three-dimensional space occupied by the physical object. A camera detects invisible light scattered by the physical object. A computer system analyzes information generated by the camera, maps the position of the physical object in the three-dimensional space, and generates a responsive image that includes the virtual object. A display presents the responsive image.