Abstract: An electromagnetic (EM) pose tracking system includes a computer input device having a pen or stylus form factor. In some embodiments, a base station device includes one of the transmitter (Tx) or receiver (Rx) module for the EM pose tracking system while the computer input device includes the other of the TX and receiver modules. The EM pose tracking system employs the Tx and Rx modules to collect EM pose data indicating a relative pose between the Tx and Rx modules. Based on the EM pose data, the EM pose tracking system (or a computer device working with the EM pose tracking system) identifies a pose (position, orientation, or both position and orientation) of the computer input device.

Abstract: A handheld electronic device is described for controlling three-dimensional content displayed in a user interface of a computing device. The handheld electronic device may include an electromagnetic sensing system for detecting a pose of the handheld electronic device in three-dimensional space and at least one communication module to trigger transmission of the commands to manipulate three-dimensional content displayed in the computing device based on detected changes in the pose of the handheld electronic device.

Abstract: A handheld electronic device is described for controlling three-dimensional content displayed in a user interface of a computing device. The handheld electronic device may include an electromagnetic sensing system for detecting a pose of the handheld electronic device in three-dimensional space and at least one communication module to trigger transmission of the commands to manipulate three-dimensional content displayed in the computing device based on detected changes in the pose of the handheld electronic device.

Abstract: An electromagnetic (EM) pose tracking system includes a computer input device having a pen or stylus form factor. In some embodiments, a base station device includes one of the transmitter (Tx) or receiver (Rx) module for the EM pose tracking system while the computer input device includes the other of the TX and receiver modules. The EM pose tracking system employs the Tx and Rx modules to collect EM pose data indicating a relative pose between the Tx and Rx modules. Based on the EM pose data, the EM pose tracking system (or a computer device working with the EM pose tracking system) identifies a pose (position, orientation, or both position and orientation) of the computer input device.

Abstract: Systems, devices, and methods synchronize sensor data and timestamps based on a second clock of a second device relative to a first clock of a first device. The data are communicated from the second device to the first device by way of respective wireless circuits in the first and second devices. Timestamps based on the second clock are corrected based on one or more of a time offset value and a clock frequency offset value of the second clock relative to the first clock. The timestamps for the sensor data are scaled to account for clock drift, and shifted to account for clock offset error.

Abstract: A method of receiving EM field magnitude values indicative of a first pose of a mobile unit in relation to a base unit, receiving sensor data from a second sensor associated with the mobile unit, where the sensor data is indicative of a direction of movement of the mobile unit, calculating a set of candidate pose solutions based on the EM field magnitude values, selecting a pose from the set of candidate pose solutions based on the sensor data from the second sensor, and sending the pose to the processor.

Abstract: A device uses a hybrid pose tracking system, whereby the hybrid pose tracking system includes both an EM pose tracking system and a secondary pose tracking system, such as a line-of-sight pose tracking system. The hybrid pose tracking system collects EM pose data from the EM tracking system indicating a relative pose between a transmitter and a receiver, and further collects from the secondary tracking system secondary pose data that is also indicative of the pose of either the transmitter or the receiver. The hybrid pose tracking system calculates a weighted combination (e.g., a weighted sum) of the EM pose data and the secondary pose data to generate a final pose for the device.

Abstract: An electromagnetic (EM) position tracking system identifies the pose of objects based on detected strength values of an EM field. To address distortions in the field, the system employs a pose sensor to provide a second pose of the mobile unit. Under conditions where no distortion in the EM field has been detected, the HMD applies a nominal set of corresponding weights to the EM pose data and the IMU pose data, respectively, and combines the weighted pose value to identify a combined pose of the mobile unit. In response to detecting conditions that indicate distortion in the EM field, the HMD can apply different weights to the EM pose data and IMU pose data to, for example increase the influence of the IMU pose data on the combined pose.

Abstract: A device uses a hybrid pose tracking system, whereby the hybrid pose tracking system includes both an EM pose tracking system and a secondary pose tracking system, such as a line-of-sight pose tracking system. The hybrid pose tracking system collects EM pose data from the EM tracking system indicating a relative pose between a transmitter and a receiver, and further collects from the secondary tracking system secondary pose data that is also indicative of the pose of either the transmitter or the receiver. The hybrid pose tracking system calculates a weighted combination (e.g., a weighted sum) of the EM pose data and the secondary pose data to generate a final pose for the device.

Abstract: An EM pose tracking system controls a power mode by adjusting a transmit power of the EM transmitter based on a metric correlated with jitter in the EM readings. Such a metric includes metrics such as estimated noise computed from received EM data, a computed distance between the transmitter and the receiver, a measured signal power between the transmitter and the receiver, and the like. By adjusting the transmit power based on the jitter metric, the EM tracking system can reduce overall power consumption at a device that employs the EM tracking system, thus allowing the system to be used in a wider variety of devices and improving the user experience with those devices.

Abstract: An EM pose tracking system controls a power mode by adjusting a transmit power of the EM transmitter based on a metric correlated with jitter in the EM readings. Such a metric includes metrics such as estimated noise computed from received EM data, a computed distance between the transmitter and the receiver, a measured signal power between the transmitter and the receiver, and the like. By adjusting the transmit power based on the jitter metric, the EM tracking system can reduce overall power consumption at a device that employs the EM tracking system, thus allowing the system to be used in a wider variety of devices and improving the user experience with those devices.

Abstract: A system for tracking an object in an ambient environment with respect to a head mounted reference frame may allow the ambient object to be rendered in a virtual display, at a virtual position corresponding to its position in the ambient environment, in response to head movement. The system may detect a position of a head mounted device with respect to a fixed frame of reference in the ambient environment, and may detect an position of the ambient object with respect to the fixed frame of reference in the ambient environment. The system may then translate the detected position of the ambient object to the frame of reference of the head mounted device, or to the head mounted reference frame, to determine a position of the ambient object relative to the head mounted device. This newly determined position may be rendered in the virtual display generated by the head mounted device.

Abstract: In a system for pairing a first device and a second device in a virtual reality environment, the first device may be a sending device, and the second device may be a receiving device. The sending device may transmit an electromagnetic signal that is received by the receiving device. The receiving device may process the electromagnetic signal to verify physical proximity of the receiving device and the transmitting device, and extract identification information related to the sending device for pairing. The receiving device may display one or more virtual pairing indicators to be manipulated to verify the user's intention to pair the first and second devices.

Abstract: A method of receiving EM field magnitude values indicative of a first pose of a mobile unit in relation to a base unit, receiving sensor data from a second sensor associated with the mobile unit, where the sensor data is indicative of a direction of movement of the mobile unit, calculating a set of candidate pose solutions based on the EM field magnitude values, selecting a pose from the set of candidate pose solutions based on the sensor data from the second sensor, and sending the pose to the processor.

Abstract: Systems, devices, and methods synchronize sensor data and timestamps based on a second clock of a second device relative to a first clock of a first device. The data are communicated from the second device to the first device by way of respective wireless circuits in the first and second devices. Timestamps based on the second clock are corrected based on one or more of a time offset value and a clock frequency offset value of the second clock relative to the first clock. The timestamps for the sensor data are scaled to account for clock drift, and shifted to account for clock offset error.

Abstract: An electromagnetic (EM) position tracking system identifies the pose of objects based on detected strength values of an EM field. To address distortions in the field, the system employs a pose sensor to provide a second pose of the mobile unit. Under conditions where no distortion in the EM field has been detected, the HMD applies a nominal set of corresponding weights to the EM pose data and the IMU pose data, respectively, and combines the weighted pose value to identify a combined pose of the mobile unit. In response to detecting conditions that indicate distortion in the EM field, the HMD can apply different weights to the EM pose data and IMU pose data to, for example increase the influence of the IMU pose data on the combined pose.

Abstract: In one general aspect, a method can include receiving, by a first computing device from a virtual reality (VR) headset, data indicative of a position of a second computing device, rendering, by the first computing device, an aspect of the second computing device for inclusion in a VR space based on the position of the second computing device, and integrating the rendered aspect of the second computing device with content for display as integrated content in the VR space. The method can further include providing the integrated content to the VR headset for display on a screen included in the VR headset, receiving data indicative of an interaction of a user with the second computing device, and based on the received data indicative of the interaction of the user with the second computing device, altering the content for display as integrated content in the VR space.

Abstract: In one general aspect, a system for providing a virtual reality (VR) space can include a mobile computing device, and a VR headset operatively coupled to the mobile computing device and including a screen. The mobile computing device can be configured to execute a VR application, and provide content for display on the screen of the VR headset in the VR space.

Abstract: A head mounted display (HMD) device may include a housing coupled to a frame, and a display disposed in the housing. A first lens and a first active shutter may be disposed along a first optical axis in the housing, and a second lens and a second active shutter may be disposed along a second optical axis in the housing. A controller may alternately switch the display, the first active shutter and the second active shutter between a first mode and a second mode. In the first mode the first active shutter may be activated and the second active shutter may be deactivated. In the second mode the first active shutter may be deactivated and the second active shutter may be activated.

Abstract: In some implementations, image data in a live image feed of a camera of an electronic device is received. The electronic device detects a face in the image data. Then, the electronic device determines that the detected face is important based on occurrence of the detected face in the previously captured images. The electronic device determines that an image of the detected face in the image data has at least a minimum level of quality. The electronic device then initiates capture of images using the camera at a time determined by the electronic device and ends the capture of images from the camera at a time determined by the electronic device.