Abstract: A method for adjusting camera intrinsic parameters of a multi-camera visual tracking device is described. In one aspect, a method for calibrating the multi-camera visual tracking system includes disabling a first camera of the multi-camera visual tracking system while a second camera of the multi-camera visual tracking system is enabled, detecting a first set of features in a first image generated by the first camera after detecting that the temperature of the first camera is within the threshold of the factory calibration temperature of the first camera, and accessing and correcting intrinsic parameters of the second camera based on the projection of the first set of features in the second image and a second set of features in the second image.

Abstract: An eyewear device with flexible frame for Augmented Reality (AR) is disclosed. At least two sensors and a display are mounted on the flexible frame. When in use, the real time geometry of the eyewear device may change from factory calibrated geometry, resulting in low quality AR rendering. A modeling module is provided to model the real time geometry of the eyewear device on the fly using sensor information of the at least two sensors. The modeled real time geometry is then provided to a rendering module to accurately display the AR to the user.

Abstract: Camera pipeline exposure timestamp error determination methods and systems that detect latency in rolling shutter camera systems. The exposure timestamp error determination system includes a rolling shutter image sensor configured to capture an image and a processor. The processor determines timestamp error by capturing the image using the rolling shutter image sensor where the image includes a bar code encoded with a barcode timestamp. The processor then obtains a system exposure timestamp corresponding to capture of the image by the rolling shutter image sensor and the barcode timestamp by decoding the bar code. Pipeline exposure timestamp error is then determined for the rolling shutter camera system by comparing the obtained barcode timestamp to the system exposure timestamp.

Abstract: A method for adjusting camera intrinsic parameters of a multi-camera visual tracking device is described. In one aspect, a method for calibrating the multi-camera visual tracking system includes disabling a first camera of the multi-camera visual tracking system while a second camera of the multi-camera visual tracking system is enabled, detecting a first set of features in a first image generated by the first camera after detecting that the temperature of the first camera is within the threshold of the factory calibration temperature of the first camera, and accessing and correcting intrinsic parameters of the second camera based on the projection of the first set of features in the second image and a second set of features in the second image.

Abstract: An eyewear device with flexible frame for Augmented Reality (AR) is disclosed. At least two sensors and a display are mounted on the flexible frame. When in use, the real time geometry of the eyewear device may change from factory calibrated geometry, resulting in low quality AR rendering. A modeling module is provided to model the real time geometry of the eyewear device on the fly using sensor information of the at least two sensors. The modeled real time geometry is then provided to a rendering module to accurately display the AR to the user.

Abstract: Camera pipeline exposure timestamp error determination methods and systems that detect latency in rolling shutter camera systems. The exposure timestamp error determination system includes a rolling shutter image sensor configured to capture an image and a processor. The processor determines timestamp error by capturing the image using the rolling shutter image sensor where the image includes a bar code encoded with a barcode timestamp. The processor then obtains a system exposure timestamp corresponding to capture of the image by the rolling shutter image sensor and the barcode timestamp by decoding the bar code. Pipeline exposure timestamp error is then determined for the rolling shutter camera system by comparing the obtained barcode timestamp to the system exposure timestamp.

Abstract: A method for adjusting camera intrinsic parameters of a multi-camera visual tracking device is described. In one aspect, a method for calibrating the multi-camera visual tracking system includes disabling a first camera of the multi-camera visual tracking system while a second camera of the multi-camera visual tracking system is enabled, detecting a first set of features in a first image generated by the first camera after detecting that the temperature of the first camera is within the threshold of the factory calibration temperature of the first camera, and accessing and correcting intrinsic parameters of the second camera based on the projection of the first set of features in the second image and a second set of features in the second image.

Abstract: A method for reducing motion-to-photon latency in an augmented reality (AR) display device is described. In one aspect, the method includes generating, using a render engine of a Graphical Processing Unit (GPU) of the AR display device, an image including a rendered 3D model of the virtual content based on a first pose of the AR display device, applying, using a reprojection engine of a display controller of the AR display device, a two-dimensional transformation to the image based on a second pose to generate a transformed image, and providing the transformed image to a display of the AR display device.

Abstract: An eyewear device with flexible frame for Augmented Reality (AR) is disclosed. At least two sensors and a display are mounted on the flexible frame. When in use, the real time geometry of the eyewear device may change from factory calibrated geometry, resulting in low quality AR rendering. A modeling module is provided to model the real time geometry of the eyewear device on the fly using sensor information of the at least two sensors. The modeled real time geometry is then provided to a rendering module to accurately display the AR to the user.

Abstract: An eyewear device with flexible frame for Augmented Reality (AR) is disclosed. At least two sensors and a display are mounted on the flexible frame. When in use, the real time geometry of the eyewear device may change from factory calibrated geometry, resulting in low quality AR rendering. A modeling module is provided to model the real time geometry of the eyewear device on the fly using sensor information of the at least two sensors. The modeled real time geometry is then provided to a rendering module to accurately display the AR to the user.

Abstract: An eyewear device with flexible frame for Augmented Reality (AR) is disclosed. At least two sensors and a display are mounted on the flexible frame. When in use, the real time geometry of the eyewear device may change from factory calibrated geometry, resulting in low quality AR rendering. A modeling module is provided to model the real time geometry of the eyewear device on the fly using sensor information of the at least two sensors. The modeled real time geometry is then provided to a rendering module to accurately display the AR to the user.

Abstract: Camera pipeline exposure timestamp error determination methods and systems that detect latency in rolling shutter camera systems. The exposure timestamp error determination system includes a rolling shutter image sensor configured to capture an image and a processor. The processor determines timestamp error by capturing the image using the rolling shutter image sensor where the image includes a bar code encoded with a barcode timestamp. The processor then obtains a system exposure timestamp corresponding to capture of the image by the rolling shutter image sensor and the barcode timestamp by decoding the bar code. Pipeline exposure timestamp error is then determined for the rolling shutter camera system by comparing the obtained barcode timestamp to the system exposure timestamp.

Abstract: An augmented reality (AR) display application generates mapped visualization content overlaid on a real world physical environment. The AR display application receives sensor feeds, location information, and orientation information from wearable devices within the environment. A tessellation surface is visually mapped to surfaces of the environment based on a depth-based point cloud. A texture is applied to the tessellation surface and the tessellation may be viewed overlaying the surfaces of the environment via a wearable device.

Abstract: An augmented reality (AR) display application generates mapped visualization content overlaid on a real world physical environment. The AR display application receives sensor feeds, location information, and orientation information from wearable devices within the environment. A tessellation surface is visually mapped to surfaces of the environment based on a depth-based point cloud. A texture is applied to the tessellation surface and the tessellation may be viewed overlaying the surfaces of the environment via a wearable device.