Abstract: Techniques are described for reconciling events timestamped in different time domains in multi-node systems supporting low-latency hardware timestamping. First and second nodes having independent time bases are synchronized by the first node generating an event that is received effectively simultaneously at the first and second nodes, the first and second nodes recording a timestamp of receipt of the event, the first node asynchronously querying the second node for its timestamp of receipt of the event and comparing its timestamp of receipt of the event with the timestamp of receipt of the event by the second node, and the first node using a difference in the timestamps of receipt of the event by the first and second nodes to align the time bases of the first and second nodes. The nodes may include hardware timestamping functionality or use an external component (e.g., field programmable gate array) to provide the timestamping functionality.

Abstract: Example systems, devices, media, and methods are described for presenting a virtual experience using the display of an eyewear device in augmented reality. A content delivery application implements and controls the detecting of beacons broadcast from beacon transmitters deployed at fixed locations and determining the current eyewear location based on the detected beacons. The method includes retrieving content and presenting a virtual experience based on the retrieved content, the beacon data, and a user profile. The virtual experience includes playing audio messages, presenting text on the display, playing video segments on the display, and combinations thereof. In addition to wireless detection of beacons, the method includes scanning and decoding a beacon activation code positioned near the beacon transmitter to access a beacon.

Abstract: Eyewear including a frame having a first side and a second side, a first temple extending from the first side of the frame, a second temple extending from the second side of the frame, electronic components, a first system on a chip (SoC) adjacent the first side of the frame coupled to a first set of the electronic components, and a second system on a chip adjacent the second side, the second SoC coupled to the first SoC and to a second set of the plurality of electronic components. Processing workloads are balanced between the first SoC and the second SoC by performing a first set of operations with the first SoC and performing a second set of operations with the second SoC.

Abstract: Example systems, devices, media, and methods are described for presenting a virtual experience using the display of an eyewear device in augmented reality. A content delivery application implements and controls the detecting of beacons broadcast from beacon transmitters deployed at fixed locations and determining the current eyewear location based on the detected beacons. The method includes retrieving content and presenting a virtual experience based on the retrieved content, the beacon data, and a user profile. The virtual experience includes playing audio messages, presenting text on the display, playing video segments on the display, and combinations thereof. In addition to wireless detection of beacons, the method includes scanning and decoding a beacon activation code positioned near the beacon transmitter to access a beacon.

Abstract: An eyewear device that includes a plurality of SoCs that share processing workload, and a USB port configured to perform low-power debugging and automation of the plurality of SoCs, such as using either a Universal Asynchronous Receiver-Transmitter (UART) or a Serial Wire Debug (SWD). The eyewear includes a USB hub configured such that the USB port can simultaneously communicate with the plurality of SoCs. The USB hub can be shut down to disable the USB hub, and all the SoCs can enter their low-power modes without being kept awake by a persistent USB connection. The eyewear includes a first switch and a control logic, wherein the control logic controls the first switch and enables the USB port to perform low-power debugging and automation of the SoCs. The eyewear further includes a second switch, wherein the control logic controls the second switch to enable the USB port to perform low-power debugging and automation of the SoCs via a processor, or to enable the USB port to control each of the SoCs.

Abstract: A method for managing power resource in an augmented reality (AR) device is described. In one aspect, the method includes configuring a low-power mode to run on a low-power processor of the AR device using a first set of sensor data, and a high-power mode to run on a high-power processor of the AR device using a second set of sensor data, operating, using the low-power processor, a low-power application in the low-power mode based on the first set of sensor data, detecting a request to operate a high-power application at the AR device, in response to detecting the request, activating the second set of sensors of the AR device corresponding to the high-power mode, and operating, using the high-power processor, a high-power application in the high-power mode based on the second set of sensors.

Abstract: A method for a low-power hand-tracking system is described. In one aspect, a method includes polling a proximity sensor of a wearable device to detect a proximity event, the wearable device includes a low-power processor and a high-power processor, in response to detecting the proximity event, operating a low-power hand-tracking application on the low-power processor based on proximity data from the proximity sensor, and ending an operation of the low-power hand-tracking application in response to at least one of: detecting and recognizing a gesture based on the proximity data, detecting without recognizing the gesture based on the proximity data, or detecting a lack of activity from the proximity sensor within a timeout period based on the proximity data.

Abstract: Disclosed are systems, methods, and non-transitory computer-readable media for reducing latency in augmented reality displays. A display controller receives, from a GPU, a stream of image pixels of a frame of virtual content to be presented on a display of a display device. The stream of image pixels is received via a high-speed bulk interface that transfers data at least as fast as can be consumed by the display. As the stream of image pixel is received, the display controller converts each respective image pixel from a data format used to transmit the stream of image pixels via the high-speed bulk interface to a data format that is compatible for display by the display. Each converted image pixel is stored in a pixel cell of the display, after which the frame is presented on the display.

Abstract: An eyewear device that includes a plurality of SoCs that share processing workload, and a USB port configured to perform low-power debugging and automation of the plurality of SoCs, such as using either a Universal Asynchronous Receiver-Transmitter (UART) or a Serial Wire Debug (SWD). The eyewear includes a USB hub configured such that the USB port can simultaneously communicate with the plurality of SoCs. The USB hub can be shut down to disable the USB hub, and all the SoCs can enter their low-power modes without being kept awake by a persistent USB connection. The eyewear includes a first switch and a control logic, wherein the control logic controls the first switch and enables the USB port to perform low-power debugging and automation of the SoCs. The eyewear further includes a second switch, wherein the control logic controls the second switch to enable the USB port to perform low-power debugging and automation of the SoCs via a processor, or to enable the USB port to control each of the SoCs.

Abstract: Example systems, devices, media, and methods are described for presenting a virtual experience using the display of an eyewear device in augmented reality. A content delivery application implements and controls the detecting of beacons broadcast from beacon transmitters deployed at fixed locations and determining the current eyewear location based on the detected beacons. The method includes retrieving content and presenting a virtual experience based on the retrieved content, the beacon data, and a user profile. The virtual experience includes playing audio messages, presenting text on the display, playing video segments on the display, and combinations thereof. In addition to wireless detection of beacons, the method includes scanning and decoding a beacon activation code positioned near the beacon transmitter to access a beacon.

Abstract: A method for managing power resource in an augmented reality (AR) device is described. In one aspect, the method includes configuring a low-power mode to run on a low-power processor of the AR device using a first set of sensor data, and a high-power mode to run on a high-power processor of the AR device using a second set of sensor data, operating, using the low-power processor, a low-power application in the low-power mode based on the first set of sensor data, detecting a request to operate a high-power application at the AR device, in response to detecting the request, activating the second set of sensors of the AR device corresponding to the high-power mode, and operating, using the high-power processor, a high-power application in the high-power mode based on the second set of sensors.

Abstract: Eyewear device including two system on a chip (SoC) that share processing workload. The SoCs communicate with each other using a low-power bridge, e.g., a mobile industry processor interface (MIPI) bridge including a display serial interface (DSI) to camera serial interface (CSI) bridge. The MIPI bridge converts DSI images from one SoC to CSI images, and also communicates metadata. Another SoC receives and processes the CSI images. The other SoC has a buffer that receives both the CSI images and the metadata, and separates the CSI images from the metadata. The other SoC has computer vision (CV) algorithms that process the metadata, and a low-speed interface that sends metadata back to the one SoC to adjust and render a next image. The MIPI bridge may comprise a field programmable gate array (FPGA).

Abstract: Example systems, devices, media, and methods are described for presenting a virtual experience using the display of an eyewear device in augmented reality. A content delivery application implements and controls the detecting of beacons broadcast from beacon transmitters deployed at fixed locations and determining the current eyewear location based on the detected beacons. The method includes retrieving content and presenting a virtual experience based on the retrieved content, the beacon data, and a user profile. The virtual experience includes playing audio messages, presenting text on the display, playing video segments on the display, and combinations thereof. In addition to wireless detection of beacons, the method includes scanning and decoding a beacon activation code positioned near the beacon transmitter to access a beacon.

Abstract: An eyewear device that includes a plurality of SoCs that share processing workload, and a USB port configured to perform low-power debugging and automation of the plurality of SoCs, such as using either a Universal Asynchronous Receiver-Transmitter (UART) or a Serial Wire Debug (SWD). The eyewear includes a USB hub configured such that the USB port can simultaneously communicate with the plurality of SoCs. The USB hub can be shut down to disable the USB hub, and all the SoCs can enter their low-power modes without being kept awake by a persistent USB connection. The eyewear includes a first switch and a control logic, wherein the control logic controls the first switch and enables the USB port to perform low-power debugging and automation of the SoCs. The eyewear further includes a second switch, wherein the control logic controls the second switch to enable the USB port to perform low-power debugging and automation of the SoCs via a processor, or to enable the USB port to control each of the SoCs.

Abstract: Techniques are described for reconciling events timestamped in different time domains in multi-node systems supporting low-latency hardware timestamping. First and second nodes having independent time bases are synchronized by the first node generating an event that is received effectively simultaneously at the first and second nodes, the first and second nodes recording a timestamp of receipt of the event, the first node asynchronously querying the second node for its timestamp of receipt of the event and comparing its timestamp of receipt of the event with the timestamp of receipt of the event by the second node, and the first node using a difference in the timestamps of receipt of the event by the first and second nodes to align the time bases of the first and second nodes. The nodes may include hardware timestamping functionality or use an external component (e.g., field programmable gate array) to provide the timestamping functionality.

Abstract: Eyewear including a frame having a first side and a second side, a first temple extending from the first side of the frame, a second temple extending from the second side of the frame, electronic components, a first system on a chip (SoC) adjacent the first side of the frame coupled to a first set of the electronic components, and a second system on a chip adjacent the second side, the second SoC coupled to the first SoC and to a second set of the plurality of electronic components. Processing workloads are balanced between the first SoC and the second SoC by performing a first set of operations with the first SoC and performing a second set of operations with the second SoC.

Abstract: Example systems, devices, media, and methods are described for presenting a virtual experience using the display of an eyewear device in augmented reality. A content delivery application implements and controls the detecting of beacons broadcast from beacon transmitters deployed at fixed locations and determining the current eyewear location based on the detected beacons. The method includes retrieving content and presenting a virtual experience based on the retrieved content, the beacon data, and a user profile. The virtual experience includes playing audio messages, presenting text on the display, playing video segments on the display, and combinations thereof. In addition to wireless detection of beacons, the method includes scanning and decoding a beacon activation code positioned near the beacon transmitter to access a beacon.

Abstract: Disclosed are systems, methods, and non-transitory computer-readable media. for reducing latency in augmented reality displays. A display controller receives, from a GPU, a stream of image pixels of a frame of virtual content to be presented on a display of a display device. The stream of image pixels is received via a high-speed bulk interface that transfers data at least as fast as can be consumed by the display. As the stream of image pixel is received, the display controller converts each respective image pixel from a data format used to transmit the stream of image pixels via the high-speed bulk interface to a data format that is compatible for display by the display. Each converted image pixel is stored in a pixel cell of the display, after which the frame is presented on the display.

Abstract: Disclosed are systems, methods, and non-transitory computer-readable media for reducing latency in augmented reality displays. A display controller receives, from a GPU, a stream of image pixels of a frame of virtual content to be presented on a display of a display device. The stream of image pixels is received via a high-speed bulk interface that transfers data at least as fast as can be consumed by the display. As the stream of image pixel is received, the display controller converts each respective image pixel from a data format used to transmit the stream of image pixels via the high-speed bulk interface to a data format that is compatible for display by the display. Each converted image pixel is stored in a pixel cell of the display, after which the frame is presented on the display.

Abstract: Disclosed are systems, methods, and non-transitory computer-readable media for reducing latency in augmented reality displays. A display controller receives, from a GPU, a stream of image pixels of a frame of virtual content to be presented on a display of a display device. The stream of image pixels is received via a high-speed bulk interface that transfers data at least as fast as can be consumed by the display. As the stream of image pixel is received, the display controller converts each respective image pixel from a data format used to transmit the stream of image pixels via the high-speed bulk interface to a data format that is compatible for display by the display. Each converted image pixel is stored in a pixel cell of the display, after which the frame is presented on the display.