Abstract: Techniques for training a neural network having a plurality of computational layers with associated weights and activations for computational layers in fixed-point formats include determining an optimal fractional length for weights and activations for the computational layers; training a learned clipping-level with fixed-point quantization using a PACT process for the computational layers; and quantizing on effective weights that fuses a weight of a convolution layer with a weight and running variance from a batch normalization layer. A fractional length for weights of the computational layers is determined from current values of weights using the determined optimal fractional length for the weights of the computational layers. A fixed-point activation between adjacent computational layers is related using PACT quantization of the clipping-level and an activation fractional length from a node in a following computational layer.

Abstract: Eyewear devices that include two SoCs that share processing workload. Instead of using a single SoC located either on the left or right side of the eyewear devices, the two SoCs have different assigned responsibilities to operate different devices and perform different processes to balance workload. In one example, the eyewear device utilizes a first SoC to operate a first color camera, a second color camera, a first display, and a second display. The first SoC and a second SoC are configured to selectively operate a first and second computer vision (CV) camera algorithms. The first SoC is configured to perform visual odometry (VIO), track hand gestures of the user, and provide depth from stereo images. This configuration provides organized logistics to efficiently operate various features, and balanced power consumption.

Abstract: A projector, such as for eyewear, having a first and second shield that individually sink heat from a light source and provide electromagnetic (EM) shielding for the projector, and a processor controlling the projector. The shields sink heat evenly and efficiently, to different portions of the eyewear. In one example, the heat is directed in different directions. The shields encompass the light source and the processor, and they may be parallel to one another. The thickness of the shield coupled to the light source is thicker proximate the light source. The shields may be separated from each other by a thermal insulating material.

Abstract: Eyewear including a frame having a first side and a second side, a first temple extending from the first side of the frame, a second temple extending from the second side of the frame, electronic components, a first system on a chip (SoC) adjacent the first side of the frame coupled to a first set of the electronic components, and a second system on a chip adjacent the second side, the second SoC coupled to the first SoC and to a second set of the plurality of electronic components. Processing workloads are balanced between the first SoC and the second SoC by performing a first set of operations with the first SoC and performing a second set of operations with the second SoC.

Abstract: Eyewear devices that include two SoCs that share processing workload. Instead of using a single SoC located either on the left or right side of the eyewear devices, the two SoCs have different assigned responsibilities to operate different devices and perform different processes to balance workload. In one example, the eyewear device utilizes a first SoC to operate the OS, a first color camera, a second color camera, a first display, and a second display. A second SoC is configured to run computer vision (CV) algorithms, visual odometry (VIO), tracking hand gestures of the user, and providing depth from stereo. This configuration provides organized logistics to efficiently operate various features, and balanced power consumption.

Abstract: Eyewear devices that include two SoCs that share processing workload. Instead of using a single SoC located either on the left or right side of the eyewear devices, the two SoCs have different assigned responsibilities to operate different devices and perform different processes to balance workload. In one example, the eyewear device utilizes a first SoC to operate a first color camera, a second color camera, a first display, and a second display. The first SoC and a second SoC are configured to selectively operate a first and second computer vision (CV) camera algorithms. The first SoC is configured to perform visual odometry (VIO), track hand gestures of the user, and provide depth from stereo images. This configuration provides organized logistics to efficiently operate various features, and balanced power consumption.

Abstract: A projector, such as for eyewear, having a first and second shield that individually sink heat from a light source and provide electromagnetic (EM) shielding for the projector, and a processor controlling the projector. The shields sink heat evenly and efficiently, to different portions of the eyewear. In one example, the heat is directed in different directions. The shields encompass the light source and the processor, and they may be parallel to one another. The thickness of the shield coupled to the light source is thicker proximate the light source. The shields may be separated from each other by a thermal insulating material.

Abstract: Eyewear including a frame having a first side and a second side, a first temple extending from the first side of the frame, a second temple extending from the second side of the frame, electronic components, a first system on a chip (SoC) adjacent the first side of the frame coupled to a first set of the electronic components, and a second system on a chip adjacent the second side, the second SoC coupled to the first SoC and to a second set of the plurality of electronic components. Processing workloads are balanced between the first SoC and the second SoC by performing a first set of operations with the first SoC and performing a second set of operations with the second SoC.

Abstract: A system for hand tracking for an Augmented Reality (AR) system. The AR system uses a camera of the AR system to capture tracking video frame data of a hand of a user of the AR system. The AR system generates a skeletal model based on the tracking video frame data and determines a location of the hand of the user based on the skeletal model. The AR system causes a steerable camera of the AR system to focus on the hand of the user.

Abstract: A method of dissipating heat generated by imaging devices and processing devices of a wearable electronic eyewear device includes providing a first heat sink thermally connecting the imaging devices to a frame of the eyewear device to sink heat to the frame and providing a second heat sink thermally connecting the processing devices to respective temples of the eyewear device to sink heat to the respective temples. The first and second heat sinks are thermally insulated from each other to direct the heat to different portions of the eyewear device. The processing devices may include a first co-processor disposed in a first temple connected to a first end of the frame and a second co-processor disposed in a second temple connected to a second end of the frame. The resulting eyewear device spreads the heat from heat generating devices over a larger area to minimize overall heating.

Abstract: An antenna that is coupled to and integrated with a projector, such as a projector included with smart glasses including eyewear. The projector has a housing and includes optical components configured to display an image. At least one antenna is coupled to the projector, wherein the optical components operate and function as an antenna substrate. The optical components are nonmetallic such that the antenna generates a strong E-field. The antenna may be coupled to the projector housing, such as on the inside or the outside surface of the housing. Multiple antennas can be included to generate multiple resonances simultaneously in different frequency bands.

Abstract: Eyewear devices that include two SoCs that share processing workload. Instead of using a single SoC located either on the left or right side of the eyewear devices, the two SoCs have different assigned responsibilities to operate different devices and perform different processes to balance workload. In one example, the eyewear device utilizes a first SoC to operate displays, and it performs three-dimensional graphics and compositing. A second SoC operates first and second color cameras, first and second computer vision (CV) cameras, an operating system (OS), CV algorithms, and visual odometry (VIO), and it performs hand gesture tracking of the user and provides depth from stereo images. This configuration provides organized logistics to efficiently operate various features, and balanced power consumption.

Abstract: Eyewear devices that include two SoCs that share processing workload. Instead of using a single SoC located either on the left or right side of the eyewear devices, the two SoCs have different assigned responsibilities to operate different devices and perform different processes to balance workload. In one example, the eyewear device utilizes a first SoC to operate the OS, a first color camera, a second color camera, a first display, and a second display. A second SoC is configured to run computer vision (CV) algorithms, visual odometry (VIO), tracking hand gestures of the user, and providing depth from stereo. This configuration provides organized logistics to efficiently operate various features, and balanced power consumption.

Abstract: Eyewear with a slot ring antenna generating orthogonal E-fields. The slot ring antenna has a first portion including an inner ring and an outer ring generating a first direction E-field, and a second portion having a respective inner ring and the outer ring generating a second direction E-field. The outer ring encompasses the respective inner rings, where a first slot is defined between the respective inner ring and the outer ring. A second slot is encompassed by the respective inner ring, which may be a cutout. The slot ring antenna encompasses eyewear optical assemblies. In one example, the first portion encompasses a first optical assembly, and the second portion encompasses a second optical assembly. A common ground plane of the outer ring may extend proximate a bridge of the eyewear.

Abstract: A system for hand tracking for an Augmented Reality (AR) system. The AR system uses a camera of the AR system to capture tracking video frame data of a hand of a user of the AR system. The AR system generates a skeletal model based on the tracking video frame data and determines a location of the hand of the user based on the skeletal model. The AR system causes a steerable camera of the AR system to focus on the hand of the user.

Abstract: A method of dissipating heat generated by imaging devices and processing devices of a wearable electronic eyewear device includes providing a first heat sink thermally connecting the imaging devices to a frame of the eyewear device to sink heat to the frame and providing a second heat sink thermally connecting the processing devices to respective temples of the eyewear device to sink heat to the respective temples. The first and second heat sinks are thermally insulated from each other to direct the heat to different portions of the eyewear device. The processing devices may include a first co-processor disposed in a first temple connected to a first end of the frame and a second co-processor disposed in a second temple connected to a second end of the frame. The resulting eyewear device spreads the heat from heat generating devices over a larger area to minimize overall heating.

Abstract: Eyewear devices that include two SoCs that share processing workload. Instead of using a single SoC located either on the left or right side of the eyewear devices, the two SoCs have different assigned responsibilities to operate different devices and perform different processes to balance workload. In one example, the eyewear device utilizes a first SoC to operate displays, and it performs three-dimensional graphics and compositing. A second SoC operates first and second color cameras, first and second computer vision (CV) cameras, an operating system (OS), CV algorithms, and visual odometry (VIO), and it performs hand gesture tracking of the user and provides depth from stereo images. This configuration provides organized logistics to efficiently operate various features, and balanced power consumption.

Abstract: Eyewear including a dipole antenna having a first leg and a second leg, wherein the first leg includes at least a portion of a battery, such as a conductive case of the battery. An antenna feed is coupled to the dipole antenna between the second leg and the battery. The second leg may comprise a flexible printed circuit (FPC), and the second leg is an active leg. The second leg has a first portion and a second portion. The first portion and the second portion may have the same physical length. The first portion may be dielectrically loaded with a high permittivity loaded material, and the second portion may be dielectrically loaded with a low permittivity loaded material.

Abstract: Eyewear with a slot ring antenna generating orthogonal E-fields. The slot ring antenna has a first portion including an inner ring and an outer ring generating a first direction E-field, and a second portion having a respective inner ring and the outer ring generating a second direction E-field. The outer ring encompasses the respective inner rings, where a first slot is defined between the respective inner ring and the outer ring. A second slot is encompassed by the respective inner ring, which may be a cutout. The slot ring antenna encompasses eyewear optical assemblies. In one example, the first portion encompasses a first optical assembly, and the second portion encompasses a second optical assembly. A common ground plane of the outer ring may extend proximate a bridge of the eyewear.

Abstract: An antenna that is coupled to and integrated with a projector, such as a projector included with smart glasses including eyewear. The projector has a housing and includes optical components configured to display an image. At least one antenna is coupled to the projector, wherein the optical components operate and function as an antenna substrate. The optical components are nonmetallic such that the antenna generates a strong E-field. The antenna may be coupled to the projector housing, such as on the inside or the outside surface of the housing. Multiple antennas can be included to generate multiple resonances simultaneously in different frequency bands.