Abstract: Systems, devices, media, and methods are presented for using a handheld device such as a ring to manipulate a virtual object being displayed by a wearable device such as eyewear. The path of the virtual object in motion is substantially linked, in time and space, to the course traveled by a hand holding the handheld device. The methods in some implementations include presenting the virtual object on a display at a first location relative to a three-dimensional coordinate system, collecting motion data from an inertial measurement unit on the handheld device, displaying the virtual object at a second location along a path based on the motion data. In some implementations the eyewear includes a projector located and configured to project the display onto a lens assembly.

Abstract: Eyewear providing an interactive augmented reality experience to users in a first physical environment viewing objects in a second physical environment (e.g., X-ray effect). The second environment may be a room positioned behind a barrier, such as a wall. The user views the second environment via a sensor system moveable on the wall using a track system. As the user in the first environment moves the eyewear to face the outside surface of the wall along a line-of-sight (LOS) at a location (x, y, z), the sensor system on the track system repositions to the same location (x, y, z) on the inside surface of wall. The image captured by the sensor system in the second environment is wirelessly transmitted to the eyewear for displayed on the eyewear displays, providing the user with an X-ray effect of looking through the wall to see the objects within the other environment.

Abstract: Augmented reality eyewear devices allow users to experience a version of our “real” physical world augmented with virtual objects. Augmented reality eyewear may present a user with a graphical user interface that appears to be in the airspace directly in front of the user thereby encouraging the user to interact with virtual objects in socially undesirable ways, such as by making sweeping hand gestures in the airspace in front of the user. Anchoring various input mechanisms or the graphical user interface of an augmented reality eyewear application to a wristwatch may allow a user to interact with an augmented reality eyewear device in a more socially acceptable manner. Combining the displays of a smartwatch and an augmented reality eyewear device into a single graphical user interface may provide enhanced display function and more responsive gestural input.

Abstract: Systems and methods for device handshaking are described. Embodiments for client device and associated wearable device initiated handshaking are described. In certain embodiments, a device such as wearable camera eyeglasses having both high-speed wireless circuitry and low-power wireless circuitry communicates with a client device. The low-power wireless circuitry is used for signaling and to manage power on handshaking for the high-speed circuitry in order to reduce power consumption. An analysis of a high-speed connection status may be performed by a client device, and used to conserve power at the glasses with signaling from the client device to indicate when the high-speed circuitry of the glasses should be powered on.

Abstract: One aspect disclosed is a method including determining a location from a positioning system receiver, determining, using a hardware processor and the location, that the location is approaching a path of direction of visual direction information, displaying the visual direction information on a display of a wearable device in response to the determining, determining, using the positioning system receiver, whether the turn of the visual direction information has been made, determining, by the hardware processor, a first period of time for display of the content data based on whether the turn of the visual direction information has been made, powering on the display and displaying, using the display, content data for the first period of time, turning off the display and the hardware processor following display of the content data.

Abstract: Systems, devices, media, and methods are presented for using a handheld device such as a ring to manipulate a virtual object being displayed by a wearable device such as eyewear. The path of the virtual object in motion is substantially linked, in time and space, to the course traveled by a hand holding the handheld device. The methods in some implementations include presenting the virtual object on a display at a first location relative to a three-dimensional coordinate system, collecting motion data from an inertial measurement unit on the handheld device, displaying the virtual object at a second location along a path based on the motion data. In some implementations the eyewear includes a projector located and configured to project the display onto a lens assembly.

Abstract: Augmented reality eyewear devices allow users to experience a version of our “real” physical world augmented with virtual objects. Augmented reality eyewear may present a user with a graphical user interface that appears to be in the airspace directly in front of the user thereby encouraging the user to interact with virtual objects in socially undesirable ways, such as by making sweeping hand gestures in the airspace in front of the user. Anchoring various input mechanisms or the graphical user interface of an augmented reality eyewear application to a wristwatch may allow a user to interact with an augmented reality eyewear device in a more socially acceptable manner. Combining the displays of a smartwatch and an augmented reality eyewear device into a single graphical user interface may provide enhanced display function and more responsive gestural input.

Abstract: Systems and methods for device handshaking are described. Embodiments for client device and associated wearable device initiated handshaking are described. In certain embodiments, a device such as wearable camera eyeglasses having both high-speed wireless circuitry and low-power wireless circuitry communicates with a client device. The low-power wireless circuitry is used for signaling and to manage power on handshaking for the high-speed circuitry in order to reduce power consumption. An analysis of a high-speed connection status may be performed by a client device, and used to conserve power at the glasses with signaling from the client device to indicate when the high-speed circuitry of the glasses should be powered on.

Abstract: Content is displayed to a user of augmented reality device. In response to receiving an indication of an increased level of risk, the degree of content being displayed to the user is reduced. The indication of increased level of risk may be generated by or received from an associated transportation device. The adjustment of the display of the degree of content may include moving one or more content elements out of a central field of view of the augmented reality device, reducing the size or visual characteristics of a content element, or eliminating a content element from the display.

Abstract: Methods and systems are disclosed for performing operations for displaying virtual content on a contact lens. The operations comprise causing the contact lens to operate in a first display mode to allow unobstructed light associated with a real-world environment to be received by a pupil of a user; detecting a condition associated with display of virtual content; selecting between a second display mode and a third display mode as a new display mode in which to operate the contact lens, the second display mode obstructing a portion of the light associated with a real-world environment received by the pupil with the virtual content, the third display mode obstructing all of the light associated with a real-world environment received by the pupil with the virtual content; and transitioning the contact lens from operating in the first display mode to operating in the new display mode in response to detecting the condition.

Abstract: One aspect disclosed is a method including determining a location from a positioning system receiver, determining, using a hardware processor and the location, that the location is approaching a path of direction of visual direction information, displaying the visual direction information on a display of a wearable device in response to the determining, determining, using the positioning system receiver, whether the turn of the visual direction information has been made, determining, by the hardware processor, a first period of time for display of the content data based on whether the turn of the visual direction information has been made, powering on the display and displaying, using the display, content data for the first period of time, turning off the display and the hardware processor following display of the content data.

Abstract: Displays and eyewear devices incorporating displays are disclosed. One display includes a light source, a first display region, and a second display region. The first display region includes a first contiguous array of pixels. The first contiguous array of pixels includes a first group of pixels and a second group of pixels interspersed with the first group of pixels. The first group of pixels is adapted to emit light from the light source in only a first wavelength band and the second group of pixels is adapted to emit light from the light source in only a second wavelength band different from the first wavelength band. The second display region consists essentially of a second contiguous array of pixels. The second contiguous array of pixels is adapted to emit light from the light source in a predetermined wavelength band.

Abstract: An eyewear device that performs diarization by segmenting spoken language into different speakers and remembering each speaker over the course of a session. The speech of each speaker is translated to text and the text of each speaker is displayed on an eyewear display. The text of each user has a different attribute such that the eyewear user can distinguish the text of different speakers. Examples of the text attribute can be a text color, font, and font size. The text is displayed on the eyewear display such that it does not substantially obstruct the user's vision.

Abstract: Systems, devices, media, and methods are presented for using a flexible electronic device to selectively interact with an eyewear device. A portable eyewear device includes a processor, a memory, and a display projected onto at least one lens assembly. A flexible electronic device includes an integrated circuit, a plurality of input sensors, and a power system, all mounted on a flexible substrate that is sized and shaped to conform to a graspable object such as a ring. The flexible electronic device operates according to a power budget, operating on a sensor power budget until it detects a first interaction with at least one of the input sensors. If the first interaction exceeds a sensitivity threshold, the flexible electronic device sends a wake signal to a nearby eyewear device. In response to the wake signal, the eyewear device presents a graphical user interface (GUI) on the display.

Abstract: The present application discloses examples of various apparatuses and systems that can be utilized for augmented reality. According to one example, a wearable device that can optionally comprise: a frame configured for wearing by a user; one or more optical elements mounted on the frame; an array having a plurality of light emitting diodes coupled to the one or more optical elements, wherein the one or more optical elements and the array are mounted within a field of view of the user when the frame is worn by the user; and additional onboard electronic components carried by the frame including at least a battery that is configured to provide for electrically powered operation of the array.

Abstract: A method of locating a personal mobility system using an augmented reality device is disclosed. The method comprises receiving positional data corresponding to a location of a personal mobility system, determining a relative position between the augmented reality device and the location of the personal mobility system, and causing the display of an augmented reality effect by the augmented reality device based on the relative position between the augmented reality device and the location of the personal mobility system.

Abstract: A method of providing guidance, such as to the user of a personal mobility device, uses a head-worn device including a camera and one or more display devices. The method includes capturing images using the camera of the head-worn device and identifying an area, represented in the captured images, having a certain permission associated therewith. An augmented reality effect is overlaid on the area, and the captured images with the overlaid augmented reality effect are displayed on the head-worn device.

Abstract: System, methods, devices, and instructions are described for fast boot of a processor as part of camera operation. In some embodiments, in response to a camera input, a digital signal processor (DSP) of a device is booted using a first set of instructions. Capture of image sensor data is initiated using the first set of instructions at the DSP. The DSP then receives a second set of instructions and the DSP is programmed using the second set of instructions after at least a first frame of the image sensor data is stored in a memory of the device. The first frame of the image sensor data is processed using the DSP as programmed by the second set of instructions. In some embodiments, the first set of instructions includes only instructions for setting camera sensor values, and the second set of instructions includes instructions for processing raw sensor data into formatted image files.

Abstract: Eyewear including a frame, a projector supported by the frame, and a lens supported by the frame. The lens has a first surface facing an eye of the user and a second surface facing away from the eye of the user when the frame is worn. The lens also includes a waveguide defined by the first and second surfaces to receive light from the projector. An input light coupler and an output light coupler are on the first surface of the lens and at least one reflector is positioned on a second surface of the lens to redirect light received from the input coupler and/or the output coupler to redirect light having an angle of incidence with respect to the second surface of the lens that would result in that portion of the light exiting the waveguide through the second surface in the absence of the at least one reflector.

Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. Point cloud data describing an environment is then accessed. A two-dimensional surface of an image of an environment is captured, and a portion of the image is matched to a portion of key points in the point cloud data. An augmented reality object is then aligned within one or more images of the environment based on the match of the point cloud with the image. In some embodiments, building façade data may additionally be used to determine a device location and place the augmented reality object within an image.