Abstract: A method of providing an interactive personal mobility system, performed by one or more processors, comprises determining an initial pose by visual-inertial odometry performed on images and inertial measurement unit (IMU) data generated by a wearable augmented reality device. Sensor data transmitted from a personal mobility system is received, and sensor fusion is performed on the data received from the personal mobility system to provide an updated pose. Augmented reality effects are displayed on the wearable augmented reality device based on the updated pose.

Abstract: A wearable device includes a body having fasteners and a frame coupled between two fasteners. The frame includes first and second sections. A first portion of the body includes the first section of the frame and one fastener and a second portion of the body includes the second section of the frame and the other fastener. A speaker and a microphone are connected to the first portion and another speaker and another microphone are connected to the second portion. The body also includes a processor, memory accessible to the processor, and programming in the memory for configuring the processor to selectively activate the speakers and microphones such that a first speaker emits an output sound signal while a first microphone and a second speaker are deactivated and a second microphone captures an input sound signal during the emission of the output sound signal by the first speaker.

Abstract: Eyewear having an optical waveguide communicating infrared light from a remote infrared emitter in the eyewear to an optical output coupler that uniformly illuminates an eye for tracking eye movement of a user. An optical input coupler couples a light beam emitted by the remote infrared emitter into the waveguide. The remote infrared emitter simplifies industrial design and is a single light source. The remote infrared emitter is not in a peripheral vision of a user's eye and improves a cosmetic impact.

Abstract: Apparatuses and systems for electronic wearable devices such as smart glasses are described. The wearable device can comprise a housing, an image capture component, a locking component, and a control component. The housing defines an imaging aperture. The image capture component is coupled to the housing and aligned with the imaging aperture. The image capture component is configured to capture image data of a field of view aligned with the imaging aperture. The locking component is coupled to the image capture component. The locking component modifies a capture state of the image capture component to selectively enable image capture in response to a selection releasing the locking component. The control component is coupled to the locking component. Interaction with the control component comprises the selection releasing the locking component and triggering modification of the capture state of the image capture component.

Abstract: Systems, devices, media, and methods are presented for composing and sharing a message based on the motion of a handheld electronic device such as a ring. The methods in some implementations include presenting a keyboard on a display, collecting course data associated with a course traveled by the ring, and overlying a trace onto the keyboard, such that the trace is correlated in near real-time with the course traveled by the ring. In some implementations the display element is part of a portable device, such as the lens of an electronic eyewear device. Based on the course data relative to the key locations on the keyboard, the system identifies and presents candidate words to be included in a message.

Abstract: A method of providing an interactive personal mobility system, performed by one or more processors, comprises determining an initial pose by visual-inertial odometry performed on images and inertial measurement unit (IMU) data generated by a wearable augmented reality device. Sensor data transmitted from a personal mobility system is received, and sensor fusion is performed on the data received from the personal mobility system to provide an updated pose. Augmented reality effects are displayed on the wearable augmented reality device based on the updated pose.

Abstract: A see-through display including a polarized reflective pinhole mirror display. The pinhole mirror display includes a plurality of tiny switchable polarized mirrors. The respective polarized mirrors individually reflect impinging light from an illuminator, and guide the respective portion of light into a pupil of an eye. A reflective optically powered surface reflects light from the illuminator. Each mirror has a first polarization and reflects a portion of light and produces a picture element (pixel) that forms a virtual image seen by the eye of the user. A user may view the reflected virtual image having the first polarization from the illuminator, as well as the image from the real world via a rear substrate that has a second polarization. Although the mirrors are very small, human eyes can still detect the mirrors if they are not polarized.

Abstract: Systems and methods herein describe using a neural network to identify a first set of joint location coordinates and a second set of joint location coordinates and identifying a three-dimensional hand pose based on both the first and second sets of joint location coordinates.

Abstract: Apparatuses and systems for electronic wearable devices such as smart glasses are described. The wearable device can comprise a housing, an image capture component, a locking component, and a control component. The housing defines an imaging aperture. The image capture component is coupled to the housing and aligned with the imaging aperture. The image capture component is configured to capture image data of a field of view aligned with the imaging aperture. The locking component is coupled to the image capture component. The locking component modifies a capture state of the image capture component to selectively enable image capture in response to a selection releasing the locking component. The control component is coupled to the locking component. Interaction with the control component comprises the selection releasing the locking component and triggering modification of the capture state of the image capture component.

Abstract: AR-enhanced gameplay includes a map of a course including a plurality of virtual objects, the map corresponding to a location in the real world and defining a track along which participants can ride on personal mobility systems such as scooters. Virtual objects are displayed in the fields of view of participants' augmented reality devices in a positions corresponding to positions in the real world on the course. Proximity of a participant or their personal mobility system with the position of a virtual object in the real world is detected, and in response to the detection of proximity, a performance characteristic of the participant's personal mobility system is modified.

Abstract: The present application discloses examples of various apparatuses and systems that can be utilized for augmented reality. According to one example, a wearable device that can optionally comprise: a frame configured for wearing by a user; one or more optical elements mounted on the frame; an array having a plurality of light emitting diodes coupled to the one or more optical elements, wherein the one or more optical elements and the array are mounted within a field of view of the user when the frame is worn by the user; and additional onboard electronic components carried by the frame including at least a battery that is configured to provide for electrically powered operation of the array.

Abstract: Systems, devices, media, and methods are presented for using a flexible electronic device to selectively interact with an eyewear device. A portable eyewear device includes a processor, a memory, and a display projected onto at least one lens assembly. A flexible electronic device includes an integrated circuit, a plurality of input sensors, and a power system, all mounted on a flexible substrate that is sized and shaped to conform to a graspable object such as a ring. The flexible electronic device operates according to a power budget, operating on a sensor power budget until it detects a first interaction with at least one of the input sensors. If the first interaction exceeds a sensitivity threshold, the flexible electronic device sends a wake signal to a nearby eyewear device. In response to the wake signal, the eyewear device presents a graphical user interface (GUI) on the display.

Abstract: AR-enhanced gameplay includes a map of a course including a plurality of virtual objects, the map corresponding to a location in the real world and defining a track along which participants can ride on personal mobility systems such as scooters. Virtual objects are displayed in the fields of view of participants' augmented reality devices in a positions corresponding to positions in the real world on the course. Proximity of a participant or their personal mobility system with the position of a virtual object in the real world is detected, and in response to the detection of proximity, a performance characteristic of the participant's personal mobility system is modified.

Abstract: Methods and systems are disclosed for performing operations for displaying virtual content on a contact lens. The operations comprise causing the contact lens to operate in a first display mode to allow unobstructed light associated with a real-world environment to be received by a pupil of a user; detecting a condition associated with display of virtual content; selecting between a second display mode and a third display mode as a new display mode in which to operate the contact lens, the second display mode obstructing a portion of the light associated with a real-world environment received by the pupil with the virtual content, the third display mode obstructing all of the light associated with a real-world environment received by the pupil with the virtual content; and transitioning the contact lens from operating in the first display mode to operating in the new display mode in response to detecting the condition.

Abstract: Systems, devices, media, and methods are presented for selectively activating and suspending control of a graphical user interface by two or more electronic devices. A portable eyewear device includes a display projected onto at least one lens assembly and a primary touchpad through which the user may access a graphical user interface (GUI) on the display. A handheld accessory device, such as a ring, includes an auxiliary touchpad that is configured to emulate the primary touchpad. The eyewear processor temporarily suspends inputs from one touchpad when it detects an activation signal from the other touchpad.

Abstract: Augmented reality eyewear devices allow users to experience a version of our “real” physical world augmented with virtual objects. Augmented reality eyewear may present a user with a graphical user interface that appears to be in the airspace directly in front of the user thereby encouraging the user to interact with virtual objects in socially undesirable ways, such as by making sweeping hand gestures in the airspace in front of the user. Anchoring various input mechanisms or the graphical user interface of an augmented reality eyewear application to a wristwatch may allow a user to interact with an augmented reality eyewear device in a more socially acceptable manner. Combining the displays of a smartwatch and an augmented reality eyewear device into a single graphical user interface may provide enhanced display function and more responsive gestural input.

Abstract: The present application discloses examples of various apparatuses and systems that can be utilized for augmented reality. According to one example, a wearable device that can optionally comprise: a frame configured for wearing by a user; one or more optical elements mounted on the frame; an array having a plurality of light emitting diodes coupled to the one or more optical elements, wherein the one or more optical elements and the array are mounted within a field of view of the user when the frame is worn by the user; and additional onboard electronic components carried by the frame including at least a battery that is configured to provide for electrically powered operation of the array.

Abstract: Content is displayed to a user of augmented reality device. In response to receiving an indication of an increased level of risk, the degree of content being displayed to the user is reduced. The indication of increased level of risk may be generated by or received from an associated transportation device. The adjustment of the display of the degree of content may include moving one or more content elements out of a central field of view of the augmented reality device, reducing the size or visual characteristics of a content element, or eliminating a content element from the display.

Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. A set of structure façade data describing one or more structure façades associated with the first position estimate is then accessed. A first image of an environment is captured, and a portion of the image is matched to part of the structure façade data. A second position is then estimated based on a comparison of the structure façade data with the portion of the image matched to the structure façade data.

Abstract: One aspect disclosed is a method including determining a location from a positioning system receiver, determining, using a hardware processor and the location, that the location is approaching a path of direction of visual direction information, displaying the visual direction information on a display of a wearable device in response to the determining, determining, using the positioning system receiver, whether the turn of the visual direction information has been made, determining, by the hardware processor, a first period of time for display of the content data based on whether the turn of the visual direction information has been made, powering on the display and displaying, using the display, content data for the first period of time, turning off the display and the hardware processor following display of the content data.