Abstract: AR-enhanced gameplay includes a map of a course including a plurality of virtual objects, the map corresponding to a location in the real world and defining a track along which participants can ride on personal mobility systems such as scooters. Virtual objects are displayed in the fields of view of participants' augmented reality devices in a positions corresponding to positions in the real world on the course. Proximity of a participant or their personal mobility system with the position of a virtual object in the real world is detected, and in response to the detection of proximity, a performance characteristic of the participant's personal mobility system is modified.

Abstract: A method of providing an interactive personal mobility system, performed by one or more processors, comprises determining an initial pose by visual-inertial odometry performed on images and inertial measurement unit (IMU) data generated by a wearable augmented reality device. Sensor data transmitted from a personal mobility system is received, and sensor fusion is performed on the data received from the personal mobility system to provide an updated pose. Augmented reality effects are displayed on the wearable augmented reality device based on the updated pose.

Abstract: A wearable device includes a body having fasteners and a frame coupled between two fasteners. The frame includes first and second sections. A first portion of the body includes the first section of the frame and one fastener and a second portion of the body includes the second section of the frame and the other fastener. A speaker and a microphone are connected to the first portion and another speaker and another microphone are connected to the second portion. The body also includes a processor, memory accessible to the processor, and programming in the memory for configuring the processor to selectively activate the speakers and microphones such that a first speaker emits an output sound signal while a first microphone and a second speaker are deactivated and a second microphone captures an input sound signal during the emission of the output sound signal by the first speaker.

Abstract: Eyewear having a camera capturing images, and an image processor configured to process the images and display the processed image in both controlled and uncontrolled regions on the display. In an example, the image processor applies a vignette gradient to soften edges of the displayed image in the uncontrolled regions, which compensates for any discoloration in the uncontrolled regions. The uncontrolled regions may be located above and below the controlled region.

Abstract: Eyewear having an optical waveguide communicating infrared light from a remote infrared emitter in the eyewear to an optical output coupler that uniformly illuminates an eye for tracking eye movement of a user. An optical input coupler couples a light beam emitted by the remote infrared emitter into the waveguide. The remote infrared emitter simplifies industrial design and is a single light source. The remote infrared emitter is not in a peripheral vision of a user's eye and improves a cosmetic impact.

Abstract: A method of controlling a personal mobility system includes displaying a virtual object on an augmented reality wearable device, the virtual object being located in a position in the field of view of the augmented reality device corresponding to a position in the real world. Proximity of the personal mobility system or a user of the personal mobility system with the position in the real world is detected. In response to the detection of proximity, a performance characteristic of the personal mobility system is modified.

Abstract: Eyewear including a frame, a projector supported by the frame, and a lens supported by the frame. The lens has a first surface facing an eye of the user and a second surface facing away from the eye of the user when the frame is worn. The lens also includes a waveguide defined by the first and second surfaces to receive light from the projector. An input light coupler and an output light coupler are on the first surface of the lens and at least one reflector is positioned on a second surface of the lens to redirect light received from the input coupler and/or the output coupler to redirect light having an angle of incidence with respect to the second surface of the lens that would result in that portion of the light exiting the waveguide through the second surface in the absence of the at least one reflector.

Abstract: System, methods, devices, and instructions are described for fast boot of a processor as part of camera operation. In some embodiments, in response to a camera input, a digital signal processor (DSP) of a device is booted using a first set of instructions. Capture of image sensor data is initiated using the first set of instructions at the DSP. The DSP then receives a second set of instructions and the DSP is programmed using the second set of instructions after at least a first frame of the image sensor data is stored in a memory of the device. The first frame of the image sensor data is processed using the DSP as programmed by the second set of instructions. In some embodiments, the first set of instructions includes only instructions for setting camera sensor values, and the second set of instructions includes instructions for processing raw sensor data into formatted image files.

Abstract: Displays and eyewear devices incorporating displays are disclosed. One display includes a light source, a first display region, and a second display region. The first display region includes a first contiguous array of pixels. The first contiguous array of pixels includes a first group of pixels and a second group of pixels interspersed with the first group of pixels. The first group of pixels is adapted to emit light from the light source in only a first wavelength band and the second group of pixels is adapted to emit light from the light source in only a second wavelength band different from the first wavelength band. The second display region consists essentially of a second contiguous array of pixels. The second contiguous array of pixels is adapted to emit light from the light source in a predetermined wavelength band.

Abstract: Systems, devices, media, and methods are presented for composing and sharing a message based on the motion of a handheld electronic device such as a ring. The methods in some implementations include presenting a keyboard on a display, collecting course data associated with a course traveled by the ring, and overlying a trace onto the keyboard, such that the trace is correlated in near real-time with the course traveled by the ring. In some implementations the display element is part of a portable device, such as the lens of an electronic eyewear device. Based on the course data relative to the key locations on the keyboard, the system identifies and presents candidate words to be included in a message.

Abstract: Systems and methods for eyewear devices with integrated heads-up displays are provided. In one embodiment, an eyewear device provides an integrated heads-up display having a partially reflective element carried by an eyeglass lens to reflect towards the user computer-generated imagery projected on to it, while permitting the passage of light through the reflective surface in the direction of view of the user. The display mechanism further includes a cooperating projector assembly housed by a frame of the eyewear device in an overhead configuration relative to the partially reflective element. The projector assembly is housed by a top bar of the eyewear frame, with the reflective surface being housed wholly within the lens.

Abstract: An eyewear device is disclosed including a frame, a temple connected to a lateral side of the frame, an array of light emitting diodes (LEDs) to emit light patterns on an inner surface of the frame or the temple within a peripheral view of a wearer of the eyewear, a processor coupled to the eyewear device, and a memory accessible to the processor. The memory stores programming for execution by the processor and notification patterns corresponding to the LEDs. Execution of the programming configures the eyewear device to identify an event for presentation to the wearer, select a notification pattern corresponding to the identified event, and display the selected notification pattern to the wearer by selectively illuminating the LEDs.

Abstract: Apparatuses and systems for wearable devices such as eyewear are described. According to one embodiment, the wearable device includes a frame, onboard electronics components, and an antenna disposed around an eyepiece area of the frame that is configured to hold an optical element. The antenna is configured for inductive coupling. In some embodiments, a switch coupled to the antenna allows selection between circuitry for inductive charging of a battery and near-field communication (NFC) circuitry for communicating data via the antenna.

Abstract: Systems and methods herein describe using a neural network to identify a first set of joint location coordinates and a second set of joint location coordinates and identifying a three-dimensional hand pose based on both the first and second sets of joint location coordinates.

Abstract: Eyewear providing an interactive augmented reality experience to users in a first physical environment viewing objects in a second physical environment (e.g., X-ray effect). The second environment may be a room positioned behind a barrier, such as a wall. The user views the second environment via a sensor system moveable on the wall using a track system. As the user in the first environment moves the eyewear to face the outside surface of the wall along a line-of-sight (LOS) at a location (x, y, z), the sensor system on the track system repositions to the same location (x, y, z) on the inside surface of wall. The image captured by the sensor system in the second environment is wirelessly transmitted to the eyewear for displayed on the eyewear displays, providing the user with an X-ray effect of looking through the wall to see the objects within the other environment.

Abstract: Apparatuses and systems for electronic wearable devices such as smart glasses are described. The wearable device can comprise a housing, an image capture component, a locking component, and a control component. The housing defines an imaging aperture. The image capture component is coupled to the housing and aligned with the imaging aperture. The image capture component is configured to capture image data of a field of view aligned with the imaging aperture. The locking component is coupled to the image capture component. The locking component modifies a capture state of the image capture component to selectively enable image capture in response to a selection releasing the locking component. The control component is coupled to the locking component. Interaction with the control component comprises the selection releasing the locking component and triggering modification of the capture state of the image capture component.

Abstract: A see-through display including a polarized reflective pinhole mirror display. The pinhole mirror display includes a plurality of tiny switchable polarized mirrors. The respective polarized mirrors individually reflect impinging light from an illuminator, and guide the respective portion of light into a pupil of an eye. A reflective optically powered surface reflects light from the illuminator. Each mirror has a first polarization and reflects a portion of light and produces a picture element (pixel) that forms a virtual image seen by the eye of the user. A user may view the reflected virtual image having the first polarization from the illuminator, as well as the image from the real world via a rear substrate that has a second polarization. Although the mirrors are very small, human eyes can still detect the mirrors if they are not polarized.

Abstract: Systems and methods for image based location estimation are described. In one example embodiment, a first positioning system is used to generate a first position estimate. Point cloud data describing an environment is then accessed. A two-dimensional surface of an image of an environment is captured, and a portion of the image is matched to a portion of key points in the point cloud data. An augmented reality object is then aligned within one or more images of the environment based on the match of the point cloud with the image. In some embodiments, building façade data may additionally be used to determine a device location and place the augmented reality object within an image.

Abstract: One aspect disclosed is a method including determining a location from a positioning system receiver, determining, using a hardware processor and the location, that the location is approaching a path of direction of visual direction information, displaying the visual direction information on a display of a wearable device in response to the determining, determining, using the positioning system receiver, whether the turn of the visual direction information has been made, determining, by the hardware processor, a first period of time for display of the content data based on whether the turn of the visual direction information has been made, powering on the display and displaying, using the display, content data for the first period of time, turning off the display and the hardware processor following display of the content data.

Abstract: A see-through display including a polarized reflective pinhole mirror display. The pinhole mirror display includes a plurality of tiny switchable polarized mirrors. The respective polarized mirrors individually reflect impinging light from an illuminator, and guide the respective portion of light into a pupil of an eye. A reflective optically powered surface reflects light from the illuminator. Each mirror has a first polarization and reflects a portion of light and produces a picture element (pixel) that forms a virtual image seen by the eye of the user. A user may view the reflected virtual image having the first polarization from the illuminator, as well as the image from the real world via a rear substrate that has a second polarization. Although the mirrors are very small, human eyes can still detect the mirrors if they are not polarized.