Abstract: An eye tracking system includes a pair of glasses including two frames; a light scanning projector coupled to the pair of glasses and operable to scan a beam of light to project an image frame including a plurality of pixels; an eyepiece mounted in one of the two frames and optically coupled to the light scanning projector; one or more photodetectors coupled to one of the two frames and operable to detect time-varying reflected signals; and a processor coupled to the light scanning projector and the photodetectors. The eyepiece includes an exit pupil expander operable to direct a portion of the beam of light towards an eye of a user. Each of the time-varying reflected signals is associated with the plurality of pixels. The processor is operable to correlate the time-varying reflected signals with the plurality of pixels and determine a first eye orientation.

Abstract: A display device includes an optical assembly and a display that includes a front surface and a back surface. The display is configured to output image light from the front surface and transmit ambient light from the back surface to the front surface. The optical assembly includes a substrate that has a substantially uniform thickness, a beam splitter, and a reflector. The optical assembly is configured to receive the image light output from the front surface of the display and to transmit a portion of the image light at a first non-zero optical power via an optical path that includes reflections at the reflector and at the beam splitter. The optical assembly is also configured to transmit a portion of the ambient light through the optical assembly at a second optical power without reflection at the reflector. The second optical power is less than the first optical power.

Abstract: An information processing apparatus according to an embodiment of the present technology includes a physical information acquisition unit, a gesture information acquisition unit, a determination condition setting unit, and a control unit. The physical information acquisition unit acquires physical information of a user wearing a head-mounted casing. The gesture information acquisition unit acquires gesture information regarding a gesture of the user. The determination condition setting unit sets, on the basis of the physical information, a determination condition for determining a trigger gesture that is a trigger for an operation input by the gesture of the user. The control unit determines, on the basis of the gesture information and the determination condition, whether or not the trigger gesture is performed and controls, on the basis of a result of the determination, an output corresponding to the trigger gesture.

Abstract: A head-mounted extended reality (XR) display device includes a rigid mounting element coupled to a frame. The XR display device further includes right-side and left-side visible light cameras coupled to the rigid mounting element, right-side and left-side near-infrared (NIR) cameras coupled to the rigid mounting element, and an NIR light-emitting diode (LED) configured to illuminate a region within a field of view of the NIR cameras. The visible light cameras are configured to capture stereoscopic visible light images within a field of view of the user when the user is wearing the frame, and the NIR cameras are configured to capture stereoscopic NIR images within the field of view of the user when the user is wearing the frame.

Abstract: An augmented reality display system is configured to direct a plurality of parallactically-disparate intra-pupil images into a viewer's eye. The parallactically-disparate intra-pupil images provide different parallax views of a virtual object, and impinge on the pupil from different angles. In the aggregate, the wavefronts of light forming the images approximate a continuous divergent wavefront and provide selectable accommodation cues for the user, depending on the amount of parallax disparity between the intra-pupil images. The amount of parallax disparity is selected using a light source that outputs light for different images from different locations, with spatial differences in the locations of the light output providing differences in the paths that the light takes to the eye, which in turn provide different amounts of parallax disparity.

Abstract: The disclosed technology relates to operating two wireless communication protocols during operation of a hearing device.

Abstract: An example wearable electronic device includes a frame, a first arm and a second arm extending from the frame, respectively, a screen display disposed in the frame, and including a display, at least one camera disposed in the frame, a first processor located in the first arm, and operatively connected to the display, and a second processor located in the second arm, and operatively connected to the at least one camera, the first processor may be configured to display contents on the screen display part using the display, and the second processor may be configured to perform an operation associated with the at least one camera.

Abstract: An optical module for a head-mounted device is configured to present content to a user. The optical module includes an optical module housing assembly, a display assembly, and an eye camera. The optical module housing assembly has a first end and a second end. The lens is connected to the optical module housing assembly and positioned at the first end of the optical module housing assembly. The display assembly is connected to the optical module housing assembly and is positioned at the second end of the optical module housing assembly. The display assembly is configured to cause the content to be displayed to the user through the lens. The eye camera is connected to the optical module housing assembly and is positioned at the second end of the optical module housing assembly. The eye camera is configured to obtain images through the lens.

Abstract: Head mounted displays (HMD) and corresponding display methods are provided, which obtain, repeatedly, from a monitoring system of a vehicle and, a reference vector relating to the vehicle; display on the HMD a reference symbol that indicates the reference vector; and determine movements of a HMD symbology according to a spatial relation between a received user's line of sight (LOS) and the reference vector. For example, the vehicle may be an aircraft and the reference vector a flight path vector (FPV) received from the aircraft's avionics. The proposed HMD enhances the displayed information content while avoiding excessive movements of the symbology. The HMD's functional parameters may be pre-set or adapted according to user preference and flight stage characteristics. The reference symbol anchors most of the symbology, while minimal critical information may be moved along with the user's LOS, providing a clearer and more stable view through the HMD.

Abstract: A switch module for an electronic device detects translational inputs and defines at least portion of a conductive path from an input surface of the electronic device to a processing unit of the electronic device. The switch module may be a component of a crown assembly for detecting rotational inputs, translational inputs, touch inputs and/or biological signals such as electrocardiogram (ECG) signals. The switch module may include a conductive dome and a friction guard that is positioned between the conductive dome and the actuation member of the crown assembly. The conductive dome and/or the friction guard may define at least a portion of the conductive path from the input surface to the processing unit.

Abstract: System and methods are provided for augmented reality displays for medical and physiological monitoring. Augmented reality user interfaces are virtually pinned to a physical device, a location, or to a patient. An augmented reality position determination process determines the presentation of user interfaces relative to reference positions and reference objects. Detection of gestures causes the augmented reality users interfaces to be updated, such as pinning a user interface to a device, location, or patient. Looking away from an augmented reality user interface causes the user interface to minimize or disappear in an augmented reality display. An augmented reality gesture detection process determines gestures based on captured image data and computer vision techniques performed on the image data.

Abstract: A control system controls a gesture recognition system of a vehicle. The control system identifies a position of a body part with respect to a gesture recognition area in accordance with a detection signal of a sensor system. The control system specifies a haptic feedback signal based on the position of the body part with respect to the gesture recognition area. The control system outputs the haptic feedback signal to a haptic feedback system. The haptic feedback signal is configured to cause the haptic feedback system to output non-contact haptic feedback indicating the position of the body part with respect to the gesture recognition area toward a vehicle occupant.

Abstract: The present invention relates to a method and a device for enabling to analyze a property of a vital sign detector (20). The proposed method comprises the steps of providing a virtual phantom (14) of a living being, rendering an artificial vital sign on the displayed virtual phantom (14), and outputting the virtual phantom (14) with the rendered artificial vital sign to the vital sign detector (20).

Abstract: In certain embodiments, pupil-related characteristic detection or spectacles correction/adjustment based thereon may be facilitated. In some embodiments, a stimulus may be presented at a location on a first display of the user device at a first time to cause a first eye of a user to fixate on the location. A stimulus may be presented at the location on a second display of the user device to cause a second eye of the user to fixate on the location at a time subsequent to the first time. Movement of the first or second eye to fixate on the location on the respective first or second display in connection with the stimulus presentation at the second time may be determined. In response to determining that the movement of the first or second eye exceeded a threshold movement amount, a user profile may be generated that includes the user's pupil distance.

Abstract: A head-mounted display and accessory system in which the accessory emits bleaching light through the head-mounted display to bleach photoreceptors for dark adaptation testing includes a casing, where a lens of a head-mounted display is positioned inside the cavity, and where an aperture of the casing is aligned with an exterior-facing camera of the head-mounted display. The system also includes an attachment body, where a posterior end of the attachment body is fixed to an anterior end of the casing, and where the attachment body includes a set of light-emitting diodes (LEDs), where the set of LEDs is attached to the posterior end of the attachment body and is directed towards the lens. The system also includes a circuitry that is configured to control light emission of the set of LEDs.

Abstract: A mobile wireless device (100) in the configuration of user wearable glasses includes at least one lens including at least one transparent display (110). The at least one display is operable to provide visual outputs that are visually perceivable to the user of the device. The user is enabled to see through the at least one lens, physical surroundings in a direct field of view. The device includes at least one input device (116, 122, 114) which receives user inputs. At least one circuit is in operative connection with the at least one display, the at least one input device, a data store (106) and a wireless transceiver (120). At least one user input is operative to cause the device to communicate at least one wireless message which includes data usable to identify a financial account associated with the user. At least one remote circuit is operative responsive to the at least one wireless message to cause a financial transfer to or from the financial account.

Abstract: A method of decrypting an encrypted message. The method comprises storing a wearer decryption code in a memory of a wearable mobile device having a head-worn augmented display which generates an augmented reality view for a wearer of the wearable mobile device, capturing using the wearable mobile device a video sequence including at least one frame imaging a visible code using an image sensor of the wearable mobile device, processing the video sequence to identify the visible code, decrypting the visible code using the wearer decryption code to create an decrypted content, and presenting the decrypted content on top of at least some of the visible code in the augmented reality view.

Abstract: Disclosed are a method and an input device for inputting information such as user commands to a computer a person wearing a virtual retinal display device that allows the person to concurrently see the real world.

Abstract: There is provided a system configured to perform location-aware augmented reality tasks utilizing software and/or hardware components. For example, and not by limitation, a general embodiment may include an AR system. The system may include an ultra-wide band (UWB) communication system configured to estimate location information. The UWB system can include a memory and a processor which when executing instructions from the memory is configured to perform operations consistent with location-aware AR applications. For instance, the operations may include receiving a first UWB signal, the first UWB signal including information comprising fiducial data associated with a device transmitting the first UWB signal.

Abstract: A high frame rate image system in a theme park attraction simultaneously displays images that are unique to each individual viewer. Although all viewers in a room or theater may be watching the same screen or area, they may see entirely different images. This allows the attraction to present more complex story narratives, and also allows the projected images to be matched to specific guests.

Abstract: An image projection system includes: eyeglasses including a frame, a first eyeglass lens, and a second eyeglass lens; and a binocular light engine coupled to the frame. The binocular light engine includes a first light transmitter configured to transmit a first plurality of light beams corresponding to a first stereoscopic image on a first transmission path; a second light transmitter configured to transmit a second plurality of light beams corresponding to a second stereoscopic image on a second transmission path; and a single scanning structure shared by the first transmission path and the second transmission path. The single scanning structure is configured to: rotate about two scanning axes, direct the first plurality of light beams at the first eyeglass lens according to a scanning pattern, and direct the second plurality of light beams at the second eyeglass lens according to the scanning pattern.

Abstract: An apparatus and method for implementing a technique for performing calibration of an electromagnetic tracking apparatus on-the-fly while operating the apparatus. The apparatus and method uses a non-magnetic tracking device to determine position and orientation of a tracked object that is not subject to magnetic distortion or interference, and store calibration data for future measurements by the electromagnetic tracking apparatus based on the measurements made by the non-magnetic tracking device.

Abstract: A Head Mounted Display (HMD) includes a pixel array having multiple pixels configured in a two-dimensional surface, each pixel providing multiple light beams forming an image provided to a user. The HMD also includes a first optical element configured to provide a central portion of a field of view for the image through an eyebox that limits a volume including a pupil of the user, and a second optical element configured to provide a peripheral portion of the field of view for the image through the eyebox, wherein the peripheral portion of the field of view comprises at least one steradian of a user's field of view at a resolution of at least fifteen arcminutes.

Abstract: A method for managing a user interface in a smart glass is provided. The method includes identifying an eye gesture of the user of the smart glass, based on an eye-tracking signal indicative of a pupil location of the user, assessing a user intention for an application displayed in a user interface in the headset based on the eye gesture, and activating the application based on the user intention. A smart glass for use with the above method is also provided.

Abstract: A transceiver based on at least one optical source is provided to facilitate wireless communication in a wearable display device, where the wearable display device is embedded with one or more planar antennas. The transceiver operates in terahertz and may be coupled to two different antennas, one for transmission and the other for reception.

Abstract: Provided is a glass type electronic device including a binocular lens, a lens frame fixed to the binocular lens and seated on a head of the wearer, an electronic component case fixed to the lens frame, and an optical driving assembly mounted in the electronic component case and emitting light to the binocular lens. The optical driving lens can include an image source panel for generating light corresponding to a content image, an emitting lens group provided to expose an exit surface to an outside of the electronic component case and for adjusting an exit angle and a focal length of the light, and a reflective mirror provided to expose a reflection surface to an outside of the electronic component case and for reflecting the light, emitted from the emitting lens group, to the binocular lens.

Abstract: The present disclosure relates to a virtual reality interaction method, a device and a system. The method includes: acquiring relative pose data of a target individual relative to a head-mounted device at a first time point, wherein the target individual is an individual in a reality space where the head-mounted device is located, the target individual and an individual wearing the head-mounted device are different individuals, and the pose data includes position data and posture data; obtaining virtual pose data of the target individual in a virtual scene of the head-mounted device at the first time point according to the relative pose data; and rendering and displaying a virtual individual corresponding to the target individual in the virtual scene according to the virtual pose data.

Abstract: Systems and methods for estimating a layout of a room are disclosed. The room layout can comprise the location of a floor, one or more walls, and a ceiling. In one aspect, a neural network can analyze an image of a portion of a room to determine the room layout. The neural network can comprise a convolutional neural network having an encoder sub-network, a decoder sub-network, and a side sub-network. The neural network can determine a three-dimensional room layout using two-dimensional ordered keypoints associated with a room type. The room layout can be used in applications such as augmented or mixed reality, robotics, autonomous indoor navigation, etc.

Abstract: A system and method for controlling a non-tactile device including a receiving device configured to receive signals corresponding to a user's EEG or movements, translate the EEG or movements into directional intentions, transmit the directional intentions to a secondary device, receive a command for one or more actions from the secondary device based on the transmitted directional intentions and output at least one control signal to the non-tactile device based on the received command for one or more actions. The non-tactile device may receive signals corresponding to a user's EEG or movements using a gestural sensor and/or an EEG sensor.

Abstract: The present invention relates to a helmet that includes an outer shell, a heads-up information system that comprises a display, and an attachment assembly. The heads-up information system is movable from a storage position within the outer shell to a use position in which the display of the heads-up information system is visible by a user, without obstructing the field of vision of the user, when the helmet is worn by the user. The attachment assembly is coupled to outer shell and the heads-up information system, and is operable to move the heads-up information system between the storage position and the use position.

Abstract: A method includes displaying a home ER environment characterized by home ER world coordinates, including one or more diorama-view representation of one or more respective ER environments. Each diorama-view representation includes ER objects arranged in a spatial relationship according to corresponding ER world coordinates. In some implementations, in response to detecting an input directed to a first diorama-view representation, the method includes transforming the home ER environment. Transforming the home ER environment includes transforming the spatial relationship between a subset of the ER objects as a function of the home ER world coordinates and corresponding ER world coordinates.

Abstract: A headset can include a frame; a display assembly supported by the frame; a motion sensor that generates motion data responsive to motion of the frame; and circuitry that generates a frame fit signal via the motion data.

Abstract: A head-mounted display, a display control method, and a program that facilitate a user to understand proximity between the user and an object around the user are provided. A display block (36) is arranged in front of the eyes of the user wearing a HMD (12). In accordance with proximity between the user and an object around the user, the HMD (12) controls the display block (36) so as to have the user visually recognize a forward direction of the display block (36).

Abstract: According to the present invention, it is possible to provide a wearable display device having good background visibility, a wide visual angle capable of viewing projected images, and a simple structure. The wearable display device includes at least a transparent screen and a projection device which projects an image on the transparent screen, in which a magnifying lens for viewing the image reflected from the transparent screen is disposed on a viewing side to cover at least a part of the transparent screen.

Abstract: Systems and methods are provided for measuring and identifying real-world tremors in order to calculate and display an anti-tremor in a virtual reality world. A system may identify a tremor in a body part, such as hands, and measure the tremor movement from, e.g., body sensors, to calculate an opposite movement and animate virtual hands performing the reverse tremor motion. Depicting inverse motions, such as an anti-tremor, may be used in a few ways to therapeutically train and exercise patients to better control their tremors. Providing a visual cue may help a patient interrupt the movement, as well as provide possibilities for therapy or training muscle memory and stimulating nerve and neuron recovery. By displaying an anti-tremor with virtual hands, a VR system may be used to help train or exercise body parts experiencing tremors.

Abstract: A method and system for image display with a head-mounted device, which use a seethrough tunable diffractive mirror, such as a see-through tunable holographic mirror or seethrough tunable LCD array mirror, which mirror is useful in providing augmented reality.

Abstract: A head-mounted display includes a display unit and a facial interface. The display unit includes a display for displaying graphical content to a user. The facial interface is coupled to the display unit and configured to engage a face of the user to support the display unit thereon. The facial interface includes an upper portion that engages a forehead of the user and side portions that engage temple regions of the user. The facial interface converts forward force applied to the upper portion by the forehead into inward force applied by side portions to the temple regions.

Abstract: A video processing device includes a receiver that successively receives input images, each having a prescribed overlapping image superimposed in one or more areas thereof, a compositing image generation unit that successively generates compositing images based on the external information, a video compositing unit that successively generates composite images, a compositing abnormality detection unit that determines whether one or more areas of the composite image have abnormality or not, a comparison unit that compares the one or more areas of the input image with those of the composite image to determine whether or not the respective areas match, if it is determined that the composite image have no abnormalities, and an output control unit that outputs the input image if it is determined that the respective areas match, and outputs the composite image when it is determined that the respective areas do not match.

Abstract: Systems, devices, media, and methods are presented for using a handheld device such as a ring to manipulate a virtual object being displayed by a wearable device such as eyewear. The path of the virtual object in motion is substantially linked, in time and space, to the course traveled by a hand holding the handheld device. The methods in some implementations include presenting the virtual object on a display at a first location relative to a three-dimensional coordinate system, collecting motion data from an inertial measurement unit on the handheld device, displaying the virtual object at a second location along a path based on the motion data. In some implementations the eyewear includes a projector located and configured to project the display onto a lens assembly.

Abstract: Object detection may include transmitting, by a first device, a first pulse into an environment using a wide field configuration of an ultrasonic sensor array, detecting a presence of an object in the environment based on a detected echo based on the first pulse. In response to detecting the presence of the object, a targeted configuration of the ultrasonic sensor array is determined, and a second pulse is transmitted into the environment based on the second pulse, wherein a characteristic of the object is determined based on a detected echo from the second pulse.

Abstract: A head-mountable device can securely support sensors in a manner that maintains their positions and orientations over time and avoids applying excessive strain on the sensors, thereby protecting them from harm. The sensor can be mounted on a flex circuit or circuit board, which is rigidly secured within an inner case, including for example a base and an inner shield. The inner case can be suspended within an outer case, including for example a frame and an outer shield. Shock absorbers on opposing sides of the inner case can flexibly couple the inner case to the outer case. The shock absorbers can dampen the effects of vibrations or other forces applied from the outer case. The inner case can decouple the sensor from strain applied from the shock absorbers.

Abstract: An electronic device is provided that includes a frame, a transparent member, a leg member, a display module, a camera, and a light emitter configured to emit infrared light toward a user's eye. The electronic device also includes a lens member configured to switch between a reflective mode reflecting infrared light and a transmissive mode allowing visible light to pass. The lens member is disposed such that infrared light reflected from the user's eye to the lens member in the reflective mode is incident on the camera. The electronic device further includes a processor that controls the camera to receive visible light, which passes through the lens member in the transmissive mode, in order to generate first image information, and to receive infrared light, reflected by the lens member in the reflective mode of the lens member, in order to generate second image information.

Abstract: An interframe difference processor 206 generates a difference image between frames of a sensor image, and an image processor 208 generates distance information indicating a distance to a photographic subject on the basis of calculation of a difference image and a developing pattern 1101. Thus, since a video display apparatus 101 generates the difference image between the frames of the sensor image, it is possible to realize a distance measuring apparatus capable of reducing an influence of a background and generating distance information with high accuracy.

Abstract: According to one embodiment, a method executed by an electronic apparatus including storage configured to store device information including first position information indicating a position of a device installed in a particular range and risk information associated with use of the device is provided. The method includes receiving second position information indicating a position of a user wearing an eyeglasses-type wearable terminal and working within the particular range, from the eyeglasses-type wearable terminal and estimating a status of the user, based at least in part on the first position information and the risk information included in the device information, and the second position information.

Abstract: A head mounted display (HMD) includes a set of one or more lenses defining an optical axis, a display configured to project light through the set of the one or more lenses, a voice coil actuator coupled with the display and configured to move the display along the optical axis, and a first guide that is separate from the first voice coil actuator and coupled with the first display to guide the movement of the first display. The HMD additionally includes a set of one or more position sensors configured to determine a position of the display long the optical axis and an electronic controller configured to receive information identifying a reference position of the display along the optical axis and generate one or more electrical signals for initiating a movement of the first display toward the first reference point along the optical axis.

Abstract: Provided is a mixed reality-based experience simulator including an imaging part including first and second cameras installed on an experience object to capture images of different viewpoints from the experience object, a display part worn by a participant and configured to display a mixed reality image of the experience object to the participant, and an image processing unit configured to provide the mixed reality image to the display part and configured to generate the mixed reality image such that images captured by the first and second cameras are included in the mixed reality image. The mixed reality-based experience simulator according to the present invention generates a mixed reality image on the basis of images captured by a plurality of cameras installed on an experience object and provides the generated mixed reality image to a participant so that a more realistic experience is provided.

Abstract: A device for providing a reverse pass-through view of a user of a headset display to an onlooker includes an eyepiece comprising an optical surface configured to provide an image to a user on a first side of the optical surface. The device also includes a first camera configured to collect an image of a portion of a face of the user reflected from the optical surface in a first field of view, a display adjacent to the optical surface and configured to project forward an image of the face of the user, and a screen configured to receive light from the display and provide the image of the face of the user to an onlooker.

Abstract: An information processing apparatus 1 acquires motion information regarding a user 700 who is a user, determines the image quality (for example, the resolution) of a virtual object on the basis of the acquired motion information, and controls the display of the virtual object on the basis of the determined image quality. The virtual object is displayed with low resolution, for example, when the user 700 is turning his/her head. On the other hand, the virtual object is displayed with high resolution when the user 700 is put in a stationary state, that is, when a change becomes zero. The information processing apparatus 1 makes it possible to reduce a drawing load, while maintaining a real expression.

Abstract: An imaging apparatus for stereoscopic viewing has a frame that seats against the head of a viewer. A left-eye imaging apparatus and a right-eye imaging apparatus are supported by the frame. The frame is reshapeable in a manner that changes a relative alignment of the left-eye imaging apparatus and the right-eye imaging apparatus to accommodate different viewer head anatomies. An adjustment mechanism responsive to the reshaping of the frame restores relative alignment of the left-eye imaging apparatus and the right-eye imaging apparatus for conveying stereoscopic virtual images to the viewer.

Abstract: Systems, methods, and non-transitory computer readable media for augmenting scenes viewed thorough displays of an eyewear devices with audio-related image information. Scenes may be augmented by capturing, via a camera of the eyewear device, initial images of a scene, identifying features within the initial images; receiving audio-related image information (e.g., lyrics and/or images), registering the audio-related image information to the identified features, creating audio-based visual overlays including the audio-related image information registered to the identified features, and displaying the audio-based visual overlays over the scene.