Abstract: An augmented reality device includes an illuminator, a camera, a memory, and a processor, wherein the processor is configured to execute one or more instructions stored in the memory to turn on a light source of the illuminator to obtain a first image from the camera, turn off the light source to obtain a second image from the camera, estimate depth information, based on the first image, and estimate posture information, based on the second image.

Abstract: An electronic device such as a head-mounted device may have a user display for displaying an image to a user. The image may be displayed at an eye box after passing through a lens that is interposed between the display and the eye box. A forward-facing component such as a forward-facing camera and/or an externally viewable display may be supported in the housing. The forward-facing component may be overlapped by an optical system. The optical system may have a double-folded light path that virtually shifts the position of the forward-facing component. The optical system may have a reflective polarizer and a partially reflective mirror that are separated by a given distance. The optical system may virtually shift the forward-facing component toward the eye box by twice the given distance.

Abstract: Described are various embodiments of a binocular light field display, adjusted pixel rendering method therefor, and vision correction system and method using same. In one embodiment, a system is described to produce a perception adjustment of an input image comprising a pupil tracking device, a digital light field display operable to define spatially periodically recurring view zones within which to produce a perceptively adjusted version of the input image, and a digital data processor operable on pixel data to produce the perceptively adjusted version of the input image within the zones while actively translating a boundary of these view zones so to reduce overlap of the boundary with each of respective pupil locations.

Abstract: A method for determining a state of vigilance of a driver in a vehicle using a predetermined image-analyzing algorithm. The method especially includes a step of executing the predetermined algorithm on the generated sequence of images in order to detect a series comprising at least one movement of the head of the driver, a step of determining the speed and/or the amplitude of each identified movement and of the dynamic and static periods of the head of the driver, a step of detecting dynamic and static periods of the head of the driver and of measuring the frequency and duration of each period, and a step of determining a state of vigilance of the driver from the speed and/or the amplitude determined for each identified movement and from the frequency and duration of each detected period.

Abstract: A computer implemented method and a virtual and physical environment integration system (VPEIS) for dynamically integrating a virtual environment with a physical environment are provided. The VPEIS receives dimensions and an orientation of the physical environment, and a user device's reference position in the physical environment.

Abstract: Compact occlusion-capable optical see-through head mounted displays (OCOST-HMDs) are described having a double-wrapped path and capable of rendering per-pixel mutual occlusion, and correct see-through viewing perspective or a pupil-matched viewing between the virtual and real views. An example device includes a polarizer, a polarizing beam splitter, an objective lens, a spatial light modulator (SLM), an eyepiece lens, a quarter wave plate, and a reflective optical element configured to reflect the light that is incident thereupon in a first direction, and to transit the light received from a microdisplay that is incident thereupon from a second direction. The components form a first double-pass configurations that allow the light that passes through the objective to reflect from the SLM and propagate again through the objective, and a second double-pass configuration that allows the light that passes through the eyepiece to reflect from the reflective optical element and propagate again through the eyepiece.

Abstract: A method includes receiving an image of a real environment captured using a camera worn by a user, the image comprising a hand of the user and determining a pose of the hand based on the image. Based on a three-dimensional model of the hand having the determined pose, generating a two-dimensional surface representing the hand as viewed from a first viewpoint of the user and positioning the two-dimensional surface representing the hand and one or more virtual-object representations in a three-dimensional space. The method further includes determining that a portion of the two-dimensional surface representing the hand is visible from a second viewpoint in the three-dimensional space, and generating an output image, wherein a set of image pixels of the output image corresponding to the portion of the two-dimensional surface that is visible is configured to cause a display to tur off a set of corresponding display pixels.

Abstract: A simulation object identity recognition method includes displaying, by an electronic device, a simulation object, determining, by the electronic device, whether the simulation object is valid, and notifying by the electronic device, a user of a determining result to improve a user alertness and to avoid disclosing personal information by the user under inducement of an invalid simulation object.

Abstract: Aspects of the present invention relate to speaker assemblies for head worn computers, including speaker assemblies in a temple portion of a head-worn computer.

Abstract: In one embodiment, a method includes segmenting a layout of a physical space surrounding a user into physical segments; generating, based on the physical segments, virtual paths for a virtual environment through which the user can navigate by traveling the physical segments; identifying, based on a current location of the user with respect to the physical space, a portion of the physical segments for which to enable an intrusion detection feature; detecting a physical object in the portion of the physical segments that corresponds to a particular virtual path of the virtual paths; and in response to the detecting, displaying a representation of the physical object in the particular virtual path.

Abstract: Systems, methods, apparatuses, and computer-readable media for creating an observation video are described. The observation video may comprise a viewport that moves in coordination with motion of an HMD user's head and that shows portions of VR content being output to the HMD user at different times. For each of those times, motion data from the HMD may be used to determine a position, orientation, and/or shape of the viewport. The observation video may also include an element that represents the HMD user, which element may comprise a video element video isolated from video of the user captured by a camera, and/or which may comprise an animated avatar.

Abstract: A device includes a first-type liquid crystal (LC) lens configured to provide a first optical power that is variable in a first step resolution. The device also includes a second-type LC lens coupled with the first-type LC lens, and configured to provide a second optical power that is variable in a second step resolution. The first step resolution is smaller than the second step resolution. A total optical power of the device is a sum of the first optical power and the second optical power, and is variable in the first step resolution.

Abstract: An augmented reality providing device includes a lens including a reflective mirror, a display module on at least one side surface of the lens and configured to display an image, and an anti-reflective module between the display module and the lens.

Abstract: A head-mounted display may include a display system and an optical system in a housing. The display system may have displays that produce images. Positioners may be used to move the displays relative to the eye positions of a user's eyes. An adjustable optical system may include tunable lenses such as tunable cylindrical liquid crystal lenses. The displays may be viewed through the lenses when the user's eyes are at the eye positions. A sensor may be incorporated into the head-mounted display to measure refractive errors in the user's eyes. The sensor may include waveguides and volume holograms, and a camera for gathering light that has reflected from the retinas of the user's eyes. Viewing comfort may be enhanced by adjusting display positions relative to the eye positions and/or by adjusting lens settings based on the content being presented on the display and/or measured refractive errors.

Abstract: A head-mounted device having a plurality of electrodes configured to detect optical events such as the movement of one or more eyes or coarse eye gestures is disclosed. In some examples, the one or more electrodes can be coupled to dielectric elastomer materials whose shape can be changed to vary contact between a user of the head-mounted device and the one or more electrodes to ensure sufficient contact and electrode signal quality. In some examples, the one or more electrodes can be coupled to pressure sensors and control circuitry to monitor and adjust the applied pressure. In some examples, the optical events can be used as triggers for operating the device, including transitioning between operational power modes. In some examples, the triggers can invoke higher resolution sensing capabilities of the head-mounted device. In some examples, the electrodes can be used as an on-head detector to wake-up and/or unlock the device.

Abstract: Provided a display apparatus including an image forming apparatus configured to form an image, a projection optical system configured to project the image formed by the image forming apparatus, and a combining optical system configured to provide the image projected from the projection optical system combined with light emitted from an external landscape, wherein the combining optical system is configured to divide the image projected from the projection optical system into same images and focus the same images on different positions.

Abstract: A head-worn device system includes one or more cameras, one or more display devices and one or more processors. The system also includes a memory storing instructions that, when executed by the one or more processors, configure the system to perform operations to initiate or join a joint visual computing session. The method may comprise receiving user input to initiate a joint session of a visual computing experience, monitoring for short-range data transmissions including data indicating the existence of a current session of the visual computing experience, and based on determining that a current session is in process, providing a user input option to join the current session of the visual computing experience.

Abstract: Aspects of the disclosure relate to a system comprising a head mounted display, an adjusting mechanism, and a connecting mechanism, wherein the head mounted display is configured to be worn on a head of a user under a cover of a surgical helmet so that the display of the head mounted display is adjacent to a transparent portion of the cover, wherein the adjusting mechanism is configured to adjust at least a position of the head mounted display in relationship to the user's eyes, and wherein the connecting mechanism is configured to couple the head mounted display to the surgical helmet. Aspects of the disclosure relate to a system for tracking a head mounted display when used in connection with a surgical helmet and a cover for the surgical helmet.

Abstract: A display panel including a first edge extending in a first direction, a second edge extending in a second direction intersecting with the first direction, and a corner edge extending in a curved shape from the first edge to the second edge includes: a substrate including a front area overlapping a center of the display panel and a corner area extending from the front area to the corner edge; and a pixel arranged over the substrate, wherein the display panel is curved in the corner area in a direction in which the corner edge approaches the center of the display panel.

Abstract: The present invention relates to an optical glass having refractive index of 1.55 or more and having chromaticity b* that satisfies b*?4.8 under A light source in a CIELab representation. The present invention also relates to an optical glass having refractive index of 1.55 or more, having a ratio (b*/|a*|) of chromaticity b* to an absolute value of chromaticity a* that satisfies b*/|a*|?0.55 under A light source in a CIELab representation, and satisfying b*?0.1.

Abstract: A method for correcting a bending of a flexible device is described. In one aspect, the method includes accessing feature data of a first stereo frame that is generated by stereo optical sensors of the flexible device, the feature data generated based on a visual-inertial odometry (VIO) system of the flexible device, accessing depth map data of the first stereo frame, the depth map data generated based on a depth map system of the flexible device, estimating a pitch-roll bias and a yaw bias based on the features data and the depth map data of the first stereo frame, and generating a second stereo frame after the first stereo frame, the second stereo frame based on the pitch-roll bias and the yaw bias of the first stereo frame.

Abstract: A method of managing user experience with a virtual reality (VR) headset includes: with a server, receiving data from a number of sensors that are detecting parameters associated with a user during use of the VR headset; with the server, analyzing the data from the sensors to predict a negative effect on the user from the use of the VR headset; and with the server, taking action to minimize the negative effect on the user that is predicted.

Abstract: A head-mounted extended reality (XR) display device includes a rigid mounting element coupled to a frame. The XR display device further includes right-side and left-side visible light cameras coupled to the rigid mounting element, right-side and left-side near-infrared (NIR) cameras coupled to the rigid mounting element, and an NIR light-emitting diode (LED) configured to illuminate a region within a field of view of the NIR cameras. The visible light cameras are configured to capture stereoscopic visible light images within a field of view of the user when the user is wearing the frame, and the NIR cameras are configured to capture stereoscopic NIR images within the field of view of the user when the user is wearing the frame.

Abstract: A display device includes an optical assembly and a display that includes a front surface and a back surface. The display is configured to output image light from the front surface and transmit ambient light from the back surface to the front surface. The optical assembly includes a substrate that has a substantially uniform thickness, a beam splitter, and a reflector. The optical assembly is configured to receive the image light output from the front surface of the display and to transmit a portion of the image light at a first non-zero optical power via an optical path that includes reflections at the reflector and at the beam splitter. The optical assembly is also configured to transmit a portion of the ambient light through the optical assembly at a second optical power without reflection at the reflector. The second optical power is less than the first optical power.

Abstract: A method includes placing a physical target on a windshield of a vehicle, mounting a fixture inside the vehicle to position a camera array on the fixture within a line of sight of a passenger, capturing images of the physical target using the camera array, and determining a difference between actual and target locations of the physical target in each image. In addition, the method includes controlling the HUD to display a virtual target on the windshield, capturing images of the virtual target using the camera array, and determining a target location of the virtual target in each image based on the difference. Further, the method includes determining an offset between an actual location of the virtual target in each image and the target location of the virtual target in each image, and adjusting the location of an image projected onto the windshield by the HUD based on the offset.

Abstract: An information processing apparatus according to an embodiment of the present technology includes a physical information acquisition unit, a gesture information acquisition unit, a determination condition setting unit, and a control unit. The physical information acquisition unit acquires physical information of a user wearing a head-mounted casing. The gesture information acquisition unit acquires gesture information regarding a gesture of the user. The determination condition setting unit sets, on the basis of the physical information, a determination condition for determining a trigger gesture that is a trigger for an operation input by the gesture of the user. The control unit determines, on the basis of the gesture information and the determination condition, whether or not the trigger gesture is performed and controls, on the basis of a result of the determination, an output corresponding to the trigger gesture.

Abstract: An augmented reality display system is configured to direct a plurality of parallactically-disparate intra-pupil images into a viewer's eye. The parallactically-disparate intra-pupil images provide different parallax views of a virtual object, and impinge on the pupil from different angles. In the aggregate, the wavefronts of light forming the images approximate a continuous divergent wavefront and provide selectable accommodation cues for the user, depending on the amount of parallax disparity between the intra-pupil images. The amount of parallax disparity is selected using a light source that outputs light for different images from different locations, with spatial differences in the locations of the light output providing differences in the paths that the light takes to the eye, which in turn provide different amounts of parallax disparity.

Abstract: An eye tracking system includes a pair of glasses including two frames; a light scanning projector coupled to the pair of glasses and operable to scan a beam of light to project an image frame including a plurality of pixels; an eyepiece mounted in one of the two frames and optically coupled to the light scanning projector; one or more photodetectors coupled to one of the two frames and operable to detect time-varying reflected signals; and a processor coupled to the light scanning projector and the photodetectors. The eyepiece includes an exit pupil expander operable to direct a portion of the beam of light towards an eye of a user. Each of the time-varying reflected signals is associated with the plurality of pixels. The processor is operable to correlate the time-varying reflected signals with the plurality of pixels and determine a first eye orientation.

Abstract: The disclosed technology relates to operating two wireless communication protocols during operation of a hearing device.

Abstract: An example wearable electronic device includes a frame, a first arm and a second arm extending from the frame, respectively, a screen display disposed in the frame, and including a display, at least one camera disposed in the frame, a first processor located in the first arm, and operatively connected to the display, and a second processor located in the second arm, and operatively connected to the at least one camera, the first processor may be configured to display contents on the screen display part using the display, and the second processor may be configured to perform an operation associated with the at least one camera.

Abstract: An optical module for a head-mounted device is configured to present content to a user. The optical module includes an optical module housing assembly, a display assembly, and an eye camera. The optical module housing assembly has a first end and a second end. The lens is connected to the optical module housing assembly and positioned at the first end of the optical module housing assembly. The display assembly is connected to the optical module housing assembly and is positioned at the second end of the optical module housing assembly. The display assembly is configured to cause the content to be displayed to the user through the lens. The eye camera is connected to the optical module housing assembly and is positioned at the second end of the optical module housing assembly. The eye camera is configured to obtain images through the lens.

Abstract: System and methods are provided for augmented reality displays for medical and physiological monitoring. Augmented reality user interfaces are virtually pinned to a physical device, a location, or to a patient. An augmented reality position determination process determines the presentation of user interfaces relative to reference positions and reference objects. Detection of gestures causes the augmented reality users interfaces to be updated, such as pinning a user interface to a device, location, or patient. Looking away from an augmented reality user interface causes the user interface to minimize or disappear in an augmented reality display. An augmented reality gesture detection process determines gestures based on captured image data and computer vision techniques performed on the image data.

Abstract: Head mounted displays (HMD) and corresponding display methods are provided, which obtain, repeatedly, from a monitoring system of a vehicle and, a reference vector relating to the vehicle; display on the HMD a reference symbol that indicates the reference vector; and determine movements of a HMD symbology according to a spatial relation between a received user's line of sight (LOS) and the reference vector. For example, the vehicle may be an aircraft and the reference vector a flight path vector (FPV) received from the aircraft's avionics. The proposed HMD enhances the displayed information content while avoiding excessive movements of the symbology. The HMD's functional parameters may be pre-set or adapted according to user preference and flight stage characteristics. The reference symbol anchors most of the symbology, while minimal critical information may be moved along with the user's LOS, providing a clearer and more stable view through the HMD.

Abstract: A control system controls a gesture recognition system of a vehicle. The control system identifies a position of a body part with respect to a gesture recognition area in accordance with a detection signal of a sensor system. The control system specifies a haptic feedback signal based on the position of the body part with respect to the gesture recognition area. The control system outputs the haptic feedback signal to a haptic feedback system. The haptic feedback signal is configured to cause the haptic feedback system to output non-contact haptic feedback indicating the position of the body part with respect to the gesture recognition area toward a vehicle occupant.

Abstract: A switch module for an electronic device detects translational inputs and defines at least portion of a conductive path from an input surface of the electronic device to a processing unit of the electronic device. The switch module may be a component of a crown assembly for detecting rotational inputs, translational inputs, touch inputs and/or biological signals such as electrocardiogram (ECG) signals. The switch module may include a conductive dome and a friction guard that is positioned between the conductive dome and the actuation member of the crown assembly. The conductive dome and/or the friction guard may define at least a portion of the conductive path from the input surface to the processing unit.

Abstract: In certain embodiments, pupil-related characteristic detection or spectacles correction/adjustment based thereon may be facilitated. In some embodiments, a stimulus may be presented at a location on a first display of the user device at a first time to cause a first eye of a user to fixate on the location. A stimulus may be presented at the location on a second display of the user device to cause a second eye of the user to fixate on the location at a time subsequent to the first time. Movement of the first or second eye to fixate on the location on the respective first or second display in connection with the stimulus presentation at the second time may be determined. In response to determining that the movement of the first or second eye exceeded a threshold movement amount, a user profile may be generated that includes the user's pupil distance.

Abstract: The present invention relates to a method and a device for enabling to analyze a property of a vital sign detector (20). The proposed method comprises the steps of providing a virtual phantom (14) of a living being, rendering an artificial vital sign on the displayed virtual phantom (14), and outputting the virtual phantom (14) with the rendered artificial vital sign to the vital sign detector (20).

Abstract: A mobile wireless device (100) in the configuration of user wearable glasses includes at least one lens including at least one transparent display (110). The at least one display is operable to provide visual outputs that are visually perceivable to the user of the device. The user is enabled to see through the at least one lens, physical surroundings in a direct field of view. The device includes at least one input device (116, 122, 114) which receives user inputs. At least one circuit is in operative connection with the at least one display, the at least one input device, a data store (106) and a wireless transceiver (120). At least one user input is operative to cause the device to communicate at least one wireless message which includes data usable to identify a financial account associated with the user. At least one remote circuit is operative responsive to the at least one wireless message to cause a financial transfer to or from the financial account.

Abstract: A head-mounted display and accessory system in which the accessory emits bleaching light through the head-mounted display to bleach photoreceptors for dark adaptation testing includes a casing, where a lens of a head-mounted display is positioned inside the cavity, and where an aperture of the casing is aligned with an exterior-facing camera of the head-mounted display. The system also includes an attachment body, where a posterior end of the attachment body is fixed to an anterior end of the casing, and where the attachment body includes a set of light-emitting diodes (LEDs), where the set of LEDs is attached to the posterior end of the attachment body and is directed towards the lens. The system also includes a circuitry that is configured to control light emission of the set of LEDs.

Abstract: Disclosed are a method and an input device for inputting information such as user commands to a computer a person wearing a virtual retinal display device that allows the person to concurrently see the real world.

Abstract: An image projection system includes: eyeglasses including a frame, a first eyeglass lens, and a second eyeglass lens; and a binocular light engine coupled to the frame. The binocular light engine includes a first light transmitter configured to transmit a first plurality of light beams corresponding to a first stereoscopic image on a first transmission path; a second light transmitter configured to transmit a second plurality of light beams corresponding to a second stereoscopic image on a second transmission path; and a single scanning structure shared by the first transmission path and the second transmission path. The single scanning structure is configured to: rotate about two scanning axes, direct the first plurality of light beams at the first eyeglass lens according to a scanning pattern, and direct the second plurality of light beams at the second eyeglass lens according to the scanning pattern.

Abstract: An apparatus and method for implementing a technique for performing calibration of an electromagnetic tracking apparatus on-the-fly while operating the apparatus. The apparatus and method uses a non-magnetic tracking device to determine position and orientation of a tracked object that is not subject to magnetic distortion or interference, and store calibration data for future measurements by the electromagnetic tracking apparatus based on the measurements made by the non-magnetic tracking device.

Abstract: There is provided a system configured to perform location-aware augmented reality tasks utilizing software and/or hardware components. For example, and not by limitation, a general embodiment may include an AR system. The system may include an ultra-wide band (UWB) communication system configured to estimate location information. The UWB system can include a memory and a processor which when executing instructions from the memory is configured to perform operations consistent with location-aware AR applications. For instance, the operations may include receiving a first UWB signal, the first UWB signal including information comprising fiducial data associated with a device transmitting the first UWB signal.

Abstract: A method of decrypting an encrypted message. The method comprises storing a wearer decryption code in a memory of a wearable mobile device having a head-worn augmented display which generates an augmented reality view for a wearer of the wearable mobile device, capturing using the wearable mobile device a video sequence including at least one frame imaging a visible code using an image sensor of the wearable mobile device, processing the video sequence to identify the visible code, decrypting the visible code using the wearer decryption code to create an decrypted content, and presenting the decrypted content on top of at least some of the visible code in the augmented reality view.

Abstract: A high frame rate image system in a theme park attraction simultaneously displays images that are unique to each individual viewer. Although all viewers in a room or theater may be watching the same screen or area, they may see entirely different images. This allows the attraction to present more complex story narratives, and also allows the projected images to be matched to specific guests.

Abstract: A transceiver based on at least one optical source is provided to facilitate wireless communication in a wearable display device, where the wearable display device is embedded with one or more planar antennas. The transceiver operates in terahertz and may be coupled to two different antennas, one for transmission and the other for reception.

Abstract: A method for managing a user interface in a smart glass is provided. The method includes identifying an eye gesture of the user of the smart glass, based on an eye-tracking signal indicative of a pupil location of the user, assessing a user intention for an application displayed in a user interface in the headset based on the eye gesture, and activating the application based on the user intention. A smart glass for use with the above method is also provided.

Abstract: A Head Mounted Display (HMD) includes a pixel array having multiple pixels configured in a two-dimensional surface, each pixel providing multiple light beams forming an image provided to a user. The HMD also includes a first optical element configured to provide a central portion of a field of view for the image through an eyebox that limits a volume including a pupil of the user, and a second optical element configured to provide a peripheral portion of the field of view for the image through the eyebox, wherein the peripheral portion of the field of view comprises at least one steradian of a user's field of view at a resolution of at least fifteen arcminutes.

Abstract: Provided is a glass type electronic device including a binocular lens, a lens frame fixed to the binocular lens and seated on a head of the wearer, an electronic component case fixed to the lens frame, and an optical driving assembly mounted in the electronic component case and emitting light to the binocular lens. The optical driving lens can include an image source panel for generating light corresponding to a content image, an emitting lens group provided to expose an exit surface to an outside of the electronic component case and for adjusting an exit angle and a focal length of the light, and a reflective mirror provided to expose a reflection surface to an outside of the electronic component case and for reflecting the light, emitted from the emitting lens group, to the binocular lens.

Abstract: The present disclosure relates to a virtual reality interaction method, a device and a system. The method includes: acquiring relative pose data of a target individual relative to a head-mounted device at a first time point, wherein the target individual is an individual in a reality space where the head-mounted device is located, the target individual and an individual wearing the head-mounted device are different individuals, and the pose data includes position data and posture data; obtaining virtual pose data of the target individual in a virtual scene of the head-mounted device at the first time point according to the relative pose data; and rendering and displaying a virtual individual corresponding to the target individual in the virtual scene according to the virtual pose data.