Abstract: A computer implemented method of facilitating communication between first and second users includes displaying, by a first head-worn device, a first virtual object to the first user first user wearing the first head-worn device. The method also includes displaying, by a second head-worn device, a second virtual object to the second user wearing the second head-worn device. The method further includes facilitating, by the first and second head-worn devices, communications between the first and second users using the first and second virtual objects to simulate the first and second users being present in a common environment.

Abstract: The present application discloses a system and device for displaying content. The system includes two optical units. The two optical units are part of the system that is wearable. Each of the two optical units comprises a front lit display. The system includes an adjustable mounting. The adjustable mounting enables a user to adjust a mounting position of the two optical units.

Abstract: A head-mounted device may have a head-mounted housing. The head-mounted housing may have rear-facing display that displays a three-dimensional image to rear eye boxes. The head-mounted device may also have a front-facing display that faces away from the rear eye boxes. The front-facing display may cover a front face of the head-mounted housing. To share content such as content being displayed by the rear-facing displays with external viewers, the head-mounted device may use the front-facing display or a separate display to display images. An accessory that is coupled to the front face of the housing may reflect an image on the front-facing display towards a viewer for viewing. Sensors in the device may detect presence of the accessory. Display projectors and waveguides or optical layers on the front face that overlap the front-facing display may be used to display three-dimensional images to front eye boxes.

Abstract: A virtual image display device includes: an image light generating device; a projection optical system configured to project image light emitted from the image light generating device; a folding mirror configured to reflect, in an intersecting direction, the image light from the projection optical system; a semi-transmissive mirror configured to reflect a portion of the image light from the folding mirror; and a concave surface mirror configured to reflect, toward the semi-transmissive mirror, the image light reflected at the semi-transmissive mirror to form an exit pupil, in which an optical axis of the image light extending from the image light generating device to the folding mirror is disposed between a first virtual extension plane obtained by imaginarily extending the semi-transmissive mirror and a second virtual extension plane obtained by imaginarily extending the concave surface mirror.

Abstract: A system and method for displaying a 3D image with depths, which utilize at least one light signal generator to sequentially generate multiple light signals(S100) and at least one optical assembly to receive the multiple light signals from the at least one light signal generator, and project and scan the multiple light signals within a predetermined time period to display the 3D image in space(S200). Each pixel of the 3D image is displayed at a position by at least two of the multiple light signals to a viewer's eye, paths or extensions of the paths of the at least two light signals intersects at the position and at an angle associated with a depth of the pixel, and the predetermined time period is one eighteenth of a second. Accordingly, the advantages of simplified structure, a miniatured size, and a less costly building cost can be ensured.

Abstract: Systems and methods related to intelligent typing and responses using eye-gaze technology are disclosed herein. In some example aspects, a dwell-free typing system is provided to a user typing with eye-gaze. A prediction processor may intelligently determine the desired word or action of the user. In some aspects, the prediction processor may contain elements of a natural language processor. In other aspects, the systems and methods may allow quicker response times from applications due to application of intelligent response algorithms. For example, a user may fixate on a certain button within a web-browser, and the prediction processor may present a response to the user by selecting the button in the web-browser, thereby initiating an action. In other example aspects, each gaze location may be associated with a UI element. The gaze data and associated UI elements may be processed for intelligent predictions and suggestions.

Abstract: A display device includes a light source array including a plurality of light sources where at least one of the plurality of light sources is selectively driven, a spatial light modulator for modulating light from the light source array to form image light, a focusing optical system for focusing the image light formed by the spatial light modulator at a position in a predetermined eye box, a micro mirror array arranged in an optical path formed in the focusing optical system and including a plurality of mirror cells. The plurality of mirror cells are controlled to be in an ON state in that light is reflected in a direction toward an inside of the eye box or to be in an OFF state in that light is reflected in a direction toward an outside of the eye box.

Abstract: Systems and methods for overlaying virtual objects in a virtual environment based on user interest and user interactions are disclosed. The methods analyze a live view of a surface viewed through camera or a transparent lens and determine if the policies of the surface allow overlaying of virtual objects. The method fetches a virtual object and calculates a score based on user interest, user gaze, and user engagement. Virtual objects that meet the policies of the surface and a scoring criterion are overlayed on the surface in the virtual environment and enhanced based on a plurality of enhancement factors. Virtual objects are also overlayed in frames of a live broadcast based on their scores. Virtual objects displayed on a conference call interface, which may be meeting tools or icons associated with other conferencing functionality, are enhanced, or removed from the user interface based on their utilization.

Abstract: Systems, methods and non-transitory computer readable media for optimizing visual contents are provided. A particular mathematical object corresponding to a particular visual content in a mathematical space including a plurality of mathematical objects corresponding to visual contents may be determined. The mathematical space and the particular mathematical object may be used to obtain first and second mathematical objects of the plurality of mathematical objects. The visual content corresponding to the first mathematical object may be used in a communication with a first user and the visual content corresponding to the second mathematical object may be used in a communication with a second user. Indications of the reactions of the first and second users to the communications may be received. A third visual content may be obtained based on the reactions. The third visual content may be used in a communication with a third user.

Abstract: A light-transmitting substrate has parallel surfaces deployed with a first of the parallel surfaces in facing relation to an eye. An optical element is associated with the first surface and applies optical power to incident light of a first type so as to collimate the incident light, and applies substantially no optical power to incident light of a second type. An optical coupling configuration is associated with the substrate and is configured for coupling-in a proportion of collimated light of the first type incident on the first surface so as to propagate within the substrate, and for coupling-out a proportion of light of the second type propagating within the substrate. Optics associated with the substrate convert collimated light of the first type into converging beams of light, which are sensed by an optical sensor. A processor derives current gaze direction of the eye by processing signals from the optical sensor.

Abstract: A system for generating a virtual image for a wearer includes: a lens providing vision of a real scene and having refractive power related to the prescription of the wearer, a directive light source that emits directive light beams to create the virtual image, a reflecting element positioned on or in the lens that receives and redirects the directive light beams emitted by the directive light source toward a convergence area of an eye of the wearer, a dynamical optical element for modifying the received light beams, and a memory storing prescription data relative to the prescription of the wearer, the dynamical optical element modifying the light beams at the convergence area so as to compensate at least partly the prescription of the wearer.

Abstract: There is provided a display system used for a head mounted display including a head mounted device having a lens for guiding image light to an eye of a user and configured to be mounted on a head of the user and a portable terminal having an imaging unit for photographing a front of a display surface and capable of being housed in the head mounted device. The display system includes a display control section configured to display a moving image on the display surface, an image information obtaining section configured to obtain image information photographed by the imaging unit, and a position information obtaining section configured to obtain position information of an optical axis of the lens on the display surface on the basis of position information of at least two reference positions whose relative positions with respect to the optical axis are determined in advance, the at least two reference positions being included in the image information.

Abstract: A multicolor static multiview display and method of multicolor static multiview display operation provide a color static multiview image using diffractive gratings to diffractively scatter light from guided light beams having a selectable color and different radial directions. The multicolor static multiview display includes a light guide configured to guide plurality of guided light beams and a multicolor light source configured to provide the guided light beam plurality having the selectable color and the different radial directions. The multicolor static multiview display further includes a plurality of diffraction gratings configured to provide from a portion of the guided light beams directional light beams having a color, intensities, and principal angular directions corresponding to color view pixels of the color static multiview image.

Abstract: An augmented reality device includes an illuminator, a camera, a memory, and a processor, wherein the processor is configured to execute one or more instructions stored in the memory to turn on a light source of the illuminator to obtain a first image from the camera, turn off the light source to obtain a second image from the camera, estimate depth information, based on the first image, and estimate posture information, based on the second image.

Abstract: An electronic device such as a head-mounted device may have a user display for displaying an image to a user. The image may be displayed at an eye box after passing through a lens that is interposed between the display and the eye box. A forward-facing component such as a forward-facing camera and/or an externally viewable display may be supported in the housing. The forward-facing component may be overlapped by an optical system. The optical system may have a double-folded light path that virtually shifts the position of the forward-facing component. The optical system may have a reflective polarizer and a partially reflective mirror that are separated by a given distance. The optical system may virtually shift the forward-facing component toward the eye box by twice the given distance.

Abstract: Described are various embodiments of a binocular light field display, adjusted pixel rendering method therefor, and vision correction system and method using same. In one embodiment, a system is described to produce a perception adjustment of an input image comprising a pupil tracking device, a digital light field display operable to define spatially periodically recurring view zones within which to produce a perceptively adjusted version of the input image, and a digital data processor operable on pixel data to produce the perceptively adjusted version of the input image within the zones while actively translating a boundary of these view zones so to reduce overlap of the boundary with each of respective pupil locations.

Abstract: A method for determining a state of vigilance of a driver in a vehicle using a predetermined image-analyzing algorithm. The method especially includes a step of executing the predetermined algorithm on the generated sequence of images in order to detect a series comprising at least one movement of the head of the driver, a step of determining the speed and/or the amplitude of each identified movement and of the dynamic and static periods of the head of the driver, a step of detecting dynamic and static periods of the head of the driver and of measuring the frequency and duration of each period, and a step of determining a state of vigilance of the driver from the speed and/or the amplitude determined for each identified movement and from the frequency and duration of each detected period.

Abstract: A computer implemented method and a virtual and physical environment integration system (VPEIS) for dynamically integrating a virtual environment with a physical environment are provided. The VPEIS receives dimensions and an orientation of the physical environment, and a user device's reference position in the physical environment.

Abstract: A method includes receiving an image of a real environment captured using a camera worn by a user, the image comprising a hand of the user and determining a pose of the hand based on the image. Based on a three-dimensional model of the hand having the determined pose, generating a two-dimensional surface representing the hand as viewed from a first viewpoint of the user and positioning the two-dimensional surface representing the hand and one or more virtual-object representations in a three-dimensional space. The method further includes determining that a portion of the two-dimensional surface representing the hand is visible from a second viewpoint in the three-dimensional space, and generating an output image, wherein a set of image pixels of the output image corresponding to the portion of the two-dimensional surface that is visible is configured to cause a display to tur off a set of corresponding display pixels.

Abstract: Compact occlusion-capable optical see-through head mounted displays (OCOST-HMDs) are described having a double-wrapped path and capable of rendering per-pixel mutual occlusion, and correct see-through viewing perspective or a pupil-matched viewing between the virtual and real views. An example device includes a polarizer, a polarizing beam splitter, an objective lens, a spatial light modulator (SLM), an eyepiece lens, a quarter wave plate, and a reflective optical element configured to reflect the light that is incident thereupon in a first direction, and to transit the light received from a microdisplay that is incident thereupon from a second direction. The components form a first double-pass configurations that allow the light that passes through the objective to reflect from the SLM and propagate again through the objective, and a second double-pass configuration that allows the light that passes through the eyepiece to reflect from the reflective optical element and propagate again through the eyepiece.

Abstract: A simulation object identity recognition method includes displaying, by an electronic device, a simulation object, determining, by the electronic device, whether the simulation object is valid, and notifying by the electronic device, a user of a determining result to improve a user alertness and to avoid disclosing personal information by the user under inducement of an invalid simulation object.

Abstract: Aspects of the present invention relate to speaker assemblies for head worn computers, including speaker assemblies in a temple portion of a head-worn computer.

Abstract: In one embodiment, a method includes segmenting a layout of a physical space surrounding a user into physical segments; generating, based on the physical segments, virtual paths for a virtual environment through which the user can navigate by traveling the physical segments; identifying, based on a current location of the user with respect to the physical space, a portion of the physical segments for which to enable an intrusion detection feature; detecting a physical object in the portion of the physical segments that corresponds to a particular virtual path of the virtual paths; and in response to the detecting, displaying a representation of the physical object in the particular virtual path.

Abstract: Systems, methods, apparatuses, and computer-readable media for creating an observation video are described. The observation video may comprise a viewport that moves in coordination with motion of an HMD user's head and that shows portions of VR content being output to the HMD user at different times. For each of those times, motion data from the HMD may be used to determine a position, orientation, and/or shape of the viewport. The observation video may also include an element that represents the HMD user, which element may comprise a video element video isolated from video of the user captured by a camera, and/or which may comprise an animated avatar.

Abstract: A device includes a first-type liquid crystal (LC) lens configured to provide a first optical power that is variable in a first step resolution. The device also includes a second-type LC lens coupled with the first-type LC lens, and configured to provide a second optical power that is variable in a second step resolution. The first step resolution is smaller than the second step resolution. A total optical power of the device is a sum of the first optical power and the second optical power, and is variable in the first step resolution.

Abstract: An augmented reality providing device includes a lens including a reflective mirror, a display module on at least one side surface of the lens and configured to display an image, and an anti-reflective module between the display module and the lens.

Abstract: Provided a display apparatus including an image forming apparatus configured to form an image, a projection optical system configured to project the image formed by the image forming apparatus, and a combining optical system configured to provide the image projected from the projection optical system combined with light emitted from an external landscape, wherein the combining optical system is configured to divide the image projected from the projection optical system into same images and focus the same images on different positions.

Abstract: A head-mounted display may include a display system and an optical system in a housing. The display system may have displays that produce images. Positioners may be used to move the displays relative to the eye positions of a user's eyes. An adjustable optical system may include tunable lenses such as tunable cylindrical liquid crystal lenses. The displays may be viewed through the lenses when the user's eyes are at the eye positions. A sensor may be incorporated into the head-mounted display to measure refractive errors in the user's eyes. The sensor may include waveguides and volume holograms, and a camera for gathering light that has reflected from the retinas of the user's eyes. Viewing comfort may be enhanced by adjusting display positions relative to the eye positions and/or by adjusting lens settings based on the content being presented on the display and/or measured refractive errors.

Abstract: A head-mounted device having a plurality of electrodes configured to detect optical events such as the movement of one or more eyes or coarse eye gestures is disclosed. In some examples, the one or more electrodes can be coupled to dielectric elastomer materials whose shape can be changed to vary contact between a user of the head-mounted device and the one or more electrodes to ensure sufficient contact and electrode signal quality. In some examples, the one or more electrodes can be coupled to pressure sensors and control circuitry to monitor and adjust the applied pressure. In some examples, the optical events can be used as triggers for operating the device, including transitioning between operational power modes. In some examples, the triggers can invoke higher resolution sensing capabilities of the head-mounted device. In some examples, the electrodes can be used as an on-head detector to wake-up and/or unlock the device.

Abstract: A head-worn device system includes one or more cameras, one or more display devices and one or more processors. The system also includes a memory storing instructions that, when executed by the one or more processors, configure the system to perform operations to initiate or join a joint visual computing session. The method may comprise receiving user input to initiate a joint session of a visual computing experience, monitoring for short-range data transmissions including data indicating the existence of a current session of the visual computing experience, and based on determining that a current session is in process, providing a user input option to join the current session of the visual computing experience.

Abstract: Aspects of the disclosure relate to a system comprising a head mounted display, an adjusting mechanism, and a connecting mechanism, wherein the head mounted display is configured to be worn on a head of a user under a cover of a surgical helmet so that the display of the head mounted display is adjacent to a transparent portion of the cover, wherein the adjusting mechanism is configured to adjust at least a position of the head mounted display in relationship to the user's eyes, and wherein the connecting mechanism is configured to couple the head mounted display to the surgical helmet. Aspects of the disclosure relate to a system for tracking a head mounted display when used in connection with a surgical helmet and a cover for the surgical helmet.

Abstract: A display panel including a first edge extending in a first direction, a second edge extending in a second direction intersecting with the first direction, and a corner edge extending in a curved shape from the first edge to the second edge includes: a substrate including a front area overlapping a center of the display panel and a corner area extending from the front area to the corner edge; and a pixel arranged over the substrate, wherein the display panel is curved in the corner area in a direction in which the corner edge approaches the center of the display panel.

Abstract: The present invention relates to an optical glass having refractive index of 1.55 or more and having chromaticity b* that satisfies b*?4.8 under A light source in a CIELab representation. The present invention also relates to an optical glass having refractive index of 1.55 or more, having a ratio (b*/|a*|) of chromaticity b* to an absolute value of chromaticity a* that satisfies b*/|a*|?0.55 under A light source in a CIELab representation, and satisfying b*?0.1.

Abstract: A method for correcting a bending of a flexible device is described. In one aspect, the method includes accessing feature data of a first stereo frame that is generated by stereo optical sensors of the flexible device, the feature data generated based on a visual-inertial odometry (VIO) system of the flexible device, accessing depth map data of the first stereo frame, the depth map data generated based on a depth map system of the flexible device, estimating a pitch-roll bias and a yaw bias based on the features data and the depth map data of the first stereo frame, and generating a second stereo frame after the first stereo frame, the second stereo frame based on the pitch-roll bias and the yaw bias of the first stereo frame.

Abstract: A method of managing user experience with a virtual reality (VR) headset includes: with a server, receiving data from a number of sensors that are detecting parameters associated with a user during use of the VR headset; with the server, analyzing the data from the sensors to predict a negative effect on the user from the use of the VR headset; and with the server, taking action to minimize the negative effect on the user that is predicted.

Abstract: A head-mounted extended reality (XR) display device includes a rigid mounting element coupled to a frame. The XR display device further includes right-side and left-side visible light cameras coupled to the rigid mounting element, right-side and left-side near-infrared (NIR) cameras coupled to the rigid mounting element, and an NIR light-emitting diode (LED) configured to illuminate a region within a field of view of the NIR cameras. The visible light cameras are configured to capture stereoscopic visible light images within a field of view of the user when the user is wearing the frame, and the NIR cameras are configured to capture stereoscopic NIR images within the field of view of the user when the user is wearing the frame.

Abstract: A display device includes an optical assembly and a display that includes a front surface and a back surface. The display is configured to output image light from the front surface and transmit ambient light from the back surface to the front surface. The optical assembly includes a substrate that has a substantially uniform thickness, a beam splitter, and a reflector. The optical assembly is configured to receive the image light output from the front surface of the display and to transmit a portion of the image light at a first non-zero optical power via an optical path that includes reflections at the reflector and at the beam splitter. The optical assembly is also configured to transmit a portion of the ambient light through the optical assembly at a second optical power without reflection at the reflector. The second optical power is less than the first optical power.

Abstract: A method includes placing a physical target on a windshield of a vehicle, mounting a fixture inside the vehicle to position a camera array on the fixture within a line of sight of a passenger, capturing images of the physical target using the camera array, and determining a difference between actual and target locations of the physical target in each image. In addition, the method includes controlling the HUD to display a virtual target on the windshield, capturing images of the virtual target using the camera array, and determining a target location of the virtual target in each image based on the difference. Further, the method includes determining an offset between an actual location of the virtual target in each image and the target location of the virtual target in each image, and adjusting the location of an image projected onto the windshield by the HUD based on the offset.

Abstract: An eye tracking system includes a pair of glasses including two frames; a light scanning projector coupled to the pair of glasses and operable to scan a beam of light to project an image frame including a plurality of pixels; an eyepiece mounted in one of the two frames and optically coupled to the light scanning projector; one or more photodetectors coupled to one of the two frames and operable to detect time-varying reflected signals; and a processor coupled to the light scanning projector and the photodetectors. The eyepiece includes an exit pupil expander operable to direct a portion of the beam of light towards an eye of a user. Each of the time-varying reflected signals is associated with the plurality of pixels. The processor is operable to correlate the time-varying reflected signals with the plurality of pixels and determine a first eye orientation.

Abstract: An information processing apparatus according to an embodiment of the present technology includes a physical information acquisition unit, a gesture information acquisition unit, a determination condition setting unit, and a control unit. The physical information acquisition unit acquires physical information of a user wearing a head-mounted casing. The gesture information acquisition unit acquires gesture information regarding a gesture of the user. The determination condition setting unit sets, on the basis of the physical information, a determination condition for determining a trigger gesture that is a trigger for an operation input by the gesture of the user. The control unit determines, on the basis of the gesture information and the determination condition, whether or not the trigger gesture is performed and controls, on the basis of a result of the determination, an output corresponding to the trigger gesture.

Abstract: An augmented reality display system is configured to direct a plurality of parallactically-disparate intra-pupil images into a viewer's eye. The parallactically-disparate intra-pupil images provide different parallax views of a virtual object, and impinge on the pupil from different angles. In the aggregate, the wavefronts of light forming the images approximate a continuous divergent wavefront and provide selectable accommodation cues for the user, depending on the amount of parallax disparity between the intra-pupil images. The amount of parallax disparity is selected using a light source that outputs light for different images from different locations, with spatial differences in the locations of the light output providing differences in the paths that the light takes to the eye, which in turn provide different amounts of parallax disparity.

Abstract: The disclosed technology relates to operating two wireless communication protocols during operation of a hearing device.

Abstract: An example wearable electronic device includes a frame, a first arm and a second arm extending from the frame, respectively, a screen display disposed in the frame, and including a display, at least one camera disposed in the frame, a first processor located in the first arm, and operatively connected to the display, and a second processor located in the second arm, and operatively connected to the at least one camera, the first processor may be configured to display contents on the screen display part using the display, and the second processor may be configured to perform an operation associated with the at least one camera.

Abstract: An optical module for a head-mounted device is configured to present content to a user. The optical module includes an optical module housing assembly, a display assembly, and an eye camera. The optical module housing assembly has a first end and a second end. The lens is connected to the optical module housing assembly and positioned at the first end of the optical module housing assembly. The display assembly is connected to the optical module housing assembly and is positioned at the second end of the optical module housing assembly. The display assembly is configured to cause the content to be displayed to the user through the lens. The eye camera is connected to the optical module housing assembly and is positioned at the second end of the optical module housing assembly. The eye camera is configured to obtain images through the lens.

Abstract: A control system controls a gesture recognition system of a vehicle. The control system identifies a position of a body part with respect to a gesture recognition area in accordance with a detection signal of a sensor system. The control system specifies a haptic feedback signal based on the position of the body part with respect to the gesture recognition area. The control system outputs the haptic feedback signal to a haptic feedback system. The haptic feedback signal is configured to cause the haptic feedback system to output non-contact haptic feedback indicating the position of the body part with respect to the gesture recognition area toward a vehicle occupant.

Abstract: System and methods are provided for augmented reality displays for medical and physiological monitoring. Augmented reality user interfaces are virtually pinned to a physical device, a location, or to a patient. An augmented reality position determination process determines the presentation of user interfaces relative to reference positions and reference objects. Detection of gestures causes the augmented reality users interfaces to be updated, such as pinning a user interface to a device, location, or patient. Looking away from an augmented reality user interface causes the user interface to minimize or disappear in an augmented reality display. An augmented reality gesture detection process determines gestures based on captured image data and computer vision techniques performed on the image data.

Abstract: A switch module for an electronic device detects translational inputs and defines at least portion of a conductive path from an input surface of the electronic device to a processing unit of the electronic device. The switch module may be a component of a crown assembly for detecting rotational inputs, translational inputs, touch inputs and/or biological signals such as electrocardiogram (ECG) signals. The switch module may include a conductive dome and a friction guard that is positioned between the conductive dome and the actuation member of the crown assembly. The conductive dome and/or the friction guard may define at least a portion of the conductive path from the input surface to the processing unit.

Abstract: Head mounted displays (HMD) and corresponding display methods are provided, which obtain, repeatedly, from a monitoring system of a vehicle and, a reference vector relating to the vehicle; display on the HMD a reference symbol that indicates the reference vector; and determine movements of a HMD symbology according to a spatial relation between a received user's line of sight (LOS) and the reference vector. For example, the vehicle may be an aircraft and the reference vector a flight path vector (FPV) received from the aircraft's avionics. The proposed HMD enhances the displayed information content while avoiding excessive movements of the symbology. The HMD's functional parameters may be pre-set or adapted according to user preference and flight stage characteristics. The reference symbol anchors most of the symbology, while minimal critical information may be moved along with the user's LOS, providing a clearer and more stable view through the HMD.

Abstract: The present invention relates to a method and a device for enabling to analyze a property of a vital sign detector (20). The proposed method comprises the steps of providing a virtual phantom (14) of a living being, rendering an artificial vital sign on the displayed virtual phantom (14), and outputting the virtual phantom (14) with the rendered artificial vital sign to the vital sign detector (20).

Abstract: In certain embodiments, pupil-related characteristic detection or spectacles correction/adjustment based thereon may be facilitated. In some embodiments, a stimulus may be presented at a location on a first display of the user device at a first time to cause a first eye of a user to fixate on the location. A stimulus may be presented at the location on a second display of the user device to cause a second eye of the user to fixate on the location at a time subsequent to the first time. Movement of the first or second eye to fixate on the location on the respective first or second display in connection with the stimulus presentation at the second time may be determined. In response to determining that the movement of the first or second eye exceeded a threshold movement amount, a user profile may be generated that includes the user's pupil distance.