Abstract: An optical combiner, configured for use in a mixed-reality display system that combines holographic and real-world images, includes an assembly of see-through waveguides that are arranged in a stack to provide full color holographic images from constituent RGB (red, green, and blue) color components received from a holographic image source. Each waveguide—one per RGB color component—includes an in-coupling DOE (diffractive optical element), an intermediate DOE, and an out-coupling DOE that are disposed on internal surfaces of the stacked waveguides in the optical combiner. Each of the out-coupling DOEs incorporates a diffractive lens functionality to render the out-coupled holographic images at a set depth on the mixed-reality display. In an illustrative non-limiting example, the out-coupling DOE may provide a half diopter of negative lens power to set the optical focus of the holographic images at 1.33 m.

Abstract: An imaging system includes a light source configured to produce a plurality of spatially separated light beams. The system also includes an injection optical system configured to modify the plurality of beams, such that respective pupils formed by beams of the plurality exiting from the injection optical system are spatially separated from each other. The system further includes a light-guiding optical element having an in-coupling grating configured to admit a first beam of the plurality into the light-guiding optical element while excluding a second beam of the plurality from the light-guiding optical element, such that the first beam propagates by substantially total internal reflection through the light-guiding optical element.

Abstract: Embodiments described herein include an input device and associated processing system for sensing force applied by input objects. The input device comprises a display device comprising a plurality of layers formed as a display stack, the display stack including a top surface. The input device further comprises one or more strain gauges disposed within the display stack and configured to detect force applied to the top surface, and a processing system configured to perform display updating using the display device and to perform force sensing using the one or more strain gauges.

Abstract: A system and method enabling location-based activation of applications.

Abstract: An information processing device including a display unit, a detector, and a first control unit. The display unit capable of providing the user with a field of view of a real space. The detector detects an azimuth of the display unit around at least one axis. The first control unit includes a region limiter, a storage unit, and a display control unit. The region limiter is capable of limiting a display region of the field of view along a direction of the one axis in three-dimensional coordinates surrounding the display unit. The storage unit stores images including information relating to a predetermined target present in the field of view with the images being made corresponding to the three-dimensional coordinates. The display control unit is configured to display, based on an output of the detector, an image in the three-dimensional coordinates, which corresponds to the azimuth, in the field of view.

Abstract: An apparatus including a first display for a user's first eye; a first motion sensor and/or a first externally facing image capture device configured to capture at least a first image of a user's real world point of view; a second display for a user's second eye; a second motion sensor and/or a second externally facing image capture device configured to capture at least a second image of a user's real world scene; and a controller configured to: receive a first signal from: the first motion sensor and/or the first image capture device, receive a second signal from: the second motion sensor and/or the second image capture device, determine, based on the first and second signals, a change in orientation of the first display with respect to the second display, and control display of first content on the first display in dependence on the determined change in orientation.

Abstract: Aspects of the present invention relate to a head-worn computer having a see-through computer display, a frame mechanically adapted to hold the see-through computer, a first side arm pivotally attached to the frame and adapted to hold the head-worn computer in place on a head of the user, wherein the first side arm comprises a temple section and an ear horn section and the temple section further comprising a compartment adapted to contain a battery, wherein the battery powers the see-through computer display.

Abstract: A method for conducting a virtual three dimensional (3D) video conference between multiple participants, the method may include receiving by a user device of a first participant of the virtual 3D video conference, reference second participant 3D representation information for generating a second participant 3D representation under different constraints. The different constraints include at least one out of (a) a touch up constraint, (b) a makeup constraint, and (c) one or more circumstances constraint.

Abstract: A voice transmitter assembly for enhancing verbal communication for a user wearing a face mask includes a clip that has a first member which is biased against a second member to engage a face mask. A microphone is coupled to the second member of the clip to capture words spoken by the user. A speaker is coupled to the first member of the clip to emit audible sounds to a listener. The speaker is in communication with the microphone thereby facilitating the speaker to emit sounds captured by the microphone. In this way the speaker can enhance the listener's ability to hear the words spoken by the user.

Abstract: Embodiments of the present disclosure disclose a presentation content update method, a head-mounted display device and a computer-readable medium. One specific embodiment of the method includes: determining three-axis attitude angles of a target device and three-axis attitude angles of a head-mounted display device based on first sensor data with respect to the target device sent by a first sensor and second sensor data with respect to the head-mounted display device sent by a second sensor; determining whether the three-axis attitude angles of the target device and the three-axis attitude angles of the head-mounted display device meet an attitude angle deviation detection condition; and updating presentation content on a display screen of the head-mounted display device in response to determining that the three-axis attitude angles of the target device and the three-axis attitude angles of the head-mounted display device meet the attitude angle deviation detection condition.

Abstract: An electronic device is disclosed. The electronic device comprises: a first display for the left eye of a user; a second display for the right eye of the user, that is spaced apart from the first display in a one direction; frames that hold the first display and the second display and are supported on the user's head; and an optical variable unit capable of varying the optical alignment of the first display or second display. An electronic device according to the present invention may be associated with an artificial intelligence module, robot, augmented reality (AR) device, virtual reality (VR) device, and device related to 5G services.

Abstract: A head-mounted display (HMD) comprising a first side for facing a user of the HMD, a second side opposite to the first side, and a reflective layer for at least partially reflecting incident light incident on the second side. At least one processor of the HMD is configured to obtain luminance data indicative of a luminance of the incident light and control a display device, based on the luminance data, to control a luminance of a portion of emitted light directed towards the user of the HMD during the display of the image. Further examples relate to an HMD with a display device configured to emit light of at least one predetermined wavelength range during display of an image by the display device, and a layer arranged to at least partially prevent transmission of the light of the at least one predetermined wavelength range outward from the HMD.

Abstract: A neural network system includes an eyewear device. The eyewear device has a movement tracker, such as an accelerometer, gyroscope, or an inertial measurement unit for measuring acceleration and rotation. The neural network system tracks, via the movement tracker, movement of the eyewear device from at least one finger contact inputted from a user on an input surface. The neural network system identifies a finger gesture by detecting at least one detected touch event based on variation of the tracked movement of the eyewear device over a time period. The neural network system adjusts the image presented on the image display of the eyewear device based on the identified finger gesture. The neural network system can also detect whether the user is wearing the eyewear device and identify an activity of the user wearing the eyewear device based on the variation of the tracked movement over the time period.

Abstract: According to various embodiments of the disclosure, an electronic device may include an image sensor and a processor. The processor may be configured to detect a movement of an object, using an image generated by the image sensor, to identify a size value of the object, to correct a size value of the object based on a location of the object within the image, and to perform an operation corresponding to a movement of the object, based on the corrected size value.

Abstract: An eyewear device is disclosed including a frame, a temple connected to a lateral side of the frame, an array of light emitting diodes (LEDs) to emit light patterns on an inner surface of the frame or the temple within a peripheral view of a wearer of the eyewear, a processor coupled to the eyewear device, and a memory accessible to the processor. The memory stores programming for execution by the processor and notification patterns corresponding to the LEDs. Execution of the programming configures the eyewear device to identify an event for presentation to the wearer, select a notification pattern corresponding to the identified event, and display the selected notification pattern to the wearer by selectively illuminating the LEDs.

Abstract: A head-mounted display includes a frame having conductivity, a first display device and a second display device supported by the frame, a cable shielded by a conductive cloth, and a screwing structure configured to interpose the cable between the frame and the first and second display devices. The screwing structure holds a conducting region of the frame and the conductive cloth in a state where the conducting region of the frame and the conductive cloth are electrically coupled.

Abstract: A near eye display system having an image display panel, a prism assembly comprising a first and second element and a structure such as a eye wear glasses frame. The front and rear surfaces of the first and second elements are aligned and bonded to form the prism assembly. A partially-reflective coating is applied to the interface of the first and second elements to define a beam-splitter interface. The image display panel is disposed near an upper optical region such as a refracting surface of the first element. The lower edge of the second element opposite the beam-splitter interface is a coated reflective surface mirror. The display panel, the optical region and the optically reflective surface are configured to provide compactness and to avoid the break of symmetry. The system accommodates large inter pupil distance (IPD) variation and left/right eye scanning motion.

Abstract: The present disclosure relates to an augmented reality system including one or more of a building, sensor(s), a gateway, a server, and a monitoring computer. The augmented reality system may further includes drones that capture video or other images of the building. The monitoring computer gathers information from the sensor(s) and/or drones and facilitates the creation of an augmented view of the building to provide intelligence to emergency responders.

Abstract: Aspects of the present invention relate to methods and systems for imaging, recognizing, and tracking of a user's eye that is wearing a HWC. Aspects further relate to the processing of images reflected from the user's eye and controlling displayed content in accordance therewith.

Abstract: A system and method enabling location-based activation of applications.

Abstract: A method, medium and system for auto-aligning displays of a head/helmet mounted display. The method, medium and system may provide for an auto-alignment of components of a headband, headgear, or a helmet. The method, medium and system may provide for a first sensor mounted to the helmet of a user and configured to communicate and transfer align with a vehicle comprising an inertial navigation system (INS). The method, medium and system may provide for display comprising a second sensor configured to communicate with the first sensor and transfer align the second sensor with the first sensor based on the transfer alignment of the first sensor with the vehicle. The method, medium and system may provide for wherein the first sensor and the second sensor comprise an inertial measurement unit (IMU). Further, the method, medium and system may also provide for the aligning of two displays on the head/helmet relative to each other in real time.

Abstract: A wearable display device includes a display element, a circuit board, an outer case including a first case member and a second case member, the first case member being configured to dissipate heat generated by the circuit board to outside, the second case member being disposed farther to a wearer side than the first case member is and configured to dissipate heat generated by the display element to the outside, and a heat insulating structure disposed in a region where the first case member and the second case member face each other.

Abstract: A display device includes a base substrate, a display panel, and a moveable structure located between the base substrate and the display panel, fixedly connected to the display panel and slidably connected to the base substrate; the display panel includes pixel areas and non-pixel areas between the pixel areas; in displaying phase, the moveable structure is configured to control the display panel to perform reciprocating motion with a preset cycle, the distance that the display panel moves in a single direction in the preset cycle is smaller than or equal to the width of a non-pixel area in the single direction, the preset cycle is the time required for the display panel to perform reciprocating motion once, and the time that the display panel moves in the single direction in the preset cycle is equal to the time that an image of the display panel is refreshed once.

Abstract: An example method includes registering, via a visualization device, a virtual model of a portion of an anatomy of an ankle of a patient to a corresponding portion of the anatomy of the ankle viewable via the visualization device, the virtual model obtained from a virtual surgical plan for an ankle arthroplasty procedure to attach a prosthetic to the anatomy. The example method also comprises displaying, via the visualization device and overlaid on the portion of the anatomy, a virtual guide that guides at least one of preparation of the anatomy for attachment of the prosthetic or attachment of the prosthetic to the anatomy.

Abstract: The exemplary embodiments disclose a method, a computer program product, and a computer system for enhancing a user's appetite with one or more augmented reality devices. The exemplary embodiments may include collecting data of the user, the user's environment, and one or more consumable items, extracting one or more features from the collected data, determining one or more augmented reality appetite enhancements based on the extracted one or more features and one or more models, and enhancing the user's appetite by way of the one or more augmented reality devices according to the determined one or more augmented reality appetite enhancements.

Abstract: A light field display, having at least one laser emitter, an optical modulator for modulating light from the laser emitter with video information; a beam focus modulator; an array of beam scanning elements; an electrically controllable beam focus modulator; and at least one at least one waveguide having at least one transparent substrate, an input grating and an output grating for extracting light from the waveguide; and an eye tracker is provided.

Abstract: A control system controls an industrial machine, and each of controllers includes a screen generation unit which generates a controller screen that is displayed on a controller display unit and which generates a glasses screen that is displayed on s glasses-type display device based on a variation in an internal state of the controller screen and the glasses-type display device includes: a transmissive glasses display unit which is arranged so as to correspond to the positions of the eyes of a wearer and which can display the generated glasses screen; a glasses side transmission/reception unit which acquires specific information for specifying the controller that is connected; and a display control unit which displays the glasses screen and the specific information on the glasses display unit.

Abstract: The present disclosure has a configuration in which a distributor who performs a separate distribution that is different from this live content, or a viewer who views this separate distribution can participate in a virtual space and express intent or participate in visual recognition through the commitment of a virtual item.

Abstract: A vision assistance apparatus may include an image acquisition unit configured to acquire an image by capturing the scene of the front which a user watches, a sensor unit configured to acquire sensing information on objects located in front of the user, a control unit configured to analyze the image acquired by the image acquisition unit and generate a notification signal for the front scene through an analysis result of the image and the sensing information acquired by the sensor unit, and an output unit configured to provide the user with the notification signal generated by the control unit in the form of sound.

Abstract: An information display method and an information display system are provided. The method is adapted to the information display system including a first image capturing device and a transparent display, and the method includes the following steps. A pattern image is obtained by shooting a pattern placed on a real object through the first image capturing device, wherein the real object is located on one side of the transparent display. Relative position information between the transparent display and the pattern is obtained according to the pattern image. Augmented image data is obtained according to the relative position information. The augmented image data is displayed through the transparent display, wherein the augmented image data include a virtual object augmented based on the real object.

Abstract: Methods and systems are disclosed for presenting virtual objects on a limited number of depth planes using, e.g., an augmented reality display system. A farthest one of the depth planes is within a mismatch tolerance of optical infinity. The display system may switch the depth plane on which content is actively displayed, so that the content is displayed on the depth plane on which a user is fixating. The impact of errors in fixation tracking is addressed using partially overlapping depth planes. A fixation depth at which a user is fixating is determined and the display system determines whether to adjust selection of a selected depth plane at which a virtual object is presented. The determination may be based on whether the fixation depth falls within a depth overlap region of adjacent depth planes. The display system may switch the active depth plane depending upon whether the fixation depth falls outside the overlap region.

Abstract: A processor may receive physical parameter data associated with a physical parameter of an object. The processor may receive pathway data associated with one or more potential pathways for transporting the object from an origin point to a destination point. The processor may determine a recommended pathway, the recommended pathway may have one or more path segments for transportation of the object from the origin point to the destination point. The processor may determine a first recommended orientation and a first recommended movement for transportation of the object through a first path segment of the recommended path. The processor may provide, to a user, a virtual rendering of the first recommended orientation and the first recommended movement of the object through the first path segment of the recommended path.

Abstract: A display system includes a head-mounted display configured to project light, having different amounts of wavefront divergence, to an eye of a user to display virtual image content appearing to be disposed at different depth planes. The wavefront divergence may be changed in discrete steps, with the change in steps being triggered based upon whether the user is fixating on a particular depth plane. The display system may be calibrated for switching depth planes for a main user. Upon determining that a guest user is utilizing the system, rather than undergoing a full calibration, the display system may be configured to switch depth planes based on a rough determination of the virtual content that the user is looking at. The virtual content has an associated depth plane and the display system may be configured to switch to the depth plane of that virtual content.

Abstract: Providing learned interactions in a virtual reality or augmented reality (collectively, a computer-mediated reality) can include determining a probable physical action of a user interacting with a computer-mediated reality (CMR) environment. A learned interaction corresponding to the probable physical action can be generated based on a CMR-physical action (CMRPA) model that correlates physical actions with results of the physical actions in a CMR scenario of the CMR environment. In response to determining, based on at least one identified characteristic of the user, a statistical likelihood of benefiting the user by providing the learned interaction, a learned interaction corresponding to the probable physical action can be provided to the user.

Abstract: Disclosed are a lamp for a vehicle and a vehicle including the lamp. A lamp for a vehicle according to one aspect of the present disclosure includes: a light source configured to emit first light; and a beam splitter configured to form transmitted light by transmitting a part of the first light and form reflected light by reflecting another part of the first light, in which the transmitted light transmitted through the beam splitter and the reflected light reflected by the beam splitter form beam patterns outside.

Abstract: A transparent optical module system or device comprising an optical architecture hierarchy based on a patch unit. In aspects, the transparent optical module comprises a display sparsely populated with pixels. The patch unit comprises one or more regions of display pixels, or a pixel pattern(s), and an associated lenslet, for example on a microlens array. The lenslet is capable of transmitting display-emitted light to an eye of the wearer of the transparent optical module, which then focuses the light to form a retinal image, which is seen or perceived by the wearer. The patch units can be combined further into patch groups, wherein members of a group serve a similar role in retinal image production as a patch unit and/or lenslet. This hierarchy allows the system to be scaled to larger and more complex systems.

Abstract: A wearable display device includes a display element, a first circuit board, a second circuit board, and an outer packaging case housing the display element, the first circuit board, and the second circuit board, wherein the second circuit board has a larger calorific value than the first circuit board, and is disposed at a further outer side, which is an opposite to a wearer than the first circuit board, in the outer packaging case.

Abstract: A system is disclosed in which an eye-tracking sensor signal is received and a moving image is generated to be rendered on one or more displays based on the eye-tracking sensor signal. Responsive to an input control signal from a user-operable control device or based on a determination that the user's gaze direction is tracking the moving image, the system adjusts the moving image.

Abstract: The disclosure provides a system that provides a mixed reality experience for users. Mixed reality is the blending of real and virtual (or digital) worlds to produce environments and visualizations where both physical and digital objects co-exist and can also interact in real time. The disclosure provide a MR system for the interaction of users, computers, and an environment in which users can experience using all five senses. In one example, the disclosure provides a mixed reality system that includes: (1) a structure, (2) a vehicle configured to support at least one user, wherein the vehicle is suspended from the structure via an articulating universal connection mount, and (3) a system controller configured to provide virtual reality video content to a virtual reality interface in response to interactions of the user with the vehicle and the virtual reality interface, wherein the virtual reality video content corresponds to the real world of the vehicle.

Abstract: An object is to provide an image projection system in which a size and weight of a head-mounted portion are reduced and binocular vision is enabled.

Abstract: Interactive augmented reality experiences with an eyewear device including a virtual eyewear beam. The user can direct the virtual beam by orienting the eyewear device or the user's eye gaze or both. The eyewear device may detect the direction of an opponent's eyewear device or eye gaze of both. The eyewear device may calculate a score based on hits of the virtual beam of the user and the opponent on respective target areas such as the other player's head or face.

Abstract: The disclosed computer-implemented method may include (1) displaying one or more images to a user via a display comprising multiple display regions, (2) switching each of the display regions to a blocking state in which a view of the user's real-world environment in a corresponding region of the user's field of view is blocked from the user, (3) detecting a pass-through triggering event involving one or more objects in the user's real-world environment, (4) identifying one or more display regions corresponding to a region of the user's field of view occupied by the object, and (5) switching each of the one or more display regions to a pass-through state in which the view of the user's real-world environment in the corresponding region of the user's field of view is passed through to the user. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: An optical waveguide includes an input diffractive optical element arranged for being aligned with an optical projector for diffracting the light beam therefrom, a waveguide substrate arranged for reflecting the light beam diffracted by the input diffractive optical element by means of total internal reflection, and an output diffractive optical element coupled at said waveguide substrate for partially diffracting the light beam as a diffracted light and partially transmitting the light beam as a transmitted light during the total internal reflection of the light beam within the waveguide substrate. The diffracted light is diffracted by the output diffractive optical element and is projected out of the waveguide substrate toward the user eye. The transmitted light is continuously transmitted and reflected within the waveguide substrate by the total internal reflection until the transmitted light is totally diffracted out of the waveguide substrate, so as to complete an exit pupil expansion.

Abstract: A foveated projection system in a wearable device is configured for tracking an eye gaze of a user wearing the wearable device. The foveated projection system may distribute and concentrate pixels only at a portion of a display screen of the wearable device, which is in direct line with a current position of the eye gaze of the user. The portion of the display screen will have a high concentration of pixels in comparison to remaining portions of the display screen, which results in the user viewing information within the portion at a high resolution. As the eyes of the user moves in a different position, all the pixels are seamlessly moved to concentrate at new portions of the display screen, which are now in line with most recent positions of the eye gaze of the user.

Abstract: Systems and methods for a flexible, head-mounted display is provided. The head-mounted display system may comprise a base member and one or more arm members that are coupled to the base member. Each of the arm members are coupled to the base member via a hinge that allows the arm members to move with respect to one another. Interior walls of the arm members and base member may define one or more chambers. One or more first batteries are positioned within a chamber in the first arm member and one or more second batteries are positioned within a chamber in the second arm member. One or more wired connections coupled to the batteries extend through the arm member(s) and hinges, and into one or more chambers in the base member, where the one or more wired connections are coupled to a battery monitor.

Abstract: Configurations are disclosed for presenting virtual reality and augmented reality experiences to users. An augmented reality display system comprises a handheld component housing an electromagnetic field emitter, the electromagnetic field emitter emitting a known magnetic field, the head mounted component coupled to one or more electromagnetic sensors that detect the magnetic field emitted by the electromagnetic field emitter housed in the handheld component, wherein a head pose is known, and a controller communicatively coupled to the handheld component and the head mounted component, the controller receiving magnetic field data from the handheld component, and receiving sensor data from the head mounted component, wherein the controller determining a hand pose based at least in part on the received magnetic field data and the received sensor data.

Abstract: By arranging cables, which transmit video signals to a pair of video image display elements arranged on the right side and the left side, along a frame for supporting a pair of right and left light guiding devices, it is possible to concentrate the cables on one of the right and left sides. That is, it is possible to integrally form the cables. By accommodating the cables in a cable cover portion, which extends along the frame, in a cover inside, it is possible to suppress an increase in size which accompanies cable arrangement and to implement the apparatus as a whole in a small body.

Abstract: Eyewear dynamically adjusts viewing effects to match the wearer, the object or scene being viewed (luminance, color prominence, glare, visual blur/noise), other conditions: sensory parameters (gaze direction, focal length, eye gestures, other eye activity, other senses, wearer inputs), medical conditions, wearer location, environmental parameters, wearer activity, use by the wearer, the wearer's field of view. The eyewear can adjust visual features presented to the wearer, such as changes in refraction, polarization/shading, color, prismatic angles/functions, 3D displays. Eyewear can be tailored to form factor: glasses, contacts, RID, IOL, facemask/helmet, vehicles, windows, screens, scopes, AR/VR devices, nerve sensors, external devices. Eyewear can adjust refraction, polarization/shading, color filtering/injection, false coloring, color change; prismatic angles/functions.

Abstract: Head mounted displays (HMD) and corresponding display methods are provided, which obtain, repeatedly, from a monitoring system of a vehicle and, a reference vector relating to the vehicle; display on the HMD a reference symbol that indicates the reference vector; and determine movements of a HMD symbology according to a spatial relation between a received user's line of sight (LOS) and the reference vector. For example, the vehicle may be an aircraft and the reference vector a flight path vector (FPV) received from the aircraft's avionics. The proposed HMD enhances the displayed information content while avoiding excessive movements of the symbology. The HMD's functional parameters may be pre-set or adapted according to user preference and flight stage characteristics. The reference symbol anchors most of the symbology, while minimal critical information may be moved along with the user's LOS, providing a clearer and more stable view through the HMD.

Abstract: A shared augmented reality system can support the sharing of video captured by a local user, using a head mounted display (HMD), with a remote user. The remote user may add augmented reality annotations (markings, notes, drawings) to certain objects within the environment captured within the video, where the annotations track the movement of those objects within the shared video. An HMD may not, however, provide a convenient interface for performing certain user-interface intensive tasks, which might be better performed on an additional device such as a mobile phone, tablet, or computer. During a shared augmented reality session, the additional device can be configured to communicate with a HMD such that certain tasks can be performed by the user through the additional device, and other tasks can be performed or experienced through the HMD. The additional device, the HMD and the remote user's device can communicatively coordinate during the session.