Abstract: A head-mounted display device for providing augmented reality contents to a wearer includes an eye tracker, a light projector, a beam steerer and a combiner. The eye tracker is configured to determine a position of a pupil of an eye of the wearer. The light projector is configured to project light for rendering images. The beam steerer is configured to change a direction of the light from the light projector based on the position of the pupil. The combiner is configured to combine the light from the light projector and light from an outside of the head-mounted display device for providing an overlap of the rendered image and a real image that corresponds to the light from the outside of the head-mounted display device.

Abstract: The disclosed computer-implemented method may include transmitting a first signal by a first antenna element included in a head mounted display system, analyzing the second signal to determine multidimensional data for the second signal, comparing the multidimensional data for the second signal to known multidimensional data related to positions of a gaze of an eye of a user in the head mounted display system, identifying a position of a gaze for an eye of a user in the head mounted display system based on the comparison, and adjusting image data for display on a display device included in the head mounted display system based on the identified position of the gaze of the eye of the user. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: The disclosed computer-implemented method may include communicatively coupling a user interface device to a virtual reality device, capturing inputs from a user on the user interface device, displaying, on the virtual reality device, a virtual representation of the captured inputs from the user, and mirroring, on the virtual reality device, content presented on the user interface device. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: Described herein are embodiments of methods and apparatuses for a wearable augmented reality system for fitness. The embodiments may include producing an avatar in the field of vision of the wearer, wherein a perceived position of the avatar may be controlled to aid the wearer in fitness training by establishing a controllable pace for the wearer. The embodiments may further include an optical system that produces the avatar such that it may be perceived by the wearer of the wearable augmented reality apparatus as a virtual running partner.

Abstract: A display assembly of a head mounted display (HMD) includes a pancake lens display assembly. The pancake display assembly comprises a first lens with a quarter-waveplate and a partially reflective surface, a second lens with a reflective polarizer, and a display. An alignment system positions the first lens relative to the second lens to align the reflective polarizer of the second lens with the quarter-waveplate of the first lens. The alignment system rotates the first lens about an optical axis to position the quarter-waveplate on the first lens such that the quarter-waveplate and the reflective polarizer on the second lens are at an angle where light transmitted through the second lens and then through the first lens is substantially circularly polarized. The alignment system mounts the second lens to the lens housing such that the quarter-waveplate is at the angle relative to the reflective polarizer.

Abstract: A near-eye display and a near-eye display system are provided. The near-eye display includes a display panel, a collimation lens component, and an optical redirector. The display panel includes a plurality of pixels that are disposed in a tiling manner. The collimation lens component includes a plurality of collimation lenses, and the plurality of collimation lenses are in a one-to-one correspondence with the plurality of pixels. Each of the plurality of collimation lenses is configured to: convert, into collimated light, light emitted by a corresponding pixel, and input the collimated light into the optical redirector. The optical redirector includes a plurality of light convergence structures, and the plurality of light convergence structures are in a one-to-one correspondence with the plurality of collimation lenses. Each of the plurality of light convergence structures is configured to converge, on a focus of the near-eye display, collimated light input by a corresponding collimation lens.

Abstract: According to one embodiment, a display and a sensor signal acceptor which accepts detection signals from a sensor are provided. A first display controller displays a first instruction for instructing a first work on the display, based on the detection signal which indicates an end of preparation for the first work. And, a second display controller displays a second instruction for instructing a next second work on the display, based on the detection signal which indicates an end of the first work.

Abstract: Systems and methods for presenting information and executing a task. In an aspect, when a user gazes at a display of a standby device, location related information is presented. In another aspect, when a user utters a voice command and gazes or gestures at a device, a task is executed. In another aspect, a partial address in a voice input, a gesture, and user information are used to determine a destination in an autonomous vehicle. In another aspect, a partial name in a voice input and a gesture are used to determine a product in a purchase process.

Abstract: A virtual image display device of the invention includes an image display element configured to emit image light, a relay optical system configured to generate an intermediate image of the image light emitted from the image display element, and an ocular optical element configured to reflect the intermediate image toward a position assumed to be a position of an eye of an observer to generate an enlarged virtual image. The relay optical system includes a prism, and the prism includes a first bending surface including a bending surface and serving as an incident surface, a second bending surface including a bending surface and serving as an emission surface, and a reflecting surface configured to reflect, toward the second bending surface, the image light incident from the first bending surface.

Abstract: A display system for realizing concentric light field with monocular-to-binocular hybridization, and methods thereof. At least some embodiments include a display arranged to emit or transmit light rays based on image content from a content engine, and an optical subsystem arranged to configure the light rays into a concentric light field. The concentric light field provides a virtual image in a large, contiguous spatial region, such that each eye of the human viewer can detect monocular depth from the light field, to provide a large field of view.

Abstract: A display apparatus including a left portion corresponding to a left eye of a user and a right portion corresponding to a right eye of the user, each portion includes at least one image capturing unit configured to capture an image of a physical space, and a display unit configured to display a video image based on a captured image obtained by the image capturing unit. The image capturing unit is arranged on an inside of an angle formed by lines extending from the pupil of the corresponding eye to each side of the display unit.

Abstract: A driving method suitable for a head mounted device (HMD) is provided. The driving method includes the following operations: moving a first image capture unit and a second image capture unit of the HMD to respectively capture two left-eye images and two right-eye images; calculating a first eye relief according to at least one left-eye feature in the two left-eye images; calculating a second eye relief according to at least one right-eye feature in the two right-eye images; calculating an interpupillary distance (IPD) according to the first eye relief and the second eye relief; and adjusting, according to the IPD, a distance between a first lens and a second lens of the HMD.

Abstract: Embodiments of this application disclose a display including a display screen, a liquid crystal lens layer, and a control module. The display screen comprises a plurality of pixel groups, each of which includes at least one pixel. The liquid crystal lens layer comprises a plurality of liquid crystal lens units, each pixel group being correspondingly disposed with a liquid crystal lens unit. The control module is configured to obtain virtual display depth information of to-be-displayed content of each pixel group. The control module is configured to control, when displaying the to-be-displayed content on a pixel group and according to the virtual display depth information, an electric field applied to a liquid crystal lens unit corresponding to the pixel group, to change a refractive index of the corresponding liquid crystal lens unit, and is configured to adjust a first virtual image of the content displayed by the pixel group.

Abstract: According to various but not necessarily all embodiments of the invention, there is provided an apparatus including an optical engine configured to provide one or more light beams, a camera, a waveguide configured to guide the one or more light beams wherein the waveguide includes a diffractive in-coupling grating and at least one diffractive out-coupling, wherein the at least one out-coupling grating is configured to out-couple the one or more light beams towards an eye of a user and towards the camera.

Abstract: A head mounted display apparatus and a distance measurement device are provided. The distance measurement device includes an image capturing device, a lens set, a position adjuster, and a controller. The position adjuster is configured to adjust positions of the image capturing device and the lens set. The position adjuster respectively adjusts the positions of the image capturing device and the lens set at a plurality of time points. The image capturing device respectively obtains a plurality of images of a target area at the plurality of time points. The controller accordingly obtains a separation distance between the lens set and the target area according to the plurality of images.

Abstract: An optical assembly for projecting light from a display includes a first optical waveguide, a reflective optical element configured, and a first in-coupler. The reflective optical element is configured to receive first light having first polarization from the display and to reflect the first light as second light having second polarization distinct from the first polarization. The first in-coupler is coupled with the first optical waveguide. The first in-coupler is configured to receive and transmit the first light. The first in-coupler is further configured to receive the second light and redirect a first portion of the second light so that the first portion of the second light undergoes total internal reflection inside the first optical waveguide.

Abstract: In one embodiment, a method includes generating, at a multi-view display, a first content to be viewed at a first angle and a second content to be viewed at a second angle. The first content and the second content are displayed simultaneously. The method also includes receiving, at a touch-screen panel coupled to the multi-view display, a first plurality of capacitive signals. The method then generates, by the touch-screen panel, a first touch-screen panel heatmap based on the received first plurality of capacitive signals. The method afterwards determines, based on the first touch-screen panel heatmap, whether a first user input is received with respect to the first content or the second content. The method then assigns, based on determining the first user input corresponds to either the first content or the second content, the first user input to the first content or the second content.

Abstract: An optical apparatus includes a lightguide and an optical combiner. The lightguide receives display light having an initial cross-section size and guides the display light down the lightguide. The lightguide includes internal optical elements that redirect the display light out of the lightguide with an expanded cross-section size that is larger than the initial cross-section size. The optical combiner combines the display light having the expanded cross-section with ambient scene light. The optical combiner includes an ambient scene side, an eye-ward side, and one or more reflective optical elements that pass at least a portion of the ambient scene light incident along an eye-ward direction on the ambient scene side through to the eye-ward side and redirect the display light having the expanded cross-section and incident on the eye-ward side to the eye-ward direction. The one or more reflective optical elements are substantially without lensing power.

Abstract: A first display device with a first display face is arranged in such a way that the first display face can be at least partially seen from a passenger compartment of the motor vehicle. A second display device with a second display face is arranged in such a way that the second display face cannot be seen from the passenger compartment. The two display faces are arranged with respect to one another in such way that the second display face is reflected in the first display face, and as a result of this a virtual display plane which can be seen from the passenger compartment is generated behind the first display face.

Abstract: An information processing apparatus according to an embodiment of the present technology includes an acquisition unit; and a display control unit. The acquisition unit is capable of acquiring a first image obtained by capturing an image of a real space reflected on a user's eyeball, and a second image obtained by capturing an image related to the real space displayed on a predetermined display unit, the real space displayed on the predetermined display unit being reflected on the eyeball. The display control unit controls, on a basis of the acquired first image and the acquired second image, image display performed by the predetermined display unit.

Abstract: An image display apparatus includes an observation optical system that includes a prism having first to third surfaces. The observation optical system has a first section is a section that contains an optical path of light from a center of the original image to a center of the exit pupil through the third surface, the first surface, the second surface, and the first surface, and a second section is a section orthogonal to the first section. A reflection area for an internal reflection of the light on the first surface has a center part that is concave toward the exit pupil on the second section and a peripheral part at both sides of the center part has a convex shape toward the exit pupil.

Abstract: A near-eye display (NED) includes an image replicator and an image combiner. The image replicator is configured for receiving a beam of image light from a source such as an image projector, and splitting the beam into a plurality of second beams of image light. The combiner is configured to relay the plurality of second beams to an eyebox of the NED such that the second beams at the eyebox are laterally offset from one another. The etendue of the NED may be increased by replicating and relaying the image beams.

Abstract: A head-mounted display (HMD) includes a frame configured to be fixated to a head, a light-transmissive display unit fixated to the frame and outputting a VR image in a VR mode and an AR image in an AR mode, a light transmission control layer having changed transmittance, a lens unit having a refractive index changed in the VR mode and the AR mode, and a controller control the light transmission control layer to increase transmittance in the AR mode and decrease transmittance in the VR mode.

Abstract: A display device as an embodiment of the present invention is provided with a light source, a light splitting portion for causing first emission light emitted from the light source to be surface-reflected as first reflected light, a retro-reflection portion for retro-reflecting the first reflected light toward the light splitting part as retro-reflected light, and a first light blocking portion for blocking surface-reflected light surface-reflected by the retro-reflection part toward an observation position of the retro-reflected light. The light splitting portion is configured to transmit at least some of the retro-reflected light.

Abstract: An augmented reality device enables selection and interaction with multiple objects viewed in an augmented reality scene. A cursor is positioned proximate to a first object in response to a first gesture. A selected state of the first object is determined in response to a second gesture. A visual indication of the selected state of the first object is displayed by the augmented reality device. A second position for the cursor, proximate to a second object, is determined. A visual indication of the first object's selected state remains displayed after the cursor is moved to be proximate to the second object.

Abstract: A head up display arrangement for a motor vehicle includes a head up display module having a picture generation unit emitting a light field. A plurality of linear polarizers are arranged in a stack. A first of the linear polarizers receives the light field from the picture generation unit. A last of the linear polarizers emits the light field. A windshield reflects the light field from the last linear polarizer such that the reflected light field is visible to a human driver of the motor vehicle as a virtual image.

Abstract: A near eye display includes a main freeform prism lens and a micro-display corrector lens, where the main freeform prism lens includes a first freeform surface, a second freeform surface, and a third freeform surface, the first freeform surface refracting a light from a micro-display into a body of the main freeform prism lens, and the main freeform prism lens having an exit pupil diameter greater than 12 millimeter (mm), and a lateral color aberration of less than 4 micrometer (um)) across a diagonal field of view (FOV), where the micro-display corrector lens is positioned between the main freeform prism lens and the micro-display, the micro-display corrector lens including a first corrector lens surface and a second corrector lens surface, and each surface of the main freeform prism lens and the micro-display corrector lens comprises a surface sag.

Abstract: A head mounted display is worn on a head of a user. The head mounted display includes a display device configured to display image; a casing that houses the display device; a right-eye lens and a left-eye lens attached to the casing; and an inter-lens structure disposed between the right-eye lens and the left-eye lens. The head mounted display causes the user to recognize a color of at least a part of the inter-lens structure as a color that is equal to or brighter than a skin color when the user wears the head mounted display.

Abstract: Glasses with gesture recognition function include a glasses frame and a gesture recognition system. The gesture recognition system is disposed on the glasses frame and configured to detect hand gestures in front of the glasses thereby generating a control command The gesture recognition system transmits the control command to an electronic device to correspondingly control the electronic device.

Abstract: A video display mirror is provided with a half mirror, a monitor, and an interlocking mechanism. The half mirror is used so that a vehicle passenger can look toward the rear of the vehicle. The monitor is disposed near the half mirror toward the front of the vehicle. The interlocking mechanism moves in relation to a video image being displayed on the monitor and changes the angle of a reflection surface of the half mirror from the position of the half mirror when the rear of the vehicle is viewed.

Abstract: A virtual reality/augmented reality (VR/AR) headset system (including the capability for one or both of virtual reality and augmented reality) includes a remote optical engine. The remote disposition of the optical engine removes many or all of the components of the VR/AR headset system that add weight, heat, and other characteristics that can add to user discomfort in using the system from the headset. An electronic image is received and/or generated remotely at the optical engine and is transmitted optically from the remote location to the headset to be viewed by the user. One or more optical waveguides may be used to transmit the electronic image to one or more passive displays of the headset, from the remote optical engine.

Abstract: An optical assembly includes a first optical waveguide, a first in-coupler coupled with the first optical waveguide and a projector configured to project image light toward a first side of the first optical waveguide. The optical assembly also includes a first scanning reflector optically coupled with the projector and disposed on a second side of the first optical waveguide that is opposite to the first side. The projector is configured to project image light. The first scanning reflector is configured to receive the image light and to redirect the image light across a first range of directions. The first in-coupler is configured to redirect a first portion of the image light so that the first portion of the image light undergoes total internal reflection inside the first optical waveguide.

Abstract: Examples are disclosed that relate to expanding an exit pupil of a display device via a curved waveguide. One example provides a curved waveguide, including an input coupler configured to couple light into the curved waveguide, a first reflective surface, a second reflective surface opposing the first reflective surface, and an output coupler configured to couple the light out of the curved waveguide. The curved waveguide also has a curvature in a direction transverse to an optical path between the input coupler and the output coupler, the curvature having a radius that varies along a direction extending between the input coupler and the output coupler.

Abstract: An optical device includes a range of angularly selective reflectors are contained within an optical waveguide substrate and substantially optimized according to their reflector order within the sequence of reflectors. This configuration of reflectors ensures that the required angular information is passed through to the correct reflector within the sequence. The angular response in addition reduces or eliminates formation of secondary images carried to successive reflectors, resulting in undesired artefacts.

Abstract: A display system comprises a light source assembly, a display assembly, a camera assembly, and a controller. The light source assembly is configured to generate visible light and infrared light. The display assembly is configured to generate image light using the visible light and to generate tracking light using the infrared light. The tracking light and the image light pass through a beam splitter prior to being projected into a local area. The camera assembly is configured to capture one or more images of the local area illuminated with the tracking light. The images are illuminated with the tracking light that passes through the beam splitter prior to be being captured by the camera assembly. The controller is configured to calculate depth information for objects in the local area using the one or more images.

Abstract: Projection systems and components thereof are described that are well suited to miniaturization.

Abstract: A display system includes a display unit, a housing, and a reflecting optical system. The display unit displays an image based on a captured image. The housing includes a housing room that houses the display unit and the reflecting optical system. The reflecting optical system reflects the image displayed on the display unit, thereby outputting the reflected image through an opening of the housing to the outside of the housing.

Abstract: A display device is configurable to be operable in a first mode and a second mode. The display device includes an emission surface configured to output image light, a first optical assembly, and a second optical assembly. The first optical assembly is configured to receive image light from the emission surface and to direct the image light toward the eyes of a user at a first optical power. The second optical assembly includes a first region configured to receive image light from the emission surface and to direct the image light toward the eyes of a user at a second optical power. The second optical assembly also includes a second region configured to receive ambient light and to transmit at least a portion of the received ambient light at a third optical power distinct from and less than the first optical power and the second optical power.

Abstract: When a location of a wearable system changes, the wearable system can ensure that a gesture working region always remains in a field of view of the wearable system. Therefore, the wearable system can still collect and recognize a gesture image and implement gesture control. The solution provided in this application is as follows: The wearable system creates a gesture working region and a region of interest, where the region of interest is within a shooting area of a first camera, and the first camera is included in a wearable device; obtains a location parameter of the wearable system; adjusts the region of interest according to the location parameter, so that the region of interest covers the gesture working region; collects a gesture image within the gesture working region; recognizes the gesture image to obtain a gesture instruction; and performs a corresponding operation according to the gesture instruction.

Abstract: Methods, systems, and apparatus for conducting a video conference. A location of one or more sets of eyes in an image may be determined. The relative location of an image capture device and/or a portion of a display device may be adjusted based on the determined location.

Abstract: In an optical system, a first optical section having positive power, a second optical section provided with a first diffractive element and having positive power, a third optical section having positive power, and a fourth optical section provided with a second diffractive element and having positive power are disposed along a light path of image light emitted from an image light generation device. A first intermediate image of the image light is formed between the first optical section and the third optical section, a pupil is formed in the vicinity of the third optical section, a second intermediate image of the image light is formed between the third optical section and the fourth optical section, and the fourth optical section collimates the image light to form an exit pupil. The first diffractive element and the second diffractive element are in a conjugate relation or a roughly conjugate relation.

Abstract: A 3D near eye display device is provided, the display device comprising a display screen for displaying more than one 2D images, at least one focusing element for collimating the images to sub-images, a spatial multiplexing unit capable of remapping the sub-images to different depths while forcing their centers to align to form remapped sub-images, and an eye piece. The device and methods allow for a high quality, compact 3D display system that can be wearable and overcomes the vergence-accommodation conflict that leads to visual discomfort and fatigue caused by traditional 3D near eye display devices.

Abstract: Interpupillary calibration system and method for stereoscopic visualization. The system includes a first display, second display, and calibration processor. The first display is disposed in proximity to a left aperture of an eyeframe to present a first image area through the left aperture, the first image area associated with an image and having a first display axis. The second display is disposed in proximity to a right aperture of the eyeframe to present a second image area through the right aperture, the second image area associated with the image and having a second display axis. The calibration processor is configured to adjust a display distance between the first image area and second image area based on an interpupillary distance of a user, wherein the first image area and second image area are visible through the first aperture and second aperture enabling formation of a stereoscopic view of the image.

Abstract: An object distance adjusting apparatus includes a first adjustment mechanism, a second adjustment mechanism, and a third adjustment mechanism, the first adjustment mechanism being meshed with the second adjustment mechanism, and the second adjustment mechanism being meshed with the third adjustment mechanism. Rotation of the first adjustment mechanism drives the second adjustment mechanism to rotate, and rotation of the second adjusting mechanism drives the third adjusting mechanism to rotate. A rotation axis of the third adjustment mechanism is perpendicular to both a rotation axis of the first adjustment mechanism and a rotation axis of the second adjustment mechanism. A virtual reality device including the object distance adjusting apparatus is also disclosed.

Abstract: A vehicle display apparatus of the present disclosure includes a display and a reflective member. The reflective member reflects display light from the display. The display causes the display light to be incident on the reflective member as S polarized light. The reflective member is located along an incident light path of the display light from the display to a reflecting surface of a windshield of a vehicle or along a transmitted light path of transmitted light transmitted by the reflecting surface. The reflective member reflects linearly polarized incident light as circularly polarized reflected light. The vehicle display apparatus guides display light reflected at the reflective member and at the windshield to an eye box.

Abstract: A headset includes a first waveguide display and a second waveguide display. The first waveguide display is configured to emit a first portion of image light, the first waveguide display having a first field of view (FOV). The second display assembly is configured to emit a second portion of the image light, and the second display assembly has a second FOV. The first waveguide display and the second display assembly are tiled such that the emitted first portion of image light and the emitted second portion of image light create a tiled FOV from a perspective of an eyebox. And a seam between the first FOV and the second FOV is located in a peripheral region of the tiled FOV.

Abstract: An imaging light guide for conveying a virtual image has a waveguide with first and second color channels for directing light of a first and second wavelength range toward a viewer eyebox. Each color channel has an in-coupling diffractive optic to diffract an image-bearing light beam into the waveguide and a reflector array having a partially reflective surface and a dichroic filter surface in parallel. Reflector array surfaces expand the respective light beam of the channel from the in-coupling diffractive optic in a first dimension and direct the expanded light beams toward an out-coupling diffractive optic. The dichroic surface reflects light of the color channel toward the reflective surface and transmits other light out of the waveguide. The out-coupling diffractive optic expands the image-bearing light beam orthogonally to the first dimension and directs the further expanded light beam toward the viewer eyebox.

Abstract: The disclosed systems for positioning head-mounted displays may include a first track along which a display apparatus of a head-mounted display is configured to move in a first direction and a second track along which the display apparatus is configured to move in a second, different direction. A first electromechanical actuator may move the display apparatus along the first track, and a second electromechanical actuator may move the display apparatus along the second track. Various other methods and systems are also disclosed.

Abstract: The invention relates to an image-generation device (11) for a head-up display (10), comprising: a light source, a light modulator suitable for spatially modulating the light emitted by the light source, and a computer (13) suitable for controlling the light of source and the light modulator such that they generate an image. According to the invention, the light source is composed of a plurality of separate light elements, and the computer is able to modulate the light intensity emitted by each light element independently of the light intensity emitted by the other light elements.

Abstract: An ultra-wide head-up display system and a display method thereof are provided. An ultra-wide image displayed by the ultra-wide head up display system is divided into independent head-up display images, an information type of each of the head-up display images is dynamically switched according to a usage status of a vehicle, each of the head-up display images is displayed in a corresponding outer frame, and each of the outer frames is formed by a display region not displaying an image.