Abstract: A waveguide and an augmented reality (AR) device employing the waveguide are disclosed. The waveguide includes a waveguide body, an input-coupling element inputting a light into the waveguide body, a reflective element disposed at one side of the waveguide body and again inputting a light that is not input into the waveguide body or is transmitted through the waveguide body into the waveguide body, and an output-coupling element outputting a light propagating inside the waveguide body to an outside.

Abstract: A head-mounted display includes: a camera configured to obtain an image by capturing a scene; at least one display configured to display the image obtained by the camera; and a lens comprising a plurality of lens elements arranged between an eye of a user and the at least one display. The lens includes an aperture stop area configured to be at least a portion of an area for facing the eye of the user. The aperture stop area includes a plurality of sub-stop areas corresponding to a plurality of gaze directions by eye rotation, respectively. The modulation values of the lens at sub-fields of 0 degrees of sub-stop areas, from the plurality of sub-stop areas, corresponding to gaze directions of 0, 10, and 20 degrees are greater than 0.7. The modulation values of the lens are measured at a spatial frequency between 15 to 20 cycles/mm.

Abstract: Provided is a catadioptric lens system implemented in a video see-through apparatus, the catadioptric lens system including a first lens, a second lens, a third lens, and a fourth lens sequentially disposed in a direction of an optical axis from a side of a user's eye toward a side of an image surface, wherein a second surface of the first lens facing the image surface is configured to reflect at least a portion of light from the second lens and a fourth surface of the second lens facing the image surface is configured to re-reflect at least a portion of light reflected from the first lens, wherein the first lens has a positive refractive power, the second lens has a positive refractive power, the third lens has a negative refractive power, and the fourth lens has a positive refractive power, and wherein the first lens is configured to move.

Abstract: An electronic device, including: an infra-red (IR) light source configured to output infrared light; a waveguide; a first optical element on a first area of the waveguide, wherein the first optical element is configured to allow external light to enter the waveguide; a second optical element on a second area of the waveguide, wherein the second optical element is configured to output the external light incident to an outside of the waveguide; a third optical element on a third area of the waveguide, wherein the third area is different from the first area and the second area, and wherein the third optical element is configured to diffract the infrared light; and an image sensor configured to receive the diffracted infrared light

Abstract: A head-mounted display includes: a camera configured to obtain an image by capturing a scene; at least one display configured to display the image obtained by the camera; and a lens comprising a plurality of lens elements arranged between an eye of a user and the at least one display. The lens includes an aperture stop area configured to be at least a portion of an area for facing the eye of the user. The aperture stop area includes a plurality of sub-stop areas corresponding to a plurality of gaze directions by eye rotation, respectively. The modulation values of the lens at sub-fields of 0 degrees of sub-stop areas, from the plurality of sub-stop areas, corresponding to gaze directions of 0, 10, and 20 degrees are greater than 0.7. The modulation values of the lens are measured at a spatial frequency between 15 to 20 cycles/mm.

Abstract: Provided are an electronic device and method for reconstructing an image from a coded image. The electronic device may acquire a coded image, based on light in which a phase is modulated by a first phase mask including noise or a second phase mask not including the noise, and acquire a reconstructed image by inputting the coded image to an artificial intelligence model trained to reconstruct an image. The noise may be an error that occurred according to a process of a phase mask.

Abstract: An augmented reality (AR) device for obtaining depth information of an object in a real world, includes: a gaze tracking sensor configured to obtain a gaze point by tracking a gaze direction of a user's eye; a depth sensor configured to obtain depth information of the object; a memory storing one or more instructions; and at least one processor configured to execute the one or more instructions to: determine a region of interest (ROI) confidence level indicating a degree to which at least one partial region within a field of view (FOV) of the AR device is predicted as an ROI, based on at least one of a moving speed, an acceleration, a fixation time, a fixation number, or a location of the gaze point; determine an ROI based on the ROI confidence level; and set a parameter for controlling an operation of the depth sensor to obtain depth information of the object within the ROI.

Abstract: An electronic device for obtaining a depth map from a coded image obtained using an active phase mask and a method for operating the same are provided. The electronic device according to an embodiment of the present disclosure may generate a first phase mask having a first coded aperture pattern in a first area on the active mask panel based on controlling the electrical driving signal applied to the active mask panel, obtain a coded image based on light transmitted through the first phase mask, wherein the coded image is phase-modulated, and wherein the light transmitted through the first phase mask is received via the image sensor, and obtain a depth map corresponding to the coded image by using an artificial intelligence model trained to extract a depth map from a convolution image.

Abstract: An augmented reality (AR) display device includes a display engine configured to project light of an image, and a waveguide configured to receive and output the projected light. The display engine includes a light source unit, a reflective display panel, and a projection optical system. The projection optical system includes an iris and a projection lens group arranged between the iris and the reflective display panel. The light source unit includes a light source or a light exit end positioned near the iris in a position deviating from an optical axis of the projection optical system, such that an incident angle range of light incident to the display panel does not overlap with a reflection angle range of light reflected from the display panel. The iris includes an effective opening through which light reflected from the display panel passes.

Abstract: Provided is an electronic device for detecting lost portions of a field of vision and distorted portions of a field of vision and storing these in a vision map. The lost portions and distorted portions are identified in cooperation with the user by means of virtual image superposition on a real scene, audible requests to the user, gesture inputs provided by the user and gaze tracking. The electronic device may detect an object and provide visual information to a user when the object is in a lost portion or distorted portion of the field of vision.

Abstract: A device and a method for recommending a custom function in an electronic device to a user is provided. The electronic device obtains a user gesture that repeatedly occur through interaction with the user and determines one or more customized functions to be suggested to the user among a plurality of accessibility functions considering the user gesture. The electronic device may execute a target customized function selected by the user from among the one or more customized functions.

Abstract: An augmented reality (AR) device for obtaining depth information of an object in a real world, includes: a gaze tracking sensor configured to obtain a gaze point by tracking a gaze direction of a user's eye; a depth sensor configured to obtain depth information of the object; a memory storing one or more instructions; and at least one processor configured to execute the one or more instructions to: determine a region of interest (ROI) confidence level indicating a degree to which at least one partial region within a field of view (FOV) of the AR device is predicted as an ROI, based on at least one of a moving speed, an acceleration, a fixation time, a fixation number, or a location of the gaze point; determine an ROI based on the ROI confidence level; and set a parameter for controlling an operation of the depth sensor to obtain depth information of the object within the ROI.

Abstract: A lens includes at least one lens element configured to interface with a user's pupil along an optical-axis direction from a side of the user's pupil to a side of a display surface. The at least one lens element defines an aperture stop that is configured to be at least a portion of an area for facing the user's pupil. The aperture stop defines a plurality of sub-stop areas corresponding to a plurality of gaze directions within an entire viewing angle of the user with respect to the optical-axis direction. An orientation of the plurality of sub-stop areas are based on a human visual system.

Abstract: An electronic device includes a light source configured to output light, a pattern mask configured to change a path of light transmitted through a pattern of the pattern mask, an image sensor configured to receive light that is output from the light source, reflected by an eye, and transmitted through the pattern mask, and at least one processor configured to obtain a coded image that is phase-modulated based on light transmitted through the pattern mask, obtain a feature point of the eye from the coded image, and obtain gaze information of a user based on the feature point.

Abstract: Provided are a projection lens optical system, and a projection device and a wearable device including the projection device. The projection lens optical system is used in a projection device of a wearable device and includes a first lens, a second lens, a third lens, a fourth lens, a fifth lens, and a sixth lens, sequentially arranged from an emission area to an image plane, wherein the first lens has a positive refractive power, the second lens has a negative refractive power, the third lens has a positive refractive power, the fourth lens has a negative refractive power, the fifth lens has a negative refractive power, and the sixth lens has a positive refractive power, wherein the projection lens optical system satisfy the following Conditional Expression: LB/f?0.5.

Abstract: An augmented reality (AR) display device includes a display engine configured to project light of an image, and a waveguide configured to receive and output the projected light. The display engine includes a light source unit, a reflective display panel, and a projection optical system. The projection optical system includes an iris and a projection lens group arranged between the iris and the reflective display panel. The light source unit includes a light source or a light exit end positioned near the iris in a position deviating from an optical axis of the projection optical system, such that an incident angle range of light incident to the display panel does not overlap with a reflection angle range of light reflected from the display panel. The iris includes an effective opening through which light reflected from the display panel passes.

Abstract: Provided is an augmented reality (AR) display device. The AR display device includes an optical engine configured to output light of a virtual image and a light guide plate including a first region that receives the light of the virtual image, a third region that outputs the light of the virtual image, and a second region that propagates the light of the virtual image input to the first region toward the third region, in which a pupil expansion grating is formed in the second region to duplicate the light of the virtual image incident to the first region into a plurality of beamlets, and in the third region, an output grating array is formed in which a plurality of small diffractive grating regions are arranged at intervals equal to or less than a size of a pupil, in which a diameter of each of the plurality of small diffractive grating regions is equal to or less than the size of the pupil.

Abstract: An augmented reality display system includes a first beam path for a foveal inset image on a holographic optical element, a second beam path for a peripheral display image on the holographic optical element, and pupil position tracking logic that generates control signals to set a position of the foveal inset as perceived through the holographic optical element, to determine the peripheral display image, and to control a moveable stage.

Abstract: A waveguide and an augmented reality (AR) device employing the waveguide are disclosed. The waveguide includes a waveguide body, an input-coupling element inputting a light into the waveguide body, a reflective element disposed at one side of the waveguide body and again inputting a light that is not input into the waveguide body or is transmitted through the waveguide body into the waveguide body, and an output-coupling element outputting a light propagating inside the waveguide body to an outside.

Abstract: Provided is an electronic device including an optical engine including a projection lens configured to project light of a virtual image, a waveguide including an input grating on which the light of the virtual image is incident, an actuator configured to adjust a position of the projection lens relative to an optical axis of the projection lens, a light sensor configured to detect light passing through the input grating, a memory configured to store one or more instructions, and a processor configured to execute the one or more instructions to obtain a degree of parallelism of the light detected by the light sensor, obtain, based on the degree of parallelism of the light, a position adjustment value of the projection lens to detect light, and control the actuator to adjust a distance between the projection lens and the waveguide based on the position adjustment value.