Abstract: The systems and methods described can include approaches to calibrate head-mounted displays for improved viewing experiences. Some methods include receiving data of a first target image associated with an undeformed state of a first eyepiece of a head-mounted display device; receiving data of a first captured image associated with deformed state of the first eyepiece of the head-mounted display device; determining a first transformation that maps the first captured image to the image; and applying the first transformation to a subsequent image for viewing on the first eyepiece of the head-mounted display device.

Abstract: An information processing apparatus (2000) displays an operation image (20) on a display screen (50) associated with a head mounted display (100). First, the information processing apparatus (2000) acquires work information. The work information includes information for determining a work target which is a target of work performed by a user of the head mounted display (100). The information processing apparatus (2000) determines a work target satisfying a provision condition by using the work information. The information processing apparatus (2000) displays the operation image (20) for selecting the determined work target on the display screen (50) in an operable manner. The information processing apparatus (2000) detects an input operation on the operation image (20).

Abstract: The present invention provides an electronic device, an external input device and a method for connecting the electronic device and the external input device. An electronic device according to various embodiments comprises: a camera module; a communication module, a display, a memory; and a processor electrically connected to the camera module, a communication module, a display and memory, wherein the processor displays, on the display, images comprising a left-eye image and a right-eye image, determines whether or not a connectable external input device is present if an event for the connection with the external input device occurs with respect to the images, displays, on at least one part of the display, external images, obtained by means of the camera module, if a connectable first external input device is present, and can perform connection with the first external input device. Moreover, other embodiments are possible.

Abstract: Methods and apparatus provide for controlling an information processing apparatus that is connected to a video display apparatus worn on a head of a user, the method comprising: displaying a planar video on the video display apparatus in a display mode that changes a shape of the planar video as a function of a change in position and/or orientation of the video display apparatus.

Abstract: The present disclosure relates to an operating system for a machine of a food industry. The operating system includes eyeglasses for a user of the operating system and a transceiver for exchanging data between the operating system and the machine. The eyeglasses include a display system configured to display a control element and information of a human machine interface (HMI). Furthermore, the operating system includes at least one input module which receives user input from the user with respect to the control element. The operating system additionally includes a processing module. The processing module converts the received user input into an input signal for controlling at least one of the machine or the HMI.

Abstract: To prevent visually induced motion sickness that occurs during viewing of three-dimensional content using a display. A video display system and a video display program for a display include a computer for displaying content video on a display unit of the display as a virtual reality space, wherein the computer displays, on the display unit, three-dimensional video data in which a content video region and a fixed background image region surrounding the content video region are set.

Abstract: Compensating for latency in a streaming virtual reality environment is disclosed. A computing device receives from a head-mounted display device (HMDD) having a field of view (FOV), first pose data that identifies an orientation of the HMDD worn by a participant viewing a virtual world via the HMDD. The computing device renders, based at least in part on the first pose data and a first oversized FOV that is greater than the FOV, oversized imagery that depicts a portion of the virtual world within the FOV of the HMDD and a portion of the virtual world outside of the FOV of the HMDD. The computing device communicates the oversized imagery to the HMDD.

Abstract: The disclosed projector device may include (1) a first monochromatic emitter array having a plurality of emitters of a first color disposed in a two-dimensional configuration and (2) a second monochromatic emitter array having a plurality of emitters of a second color disposed in a two-dimensional configuration. The first and second monochromatic emitter arrays may be configured to emit images of the first and second colors into a waveguide configuration, and the first color may be different than the second color. Associated display systems and methods are also provided.

Abstract: An article of headgear to be worn on the head of a user includes a first portion to encompass at least a portion of the head of the user and a visor extending forward from the first portion. The visor includes a laterally extending opening therein to receive a personal communication device including a camera such that a lens of the camera is positioned below the lower surface of the visor.

Abstract: During a period when a user's dominant eye is the right eye, an image generating device (200) generates an image for the right eye (272) at a standard resolution and generates a display image for the left eye (270) at a lower resolution. During a period when the dominant eye is the left eye, the image generating device (200) generates an image for the left eye (278) at the standard resolution and generates a display image for the right eye (280) at a lower resolution. In a head mounted display (100), the images with the lower resolution are enlarged into display images (274) and (276), and the image for the left eye and the image for the right eye are displayed.

Abstract: One embodiment provides a method, including: producing, using one or more optical engines of an augmented reality display, an augmented reality scene; identifying, based upon a location of a gaze of a user, at least one object the user is viewing; and adjusting, based upon the identification of the at least one object, a drive strength of one or more pixels associated with at least one virtual object on the augmented reality display. Other aspects are described and claimed.

Abstract: A visibility improvement method using gaze tracking includes detecting a gaze of a user using a camera; determining a focus object at which the user gazes from among at least one object viewed through a display unit of an electronic device; and displaying, on the display unit, an image with high visibility that corresponds to the focus object and has higher visibility than the focus object.

Abstract: A method for controlling an aircraft includes determining photographing information related to a photographing object, the photographing information indicating an occupying scope of the photographing object in an image to be captured. The method also includes controlling the aircraft to fly to a photographing location based on the photographing information.

Abstract: A head-mountable device can include a speaker unit that provides structural support to its own components and electrical connections between other components. The arrangement of conductive strips within a back plate of a speaker unit can provide the structural support needed by the components of a speaker while allowing components on opposing sides of the speaker unit to be operably connected to each other. By providing both functions with the conductive strips of a back plate, the total space required is minimized so that the head-securement element (e.g., band) of the head-mountable device maintains a thin profile.

Abstract: Improved text rendering by microshifting the display in a head mounted display is provided. Systems, methods and computer-readable devices provide a head mounted display. The head mounted display includes a display unit; a rotational actuator coupled to the display unit; and a rotation processor having a rotation sensor coupled to the display unit wherein as the head mounted display is rotated, the rotation processor is operable to signal the rotational actuator to rotate the display unit to counter the rotation of the head mounted display.

Abstract: A device may receive, from a user device, a request to activate an extended reality experience. The device may obtain access network information relating to a set of access networks available to the user device and user device information relating to the user device. Based on the access network information and the user device information, the device may determine an access network to use for the extended reality experience. The device may determine, based on the access network, a first portion of the extended reality experience to execute locally or a second portion of the extended reality experience to execute remotely.

Abstract: A near-eye display system includes a display panel to present image frames to the eyes of a user for viewing. The system also includes a beam steering assembly facing the display panel that is configurable to displace a light beam incident on the beam steering assembly, thereby laterally shifting light relative to an optical path of the light beam incident on the beam steering assembly. A method of operation of the near-eye display system includes configuring the beam steering assembly in a first configuration state so that the beam steering assembly displaces a light beam incident on the beam steering assembly, such that the displaced light beam is laterally shifted relative to an optical path of the light beam.

Abstract: Methods for using a head mounted display (HMD) can detect slippage of the HMD through the use of a comparison between, for example, a calibrated glint reference point and a glint reference point calculated during monitoring of glints during usage of the HMD.

Abstract: Devices/techniques coupleable to patient sensors, ambient environment, and external sensory input. Devices/techniques receive/maintain information; correlate received/maintained information with measures associated with detecting/monitoring, predict, prevent/treat, and train/reward patient self-care, for dry eyes. Devices/techniques detect/monitor, predict, and prevent/treat dry eyes in real time; and train/reward patients to conduct self-care for dry eyes. The devices/techniques provide adjusted sensory inputs to prevent/treat dry eyes, or to train/reward patients to conduct self-care for dry eyes. The devices/techniques cooperate with other devices, including devices worn by nearby patients, to receive/maintain information about the ambient environment, or communicate with medical personnel. The devices/techniques adjust parameters they use, in response to received information that differs from predictions, to provide superior behavior, and communicate with other devices and medical personnel.

Abstract: Systems and methods for interacting with virtual objects in a three-dimensional space using a wearable system are disclosed. The wearable system can be programmed to permit user interaction with interactable objects in a field of regard (FOR) of a user. The FOR includes a portion of the environment around the user that is capable of being perceived by the user via the AR system. The system can determine a group of interactable objects in the FOR of the user and determine a pose of the user. The system can update, based on a change in the pose or a field of view (FOV) of the user, a subgroup of the interactable objects that are located in the FOV of the user and receive a selection of a target interactable object from the subgroup of interactable objects. The system can initiate a selection event on the target interactable object.

Abstract: A method for transferring an image to a subpixel array may include generating a set of subframes in which each subframe contains a fraction of the range of intensities of the image. The bit-depth of the subframes may be reduced from the bit-depth of the image. The computer-implemented method may include (1) receiving image data for an image including a set of intensities in one or more channels, (2) processing the image data into subframe data for a plurality of subframes, each subframe including a fractional range of intensities that are a subset of the set of intensities of the image, and (3) temporally multiplexing the plurality of subframes generated from the subframe data to reconstitute the image in a viewing region using an optical system having a light deviator that laterally shifts light from an emissive array. Various other apparatus, systems, and methods are also disclosed.

Abstract: An assembly includes a head mount such as smart glasses wearable on a head of a user. An imager is on the head mount and is configured to generate images of objects. A processor accesses the images responsive to a query and presents images of objects on a display of the head mount to assist the user in identifying, for example, where a lost object was last seen.

Abstract: A virtual wave creation system comprises an eyewear device that includes a frame, a temple connected to a lateral side of the frame, and a depth-capturing camera. Execution of programming by a processor configures the virtual wave creation system to generate, for each of multiple initial depth images, a respective wave image by applying a transformation function that is responsive to a selected input parameter to the initial three-dimensional coordinates. The virtual wave creation system creates a warped wave video including a sequence of the generated warped wave images. The virtual wave creation system presents, via an image display, the warped wave video.

Abstract: A head mounted display includes a first display element and a second display element that emit light to a second portion. A first portion includes a first opening and a second opening separating from the first opening. The second portion includes a first optical element portion facing the first opening in a first direction and a second optical element portion facing the second opening in the first direction. Each of the first optical element portion and the second optical element portion of the second portion includes a reflection portion reflecting light emitted from the first display element or the second display element and a light-transmittance adjustment portion controlling a transmittance of external light travelling from the second portion toward the first portion on the basis of a signal that is output from a light-transmittance control circuit. The reflection portion is arranged between the light-transmittance adjustment portion and the first portion.

Abstract: Provided are an eyeglass-mounted image display device capable of adjusting the interval between, height of, and elevation/depression angle of viewers detachably attached to eyeglasses, and an image display system using the eyeglass-mounted image display device. The eyeglass-mounted image display device includes: viewers 7 displaying an image from an endoscope serving as an image output apparatus; and eyeglasses 1 to which the viewers 7 are detachably attached via an attaching member 8. The viewers 7 are disposed in front of lenses 3 of the eyeglasses 1, and the interval between, height of, and elevation/depression angle of the viewers 7 are adjustable with the attaching member 8.

Abstract: An imaging unit captures an image of a visual field. A detector detects a position of an eyeball and a sight line of an occupant. A visual point identifier identifies a position of a visual point of the occupant in the visual field, the eye position and the sight line direction. A measuring unit measures a position and a distance of an object included in the image of the visual field. An image generator generates display images based on the eye position and the position and the distance of the object. The display images are displayed on a virtual plane, fused on a fusion plane and displayed as a three-dimensional display on the visual field. The display images are generated to display the three-dimensional image at a given magnification ratio calculated by reducing a geometric display magnification ratio as the distance from the occupant increases.

Abstract: A conferencing system for conferencing between multiple local conferees within a first conference space and at least a first remote conferee located remotely from the first conference space includes an emissive surface located within the first conference space for generating at least first and second video representations of the remote conferee and at least a first processor for driving the emissive surface to simultaneously present at least the first and second video representations on the emissive surface. The first video representation shows the remote conferee from a first perspective and the second video representation shows the remote conferee from a second, different perspective. The first video representation is observable from within a first viewing zone and not within a second viewing zone within the conference space, and the second video representation is observable from within the second viewing zone and not within the first viewing zone.

Abstract: A light projection apparatus is provided comprising: a source of light; a switchable grating on a first substrate; and a diffractive optical element. Light is diffracted at least once by the switchable grating and is diffracted at least once by the DOE.

Abstract: The present invention provides for a mobile process-interaction device for interacting with a process at a processing location, and a related method of interaction, the device having an input module for accepting data produced by the process, an output module for providing user-information, and wherein the process-interaction device comprises a mobile wearable electronic interaction device arranged for communication by way of a human machine interface at the processing location.

Abstract: In an exemplary process for determining a position of an object in a computer-generated reality environment using an eye gaze, a user uses their eyes to interact with user interface objects displayed on an electronic device. A first direction of gaze is determined for a first eye of a user detected via the one or more cameras, and a second direction of gaze is determined for a second eye of the user detected via the one or more cameras. A convergence point of the first and second directions of gaze is determined, and a distance between a position of the user and a position of an object in the computer-generated reality environment is determined based on the convergence point. A task is performed based on the determined distance between the position of the user and the position of the object in the computer-generated reality environment.

Abstract: A display system comprising a steerable display having a monocular field of view of at least 1 degree, positioned within a scannable field of view of at least 20 degrees, the steerable display positioned for a user. In one embodiment, the steerable display is positioned for the user's fovea.

Abstract: A document processing apparatus includes an operation reception unit and a processing execution unit. The operation reception unit receives an operation for inputting an instruction to a document processing application from a user. The processing execution unit executes, when the operation reception unit receives a single operation, display switching processing for switching, every time the single operation is received, between display and non-display of a button that is assigned an instruction to the document processing application, the button being displayed on a display screen of the document processing application.

Abstract: In one embodiment, a method includes segmenting a layout of a physical space surrounding a user into physical segments; generating, based on the physical segments, virtual paths for a virtual environment through which the user can navigate by traveling the physical segments; identifying, based on a current location of the user with respect to the physical space, a portion of the physical segments for which to enable an intrusion detection feature; detecting a physical object in the portion of the physical segments that corresponds to a particular virtual path of the virtual paths; and in response to the detecting, displaying a representation of the physical object in the particular virtual path.

Abstract: A display device includes a light emitting layer, a light adjusting layer and a display layer. The light emitting layer includes a plurality of light emitting units. The light adjusting layer is disposed to be corresponding to the light emitting layer. The display layer is disposed on the light adjusting layer. The light adjusting layer includes at least one light adjusting structure corresponding to at least three of the plurality of light emitting units.

Abstract: Head-mounted display visor assembly. A head mounted display visor assembly includes a molded world-facing visor coupled to a separately molded user-facing bathtub. The visor includes an IR opaque and visual light opaque portion coupled to a separately manufactured IR permissive portion. The visor also includes an IR opaque portion. The bathtub includes an IR permissive, but visual light opaque portion and a visual light permissive portion.

Abstract: An embodiment of the invention may include a method, computer program product and system for collaborative video capturing via multiple smart contact lenses. An embodiment may include identifying a participant, of multiple participants, currently capturing video via a smart contact lens of the identified participant. In response to a predicted next eye closing event for the identified participant, an embodiment may include transferring current video capture to a smart contact lens of another participant, of the multiple participants, during the predicted next eye closing event for the identified participant.

Abstract: In one example, an apparatus may include a frame that includes an optical component configured for use with a near-eye display that is part of a head-worn display system. The frame magnetically attaches to the head-worn display system, and when the frame is attached to the head-worn display system, the frame may align the optical component for use with the near-eye display. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: Disclosed is an AR device and method for controlling the same. According to an embodiment of the present disclosure, the method for controlling the AR device computes a distance between the AR device and a capturing device connected with the AR device via wired/wireless communication and receives an angle of the capturing device and computes an angle of the AR device. The method determines information related to a distance to a real object captured by the capturing device, computes an augmented position of a virtual object corresponding to the real object, and displays the virtual object in the augmented position on a display. The AR device of the present disclosure may be associated with an artificial intelligence module, a robot, a virtual reality (VR) device, a device related to a 5G service, and the like.

Abstract: A method of tracking an eye of a user on a wearable heads-up display (WHUD) worn on the head of the user includes generating infrared light over an eye tracking period, scanning the infrared light over the eye, and detecting reflections of the infrared light from the eye. A motion parameter that is sensitive to motion of the WHUD is measured. Eye tracking is performed in a first mode that is based on glint for values of the motion parameter that fall within a first range of motion parameter values for which an error in measurement of glint position. Eye tracking is performed in a second mode that is based on glint-pupil vector for values of the motion parameter that fall within a second range of motion parameter values for which an error in measurement of glint position exceeds the error threshold. A head-mounted apparatus with eye tracking is disclosed.

Abstract: Embodiments of systems and methods for adaptive backchannel synchronization for virtual, augmented, or mixed reality (xR) applications in edge cloud architectures are described. In some embodiments, an Information Handling System (IHS) may include a memory having program instructions stored thereon that, upon execution by a processor, cause the IHS to: receive, from a first Head-Mounted Device (HMD), first Simultaneous Localization and Mapping (SLAM) data comprising a first plurality of packets; receive, from the HMD, an indication of a synchronized time; and at least one of: in response to a determination that the first SLAM data is advanced with respect to the synchronized time by a threshold value, drop one or more of the first plurality of packets; or in response to a determination that the first SLAM data is lagged with respect to the synchronized time by the threshold value, transform lagged SLAM data into current SLAM data.

Abstract: An HMD is an HMD mounted at a head of a user, and includes a display unit located at a left eye side and a right eye side of the user, and displaying a first image that is overlapped on an outside scene, a first detector detecting an inclination of the head, a first adjustment unit adjusting, based on a detection result of the first detector, a display region of the first image, and a second display control unit causing, based on an adjustment result of the first adjustment unit, the first image to be displayed in the display region.

Abstract: A calibration system is described that includes a calibration target having one or more calibration objects, a head mounted display (HMD), and a rendering engine configured to render, based on an estimated pose of the HMD, respective virtual calibration objects in a viewing area of the HMD at respective locations corresponding to the one or more calibration objects visible in the viewing area, wherein the HMD is configured to output the virtual calibration targets. The calibration system further includes an image capture system configured to capture image data comprising images of the viewing area of the HMD, and a calibration engine configured to compute, from the image data, difference data comprising respective distances between the one or more calibration objects and the respective, corresponding virtual calibration objects.

Abstract: A display system is disclosed. The display system includes a display, an eye-tracking sensor, and a processor communicatively coupled to the display and the eye-tracking sensor. The computing device receives data from the eye-tracking sensor, determines, based on the eye-tracking data, whether a user's eye is looking at a display in the display system, and based on whether the eye is determined to be looking at the display, controls a power consumption of the display.

Abstract: A method for adjusting a virtual reality image including: acquiring first three-dimensional coordinates and a first attitude orientation of a positioning component (101); converting the first three-dimensional coordinates into second three-dimensional coordinates, and converting the first attitude orientation into a second attitude orientation (102); converting the second three-dimensional coordinates into target three-dimensional coordinates in a virtual space, and converting the second attitude orientation into a target attitude orientation in the virtual space (103); determining a projection plane in the virtual space (104); perspectively projecting a virtual object in the virtual space onto an imaging area in the projection plane to generate a two-dimensional image (105); and displaying the two-dimensional image on a display screen of a display module (106). Also disclosed is a device for adjusting a virtual reality image.

Abstract: An eye is illuminated with light propagating substantially normal to a pupil plane of the eye. Illuminating the eye includes illuminating an ellipsoidal combiner that has a foci at a center of rotation of the eye. The light propagates through the pupil to become incident on the retina.

Abstract: An augmented reality or virtual reality (AR/VR) device pairs with a companion device to augment input interfaces associated with an AR/VR application at the AR/VR device. In implementations, an AR/VR device determines a portion of a markup file that corresponds to an AR/VR scene of a plurality of AR/VR scenes in an AR/VR environment, and communicates the portion of the markup file to the companion device to cause the companion device to configure a companion user interface associated with initiating an action as part of the AR/VR scene. In response to receiving user input via the companion user interface, the companion device communicates the action to the AR/VR device to initiate the action. The AR/VR device receives input data from the companion device, and initiates the action for the AR/VR scene.

Abstract: An ophthalmic examination method using VR according to an embodiment of the present disclosure includes: providing an ophthalmic examination setting interface inputting a user setting for the ophthalmic examination; selecting and progressing a first ophthalmic examination in accordance with the ophthalmic examination setting interface; controlling a head mounted display to output a VR image for the first ophthalmic examination; acquiring examination data according to the VR image from the head mounted display; and outputting an ophthalmic examination progress image for an examiner for the first ophthalmic examination. As described above, since a head mounted display device for an eye examination of the present disclosure can perform various ophthalmic examinations digitally, there is an effect that it is possible to accurately and quickly determine ophthalmic examinations.

Abstract: A head-mounted extended reality (XR) display device includes a rigid mounting element coupled to a frame. The XR display device further includes right-side and left-side visible light cameras coupled to the rigid mounting element, right-side and left-side near-infrared (NIR) cameras coupled to the rigid mounting element, and an NIR light-emitting diode (LED) configured to illuminate a region within a field of view of the NIR cameras. The visible light cameras are configured to capture stereoscopic visible light images within a field of view of the user when the user is wearing the frame, and the NIR cameras are configured to capture stereoscopic NIR images within the field of view of the user when the user is wearing the frame.

Abstract: The display device including a first diffraction optical element group, and a second diffraction optical element group, wherein the first diffraction optical element group is constituted by laminating a first diffraction optical element having a first interference pattern corresponding to a wavelength band of one or two of three colors of red, green, and blue of the image light, and a second diffraction optical element having a second interference pattern corresponding to a wavelength band of remaining colors of the three colors, and the second diffraction optical element group is constituted by laminating a third diffraction optical element having a third interference pattern corresponding to a wavelength band of one or two of three colors of red, green, and blue of the image light, and a fourth diffraction optical element having a fourth interference pattern corresponding to a wavelength band of remaining colors of the three colors.

Abstract: A waveguide is provided for conveying image light. The waveguide includes an input port for receiving a first beam of image light carrying an image in a wavelength band. A first diffraction grating of the waveguide includes a plurality of volume Bragg gratings (VBGs) configured to expand the first beam along a first axis and to redirect the first beam towards a second diffraction grating of the waveguide. The second diffraction grating includes a plurality of VBGs configured to receive the first beam from the first diffraction grating and to out-couple different portions of the first wavelength band of the first beam along a second axis, thereby expanding the first beam along the second axis for observation of the image by a user.