Abstract: A display apparatus including first display or projector for displaying first images for first eye; second display or projector for displaying second images for second eye; first portion and second portion arranged to face first and second eyes; means for tracking poses of first and second eyes relative to first and second optical axes, respectively; and processor. Processor or external processor is configured to: obtain given pose of given eye relative to given optical axis; generate information pertaining to given visual artifact that is formed over given image at image plane when given image is displayed; determine artifact-superposing portion of given image; and process given image based on generated information and artifact-superposing portion, to generate given artifact-compensated image. Processor displays given artifact-compensated image via given display or projector.

Abstract: A computer implemented method for updating a point map on a system having first and second communicatively coupled hardware components includes the first component performing a first process on the point map in a first state to generate a first change. The method also includes the second component performing a second process on the point map in the first state to generate a second change. The method further includes the second component applying the second change to the point map in the first state to generate a first updated point map in a second state. Moreover, the method includes the first component sending the first change to the second component. In addition, the method includes the second component applying the first change to the first updated point map in the second state to generate a second updated point map in a third state.

Abstract: A viewing apparatus includes a housing, an optical mechanism including a first lens barrel and a second lens barrel, and an adjustment mechanism including a driving assembly and a sliding assembly. The driving assembly includes a mounting base, a toggle wheel, and a rotating shaft inserted through the toggle wheel and rotatably mounted at the mounting base. The sliding assembly includes a first sliding component connected to the first lens barrel, and a second sliding component connected to the second lens barrel. In response to a rotation of the toggle wheel, the rotating shaft is driven to have a rotation. The rotation of the rotating shaft enables a relative movement between the first sliding component and the second sliding component, and adjusts a distance between a distance between the first lens barrel and the second lens barrel.

Abstract: Provided are an image processing apparatus and an image processing method that make it possible to reduce a storage capacity necessary for an omnidirectional image. Of a plurality of images generated by perspectively projecting an omnidirectional image mapped to a 3D model onto a plurality of two-dimensional planes, an image corresponding to a viewing direction of a user and an omnidirectional image reduced in resolution are accepted, and a drawing block generates a display image on the basis of at least one of the accepted image and the accepted omnidirectional image reduced in resolution. A viewing direction acquisition block acquires viewing direction information related with the viewing direction of the user, and a sending block sends a viewing direction log recorded on the basis of the acquired viewing direction information.

Abstract: A Head-Mounted Display, HMD, apparatus for recording a video and playing back the video to a viewer in a Virtual Reality, VR, environment. A geographical area is recorded with an omnidirectional video recording camera by dividing the geographical area into a plurality of area portions and recording in separate video sections, each of the area portions while moving the camera in different directions. Time points in each video section are associated with virtual locations of the viewer. At a time point providing the viewer with a choice of directions to proceed, the system receives the viewer's choice and presents to the viewer, a video section corresponding to the virtual location of the viewer and desired direction of movement. The viewer's choice may be indicated by detecting a direction of the viewer's field of view or by receiving from the viewer, a response to a banner notification.

Abstract: Systems and methods for employing virtual environmental augmentation in clinical care environments to enhance a clinician's in-the-moment knowledge, leverage past experiences of the clinician and others, and improve the quality of patient care are provided. Such virtual environmental augmentation may align with prior-established, evidence-based clinical processes and enhance the clinician's in-the-moment knowledge by extracting relevant data from one or more clinical sources and presenting a virtual representation of at least a portion of the extracted data (or a summary, exemplification, or interpretation thereof) in the clinician's field-of-view while the clinician is present in a clinical care environment and is utilizing an environmental augmentation device. Such environmental augmentation additionally may facilitate real-time documentation enabling more complete clinical records and ultimately improving the quality of patient care.

Abstract: A head-mounted display includes a display device configured to display an image, a diopter adjustment device configured to adjust a diopter, and a correction processing circuit serving as an image correction device configured to correct a display image in accordance with a degree of diopter adjustment. In the adjustments made on a left side and a right side, respectively, after diopter adjustment, the display image is corrected in accordance with the degree of diopter adjustment.

Abstract: A display apparatus includes a first substrate including an active area, a circuit area extending outwardly from the active area, and a cell seal area extending outwardly from the circuit area, a second substrate covering the first substrate, a sealing portion between the first substrate and the second substrate, the sealing portion covering at least a portion of the circuit area, a circuit line in the circuit area of the first substrate and electrically connected to a device in the active area of the first substrate, at least a portion of the sealing portion being on the circuit line, and a pixel definition layer between the sealing portion and the circuit line.

Abstract: An adjusting apparatus and a head-mounted display device, which includes: a runner, an interpupillary distance adjusting component and an object distance adjusting component; where, the interpupillary distance adjusting component includes: a first screw, and an interpupillary distance adjusting actuator engaged with the first screw; the object distance adjusting component includes: a second screw, and an object distance adjusting actuator engaged with the second screw; a through hole is formed on a center of the runner, the through hole, and the first screw and the second screw are coaxial; when the runner moves onto the first screw, the runner is connected with the first screw through a connection structure, and the runner drives the first screw to rotate together; when the runner moves onto the second screw, the runner is connected with the second screw through a connection structure, and the runner drives the second screw to rotate together.

Abstract: The measurement result display apparatus of the present invention includes: a storage unit for storing shape information and a predetermined measurement result with respect to an object to be measured; a three-dimensional sensor for detecting shape information of an object existing in a three-dimensional space; a display unit configured so that the object detected by the three-dimensional sensor can be visually recognized and configured to be capable of displaying predetermined information; and a display control unit for displaying the predetermined measurement result of a target object on the display unit so as to be visually recognized together with the object, using the object to be measured whose shape information is detected by the three-dimensional sensor as the target object.

Abstract: An augmented reality (AR) system for field training. The AR system may comprise: user platform sensors for obtaining user platform data associated with geolocation/orientation/movement of a user platform; a weapon simulator configured for haptic feedback and comprising weapon sensors for obtaining weapon data associated with muzzle orientation and trigger actuation of the weapon simulator, a head-worn display device for depicting AR graphic elements associated with training simulation data; target platform sensors for obtaining target platform data associated with geolocation/orientation/movement of a target platform; a microcontroller for packetizing the target platform data for wireless transmission; a computer system for generating the training simulation data based on the user platform data, weapon data, and target platform data; and transceivers for providing wireless communication between the computer system and microcontroller.

Abstract: A digital video transmitter includes a video converter configured to convert a digital video signal obtained from an imaging device to a serial differential signal, a filter electrically coupled to the video converter through a differential signal transmission line and configured to filter an interference introduced by an electronic adjuster or a motor, and an image transmitter electrically coupled to the filter and configured to receive and transmit the serial differential signal.

Abstract: The majority of applications for head mounted display (HMD) users, irrespective of whether they are for short-term, long-term, low vision, augmented reality, etc. yield a conflicting set of tradeoffs between user comfort and minimal fatigue and strain during use, ease of attachment, minimizing intrusiveness and aesthetics which must be concurrently balanced with and are often in conflict with providing an optical vision system that provides the user with a wide field of view and high image resolution whilst also offering a large exit pupil for eye placement with sufficient eye clearance. Further, individual users' needs vary as do their needs with the general task at-hand, visual focus, and various regions-of-interest within their field of view. To address these issues, it is necessary to provide a high performance optical system, eyepiece design, and system features which overcome these limitations.

Abstract: A virtual shockwave creation system comprises an eyewear device that includes a frame, a temple connected to a lateral side of the frame, and a depth-capturing camera. Execution of programming by a processor configures the virtual shockwave creation system to generate, for each of multiple initial depth images, a respective shockwave image by applying a transformation function to the initial three-dimensional coordinates. The virtual shockwave creation system creates a warped shockwave video including a sequence of the generated warped shockwave images. The virtual shockwave creation system presents, via an image display, the warped shockwave video.

Abstract: There is a need for more effective and efficient data modeling and/or data visualization solutions. This need can be addressed by, for example, solutions for performing data modeling and/or data visualization in an effective and efficient manner. In one example, solutions for generating a data model with dynamic relational awareness are disclosed. In another example, solutions for processing data retrieval queries using data models with dynamic relational awareness are disclosed. In yet another example, solutions for generating data visualizations using data models with dynamic relational awareness are disclosed. In a further example, solutions for integrating external data objects into data models with dynamic relational awareness are disclosed.

Abstract: An electronic device is provided. The electronic device is configured to display a 3-dimension (3D) image using the display, to receive a scroll input on the 3D image, to determine a scroll angular speed based at least on a scroll speed corresponding to the scroll input and a depth of the 3D image, to control the display to display the 3D image based on a first method based on the determined scroll angular speed being less than a specified angular speed, and control the display to display the 3D image based on a second method different from the first method based on the determined scroll angular speed being greater than or equal to the specified angular speed.

Abstract: Enhanced passthrough images are generated and displayed. A current visibility condition of an environment is determined. Based on the current visibility condition, a first camera or a second camera, which detect light spanning different ranges of illuminance, is selected to generate a passthrough image of the environment. The selected camera is then caused to generate the passthrough image. Additionally, a third camera, which is structured to detect long wave infrared radiation, is caused to generate a thermal image of the environment. Parallax correction is performed by aligning coordinates of the thermal image with corresponding coordinates identified within the passthrough image. Subsequently, the parallax-corrected thermal image is overlaid onto the passthrough image to generate a composite passthrough image, which is then displayed.

Abstract: A gaze initiated interaction technique for facilitating interaction between wearers of head-mountable devices. Methods are shown which allow users to interact with each other following an event of interlocking gaze. Methods are also shown which allows the operator of a personal point-of-interest beacon to control and limit interaction from the public thus ensuring a greater degree of privacy. Methods are also introduced which allow a mode of interaction to be determined by a remote service after mutual authorization of each interacting user. This disclosure also introduces a system of a head-mountable device which comprises a directional beacon transceiver system using beams in the infrared light spectrum enabling the detection of a gaze interlock event.

Abstract: A method includes projecting an object in a digital space. The object is transitioned to a final viewable peripheral location in the digital space. The object is removed from the digital space to define an unviewable path segment. The object is introduced to an initial viewable peripheral location in the digital space substantially opposite the final viewable peripheral location in the digital space. The initial viewable peripheral location to the final viewable peripheral location defines a viewable path segment. The object is returned to the center of the digital space. The operations are performed in an aggregate object path including the viewable path segment and the unviewable path segment. The object has a pre-configured object velocity and a pre-configured cycle time period in the aggregate object path.

Abstract: A method for compositing display data at a remote device to form an image for display involves the remote device receiving (S62) elements of the image, where the image includes display data forming a background layer, display elements forming a foreground layers and an overlay data layer. The remote device receives (S63) sensor information indicating one or more of a position of an eye of a viewer, a direction of focus of the eye of the viewer, and/or a position of a display. It then determines (S64) movement of a line of sight between the eye of the viewer and the display, determines an estimate of a future position of the line of sight at a future time based on the determined movement of the line of sight, and determines (S65) an adjustment to be made to the image based on the future position of the line of sight.

Abstract: A method of providing immersive reality content includes determining a field of view intersection between a first field of view from a first device and a second field of view from a second device, generating a first immersive reality content based on the field of view intersection and providing the first immersive reality content. An apparatus for providing immersive reality content includes a processor and at least one memory coupled to the processor, the processor being configured to determine a field of view intersection between a first field of view from a first device and a second field of view from a second device, generate a first immersive reality content based on the field of view intersection and provide the first immersive reality content. A computer-readable storage medium, computer program and a non-transitory article of manufacture are also described.

Abstract: Eyewear having a camera capturing images, and an image processor configured to process the images and display the processed image in both controlled and uncontrolled regions on the display. In an example, the image processor applies a vignette gradient to soften edges of the displayed image in the uncontrolled regions, which compensates for any discoloration in the uncontrolled regions. The uncontrolled regions may be located above and below the controlled region.

Abstract: A disclosed apparatus may include a line source configured to produce a line of light and a scanning device configured to scan the line of light across a scanning field in a scanning direction. The scanning field may include a receiving portion configured to receive an eye. The apparatus may also include a reflector positioned within the scanning field. During a primary period of a scan, the line of light may scan the receiving portion in a primary direction. During a secondary period of the scan, the reflector may reflect the line of light such that a reflection of the line of light scans the receiving portion in a secondary direction. The apparatus may also include a photodetector positioned to receive (1) an initial reflection during the primary period, and (2) a subsequent reflection during the secondary period. Various other methods, apparatuses, and computer-readable media are also disclosed.

Abstract: An electronic device providing information through a virtual environment is disclosed. The device includes: a display; and an information providing module functionally connected with the display, wherein the information providing module displays an object corresponding to an external electronic device for the electronic device through the display, obtains information to be output through the external electronic device, and provides contents corresponding to the information in relation to a region, on which the object is displayed.

Abstract: An adjustable frame assembly for augmented reality eyewear. The frame assembly includes a face portion for supporting at least one waveguide that creates an eye box, a support rest for supporting the face portion on a user, and a coupling for adjusting the position of the face portion relative to the support rest. This enables movement of the waveguide eye box relative to the support rest to position the eye box in front of the wearer's eyes.

Abstract: A display device includes a display device body. The display device body includes a first lens barrel and a second lens barrel. A first lens is disposed at a first end of the first lens barrel, and a second lens is disposed at a first end of the second lens barrel. A first distance sensor and a second distance sensor are further disposed on the display device body. The second distance sensor is configured to measure a distance between a right eyeball and the second lens. Two distance sensors are disposed on the display device body.

Abstract: A display device includes: a display panel configured to display a first image having a first resolution; and a display panel driving circuit configured to drive the display panel, wherein the display panel driving circuit is configured to receive image data corresponding to a second image having a second resolution that is higher than the first resolution, to receive gaze data indicating a user's gaze, to select partial image data which reflects the user's gaze from the image data based on the gaze data, and to drive the display panel to display the first image based on the partial image data.

Abstract: Provided are a computer program product, system, and method for generating in a gaze tracking device augmented reality representations for objects in a user line-of-sight. A determination is made of user coordinates of a user position and coordinates of an axis of a line-of-sight of the user from the gaze tracking device. Requested object information is received indicating objects along the axis of the line-of-sight at different distances from the user position, including a first object in the line-of-sight that is visible to the user at a first distance from the user position and at least one additional object. Each of the at least one additional object is at a further distance from the user position than the first distance. Descriptions of the objects are rendered to the user in a view of the gaze tracking device along the axis of the line-of-sight.

Abstract: An extended reality (XR) device and a method for controlling the same are disclosed. The XR device is applicable to 5G communication technology, robot technology, autonomous driving technology, and Artificial Intelligence (AI) technology. The XR device includes a communication module configured to communicate with a Head-Mounted Display (HMD) that is worn by a user to provide the user with Virtual Reality (VR) content, a camera configured to receive an image of a first space including the user, and a processor configured to transmit VR content to the HMD through the communication module. The processor recognizes a position of the user and positions of a plurality of real-world objects within an image of the first space. When the user moves closer to at least one of the recognized objects by a predetermined distance or less, the processor warns the user of possibility of collision with the at least one recognized object.

Abstract: Head-worn computers with eye-imaging systems include a camera system positioned in a head-worn computer, wherein the camera system is further positioned to capture eye-image light that originates as reflections from a user's eye, wherein the camera system is further positioned to capture eye-image light as a reflection from a partially reflective surface that is positioned in front of an image display in the head-worn computer, wherein image light, from the image display, is transmitted through the partially reflective surface. A processor is adapted to cause the camera system to capture the eye-image light. The processor is further adapted to cause a comparison of the captured eye-image light with a pre-stored eye image of a known user of the head-worn computer. In the event the comparison confirms the identity of the known user, the user is granted permission to view content to be presented in a display of the head-worn computer.

Abstract: Technologies are described for providing a projected augmented reality system with pose tracking for directing manual processes. A projected augmented reality system includes a video projector, configured to project a dynamically-changing image onto a surface within a work area of an operator, a sensor, and a computer. The computer includes a memory including instructions that when executed cause the computer to obtain three-dimensional pose data using the sensor, determine an output graphical element based on a sequence of three-dimensional pose data over time, and on a current production state, and send an output image based on the output graphical element to the video projector for projection onto the surface.

Abstract: Aspects of the present invention relate to methods and systems for imaging, recognizing, and tracking of a user's eye that is wearing a HWC. Aspects further relate to the processing of images reflected from the user's eye and controlling displayed content in accordance therewith.

Abstract: A technique is provided for controlling an object avatar. The technique includes receiving one or more utterance from one or more user. Further, one or more object avatar is determined from object avatar database based on context. Based on one or more utterances, one or more parameters is extracted to control the object avatar. Further, one or more outcome is determine based on the one or more parameters extracted. Subsequently, the object avatar is controlled when the one or more outcomes correspond to a one or more permissible outcomes.

Abstract: A head-mounted display apparatus is disclosed. The head-mounted display apparatus includes an optical member having a front surface, a rear surface, and a plurality of side surfaces, a display unit adapted to emit a display image toward one of the side surfaces of the optical member, and a reflective structure disposed inside the optical member to reflect the display image emitted from the display unit and to allow the reflected display image to pass and propagate through the rear surface. The image reflected by the reflective structure and delivered to user's eyes is the same irrespective of the coverage of the user's field of view.

Abstract: An input system and an electronic apparatus with novel structures are provided. An electronic apparatus whose setting can be changed even when both hands are full is provided. An input system and an electronic apparatus including an imaging device having a function of taking an image of eyes and a detection device having a function of detecting a change of the shape of the eyes from data obtained by the imaging device are provided. Settings are changed in accordance with the change of the shape of the eyes. The settings are changed by a different method from a manual method and the change of the settings can be reflected in display.

Abstract: A relay apparatus for coupling a head-mounted display apparatus to a first external device includes a substrate, a first cable including a plurality of first thin wires, the first cable extending in a first direction and a second cable extending in a direction opposite the first direction. In the relay apparatus, the substrate includes a first surface, a second surface on a backside of the first surface, a first coupling portion to which the plurality of first thin wires are coupled, and a second coupling portion to which the second cable is coupled, the first coupling portion includes a first connector that is located on the first surface and to which a subset of the plurality of first thin wires is coupled, and a second connector that is located on the second surface and to which another subset of the plurality of first thin wires is coupled.

Abstract: A display apparatus for an emergency service member for displaying information content of different information types from a guidance system is proposed. The display apparatus comprises a display, carriable by the emergency service member, having a plurality of visually distinguishable segments, with each of which at least one of the information types is associated, each segment being configured to visually output a current information content of the information type associated with the segment. Further, the display apparatus comprises an actuating unit, couplable to the guidance system, for actuating the display.

Abstract: A virtual image display device includes a video image element that displays an image, and a light-guiding member that guides video image light from the video image element by reflection and transmission at a plurality of light-guiding surfaces. Among the plurality of light-guiding surfaces, with respect to an incident-side light-guiding surface and an emission-side light-guiding surface that are adjacent to each other, and an opposing light-guiding surface that faces the incident-side light-guiding surface and the emission-side light-guiding surface, a thickness from the incident-side light-guiding surface to the opposing light-guiding surface is caused to be smaller than a thickness from the emission-side light-guiding surface to the opposing light-guiding surface.

Abstract: A simulation system includes a processor including hardware. The processor performs: a virtual space setting process of setting a virtual space in which a plurality of objects are arranged; a virtual camera control process of controlling a virtual camera corresponding to a point-of-view of a user wearing a head mounted display; and a display process of generating an image as viewed from the virtual camera in the virtual space as a display image on the head mounted display. In the virtual space setting process, the processor arranges at least one information display object in a line-of-sight direction of the user, and in the display process, when it is determined that a given change condition is satisfied by a change in the point-of-view of the user, the processor performs a change process of a display mode of the information display object.

Abstract: A method for placing content in an augmented reality system. A notification is received regarding availability of new content to display in the augmented reality system. A confirmation is received that indicates acceptance of the new content. Three dimensional information that describes the physical environment is provided, to an external computing device, to enable the external computing device to be used for selecting an assigned location in the physical environment for the new content. Location information is received, from the external computing device, that indicates the assigned location. A display location on a display system of the augmented reality system at which to display the new content so that the new content appears to the user to be displayed as an overlay at the assigned location in the physical environment is determined, based on the location information. The new content is displayed on the display system at the display location.

Abstract: The present invention concerns virtual reality viewers for use with touchscreen enabled mobile devices. The virtual reality viewer comprises: a housing configured to receive a mobile electronic device within interior of the housing; and an input mechanism that is accessible from an exterior of the housing and that is moveable within the interior between a first position and an extended position, wherein a surface of the input mechanism is configured to contact the touch-screen of the mobile electronic device when in the position. The disclosed systems and methods facilitate receiving user inputs on the exterior of the housing and providing the user inputs to the touchscreen within the housing using the electro-mechanical input mechanism. Accordingly, the viewer can be used with a variety of smartphones without requiring switches or a wireless/cable connection between the input device and the smartphone.

Abstract: Examples are disclosed that relate to computing devices, head-mounted display devices and methods for remote collaborations. In one example a computing device receives a first spatial mapping of a first environment and a second spatial mapping of a second environment. The computing device determines that a first volumetric space in the first environment and a second volumetric space in the second environment each satisfy at least one collaboration criterion. Based on this determination, an indication of the first volumetric space is displayed by a first display device in the first environment, and an indication of the second volumetric space is displayed by a second display device in the second environment.

Abstract: A system includes an eyewear device, and a neckband device. The neckband device includes a power source and a processor communicatively coupled to the eyewear device. The system includes a bracelet device, which includes at least one sensor configured to determine a position signal in response to movement of the user's hand, the bracelet device communicatively coupled to the processor. A display device is configured to present content to a user, and is also configured to couple to and be removable from the eyewear device.

Abstract: The present invention provides a sound outputting apparatus, a head-mounted display, a sound outputting method, and a program each of which enables realistic feeling of an augmented reality space or a mixed reality space to be enhanced. An AR space video image generating section (116) generates an image, of an augmented reality space or a mixed reality space to be displayed on a display section of a head-mounted display, including a part which an image of a virtual reality space occupies, and a part which an image of a real space obtained through photographing by a camera photographing a circumference of a user occupies. A synthetic sound generating section (108) synthesizes a sound of the virtual reality space, and a sound of a real space of the circumference of the user with each other to generate a synthetic sound. A synthetic sound transmitting section (110) outputs the synthetic sound sounded from a speaker arranged in the vicinity of an ear of the user.

Abstract: Methods, apparatus, systems and articles of manufacture are disclosed to develop driving simulations. An example apparatus includes a vehicle configuration engine to retrieve first tier environment parameters associated with a simulation type, and generate second tier environment parameters associated with the simulation type, a simulation modifier (SM) source engine to identify a source of SMs, and distinguish respective ones of the source of SMs that are compatible with the simulation type and the second tier environment parameters, and a development environment configuration engine to improve simulation design efficiency by associating simulation events with only the respective ones of the SMs that are compatible with the simulation type.

Abstract: An eye projection device is provide comprising an eye projection system configured for projecting a light beam to propagate along a propagation path to an eye.

Abstract: This assistance method is intended for assisting an operator in performing a task on a product (12). To that end, the method comprises a step of displaying, superimposed on a view of a scene including a monitored part of the product (12) on which a subtask of the task has to be performed, at least one assistance image (100, 136) intended to assist the operator in performing this subtask. Said at least one assistance image (100, 136) includes at least one highlighting image (100, 102) highlighting the monitored part.

Abstract: The present disclosure is directed to systems and methods of eye tracking for use in various applications, such as virtual reality or augmented reality applications that include head-mounted display devices. An eye tracking subsystem may be provided that includes a plurality of assemblies that each include a light source, such as an LED, a light detector, such as a silicon photodiode, and a polarizer that is configured to prevent light reflected via specular reflection from reaching the light detectors so that only scattered light is detected by the light detectors. Machine learning or other techniques may be used to track or otherwise determine a user's gaze direction, which may be used by one or more components of an HMD device to improve its functionality in various ways.

Abstract: An electronic device is disclosed. The electronic device of the present disclosure includes a main body wearable on the head of a user, a display coupled to the main body to be detachable to the main body, and a controller configured to generate images to implement the images on the display while the display is mounted on the main body. An electronic device according to the present invention may be associated with an artificial intelligence module, robot, augmented reality (AR) device, virtual reality (VR) device, and device related to 5G services.

Abstract: A load control system may include control-target devices for controlling an amount of power provided to an electrical load. The control-target devices may be capable of controlling the amount of power provided to the electrical load based on control instructions. The control-target devices and/or the control-instructions may be determined based on a gesture performed by a user. The user may wear a wearable control device capable of measuring movements performed by the user and transmit digital messages that may be used to control an electrical load. The wearable control device may identify gestures performed by the user for controlling a control-target device and/or provide control instructions to the control-target device based on the identified gestures. A gesture may be associated with a scene that includes a configuration of one or more control devices in a load control system.