Abstract: Embodiments relate to a system for generating simulated eye movements and eye responses related to concussion symptoms for training medical practitioners. The system includes a computer device with a display that displays the pair of simulated eyes. Scenarios are generated and executed, in which simulated eye movements and responses to external stimuli are representative of typical symptoms associated with having a concussion. A user (e.g., medical trainee or medical trainer) provides external inputs e.g., voice commands, stylus movements, etc.) and assess eye movements provided by the scenarios and eye responses to the external inputs.

Abstract: An image processing method according to some embodiments of the present disclosure includes: obtaining rendering durations of images of M frames; determining whether the rendering durations of the images of the M frames match a motion gesture requirement; if yes, controlling a difference ?t between a rendering start timing of the image of each frame and a warp processing start timing of the image of a corresponding frame to be less than or equal to a preset difference ?taim; otherwise, setting a system frame rate to make the rendering duration of the image of each frame match the motion gesture requirement.

Abstract: Head-mountable devices can include an arrangement of components that include a waveguide that is decoupled from the ability of system loads to be transferred into the waveguide. Such decoupling can be achieved by utilizing an elastic bond with low stiffness to bond certain components together. This allows the system to flex and deform without transferring stress to the waveguide. Such decoupling can also be achieved by selectively bonding in regions that have relatively lower displacements between a support structure and the waveguide. These measures can help preserve component alignment while allowing a head-mountable device to be lightweight and small in size.

Abstract: An autostereoscopic three-dimensional display system for surgical robotics has an autostereoscopic three-dimensional display configured to receive and display video from a surgical robotics camera, and a first sensor assembly and a second sensor assembly. A processor is configured to detect and track an eye position or a head position of a user relative to the display based on processing output data of the first sensor assembly, and to detect and track a gaze of the user based on processing output data of the second sensor assembly. The processor further is configured to modify or control an operation of the display system based on the detected gaze of the user. A spatial relationship of the display also can be automatically adjusted in relation to the user based on the detected eye or head position of the user to optimize the user's visualization of three-dimensional images on the display.

Abstract: The present disclosure relates to an eyewear and a control method thereof. The eyewear includes an optic, a camera device and a frame; wherein the optic and the camera device are respectively located on the frame; and the optic is a transparent display screen. The control method of the eyewear includes: detecting a light intensity of ambient light; obtaining a current light intensity of transmitted light generated after the ambient light passes through the optic, based on the light intensity of the ambient light and current light transmittance of the eyewear; adjusting the light transmittance of the optic; starting the camera device to acquire an environment image; performing enhancement processing on the environment image to obtain an enhanced environment image; and controlling the optic to display according to the enhanced environment image.

Abstract: An eye tracking system can include an eye-tracking camera configured to obtain images of the eye at different exposure times or different frame rates. For example, longer exposure images of the eye taken at a longer exposure time can show iris or pupil features, and shorter exposure, glint images can show peaks of glints reflected from the cornea. The shorter exposure glint images may be taken at a higher frame rate (than the longer exposure images) for accurate gaze prediction. The shorter exposure glint images can be analyzed to provide glint locations to subpixel accuracy. The longer exposure images can be analyzed for pupil center or center of rotation. The eye tracking system can predict future gaze direction, which can be used for foveated rendering by a wearable display system.

Abstract: Disclosed herein is a system for facilitating fast and intuitive investigations of security incidents by responding to physical gestures performed by security analysts within a virtual scene. A query triggers an alert for detecting security incidents that occur with respect to computing resources. Following the alert, the security analyst dons a Near-Eye-Display (NED) device and is presented with a virtual scene having control elements representing various data sets and/or data analysis operations relevant to a security incident. The security analyst investigates the security incident by performing hand motions to “grab-and-drag” control elements representing data sets. The security analyst may also perform hand motions to “tap on” control elements that represents a data analysis operation. Responsive to the hand motions, the system performs data analysis operations and displays a result within the virtual scene.

Abstract: A freeform prism-lens group includes: a primary prism; a first auxiliary lens; and a beamsplitter film between the primary prism and the first auxiliary lens and having a predetermined beamsplitting ratio; wherein: the first auxiliary lens has a first optical surface substantially conforming to a neighboring freeform surface of the primary prism; and the first auxiliary lens has a second opposing optical surface distal from the primary prism that is planar, aspheric, or spherical with a curvature radius greater than 100 mm.

Abstract: Optical systems including a partial reflector, a reflective polarizer, and a retarder disposed between the partial reflector and the reflective polarizer are described. The reflective polarizer is curved about two orthogonal axes and includes at least one layer that is substantially optically uniaxial at at least one location. The optical system is adapted to provide an adjustable focus.

Abstract: An apparatus for image viewing and eye tracking in virtual or mixed reality systems that includes two or more display panels (e.g., a top display panel and a bottom display panel) for each eye with left and right prisms located between the display panels and the user's eyes. S- and P-polarizing filters are located between the display panels and first and second surfaces of the prism. For each eye, the polarized light from the top and bottom display panels is redirected by a respective prism to form exit pupils for top and bottom images at a plane at or near the eye. At least one eye-tracking camera is located in front of each prism and between the top and bottom display panels so that the cameras have a direct or near-direct view of the user's eyes through the eyepieces.

Abstract: (Object) It is possible to make a display area less perceivable to a user. (Means of Achieving the Object) An HUD device (i.e., the HUD device of the practical example 1) is a display device for displaying in a display area a virtual image of at least a part of a sign that moves. The display device includes a displaying system configured to form an image of the sign that moves with light in a region including an image region (i.e., a predetermined region), and to irradiate a front windshield (i.e., transparent/reflective member) with light that forms at least a part of the image, the part of which is in the image region, such that the virtual image of the at least a part of the image is displayed in the display area. The displaying system includes an FPGA 600 (i.e., control device) that is capable of controlling a characteristic of the image in accordance with position of the virtual image relative to the display area.

Abstract: Some implementations of the disclosure describe a display system for optically fusing light, comprising: multiple image sources configured to emit light corresponding to multiple respective image portions; a bent reflector comprising multiple segments, each segment configured to receive the light emitted by a corresponding image source, and reflect the light to a back reflector that has a bend region including a first of the segments attached to a second of the segments at an angle; and the back reflector, the back reflector configured to: modify a polarization or an angular profile of the light reflected by each segment; and after modifying the polarization or the angular profile, reflect the light back to the segments such that the light passes through the segments, wherein the angle is configured such that after the light reflected by the back reflector passes through the segments, the image portions are tiled or fused.

Abstract: A head mounted display (HMD) includes an electronic display configured to display a virtual scene to a user, an optics block, an eye tracking system, and a varifocal actuation that mechanically changes a distance between the optics block and the electronic display. The varifocal actuation block is configured to change a location of an image plane of the HMD and includes a motor, a power screw coupled to the actuating motor configured to turn responsive to actuation of the motor, and a nut sled on the power screw that is coupled to the electronic display. The nut sled is configured to move back and forth along a length of the power screw responsive to the power screw being turned by the motor that results in movement of the electronic display relative to the optics block.

Abstract: Techniques for conducting a support session and determine suitable instructions for resolving a certain technical mal-function in a device/equipment of a user. Imagery data associated the technical mal-function is received from a user's device and used for determining at least one improperly setup property associated with the mal-function in the mal-functioning device/equipment based on a comparison of the received imagery data with reference data. Instructions comprising augmented imagery for resolving the mal-function can be then generated, or fetched form a database, based on the determined at least one improperly setup property. A new database record can be generated comprising the augmented imagery data for use in future support sessions associated with the mal-function.

Abstract: A method and a system for warping a rendered frame is disclosed. On a host device of a split-rendering system, the method includes generating the rendered frame based on head tracking information of a user. The method also includes identifying a region of interest (ROI) of the rendered frame. The method also includes generating metadata for a warping operation from the ROI. The method further include transmitting the rendered frame and the metadata for a warping operation of the rendered frame. On a client device of the split-rendering system, the method includes transmitting head tracking information of a user by a client device. The method also includes receiving the rendered frame and metadata. The method further includes warping the rendered frame using the metadata and display pose information. The host device and the client device may be combined into an all-in-one head mounted display.

Abstract: A device and a method is provided. The method includes identifying a sight direction of the device based on the movement information. The method also includes identifying an angle formed between a first straight line that starts from a predetermined position on the display and corresponds to the identified sight direction, and a second straight line that starts from the predetermined position and corresponds to a direction according to a movement trajectory obtained from multiple frames. The method further includes determining whether to start an adjusting mode for providing a frame corresponding to the identified sight direction based on the identified angle and a threshold value determined with respect to a field of view of the device. The method additionally includes identifying a first frame and a second frame among the multiple frames. The method also includes displaying the first frame and then display the second frame.

Abstract: Device and method for visual technical support of manual order-picking processes through device with at least one (mobile) unit having optical sensing detection device, optical display device, data processing device and wireless data interface to data-processing system having product management software and connection device for active units. Each unit cyclically receives navigation information to produce directions on optical display device. Data for specific navigation results from comparing data from respective optical sensing detection device with stored reference/model data and position of current target of route-optimized list of goods transmitted to unit.

Abstract: A motion signal generation apparatus includes a detector to detect one or more image features of images generated by a data processing apparatus; and a generator, responsive to an image location of the one or more detected image features and to a current simulated orientation of a head mountable display (HMD), to generate a motion signal to simulate head motion by a wearer of the HMD.

Abstract: A research and development support system includes: one or more databases that store a plurality of types of data and information related to research and development, and an administrative system that accesses the one or more databases to perform information processing. The one or more databases stores research and development-related information as information related to research and development conducted by a researcher, device-related information as information related to devices used for research and development, and usage history information as information on history of the device being used by the researcher. The administrative system is configured to generate and outputting information that supports research and development on the basis of the usage history information, the device-related information, and the research and development-related information.

Abstract: Systems and methods for tracking the position of a head-mounted display (HMD). The HMD may include a support structure that carries a forward facing camera and a plurality of optical flow sensor integrated circuits (ICs). The forward camera captures image sensor data in a forward camera field of view (FOV) at a first frame rate, and each of the plurality of sensor ICs captures image sensor data in a respective plurality of sensor IC FOVs at a second frame rate. The sensor IC FOVs may collectively cover at least a substantial portion of the forward camera FOV. A processor may receive the image sensor data from the camera and the plurality of sensor ICs. The processor may process the received image sensor data and/or other sensor data (e.g., IMU data) to track a position of the head-mounted display based on the processing of the received sensor data.

Abstract: A head-mounted display apparatus includes an image display unit configured to display an image, a sound output unit configured to output a sound, a mounting state determination unit configured to determine a mounting state of the head-mounted display apparatus, and an image sound output control unit configured to turn ON/OFF display, and turn ON/OFF an output of a sound, based on the mounting state. The image sound output control unit is configured to turn ON display of an image and an output of a sound when the mounting state is the first state, turn OFF display of an image and turn ON an output of a sound when the mounting state is not the first state and is the second state, and turn OFF display of an image and an output of a sound when the mounting state is not the first state and is not the second state.

Abstract: A dual mode virtual reality (VR) and augmented reality (AR) headset includes a head-attachment, a main frame coupled to the head-attachment, and a pivot frame. The pivot frame includes a holder configured to accommodate an electronic device having a display screen, and a reflective screen configured to reflect content shown on the display screen. The pivot frame pivotally coupled to the main frame. In the first pivot frame position, the reflective screen at least partially intersects a field of view (?) of a user wearing the headset, and in the second pivot frame position the display screen at least partially intersects the ? when the electronic device is accommodated in the holder.

Abstract: Disclosed are an image synthesis method and apparatus, and an electronic device and a computer readable storage medium. The image synthesis method comprises: obtaining a virtual object; obtaining a video collected by an image sensor; identifying a hand in the video to obtain hand information; obtaining image rendering information corresponding to the virtual object and the hand information; and synthesizing and rendering the virtual object and the hand according to the image rendering information to generate a synthesized image. By means of the technical solution, the technical problems in the prior art that the virtual object cannot move along with the hand, and the mode that the virtual object is mounted on the hand is not flexible are solved.

Abstract: In one implementation, a method for generating computer-generated reality content (CGR) content in order to invoke a target state of a user based on a user model is performed at an electronic device. The method includes: while presenting reference CGR content via the one or more displays, obtaining a request from a user to invoke a target state for the user; generating, based on a user model associated with the user and the reference CGR content, modified CGR content to invoke the target state for the user, wherein the user model provides projected reactions to CGR content; and presenting, via the one or more displays, the modified CGR content. In some implementations, obtaining the request from the user to invoke the target state for the user includes determining whether the user provided informed consent to store user information in the user model associated with the user of the device.

Abstract: A device configured to reduce movement artefacts in magnetic resonance (MR) imaging can include a head mount configured to hold a head of a patient on a patient bed of a magnetic resonance (MR) imaging system; a display; a supporting arm mechanically attached between mount and the display; an eye tracker configured to register one or more eye movements of the patient held in the head mount; and a controller configured to control content provided to the display.

Abstract: A see-through free-form head-mounted display including a wedge-shaped prism-lens having free-form surfaces and low F-number is provided.

Abstract: Provided are stereoscopic eyeglasses capable of reducing visual fatigue in binocular stereoscopic display by a simple configuration. In stereoscopic eyeglasses, in order to expand a tolerance of match between vergence and accommodation enabling comfortable stereovision in eyeglasses-using stereoscopic display, wide-focus lenses ranging in focal length are incorporated so as to overlap optical filters in light transmission directions, and accordingly, visual fatigue to be caused by vergence-accommodation conflict during stereoscopic image observation is reduced.

Abstract: A processor causes a display provided on a Head Mounted Display to display a stereoscopic image to which binocular parallax is applied, the stereoscopic image being an image of a virtual space captured by a virtual camera, and acquire orientation information on an orientation of the Head Mounted Display. When, in the virtual space, a predetermined positional relationship is established between a virtual object that exists in the virtual space and a virtual line that passes through the virtual camera, the virtual line having a direction according to the orientation information, the processor causes to move, based on a change in relative position between the virtual line and the virtual object, a display range of display information to be displayed in the virtual space, the display range being a part of the display information and displayed in the display region provided in the virtual space.

Abstract: An interactive head-mounted display includes a U-shaped headband that rests atop the crown of a user's head. At each end of the headband is an earpiece and a housing containing various electronics for operating and interacting with a designated wireless phone. Pivotally attached to an end of the headband is an arcuate, translucent shield that is suspended in front of the wearer's eyes. When wearing a connected device, a user can display on the shield any graphics generated by the phone, initiate a telephone call, transmit a text message, or initiate any other task that can be performed on the wireless phone, but without using the hands.

Abstract: The present disclosure relates to a near-eye display and a method for adjusting the brightness of a near-eye display. The near-eye display including a first display screen for displaying one of a left eye image and a right eye image, a second display screen for displaying the other of the left eye image and the right eye image, a detector configured to detect a first detected value indicating brightness of the first display screen and a second detected value indicating brightness of the second display screen, and a controller configured to adjust brightness of at least one of the first display screen and the second display screen based on the first detected value and the second detected value.

Abstract: A display device (e.g., in a contact lens) is mounted on the eye. The eye mounted display contains multiple sub-displays, each of which projects light to different retinal positions within a portion of the retina corresponding to the sub-display. Additionally, a “locally uniform resolution” mapping may be used to model the variable resolution of the eye. Accordingly, various aspects of the display device may be based on the locally uniform resolution mapping. For example, the light emitted from the sub-displays may be based on the locally uniform resolution mapping.

Abstract: This disclosure relates to a head-mounted display including a wearable component, a display device and at least one sensor. The display device is movably disposed on the wearable component. The at least one sensor is connected to the display device. A position of the display device is related to a sensing result of the at least one sensor.

Abstract: An electronic device is disclosed. The electronic device includes a support unit, a display unit, and a slide unit coupling the support unit and the display unit to be relatively movable with respect to each other, wherein the slide unit includes a base and a slide member which relatively moves forward and backward, wherein the base includes a first outer guide portion and a first inner guide portion and the slide member includes a second outer guide portion and a second inner guide portion, having a dual guide structure. An electronic device according to the present invention may be associated with an artificial intelligence module, robot, augmented reality (AR) device, virtual reality (VR) device, and device related to 5G services.

Abstract: Interferometric systems and methods for measuring rotational movement are described. In one implementation, an interferometer for measuring rotational movement includes a housing and a light source within the housing configured to project coherent light toward a non-coded surface of an object. The interferometer further includes at least one optical element configured to modify the projected coherent light in a manner accounting for a rotation of the object. The interferometer also includes at least one sensor within the housing including at least one light detector configured to detect reflections of the modified projected coherent light from the opposing non-coded surface as the object rotates relative to the housing. The interferometer further includes at least one processor configured to receive input from the at least one sensor and determine an amount of rotation of the object around the at least one rotational axis.

Abstract: An electronic display assembly includes a display element and a corrective element coupled to the display element. The display element has a first plurality of sub-pixels of a first type and a second plurality of sub-pixels of a second type. Two adjacent sub-pixels of the first plurality of sub-pixel are separated by a sub-pixel distance. The corrective element has a plurality of features configured to diffuse light emitted by the first plurality of sub-pixels such that an apparent distance between the two adjacent sub-pixels of the first type, viewed at a viewing distance away from the electronic display assembly, is less than the sub-pixel distance.

Abstract: Various aspects described herein generally relate to visualizing a vehicle history using extended reality. In some implementations, an extended reality device may obtain image data corresponding to one or more vehicle parts that are visible in a field of view of the extended reality device. The extended reality device may identify one or more anchor points in a coordinate space corresponding to the field of view of the extended reality device and obtain a vehicle history report based on an identifier associated with the vehicle. The extended reality device may obtain digital content based on one or more records contained in the vehicle history report and an expected visual appearance of the one or more parts of the vehicle. The extended reality device may render the digital content on a display of the extended reality device. Various other aspects are provided.

Abstract: The invention is about a human identification method based on the perception of low-intensity light. In its path towards the retina, light suffers optical losses. For any illuminated ganglion receptive field, the number of detected photons divided by the number of photons incident on the eye is called a, and is different from field to field for the same subject, and for geometrically similar fields in different subjects. The identification is based on a a-map. The user is asked to respond positively/negatively on the perception of light pulses illuminating various receptive fields chosen to have either high-? or low-?. The choice is random, hence an impostor is forced to respond randomly to the device's interrogations. The illumination of receptive fields can be done serially or in parallel, leading quickly to false positive and false negative identification probabilities at the level of 10?10 and 10?4, respectively.

Abstract: Systems, devices, media, and methods are presented for using a handheld device such as a ring to manipulate a virtual object being displayed by a wearable device such as eyewear. The path of the virtual object in motion is substantially linked, in time and space, to the course traveled by a hand holding the handheld device. The methods in some implementations include presenting the virtual object on a display at a first location relative to a three-dimensional coordinate system, collecting motion data from an inertial measurement unit on the handheld device, displaying the virtual object at a second location along a path based on the motion data. In some implementations the eyewear includes a projector located and configured to project the display onto a lens assembly.

Abstract: The type of virtual object to be presented to each player is determined based on player attribute information prescribed for each player.

Abstract: A depth sculpturing system comprises an eyewear device that includes a frame, a temple connected to a lateral side of the frame, and a depth-capturing camera. The depth sculpturing system further includes a user input device. Execution of programming by a processor configures the depth sculpturing system to perform functions to track, via the user input device, motion of a two-dimensional input selection from an initial touch point to a final touch point. The depth sculpturing system determines a rotation matrix between an initial ray and a final ray that project to the initial touch point and the final touch point, correspondingly. The depth sculpturing system generates a depth sculptured image by applying the rotation matrix to vertices of an initial depth image. The depth sculpturing system presents, via an image display, the depth sculptured image.

Abstract: A system evaluates a point of gaze of a user on an object and includes at least one eye tracker camera and at least one positioning camera. The eye tracker camera and the positioning camera are configured to be arranged in fixed positions relative to each other. At least one light source is configured to provide conical reflection from at least one of a user's eyes. At least one computer and at least one object is provided. The geometrical data of the object is stored in a storage device accessible to the computer. Wherein the computer is configured to determine: a gaze line of said user relative to a 3D coordinate system, the position of said at least one object relative to said 3D coordinate system, and a gaze point calculated as the intersection of said gaze line with the surface of said object in said 3D coordinate system.

Abstract: The orientation and/or position estimation system includes: a movable operating unit configured to be held by a user and having an image capturing section; and a stereoscopic image providing unit including a display portion configured to display a stereoscopic image, a contact portion configured to come into contact with a part of a face of a user who is viewing the stereoscopic image, and a detection subject portion configured to be captured by the image capturing section. A detection subject portion image in the image captured by the image capturing section is detected and the position and the orientation of the movable image capturing unit are estimated on the basis of the detection subject portion image. On the basis of a result of the estimation, the stereoscopic image is generated and displayed.

Abstract: Techniques for improving the visualization of content with a mixed reality (MR) device are described. One techniques includes monitoring a gaze of a user of a MR device through one or more displays of the MR device. A convergence distance of the gaze of the user is determined based on the monitoring. A selection between a first projection mode and a second projection to display content on the one or more displays is made based on whether the convergence distance exceeds a threshold distance from the user. Content is displayed on the one or more displays, based on the selection.

Abstract: A binaural sound reproduction system, and methods of using the binaural sound reproduction system to dynamically re-center a frame of reference for a virtual sound source, are described. The binaural sound reproduction system may include a reference device, e.g., a mobile device, having a reference sensor to provide reference orientation data corresponding to a direction of the reference device, and a head-mounted device, e.g., headphones, having a device sensor to provide device orientation data corresponding to a direction of the head-mounted device. The system may use the reference orientation data to determine whether the head-mounted device is being used in a static or dynamic use case, and may adjust an audio output to render the virtual sound source in an adjusted source direction based on the determined use case. Other embodiments are also described and claimed.

Abstract: An HMD includes a display section and a lens. The display section includes organic light emitting diodes (OLEDs). The lens enlarges an image displayed on the display section and presents the enlarged image to a user. A PC generates an image of a virtual space. The PC generates an image to be displayed on the display section by correcting an image obtained by shifting the generated virtual space image according to distortion caused by the lens.

Abstract: The present disclosure includes a display element configured to emit imaging light, a main circuit board and the like being a circuit board configured to process a video signal, a board holder being a circuit board holder configured to fix the main circuit board and the like, and a harness coupled to the main circuit board, and the board holder fixes an end portion of the main circuit board in a state where the end portion protrudes to an optical path upstream of the display element. As a result, a space for avoiding interference is provided on the optical path upstream of the display element, namely, on a back surface side of the display element, while suppressing an increase in size of the device toward a lateral side and the like.

Abstract: A live video distribution system has an on-the-spot system including a video signal generating means for generating video signals of a plurality of systems having different display ranges and a communicating means, and a plurality of terminal apparatuses each including a video display means, a display range setting signal generating means, and a communicating means. The systems of the video signals and the terminal apparatuses are associated with each other, the on-the-spot system has a function to determine the display ranges of the video signals of the respective systems on the basis of display range setting signals generated by the terminal apparatuses associated with the respective systems, and a function to send the video signals. Each of the terminal apparatuses can send the display range setting signal, can receive the video signal of the system associated with the terminal apparatus itself, and can display a video image based on the video signal.

Abstract: An information processing device includes: an acquisition unit (110, 140) configured to acquire a captured image including a subject and three-dimensional subject position information indicating a three-dimensional position of the subject; and a content configuration information generation unit (150) configured to generate content configuration information including the captured image, the three-dimensional subject position information, and virtual space association information which is information used for an interaction in which the subject in the captured image displayed in the virtual space is involved and is information for associating the subject in the captured image with the three-dimensional subject position information.

Abstract: A light guide module and an augmented reality (AR) apparatus are disclosed. The AR apparatus includes a display module and the light guide module. The light guide module includes a first light guide plate and a second light guide plate. The first light guide plate has a light receiving area for receiving optical input light with a predetermined incident angle and a light outputting area for outputting optical input light. The second light guide plate is disposed on the first light guide plate, and has dichroic surfaces for selectively transmitting or reflecting the optical input light.

Abstract: A head-mounted display device includes a display assembly, a rotating assembly, and a fixed assembly. The rotating assembly is connected to the display assembly and includes a motor holder, a motor and a first connecting element. The motor is disposed on the motor holder. The first connecting element has a first accommodating portion and a second accommodating portion, wherein the first connecting element receives a part of the motor and the second connecting element receives a part of the motor holder. The fixed assembly is connected to the rotating assembly. The rotating assembly rotates the display assembly relative to the fixed assembly.