Abstract: A head mounted display apparatus includes a display, a focus adjuster and a controller. The display generates a display image. The focus adjuster is disposed between a target zone and the display, and is configured to adjust a position of a focus plan of the display image according to a control signal. The controller generates the control signal according to vision depth information.

Abstract: A method for controlling movement of a computer display cursor based on a point-of-aim of a pointing device within an interaction region includes projecting an image of a computer display to create the interaction region. At least one calibration point having a predetermined relation to the interaction region is established. A pointing line is directed to substantially pass through the calibration point while measuring a position of and an orientation of the pointing device. The pointing line has a predetermined relationship to the pointing device. Movement of the cursor is controlled within the interaction region using measurements of the position of and the orientation of the pointing device.

Abstract: A system for displaying medical data is provided having a source providing image data, a monitor presenting the image data, a plurality of medical devices generating signals each indicative of a medical parameter, and a display for presenting at least one signal correlated with a view vector of the display.

Abstract: An apparatus configured, based on a first virtual space in which visual imagery is presented to a first user and a second, different, virtual space in which visual imagery is presented to a second user, the first and second virtual spaces based on respective virtual reality content that comprises visual imagery and wherein a representation of the first user, viewable by the second user, is provided in the second virtual space and based on a communication initiation input from the second user; to provide for communication and presentation in the second virtual space, at a virtual location based on a location of the second representation of the first user, of a context-volume comprising a sub-volume of the first virtual space at least partly surrounding the first user to enable the second user to seethe first virtual space currently experienced by the first user.

Abstract: A depth camera assembly (DCA) for depth sensing of a local area. The DCA includes a polarized light generator, an imaging device, and a controller. The polarized light generator modulates one or more optical beams emitted from an illumination source to generate modulated light, and projects the modulated light into the local area as polarized light having a first polarization. The imaging device receives light from the local area, the received light including ambient light and a portion of the polarized light reflected from the local area. The imaging device reduces an intensity of the received light having polarization different from a second polarization to generate filtered light substantially composed of light of the second polarization, and detects the portion of the polarized light having the second polarization using the filtered light. The controller determines depth information for the local area based on the detected portion of the polarized light.

Abstract: A wearable device for augmented media content experiences can be formed with a mountable physical structure that has removably mountable positions and component devices that are removably mounted through the removably mountable positions. The component devices can be specifically selected based on a specific type of content consumption environment in which the wearable device is to operate. The mountable physical structure may be subject to a device washing process to which the component devices are not subject to, after the wearable device including the mountable physical structure and the component devices is used by a viewer in a content consumption session in the specific type of content consumption environment, so long as the component devices are subsequently removed from the mountable physical structure.

Abstract: One or more cameras capture objects at a higher resolution than the human eye can perceive. Objects are segmented from the background of the image and scaled to human perceptible size. The scaled-up objects are superimposed over the unscaled background. This is presented to a user via an augmented reality display whereby the process selectively amplifies the size of the objects' spatially registered retinal projection while maintaining a natural (unmodified) view in the remainder of the visual field.

Abstract: Exemplary embodiments of the present disclosure are directed towards an integrated smart helmet system, comprising: a control unit-PCB 201 is wirelessly connected to a computing device 303 over network 305, computing device 303 is configured to enable a user to use different functionalities without having to remove helmet 102 and access the computing device 303 and the control unit-PCB 201 is configured to detect crashes while wearing the helmet 102 by the user and notify crash detected information to computing device 303 over network 305, buttons 213a-213d are positioned at the rear or side of helmet 102 and control unit-PCB 201 is electrically coupled to buttons 213a-213d, buttons 213a-213d are configured to initiate prompts to direct the user to put away the computing device 303 while driving and disable certain dangerous functions.

Abstract: A method comprising determining a set of position parameters for an inertial measurement unit (IMU) on a headset worn by a user. The set of position parameters includes at least a first yaw measurement and a first roll measurement. The set describes a pointing vector. The method further comprises calculating a drift correction component that describes a rate of correction. The drift correction component is based at least in part on the set of position parameters. The method further comprises applying the drift correction component to one or more subsequent yaw measurements for the IMU. The drift correction component forces an estimated nominal position vector to the pointing vector at the rate of correction.

Abstract: A projecting apparatus is provided, and includes a frame, a light source module, at least one collimator lens, at least one adhesive, and a microelectromechanical systems (MEMS) module. The frame includes a first frame portion and a second frame portion. The first frame portion has a carrier and a carrying bridge having an end connected to the carrier. The frame has a processing slot that uses the carrying bridge as a bottom thereof, and the carrying bridge has at least one thru-hole that is in spatial communication with the processing slot. The second frame portion is connected to the carrier and another end of the carrying bridge of the first frame portion. The at least one adhesive corresponds in position to the at least one thru-hole, and connects the at least one collimator lens onto the carrying bridge. The MEMS module is disposed on the second frame portion.

Abstract: An augmented reality apparatus for use in a hazardous area comprises a display unit for providing information within a user's field of view. The augmented reality apparatus also comprises a controller configured to control the display. The controller is configured modify the mode of operation of the display unit in dependence of location information indicating that the augmented reality apparatus is in the hazardous area.

Abstract: Apparatuses, methods, systems, and program products are disclosed for adjustable bone conduction speaker for head mounted display. An apparatus includes a sliding member couplable to a head mounted display (“HMD”) unit and comprising at least one bone conduction speaker, the sliding member adjustable along a first axis to position the bone conduction speaker along the first axis. An apparatus includes a protrusion member coupled to the sliding member and housing the at least one bone conduction speaker, the protrusion member adjustable along a second axis, substantially perpendicular to the first axis, to position the bone conduction speaker along the second axis.

Abstract: A method can include displaying a first front view of 360° content based on a first user position configured based on a head position of a user and a body position of the user, the 360° content being displayed based on user position information in a 360° space; in response to determining that the user position information indicates that the head position has changed to a changed head positon while the body position remains unchanged, displaying a second front view of the 360° content according to the changed head position, the second front view being different than the first front view; and in response to determining that the user position information indicates that the head position has changed to the changed head position and the body position has changed to a changed body position, continuing to display the first front view according to the changed head position and the changed body position.

Abstract: A headset can include at least one display; virtual reality circuitry operatively coupled to the at least one display; and a display frame that includes a nosepiece coupling and a nosepiece received in part by the nosepiece coupling, where the nosepiece includes a ball, an extension, a carrier and nose pads coupled to the carrier, where the carrier is rotatable via the ball and translatable via the extension.

Abstract: A periphery monitoring device includes: an acquisition unit that acquires capture images which are captured by an imaging unit in time series when a vehicle is moving, the imaging unit being provided in the vehicle and capable of imaging surroundings of the vehicle; and a restoration processing unit that, in a case where dirt is present in a latest capture image among the capture images, inputs the capture images into a first learned model and generates a first restoration image as a restoration image obtained by restoring a region concealed with the dirt in the latest capture image, the first learned model being a result obtained by machine learning a relationship between a first learning image in which learning dirt is not present and first learning dirt images each of which is made by causing the learning dirt to be present in the first learning image.

Abstract: The present disclosure proposes an information processing device, an information processing method and a program, which are capable of, while virtual reality content is displayed, informing a user of positional relationship between the user and a boundary region of a space in which the user can act in the real space. The information processing device comprising: an obtaining unit that obtains body information of a user; and an output control unit that, while virtual reality content is displayed by a display unit, causes a sign indicating positional relationship between the user and a boundary region of a second real space in which the user can act in a first real space in which the user is located, the boundary region having been determined on the basis of the body information of the user, to be displayed with the sign superimposed on the content.

Abstract: Aspects of the present disclosure relate to controlling virtual reality (VR) content displayed on a VR head mounted display (HMD). Communication can be established between a computer system, a VR HMD, and a mobile device. A user input configured to control VR content displayed on a display of the VR HMD can be received on the mobile device. The VR content displayed on the VR HMD can then be controlled based on the user input received on the mobile device.

Abstract: A display device includes a display operable to generate a real image and an optical system including: a plurality of optical channel bundles, each bundle comprising one or more channels, each channel comprising a lenslet arranged to generate a sub-image from a respective partial real image on the display, Each lenslet is configured to project light from the display to a corresponding eye position among two eye positions. The sub-images combine to form two virtual images so that different optical channel bundles image a same portion of the display to different portions of the virtual images. The optical system is configured to allow light to flow through selected channels and prevent, light from flowing through other selected channels. The system successively opens the optical channel bundles and displays partial real images associated with the channels of the corresponding optical channel bundle.

Abstract: An adaptation status judging unit (112) judges an adaptation status of a driver to a color. A goal color decision unit (113) decides a goal color of a display range based on the adaptation status of the driver. An applicable color decision unit (115) decides an applicable color of a display portion on a screen of a display based on the goal color, the display portion displaying information. A control unit (116) controls the display based on the applicable color of the display portion.

Abstract: The technology disclosed relates to highly functional/highly accurate motion sensory control devices for use in automotive and industrial control systems capable of capturing and providing images to motion capture systems that detect gestures in a three dimensional (3D) sensory space.

Abstract: A head-mounted display comprises: a wearing body; a display; a communication module configured to perform communication connection with a mobile information terminal; a field of view (FOV) sensor configured to output status data used for determining whether the mobile information terminal is included in a user's FOV through the wearing body; and a controller connected to each of the display, the communication module, and the FOV detection sensor. The controller determines whether the mobile information terminal is included in the user's FOV based on the status data, and performs display control with respect to the display so as to display an application screen of the mobile information terminal on the display when determining that the mobile information terminal is not included in the FOV, and not to display the application screen on the display when determining that the mobile information terminal is included in the FOV.

Abstract: A system includes a head mounted display (HMD), a processor, and a memory. The HMD is configured to generate sensor data indicative of a gaze vector of a user and a position of the user. The processor is configured to communicate with the HMD. The memory is coupled to the processor and stores instructions that, when executed by the processor, cause the processor to obtain data indicating the gaze vector of the user and the position of the user. The instructions also cause the processor to determine a component vector for a virtual component of a virtual reality simulator based on the position of the user and a position of the virtual component. The instructions further cause the processor to calculate an alignment value based on the gaze vector and the component vector, and adjust a simulation setting of the virtual component based on the alignment value.

Abstract: A multi-layer viewing system includes a stationary imager and a beam projector to project physical layer markings onto a region of an object. A headset includes an augmented reality display that is sufficiently transparent to enable a user who is wearing the headset to directly view the object through the display, and to display annotation that is superimposed on the object. A processor is configured to receive a selected location relative to the target for display of the annotation, determine an orientation of the augmented reality display by identifying images of markings in acquired images or markings on the object, calculate a display location for displaying the annotation on the augmented reality display such that the annotation is perceivable by the user as displayed at the selected position, and display the annotation at the calculated display location.

Abstract: The invention discloses an optical system of near-eye see-through head-mounted display, comprising a first lens, a second lens and a micro image display, the first lens and the second lens are attached to the micro image display, and the first lens and the second lens are free-form lenses with a uniform thickness. The architecture of the optical system of near-eye see-through head-mounted display provided by the present invention can not only reduce the number of times the light is refracted in the architecture of the optical system, but also eliminate the aberration of the light emitted by the micro image display in all directions, making the images be viewed from all directions and angles with no aberration.

Abstract: Methods, apparatus, devices, and systems for reconstructing three-dimensional objects with display zero order light suppression are provided. In one aspect, a method includes illuminating a display with light at an incident angle, a portion of the light illuminating display elements of the display, modulating the display elements of the display with a hologram corresponding to holographic data to diffract the portion of the light to form a holographic scene corresponding to the holographic data, and redirecting display zero order light away from the holographic scene to suppress the display zero order light in the holographic scene. The display zero order light includes reflected light from the display. The light includes a plurality of different colors of light.

Abstract: A device to stimulate the retina comprises one or more light sources coupled to one or more optical elements. The one or more optical elements is configured to illuminate the retina with one or more images at a location away from a fovea of a wearer. In some embodiments, each of the one or more images comprises a depth of focus and a spatial resolution. The one or more images can be formed at a distance anterior to the retina, at a distance posterior to the retina or on the retina. In some embodiments, the depth of focus is less than the distance, and the spatial resolution greater than a spatial resolution of the retina at the location.

Abstract: The present invention relates to a method implemented by computer means of selecting an optical filtration of an ophthalmic device for a wearer, the method comprising: —obtaining wearer's preferences relatively to at least one predetermined type of visual environment comprising multispectral or hyper spectral data; —selecting at least one filter: —corresponding to said wearer's preferences relatively to said at least one predetermined type of visual environment, and —determined on the basis of said multispectral or hyper spectral data.

Abstract: A head mounted display apparatus and a method for displaying a content are provided. More particularly, a head mounted display apparatus which changes an operation of a virtual character in a content displayed on a display in accordance with a plurality of touches and a method for displaying a content are provided. One of the exemplary embodiments include a head mounted display apparatus which changes an operation of a virtual character in a content displayed on a display corresponding to combination of a first touch detected from a touch pad of the head mounted display apparatus and a second touch detected from a peripheral portable apparatus and a method for displaying a content.

Abstract: Stereoscopic system including a portal component, first sensor and first cable, second sensor and second cable, first display and second display. The portal component includes an axis, a first channel and second channel extending along the axis. The first sensor is secured within the first channel at a first angle with respect to the axis and directed inwardly toward a location. The first cable extends from the first sensor. The second sensor is secured within the second channel at a second angle with respect to the axis and directed inwardly toward the location. The first angle and second angle converge at the location to define a depth of perception. The second cable extends from the second sensor. The first display structure is disposed in proximity to a left aperture of an eyeframe, and the second display structure is disposed in proximity to a right aperture of the eyeframe.

Abstract: Provided is an information processing device including a control section that recognizes an intention of a first action subject on a basis of an action performed by the first action subject in a first context, generates information indicating the intention of the first action subject in a second context of the second action subject, and causes the information to be outputted to the second action subject. The first action subject is one of a user or a communication target of the user. The second action subject is another of the user or the communication target of the user.

Abstract: According to various embodiments of the present invention, a head mounting device (HMD) may comprise: a facial wearing part which is worn on a user's face and outputs an image to both of a user's eyes; a wearing band part mounted on an upper side of the facial wearing part; and a support part which is mounted on the wearing band part to support a user's head, wherein the facial wearing part may comprise a housing in which an optical device is disposed, a guide member which extends over a first surface of the housing and is formed corresponding to a contour of the user's face, and a fixing plate which is mounted on the housing with a part of the guide member interposed between the fixing plate and the housing so as to fix the guide member to the housing. The head mounting device as mentioned above can be various according to embodiments.

Abstract: A method for multi-location DJ presence management includes generating an avatar image corresponding to a DJ operating a DJ console at a primary location on a vessel and transmitting from the DJ console, an audio feed produced by the DJ console to multiple other locations on the vessel. The avatar then can be displayed at each of the other locations. Finally, the displayed can be animated in coordination with movements of the DJ operating the DJ console. In this way, irrespective of the location of a member of the audience in any of the locations, the member of the audience can experience the live performance of the DJ as if the DJ were present in person at the location of the member of the audience.

Abstract: Methods for administering and taking a test using a headpiece supported on a person's head. A test is directed to the headpiece and includes real displays. A sequence of the real displays and fake displays are displayed on a display in front of the person's face. An encrypted code is provided, which when decrypted, provides places of the real displays in the display sequence. The encrypted code is decrypted to obtain the places of the real displays in the display sequence. A light valve assembly in the viewing portion is controlled to assume, when a real display is being displayed, a first state in which the person is able to view the display through the light valve assembly and thus the real display and assume, when a fake display is being displayed, a second state in which the person is prevented from viewing the display through the light valve assembly.

Abstract: Provided is a glasses-type display apparatus. The glasses-type display apparatus includes an optical engine configured to project light containing an image; a waveguide including an input region for receiving the projected light and an output region for outputting at least a portion of the received light; and a glasses-type body for holding the waveguide and the optical engine where a portion of the optical engine is arranged at a side portion of the waveguide.

Abstract: Techniques for employing augmented reality or virtual reality information are presented. An information management component (IMC) of an augmented reality device (ARD) can monitor and detect user activities and conditions in area in proximity to ARD. Based on user activities and conditions, IMC can determine augmented reality information that can enhance user experience, performance of user activities, or security and safety of user. IMC can present, via an interface component of ARD, the augmented reality information to the user. The augmented reality information can relate to user location; navigation by the user; tasks to be performed by the user; product assembly; maintenance work; system or product design or configuration; remote control of assembly, maintenance, design, or configuration; environmental and/or hazardous conditions; security, identification, and authentication of users; or training the user to perform tasks. IMC can translate information from a language to a different language of the user.

Abstract: A detachable spectacles-mounted augmented reality (AR) device and clip-on unit wherein the device has a housing (31) configured for detachably supporting the clip-on unit, an exit window (30) and an entrance window (30?) in the housing through which the user observes a scene, a communications interface (71, 74) for coupling to a hand-held device, and a camera (37) inside the housing for imaging the scene observed by the user through a camera window (36) and configured to convey an image of the scene to the hand-held device. A line-of-sight guide unit (39) displays at least one marker at the user's field of view for directing a line of sight of the user toward a designated feature in the scene, and optics (40) within the housing projects the marker at a distance for superimposing on to the scene viewed by the user.

Abstract: The present disclosure is directed to a head mounted apparatus that provides similar feeling in wearing, regardless of differences in head shape of users, and maintains stability of wearing even in a case where a user moves the head. A head mounted apparatus to be mounted on a head of a user includes a display unit configured to display an image to the user, an abutment portion disposed near the display unit and configured to abut the head of the user, a support member connected to the abutment portion and configured to hold a positional relationship between the abutment portion and the head of the user, and an assistance member movably connected to the abutment portion, and configured to abut a side portion of a face of the user and to assist support of the support member.

Abstract: An attachment device comprising a cover, with first and second windows, is affixed to a backing, with third and fourth windows, thereby forming a casing. The first and third windows form a first optical path with light entering the third window passing through the first window. The second and fourth windows form a second optical path with light entering the second window passing through the fourth window. A filter housing with a plurality of filters is driven by a motor so that the filters intercept the first optical path in accordance with an imaging regimen electronically stored in the casing interior. The imaging regimen communicates instructions, via a communications interface of the attachment device, to an imager and light source of an external device, to which the attachment device is attached, thereby controlling these components in accordance with the regimen.

Abstract: Systems and methods for synthesizing an image of the face by a head-mounted display (HMD), such as an augmented reality device, are disclosed. The HMD may be able to observe only a portion of the face with an inward-facing imaging system, e.g., the periocular region. The systems and methods described herein can generate a mapping of a conformation of the portion of the face that is not imaged based at least partly on a conformation of the portion of the face that is imaged. The HMD can receive an image of a portion of the face and use the mapping to determine a conformation of the portion of the face that is not observed. The HMD can combine the observed and unobserved portions to synthesize a full face image.

Abstract: Head-mountable devices can include an arrangement of components that include a waveguide that is decoupled from the ability of system loads to be transferred into the waveguide. Such decoupling can be achieved by utilizing an elastic bond with low stiffness to bond certain components together. This allows the system to flex and deform without transferring stress to the waveguide. Such decoupling can also be achieved by selectively bonding in regions that have relatively lower displacements between a support structure and the waveguide. These measures can help preserve component alignment while allowing a head-mountable device to be lightweight and small in size.

Abstract: A helmet mounted display system is described. A visor has an inner reflective surface and is mountable to head gear. A light source is arranged to emit light. Directing optics are arranged to image light from the light source onto the inner reflective surface of the visor to provide a reticle image on the inner reflective surface of the visor. An eye tracker is configured to determine the orientation of an eye of a wearer of the head gear. A controller is configured to receive an indication of the determined orientation of the eye, and to control the at least one actuator to change the orientation and shape of the directing optics to change the position of reticle image based on the indication of the determined orientation of the eye such that the eye views the reticle image.

Abstract: An image processing method according to some embodiments of the present disclosure includes: obtaining rendering durations of images of M frames; determining whether the rendering durations of the images of the M frames match a motion gesture requirement; if yes, controlling a difference ?t between a rendering start timing of the image of each frame and a warp processing start timing of the image of a corresponding frame to be less than or equal to a preset difference ?taim; otherwise, setting a system frame rate to make the rendering duration of the image of each frame match the motion gesture requirement.

Abstract: Embodiments relate to a system for generating simulated eye movements and eye responses related to concussion symptoms for training medical practitioners. The system includes a computer device with a display that displays the pair of simulated eyes. Scenarios are generated and executed, in which simulated eye movements and responses to external stimuli are representative of typical symptoms associated with having a concussion. A user (e.g., medical trainee or medical trainer) provides external inputs e.g., voice commands, stylus movements, etc.) and assess eye movements provided by the scenarios and eye responses to the external inputs.

Abstract: An eye tracking system can include an eye-tracking camera configured to obtain images of the eye at different exposure times or different frame rates. For example, longer exposure images of the eye taken at a longer exposure time can show iris or pupil features, and shorter exposure, glint images can show peaks of glints reflected from the cornea. The shorter exposure glint images may be taken at a higher frame rate (than the longer exposure images) for accurate gaze prediction. The shorter exposure glint images can be analyzed to provide glint locations to subpixel accuracy. The longer exposure images can be analyzed for pupil center or center of rotation. The eye tracking system can predict future gaze direction, which can be used for foveated rendering by a wearable display system.

Abstract: An autostereoscopic three-dimensional display system for surgical robotics has an autostereoscopic three-dimensional display configured to receive and display video from a surgical robotics camera, and a first sensor assembly and a second sensor assembly. A processor is configured to detect and track an eye position or a head position of a user relative to the display based on processing output data of the first sensor assembly, and to detect and track a gaze of the user based on processing output data of the second sensor assembly. The processor further is configured to modify or control an operation of the display system based on the detected gaze of the user. A spatial relationship of the display also can be automatically adjusted in relation to the user based on the detected eye or head position of the user to optimize the user's visualization of three-dimensional images on the display.

Abstract: The present disclosure relates to an eyewear and a control method thereof. The eyewear includes an optic, a camera device and a frame; wherein the optic and the camera device are respectively located on the frame; and the optic is a transparent display screen. The control method of the eyewear includes: detecting a light intensity of ambient light; obtaining a current light intensity of transmitted light generated after the ambient light passes through the optic, based on the light intensity of the ambient light and current light transmittance of the eyewear; adjusting the light transmittance of the optic; starting the camera device to acquire an environment image; performing enhancement processing on the environment image to obtain an enhanced environment image; and controlling the optic to display according to the enhanced environment image.

Abstract: An apparatus for image viewing and eye tracking in virtual or mixed reality systems that includes two or more display panels (e.g., a top display panel and a bottom display panel) for each eye with left and right prisms located between the display panels and the user's eyes. S- and P-polarizing filters are located between the display panels and first and second surfaces of the prism. For each eye, the polarized light from the top and bottom display panels is redirected by a respective prism to form exit pupils for top and bottom images at a plane at or near the eye. At least one eye-tracking camera is located in front of each prism and between the top and bottom display panels so that the cameras have a direct or near-direct view of the user's eyes through the eyepieces.

Abstract: Disclosed herein is a system for facilitating fast and intuitive investigations of security incidents by responding to physical gestures performed by security analysts within a virtual scene. A query triggers an alert for detecting security incidents that occur with respect to computing resources. Following the alert, the security analyst dons a Near-Eye-Display (NED) device and is presented with a virtual scene having control elements representing various data sets and/or data analysis operations relevant to a security incident. The security analyst investigates the security incident by performing hand motions to “grab-and-drag” control elements representing data sets. The security analyst may also perform hand motions to “tap on” control elements that represents a data analysis operation. Responsive to the hand motions, the system performs data analysis operations and displays a result within the virtual scene.

Abstract: Optical systems including a partial reflector, a reflective polarizer, and a retarder disposed between the partial reflector and the reflective polarizer are described. The reflective polarizer is curved about two orthogonal axes and includes at least one layer that is substantially optically uniaxial at at least one location. The optical system is adapted to provide an adjustable focus.

Abstract: A freeform prism-lens group includes: a primary prism; a first auxiliary lens; and a beamsplitter film between the primary prism and the first auxiliary lens and having a predetermined beamsplitting ratio; wherein: the first auxiliary lens has a first optical surface substantially conforming to a neighboring freeform surface of the primary prism; and the first auxiliary lens has a second opposing optical surface distal from the primary prism that is planar, aspheric, or spherical with a curvature radius greater than 100 mm.