Abstract: A video server comprises a video encoder to encode video data representing panoramic video content in which the panoramic video content has a greater field of view than a displayable region at a client device, the video encoder being configured to encode spatial regions within the video content at different respective encoding qualities in dependence upon track data indicating, for temporal positions with respect to the panoramic video content, a preferred viewing region within the panoramic video content at those temporal positions, so that the preferred viewing region is encoded at a higher encoding quality than another region of the panoramic video content.

Abstract: An index extraction unit detects indices from a sensed image sensed by a sensing unit which senses an image of a physical space on which a plurality of indices is laid out. A convergence arithmetic unit calculates position and orientation information of the sensing unit based on the detected indices. A CG rendering unit generates a virtual space image based on the position and orientation information. A sensed image clipping unit extracts, as a display image, an image in a display target region from the sensed image. An image composition unit generates a composite image by compositing the extracted display image and the generated virtual space image. A display unit displays the composite image.

Abstract: A method for the production of immersive virtual reality experiences designed for viewing in virtual reality head-mounted displays (HMD). This unique layered panorama process is a cubic or spherical mapped content method for presentation of pre-rendered images viewed from a fixed point of view in a head mounted display for virtual reality (VR) applications, a method that by mapping/layering all visual elements onto a mono or stereoscopic spherical or cubic panorama surface creates a seamless visual integration.

Abstract: An approach for projecting light may be implemented using a acousto-optical depth switch that uses surface acoustic waves produced along a substrate to guide image light to different areas. The surface acoustic waves may be generated on a substrate using a transducer. Surface acoustic waves of different frequencies can guide image light onto different optical elements at different physical positions. The optical elements may be configured to show objects in an image at different distances from a viewer.

Abstract: A head-mounted display, a display control method, and a program that facilitate a user to understand proximity between the user and an object around the user are provided. A display block (36) is arranged in front of the eyes of the user wearing a HMD (12). In accordance with proximity between the user and an object around the user, the HMD (12) controls the display block (36) so as to have the user visually recognize a forward direction of the display block (36).

Abstract: An apparatus comprising: at least one processor; and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following: based on a virtual reality space provided for viewing by a first user and a physical location of the first user, provide for display of an augmented reality graphic for viewing by a second, different user, in an augmented reality view, said augmented reality graphic comprising an image of at least part of the virtual reality space provided to the first user which is displayed at a position corresponding to the physical location of the first user to at least partially surround the first user in the augmented reality view, such that the second user can see the at least part of the virtual reality space experienced by the first user.

Abstract: The general field of the invention is that of monochromatic stereoscopic image projectors including two light sources that illuminate two imagers, the radiation of the two light sources having a spectral distribution centred on a central wavelength, the first imager and the second imager being connected to a generator of stereoscopic image pairs. The image projector includes a dichroic separating filter that transmits the portion of the spectrum below the central wavelength and that reflects the portion of the spectrum above this central wavelength. The first light source and the second light source are arranged symmetrically on either side of the dichroic separating filter. The image projector operates cyclically, each cycle including two alternations. Each alternation consists in changing the emission source and in switching to the two displays the left and right images emitted by the generator of image pairs.

Abstract: Embodiments allow different viewers of a shared display to see different images. Images may have different combinations of polarization and time slices that correspond to filters in glasses worn by the viewers. The images viewed by each of the glasses may be based on the tracked position and orientation of the glasses, so that the images correspond to the user's viewpoint. Different images may be presented to left and right eyes for 3D stereoscopic viewing. The lenses of the glasses may have a filter that selects light of a specific polarization combined with a shutter that passes images during a specific time slice. The polarization filter may select circularly polarized images of a desired orientation and emit linearly polarized images. The shutter may use liquid crystals to twist the linearly polarized images during the desired time slice so that a final linear polarizer passes the image to the viewer.

Abstract: The present disclosure relates to a virtual reality display device and an adaptive parallax adjustment method for the virtual reality display device, which belong to the display technical field. The adaptive parallax adjustment method includes: obtaining pupil distance information of a user; and adjusting a position of a to-be-displayed image on a display screen according to the pupil distance information.

Abstract: A method, an electronic device and a non-transitory computer readable medium for are provided. The method includes capturing a first eye and a second eye. The method also includes identifying a first position of the first eye and a second position the second eye. Additionally, the method includes staggering the capture of the first eye and the second eye, wherein the first eye is captured prior to capturing the second eye. The method also includes identifying the first gaze direction with respect to a display. The method further includes mapping the second gaze direction of the second eye based on the identified first gaze direction, prior to capturing the second eye.

Abstract: Disclosed herein are systems and methods for configuring a multi-device digital experience. In an embodiment, the method includes presenting a first content portion of a digital experience via a wearable display device in an environment; presenting a second content portion of the digital experience via a first device in a set of one or more devices in the environment; capturing test-signal-output data presented by the first device, the test-signal-output data being captured by the wearable display device in the environment, the test-signal-output data being based on a test signal sent to the first device; estimating spatial-characteristic data of the first device based on the captured test-signal-output data; and modifying the presentation of the second content portion of the digital experience via the first device based on the estimated spatial-characteristic data of the first device.

Abstract: One disclosed example provides a head-mounted device including a stereo camera arrangement, a logic device configured to execute instructions, and a storage device storing instructions executable by the logic device to, for each camera in the stereo camera arrangement, receive image data of a field of view of the camera, detect light sources of a handheld object in the image data, and based upon the light sources detected, determine a pose of the handheld object. The instructions are executable to, based upon the pose of the handheld object determined for each camera in the stereo camera arrangement, calibrate the stereo camera arrangement.

Abstract: A display control method with which a captioned image can be displayed in the visual field of a user irrespective of a change in the line-of-sight direction of the user. The display control method includes a step of generating visual-field image data, which represents a visual-field image, based on the line-of-sight direction of a user and 360-degree space image data. The method further includes a step of receiving captioned image data, which represents a captioned image. The method further includes a step of displaying on an HMD a composite image of the visual-field image and from the captioned image, based on the visual-field image data and the captioned image data. The composite image is displayed is displayed at a given place in the visual-field image irrespective of a change in the line-of-sight direction of the user.

Abstract: A virtual reality goggle includes a goggle shaped body having multiple cameras mounted thereon. A display is supported by the goggle shaped body. A support extends between sides of the goggle shaped body and includes multiple cameras. Circuitry is coupled to receive video from the multiple cameras, the video comprising a composite field of view of approximately 360 degrees about the goggle, the circuitry to couple to a wireless communication device to transmit the received video to networked processing services, and to receive stitched stereoscopic three dimensional virtual reality video from the networked processing services, the circuitry further coupled to provide the received stitched stereoscopic three dimensional virtual reality video for display.

Abstract: Methods and apparatus relating to enabling augmented reality applications using eye gaze tracking are disclosed. An exemplary method according to the disclosure includes displaying an image to a user of a scene viewable by the user, receiving information indicative of an eye gaze of the user, determining an area of interest within the image based on the eye gaze information, determining an image segment based on the area of interest, initiating an object recognition process on the image segment, and displaying results of the object recognition process.

Abstract: A method for determining an optical performance parameter of a head mounted display device adapted for a wearer includes a head mounted display device providing step, during which a head mounted display device adapted for a wearer is provided, an optical measurement device providing step, during which an optical measurement device is provided that includes an entrance pupil and a sensor receiving light through the entrance pupil, a positioning step, during which the optical measurement device and the head mounted display device are positioned so that the position of the entrance pupil of the optical measurement device corresponds to the position of the pupil of the wearer when wearing the head mounted display device, an optical performance parameter determining step during which at least one optical performance parameter of the head mounted see-through display device is determined based on the data measured by the optical measurement device.

Abstract: An MRI-compatible video projector system with improved safety features, comprising a projector module, a liquid cooling system, comprising a coolant block of non-magnetic material disposed in or adjacent the housing of the projector and heat generating components, a coolant pump situated remotely from the projector, and coupled to the coolant block by coolant lines carrying liquid to and from the coolant block, and a projector power system situated remotely from the projector.

Abstract: A recording medium according an aspect of the present disclosure has recorded therein a main video stream where a main video has been encoded, and a sub-video stream where a sub-video, that is to be superimposed on the main video and displayed, has been encoded. The sub-video stream includes bitmap data indicating a design of the sub-video and palette data specifying the display color of the design. The palette data includes first palette data for a first luminance dynamic range (SDR), and second palette data for a second luminance dynamic range (HDR) that is broader than the first dynamic range.

Abstract: The present invention relates to a head mounted display (HMD) capable of receiving an image through a camera. An HMD according to an embodiment of the present invention comprises: a main body configured to be worn on a user's head; a camera equipped in the main body; a sensing unit configured to measure the distance between the main body and a subject corresponding to the image received through the camera; and a control unit which determines a plurality of feature points satisfying preset conditions in the image, measured, by means of the sensing unit, the distance between the main body and the subject corresponding to at least one of the plurality of feature points, and determines the movement of the main body on the basis of at least one of the plurality of feature points and the measured distance.

Abstract: In various embodiments, computerized methods and systems for rendering near-field objects as perceivable far-field objects within a virtual environment are provided. A determination is made that a near-field object to be rendered is configured for far-field perception within the virtual environment. The virtual environment is operable to include one or more virtualized near-field objects that are stereoscopically rendered utilizing one or more stereoscopic projection transforms generated based at least in part on a position and orientation of a head-mounted display. A harmonize transform is generated for the configured near-field object based at least in part on one of the stereoscopic projection transforms. Based on the determination that the near-field object is configured for far-field perception, the generated harmonize transform is employed to stereoscopically render the configured near-field object as a perceivable far-field object within the virtual environment.

Abstract: A method for the production of immersive virtual reality experiences designed for viewing in virtual reality head-mounted displays (HMD). This unique layered panorama process is a cubic or spherical mapped content method for presentation of pre-rendered images viewed from a fixed point of view in a head mounted display for virtual reality (VR) applications, a method that by mapping/layering all visual elements onto a mono or stereoscopic spherical or cubic panorama surface creates a seamless visual integration.

Abstract: An optical scanning head-mounted display includes an optical scanning controller that emits, as image light, a laser beam in accordance with an image signal; a transmission cable that transmits the image light emitted from the optical scanning controller; and a head mount unit provided with an optical scanner including a mirror for scanning the image light transmitted by the transmission cable, wherein the head mount unit includes an amplifier that amplifies a motion signal corresponding to a tilt of the mirror, the motion signal being output from the optical scanner, and wherein the optical scanning controller includes a difference generator that generates a difference signal from the motion signal output from the amplifier through the transmission cable and a filter that removes noise from the difference signal generated by the difference generator.

Abstract: An approach for projecting light may be implemented using a acousto-optical depth switch that uses surface acoustic waves produced along a substrate to guide image light to different areas. The surface acoustic waves may be generated on a substrate using a transducer. Surface acoustic waves of different frequencies can guide image light onto different optical elements at different physical positions. The optical elements may be configured to show objects in an image at different distances from a viewer.

Abstract: A head-mounted display includes a camera that obtains an image of an object within a field of view. The head-mounted display further includes a processor configured to determine a plurality of feature points from the image and calculate a feature strength for each of the plurality of feature points. The processor is further configured to divide the image into a plurality of cells and select feature points having the highest feature strength from each cell and which have not yet been selected. The processor being further configured to detect and track the object within the field of view using the selected feature points.

Abstract: A method, computer program product and system for eye contact-based information transfer. Communication is established by a computer device between a first head mounted device worn by a first user and a second head mounted device worn by a second user. Gaze tracking establishes through gaze tracking of the first head mounted device and the second head mounted device that the first head mounted device and the second head mounted device have made eye contact. Responsive to an input to at least one of the first head mounted device and the second head mounted device made while the first head mounted device and the second head mounted device have established eye contact, a computer device transfers a file between the first head mounted device and the second head mounted device.

Abstract: A head-mounted display device may display a notification artifact for another display device. Using image data of a physical environment, a three dimensional model of the environment may be generated. Locations of the head-mounted display device and the other display device within the model may be determined. Notification data for the other display device may be received. Based on the location of the other display device relative to the head-mounted display device, the notification artifact for the other display device may be displayed within the physical environment.

Abstract: The disclosure provides methods and systems for warning a user of a head mounted display that the user approaches an edge of field of view of a camera or one or more tangible obstacles. The warning includes presenting audio and/or displayable messages to the user, or moving the display(s) of the head mounted displays away of the user's eyes. The determination that the user approaches the edge of scene or a tangible obstacle is made by dynamically tracking motions of the users through analysis of images and/or depth data obtained from image sensor(s) and/or depth sensor(s) secured to either the head mounted display, arranged outside of the scene and not secured to the head mounted display, or a combination of both.

Abstract: A system and method of operating an audio visual device generating a virtual immersive experience is provided. The system may include an optical system and a display system received in a housing, and an audio output device operably coupled to the display system, the housing being coupled to a frame to be worn by a user. A sensing device may sense at least one of an ambient brightness level or an ambient noise level, and a control system and processor operably coupled to the optical system, the display system, the audio output device and the sensing device may, in response to an external command to transition between the virtual environment and the ambient environment, adjust at least one of a brightness level or a noise level of the virtual environment based on the sensed ambient brightness level and/or the sensed ambient noise level before executing the received external command.

Abstract: An approach for projecting light may be implemented using a acousto-optical depth switch that uses surface acoustic waves produced along a substrate to guide image light to different areas. The surface acoustic waves may be generated on a substrate using a transducer. Surface acoustic waves of different frequencies can guide image light onto different optical elements at different physical positions. The optical elements may be configured to show objects in an image at different distances from a viewer.

Abstract: Embodiments described herein include an optical system, and associated method and computer program product. The optical system comprises one or more display devices, and one or more computer processors configured to transmit display signals comprising at least one virtual object for updating imagery displayed by the display devices, and to selectively defocus a focus of the virtual object.

Abstract: A notification system for virtual reality devices that includes a message indicator device, an audiovisual (A/V) signal source connected to the message indicator device and adapted provide an A/V feed containing at least one of video information and audio information, a monitoring system connected to the message indicator device and configured to detect notification events at a monitored premises, and a virtual reality (VR) headset connected to the message indicator device and adapted to receive and present the A/V feed, wherein the message indicator device is adapted to communicate the A/V feed to the VR headset during a normal operating state, and wherein the message indicator device is adapted to communicate an alert signal to the VR headset upon detection of a notification event by the monitoring system.

Abstract: An object of the present invention is to provide an eye opening degree detection system that can accurately and stably calculate an eye opening degree. The eye opening degree detection system includes imaging devices that generate images including regions of both eyes, a one eye opening degree calculation unit that calculates each one eye opening degree of the left and right eyes of a first image, an eye opening degree selection unit that selects a correctly-calculated one eye opening degree, an eye opening degree calculation unit that calculates an eye opening degree on the basis of the one eye opening degree and an eye opening degree determination unit that compares the eye opening degree calculated on the basis of the first image with an eye opening degree calculated on the basis of a second image prior to the first image to determine the propriety of the eye opening degree.

Abstract: Embodiments of the present disclosure disclose a head-wearable apparatus, a 3D video call system and a method for implementing 3D video call. The present disclosure relates to virtual reality technologies and is invented to relatively completely shoot video images of the scenario where the user locates, achieve real-time 3D video call between users of both parties, and mutually share scenes viewed by themselves. The head-wearable apparatus comprises at least two cameras which are spaced apart from each other and arranged on the head fixing means and/or the video output unit, and field of vision of the at least two cameras superimposes and covers all positions in a horizontal direction.

Abstract: An optical evaluation workstation evaluates quality metrics (e.g., sharpness, blemishes) of eyecup assemblies of a head mounted display (HMD). The workstation includes an eyecup assembly feeder, a camera, and a control module. The eyecup assembly feeder is configured to receive an eyecup assembly of a HMD, the eyecup assembly comprising an optics block rigidly fixed at a first distance to an electronic display panel. The camera is configured to capture one or more images of the one or more test patterns presented by the electronic display panel through the optics block. The control module is configured to modify at least one image of the one or more images using a transform, and determine a quality metric for the modified at least one image.

Abstract: Provided are wearable glasses including a display and a method of operating the same. The wearable glasses include: a display configured to display an image; a sensor configured to acquire wear state information representing a state in which a user currently wears the wearable glasses, while the image is being displayed on the display; and a processor configured to determine an inclination of the wearable glasses with respect to the user based on the acquired wear state information, and to adjust, based on the determined inclination, the image that is displayed on the display.

Abstract: A head-mounted display device includes a head fitting by which the display device can be worn on the head of a user, and a visor assembly mounted to the head fitting. The visor assembly includes a plurality of display elements arranged to be aligned with the eyes of the user, a plurality of sensors, and a protective enclosure that encloses the display elements and the sensors. The protective enclosure may include an upper portion aligned with the sensors and a lower portion aligned with the display elements. The upper portion may be substantially opaque to visible light and transparent to infrared light. The lower portion may have a variable tinting scheme in which at least some of the lower portion of the enclosure is transparent to visible light.

Abstract: Methods and apparatus for generating a sharp image are described. A camera device includes a plurality of camera modules, e.g., optical chains, where at least some of the camera modules have different depths of field. Multiple images of a scene are captured using the plurality of camera modules. Portions of the multiple images which correspond to the same scene area are identified. Image portion sharpness levels are determined for individual image portions. Image portions with high sharpness levels are selected and included in a composite image.

Abstract: A portable folding virtual reality device having a cover formed horizontally; a mounting case which is provided on a front of the cover and on which an image device such as a smart phone is mounted; a lens plate provided with a magnifying lens at a rear of the cover; and a band which is connected to both ends of the lens plate and through which the device is mounted to a head of a user. The mounting case and the lens plate are arranged to form up and downward at a right angle and to rotate by the cover and a front and rear hinges. A supporting plate that rotates left and rightward with respect to a central line of the cover is provided, and the interval between the front hinge and the rear hinge is identical to the focal distance of the left and right magnifying lens.

Abstract: Control of head-mounted display (HMD) systems is described. One method displays at least one image on a first display layer of a HMD system. While displaying the at least one image, the method adjust a transparency setting of a second display layer from a first value to a second value to cause the second display layer to be opaque to limit an amount of light that passes through the lens for viewing the at least one image on the first display layer.

Abstract: An object-image alignment data generating method for use in an object recognition system is presented. The method obtains a 3D model and a set of 2D images of the object. Each 2D image from the set is captured based on a particular camera point of view. The method then uses the 3D model of the object to generate multiple silhouettes of the object according to different camera point of views. Each silhouette is then matched and aligned with a 2D image based on the corresponding camera point of view. The method also derives at least one descriptor from the 2D images and compiles feature points that correspond to the descriptors. Each feature point includes a 2D location and a 3D location. The method then generates an object-image alignment packet by packaging the 2D images, the descriptors, and the feature points.

Abstract: A method for displaying a view of a target comprises establishing a network including a plurality of display devices, requesting by a first display device in the network having an obstructed view of the target, at least one of position and orientation data from one or more remaining display devices in the network each having a different view of the target than the obstructed view, selecting a remaining display device as a view provider to provide the different view of the target to the first display device, requesting the different view of the target from the selected view provider; providing the different view of the target to the first display device, and displaying the different view of the target via the first display device.

Abstract: An apparatus for and method of image processing in an augmented reality application is provided. The method includes the steps of: providing at least one image of a real environment; performing image processing in an augmented reality application with the at least one image employing visualization of overlaying digital information with visual impressions or the image of the real environment and employing vision-based processing or tracking; and adjusting at least one of a parameter and operating flow of the vision-based processing or tracking depending on at least one of the following: a usage of the image processing, a usage of the visualization, a visually perceivable property of the digital information or the real environment, a property of a display device employed in the visualization, or a manner in which a user is viewing the visualization.

Abstract: A display auxiliary device includes a light receiving sensor that receives display light from a display target, and a CPU that determines whether or not a switching display synchronous signal is included in the received display light, shields both a left-eye liquid crystal shutter and a right-eye liquid crystal shutter during a light reception period of time of the switching display synchronous signal based on the switching display synchronous signal, and performs a shutter switching operation of the left-eye liquid crystal shutter for the left-eye image and the right-eye liquid crystal shutter for the right-eye image to be switched and displayed, when the switching display synchronous signal is determined to be included.

Abstract: In a method of managing 3D video stream, 3D video stream is output to a connected display. The connected display displays the 3D video stream after a delay associated with the connected display. A timing offset is determined based on the delay. The timing offset is operable to be used to synchronize shutter operations of at least one shutter glasses with the presentation of the 3D video stream. A shutter control signal based on a frame start indication from the 3D video stream is transmitted. The frame start indication is operable to be used to determine a frame rate of the 3D video stream, and the shutter control signal is operable to be used to maintain synchronization of the shutter operations of the at least one shutter glasses with the presentation of the 3D video stream at the connected display.

Abstract: Aspects of the present invention relate to providing see-through computer display optics.

Abstract: A display apparatus includes a master/slave setting unit configured to execute at least one of setting of a master apparatus which displays a switching-display synchronization signal superposed on an image as a target to be displayed and setting of a slave apparatus which does not display the switching-display synchronization signal, a synchronization-signal superposition unit configured to superpose the switching-display synchronization signal on the image as the target to be displayed, when setting of the master apparatus is executed by the master/slave setting unit, and a display unit configured to display the image on which the switching-display synchronization signal is superposed by the synchronization signal superposition unit.

Abstract: Several embodiments of image processing systems and methods are disclosed herein whereby at least one characteristic of an image displayed on a target display is changed according to information regarding the viewer's position—e.g. distance to the target display, the visual angle the target display's subtends of the viewer's field of view. In one embodiment, luminance and/or contrast may be changed depending on the information regarding viewer's position relative to the target display.

Abstract: A 3-D picture is provided by providing a pair of pictures that includes a first picture for one eye of a viewer, and a second picture for the other eye of the viewer. In addition, a depth map specifically dedicated to the first picture is provided. The depth map includes depth indication values. A depth indication value relates to a particular portion of the first picture and indicates a distance between an object at least partially represented by that portion of the first picture and the viewer. The 3-D picture is supplemented with rendering guidance data that specifies respective parameters for respective rendering contexts. These respective parameters relate to generating a shifted viewpoint picture from the first picture and the depth map.

Abstract: A stereoscopic image display device includes a display unit including a plurality of pixels and a data driver supplying first image data for a first view point to the plurality of pixels, second image data for a second view point to the plurality of pixels after supply of the first image data, third image data for the second view point to the plurality of pixels after supply of the second image data, and fourth image data for the first view point to the plurality of pixels after the input of the third image data. The stereoscopic image display device using such a time-division type scheme may decrease driving speed needed to display the stereoscopic image, may decrease reduction of luminance by reducing an amount of black data, and may decrease power consumption.

Abstract: Graphical elements displayed on a two-dimensional display screen have an appearance that is consistent with a three-dimensional view of those elements over a range of viewing angles. A current viewing angle of a user is determined, and a view of an element to be rendered can be determined that includes an orientation appropriate for the current viewing angle. An image manipulation process is applied in order to enable the element to have the determined view from the current viewing angle of the user, taking into account the angle of the display screen with respect to the user. In at least some embodiments, an anamorphic skewing process can be used to correlate locations on the display screen with apparent positions of those locations at the current viewing angle, and cause the graphical elements to be rendered on the display screen with a skew or distortion based on the correlated locations.