Abstract: Disclosed are a binocular see-through AR head-mounted device and an information displaying method thereof. Sight mapping relationship ? is preset in the head-mounted device, human eye spatial sight information data of a user is tracked and calculated by a sight tracking system, virtual information that needs to be displayed is displayed on the left and right lines of sight of the human eyes on the basis of a binocular see-through AR head-mounted device virtual image imaging principle and a human eye binocular vision principle, thus implementing accurate overlap of the virtual information to the proximity of the position of the fixation point of the human eyes, allowing a high degree of integration of the virtual information with the environment, and implementing enhanced virtual reality in the true sense. The present invention provides a simple solution, requires only the sight tracking system to complete the process, obviates the need for excessive hardware facilities, and is inexpensive.

Abstract: A display device comprises a projection device projecting a display image, an aerial imaging element, and a distribution mechanism in which distribution units are arranged at a given interval. An interval between the distribution units is determined according to a relationship between a number of view point pixels constituting a pixel unit, a number of pixel units, a distance from the pixel unit at a center to the pixel unit at an edge, a distance from a distribution unit at a center to the distribution unit at an edge, a pitch of the view point pixel, an angle of light from the pixel unit at the center emitted to the distribution unit, and an angle of the emitted light, an angle of light from the pixel unit at the edge emitted to the distribution unit, and an angle of the emitted light, a distance between the projection device and the distribution units, a refractive index of the distribution mechanism, a distance between the real image and an optimal viewing position for a viewer, and a projection width.

Abstract: The subject matter discloses a system for testing an application or a game build on top of a rendering engine, the system comprises an agent configured for running on a first computing device; the first computing device is configured for running the game or said application; a test framework installable on a second computing device, the test framework is configured for receiving one or more instructions related to a test of said game or the application from a user and for transmitting the one or more instructions to the agent; wherein the agent is further configured for communicating with the test framework for extracting one or more object properties of the game or the application in response to the one or more instructions and for providing to the test framework to access to the one or more object properties.

Abstract: The disclosure relates to a display control device, a display control method, and a recording medium capable of performing more reliable stereoscopic viewing. Whether or not a condition for generating erroneous fusion on a presented image is satisfied on the basis of the display mode of a plurality of display objects arranged side by side in one direction on the presented image at the time of displaying the presented image presented in three-dimensional space. The presented image is expressed by an image for a right eye and an image for a left eye for stereoscopic viewing by using fusion in which the image for a right eye and the image for a left eye are superimposed and recognized as one image. Then, control of applying a predetermined effect to display of the presented image is performed on the basis of the determination result. The present technology can be applied to, for example, a stereoscopic display system using a head-mounted display.

Abstract: Concepts for detecting a scene transition in video footage are presented. One example comprises, for each of a plurality of different frames of video footage, obtaining a value of a confidence measure associated with a detected object in the frame. A scene transition in the video footage is then detected based on the obtained values of the confidence measure.

Abstract: A system for displaying three dimensional (3D) images. The system includes a 3D display operating in a first state to display a 3D image by outputting light into a viewing space and operating in a second state in which the 3D image is not displayed. The system further includes a screen element positioned between the 3D display and the viewing space. The screen element reflects light from the viewing space to appear opaque to a viewer in the viewing space when the 3D display operates in the second state. The screen element transmits the light output by the 3D display, whereby the 3D display image is perceivable by the viewer in the viewing space. The screen element includes a sheet of mesh or netting material that transmits light output by the 3D display through its pores or openings and may be a planar sheet of scrim, tulle, or chiffon.

Abstract: According to the present disclosure, an apparatus for real-time object detection in an image captured by an unmanned aerial vehicle (UAV) including an image splitter configured to receive an input image and split the input image into a left image and a right image; and an object detector configured to detect an object from each of the left image and the right image provided from the image splitter is provided.

Abstract: Encoding and streaming methods and apparatus are described. Objects in negative parallax in frame pairs, e.g., pairs of left and right eye images forming a stereoscopic image, are identified. An amount of negative parallax reduction implemented depends, in some embodiments, on the data rate being used for encoding and/or the amount of negative parallax detected in the frame pair to be encoded. The lower the supported data rate the greater the reduction in negative parallax in some embodiments. In some, but not all, embodiments objects in positive parallax, e.g., objects appearing to go into the page, are not subject to parallax reduction. When a lowest supported data rate is used mono encoding is used and parallax reduction steps are skipped. The same frame pair is encoded multiple times at different data rates. Different amounts of negative parallax reduction are performed for at least some of the different supported data rates.

Abstract: Aspects of the subject disclosure may include, for example, encoding a point cloud in a first frame of volumetric video in an octree format and identifying a first group of points of the point cloud, resulting in a first base layer including a base layer, a first enhancement layer and a second enhancement layer. Each layer includes different points from the point cloud, with the second enhancement layer including all points in each octet of leaf nodes in the octree format of the point cloud that are not in the base layer and the first enhancement layer. The first base layer of the point cloud is provided over a communication network to a media device and the first enhancement layer is also provided responsive to a determination of sufficient available bandwidth in the communication network. Other embodiments are disclosed.

Abstract: An information processing apparatus specifies that material data for generating a virtual-viewpoint content at what time is stored in a storage device that stores a plurality of material data for generating a virtual-viewpoint content; and outputs, based on a result of the specification, information for causing an image to be displayed, the image indicating a time at which a virtual-viewpoint content can be generated.

Abstract: An image processing method includes the steps of acquiring a first image obtained by imaging an object space through a first pupil in an optical system, and a second image obtained by imaging the object space through a second pupil different from the first pupil in the optical system, and generating a blur reshaped image in which a blur caused by a defocus is reshaped based on the first image and the second image using a neural network.

Abstract: To prevent an object that should exist in a virtual viewpoint video image from disappearing. The image processing apparatus generates three-dimensional shape data on a moving object from images based on image capturing from a plurality of viewpoints and outputs the data to the apparatus that generates a virtual viewpoint video image. Then, in a case where it is not possible to generate three-dimensional shape data on an object that behaves as the moving object during a part of the period of the image capturing, three-dimensional shape data on the object generated in the past is output to the apparatus that generates a virtual viewpoint video image.

Abstract: In one embodiment, a method includes retrieving a media content item for display on a projectable surface. The method includes sending, to an interaction device including a projector and a camera, instructions causing the camera to capture one or more images of the projectable surface, receiving the one or more images from the interaction device, and determining one or more attributes of the surface based on the one or more images. The method also includes modifying the media content item based at least in part on the one or more attributes of the projectable surface and sending, to the interaction device, the modified media content item and instructions causing the projector to project the modified media content on the projectable surface.

Abstract: Configurations are disclosed for presenting virtual reality and augmented reality experiences to users. The system may comprise a scanning device for scanning one or more frames of image data. The scanning device may be communicatively coupled to an image source to receive the image data. The system may further comprise a variable focus element (VFE) operatively coupled to the scanning device for focusing the one or more frames of image data on an intermediate image plane, wherein the intermediate image plane is aligned to one of a plurality of switchable screens. The plurality of switchable screens may spread light associated with the intermediate image plane to specific viewing distances. The system may also comprise viewing optics operatively coupled to the plurality of switchable screens to relay the one or more frames of image data.

Abstract: There is provided an information processing device for rotating an object relative to a viewpoint position of a user in further accordance with the user's desire, the information processing device including: a rotation center determination unit that determines a center of rotation based on a position of an object in a three-dimensional space and an instruction direction of a user in the three-dimensional space; and a rotation control unit that rotates the object relative to a viewpoint position of the user on the basis of the center of rotation.

Abstract: An interactive stereoscopic display and an interactive sensing method for the same are provided. In the method, a gesture sensor senses a hand gesture over a stereoscopic image displayed on a stereoscopic display. The gesture is such as moving, rotating or zooming actions. The gesture is referred to, to obtain stereo coordinate variations that are used to determine an interactive instruction. Next, the stereoscopic display or a stereoscopic image server generates a new stereoscopic image data by comparing image coordinate data of the stereoscopic image with a previous state of image coordinate data according to the interactive instruction. The stereoscopic image data describes color and three-dimensional information of the stereoscopic image. Therefore, the stereoscopic display displays a new stereoscopic image using the new stereoscopic image data. The method achieves an interactive effect with the stereoscopic image using the gesture.

Abstract: A holographic display device presents a holographic image within an external part for a vehicle such as a headlight assembly or an exterior rearview mirror assembly. An outer cover defines an interior cavity, with a transparent portion, such as a window, allowing a viewer to see into the interior cavity. A presentation surface inside the interior cavity is illuminated by an image source to display the holographic image, which appears as a 3-dimensional object within the interior cavity, and which appears to be suspended therein. The holographic image may be stationary or moving, and may include a logo, symbol, or other graphic. The image source is may be hidden from direct view. One embodiment includes two circular polarizer to prevent light directly from the image source from being visible, while allowing reflected light to become visible by being having the polarization direction reversed.

Abstract: A three-dimensional display system includes: an LED array and a light control layer disposed on a base substrate; wherein the LED array is used to form polarized lights of different polarization directions; the light control layer is used to control a light emission order of the polarized lights of different polarization directions.

Abstract: A reinforcement learning method and apparatus includes storing video frames in a video memory, performing a first preprocessing step of retrieving a sequence of n image frames of the stored video frames, and merging the n image frames in a fading-in fashion by incrementally increasing the intensity of each frame up to the most recent frame having full intensity to obtain a merged frame; and performing a training step of inputting the merged frame to the DQN and training the DQN to learn Q-values for all possible actions from a state represented by the merged frame with only a single forward pass through the network. The learning method and apparatus includes a second preprocessing step of removing the background from the merged frame. The method can be applied to any DQN learning method that uses a convolution neural network as its core value function approximator.

Abstract: A virtual reality imaging system for two or more users including: at least one screen for presenting images of a virtual environment to two or more users; an imaging assembly, including two or more sets of projectors corresponding to the two or more users for producing images on the at least one screen; a tracking system that is configured to track each of the two or more users; a computer that is programmed to produce stereo 3D images of the virtual environment corresponding to tracking data from the tracking system for phone providing different views of the same virtual environment; stereo 3D glasses arranged to provide stereo 3D images; and an image separation arrangement whereby each user sees images emanating from a corresponding one of the sets of projectors only.

Abstract: A display device includes a front portion, a rear portion, a halo, and sides extending between the front portion and the rear portion. The front portion, the rear portion, and the sides form an enclosure. The halo includes a rim and an internal structure. The rim is positioned between the front portion and the rear portion. The internal structure is at least partially within the enclosure and includes a sweep portion and a receiving post. The receiving post and the sweep portion are configured to receive light emitted by one or more light emitting devices and at least one of guide, direct, diffuse, focus, and scatter light emitted by the one or more light emitting devices out of the display device.

Abstract: A display system includes an interface unit, a head worn display in wireless communication with the interface unit, and a first tracker sensor remote from a head of a user and configured to wirelessly sense a head pose and provide first head tracking data to the interface unit. The interface unit is remote from the head worn display. The display system also includes a second tracker sensor associated with the head of the user and configured to provide second head tracking data associated with the head pose to the head worn display. The interface unit is configured to receive the second head tracking data from the head worn display via at least one wireless link and provide video information for display on the head worn display via the at least one wireless link.

Abstract: A decoding method including: decoding at a current time instant a current image having at least two views respectively representative of a same scene. The decoding includes: deriving a disparity motion vector for a current block; predictively decoding the current block according to the derived disparity motion vector; and during the deriving: constructing a plurality of lists of disparity motion vectors, including at least one list in which at least two disparity motion vectors have been derived respectively according to at least two different estimation methods; applying a first function to the at least two disparity motion vectors of the at least one list, to obtain one disparity motion vector for each of the at least one list, and applying a second function to the disparity motion vectors of the plurality of lists to deliver the derived disparity motion vector.

Abstract: The methods and systems described herein provide for depth-aware image editing and interactive features. In particular, a computer application may provide image-related features that utilize a combination of a (a) the depth map, and (b) segmentation data to process one or more images, and generate an edited version of the one or more images.

Abstract: A system and method may provide for a computing system including multiple display devices. Data collected by sensors such as, for example, image sensors and positional sensors, of the display devices is leveraged to determine a position and/or an orientation of each of the display devices in the real world environment. This identification and utilization of the relative positioning of the display devices may be used to configure, and reconfigure, display settings, set display priorities, control movement of content, and respond to gesture based commands related to content management.

Abstract: An immersive experience system provides interactive content to a user while isolating the user from external stimuli in an isolation chamber. The user floats in a high-density suspension liquid maintained at the user's body temperature while consuming the interactive content which can provide audio, video and tactile inputs to the user. The user can interact with the immersive experience system via different modalities such as eye movements or gestures or via providing thought input through a visual cortex thought recorder comprised in the immersive experience system.

Abstract: Features for a lightweight stereoscopic viewing client are described. The client can generate accurate ground point coordinates from selections within the lightweight viewer by accumulating the transformations from original image sources to the images used to render the stereoscopic scene to accurately predict error for a point selection. The viewer may also be decoupled from a permanent image store allowing on-demand retrieval of images via a network for stereoscopic viewing.

Abstract: A system includes a headset to capture sound and a visual signal of a local area including one or more sound sources. The system determines a strength of the audio signal and a portion of the visual signal associated with the audio signal, compares the strengths, selects the weaker signal, and augments the weaker signal. The headset accordingly presents augmented audio-visual content to a user, thereby enhancing the user's perception of the weak signal.

Abstract: A method of autostereoscopic imaging including providing an autostereoscopic illumination unit including a lens field composed of a multiplicity of individual lenses or concave mirrors, and modulating an emission characteristic of the light source such that the individual lenses or the concave mirrors are illuminated only partly by the light source, wherein light from the light source impinges on the individual lenses or concave mirrors such that an emission characteristic of a three-dimensional object is imitated, the lens field extends over a spatial angle range of at least 2 sr relative to the light source or an external observer, the individual lenses or concave mirrors are distributed over the lens field and are at least partially sequentially irradiated, and the light source is formed by one or more lasers and the laser or each of the lasers irradiates/irradiate only one of the individual lenses at a specific point in time.

Abstract: Stereoscopic display technologies are provided. A computing device generates a stereoscopic display of an object by coordinating a first image and a second image. To reduce discomfort or to reduce diplopic content, the computing device may adjust at least one display property of the first image and/or the second image depending on one or more factors. The factors may include a time period associated with the display of the object, the vergence distance to the object, the distance to the focal plane of the display, contextual data interpreted from the images and/or any combination of these and other factors. Adjustments to the display properties can include a modification of one or more contrast properties and/or other modifications to the images. The adjustment to the display properties may be applied with varying levels of intensity and/or be applied at different times depending on one or more factors and/or contextual information.

Abstract: A unique mobile device casing or cover integrated with a camera system & 3D/multiple video & still frame viewer is disclosed, which can record 2-Dimensional (2D) and 3-Dimensional (3D) video movies and still photographs and which can be used to view both 3-D video/still image, using an attachable/detachable 3D display system is disclosed herein. The unique display disclosed herein can be used to view both 3D and 2D video/still simultaneously. The camera may have zoom, tele-photo or microscopic capability by using a unique optical system disclosed herein. The Camera disclosed herein can be used in or with mobile devices for capturing self photos or self video commonly known as “selfies”, in 3 dimension (3D) and any photography or videography application. Furthermore, the 3D camera may be used with mobile phone/devices, tablets, ipad type devices by integrating the camera and 3D display sheet, on a mobile phone/device case, tablet case or the case of an ipad type device.

Abstract: A three-dimensional (3D) measuring device and a method of operating is provided. The 3D measuring device includes a housing and a processor system including at least one of a 3D scanner controller. A 3D scanner is disposed within the housing and operably coupled to the processor system, the scanner having a light source, a beam steering unit, a first angle measuring device, a second angle measuring device, and a light receiver. The scanner cooperates with the processor system to determine 3D coordinates of an object point. A laser projector includes a second light source and a movable mirror system, the second light source positioned to emit light onto the movable mirror system. The processor system causes the light source to emit light and the mirror to move to generate a pattern on a surface in the environment based at least in part on the 3D coordinates.

Abstract: Improved techniques for providing passthrough images in the form of a stylized image embodying a novel perspective. A raw texture image of an environment is generated. A depth map is acquired for the environment. A stylized image is generated by applying a stylization filter to the raw texture image. Subsequent to acquiring the depth map and subsequent to generating the stylized image, a stylized parallax-corrected image is generated by reprojecting the stylized image to a new perspective using depth data.

Abstract: A computer simulation controller includes a camera that can be used to image a display on which a computer simulation, controlled by the controller, can be presented. The camera images information on the display, such as display identification (ID), and sends the information to a server streaming the simulation. Based on the information, the server knows to which display to stream the simulation.

Abstract: A head-mounted display apparatus including a light source module, an optical adjustment element, a display module and a lens element is provided. The light source module provides an illumination beam. The optical adjustment element and the display module are disposed on a transmission path of the illumination beam, and the display module is configured to convert the illumination beam into an image beam. The optical adjustment element is located between the light source module and the display module. The lens element is disposed on a transmission path of the image beam, wherein a transmission direction of the maximum light-emitting intensity of the illumination beam transmitted from the light source module to the optical adjustment element is different to a transmission direction of the maximum light-emitting intensity of the illumination beam transmitted from the optical adjustment element to the display module.

Abstract: A method of determining and displaying movement of an object in an environment using a moving camera includes identifying later environment features located in the environment in a later image, earlier environment features located in the environment in an earlier image, and earlier object features located on the object in the earlier image. The method further includes estimating object features in the later image using the earlier object features and a determined camera movement. The method further includes locating, in the later image, matched object features that are actual object features in the later image at a same location as the estimated object features. The method further includes determining that the object has moved between the earlier image and the later image if a number of matched object features does not exceed a threshold.

Abstract: A three-dimensional display includes a plurality of micro-projectors, each of which including a display element and a projection optic, and a micro-lens array, and each micro-projector projects a display image displayed by the display element onto the micro-lens array through the projection optic and the display element includes a drive circuit substrate and a plurality of micro light emission elements formed on a surface on one side of the drive circuit substrate.

Abstract: A three-dimensional image processing device includes: an input unit configured to acquire a first taken image and a second taken image respectively from a first imaging unit and a second imaging unit; and a stereo processing unit configured to execute stereo processing and then outputs a range image, for a common part where an imaging region of the first taken image and an imaging region of the second taken image have an overlap with each other, an imaging direction of the first imaging unit and an imaging direction of the second imaging unit are set toward a horizontal direction, and both side parts of the imaging region of the first imaging unit and both side parts of the imaging region of the second imaging unit are set as common parts.

Abstract: A terminal apparatus includes circuitry configured to receive image data of an object and three-dimensional computer graphics (3DCG) data transmitted from an image distribution apparatus, and display, on a display, a specific region image corresponding to a specific region within an image of the object as a background image, and an image of the 3DCG data as a superimposed image to be superimposed on the background image. The specific region image corresponding to the specific region is generatable from the image data of the object and the image of the 3DCG data is generatable from the 3DCG data.

Abstract: Disclosed is an object determining system comprising an optical sensor, a kind determining circuit and an element analyzing circuit. The optical sensor comprises a kind determining region and an element analyzing region, wherein the optical sensor captures at least one object image of an object via the kind determining region, and acquires element analyzing optical data via the element analyzing region. The kind determining circuit is configured to determine an object kind of the object according to the object image. The element analyzing circuit is configured to analyze element of the object according to the element analyzing optical data and the object kind. An object determining system applying tow stage object sensing steps to determine an object kind is also disclosed.

Abstract: A method of displaying a light field to at least one viewer of a light field display device, the light field based on a 3D model, the light field display device comprising a plurality of spatially distributed display elements, the method including the steps of: (a) determining the viewpoints of the eyes of the at least one viewer relative to the display device; (b) for each eye viewpoint and each of a plurality of the display elements, rendering a partial view image representing a view of the 3D model from the eye viewpoint through the display element; and (c) displaying, via each display element, the set of partial view images rendered for that display element.

Abstract: An information processing apparatus includes a controller that controls formation of an image to be formed in air so that the image and a user do not overlap each other in a space.

Abstract: Aspects of the subject disclosure may include, for example, a machine-readable medium, comprising executable instructions that, when executed by a processing system including a processor, facilitate performance of operations including receiving a base layer of a first frame of a point cloud of a volumetric video encoded in an octree format over a communication network; receiving a first enhancement layer of the first frame of the point cloud of the volumetric video encoded in the octree format responsive to available sufficient bandwidth in the communication network for delivery of the first enhancement layer; receiving a second enhancement layer of the first frame of the point cloud of the volumetric video encoded in the octree format responsive to available sufficient bandwidth in the communication network for delivery of the second enhancement layer; and rendering the first frame on a display device. Other embodiments are disclosed.

Abstract: The present invention relates to a system for providing a stereoscopic 3D 360-degree virtual reality (VR) service based on a hybrid network. According to a detailed embodiment of the present invention, standardizing and multiplexing based on an ATSC 3.0 protocol for a base layer stream, an enhancement layer stream, and a stereoscopic stream which are derived from a high resolution left eye image and a high resolution right eye image which are captured by 360-degree cameras may be performed by performing MPD signaling, and thus realistic media such as HD and UHD resolution 360-degree VR broadcast services, stereoscopic 3D 360-degree VR services, etc. may be provided. In addition, system complexity may be reduced by deriving a base layer stream, an enhancement layer stream, and a stereoscopic stream by using one encoder, and thus compression efficiency may be improved.

Abstract: An aerial image display device includes a display component, an imaging component, and a first limiter. The display component has a display surface for displaying an image. The imaging component has a first reflecting surface and a second reflecting surface that are arranged perpendicular to each other along an image formation plane of the imaging component. The imaging component forms an aerial image of the image in a display area that is symmetrical with the display surface with respect to the image formation plane. The first limiter is disposed closer to the display component than the imaging component. The first limiter limits an incident angle of incident light incident on the imaging component. The first reflection surface and the second reflection surface are inclined by an angle between 30° and 60° with respect to a median plane that includes a perpendicular of each of the display surface and the image formation plane.

Abstract: A method and system for presentation of an augmented reality experience is disclosed. The method for producing the augmented reality viewing experience comprises viewing real-world objects such as 2D and 3D works of art or other objects through a portable device such as a smart phone, tablet or augmented reality goggles. An augmented reality application controlling the augmented reality experience prompts the viewer to begin the experience. Both three-dimensional and two-dimensional multi-media presentations, such as an animation telling a story related to the real-world object are displayed on the portable device in one or more virtual screens anchored to the real-world object.

Abstract: An electronic product with a stereoscopic display device includes a main body and a stereoscopic display device. The main body includes a housing and a circuit unit. The circuit unit is disposed in the housing. The housing has an accommodating slot. The stereoscopic display device is disposed in the accommodating slot. The stereoscopic display device includes a flat panel display, a lens array layer and a microstructure layer. The lens array layer is disposed on a display surface of the flat panel display. The lens array layer is configured to adjust light field. The microstructure layer is disposed on the lens array layer. The microstructure layer is configured to modulate a direction of light. The stereoscopic display device is configured to display a stereo image that is floating in mid-air. Accordingly, a user can naturally see the stereo image floating in mid-air at an oblique viewing angle.

Abstract: Systems, apparatuses and methods may provide for technology that partitions a three-dimensional (3D) scene into a plurality of layers including at least a foreground layer and a background layer. Additionally, the foreground layer may be rendered at a first rate and the background layer may be rendered at a second frame rate, wherein the first frame rate is greater than the second frame rate. In one example, the foreground layer and the background layer are composited into a frame.

Abstract: An optical system includes a first beam shifter and a second beam shifter configured to couple with one or more display screens. The first beam shifter is configured to shift first light from a first portion of the one or more display screens in a first direction, and the second beam shifter is configured to shift second light from a second portion of the one or more display screens in a second direction that is distinct from the first direction. The second portion of the one or more display screens does not overlap with the first portion of the one or more display screens. Also disclosed are a method for increasing an effective interpupillary distance of light provided by a display screen, and a head-mounted display including the above-described optical system and one or more display screens configured to project light through the optical system.

Abstract: A liquid-crystal display device has a display that includes a display face, a plurality of first light sources, each of which emits a first light to a face on an opposite side of the display face, a second light source that differs from the first light source and emits a second light, and a scanner that scans the second light in the face. The scanner scans the second light in a predetermined region within a region to which the first light is irradiated. The second light overlaps the first lights in the predetermined region.