Abstract: A volumetric content enhancement system (“the system”) can annotate at least a portion of a plurality of voxels from a volumetric video with contextual data. The system can determine at least one actionable position within the volumetric video. The system can create an annotated volumetric video that includes the volumetric video, an annotation with the contextual data, and the at least one actionable position. The system can provide the annotated volumetric video to a volumetric content playback system. The system can obtain viewer feedback associated with the viewer and can determine an emotional state of the viewer based, at least in part, upon the viewer feedback. The system can receive viewer position information that identifies a specific actionable position of the viewer. The system can generate manipulation instructions to instruct the volumetric content playback system to manipulate the annotated volumetric content to achieve a desired emotional state of the viewer.

Abstract: One or more stereoscopic images are generated based on a single monoscopic image that may be obtained from a camera sensor. Each stereoscopic image includes a first digital image and a second digital image that, when viewed using any suitable stereoscopic viewing technique, result in a user or software program receiving a three-dimensional effect with respect to the elements included in the stereoscopic images. The monoscopic image may depict a geographic setting of a particular geographic location and the resulting stereoscopic image may provide a three-dimensional (3D) rendering of the geographic setting. Use of the stereoscopic image helps a system obtain more accurate detection and ranging capabilities. The stereoscopic image may be any configuration of the first digital image (monoscopic) and the second digital image (monoscopic) that together may generate a 3D effect as perceived by a viewer or software program.

Abstract: Provided is a control device including a control unit that calculates a first positional relationship between an eye of an observer observing an object displayed on a display unit and a first point in a master-side three-dimensional coordinate system, and controls an imaging unit that images the object so that a second positional relationship between the imaging unit and a second point corresponding to the first point in a slave-side three-dimensional coordinate system corresponds to the first positional relationship.

Abstract: Provided is a video decoding method including determining a displacement vector per unit time of pixels of a current block in a horizontal direction or a vertical direction, the pixels including a pixel adjacent to an inside of a boundary of the current block, by using values about reference pixels included in a first reference block and a second reference block, without using a stored value about a pixel located outside boundaries of the first reference block and the second reference block; and obtaining a prediction block of the current block by performing block-unit motion compensation and pixel group unit motion compensation on the current block by using a gradient value in the horizontal direction or the vertical direction of a first corresponding reference pixel in the first reference block which corresponds to a current pixel included in a current pixel group in the current block, a gradient value in the horizontal direction or the vertical direction of a second corresponding reference pixel in the sec

Abstract: Provided are a method and an apparatus for streaming a multi-view 360 degree video, and a method for streaming a 360 degree video according to an embodiment of the present disclosure includes: encoding a multi-view video to a bitstream of a base layer and a bitstream of a tile layer constituted by at least one tile; selecting a tile included in a user view video in the encoded bitstream of the tile layer by using user view information received from a 360 degree video rendering apparatus, and video information of the multi-view video; extracting tile data included in the selected user view video from the encoded bitstream of the tile layer, and generating a tile bitstream corresponding to the extracted tile data; and transmitting the encoded bitstream of the base layer and the generated tile bitstream to the 360 degree video rendering apparatus.

Abstract: Techniques for efficiently generating and displaying light-field data are disclosed. In one particular embodiment, the techniques may be realized as a method for generating light-field data, the method comprising receiving input image data, synthesizing a first plurality of viewpoints based on the input image data, synthesizing a second plurality of viewpoints based on cached image data, combining the first and second plurality of viewpoints, yielding a plurality of blended viewpoints, displaying the plurality of blended viewpoints, and caching image data associated with the plurality of blended viewpoints.

Abstract: Frames from an image stream or streams are processed by independently operating digital signal processors (DSPs), with only frame checking microprocessors operating in a lockstep mode. In one example, two DSP are operating on alternate frames. Each DSP processes the frames and produces prediction values for the next frame. The lockstep microprocessors develop their own next frame prediction. The lockstep processors compare issued frames and previously developed predicted frames for consistency. If the predictions are close enough, the issued frame passes the test. The lockstep processors then compare the issued frame to the preceding two frames for a similar consistency check. If the prior frames are also close enough, the issued frame is acceptable. In another example, hardware checkers are provided to compare the present frame with a larger number of prior frames. The hardware checkers provide comparison results to the lockstep processors to compare against allowable variation limits.

Abstract: An electronic apparatus comprising: a processor; and a memory storing a program which, when executed by the processor, causes the electronic apparatus to: acquire a VR image; read viewpoint information indicating a plurality of viewpoints with respect to the VR image; control a display device so that a part of the VR image corresponding to each viewpoint is automatically switched over in order and displayed, on a screen on a basis of the viewpoint information; and change the viewpoint so that a predetermined subject is included in the part of the VR image displayed on the screen.

Abstract: A processor system and computer-implemented method are provided for assigning view numbers to display elements of an autostereoscopic display for use in interleaving image data of different viewpoints of a scene on the basis of said assigned view numbers. The assignment is performed in an efficient yet accurate manner and may be easily adapted to different optical designs of such autostereoscopic displays, for example, in terms of pitch and/or slant of the optical elements used in such autostereoscopic displays, or to different sub-pixel layouts of the display panel.

Abstract: A device for time-based multiplexing of a projection of a three-dimensional FIG. 1 image to increase its resolution includes a two-dimensional display comprising an array of pixels. An array of optical elements is placed in front of the pixels. The optical elements are structured to refract and configure into multiple parallel light beams, in a plurality of angles, light emitted from the pixels. An array of adjustable light deflecting devices is mounted in front of the pixels. Each of the adjustable light deflecting devices is structured to deflect the light emitted by the pixels. At least one controller is configured to (1) vary at least one of the intensity or color of light emitted by each of the pixels according to three-dimensional information set for display of a three dimensional image; and (2) change a deflection angle of the light deflecting devices during a period of image integration of the human visual system.

Abstract: A method of detecting occupants in a vehicle includes detecting an oncoming vehicle and acquiring a plurality of images of occupants in the vehicle in response to detection of the vehicle. The method includes performing automated facial detection on the plurality of images and adding a facial image for each face detected to a gallery of facial images for the occupants of the vehicle. The method includes performing automated facial recognition on the gallery of facial images to group the facial images into groups based on which occupant is in the respective facial images, and counting the final group of unique facial images to determine how many occupants are in the vehicle.

Abstract: A 3D display system and a 3D display method are provided. The 3D display system includes a 3D display, a memory and one or more processors. The memory records a plurality of modules, and the processor accesses and executes the modules recorded by the memory. The modules include a bridge interface module and a 3D display service module. When an application is executed by the processor, the bridge interface module creates a virtual extend screen, and moves the application to the virtual extend screen. The bridge interface module obtains a 2D content frame of the application from the virtual extend screen by a screenshot function. The 3D display service module converts the 2D content frame into a 3D format frame by communicating with a third-party software development kit, and provides the 3D format frame to the 3D display for displaying.

Abstract: Disclosed is a data transmission system that transmits data by using a relay. The relay selects a transmission terminal from among a plurality of terminals accessing a base station. A base station transmits base station data to the relay during a first time slot, and the transmission terminal transmits terminal data to the relay. The relay transmits terminal data to the base station during a second time slot, and transmits base station data to the transmission terminal.

Abstract: In one embodiment, a computing system may receive, from a second computing system, video streams of a scene, the video streams including at least a first image and a second image that are simultaneously captured by a first camera and a second camera of the second computing system, respectively. The system may determine, using a sensor system, a viewpoint of a viewer with respect to a display region of a monoscopic display associated with the first computing system. The system may generate an output image of the scene by blending, according to blending proportions computed using the viewpoint of the viewer, corresponding portions of the first image and the second image. The system may display the output image in the display region of the monoscopic display.

Abstract: A method of synthesizing intermediate views of a light field includes selecting a configuration of specific input views of a light field collected by a light field acquiring device, specifying coordinates of intermediate views to be synthesized and inputting the specified coordinates to a neural network, and synthesizing intermediate views based on a scene disparity, a selected configuration of the specific input views, and the specified coordinates of the intermediate views, using a neural network.

Abstract: A method for decoding encoded blocks of pixels from an encoded video bit stream is provided that includes decoding a block vector corresponding to an encoded block of pixels from the encoded bit stream, verifying that the block vector indicates a block of reconstructed pixels in a search area including reconstructed pixels of a largest coding unit (LCU) including the encoded block of pixels and N left neighboring reconstructed LCUs of the LCU, and decoding the encoded block of pixels, wherein the block of reconstructed pixels is used as a predictor for the encoded block of pixels.

Abstract: The present invention relates to a system and method for capturing video of a real-world scene over a field of view that may exceed the field of view of a user, manipulating the captured video, and then stereoscopically displaying the manipulated image to the user in a head mounted display to create a virtual environment having length, width, and depth in the image. By capturing and manipulating video for a field of view that exceeds the field of view of the user, the system and method can quickly respond to movement by the user to update the display allowing the user to look and pan around, i.e., navigate, inside the three-dimensional virtual environment.

Abstract: A processor system and computer-implemented method are provided for assigning view numbers to display elements of an autostereoscopic display for use in interleaving image data of different viewpoints of a scene on the basis of said assigned view numbers. The assignment is performed in an efficient yet accurate manner and may be easily adapted to different optical designs of such autostereoscopic displays, for example, in terms of pitch and/or slant of the optical elements used in such autostereoscopic displays, or to different sub-pixel layouts of the display panel.

Abstract: An aircraft that includes a helicopter drone on which a 3D scanner is mounted via an actively rotatable joint is provided. The 3D scanner has at least one high-resolution camera for recording a multiplicity of overlapping images of the object from different recording positions and recording directions, so that comparison of the images allows a position and orientation of the 3D scanner relative to the object to be ascertained. In addition, the aircraft has a coordination device for coordinated control of the 3D scanner, the joint and the helicopter drone. The system for damage analysis has an aircraft and an image processing module generating a data representation of a surface profile of the object on the basis of the recorded images. In addition, the system includes a rating device for checking the surface profile and for outputting a damage statement on the basis of the check.

Abstract: A video display device includes LED pixels, a memory, and a processor. The processor receives video data that includes video pixels that correspond to the LED pixels. For at least some of the video pixels, the processor calculates a viewing angle for the LED pixel based on (i) a 3D location and optical axis vector for the LED pixel and (ii) a 3D location of a viewer of the LED pixel. The processor calculates a gain factor for the LED pixel based on the viewing angle and a relationship between pixel intensity and pixel viewing angle for the LED pixel. The processor calculates a compensated brightness for the LED pixel based on the gain factor and a brightness of the video pixel. The processor causes the LED pixel to emit light having the compensated brightness.