Abstract: A holographic communication device for facilitating holographic communication between a plurality of users includes a plurality of computers each located at a respective one of a plurality of locations. Each computer of the plurality of computers is in wireless communication with an extrinsic communication network. A plurality of receiver and holographic image processors each located at a respective location to capture imagery of a respective user at the respective location. Each receiver and holographic image processor is in electrical communication with a respective computer to produce a holographic image of the user who is located at the respective location such that each user who is located at each of the plurality of locations can view holographic images of other users.

Abstract: An image information acquisition apparatus acquires image information based on a captured image of surroundings of a vehicle. The acquisition apparatus acquires whether a state of each of a plurality of cameras mounted in the vehicle is a normal state or an abnormal state. The acquisition apparatus generates compensation target object image information corresponding to an abnormal camera in the abnormal state among the cameras, based on compensation source image information based on the captured image acquired by a normal camera in the normal state among the cameras. The acquisition apparatus generates the compensation target object image information, based on: the compensation source image information; and a time difference between a timing at which an image should be captured by the abnormal camera and a timing at which an image is captured by the normal camera regarding the same imaging target object.

Abstract: Provided are an image decoding method and an image decoding apparatus for performing the image decoding method, the image decoding method including: determining whether or not to obtain second transform set information; determining the second transform set information based on the determining of whether or not to obtain the second transform set information; selecting any one second transform set applied to a second transform block from among a plurality of second transform set candidates corresponding to a plurality of prediction modes, by using the determined second transform set information; generating a first transform block by inverse-transforming the second transform block based on a plurality of transform matrices included in the selected second transform set; and generating a residual block corresponding to the first transform block by inverse-transforming the first transform block based on a first transform matrix.

Abstract: Various embodiments describe an apparatus, a method, and a computer program product. An example apparatus includes at least one processor; and at least one memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to perform: encoding an input picture by using a first encoder or first encoding parameters; encoding the input picture by using a second encoder or second encoding parameters; generating a first reconstructed picture based on the encoding of the input picture by using the first encoder or the first encoding parameters; and generating a second reconstructed picture based on the encoding of the input picture by using the second encoder or the second encoding parameters.

Abstract: Various implementations disclosed herein include devices, systems, and methods that provides a view of a three-dimensional (3D) environment that includes a projection of a 3D image, such as a multi-directional stereo image or video content. For example, an example process may include obtaining a three-dimensional (3D) image including a stereoscopic image pair including left eye content corresponding to a left eye viewpoint and right eye content corresponding to a right eye viewpoint, generating a projection of the 3D image within a 3D environment by projecting portions of the 3D image to form a shape within the 3D environment, the shape based on an angle of view of the 3D image, where the 3D environment includes additional content separate from the 3D image, and providing a view of the 3D environment including the projection of the 3D image.

Abstract: Systems and methods are directed to monocular depth estimation. A method includes capturing an image; encoding the image to form an encoded image; masking one or more dynamic objects in the encoded image; predicting a final prediction performance based on one or more unmasked static objects from the encoded image; decoding and projecting the final prediction performance; and producing an information based on Global Positioning System (GPS), Inertial Measurement Unit (IMU), and wheel encoder fusion.

Abstract: A video coding method and apparatus adaptively determine spatial resolution for a horizontal component and a vertical component of a motion vector or block vector indicating a position of a reference block when performing inter prediction or intra block copy (IBC) of a current block. The video coding method and apparatus separately determine each spatial resolution for a plurality of motion vectors.

Abstract: Methods and apparatuses are provided for encoding and decoding video data based on a supplemental enhancement information (SEI) message. An exemplary method includes: generating a reconstructed frame sequence based on a compressed video; decoding a supplemental enhancement information (SEI) message with respect to the reconstructed frame sequence, according to the compressed video; and performing temporal upsampling to the reconstructed frame sequence based on the SEI message by using a neural network.

Abstract: In some embodiments, a method analyzes flagged locations from a plurality of locations in an encoding of a video to form a cluster of locations. Draft micro-chunk boundaries for the cluster are determined based on searching for a first start location and a first end location in the encoding. The method searches in a first search range before the first start location and a second search range after the first end location for a second start location in the first search range and a second end location in the second search range. The second start location and the second end location form a micro-chunk. An encoding parameter set is determined for the micro-chunk formed by the second start location and the second end location based on content characteristics of the micro-chunk. The method uses the encoding parameter set to encode the micro-chunk for insertion in the encoding of the video.

Abstract: An example device for decoding video data includes a memory configured to store video data; and one or more processors implemented in circuitry and configured to: determine a size of a current block of video data; determine an intra-prediction mode for the current block of video data; determine a mode group including the determined intra-prediction mode, the mode group being one of a plurality of mode groups, each including respective sets of intra-prediction modes; determine a set of available multiple transform selection (MTS) schemes for the current block according to the size and the intra-prediction mode for the current block; determine an MTS scheme from the set of available MTS schemes according to the determined mode group; apply transforms of the MTS scheme to a transform block of the current block to produce a residual block for the current block; and decode the current block using the residual block.

Abstract: This disclosure describes systems and methods for unrestricted intra content to improve video quality of real-time encoding. An example method may include receiving, at a logic gate included within an encoding pipeline of a video encoder, a first transform unit (TU) of a first size. The example method may also include receiving, at the logic gate, a second transform unit (TU) of a second size, wherein the first size and the second size are different. The example method may also include generating, using the logic gate, a first forward transform of the first TU and a second forward transform of the second TU.

Abstract: Methods, apparatus and system for managing an in-flight entertainment network include a method in which a first manifest file and a second manifest file are received. A first data connectivity with a first group of display devices and a second data connectivity with a second group of display devices is established. A bandwidth map and a profile map are used based on the manifest files and used for providing entertainment to the first group of display devices and the second group of display devices.

Abstract: A panoramic video camera comprises a plurality of image sensors which are configured to capture a plurality of frames at a time; an image processing circuitry configured to generate a frame read signal to read the plurality of frames generated by the plurality of camera sensors, apply a cylindrical mapping function to map the plurality of frames to a cylindrical image plane and stitch the cylindrically mapped plurality of frames together in the cylindrical image plane based on a plurality of projection parameters.

Abstract: A three-dimensional sensor control device performs processes of acquiring orthogonal coordinates of data points found in a plurality of photograph frames photographed by at least one three-dimensional sensor with a fixed photographing range and converting the orthogonal coordinates of the data points into polar coordinates using a first formula for conversion from orthogonal coordinates to polar coordinates The device then performs searching each sub-region of the photographing range to locate a set of polar coordinates representing a farthest data point that is located farthest in distance from the three-dimensional sensor in a respective sub-region and converting the polar coordinates of a collection of the farthest data points back into orthogonal coordinates using a second formula for conversion from the polar coordinates to the orthogonal coordinates, The device outputs environment map data of the photographing range using the orthogonal coordinates of the collection of the farthest data points.

Abstract: A decoding method performed by a decoding device, according to the present document, may comprise the steps of: acquiring, from a bitstream, at least one of a combined inter-picture merge and intra-picture prediction (CIIP) enable flag and a coding unit (CU) skip flag indicating whether a skip mode is applied to a current block; acquiring, from the bitstream, a regular merge flag on the basis that a condition based on the current block size, and at least one of a condition based on the CIIP enable flag and a condition based on the CU skip flag are satisfied; generating prediction samples of the current block on the basis of the regular merge flag; and generating restoration samples on the basis of the prediction samples.

Abstract: Video coding may include generating, by a processor, a decoded frame by decoding a current frame from an encoded bitstream and outputting a reconstructed frame based on the decoded frame. Decoding includes identifying a current encoded block from the current frame, identifying a prediction coding model for the current block, wherein the prediction coding model is a machine learning prediction coding model from a plurality of machine learning prediction coding models, identifying reference values for decoding the current block based on the prediction coding model, obtaining prediction values based on the prediction coding model and the reference values, generating a decoded block corresponding to the current encoded block based on the prediction values, and including the decoded block in the decoded frame.

Abstract: Techniques are disclosed for addressing “stereoscopic window violations” in stereoscopic multimedia content. Stereoscopic window violations result in the stereoscopic effect becoming “broken” for the viewer and may occur, e.g., when the left and right stereo eye views in the stereoscopic content are mismatched. Stereoscopic mismatch often occurs at the edges of the left and right eye video image frames (wherein, e.g., a depicted shape may become cut off for a left eye view but not a corresponding right eye view). According to the techniques disclosed herein, rather than permanently masking or otherwise editing the stereoscopic video content to account for any window violations, accompanying stereoscopic window violation metadata information may be generated for the stereoscopic video, which may be used to define a particular geometry for each left and right eye video image frame pair, and used at playback time to crop, mask, or otherwise modify the video image frames.

Abstract: Provided are a display apparatus and a method for manufacturing the same. The display apparatus comprises: a display panel, which comprises a plurality of pixel groups, wherein each pixel group comprises a plurality of pixels; a light-transmitting spacer layer, which is located on a light-emitting side of the display panel; and an imaging structure, which is located on the side of the light-transmitting spacer layer facing away from the display panel, and comprises a light-shielding layer, wherein the light-shielding layer comprises a plurality of light-transmitting holes matching the pixel groups, light rays emitted by the pixels pass through the light-transmitting holes, and light rays emitted by at least two pixels pass through the light-transmitting holes so as to simultaneously enter a monocular pupil of a user.

Abstract: Aspects of the disclosure provide a method and an apparatus including processing circuitry for video decoding. The processing circuitry can be configured to determine a transform skip for a transform block (TB) is in one direction. The processing circuitry can be configured to quantize transform coefficients in the TB based on a plurality of quantization steps. First transform coefficients in the TB can be quantized based on a smallest of the plurality of quantization steps. The first transform coefficients in the TB include one of a first row and a first column of the transform coefficients in the TB that has a DC spatial frequency, the one of the first row and the first column being along the one direction of the transform skip. Further, the processing circuitry can be configured to perform a transform on the quantized transform coefficients in the TB.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for performing miscalibration detection. One of the methods includes receiving sensor data from each of multiple sensors of a device in a system configured to provide augmented reality or mixed reality output to a user. Feature values are determined based on the sensor data for a predetermined set of features. The determined feature values are processed using a miscalibration detection model that has been trained, based on examples of captured sensor data from one or more devices, to predict whether a miscalibration condition of one or more of the multiple sensors has occurred. Based on the output of the miscalibration detection model, the system determines whether to initiate recalibration of extrinsic parameters for at least one of the multiple sensors or to bypass recalibration.