Abstract: Various embodiments describe an apparatus, a method, and a computer program product. An example apparatus includes at least one processor; and at least one memory storing instructions that, when executed by the at least one processor, cause the apparatus at least to perform: encoding an input picture by using a first encoder or first encoding parameters; encoding the input picture by using a second encoder or second encoding parameters; generating a first reconstructed picture based on the encoding of the input picture by using the first encoder or the first encoding parameters; and generating a second reconstructed picture based on the encoding of the input picture by using the second encoder or the second encoding parameters.

Abstract: Various implementations disclosed herein include devices, systems, and methods that provides a view of a three-dimensional (3D) environment that includes a projection of a 3D image, such as a multi-directional stereo image or video content. For example, an example process may include obtaining a three-dimensional (3D) image including a stereoscopic image pair including left eye content corresponding to a left eye viewpoint and right eye content corresponding to a right eye viewpoint, generating a projection of the 3D image within a 3D environment by projecting portions of the 3D image to form a shape within the 3D environment, the shape based on an angle of view of the 3D image, where the 3D environment includes additional content separate from the 3D image, and providing a view of the 3D environment including the projection of the 3D image.

Abstract: Systems and methods are directed to monocular depth estimation. A method includes capturing an image; encoding the image to form an encoded image; masking one or more dynamic objects in the encoded image; predicting a final prediction performance based on one or more unmasked static objects from the encoded image; decoding and projecting the final prediction performance; and producing an information based on Global Positioning System (GPS), Inertial Measurement Unit (IMU), and wheel encoder fusion.

Abstract: A video coding method and apparatus adaptively determine spatial resolution for a horizontal component and a vertical component of a motion vector or block vector indicating a position of a reference block when performing inter prediction or intra block copy (IBC) of a current block. The video coding method and apparatus separately determine each spatial resolution for a plurality of motion vectors.

Abstract: Methods and apparatuses are provided for encoding and decoding video data based on a supplemental enhancement information (SEI) message. An exemplary method includes: generating a reconstructed frame sequence based on a compressed video; decoding a supplemental enhancement information (SEI) message with respect to the reconstructed frame sequence, according to the compressed video; and performing temporal upsampling to the reconstructed frame sequence based on the SEI message by using a neural network.

Abstract: In some embodiments, a method analyzes flagged locations from a plurality of locations in an encoding of a video to form a cluster of locations. Draft micro-chunk boundaries for the cluster are determined based on searching for a first start location and a first end location in the encoding. The method searches in a first search range before the first start location and a second search range after the first end location for a second start location in the first search range and a second end location in the second search range. The second start location and the second end location form a micro-chunk. An encoding parameter set is determined for the micro-chunk formed by the second start location and the second end location based on content characteristics of the micro-chunk. The method uses the encoding parameter set to encode the micro-chunk for insertion in the encoding of the video.

Abstract: An example device for decoding video data includes a memory configured to store video data; and one or more processors implemented in circuitry and configured to: determine a size of a current block of video data; determine an intra-prediction mode for the current block of video data; determine a mode group including the determined intra-prediction mode, the mode group being one of a plurality of mode groups, each including respective sets of intra-prediction modes; determine a set of available multiple transform selection (MTS) schemes for the current block according to the size and the intra-prediction mode for the current block; determine an MTS scheme from the set of available MTS schemes according to the determined mode group; apply transforms of the MTS scheme to a transform block of the current block to produce a residual block for the current block; and decode the current block using the residual block.

Abstract: This disclosure describes systems and methods for unrestricted intra content to improve video quality of real-time encoding. An example method may include receiving, at a logic gate included within an encoding pipeline of a video encoder, a first transform unit (TU) of a first size. The example method may also include receiving, at the logic gate, a second transform unit (TU) of a second size, wherein the first size and the second size are different. The example method may also include generating, using the logic gate, a first forward transform of the first TU and a second forward transform of the second TU.

Abstract: Methods, apparatus and system for managing an in-flight entertainment network include a method in which a first manifest file and a second manifest file are received. A first data connectivity with a first group of display devices and a second data connectivity with a second group of display devices is established. A bandwidth map and a profile map are used based on the manifest files and used for providing entertainment to the first group of display devices and the second group of display devices.

Abstract: A panoramic video camera comprises a plurality of image sensors which are configured to capture a plurality of frames at a time; an image processing circuitry configured to generate a frame read signal to read the plurality of frames generated by the plurality of camera sensors, apply a cylindrical mapping function to map the plurality of frames to a cylindrical image plane and stitch the cylindrically mapped plurality of frames together in the cylindrical image plane based on a plurality of projection parameters.

Abstract: A three-dimensional sensor control device performs processes of acquiring orthogonal coordinates of data points found in a plurality of photograph frames photographed by at least one three-dimensional sensor with a fixed photographing range and converting the orthogonal coordinates of the data points into polar coordinates using a first formula for conversion from orthogonal coordinates to polar coordinates The device then performs searching each sub-region of the photographing range to locate a set of polar coordinates representing a farthest data point that is located farthest in distance from the three-dimensional sensor in a respective sub-region and converting the polar coordinates of a collection of the farthest data points back into orthogonal coordinates using a second formula for conversion from the polar coordinates to the orthogonal coordinates, The device outputs environment map data of the photographing range using the orthogonal coordinates of the collection of the farthest data points.

Abstract: A decoding method performed by a decoding device, according to the present document, may comprise the steps of: acquiring, from a bitstream, at least one of a combined inter-picture merge and intra-picture prediction (CIIP) enable flag and a coding unit (CU) skip flag indicating whether a skip mode is applied to a current block; acquiring, from the bitstream, a regular merge flag on the basis that a condition based on the current block size, and at least one of a condition based on the CIIP enable flag and a condition based on the CU skip flag are satisfied; generating prediction samples of the current block on the basis of the regular merge flag; and generating restoration samples on the basis of the prediction samples.

Abstract: Video coding may include generating, by a processor, a decoded frame by decoding a current frame from an encoded bitstream and outputting a reconstructed frame based on the decoded frame. Decoding includes identifying a current encoded block from the current frame, identifying a prediction coding model for the current block, wherein the prediction coding model is a machine learning prediction coding model from a plurality of machine learning prediction coding models, identifying reference values for decoding the current block based on the prediction coding model, obtaining prediction values based on the prediction coding model and the reference values, generating a decoded block corresponding to the current encoded block based on the prediction values, and including the decoded block in the decoded frame.

Abstract: Techniques are disclosed for addressing “stereoscopic window violations” in stereoscopic multimedia content. Stereoscopic window violations result in the stereoscopic effect becoming “broken” for the viewer and may occur, e.g., when the left and right stereo eye views in the stereoscopic content are mismatched. Stereoscopic mismatch often occurs at the edges of the left and right eye video image frames (wherein, e.g., a depicted shape may become cut off for a left eye view but not a corresponding right eye view). According to the techniques disclosed herein, rather than permanently masking or otherwise editing the stereoscopic video content to account for any window violations, accompanying stereoscopic window violation metadata information may be generated for the stereoscopic video, which may be used to define a particular geometry for each left and right eye video image frame pair, and used at playback time to crop, mask, or otherwise modify the video image frames.

Abstract: Provided are a display apparatus and a method for manufacturing the same. The display apparatus comprises: a display panel, which comprises a plurality of pixel groups, wherein each pixel group comprises a plurality of pixels; a light-transmitting spacer layer, which is located on a light-emitting side of the display panel; and an imaging structure, which is located on the side of the light-transmitting spacer layer facing away from the display panel, and comprises a light-shielding layer, wherein the light-shielding layer comprises a plurality of light-transmitting holes matching the pixel groups, light rays emitted by the pixels pass through the light-transmitting holes, and light rays emitted by at least two pixels pass through the light-transmitting holes so as to simultaneously enter a monocular pupil of a user.

Abstract: Aspects of the disclosure provide a method and an apparatus including processing circuitry for video decoding. The processing circuitry can be configured to determine a transform skip for a transform block (TB) is in one direction. The processing circuitry can be configured to quantize transform coefficients in the TB based on a plurality of quantization steps. First transform coefficients in the TB can be quantized based on a smallest of the plurality of quantization steps. The first transform coefficients in the TB include one of a first row and a first column of the transform coefficients in the TB that has a DC spatial frequency, the one of the first row and the first column being along the one direction of the transform skip. Further, the processing circuitry can be configured to perform a transform on the quantized transform coefficients in the TB.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for performing miscalibration detection. One of the methods includes receiving sensor data from each of multiple sensors of a device in a system configured to provide augmented reality or mixed reality output to a user. Feature values are determined based on the sensor data for a predetermined set of features. The determined feature values are processed using a miscalibration detection model that has been trained, based on examples of captured sensor data from one or more devices, to predict whether a miscalibration condition of one or more of the multiple sensors has occurred. Based on the output of the miscalibration detection model, the system determines whether to initiate recalibration of extrinsic parameters for at least one of the multiple sensors or to bypass recalibration.

Abstract: The present disclosure relates to methods and apparatuses for decoding data for (still or video processing into a bitstream). Two or more sets of segmentation information elements are obtained from the bitstream. Then, each of the two or more sets of segmentation information elements are inputted respectively into two or more segmentation information processing layers out of a plurality of cascaded layers. In each of the two or more segmentation information processing layers, the respective sets of segmentation information are processed. The decoded data for picture or video processing are obtained based on the segmentation information processed by the plurality of cascaded layers. Accordingly, the data may be decoded from the bitstream in an efficient manner in the layered structure.

Abstract: Examples of video encoding methods and apparatus and video decoding methods and apparatus are described. An example method of video processing includes performing a conversion between a video and a bitstream of the video according to a rule. At least one of the one or more parameter sets of the bitstream includes a general syntax structure including timing and hypothetical reference decoder (HRD) parameters. The rule specifies that a first syntax flag is not included in the general syntax structure in response to (1) a second syntax flag specifying that network abstraction layer (NAL) HRD parameters are not present in the general syntax structure, and (2) a third syntax flag specifying that video coding layer (VCL) HRD parameters are not present in the general syntax structure, where the first syntax flag specifies that same picture-level timing information applies to all output layer sets in the bitstream.

Abstract: The various implementations described herein include methods and systems for coding video (e.g., decoding video data). In one aspect, a method includes identifying, in a current frame, a current coding block and one or more neighboring coding blocks. The current coding block has a first luma sample. The method further includes identifying a plurality of candidate luma samples within the one or more neighboring coding blocks for the first luma sample. The one or more neighboring coding blocks are coded in 4:2:0 chroma color format. The method further includes identifying a target luma sample among the plurality of candidate luma samples including a 2×2 luma block and determining a first chroma sample co-located with the first luma sample based on a target chroma sample co-located with the target luma sample in the one or more neighboring coding blocks.