Abstract: The present disclosure describes systems and techniques directed to optical image stabilization movement to create a super-resolution image of a scene. The systems and techniques include a user device (102) introducing (502), through an optical image stabilization system (114), movement to one or more components of a camera system (112) of the user device (102). The user device (102) then captures (504) respective and multiple frames (306) of an image of a scene, where the respective and multiple frames (306) of the image of the scene have respective, sub-pixel offsets of the image of the scene across the multiple frames (306) as a result of the introduced movement to the one or more components of the camera system (112). The user device (102) performs (506), based on the respective, sub-pixel offsets of the image of the scene across the respective, multiple frames (306), super-resolution computations and creates (508) the super-resolution image of the scene based on the super-resolution computations.

Abstract: Techniques are described of using Position Dependent Intra Prediction Combination (PDPC). A video coder such as a video encoder or a video decoder utilizes PDPC in cases where a current block intra mode predicted using an angular intra prediction mode.

Abstract: A method for video decoding includes decoding prediction information of a current block, the prediction information being indicative of a symmetric motion vector difference mode for bi-prediction from a pair of forward and backward reference pictures. The method also includes assigning, to a reference picture marked as a long term reference picture (LTRP), a calculated picture order count with a default POC distance to the current picture, and excluding a reference picture from being in the pair of forward and backward reference pictures without a check based on a picture order count (POC) of the reference picture. The method further includes determining a first reference block for the current block in the forward reference picture and a second reference block for the current block in the backward reference picture, and reconstructing at least a sample of the current block according to the first reference block and the second reference block.

Abstract: Disclosed is an image data encoding/decoding method and apparatus. A method for decoding a 360-degree image comprises the steps of: receiving a bitstream obtained by encoding a 360-degree image; generating a prediction image by making reference to syntax information obtained from the received bitstream; combining the generated prediction image with a residual image obtained by dequantizing and inverse-transforming the bitstream, so as to obtain a decoded image; and reconstructing the decoded image into a 360-degree image according to a projection format.

Abstract: A method, computer program, and computer system is provided for coding video data. Video data having a coding tree unit size is received. The coding tree unit size associated with the video data is signaled by setting two or more flags. The video data is encoded/decoded based on the flags corresponding to the signaled coding tree unit size.

Abstract: A system and method are provided for inter-ceding video in which encoder and decoder memory requirements associated with storage of motion information related to collocated coding units is reduced. In some embodiments motion information related to only a single collocated coding unit may be stored at the encoder and decoder. In operation, if the encoder determines that motion information for a current coding unit should replace the currently stored motion information for the currently stored motion information for the collocated coding unit, then the encoder can replace the motion information at the encoder and transmit an indicator with the current coding unit to signal to the decoder that the motion information currently stored should be updated or replaced with the motion information associated with the current coding unit.

Abstract: Aspects of the present disclosure provide an image processing device that includes circuitry configured to perform a decoding process on an encoded stream for generating an image. The encoded stream is arranged into largest coding units (LCUs), and filtering parameters applicable to each LCU are provided at a beginning portion of the corresponding LCU. The circuitry is further configured to perform adaptive offset filtering on portions of the image that correspond to the LCUs using the filtering parameters set at the beginning portions of the LCUs, respectively.

Abstract: According to an embodiment disclosed in the present specification, a history-based motion vector prediction (HMVP) candidate set with respect to a current block may be derived based on a history, the HMVP candidate set may be updated or initialized according to a condition, and motion information of the current block may be derived based on the HMVP candidate set, through which inter prediction efficiency can be improved.

Abstract: Aspects of the disclosure provide methods and apparatuses for video decoding. In some examples, an apparatus includes processing circuitry. The processing circuitry decodes prediction information of a current block from a coded video bitstream. The prediction information is indicative of an intra block copy mode. Then, the processing circuitry determines, according to the intra block copy mode, a first portion of a resolution syntax. The resolution syntax is unified of a same semantic for block vectors in the intra block copy mode and motion vectors in an inter picture merge mode. Further, the processing circuitry decodes a second portion of the resolution syntax from the coded video bitstream, and determines a block vector according to a resolution that is indicated by a combination of the first portion and the second portion. Then, the processing circuitry reconstructs at least one sample of the current block according the block vector.

Abstract: A method of video processing is provided to include: deciding a coding mode used for representing a current video block of a video in a coded representation of the video; and coding the current video block into the coded representation according to the coding mode, wherein use of alternative half-pel accuracy filters in addition to a default half-pel accuracy filter for representing motion information is disabled for the current video block due to use of the coding mode.

Abstract: An object of the present invention is to provide an image processing apparatus, an image processing program, and an image processing method capable of specifying and correcting desired motion. An image processing apparatus includes: global motion estimation means for estimating global motion indicating motion of a specific region containing a specific object in a moving picture from a plurality of frame images contained in the moving picture; local motion estimation means for estimating local motion indicating motion of the specific object in the moving picture from the plurality of frame images; and image correction means for correcting the motion of the specific object or the specific region in the moving picture on the basis of the estimated global motion or the local motion.

Abstract: A moving picture coding includes: coding a first flag indicating whether or not temporal motion vector prediction is used; when the first flag indicates that the temporal motion vector prediction is used: coding a first parameter for calculating the temporal predictive motion vector; wherein when the first flag indicates that the temporal motion vector prediction is not used, the first parameter is not coded.

Abstract: In some aspects, the disclosure is directed to methods and systems for reducing memory utilization and increasing efficiency during affine merge mode for versatile video coding by utilizing motion vectors stored in a motion data line buffer for a prediction unit of a second coding tree unit neighboring a first coding tree unit to derive control point motion vectors for the first coding tree unit.

Abstract: The present disclosure concerns a method and a device for encoding or decoding video data. It concerns more particularly the encoding according to a particular encoding mode using a decoder side motion vector derivation mode referenced as frame-rate up conversion mode or FRUC mode. It concerns encoding and decoding improvement which reduce the need for memory accesses when using an encoding mode where the motion information is predicted using a decoder side motion vector derivation method.

Abstract: In an image encoding/decoding method and device according to the present invention, a candidate list for motion information prediction of a current block is generated, a control point vector of the current block is derived on the basis of the candidate list and a candidate index, a motion vector of the current block is derived on the basis of the control point vector of the current block, and inter-prediction with respect to the current block can be performed by means of the motion vector.

Abstract: A method of decoding a motion vector includes: determining at least one prediction motion vector (PMV) candidate block used to determine a PMV of a current block; determining an availability of a motion vector of the at least one PMV candidate block; when there is a PMV candidate block determined to be unavailable, determining the PMV of the current block by using a default motion vector (MV); and obtaining a motion vector of the current block based on the determined PMV.

Abstract: A method of encoding a digital video, comprising receiving a high dynamic range (HDR) master of a video, a reference standard dynamic range (SDR) master of the video, and target SDR display properties at an encoder, finding a color volume transform that converts HDR values from the HDR master into SDR values that, when converted for display on the target SDR display, are substantially similar to SDR values in the reference SDR master, converting HDR values from the HDR master into SDR values using the color volume transform, generating metadata items that identifies the color volume transform to decoders, and encoding the SDR values into a bitstream.

Abstract: A video coder is configured to determine a reference block of a reference picture for prediction of a current block of a current picture using motion information and to generate a set of reference samples for the current block of the current picture. To generate the set of reference samples, the video coder is configured to perform reference sample clipping on the reference block of the reference picture based on a size of the reference picture. The video coder is further configured to generate a prediction block for the current block of the current picture based on the set of reference samples.

Abstract: Apparatus and methods for the pre-processing of image data so as to enhance quality of subsequent encoding and rendering. In one embodiment, a capture device is disclosed that includes a processing apparatus and a non-transitory computer readable apparatus comprising a storage medium have one or more instructions stored thereon. The one or more instructions, when executed by the processing apparatus, are configured to: receive captured image data (such as that sourced from two or more separate image sensors) and pre-process the data to enable stabilization of the corresponding images prior to encoding. In some implementations, the pre-processing includes combination (e.g., stitching) of the captured image data associated with the two or more sensors to facilitates the stabilization. Advantageously, undesirable artifacts such as object “jitter” can be reduced or eliminated. Methods and non-transitory computer readable apparatus are also disclosed.

Abstract: The present disclosure relates to a technical idea of compensating for degradation of an image quality during compression in an encoding process by using a parameter trained based on machine learning within a codec. An image processing apparatus includes an input frame buffer configured to store an input original frame, an encoding processor configured to encode the stored original frame, an output stream buffer configured to output the encoded original frame as an output stream for multiplexing, and a multiplexing processor configured to control the output stream to be multiplexed and transmitted. The encoding processor outputs a filter parameter trained based on machine learning using the stored original frame and a restored frame obtained by the encoding. A device on a decoding side decodes the output stream by using the output filter parameter.

Abstract: Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. In some examples, an apparatus for video decoding includes receiving circuitry and processing circuitry. In some embodiments, the processing circuitry decodes prediction information of a current block in a current coding from a coded video bitstream. The prediction information is indicative of an intra block copy mode. Then, the processing circuitry determines a block vector that points to a reference block in a same picture as the current block. The reference block is restricted within a coding region with reconstructed samples buffered in a reference sample memory. The coding region is one of multiple predefined regions of a coding tree unit (CTU). Then, the processing circuitry reconstructs at least a sample of the current block based on the reconstructed samples of the reference block that are retrieved from the reference sample memory.

Abstract: A computing device performs a method of decoding video data by acquiring a video bitstream including data associated with multiple encoded pictures, each picture including multiple rows of coding tree units (CTUs) and each CTU including one or more coding units (CUs). A data buffer storing a plurality of history-based motion vector predictors is used for encoding the rows of CTUs and the decoding process resets the buffer before decoding a first CU of a current row of CTUs. For a current CU of the row of CTUs, a motion vector candidate list is constructed from exploiting spatial and temporal correlation of motion vectors of neighbouring code units as well as the history-based motion vector predictors in the buffer. Finally, one motion vector predictor is selected, from the motion vector candidate list, for decoding the current CU and the buffer is updated based on the selected one.

Abstract: A moving picture coding apparatus, method, and medium for coding a current block of a picture are provided. A motion vector candidate list is generated that includes motion vector candidates and, for each of the motion vector candidates, a value. The motion vector candidates include a first candidate and a second candidate. The second candidate is arranged before the first candidate in the motion vector candidate list. The first candidate is sorted before the second candidate in the motion vector candidate list based on the value of the first candidate and the value of the second candidate. The value of the first candidate is higher than the value of the second candidate. For each of the motion vector candidates, the value is based on a number of times the motion vector candidate is selected as a motion vector predictor for neighboring blocks.

Abstract: A method and an apparatus for video decoding are disclosed. The apparatus decodes prediction information of a current block from a coded video bitstream. The prediction information indicates an intra block copy mode. The current block is one of a plurality of coding blocks in a current region of a current coding tree block (CTB) in a current picture. The apparatus determines whether the current block is to be reconstructed first in the current region. When the current block is to be reconstructed first in the current region, the apparatus determines a block vector for the current block where a reference block indicated by the block vector is in a search range in the current picture that excludes a collocated region in a previously reconstructed CTB. A position of the collocated region in the previously reconstructed CTB has a same relative position as the current region in the current CTB.

Abstract: Methods, systems, and media for generating a summarized video using frame rate modification are provided. In some embodiments, a method for editing a video is provided, the method comprising: receiving, using a hardware processor, a video file; identifying a plurality of frames at a playback frame rate from the video file; generating an edited video file by extracting a subset of the plurality of frames, wherein the extracted frames in the subset of the plurality of frames are separated by a predetermined length in the plurality of frames and wherein extracting the subset of the plurality frames modifies a frame rate of at least a portion of the video file to an effective frame rate; storing the edited video file; and presenting the edited video file at the playback frame rate.

Abstract: An encoder is provided that comprises a partitioner and an entropy coder. The partitioner is configured to receive a current block of the frame and obtain a list of candidate geometric partitioning (GP) lines. Each of the candidate GP lines is generated based on information of one or more candidate neighbor blocks of the current block. The partitioner is further configured to determine a final GP line that partitions the current block into two segments, select a GP line from the list of GP lines to obtain a selected GP line, and generate a GP parameter for the current block. The GP parameter includes an offset information indicating an offset between the final GP line and the selected GP line. The entropy coder is configured to encode the GP parameter.

Abstract: The invention relates to a method for encoding, a method for decoding, an apparatus, computer program products, an encoder and a decoder for video information. The motion vector for a block in a video image is predicted from a set of motion vector prediction candidates determined based on previously-coded motion vectors. A motion vector prediction candidate is included in the set based on the location of the block associated with the first spatial motion vector prediction candidate and in comparison with motion vector prediction candidates already in the set.

Abstract: Provided is a video decoding method including: generating a merge candidate list including neighboring blocks referred to predict a motion vector of a current block in a skip mode or a merge mode; when a merge motion vector difference is used according to merge difference mode information indicating whether the merge motion vector difference and a motion vector determined from the merge candidate list are used, determining a base motion vector from a candidate determined among the merge candidate list based on merge candidate information; determining the motion vector of the current block by using the base motion vector and a merge motion vector difference of the current block, the merge motion vector difference being determined by using a distance index and direction index of the merge motion vector difference of the current block; and reconstructing the current block by using the motion vector of the current block.

Abstract: At least a method and an apparatus are presented for efficiently encoding or decoding video. For example, a prediction block for a current block is obtained. A reconstructed neighboring block of the prediction block is obtained. Filtering is performed on a boundary between the prediction block and the reconstructed neighboring block. At the encoder side, the prediction residual is obtained as the difference between the filtered prediction block and the current block, and then encoded. At the decoder side, the prediction residual is added to the filtered prediction block to reconstruct the current block.

Abstract: This application discloses a motion vector obtaining method and apparatus, a computer device, and a storage medium. In the method, an initial motion vector of a to-be-processed picture block is determined by using a location relationship between a reference block and the to-be-processed picture block. When the reference block and the to-be-processed picture block are located in a same coding tree block, a decoder uses an initial motion vector of the reference block as the initial motion vector of the to-be-processed picture block. When the reference block and the to-be-processed picture block are located in different coding tree blocks, the decoder uses a final motion vector of the reference block as the initial motion vector of the to-be-processed picture block.

Abstract: A method of processing video data comprises performing a bitstream conformance process that determines whether a bitstream that comprises an encoded representation of the video data conforms to a video coding standard, wherein the bitstream conformance process determines that the bitstream does not conform to the video coding standard when at least one of: a chroma-related constraint flag is equal to 0 and when there are no chroma components for pictures in the bitstream, or an inter prediction-related constraint flag is equal to 0 when all slices of the bitstream are I slices.

Abstract: The present invention relates to a video encoding/decoding method and apparatus. The video decoding method according to the present invention may comprise dividing a coding unit into a plurality of sub-units according to a block division structure and performing decoding based on the sub-unit, wherein the block division structure is a block division structure in which division is performed so as to include at least one sub-unit having a predetermined block form other than square and rectangle forms.

Abstract: Methods and apparatus for intra prediction in video encoding and decoding using a composite reference array are described. In one exemplary embodiment, the composite reference array is formed from two or more reference arrays of a plurality of reference arrays. The composite reference array can be formed by projecting along a prediction direction, one or more of the plurality of reference arrays onto a reference array closest to the block of the video data being encoded or decoded. The filter coefficients for the interpolation filter are then determined based on the locations of the predictors on different reference arrays. Interpolating reference samples from different reference arrays, the predictor value for a target sample can be obtained.

Abstract: Systems, methods, and instrumentalities for sub-block motion derivation and motion vector refinement for merge mode may be disclosed herein. Video data may be coded (e.g., encoded and/or decoded). A collocated picture for a current slice of the video data may be identified. The current slice may include one or more coding units (CUs). One or more neighboring CUs may be identified for a current CU. A neighboring CU (e.g., each neighboring CU) may correspond to a reference picture. A (e.g., one) neighboring CU may be selected to be a candidate neighboring CU based on the reference pictures and the collocated picture. A motion vector (MV) (e.g., collocated MV) may be identified from the collocated picture based on an MV (e.g., a reference MV) of the candidate neighboring CU. The current CU may be coded (e.g., encoded and/or decoded) using the collocated MV.

Abstract: An inter prediction method includes obtaining predicted motion information of a current image block, where the predicted motion information is used to obtain one or more motion vectors of the current image block, the motion vectors include a forward MV and a backward MV for a bidirectional inter prediction, determining a motion vector difference for the current image block, and calculating the motion vectors based on the predicted motion information and the motion vector difference, where the motion vector difference is shared by the forward MV and the backward MV.

Abstract: Various embodiments for calculating a motion vector predictor for decoding a motion vector of a current block are provided. The motion vector is selected from a candidate list. When a motion vector used for coding a first block spatially adjacent to the current block in a current picture is useable for coding the current block, one or more first candidates is added to the candidate list based on the motion vector used for coding the first block. A second candidate is added to the candidate list based on a motion vector used for coding a second block within a first collocated picture. When a total number of available candidates in the candidate list is less than a predetermined number, a third candidate is added to the candidate list based on a motion vector used for coding a third block within a second collocated picture.

Abstract: A system for decoding a video bitstream includes receiving a bitstream and a plurality of enhancement bitstreams together with receiving a video parameter set and a video parameter set extension. The system also receives an output layer set change message including information indicating a change in at least one output layer set.

Abstract: Methods, systems, and non-transitory computer readable storage media are disclosed for two-phase encoding a digital video based on downsampling distortion of the digital video and a constant rate factor transition threshold. For example, the disclosed system can determine a downsampling distortion indicating a measure of distortion resulting from downsampling an input digital video. The disclosed systems can utilize the downsampling distortion to determine a constant rate factor transition threshold for selecting sets of encoding parameters. For example, the disclosed systems can select a first set of encoding parameters below the constant rate factor transition threshold and a second set of encoding parameters at or above the constant rate factor transition threshold. Additionally, the disclosed systems can generate first and second sets of digital video encodings of the input digital video by utilizing the first and second sets of encoding parameters, respectively.

Abstract: An image decoding method is disclosed in the present specification. An image decoding method according to the present invention may include: determining a position of a co-located block of a current block within a co-located picture (co-located picture); determining a representative motion vector of the current block by using motion information at the position of the co-located block; and deriving motion information on a sub-block included in the current block by using the representative motion vector.

Abstract: According to embodiments of the disclosure, information of higher and lower quality encoded video segments is used to limit Rate-Distortion Optimization (RDO) for each Coding Unit Tree (CTU). A method first encodes the highest bit-rate segment and consequently uses it to encode the lowest bit-rate video segment. Block structure and selected reference frame of both highest and lowest bit-rate video segments are used to predict and shorten RDO process for each CTU in middle bit-rates. The method delays just one frame using parallel processing. This approach provides time-complexity reduction compared to the reference software for middle bit-rates while degradation is negligible.

Abstract: There is provided an image processing apparatus and method that make it possible to suppress degradation of the encoding efficiency. In the case where primary transform that is a transform process for a prediction residual that is a difference between an image and a prediction image of the image is to be skipped, also secondary transform, which is a transform process for a primary transform coefficient obtained by the primary transform of the prediction residual, is skipped. The present disclosure can be applied, for example, to an image processing apparatus, an image encoding apparatus, an image decoding apparatus and so forth.

Abstract: A method of visual media processing includes determining, for a conversion between a current video block of visual media data and a bitstream representation of the current video block, a buffer that stores reference samples for prediction in an intra block copy mode; for a sample spatially located at location of the current video block relative to an upper-left position of a coding tree unit including the current video block and having a block vector, computing a corresponding reference in the buffer at a reference location, wherein the reference location is determined using the block vector and the location; and upon determining that the reference location lies outside the buffer, re-computing the reference location based at least in part on a location of the current video block relative to the coding tree unit including the current video block.

Abstract: Disclosed is an image data encoding/decoding method and apparatus. A method for decoding a 360-degree image comprises the steps of: receiving a bitstream obtained by encoding a 360-degree image; generating a prediction image by making reference to syntax information obtained from the received bitstream; combining the generated prediction image with a residual image obtained by dequantizing and inverse-transforming the bitstream, so as to obtain a decoded image; and reconstructing the decoded image into a 360-degree image according to a projection format.

Abstract: Embodiments of video coding systems and methods are described for reducing coding latency introduced by decoder-side motion vector refinement (DMVR). In one example, two non-refined motion vectors are identified for coding of a first block of samples (e.g. a first coding unit) using bi-prediction. One or both of the non-refined motion vectors are used to predict motion information for a second block of samples (e.g. a second coding unit). The two non-refined motion vectors are refined using DMVR, and the refined motion vectors are used to generate a prediction signal of the first block of samples. Such embodiments allow the second block of samples to be coded substantially in parallel with the first block without waiting for completion of DMVR on the first block. In additional embodiments, optical-flow-based techniques are described for motion vector refinement.

Abstract: The present disclosure provides methods and devices of construct a candidate merge list for Intra block copy (IBC) mode, the method comprising: inserting a block vector of a left neighboring block of a current block into an initial merge list, when the left neighboring block is available and the left neighboring block is using IBC mode; inserting a block vector of an above neighboring block of the current block into the initial merge list, when the above neighboring block is available, the above neighboring block is using IBC mode and the block vector of the above neighboring block is not same as the block vector of the left neighboring block; inserting a block vector of the last candidate in a history based motion vector predictor (HMVP) into the initial merge list; obtaining a block vector of the current block according to the initial merge list.

Abstract: Disclosed is an image data encoding/decoding method and apparatus. A method for decoding a 360-degree image comprises the steps of: receiving a bitstream obtained by encoding a 360-degree image; generating a prediction image by making reference to syntax information obtained from the received bitstream; combining the generated prediction image with a residual image obtained by dequantizing and inverse-transforming the bitstream, so as to obtain a decoded image; and reconstructing the decoded image into a 360-degree image according to a projection format.

Abstract: Disclosed is an image data encoding/decoding method and apparatus. A method for decoding a 360-degree image comprises the steps of: receiving a bitstream obtained by encoding a 360-degree image; generating a prediction image by making reference to syntax information obtained from the received bitstream; combining the generated prediction image with a residual image obtained by dequantizing and inverse-transforming the bitstream, so as to obtain a decoded image; and reconstructing the decoded image into a 360-degree image according to a projection format.

Abstract: An image encoding/decoding method and apparatus are provided. An image decoding method performed by an image decoding apparatus according to the present invention may comprise deriving an intra-prediction mode of a current block, and performing intra-prediction for the current block based on the intra-prediction mode. The deriving of the intra-prediction mode may comprise decoding a predetermined mode sameness indicator.

Abstract: A method and apparatus of prediction for video coding using MH (Multiple Hypothesis) mode are disclosed. According to this method, a block is partitioned into a first partition and a second partition. A first candidate and a second candidate are derived for the first and second partitions respectively. At least one of the first candidate and the second candidate is derived using a candidate list derived for a regular Merge mode (or also called as normal Merge mode). An MH prediction generated by blending a first prediction corresponding to a first candidate and a second prediction corresponding to a second candidate, and the MH prediction is applied to a part of the current block.

Abstract: An example device for coding video data includes a memory configured to store video data; and one or more processors implemented in circuitry and configured to: determine that a size of a current block of the video data is less than a threshold, the current block being a two-dimensional array of samples representing a portion of a picture; determine a set of motion vector prediction candidates for the current block according to the determination that the size of the current block is less than the threshold; select a motion vector predictor of the motion vector prediction candidates for the current block; code motion information of the current block using the motion vector predictor; and code the current block using the motion information.