Abstract: A method dynamically selects one of a first sampling order and a second sampling order for a ray trace of pixels in a tile where the selection is based on a motion vector for the tile. The sampling order may be a bowtie pattern or an hourglass pattern. Subframes generated based on the sampling order are communicated over a bus along with motion vectors for tiles of the subframes.

Abstract: An apparatus for encoding a current frame of a video. The apparatus includes a memory and a processor. The processor is configured to execute instructions stored in the memory to generate, for each reference frame of a subset of available reference frames, at least one respective candidate global motion model (GMM); partition the current frame into blocks; generate an aggregated residual frame for the current frame; and encode the respective residual blocks in a compressed bitstream. To generate the aggregated residual frame includes to select, for predicting each block of the blocks, a respective selected GMM, where the respective selected GMM corresponds to the one of the at least one respective candidate GMMs that minimizes a total error associated with the aggregated residual frame; and obtain respective residual blocks for the block.

Abstract: A moving picture coding apparatus, method, and medium for coding a current block are provided. A first candidate is derived from a first motion vector that has been used to decode a first block. The first block is adjacent to the current block. A first index identifying a reference picture to be selected for coding the current block is coded. A second candidate having a second motion vector that includes a non-zero value is derived. The non-zero value is assigned to the reference picture. A selected candidate is selected from a plurality of candidates, including the first candidate and the second candidate. A second index identifying the selected candidate is coded. The current block is coded using the selected candidate. The second candidate includes the non-zero value of the reference picture, with the reference picture being selected from a plurality of referable reference pictures.

Abstract: A method of video decoding includes maintaining a number of tables, wherein each table includes a set of motion candidates, wherein each motion candidate is associated with corresponding motion information derived from previously video blocks, performing a conversion between a video block and a coded representation of the video block, and determining, based on a conversion condition of the video block, whether to update at least one of the tables by adding motion information corresponding to the video block.

Abstract: According to the present invention, there is provided A method of encoding a three-dimensional (3D) image, the method comprising: determining a prediction mode for a current block as an inter prediction mode; determining whether a reference block corresponding to the current block in a reference picture has motion information; when the reference block has the motion information, deriving motion information on the current block for each sub prediction block in the current block; and deriving a prediction sample for the current block based on the motion information on the current block.

Abstract: Devices, systems and methods for processing video are described. In a representative aspect, a video processing method is provided to comprise: maintaining tables, wherein each table includes a set of motion candidates and each motion candidate is associated with corresponding motion information; performing a conversion between a first video block and a bitstream representation of a video including the first video block based on the tables; and updating, after performing of the conversion, zero or more tables, based on an update rule.

Abstract: A video decoder system, in one embodiment, includes one or more processors and a memory storing instructions that when executed by the one or more processors cause the video decoding system to perform an entropy decoding operation in a frame level pipelined manner on a bitstream representative of encoded video data to produce first output data, perform at least one of an inverse quantization operation or an inverse frequency transform operation in a row level pipelined manner on the first output data to produce second output data, perform a deblocking filtering operation on first input data that includes the second output data in a row level pipelined manner to produce third output data, and output a decoded video output based on the third output data.

Abstract: An image coding method includes: deriving a candidate for a motion vector of a current block from a co-located motion vector; adding the candidate to a list; selecting the motion vector of the current block from the list; and coding the current block, wherein the deriving includes: deriving the candidate by a first derivation scheme in the case of determining that each of a current reference picture and a co-located reference picture is a long-term reference picture; and deriving the candidate by a second derivation scheme in the case of determining that each of the current reference picture and the co-located reference picture is a short-term reference picture.

Abstract: Methods and apparatus of motion compensation using the bi-directional optical flow (BIO) techniques are disclosed. According to one method of the present invention, the BIO process is applied to encode or decode bi-directional current block in Merge mode only or in AMVP (advanced motion vector prediction) mode only. According to another method, the BIO process conditionally to encode or decode the current block depending on a jointly-coded flag if the current block is coded using a bi-prediction mode. According to yet another method, x-offset value vx and y-offset value vy for the current block are added to the current motion vector to form a final motion vector. The final motion vector is then used as a reference motion vector for following blocks. In still yet another method, the BIO process is applied to the chroma component.

Abstract: The image decoding method includes: determining a context for use in a current block to be processed, from among a plurality of contexts; and performing arithmetic decoding on a bit sequence corresponding to the current block, using the determined context, wherein in the determining: the context is determined under a condition that control parameters of neighboring blocks of the current block are used, when the signal type is a first type, the neighboring blocks being a left block and an upper block of the current block; and the context is determined under a condition that the control parameter of the upper block is not used, when the signal type is a second type, and the second type is one of “ref_idx_l0” and “ref_idx_l1”.

Abstract: An image encoding method is used for encoding a current picture on a block-by-block basis and includes: generating a reference picture list by (i) assigning a reference picture index to a reference picture referable for encoding the current picture and (ii) including the reference picture assigned the reference picture index into the reference picture list; and encoding a current block included in the current picture with reference to a reference picture that is specified, from the reference picture list, for encoding the current block, wherein, when a reference picture belonging to a reference view different from a current view to which the current picture belongs has a chance of being referenced for encoding the current picture, the reference picture belonging to the reference view is added to the reference picture list in the generating.

Abstract: Motion vectors of a first reference frame are permitted to point to a plurality of further reference frames. A method of storing the motion vectors comprises, when a block of the first reference frame has two motion vectors (V2A, V2B) initially, selecting one of the two motion vectors, the non-selected motion vector not being stored. The selected motion vector may be scaled. This can reduce the motion vector memory size.

Abstract: A method of controlling intra prediction for decoding or encoding of a video sequence, is performed by at least one processor and includes obtaining intra prediction modes including directional modes respectively corresponding to angular prediction directions, a first amount of one or more of the directional modes being excluded from the intra prediction modes based on a second amount of the intra prediction modes and a third amount of most probable modes (MPMs). The method further includes selecting, as the MPMs, two or more of the intra prediction modes from which the one or more of the directional modes are excluded, and selecting, for decoding the video sequence, one of the intra prediction modes from which the one or more of the directional modes are excluded.

Abstract: The presently disclosed subject matter includes a computerized method and system of clustering data-subsets of one or more structured or semi-structured data sources, each data-subset comprising data-values. For each data-subset (e.g. column) in a group of data-subsets extracted from the one or more structured or semi-structured data sources, a respective vector indicative of characters' position distribution in data-values in the data-subset is generated, thereby giving rise to a group of vectors; for each vector in the group of vectors, a respective proxy hash value is calculated, and data-subsets of respective proxy hash values are assigned to clusters according to similarity between the respective proxy hash values and between the respective vectors.

Abstract: A method of video decoding includes maintaining a number of tables, wherein each table includes a set of motion candidates and each motion candidate is associated with corresponding motion information derived from previously coded video blocks, performing a conversion between a current video block and a bitstream representation of the current video block in a video region, and updating the one or more tables based on an updating rule.

Abstract: An image prediction method and apparatus includes obtaining predicted motion information of an image block; determining an initial predicted block of the image block according to the predicted motion information and a reference image of the image block; performing, according to the predicted motion information, L iterative searches in the reference image using an integer pixel step size to obtain an intermediate predicted block of the image block; performing a single search in the reference image using a fractional pixel step size to obtain M predicted blocks of the image block; determining a target predicted block of the image block according to the M predicted blocks and the intermediate predicted block; and obtaining a predicted value of a pixel value of the image block according to a pixel value of the target predicted block.

Abstract: Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. An apparatus for video decoding includes processing circuitry. The processing circuitry checks an inferable condition for a flag of a specific prediction mode for a current block before parsing the flag of the specific prediction mode for the current block from a coded video bitstream. The specific prediction mode is one of a plurality of inter picture prediction modes. When the inferable condition indicates that the flag is inferable, the processing circuitry infers the flag without parsing the flag from the coded video bitstream. When the inferable condition indicates uncertainty for inferring the flag, the processing circuitry parses the flag from the coded video bitstream. Then, the processing circuitry reconstructs the current block according to the specific prediction mode when the flag is indicative of an application of the specific prediction mode on the current block.

Abstract: The present invention relates to an image processing device and method which enable encoding efficiency in intra prediction to be improved. In the event that the optimal intra prediction mode is mode 0, adjacent pixels to be used for prediction of the current block are pixels A0, A1, A2, and A3. According to these pixels and a 6-tap FIR filter, pixels a?0.5, a+0.5, and so on with ½ pixel precision are generated, and further, pixels a?0.75, a?0.25, a+0.25, and a+0.75 with ¼ pixel precision are generated by linear interpolation. Subsequently, the optimal shift amount is determined with a value of ?0.75 through +0.75 that is phase difference between an integer pixel and generated fractional pixel precision serving as a candidate of the shift amount in the horizontal direction. The present invention may be applied to an image encoding device which performs encoding using the H.264/AVC system, for example.

Abstract: The present invention relates to the encoding and decoding of image information. According to the present invention, the decoding method comprises the steps of: entropy-decoding received information; performing inter prediction on a current block based on the entropy-decoded information; and restoring images by using the prediction results, wherein, in the inter prediction step, a skip mode or merge mode is applied to the current block and movement information of the current block may be determined based on the movement information of a neighboring block of the current block.

Abstract: processors set a search-range from a first processing-block to a side closer to the first processing-block by a size of a second processing-block from a boundary between a refreshed area and an unrefreshed area in a second picture preceding a first picture in which the first processing-block exists in the encoding order, detect a first motion vector for the first processing-block in the search-range, perform a weighted average of a second motion vector detected in the second processing-block around the first processing-block and the first motion vector to obtain the first motion vector, generate first prediction data by using the first motion vector and the second picture, use another block in an intra slice line of the first picture to generate second prediction data in the block in the intra slice line, and encode the first picture by using the first and second prediction data.

Abstract: A method of video processing is provided to include maintaining one or more tables, wherein each table includes one or more motion candidates and each motion candidate is associated with corresponding motion information; performing a conversion between a current block and a bitstream representation of a video including the current block by using motion information in a table; and updating, after performing of the conversion, one or more tables based on M sets of additional motion information associated with the current block, M being an integer.

Abstract: An index, indicating a vector representing a spatial relationship between a block to be encoded and at least one block spatially at the periphery of the block to be encoded, is encoded in a case where an coding mode to encode the block to be encoded is a first coding mode, and an index, indicating a vector representing a spatial relationship between the block to be encoded and at least one block spatially at the periphery of the block to be encoded, and a vector correlated with a block within an image that is different from the image to be encoded, is encoded in a case where the coding mode to encode the block to be encoded is a second coding mode.

Abstract: There is provided a method of decoding an image, the method comprising: decoding information for motion information prediction of a current block from a bitstream, predicting motion information of the current block based on the information, refining motion information of the current block by using the decoded information and the predicted motion information of the current block and reconstructing the current block based on the refined motion information of the current block.

Abstract: A method includes receiving a reference frame, determining, for a current block, a scaling constant; scaling a block of the reference frame according to the scaling constant, the block of the reference frame corresponding to the current block, and reconstructing pixel data of the current block and using the scaled block of the reference frame. Related apparatus, systems, techniques and articles are also described.

Abstract: Devices, systems and methods for encoding and decoding digital video historical information such as tables containing coding candidates are described. In a representative aspect, a method for video processing includes maintaining an Advanced Motion Vector Prediction (AMVP) candidate list for a conversion between a video block of a video and a bitstream representation of the video with a motion vector precision of M-Pel or sub-pel selected from multiple available motion vector precisions, M being a positive integer. The method also includes comparing an AMVP candidate associated with the video block with existing AMVP candidates in the AMVP candidate list, adding the AMVP candidate to the AMVP candidate list upon determining that the AMVP candidate is different than the existing candidates, and performing the conversion based on the AMVP candidate list.

Abstract: Disclosed is an inter prediction method which includes deriving control points (CPs) for the current block, wherein the CPs include a first CP and a second CP, deriving a first motion vector predictor (MVP) for the first CP and a second MVP for the second CP based on neighboring blocks of the current block, decoding a first motion vector difference (MVD) for the first CP, decoding a difference of two MVDs (DMVD) for the second CP, deriving a first motion vector (MV) for the first CP based on the first MVP and the first MVD, deriving a second MV for the second CP based on the second MVP and the DMVD for the second CP, and generating a predicted block for the current block based on the first MV and the second MV.

Abstract: An encoder includes circuitry and memory. Using the memory, the circuitry performs prediction on an image. A motion vector predictor list used in the prediction includes a spatially neighboring motion vector predictor obtained from a block spatially neighboring a current block, and a spatially broad motion vector predictor obtained from a block positioned at any of a plurality of predetermined positions in a second range that is broader than a first range that spatially neighbors the current block. The plurality of predetermined positions are defined by a regular interval using the top-left of a current picture as a reference point.

Abstract: Disclosed are a method for encoding a video signal and a device therefor. Specifically, a method for decoding an image based on an inter prediction mode comprises: generating a merging candidate list by using a spatial merge candidate and a temporal merge candidate of a current block; obtaining a merge index indicating a certain merge candidate in the merging candidate list; and generating a prediction block of the current block by using motion information of the certain merge candidate, wherein the generating of the merging candidate list may include adding a first merge candidate indicating a collocated block specified by motion information of the spatial merge candidate to the merging candidate list if a reference picture of the spatial merge candidate is same as a predetermined picture.

Abstract: A system and method for scalable video coding that includes base layer having lower resolution encoding, enhanced layer having higher resolution encoding and the data transferring between two layers. The system and method provides several methods to reduce bandwidth of inter-layer transfers while at the same time reducing memory requirements. Due to less memory access, the system clock frequency can be lowered so that system power consumption is lowered as well. The system avoids having prediction data from base layer to enhanced layer to be up-sampled for matching resolution in the enhanced layer as transferring up-sampled data can impose a big burden on memory bandwidth.

Abstract: An example video coding system may determine a first coding mode for a first block of video data of a plurality of blocks of video data in a processing area. The video coding system may compare a characteristic of the processing area to a threshold. The video coding system may determine whether to enable or disable use of a second coding mode for the remainder of the plurality of blocks of video data in the processing area based on the comparison. The video coding system may code the first block based on the first coding mode and code at least one block of the remainder of the plurality of blocks of video data based on the comparison.

Abstract: In the present invention, an inter-prediction mode based image processing method and an apparatus therefor are disclosed. Specifically, the inter-prediction based image processing method may comprise the steps of: deriving movement information of a control point for specifying a reference block of a current block; dividing the current block into sub-blocks; deriving movement information of the sub-blocks using the movement information of the control point; and generating a prediction block for each sub-block using the movement information of the sub-blocks.

Abstract: Innovations in motion estimation adapted for screen remoting scenarios are described. For example, a video encoder calculates a hash value for a current block in a current picture. The video encoder searches, subject to a spatial constraint, for a matching block in a reference picture (e.g., the previous picture in display order) based at least in part on the hash value for the current block. The spatial constraint defines a search area in the reference picture within which hash values for candidate blocks in the reference picture may be compared to the hash value for the current block. By using a spatial constraint to limit the range of the local hash-based motion estimation, the video encoder can speed up the motion estimation process while still considering the candidate blocks in the reference picture that are most likely to match the current block.

Abstract: A method and apparatus for encoding or decoding a video sequence includes applying a Cross-Component Linear Model (CCLM) to a video sequence, and applying an interpolation filter in the Cross-Component Linear Model (CCLM), wherein the interpolation filter is dependent upon a YUV format of the video sequence.

Abstract: A method and device for deriving motion information of an image portion of an image predicted by motion prediction with respect to at least one reference image, the method comprising for said image portion: obtaining a number i of motion information predictors 808 of a second set of motion information predictors 814 taken from a first set of motion information predictors for decoding the image portion; generating said second set of motion information predictors 814 consisting of said number i of motion information predictors, wherein there are no duplicates among the i motion information predictors of said second set. A method and device for of decoding a bitstream, and a method and device for encoding a sequence of image including a method for deriving motion information of an image portion of an image predicted by motion prediction with respect to at least one reference image as described above.

Abstract: Approaches to selection of motion vector (“MV”) precision during video encoding are presented. These approaches can facilitate compression that is effective in terms of rate-distortion performance and/or computational efficiency. For example, a video encoder determines an MV precision for a unit of video from among multiple MV precisions, which include one or more fractional-sample MV precisions and integer-sample MV precision. The video encoder can identify a set of MV values having a fractional-sample MV precision, then select the MV precision for the unit based at least in part on prevalence of MV values (within the set) having a fractional part of zero. Or, the video encoder can perform rate-distortion analysis, where the rate-distortion analysis is biased towards the integer-sample MV precision. Or, the video encoder can collect information about the video and select the MV precision for the unit based at least in part on the collected information.

Abstract: Disclosed herein are a method and an apparatus for removing ghost artifacts of an echo planner image using a neural network. An image processing method according to an embodiment of the inventive concept includes receiving Fourier space data of an echo planar image, and restoring the echo planar image in which ghost artifacts are removed using a neural network. The receiving of the Fourier space data may include dividing the Fourier space data into the odd-numbered Fourier space data and even-numbered Fourier space data, and the restoring of the echo planar image may include obtaining the odd-numbered Fourier space data and even-numbered Fourier space data with the Fourier space interpolated using the neural network and restoring the echo planar image in which the ghost artifacts are removed based on the odd-numbered Fourier space data and even-numbered Fourier space data with the Fourier space interpolated.

Abstract: A method of video processing is provided to include determining, for a conversion between a current video block of a video and a coded representation of the video, a mode of operation of an UMVE mode; and performing the conversion based on the determining, wherein the current video block is coded with a merge mode and motion vector differences in an UMVE mode that comprises a motion vector expression that includes a starting point of motion information, a motion magnitude and a motion direction for the current video block, and wherein one or more fields in the coded representation correspond to the mode of operation, and wherein the one or more fields include: a list size field that indicates a size of a base candidate list used by the UMVE mode, or a table field that signals a distance table or a direction table for the UMVE mode.

Abstract: Video signal coding and decoding functions can generate lists of potential candidates to use in coding and decoding, for example, predictors. Video signal coding component candidates undergo operations before potential inclusion in candidate lists. The candidates are checked after being modified by the operations to see if other equal candidates are already in the candidate are added to the candidate list. If equal candidates are already in the list, the modified candidates are not added to the list. Operations that can be performed comprise rounding and clipping.

Abstract: An approach is provided for generating a polyline from line segments (e.g., line segments representing objects detected by a computer vision system). The approach involves selecting a line segment from a plurality of line segments. The approach also involves determining a neighboring line segment from among the plurality of line segments. The determined neighboring line segment has a closest distance to the line segment from among the plurality of line segments. The approach further involves merging the line segment and the neighboring line segment into a polyline based on determining that the closest distance is a mutual closest distance between line segment and the neighboring line segment.

Abstract: A method, device, and computer program for motion vector prediction in scalable video encoder and decoder. The method concerns the process to determine motion information predictor in the enhancement layer of a scalable encoding scheme also known as motion derivation process. The method comprises a correction of the position in the reference layer used to pick-up the more relevant motion information available due to the compression scheme. Accordingly, motion information prediction is improved.

Abstract: In some embodiments, a method selects a current block in a frame and determines whether the current block is in a first set of positions in the frame. When the current block is in the first set of positions: the method loads a first set of motion vectors from a first list as historical motion vector predictors, wherein the one or more motion vectors are from one or more blocks in the first set of positions in the frame; and uses the first set of motion vectors to transcode the current block. When the current block is not in the first set of positions, the method uses a second set of motion vectors from a second list.

Abstract: A method and apparatus for a video coding system with the current picture referencing (CPR) mode enabled are disclosed. According to one method, the luma and chroma blocks of the current image are jointly coded using a same coding unit (CU) structure if the CPR mode is selected for the luma and the chroma blocks. Alternatively, if the luma and chroma components are partitioned into the luma and the chroma blocks separately using separate CU structures, the luma and chroma blocks are encoded or decoded using a coding mode selected from a coding mode group excluding the CPR mode. According to another method, the luma and chroma blocks of the current image are coded separately using a different CU structure if the CPR mode is selected for the luma and chroma blocks. In yet another method, reconstructed reference data is disclosed for the CPR mode with CU equal to PU.

Abstract: Devices, systems and methods for digital video coding, which include decoder side motion vector derivation (DMVD) tools, are described. An exemplary method for video processing includes making a decision, based on a determination that a current block of a video is coded using a multi-hypothesis prediction mode, regarding a selective enablement of a DMVD tool for the current block, wherein the DMVD tool derives a refinement of motion information signaled in a bitstream representation of the video; and performing, based on the decision, a conversion between the current block and the bitstream representation.

Abstract: A method of video decoding includes maintaining a number of tables, wherein each table includes a set of motion candidates, wherein each motion candidate is associated with corresponding motion information derived from previously video blocks, performing a conversion between a video block and a coded representation of the video block, and determining, based on a conversion condition of the video block, whether to update at least one of the tables by adding motion information corresponding to the video block.

Abstract: A method, computer readable medium, and system are disclosed for identifying residual video data. This data describes data that is lost during a compression of original video data. For example, the original video data may be compressed and then decompressed, and this result may be compared to the original video data to determine the residual video data. This residual video data is transformed into a smaller format by means of encoding, binarizing, and compressing, and is sent to a destination. At the destination, the residual video data is transformed back into its original format and is used during the decompression of the compressed original video data to improve a quality of the decompressed original video data.

Abstract: Disclosed herein are an inter prediction mode-based image processing method and an apparatus therefor. Specifically, a method for processing an image based on an inter prediction mode may include: generating a temporary candidate list by using a spatial neighbor block or temporal neighbor block of a current block; calculating a cost for each candidate in the temporary candidate list by using a template of the current block; generating a final candidate list by rearranging candidates of the temporary candidate list based on the calculated cost; decoding a merge index indicating a specific candidate in the final candidate list; and generating a prediction block of the current block by using motion information of a candidate indicated by the merge index.

Abstract: Novel tools and techniques for concurrent media stream aggregate fingerprinting are provided. A system includes a harvester subsystem, downloader subsystem, fingerprinter subsystem, and an analyzer subsystem. The harvester subsystem is configured to identify a first address associated with a first third-party streaming platform based on stream search criteria. The downloader subsystem is configured to capture a first streaming media segment from the first address. The fingerprinter subsystem is configured to generate a first captured stream fingerprint of the first streaming media segment and generate a first source fingerprint of a source streaming media segment.

Abstract: Systems, methods, and processor-readable media are provided for content distribution for a multi-channel content distribution system. A content item may be received by a video handling system. The content item may include video data, the content item corresponding to media for delivery to a television receivers via channel components. A metric of the content item may be detected as a function of time. Viewership data received from data sources may be processed, the viewership data indicative of one or more characteristics of viewers. The viewership data may be mapped to the content item. The content item may be qualified based on the viewership data to yield a qualification result for the content item. An encoding parameter to encode the content item may be determined based on the metric and the qualification result. Encoding of the content item may be specified in accordance with the encoding parameter.

Abstract: A moving picture decoding apparatus, method, and medium for decoding a current block of a picture are provided. A motion vector candidate list is generated that includes motion vector candidates and, for each of the motion vector candidates, a value. The motion vector candidates include a first candidate and a second candidate. The second candidate is arranged before the first candidate in the motion vector candidate list. The first candidate is sorted before the second candidate in the motion vector candidate list based on the value of the first candidate and the value of the second candidate. The value of the first candidate is higher than the value of the second candidate. For each of the motion vector candidates, the value is based on a number of times the motion vector candidate is selected as a motion vector predictor for neighboring blocks.

Abstract: Embodiments of the present disclosure provide an inter-frame prediction method performed at a computing device. The method includes: determining at least one reference encoded block spatially adjacent to a to-be-processed prediction unit of a to-be-processed encoded block; for each preset reference frame, separately determining a corresponding AMVP of the to-be-processed prediction unit according to reference information of each reference encoded block; determining a target AMVP under the reference frames, and using a reference frame corresponding to the target AMVP as a candidate reference frame; when the candidate reference frame is different from the first reference frame, performing motion estimation on the to-be-processed prediction unit separately and determining a target reference frame from the candidate reference frame and the first reference frame according to their corresponding encoding costs obtained through the motion estimation.