Abstract: Provided are a method and apparatus for performing intra prediction, in a video encoding and decoding procedure, by configuring an additional mode set based on most probable mode (MPM) modes of a current block, and determining an intra prediction mode of the current block, based on the MPM modes and the additional mode set. To solve the technical problems, a video decoding method provided in the present disclosure includes configuring an additional mode set based on MPM modes of a current block; determining an intra prediction mode of the current block, based on the MPM modes and the additional mode set; and performing intra prediction on the current block, based on the intra prediction mode.
Abstract: A video processing method is disclosed to include: generating one or more initial predictions for a sub-block of a current video block of the video; refining the one or more initial predictions to generate a final prediction block using a prediction refinement with optical flow (PROF) procedure by calculating motion vector differences based on variables having a bit width not exceeding a predetermined maximum bit width; and performing a conversion between the current video block and a coded representation of the video using the variables having the bit width not exceeding the predetermined maximum bit width.
Type:
Grant
Filed:
August 3, 2021
Date of Patent:
January 31, 2023
Assignees:
BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
Inventors:
Kai Zhang, Li Zhang, Hongbin Liu, Yue Wang
Abstract: Provided is a video decoding method including: obtaining a first motion vector indicating a first reference block of a current block in a first reference picture and a second motion vector indicating a second reference block of the current block in a second reference picture; obtaining a parameter related to pixel group unit motion compensation of the current block, based on at least one of information of the parameter related to the pixel group unit motion compensation and a parameter related to an image including the current picture; generating a prediction block by performing, with respect to the current block, block unit motion compensation based on the first motion vector and the second motion vector and performing the pixel group unit motion compensation based on the parameter related to the pixel group unit motion compensation; and reconstructing the current block. Here, a pixel group may include at least one pixel.
Abstract: In order to provide low-load, efficient coding technology, a moving-picture decoding device includes a spatial motion information candidate derivation unit configured to derive a spatial motion information candidate from motion information of a block neighboring a decoding target block in a space domain and a history-based motion information candidate derivation unit configured to derive a history-based motion information candidate from a memory where motion information of a decoded block is retained, wherein the history-based motion information candidate derivation unit preferentially derives old motion information without making a comparison of the motion information with the spatial motion information candidate.
Abstract: A method for processing a video includes performing a conversion between a current block of visual media data and a corresponding coded representation of the visual media data, wherein the conversion of the current block includes determining whether a use of one or both of a bi-directional optical flow (BIO) technique or a decoder-side motion vector refinement (DMVR) technique to the current block is enabled or disabled, and wherein the determining the use of the BIO technique or the DMVR technique is based on a cost criterion associated with the current block.
Type:
Grant
Filed:
August 18, 2021
Date of Patent:
January 10, 2023
Assignees:
BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
Inventors:
Hongbin Liu, Li Zhang, Kai Zhang, Jizheng Xu, Yue Wang
Abstract: An image decoding method performed by a decoding apparatus according to the present disclosure includes determining whether to use an advanced temporal motion vector predictor (ATMVP) candidate of sub-block unit for a current block, specifying a corresponding block corresponding to the current block in a reference picture based on a motion vector for a spatial neighboring block of the current block when the ATMVP candidate of the sub-block unit is used, deriving the ATMVP candidate of the sub-block unit for the current block based on motion vectors of sub-block unit of the corresponding block, constructing a merge candidate list including the ATMVP candidate of the sub-block unit for the current block, generating prediction samples of the current block by deriving motion vectors of the sub-block unit for the current block based on the merge candidate list and reconstructing a current picture based on the prediction samples of the current block.
Abstract: Non-transform blocks of video content may be coded by selectively changing a scanning order. In some implementations, an encoder or decoder may perform a scanning process on a block according to a scanning order. When the block has not been transformed, the encoder or decoder may selectively change the scanning order to a different order. For example, if the block is associated with a particular type of prediction, the scanning order may be changed to a different order. In another example, if the non-transform block has a size that is smaller than a predetermined size, the scanning order may be changed to a different order.
Abstract: A method is useable for digitally correcting an optical image of a sample by a microscope that has a cover slip covering the sample. The method includes: determining, by the microscope, an index of refraction of an optical medium bordering the cover slip, a tilt of the cover slip, and/or a thickness of the cover slip; ascertaining an imaging error to be corrected in the form of a pupil function based on the index of refraction of the optical medium, the tilt of the cover slip, and/or the thickness of the cover slip; carrying out imaging of the sample by the microscope; and digitally correcting image data captured by the imaging of the sample based on the pupil function.
Abstract: An image encoding/decoding method and apparatus are provided. An image decoding method performed by an image decoding apparatus may include identifying a prediction mode of a current block, determining a candidate intra prediction mode for the current block, based on a prediction mode of a neighboring block located around the current block, based on the intra prediction mode of the current block being an intra prediction mode, generating a candidate intra prediction mode list of the current block based on the candidate intra prediction mode, and determine an intra prediction mode of the current block based on the candidate intra prediction mode list. In this case, the candidate intra prediction mode may be determined to be a predetermined intra prediction mode, based on the prediction mode of the neighboring block being an MIP mode.
Type:
Grant
Filed:
December 10, 2021
Date of Patent:
December 20, 2022
Assignee:
LG ELECTRONICS INC.
Inventors:
Jangwon Choi, Jin Heo, Sunmi Yoo, Jungah Choi, Seung Hwan Kim
Abstract: An array of more than one digital micro-camera, along with the use of patterned illumination and a digital post-processing operation, jointly create a multi-camera patterned illumination (MCPI) microscope. Each micro-camera includes its own unique lens system and detector. The field-over-view of each micro-camera unit at least partially overlaps with the field-of-view of one or more other micro-camera units within the array. The entire field-of-view of a sample of interest is imaged by the entire array of micro-cameras in a single snapshot. In addition, the MCPI system uses patterned optical illumination to improve its effective resolution. The MCPI system captures one or more images as the patterned optical illumination changes its distribution across space and/or angle at the sample. Then, the MCPI system digitally combines the acquired image sequence using a unique post-processing algorithm.
Type:
Grant
Filed:
April 12, 2021
Date of Patent:
December 13, 2022
Inventors:
Roarke Horstmeyer, Robert Horstmeyer, Mark Harfouche
Abstract: A system includes a processor and a memory storing instructions that, when executed by the processor cause the system to generate a machine learning model; generate an artificial neural network; analyze an image of a parking area using a spot detection machine learning model; analyze the image of the parking area using a vehicle detection machine learning model; and classify a parking space as available when an area of intersection does not exceed a predetermined value. A method includes analyzing an image of a parking area using a first machine learning model; analyzing the image of the parking area using second machine learning model; and classifying a parking space as available when an area of intersection does not exceed a predetermined value. A method includes generating a spot detection machine learning model; and generating, by analyzing a plurality of labeled images, an artificial neural network.
Type:
Grant
Filed:
April 26, 2021
Date of Patent:
December 13, 2022
Assignee:
CDW LLC
Inventors:
Colin R. Vallance, Michael Alan Robinson, Forrest Weinberg, Sankar Nair
Abstract: A video decoding method, including: parsing a received bitstream to obtain prediction information of a coding unit (CU); obtaining a target transform mode of a residual transform unit (TU); parsing the received bitstream to obtain transform coefficients of the residual TU; applying an inverse quantization to the transform coefficients of the residual TU to obtain dequantized coefficients; applying, based on the target transform mode, an inverse transform to the dequantized coefficients to obtain a residual block of the residual TU; obtaining a prediction block of the CU based on the prediction information; obtaining a video block based on the residual block and the prediction block; and outputting a video sequence including a video frame that includes the video block.
Abstract: An image encoding/decoding method and apparatus are provided. An image decoding method according to the present disclosure is performed by an image decoding apparatus. The image decoding method comprises deriving a prediction sample of a current block based on motion information of the current block, deriving a reference picture resampling (RPR) condition for the current block, determining whether prediction refinement with optical flow (PROF) applies to the current block based on the RPR condition, and deriving a refined prediction sample for the current block by applying PROF to the current block.
Type:
Grant
Filed:
March 16, 2022
Date of Patent:
November 29, 2022
Assignee:
LG ELECTRONICS INC.
Inventors:
Nae Ri Park, Jung Hak Nam, Hyeong Moon Jang
Abstract: Provided are a video decoding method and device. This specification provides a video decoding method comprising the steps of: acquiring a parameter indicating whether a multiple transform set is applicable to a block to be decoded, as well as information about the width of the block to be decoded and the height of the block to be decoded; determining the transform type of the block to be decoded on the basis of at least one of the parameter indicating whether a multiple transform set is applicable, or the information about the width and height of the block to be decoded, and setting a zero-out region of the block to be decoded; and inverse-transforming the block to be decoded on the basis of the zero-out region of the block to be decoded and the result of determining the transform type.
Abstract: Aspects of the disclosure provide methods and apparatuses for video coding. In some examples, an apparatus includes processing circuitry that stores reconstructed samples of a reconstructed block in a memory. When a current sub-block in a current block is to be reconstructed using intra block copy (IBC) based on a reference sub-block in the reconstructed block, the processing circuitry determines whether the reconstructed samples of the reference sub-block stored in the memory are indicated as overwritten based on a position of the current sub-block, generates reconstructed samples of the current sub-block based on the reconstructed samples of the reference sub-block when the reconstructed samples of the reference sub-block stored in the memory are determined to be indicated as not overwritten, and overwrites the reconstructed samples of a collocated sub-block in the reconstructed block stored in the memory with the generated reconstructed samples of the current sub-block.
Abstract: In order to provide efficient coding technology with a low load, a picture decoding device includes a spatial motion information candidate derivation unit configured to derive a spatial motion information candidate from motion information of a block neighboring a decoding target block in a space domain, a temporal motion information candidate derivation unit configured to derive a temporal motion information candidate from motion information of a block neighboring a decoding target block in a time domain, and a history-based motion information candidate derivation unit configured to derive a history-based motion information candidate from a memory for retaining motion information of a decoded block, wherein the temporal motion information candidate is compared with neither the spatial motion information candidate nor the history-based motion information candidate with respect to the motion information.
Abstract: A picture decoding method includes determining motion information of a to-be-decoded block, obtaining a first decoding prediction block of the to-be-decoded block based on the motion information, performing motion search with first precision in the prediction reference picture block to obtain at least two second decoding prediction blocks, performing downsampling on the first decoding prediction block and the at least two second decoding prediction blocks to obtain a first sampling pixel array and at least two second sampling pixel arrays, respectively, calculating a difference between the first sampling pixel array and each of the second sampling pixel arrays, setting, as a target prediction motion vector, a motion vector corresponding to a second sampling pixel array with a minimum difference, obtaining a target decoding prediction block of the to-be-decoded block based on the target prediction motion vector, and decoding the to-be-decoded block based on the target decoding prediction block.
Abstract: A method for decoding a picture, a method for encoding a picture, an encoder, and a decoder are provided. The method for encoding a picture includes (i) determining a width and a height of a coding block in the picture; (ii) if the width and the height are equal to N, where N is a positive integer power of 2, determining a matrix-based intra prediction (MIP) size identifier indicating that an MIP prediction size equal to N; (iii) deriving a group of reference samples of the coding block; and (iv) deriving an MIP prediction of the coding block based on the group of reference samples and an MIP matrix corresponding to the MIP size identifier.
Type:
Grant
Filed:
January 20, 2022
Date of Patent:
November 15, 2022
Assignee:
GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
Abstract: A method of visual media processing includes determining whether to use an affine adaptive motion vector resolution (AMVR) technique on visual media data relying on a control information related to the affine AMVR technique in a bitstream representation of the visual media data, wherein the control information is included or excluded from the bitstream representation based on a rule; and performing a conversion between the visual media data and the bitstream representation of the visual media data.
Type:
Grant
Filed:
November 8, 2021
Date of Patent:
November 8, 2022
Assignees:
BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
Inventors:
Kai Zhang, Li Zhang, Hongbin Liu, Yue Wang