Patents Issued in April 14, 2022
  • Publication number: 20220116586
    Abstract: A method for coding implemented by a decoding device or an encoding device includes: obtaining a first prediction mode for a first sub-block, obtaining a second prediction mode for a second sub-block; obtaining a first prediction value for a sample in the current block according to the first prediction mode, obtaining a second prediction value for the sample in the current block according to the second prediction mode; obtaining a value of an indicator, the value of the indicator indicating a blending operation which is performed for the sample in the current block; and obtaining a combined prediction value for the sample in the current block, according to the value of the indictor, the first prediction value, and the second prediction value. The blending operation adaptively performs around a separation line dividing the current block into at least the first sub-block and the second sub-block.
    Type: Application
    Filed: December 21, 2021
    Publication date: April 14, 2022
    Inventors: Semih ESENLIK, Max BLAESER, Zhijie ZHAO, Han GAO, Biao WANG, Anand Meher KOTRA, Elena Alexandrovna ALSHINA
  • Publication number: 20220116587
    Abstract: The present invention provides a method of processing a video signal based on inter prediction, the method comprises constructing a merge list based on a neighboring block of a current block; adding a history-based merge candidate representing motion information of a previously coded block of the current block to the merge list; obtaining a merge index indicating a merge candidate used for inter prediction of the current block within the merge list; generating a prediction block of the current block based on motion information of the merge candidate indicated by the merge index; and adding a residual block of the current block to the prediction block to reconstruct the current block, wherein when the history-based merge candidate has motion information that is not redundant with a pre-defined merge candidate among merge candidates included in the merge list, the history-based merge candidate is added to the merge list.
    Type: Application
    Filed: December 6, 2019
    Publication date: April 14, 2022
    Inventors: Jane ZHAO, Seunghwan KIM
  • Publication number: 20220116588
    Abstract: A method and an apparatus for image encoding/decoding, according to the present invention, may generate a candidate list of a current block and perform inter-prediction of the current block by using any one of a plurality of candidates belonging to the candidate list. Here, the plurality of candidates comprise at least one from among a spatial candidate, a temporal candidate, and a restoration information-based candidate, and the restoration information-based candidate may be added from a buffer which stores motion information decoded prior to the current block.
    Type: Application
    Filed: January 6, 2020
    Publication date: April 14, 2022
    Applicant: Industry Academy Cooperation Foundation of Sejong University
    Inventors: Joo Hee MOON, Dong Jae WON, Jae Min HA
  • Publication number: 20220116589
    Abstract: The present invention relates to the field of video encoding. In particular, it relates to a method 300 of encoding images captured by a camera and to an image processing device. An image sequence captured with an image sensor of the camera is obtained S310, and an oscillation frequency of a periodic movement of the camera during capturing of the image sequence is determined S320. A base subset of images of the image sequence corresponding to the oscillation frequency is identified S330 and the base subset of images are encoded S340 into an encoded video stream comprising intra frames and inter frames.
    Type: Application
    Filed: October 7, 2021
    Publication date: April 14, 2022
    Applicant: Axis AB
    Inventors: Fredrik PIHL, Mattias PETTERSSON
  • Publication number: 20220116590
    Abstract: A decoding method performed by a decoding device, according to the present document, may comprise the steps of: acquiring a sequence parameter set from a bitstream; acquiring a combined inter-picture merge and intra-picture prediction (CIIP) enable flag from the sequence parameter set; determining, on the basis of the CIIP enable flag and the size of a current block, whether a regular merge flag is included in the bitstream; parsing the regular merge flag in the bitstream on the basis that a condition based on the CIIP enable flag and a condition based on the size of the current block are satisfied; generating prediction samples of the current block on the basis of the regular merge flag; and generating a restoration picture on the basis of the prediction samples.
    Type: Application
    Filed: December 17, 2021
    Publication date: April 14, 2022
    Inventors: Hyeongmoon Jang, Naeri Park, Seunghwan Kim
  • Publication number: 20220116591
    Abstract: Disclosed are a colour component prediction method, encoder, decoder, and storage medium. When CCLM is used for a current block to determine its intra prediction value, the encoder determines multiple groups of corresponding CCLM parameters using multiple groups of reference samples of current block, determines a target CCLM parameter from multiple groups of CCLM parameters; sets a CCLM index value indicating to use the target CCLM parameter and signals same in bitstream; and determines intra prediction value of current block according to the target CCLM parameter. The decoder parses bitstream to determine a prediction mode parameter of current block, parses bitstream to determine a CCLM index value of current block when prediction mode parameter indicates intra prediction value of current block is determined using CCLM; determines target CCLM parameter according to the CCLM index value, and determines intra prediction value of current block according to the target CCLM parameter.
    Type: Application
    Filed: December 21, 2021
    Publication date: April 14, 2022
    Inventors: Junyan HUO, Yanzhuo MA
  • Publication number: 20220116592
    Abstract: A method of video processing includes constructing, for a conversion between a current block of a current picture of a video and a bitstream representation of the video, a list of motion candidates for a coding technique applicable to the current block in which history-based motion candidates derived according to information from previously processed blocks of the video. The codingtechniqueusesreferencesamplesfromthecurrentpictureofthecurrentblockforpredicting at least a portion of the current block. The method also includes performing the conversion based on the determining.
    Type: Application
    Filed: December 21, 2021
    Publication date: April 14, 2022
    Inventors: Li ZHANG, Kai ZHANG, Hongbin LIU, Yue WANG
  • Publication number: 20220116593
    Abstract: Disclosed herein is a region-based reference management system using in video frame encoding. Source content, such as video game streaming or remote desktop sharing, that includes scene changes or significant instantaneous changes in a region from one frame to the next can present encoding challenges. Techniques disclosed herein use hints about changes in regional frame content, dissect frame content into regions, and associate the dissected regions with stored reference frame data using the hints and information about the regions to more efficiently encode frames.
    Type: Application
    Filed: December 23, 2021
    Publication date: April 14, 2022
    Applicant: ATI Technologies ULC
    Inventors: Ahmed M. Abdelkhalek, Ihab M. A. Amer, Khaled Mammou
  • Publication number: 20220116594
    Abstract: According to the disclosure of the present document, when the inter-prediction type of the current block indicates biprediction, weight index information for a candidate in a merge candidate list or sub-block merge candidate list can be derived, and coding efficiency can be raised.
    Type: Application
    Filed: December 23, 2021
    Publication date: April 14, 2022
    Inventors: Naeri PARK, Junghak NAM, Hyeongmoon JANG
  • Publication number: 20220116595
    Abstract: This disclosure describes systems, methods, and devices related to providing video coding mode decisions to multiple video codecs. A method may include receiving, at a first engine of a graphics processor, intra coding mode candidates associated with generating bitstreams of coded video; receiving, at the first engine, inter coding mode candidates associated with generating the bitstreams; receiving, at the first engine, palette coding mode candidates associated with generating the bitstreams; generating, by the first engine, based on rate distortion estimates associated with the received candidates, coding mode decisions associated with generating the bitstreams; sending, by the first engine, the coding mode decisions to a second engine of the graphics processor and to a third engine of the graphics processor, the second engine using a first codec and the third engine using a second codec different than the first codec; generating the encoded bitstreams based on the coding mode decisions.
    Type: Application
    Filed: December 22, 2021
    Publication date: April 14, 2022
    Inventors: Satya Yedidi, Shriram Deshpande, Jian Hu, Kailash Kamana, Jakob Saxtorph
  • Publication number: 20220116596
    Abstract: A method of video processing includes determining, for a conversion between a block of a video and a bitstream representation of the video, whether a sample of the block is positioned within a distance from a boundary of the block to be a boundary sample for a filtering process according to a rule associated with a component identity of the block. The method also includes performing the conversion based on the determining.
    Type: Application
    Filed: December 10, 2021
    Publication date: April 14, 2022
    Inventors: Li ZHANG, Kai ZHANG, Hongbin LIU, Yue WANG
  • Publication number: 20220116597
    Abstract: A filter, to an encoder and a decoder using the filter, to a filtering method and a corresponding program, as well as to encoding and decoding using the filtering method or the filter. The method includes obtaining of an extended reconstructed block by extending the current reconstructed block to include at least padding samples from the current reconstructed block. After padding, a current pixel of the extended reconstructed block and its neighboring pixels are loaded into a linear buffer and transformed with a one-dimensional (1D) transform. The method is performed in frequency domain using a look-up table and the filtered pixels are transformed back.
    Type: Application
    Filed: December 20, 2021
    Publication date: April 14, 2022
    Inventors: Sergey Yurievich Ikonin, Victor Alexeevich Stepin, Alexander Alexandrovich Karabutov
  • Publication number: 20220116598
    Abstract: A method for in-loop filtering by performing adaptive loop filtering on a reconstructed frame of a video stream, implemented by an encoding device or a decoding device, the method comprising forming differences between a pixel of the reconstructed frame and neighboring pixels in a connected area of the pixel, clipping the differences according to respective clipping levels, forming a weighted sum of the clipped differences, and adding the weighted sum to the pixel to determine a filtered pixel, wherein the respective clipping levels are chosen from a same set of clipping levels for the luma and chroma components.
    Type: Application
    Filed: December 23, 2021
    Publication date: April 14, 2022
    Inventors: Victor Alexeevich STEPIN, Sergey Yurievich IKONIN, Elena Alexandrovna ALSHINA
  • Publication number: 20220116599
    Abstract: Provided is an image processing device including a decoding section that decodes an encoded stream to generate an image, a line determining section that determines whether to apply a deblocking filter to each of lines perpendicular to a boundary in neighboring blocks neighboring across the boundary in the image generated by the decoding section, and a filtering section that applies the deblocking filter to each line to which the line determining section determines to apply the deblocking filter.
    Type: Application
    Filed: December 22, 2021
    Publication date: April 14, 2022
    Inventor: MASARU IKEDA
  • Publication number: 20220116600
    Abstract: A system and method of decoding a coding unit in an image frame from a bitstream. The method comprises determining a size of the coding unit from the bitstream; and dividing the image frame into a plurality of equally sized processing regions, each of the equally sized processing regions being a block processed during a single stage of a pipeline decoding the bitstream. If the coding unit overlaps a boundary between the determined processing regions, the method comprises selecting a transform size for the coding unit from a plurality of transform sizes, the transform size being selected to fit within the coding unit and being different in size to the processing regions; and decoding the coding unit by applying an inverse transform to residual coefficients of each transform unit in the coding unit, each of the transform units being of the selected transform size.
    Type: Application
    Filed: June 25, 2019
    Publication date: April 14, 2022
    Inventors: Christopher James ROSEWARNE, Andrew James DORRELL
  • Publication number: 20220116601
    Abstract: An approach for encoding/decoding video data including obtaining video data; parsing the obtained video data to obtain partitioning parameters; obtaining a partitioned coding block based on the partitioning parameters; and decoding the obtained video data based on the partitioned coding block. The partitioned coding block may be partitioned into a rectangular partition and at least one non-rectangular partition.
    Type: Application
    Filed: December 20, 2021
    Publication date: April 14, 2022
    Applicant: TENCENT AMERICA LLC
    Inventors: Xin ZHAO, Liang ZHAO, Shan LIU
  • Publication number: 20220116602
    Abstract: An image is divided into a plurality of tiles and the tile is divided into rectangular regions each including at least one block row formed from a plurality of blocks each having a size smaller than the tile. If each slice in the image includes only one rectangular region, based on the number of blocks in a vertical direction in the rectangular region, the number of pieces of information for specifying a start position of coded data of the block row in the slice is specified. A bitstream in which at least the pieces of information, whose number is as many as the specified number, information representing that each slice in the image is formed by only one rectangular region, and the coded data of the block row are multiplexed is generated.
    Type: Application
    Filed: December 20, 2021
    Publication date: April 14, 2022
    Inventors: Koji Okawa, Masato Shima
  • Publication number: 20220116603
    Abstract: An image is divided into rectangular regions each including at least one block row, and the image is divided into rectangular slices or slices to be processed in raster order. In a case where the image is divided into the rectangular slices, based on first information for specifying a rectangular region to be processed first and second information for specifying a rectangular region to be processed last, the rectangular regions in the rectangular slice is specified. Based on the number of blocks in a vertical direction in each of the specified rectangular regions, the number of pieces of information for specifying a start position of coded data of the block row in the rectangular slice is specified. A bitstream in which at least the pieces of information, the first and second information, and the coded data are multiplexed is generated.
    Type: Application
    Filed: December 20, 2021
    Publication date: April 14, 2022
    Inventors: Koji Okawa, Masato Shima
  • Publication number: 20220116604
    Abstract: A method for motion estimation is provided that includes determining a first motion vector for a first child coding unit (CU) of a parent CU and a second motion vector for a second child CU of the parent CU, wherein the first child CU, the second child CU, and the parent CU are in a CU hierarchy, wherein the first and second child CUs are smallest size CUs in the CU hierarchy, and wherein a first motion search type is used to determine the first motion vector and the second motion vector, selecting the first and second motion vectors as candidate predictors for the parent CU, selecting a predictor for a prediction unit (PU) of the first parent CU from the candidate predictors, and refining the predictor using a second motion search type to determine a motion vector for the PU.
    Type: Application
    Filed: December 23, 2021
    Publication date: April 14, 2022
    Inventors: Hyung Joon Kim, Minhua Zhou, Akira Osamoto, Hideo Tamama
  • Publication number: 20220116605
    Abstract: Embodiments of the present invention provide a method and device for processing a video signal. A method for processing a video signal according to an embodiment of the present specification comprises the steps of: acquiring position information of a last significant coefficient according to scanning order in a transform block; and performing residual coding on the basis of the position information of the last significant coefficient.
    Type: Application
    Filed: January 9, 2020
    Publication date: April 14, 2022
    Inventors: Moonmo KOO, Jaehyun LIM, Seunghwan KIM
  • Publication number: 20220116606
    Abstract: An apparatus configured to select a predetermined intra prediction mode out of a plurality of intra-prediction modes which includes a first set of intra-prediction modes and a second set of matrix-based intra-prediction modes. The apparatus is configured to select a subset of one or more secondary transforms dependent on the predetermined intra prediction mode so that the subset is nonempty in case of the predetermined intra prediction mode being contained in the first set of intra-prediction modes or in the second set of matrix-based intra-prediction modes. The apparatus is configured to derive a transformed version of a prediction residual for a predetermined block, which is related to a spatial domain version of the prediction residual of the predetermined block via a transform defined by a concatenation of a primary transform and a predetermined secondary transform out of the subset of secondary transforms.
    Type: Application
    Filed: December 22, 2021
    Publication date: April 14, 2022
    Inventors: Jonathan PFAFF, Tobias HINZ, Philipp HELLE, Philipp MERKLE, Björn STALLENBERGER, Michael SCHÄFER, Benjamin BROSS, Martin WINKEN, Mischa SIEKMANN, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20220116607
    Abstract: The application discloses a method, system, device and computer-readable storage medium for inverse quantization, wherein, in some embodiments, determining an initial weighted inverse quantization matrix, wherein, the initial weighted inverse quantization matrix is the same as the quantized block in size; setting some matrix elements in the initial weighted inverse quantization matrix to zero to obtain a weighted inverse quantization matrix, wherein, determining the matrix elements that need to be zeroed according to the size of the quantized block; weighted inverse quantizing the quantized coefficients in the quantized block to generate corresponding inverse transform coefficients, wherein, the value of the matrix element corresponding to the position of the quantized coefficient in the weighted inverse quantization matrix is used as a weight coefficient of the weighted inverse quantization.
    Type: Application
    Filed: March 6, 2019
    Publication date: April 14, 2022
    Inventors: Ronggang WANG, Zhenyu WANG, Wen GAO
  • Publication number: 20220116608
    Abstract: An image decoding method according to the present document comprises a step of generating residual samples of a current block on the basis of residual information, wherein the residual information comprises a multiple transform selection (MTS) index and information regarding transform coefficients, the residual samples are generated from transform coefficients according to the information regarding the transform coefficients by using a transform kernel set, the transform kernel set is determined by the MTS index from among transform kernel set candidates, at least one of bins of a bin string of the MTS index is derived on the basis of context coding, the context coding is performed based on a value of a context index with respect to the MTS index.
    Type: Application
    Filed: December 20, 2021
    Publication date: April 14, 2022
    Inventors: Junghak NAM, Moonmo KOO, Jaehyun LIM, Seunghwan KIM
  • Publication number: 20220116609
    Abstract: A system can include a video processing engine to determine an estimated Quantization Parameter (QP) for a row of Coding Tree Units (CTUs) in a frame of a video. The processing engine can encode the row of CTUs in the frame of the video. A CTU in the row of CTUs can be encoded with a QP equal to the estimated QP. The system includes another video processing engine to determine an estimated QP for another row of CTUs of the frame of the video. The other processing engine can set a running QP to the estimated QP for the row of CTUs prior to the given video processor encoding a last CTU in the given row of CTUs. The other processing engine can further encode the other row of CTUs. CTUs encoded by the video processing engine and the other video processing engine can be stored in memory.
    Type: Application
    Filed: December 21, 2021
    Publication date: April 14, 2022
    Inventors: Prashanth N. Subramanya, Ramakrishna Adireddy
  • Publication number: 20220116610
    Abstract: A method of quantization, adaptive block partitioning and codebook coding for neural network model compression, is performed by at least one processor and includes determining a saturated maximum value of a multi-dimensional tensor in a layer of a neural network, and a bit depth corresponding to the saturated maximum value, and clipping weight coefficients in the multi-dimensional tensor to be within a range of the saturated maximum value. The method further includes quantizing the clipped weight coefficients, based on the bit depth, and transmitting, to a decoder, a layer header including the bit depth.
    Type: Application
    Filed: December 22, 2021
    Publication date: April 14, 2022
    Applicant: TENCENT AMERICA LLC
    Inventors: Wei WANG, Wei JIANG, Shan LIU
  • Publication number: 20220116611
    Abstract: This disclosure describes systems, methods, and devices related to generating region-based quantization parameters for video encoding.
    Type: Application
    Filed: December 22, 2021
    Publication date: April 14, 2022
    Inventors: Satya Yedidi, Sai Agnihotri, Shriram Deshpande, Aaron McKenney
  • Publication number: 20220116612
    Abstract: According to the disclosure of the present document, when the inter prediction type of a current block indicates biprediction, weight index information for candidates in a merge candidate list or a sub-block merge candidate list can be derived, and thus coding efficiency can be increased.
    Type: Application
    Filed: December 17, 2021
    Publication date: April 14, 2022
    Inventors: Hyeongmoon JANG, Naeri PARK, Seunghwan KIM
  • Publication number: 20220116613
    Abstract: The present disclosure relates to apparatus and methods of image decoding and image encoding. In one or more embodiments, an image decoding method may comprise determining a first sample value of an upper left reference sample of the current block. The image decoding method may further comprise sequentially searching for a searched reference sample of at least one reference line from a plurality of reference lines, except for the upper left reference sample. The image decoding method may further comprise determining a second sample value of remaining reference samples of the current block, except for the upper left reference sample. The image decoding method may further comprise performing intra prediction on the current block to obtain a prediction block of the current block. The image decoding method may further comprise obtaining a residual block of the current block and a reconstruction block of the current block.
    Type: Application
    Filed: December 20, 2021
    Publication date: April 14, 2022
    Applicant: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Narae CHOI, Minwoo PARK
  • Publication number: 20220116614
    Abstract: According to disclosure of the present document, an LMCS procedure can be used for blocks having various block tree structures, and memories used in the LMCS procedure can be reduced (limited).
    Type: Application
    Filed: December 20, 2021
    Publication date: April 14, 2022
    Inventors: Jie ZHAO, Seunghwan KIM
  • Publication number: 20220116615
    Abstract: According to the disclosure of the present document, it is possible for various LMCS application cases to apply an LMCS procedure to a block having a dual tree structure. In addition, the coding predormance of the block can be improved. According to the disclosure of the present document, resources required for the LMCS procedure can be reduced. Therefore, the complexity of the LMCS can be reduced and the video/image coding efficiency can be increased.
    Type: Application
    Filed: December 20, 2021
    Publication date: April 14, 2022
    Inventors: Jie ZHAO, Seunghwan KIM
  • Publication number: 20220116616
    Abstract: Methods are provided for reducing the computation complexity and on-chip memory requirements as well as the decoding latency introduced by LMCS. In one method, a luma prediction sample is obtained for decoding a luma residual sample, a scaling factor is derived using the luma prediction sample, the scaling factor is used to scale the luma residual sample, and the reconstructed luma sample is calculated by adding the luma prediction sample and the scaled luma residual sample.
    Type: Application
    Filed: December 20, 2021
    Publication date: April 14, 2022
    Inventors: Xiaoyu XIU, Yi-Wen CHEN, Xianglin WANG, Tsung-Chuan MA, Shuiming YE, Hong-Jheng JHU
  • Publication number: 20220116617
    Abstract: An image decoding method performed by a decoding device according to the present document comprises a step of receiving a bitstream containing residual information, and a step of deriving a quantized transform coefficient for a current block on the basis of the residual information contained in the bitstream, wherein the residual information includes a context syntax element coded on the basis of the context, and if the size of a transformation block is changed as much as a sub-block region having a predetermined size and the current block is the last sub-block in the sub-block region and the last quantized transform coefficient is in the current block, then the step of deriving a quantized transform coefficient includes context-based decoding of the context syntax element on the basis of a predetermined maximum value for the context syntax element, wherein the maximum value is determined on the basis of the size of the sub-block region.
    Type: Application
    Filed: December 21, 2021
    Publication date: April 14, 2022
    Inventors: Sunmi YOO, Seunghwan Kim, Jungah Choi, Jangwon Choi, Jin Heo
  • Publication number: 20220116618
    Abstract: A video decoder and a video encoder include a noise reduction operation including at least two denoising operations and adapting the second denoising operation in dependence of the difference before and after the first denoising operation, thus correcting the quality reduction occurred due to the application of the first denoising operation. Corresponding methods serve to encode and decode video signals.
    Type: Application
    Filed: December 23, 2021
    Publication date: April 14, 2022
    Inventors: Wang-Q LIM, Heiko SCHWARZ, Detlev MARPE, Thomas WIEGAND
  • Publication number: 20220116619
    Abstract: A video encoder, a video decoder, and a corresponding method are provided. The method includes: when a plurality of preset conditions are satisfied, performing bi-directional optical flow BDOF processing on a current picture block, to obtain a predicted sample value of the current picture block, where the plurality of preset conditions include at least a condition that a height H of the current picture block is greater than or equal to 8, a width W of the current picture block is greater than or equal to 8, and a product of the width W of the current picture block and the height H of the current picture block is greater than 128. Thus encoding/decoding complexity and prediction accuracy can be balanced to some extent.
    Type: Application
    Filed: December 23, 2021
    Publication date: April 14, 2022
    Inventors: Xu Chen, Haitao Yang, Lian Zhang
  • Publication number: 20220116620
    Abstract: A method for picture or video encoding, wherein a block of residual signal is being subsampled before transform, quantization and residual coding, comprising obtaining a residual signal from an original picture and a predicted block; obtaining a subsampled block from samples of a near-boundary region of a block of residual signal, wherein the subsampled block has a smaller size than the block of residual signal; performing forward transform over the subsampled block; performing quantization over the subsampled block to obtain a subsampled quantized residual block; performing residual coding of the subsampled quantized residual block; obtaining a subsampled reconstructed residual block by inverse quantization and inverse transform of the subsampled quantized residual block; obtaining a reconstructed residual block by filling samples of the near-boundary region of the reconstructed residual block from the subsampled reconstructed residual block; and obtaining a reconstructed block from the predicted block and t
    Type: Application
    Filed: December 20, 2021
    Publication date: April 14, 2022
    Inventors: Alexey Konstantinovich Filippov, Vasily Alexeevich Rufitskiy, Elena Alexandrovna Alshina
  • Publication number: 20220116621
    Abstract: Video processing can involve encoding and/or decoding a picture based on determining an activation of a processing mode involving a motion vector refinement process and a second process other than the motion vector refinement process; modifying the motion vector refinement process based on the activation and the second process; and encoding and/or decoding the picture based on the modified motion vector refinement process and the second process.
    Type: Application
    Filed: March 6, 2020
    Publication date: April 14, 2022
    Inventors: Fabrice Urban, Franck Galpin, Philippe Bordes
  • Publication number: 20220116622
    Abstract: Methods, apparatus, systems, and articles of manufacture are disclosed. Example apparatus disclosed herein are to process features extracted from first and second downscaled image frames to determine block classifications for respective blocks of the first and the second downscaled image frames. Disclosed example apparatus are also to generate a map based on the block classifications, the map including values representative of amounts of change associated with blocks of the second downscaled image frame and corresponding blocks of the first downscaled image frame. Disclosed example apparatus are further to adjust a quantization parameter of a full-scale image frame based on the map, the full-scale image frame corresponding to the at least one of the first or the second downscaled image frames.
    Type: Application
    Filed: December 22, 2021
    Publication date: April 14, 2022
    Inventors: Sebastian Possos, Ximin Zhang, Changliang Wang
  • Publication number: 20220116623
    Abstract: According to embodiments of the present document, a prediction procedure can be performed for image video coding, and the prediction procedure can comprise merge mode motion vector differences (MMVD) and symmetric motion vector differences (SMVD) according inter prediction. The inter prediction can be performed on the basis of reference pictures of a current picture, and types of the reference pictures (e.g. a long-term reference picture, a short-term reference picture, etc.) can be considered for the inter prediction. Accordingly, performance and coding efficiency in the prediction procedure can be increased.
    Type: Application
    Filed: December 23, 2021
    Publication date: April 14, 2022
    Inventors: Naeri PARK, Junghak NAM, Hyeongmoon JANG
  • Publication number: 20220116624
    Abstract: A method for bi-directional optical flow prediction based on reference sample values from sample positions belonging to an extended region of a predicted block used in the bi-directional optical flow prediction of a current block is provided, wherein sub-pixel positions in the extended region of the predicted block in the reference picture are rounded to obtain integer pixel sample positions in the reference picture, wherein the reference sample values at the obtained integer pixel sample positions in the reference picture are used in the computation of boundary sample gradients corresponding to the boundaries of the predicted block in the reference picture.
    Type: Application
    Filed: December 22, 2021
    Publication date: April 14, 2022
    Inventors: Sriram SETHURAMAN, Jeeva Raj A, Sagar KOTECHA
  • Publication number: 20220116625
    Abstract: An image processing device, a camera and a method of encoding a sequence of video images into a single video stream with dynamic bitrate are provided. The sequence of video images is encoded into frames of a base layer of the single video stream using a base layer resolution and a base layer compression level. Video images of the sequence of video images corresponding to respective times before detecting an event trigger are encoded into a first set of frames of an extended layer of the single video stream. The event trigger is detected and upon detecting the event trigger, video images of the sequence of video images corresponding to respective times after detecting the event trigger are encoded into a second set of frames of the extended layer using a higher resolution than the base layer resolution or a lower compression level than the base layer compression level.
    Type: Application
    Filed: September 29, 2021
    Publication date: April 14, 2022
    Applicant: Axis AB
    Inventors: Fredrik PIHL, Mats LUND
  • Publication number: 20220116626
    Abstract: A system for encoding a sequence of frames of a data signal. The system comprises: a first encoding system comprising at least: a first encoder configured to encode the sequence of frames according to a first encoding algorithm; and a first rate control unit configured to control a first bit rate at which the first encoder encodes said sequence of frames; a second encoding system comprising at least: a second encoder configured to encode a second sequence of frames associated with the sequence of frames according to a second encoding algorithm; and a second rate control unit configured to control a second bit rate at which the second encoder encodes said second sequence of frames associated with the sequence of frames.
    Type: Application
    Filed: October 22, 2021
    Publication date: April 14, 2022
    Inventors: Ivan DAMNJANOVIC, Matthew COMPTON
  • Publication number: 20220116627
    Abstract: Aspects of the disclosure provide methods and apparatuses for use in video coding for machines. In some examples, an apparatus of video coding for machines includes processing circuitry. The processing circuitry determines a first picture quality vs. coding efficiency characteristic for a first coding scheme of video coding for machines (VCM), and a second picture quality vs. coding efficiency characteristic for a second coding scheme of VCM. Then, the processing circuitry determines a Bjøntegaard delta (BD) metric for a comparison of the first coding scheme and the second coding scheme, based on the first picture quality vs. coding efficiency characteristic and the second picture quality vs. coding efficiency characteristic.
    Type: Application
    Filed: June 28, 2021
    Publication date: April 14, 2022
    Applicant: TENCENT AMERICA LLC
    Inventors: Shan LIU, Wen GAO, Xiaozhong XU
  • Publication number: 20220116628
    Abstract: Systems and methods for efficient lossless compression of captured raw image information are presented. A method can comprise: receiving raw image data from an image capture device, segregating the pixel data into a base layer portion and an enhanced layer portion, reconfiguring the base layer portion expressed in the first color space values from a raw capture format into a pseudo second color space compression mechanism compatible format, and compressing the reconfigured base layer portion of first color space values. The raw image data can include pixel data are expressed in first color space values. The segregation can be based upon various factors, including a compression benefits analysis of a boundary location between the base layer portion and enhanced layer portion. The reconfiguring the base layer portion can include separating the base layer portion based upon multiple components within the raw data; and forming base layer video frames from the multiple components.
    Type: Application
    Filed: December 20, 2021
    Publication date: April 14, 2022
    Inventors: Sarvesh SATAVALEKAR, Gordon GRIGOR, Vinayak PORE, Gajanan BHAT, Mohan NIMAJE, Soumen Kumar DEY, Sameer Anand GUMASTE
  • Publication number: 20220116629
    Abstract: According to the disclosure of the present document, LMCS may also be applied to a block having a dual tree sturcture. In addition, the number of LMCS APS may be limited. Therefore, an LMCS procedure may be efficiently performed, and the complexity of LMCS may be reduced. As the performance of LMCS is improved, the video/image coding efficiency may be increased.
    Type: Application
    Filed: December 20, 2021
    Publication date: April 14, 2022
    Inventors: Jie Zhao, Seunghwan Kim
  • Publication number: 20220116630
    Abstract: According to the disclosure of the present document, an ID value of an LMCS APS may be within a predetermined range. Thus, an LMCS procedure can be efficiently performed, and the complexity of LMCS is reduced. Since the performance of LMCS is improved, efficiency of video/image coding may increase.
    Type: Application
    Filed: December 22, 2021
    Publication date: April 14, 2022
    Inventors: Jie Zhao, Seunghwan Kim
  • Publication number: 20220116631
    Abstract: According to the disclosure of the present document, the resources necessary for an LMCS process may be reduced by limiting the range that an LMCS APS occupies in all APSs. Thus, the degree of complexity in LMCS may be reduced, and video/image coding efficiency may be increased.
    Type: Application
    Filed: December 23, 2021
    Publication date: April 14, 2022
    Inventors: Jie ZHAO, Seunghwan Kim
  • Publication number: 20220116632
    Abstract: According to a disclosure of the present document, image information including prediction mode information and information associated with luma mapping with chroma scaling (LMCS) is acquired from a bitstream, wherein the image information includes LMCS adaptation parameter sets (APSs), and by limiting the range of APS ID information included in the LMCS APSs, a memory used in a LMCS procedure may be reduced (limited).
    Type: Application
    Filed: December 23, 2021
    Publication date: April 14, 2022
    Inventors: Jie ZHAO, Seunghwan KIM
  • Publication number: 20220116633
    Abstract: A method, apparatus and storage medium for performing video coding are provided. The method includes obtaining a plurality of image frames in a video sequence; determining a feature map for each of the plurality of image frames and determining an offset map based on the feature map; determining an aligned feature map by performing a temporal deformable convolution (TDC) on the feature map and the offset map; and generating a plurality of aligned frames based on the aligned feature map.
    Type: Application
    Filed: August 5, 2021
    Publication date: April 14, 2022
    Applicant: TENCENT AMERICA LLC
    Inventors: Wei JIANG, Wei Wang, Zeqiang Li, Shan Liu
  • Publication number: 20220116634
    Abstract: Systems and methods are provided for encoding a multi-pixel caching scheme for lossless encoders. The systems and methods can include obtaining a sequence of pixels, determining repeating sub-sequences of the sequence of pixels consisting of a single repeated pixel and non-repeating sub-sequences of the sequence of pixels, responsive to the determination, encoding the repeating sub-sequences using a run-length of the repeated pixel and encoding the non-repeating sub-sequences using a multi-pixel cache, wherein the encoding using a multi-pixel cache comprises, encoding non-repeating sub-sequences stored in the multi-pixel cache as the location of the non-repeating sub-sequences in the multi-pixel cache, and encoding non-repeating sub-sequences not stored in the multi-pixel cache using the value of the pixels in the non-repeating sub-sequences.
    Type: Application
    Filed: October 25, 2021
    Publication date: April 14, 2022
    Inventor: Muhammad A. Dawood
  • Publication number: 20220116635
    Abstract: Aspects of the disclosure include methods, apparatuses, and non-transitory computer-readable storage mediums for video encoding/decoding. An apparatus includes processing circuitry that determines directionality information of a restoration filter unit included in a video frame based on at least one of a constrained directional enhancement filter (CDEF) process or an intra prediction mode. The processing circuitry determines one of a plurality of sets of filter parameters of a restoration filter process based on the directionality information of the restoration filter unit. The processing circuitry performs the restoration filter process on the restoration filter unit based on the one of the plurality of sets of filter parameters. The processing circuitry reconstructs the video frame based on the filtered restoration filter unit.
    Type: Application
    Filed: June 29, 2021
    Publication date: April 14, 2022
    Applicant: TENCENT AMERICA LLC
    Inventors: Sehoon YEA, Yixin DU, Xin ZHAO, Shan LIU