Patents Examined by Dramos Kalapodas
  • Patent number: 11683484
    Abstract: An example system may include a primary mode decision module, included in a hardware video encoding pipeline, that (1) receives video data for encoding in accordance with a video encoding standard, and (2) identifies, from an initial set of prediction modes supported by the video encoding standard, a primary set of prediction modes for encoding the video data in accordance with the video encoding standard. The example system may also include a secondary mode decision module that (1) determines, for each prediction mode included in the primary set of prediction modes and based on the video data, a cost associated with the prediction mode, and (2) selects, from the primary set of prediction modes and based on the determined costs associated with the prediction modes included in the primary set of prediction modes, a prediction mode for encoding of the video data by the hardware video encoding pipeline.
    Type: Grant
    Filed: September 28, 2021
    Date of Patent: June 20, 2023
    Assignee: Meta Platforms, Inc.
    Inventors: Gaurang Chaudhari, Harikrishna Madadi Reddy
  • Patent number: 11677950
    Abstract: Concepts are presented which achieve a more efficient coding of coefficients of a transform block by use of dependent quantization and context adaptive entropy coding or achieve a coding of coefficients of a transform block in a manner which allows a more efficient coding even if a usage of dependent quantization is combined with the usage of context adaptive entropy coding.
    Type: Grant
    Filed: March 19, 2021
    Date of Patent: June 13, 2023
    Assignee: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
    Inventors: Heiko Schwarz, Thomas Wiegand, Phan Hoang Tung Nguyen, Detlev Marpe
  • Patent number: 11647227
    Abstract: Disclosed approaches may provide for non-blocking video processing pipelines that have the ability to efficiently share transform hardware resources. Transform hardware resources may be shared across processing parameters, such as pixel block dimensions, transform types, video stream bit depths, and/or multiple coding formats, as well as for inter-frame and intra-frame encoding. The video processing pipeline may be divided into phases, each phase having half-butterfly circuits to perform a respective portion of computations of a transform. The phases may be selectable and configurable to perform transforms for multiple different combinations of the processing parameters. In each configuration, the phases may be capable of performing a transform by a sequential pass through at least some of the phases resulting in high throughput. Approaches are also described related to improving the performance and efficiency of transpose operations of transforms.
    Type: Grant
    Filed: August 16, 2021
    Date of Patent: May 9, 2023
    Assignee: NVIDIA Corporation
    Inventors: Eric Masson, Ankur Saxena, Donald Bittel
  • Patent number: 11641478
    Abstract: A video processing method includes determining, fora conversion between a video block of a video and a coded representation of the video, factors of a scaling tool based on a coding mode of the video block; and performing the conversion using the scaling tool, wherein the use of the scaling tool comprises: scaling at least some coefficients representing the video block during encoding or descaling at least some coefficients from the coded representation during decoding.
    Type: Grant
    Filed: February 18, 2022
    Date of Patent: May 2, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • Patent number: 11641480
    Abstract: A method of decoding a coded picture of a coded video sequence is performed by at least one processor and the method includes decoding, from a parameter set, a plurality of candidate decoded resolutions, selecting, through an index coded in a transient header structure applicable to a group of samples, a candidate decoded resolution among the plurality of candidate decoded resolutions, resampling a sample of the group of samples based on an output resolution and the selected candidate decoded resolution, and enabling prediction using the resampled sample.
    Type: Grant
    Filed: June 30, 2021
    Date of Patent: May 2, 2023
    Assignee: TENCENT AMERICA LLC
    Inventors: Stephan Wenger, Byeongdoo Choi, Shan Liu
  • Patent number: 11636571
    Abstract: A video system processes video frames from a wide angle camera to dewarp the video frames in a manner that preserves conformity of an object of interest. A crop region of a video frame corresponding to the object of interest is determined. An input parameter to a dewarping function is generated based on the detected crop region. The dewarping function is applied to the crop region using the input parameter to generate a dewarped video frame and the dewarped video frame is outputted. The input parameter may be generated in a manner that causes the dewarped video frame to have higher conformity and lower distortion in the region around the object of interest than in a region distant from the object of interest.
    Type: Grant
    Filed: July 2, 2021
    Date of Patent: April 25, 2023
    Assignee: Meta Platforms, Inc.
    Inventors: Josiah Vincent Vivona, Ted Taejin Kim, Eric W. Hwang
  • Patent number: 11632553
    Abstract: Provided are a coding prediction method and apparatus and a computer storage medium. The method includes that; for a coding block of an intra prediction type, Motion Vector (MV) Predictors (MVPs) of at least two control points of the coding block are determined; affine motion model-based motion estimation is performed on the coding block based on the MVPs of the at least two control points to obtain a first coding parameter of the coding block, the first coding parameter indicating a group of coding parameters corresponding to a minimum Rate-Distortion Cost (RDcost) obtained by performing motion estimation on the coding block in a non-translation motion manner; and prediction coding is performed on the coding block based on the first coding parameter.
    Type: Grant
    Filed: June 24, 2021
    Date of Patent: April 18, 2023
    Assignee: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP., LTD.
    Inventors: Fan Liang, Haiyang Han, Siqi Cao
  • Patent number: 11627325
    Abstract: An intra prediction method according to the present invention comprises the following steps: performing a directional prediction using at least one of a neighboring pixel of a current block and a left upper corner pixel positioned at a left upper corner of the current block so as to obtain a first prediction value for the current block; obtaining a second prediction value for the current block using the reference sample positioned in the current block; and weighted summing the first prediction value and the second prediction value using a weighting matrix so as to obtain a final prediction value for the current block. According to the present invention, image encoding/decoding efficiency may be improved.
    Type: Grant
    Filed: April 14, 2022
    Date of Patent: April 11, 2023
    Assignee: Electronics and Telecommunications Research Institute
    Inventors: Jin Ho Lee, Hui Yong Kim, Sung Chang Lim, Jong Ho Kim, Ha Hyun Lee, Se Yoon Jeong, Suk Hee Cho, Jin Soo Choi, Jin Woong Kim, Chie Teuk Ahn
  • Patent number: 11606572
    Abstract: A video processing method includes determining, fora conversion between a video block of a video and a coded representation of the video, factors of a scaling tool based on a coding mode of the video block; and performing the conversion using the scaling tool, wherein the use of the scaling tool comprises: scaling at least some coefficients representing the video block during encoding or descaling at least some coefficients from the coded representation during decoding.
    Type: Grant
    Filed: February 18, 2022
    Date of Patent: March 14, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • Patent number: 11595652
    Abstract: A decoder includes circuitry configured to receive a bitstream; store a plurality of long-term reference frames in a reference list; retain a long-term reference frame in the reference list for a length of time based on a retention time; and decode at least a portion of video using the long-term reference frame retained in the reference list. Related apparatus, systems, techniques and articles are also described.
    Type: Grant
    Filed: July 27, 2021
    Date of Patent: February 28, 2023
    Assignee: OP Solutions, LLC
    Inventors: Borivoje Furht, Hari Kalva, Velibor Adzic
  • Patent number: 11595656
    Abstract: A method and apparatus for encoding or decoding transform coefficients in a video coding system are disclosed. According to this method, a region after zero-outis determined. A remaining number of context-coded bins is determined for the current TB based on a size of the region after zero-out. The current TB is encoded or decoded using context-based coding with a constraint based on the remaining number of context-coded bins. According to another method, a remaining number of context-coded bins is determined for the current TB based on the last significant CG index.
    Type: Grant
    Filed: January 22, 2020
    Date of Patent: February 28, 2023
    Assignee: HFI INNOVATION INC.
    Inventors: Tzu-Der Chuang, Ching-Yeh Chen
  • Patent number: 11595678
    Abstract: A method, computer program, and computer system is provided for coding video data. Video data including one or more blocks is received. A current block coded in intra block copy mode or string matching mode is predicted from among the one or more blocks based on a coded block vector or a string offset vector corresponding to one or more spatial neighboring or non-neighboring blocks from among the one or more blocks. The video data is decoded based on the predicted current block.
    Type: Grant
    Filed: April 26, 2021
    Date of Patent: February 28, 2023
    Assignee: TENCENT AMERICA LLC
    Inventors: Xiaozhong Xu, Shan Liu
  • Patent number: 11582449
    Abstract: A set of rough prediction modes including a MPM subset is determined for a code block during image encoding. A first prediction mode having a mode cost less than a first threshold is selected from the set of rough prediction modes, and a second prediction mode having a mode cost less than a second threshold is selected from the MPM subset. A candidate mode subset is determined based on mode types of prediction modes contained in the set of rough prediction modes and a ranking result of mode costs of the prediction modes, when the mode cost of the first prediction mode is different from the mode cost of the second prediction mode. A target prediction mode is determined for the code block from the candidate mode subset. The code block is encoded with the target prediction mode.
    Type: Grant
    Filed: June 3, 2021
    Date of Patent: February 14, 2023
    Assignee: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY CO., LTD.
    Inventors: Jiaojiao Zhang, Wenpeng Ding
  • Patent number: 11582453
    Abstract: A method, computer program, and computer system is provided for video encoding and decoding. Video data including one or more frames is received. One or more quantization parameters associated with the received video data are determined for frame generation or enhancement of a target frame from among the one or more frames. The video data is decoded based on the determined quantization parameters.
    Type: Grant
    Filed: July 6, 2021
    Date of Patent: February 14, 2023
    Assignee: TENCENT AMERICA LLC
    Inventors: Zeqiang Li, Wei Wang, Xiaozhong Xu, Wei Jiang, Shan Liu
  • Patent number: 11580639
    Abstract: A first electronic device according to various embodiments may include: a display; a communication module comprising communication circuitry; a camera module including at least one camera; and a processor.
    Type: Grant
    Filed: December 14, 2020
    Date of Patent: February 14, 2023
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Youngjae Oh, Yoonhee Choi, Jinhong Min, Hyoungseon Choi, Joonho Kim, Sangkyung Lee, Changwon Son, Younjoo Song, Seoyoung Yoon, Taehan Jeon, Hyunjoo Jung, Jiwoon Jung
  • Patent number: 11576555
    Abstract: A medical imaging system is described that comprises an heating element configured to apply at least one heating pattern element to a material to locally heat the material; a sensor configured to capture the position of the heated material a predetermined time after the application of the heating pattern element; and circuitry configured to determine the change of the heating pattern applied to the material based upon the captured position of the heated material after the predetermined time.
    Type: Grant
    Filed: February 23, 2018
    Date of Patent: February 14, 2023
    Assignee: SONY CORPORATION
    Inventors: Matthew Lawrenson, Shigeru Mitarai
  • Patent number: 11575924
    Abstract: Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. In some examples, an apparatus for video decoding includes receiving circuitry and processing circuitry. In some embodiments, the processing circuitry decodes prediction information of a current block in a current coding from a coded video bitstream. The prediction information is indicative of an intra block copy mode. Then, the processing circuitry determines a block vector that points to a reference block in a same picture as the current block. The reference block is restricted within a coding region with reconstructed samples buffered in a reference sample memory. The coding region is one of multiple predefined regions of a coding tree unit (CTU). Then, the processing circuitry reconstructs at least a sample of the current block based on the reconstructed samples of the reference block that are retrieved from the reference sample memory.
    Type: Grant
    Filed: August 24, 2021
    Date of Patent: February 7, 2023
    Assignee: Tencent America LLC
    Inventors: Xiaozhong Xu, Xiang Li, Shan Liu
  • Patent number: 11575914
    Abstract: An image decoding method according to the present disclosure includes deriving transform coefficients through dequantization based on the quantized transform coefficients for the target block; deriving modified transform coefficients based on an inverse reduced secondary transform (RST) for the transform coefficients; deriving residual samples for the target block based on an inverse primary transform for the modified transform coefficients; and generating a reconstructed samples based on the residual samples, and prediction samples derived based on an intra prediction mode for the target block, wherein the inverse RST is performed based on a transform kernel matrix selected from a transform set including a plurality of transform kernel matrices, the transform set is determined based on a mapping relationship according to the intra prediction mode applied to the target block, and a plurality of intra prediction modes including the intra prediction mode of the target block are mapped to one transform set.
    Type: Grant
    Filed: December 27, 2021
    Date of Patent: February 7, 2023
    Assignee: LG ELECTRONICS INC.
    Inventors: Moonmo Koo, Mehdi Salehifar, Seunghwan Kim, Jaehyun Lim
  • Patent number: 11570438
    Abstract: An image decoding method includes: acquiring a multiple transform selection (MTS) index and residual information from a bitstream; deriving transform coefficients for the current block on the basis of the residual information; and generating residual samples of the current block on the basis of the MTS index and the transform coefficients, wherein the MTS index indicates a transform kernel set to be applied to the current block among transform kernel set candidates, at least one bin among bins of a bin string of the MTS index is derived on the basis of context coding, the context coding is performed on the basis of values of increase and decrease in a context index pertaining to the MTS index, and a single value of increase and decrease in the context index can be used for the context coding of the first bin among the bins of the bin string.
    Type: Grant
    Filed: December 20, 2021
    Date of Patent: January 31, 2023
    Assignee: LG Electronics Inc.
    Inventors: Junghak Nam, Moonmo Koo, Jaehyun Lim, Seunghwan Kim
  • Patent number: 11558613
    Abstract: There are provided mechanisms for methods and apparatuses for transform selection in encoding and decoding of video blocks.
    Type: Grant
    Filed: June 28, 2021
    Date of Patent: January 17, 2023
    Assignee: Telefonaktiebolaget LM Ericsson (publ)
    Inventors: Christopher Hollmann, Davood Saffar, Jacob Ström, Per Wennersten