Patents Examined by Zhubing Ren
  • Patent number: 11968389
    Abstract: The present technique relates to an image processing device and method which can suppress an increase in an operation time. The image processing device has: an encoding control unit which, upon encoding independently performed per slice for dividing a picture into a plurality of pictures, controls whether or not to adopt for motion information a merge mode of merging a relevant region of an operation target with a surrounding region positioned in a surrounding of the relevant region, based on information of surrounding regions which belong to a relevant slice to which the relevant region belongs; and an encoding unit which encodes the relevant region in the merge mode or a mode other than the merge mode under control of the encoding control unit. The present disclosure is applicable to the image processing device.
    Type: Grant
    Filed: March 16, 2022
    Date of Patent: April 23, 2024
    Assignee: SONY CORPORATION
    Inventor: Kenji Kondow
  • Patent number: 11949895
    Abstract: An apparatus for video decoding includes processing circuitry. The circuitry can be configured to receive a current block that is affine coded and included in a current coding tree unit (CTU), and determine an inherited affine candidate based on regular motion information of two minimum blocks in a rightmost column of minimum blocks of a left neighboring CTU of the current CTU when the current block is adjacent to a left boundary of the current CTU.
    Type: Grant
    Filed: September 9, 2021
    Date of Patent: April 2, 2024
    Assignee: TENCENT AMERICA LLC
    Inventors: Guichun Li, Xiaozhong Xu, Xiang Li, Shan Liu
  • Patent number: 11943467
    Abstract: Systems, methods, and instrumentalities for affine motion estimation for affine model-based video coding may be disclosed herein. A first motion vector (MV) set including one or more MVs may be derived for a first coding block. The MVs may be control point MVs (CPMVs) and the MVs may be derived by performing affine motion estimation (ME) associated with the first coding block. The first MV set may be added to a recently-estimated MV list. A head of the recently-estimated MV list may be set to the first MV set. The recently-estimated MV list may be empty or may contain one or more previously-added MV sets.
    Type: Grant
    Filed: September 20, 2019
    Date of Patent: March 26, 2024
    Assignee: VID Scale, Inc.
    Inventors: Yuwen He, Xiaoyu Xiu, Yan Ye, Jiancong Luo
  • Patent number: 11943430
    Abstract: A method of decoding an image according to an embodiment includes: when a size of a current block in the image is equal to or greater than a certain size, determining a candidate list including, as a candidate, a first reference block indicated by a temporal motion vector; when the first reference block is selected from among candidates included in the candidate list, determining motion vectors of sub-blocks in the current block by using motion vectors obtained from the first reference block; and reconstructing the current block based on sample values of a second reference block indicated by the motion vectors of the sub-blocks.
    Type: Grant
    Filed: July 29, 2019
    Date of Patent: March 26, 2024
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Minwoo Park, Minsoo Park, Seungsoo Jeong, Anish Tamse
  • Patent number: 11924471
    Abstract: A video decoder configured to set a context index variable to a first value, wherein the first value for the context index variable is associated with a first context; context decode a first bin for a syntax element indicating a transform using the first context; determine a new value for the context index variable based on a value of the first bin; context decode a second bin for the syntax element indicating the transform using a context associated with the new value; determine an inverse transform from a set of inverse transform candidates based on the first bin and the second bin; and apply the inverse transform to a set of coefficients to determine a block of residual data.
    Type: Grant
    Filed: June 9, 2021
    Date of Patent: March 5, 2024
    Assignee: QUALCOMM Incorporated
    Inventors: Hilmi Enes Egilmez, Vadim Seregin, Marta Karczewicz
  • Patent number: 11871031
    Abstract: Disclosed are a method for inducing a prediction motion vector and an apparatus using the same. An image decoding method can include: a step of determining the information related to a plurality of spatial candidate prediction motion vectors from peripheral predicted blocks of a predicted target block; and a step of determining the information related to temporal candidate prediction motion vectors on the basis of the information related to the plurality of spatial candidate prediction motion vectors. Accordingly, the present invention can reduce complexity and can enhance coding efficiency when inducing the optimum prediction motion vector.
    Type: Grant
    Filed: July 13, 2020
    Date of Patent: January 9, 2024
    Assignees: Electronics and Telecommunications Research Institute, Industry-University Cooperation Foundation Korea Aerospace University
    Inventors: Sung Chang Lim, Hui Yong Kim, Jin Ho Lee, Jin Soo Choi, Jin Woong Kim, Jae Gon Kim, Sang Yong Lee, Un Ki Park
  • Patent number: 11856216
    Abstract: The present disclosure provides embodiments for coding and decoding signs of transform coefficients which is applicable, for instance, in image and/or video coding and decoding. In particular, a plurality of the signs are predicted and only a prediction error signal is embedded in the bitstream. The prediction error signal may have a distribution which can be efficiently coded with CABAC or another variable length (entropy) coding. Moreover, if adaptive multi-core transform is used, the context for the entropy code to code a transform coefficient sign is selected according to the transformation which was used to obtain the transform coefficient.
    Type: Grant
    Filed: August 14, 2020
    Date of Patent: December 26, 2023
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Alexey Konstantinovich Filippov, Vasily Alexeevich Rufitskiy
  • Patent number: 11818385
    Abstract: There are disclosed various methods, apparatuses and computer program products for video encoding and decoding. In some embodiments a method comprises at least one of the following: encoding into a bitstream an indication that motion fields are stored, but only for inter-layer motion prediction; encoding into a bitstream an indication on a limited scope of motion field usage; encoding into a bitstream an indication whether or not to use the motion field for prediction; encoding into a bitstream an indication of storage parameters for storing motion information.
    Type: Grant
    Filed: November 22, 2021
    Date of Patent: November 14, 2023
    Assignee: NOKIA TECHNOLOGIES OY
    Inventor: Miska Matias Hannuksela
  • Patent number: 11800108
    Abstract: A method for image compression and a circuit system thereof are provided. In the method, pixel values of an image are obtained. A compression scenario is decided, for example, a uniform-quantization manner or a non-uniform-quantization manner is used for an M-bit image being compressed to an N-bit image so as to decide codeword sections for the image. Every codeword section has a codeword distance. The codeword sections have a fixed codeword distance in the uniform-quantization manner. Alternatively, in the non-uniform-quantization manner, the image can be divided into multiple codeword sections having different codeword distances according to a brightness distribution. Afterwards, a random number is generated for deciding codeword and index for original value of each of the pixels. An index table is accordingly formed. The index table is provided for obtaining the codeword in a decoding process by querying a codebook with the index.
    Type: Grant
    Filed: March 16, 2022
    Date of Patent: October 24, 2023
    Assignee: REALTEK SEMICONDUCTOR CORP.
    Inventors: Wan-Ju Tang, Tsung-Hsuan Li, Shih-Tse Chen
  • Patent number: 11770549
    Abstract: Apparatus comprises video data decoder circuitry configured to decode an input video data stream, the video data decoder being responsive to parameter data associated with the input video data stream, the parameter data indicating a profile selected from a plurality of profiles, each profile defining a decoding attribute comprising one or more of a bit depth and a chrominance subsampling format; detector circuitry configured to detect constraint data associated with the input video data stream, the constraint data defining a difference between a decoding attribute applicable to the input video data stream and the decoding attribute defined by the profile indicated by the parameter data, in which the constraint data is configured to indicate a zero difference of the decoding attribute by a zero value of the constraint data; and control circuitry configured to control the video data decoder to decode the input video data stream to generate a decoded video data stream having a decoding attribute defined by the e
    Type: Grant
    Filed: June 10, 2020
    Date of Patent: September 26, 2023
    Assignee: SONY GROUP CORPORATION
    Inventors: Karl James Sharman, Stephen Mark Keating, Adrian Richard Browne
  • Patent number: 11758178
    Abstract: An image decoding method performed by a decoding device according to the present document comprises the steps of: deriving a temporary reference motion vector regarding a current block on the basis of a temporal periphery block included in a reference picture of a current picture including the current block; deriving a binary code indicating a reference motion vector by applying a shifting operation to a binary code indicating the temporary reference motion vector; storing information regarding the binary code indicating the reference motion vector; deriving a motion vector regarding the current block on the basis of the reference motion vector; deriving a predicted block regarding the current block on the basis of the motion vector regarding the current block; and generating a restored picture regarding the current picture on the basis of the predicted block regarding the current block.
    Type: Grant
    Filed: September 23, 2019
    Date of Patent: September 12, 2023
    Assignee: LG ELECTRONICS INC.
    Inventor: Hyeongmoon Jang
  • Patent number: 11758166
    Abstract: An image decoder includes circuitry and a memory, wherein the circuitry, in operation, determines whether inter prediction is to be applied to a current block; in response to determining that the inter prediction is to be applied to the current block, performs a partition prediction process; and, in response to determining that the inter prediction is not to be applied, decodes the current block without using the partition prediction process. The partition prediction process includes predicting first values of a set of pixels between a first partition and a second partition in the current block, using a first motion vector for the first partition; predicting second values of the set of pixels, using a second motion vector for the second partition; weighting the first values and the second values; and generating a prediction image for the current block using the weighted first values and the weighted second values.
    Type: Grant
    Filed: September 7, 2021
    Date of Patent: September 12, 2023
    Assignee: Panasonic Intellectual Property Corporation of America
    Inventors: Kiyofumi Abe, Takahiro Nishi, Tadamasa Toma, Ryuichi Kanoh, Chong Soon Lim, Ru Ling Liao, Hai Wei Sun, Sughosh Pavan Shashidhar, Han Boon Teo, Jing Ya Li
  • Patent number: 11729428
    Abstract: Example devices and techniques are disclosed for incorporating temporal identification information in geometry point cloud compression syntax structures. An example device for decoding point cloud data includes memory configured to store the point cloud data and one or more processors implemented in circuitry and communicatively coupled to the memory. The one or more processors are configured to determine a value of a temporal identifier (ID) of a syntax structure and decode the point cloud data based on the value of the temporal ID. The temporal ID of the syntax structure identifies a temporal layer to which point cloud data associated with the syntax structure belongs.
    Type: Grant
    Filed: September 22, 2021
    Date of Patent: August 15, 2023
    Assignee: QUALCOMM Incorporated
    Inventors: Adarsh Krishnan Ramasubramonian, Geert Van der Auwera, Bappaditya Ray, Marta Karczewicz
  • Patent number: 11711542
    Abstract: To increase efficiency of a bit-depth scalable data-stream an inter-layer prediction is obtained by mapping samples of the representation of the picture or video source data with a first picture sample bit-depth from a first dynamic range corresponding to the first picture sample bit-depth to a second dynamic range greater than the first dynamic range and corresponding to a second picture sample bit-depth being higher than the first picture sample bit-depth by use of one or more global mapping functions being constant within the picture or video source data or varying at a first granularity, and a local mapping function locally modifying the one or more global mapping functions and varying at a second granularity smaller than the first granularity, with forming the quality-scalable data-stream based on the local mapping function such that the local mapping function is derivable from the quality-scalable data-stream.
    Type: Grant
    Filed: March 22, 2021
    Date of Patent: July 25, 2023
    Assignee: GE Video Compression, LLC
    Inventors: Thomas Wiegand, Martin Winken
  • Patent number: 11695960
    Abstract: A video decoder determines, based on a block size of a current block and a low-frequency non-separable transform (LFNST) syntax element, a zero-out pattern of normatively defined zero-coefficients. The LFNST syntax element is signaled at a transform unit (TU) level. Additionally, the video decoder determines transform coefficients of the current block. The transform coefficients of the current block include transform coefficients in an LFNST region of the current block and transform coefficients outside the LFNST region of the current block. As part of determining the transform coefficients of the current block, the video decoder applies an inverse LFNST to determine values of one or more transform coefficients in the LFNST region of the current block. The video decoder also determines that transform coefficients of the current block in a region of the current block defined by the zero-out pattern are equal to 0.
    Type: Grant
    Filed: June 11, 2020
    Date of Patent: July 4, 2023
    Assignee: QUALCOMM Incorporated
    Inventors: Alican Nalci, Hilmi Enes Egilmez, Vadim Seregin, Muhammed Zeyd Coban, Marta Karczewicz
  • Patent number: 11671593
    Abstract: An encoder includes processing circuitry and memory. Using the memory, the processing circuitry: encodes and reconstructs an image to generate a reconstructed image; determines, according to a characteristic of a block in the reconstructed image, an interpolation method for interpolating pixels located outside a referable region including the block; interpolates the pixels located outside the referable region, using the interpolation method determined; and applies a filter to the block using the pixels interpolated.
    Type: Grant
    Filed: September 29, 2021
    Date of Patent: June 6, 2023
    Assignee: Panasonic Intellectual Property Corporation of America
    Inventors: Ryuichi Kanoh, Tadamasa Toma, Takahiro Nishi, Kiyofumi Abe, Takashi Hashimoto
  • Patent number: 11671632
    Abstract: A method for encoding a video image using coding parameters, adapted on the basis of motion of the video image and of an output of a machine-learning based model, wherein the machine-learning based model is input with samples of a block of the video image and motion information of the samples, and along with texture, wherein the machine-learning model segments the video image into regions based on strength of the motion determined from the motion information. An object is detected within the video based on the motion and the texture, and spatial-time coding parameters are determined based on the strength of the motion, and whether or not the detected objects moves.
    Type: Grant
    Filed: February 9, 2021
    Date of Patent: June 6, 2023
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Kirill Aleksandrovich Malakhov, Hu Chen, Zhijie Zhao, Dmitry Vadimovich Novikov, Marat Ravilevich Gilmutdinov
  • Patent number: 11653013
    Abstract: A computer implemented program executable to display a graphical user interface on a display surface of a computing device which by user indications retrieves a video and a geospatial representation in which one or more coordinate location indicators can be selected, and further functions to match location coordinates associated with selected coordinate location indicators with the plurality of images occurring between a beginning video image and an ending video image of the video.
    Type: Grant
    Filed: November 13, 2019
    Date of Patent: May 16, 2023
    Assignee: Remote Geosystems, Inc.
    Inventors: Bradon D. Loyd, Jeffrey W. Dahlke
  • Patent number: 11647226
    Abstract: A system comprises an encoder configured to compress attribute information and/or spatial information for a point cloud and/or a decoder configured to decompress compressed attribute and/or spatial information for the point cloud. To compress the attribute and/or spatial information, the encoder is configured to convert a point cloud into an image based representation. Also, the decoder is configured to generate a decompressed point cloud based on an image based representation of a point cloud. In some embodiments, a bit stream structure may be used to communicate compressed point cloud data. The bit stream structure may include point cloud compression network abstraction layer (PCCNAL) units that enable use of groups of frames (GOFs), frame, and sub-frame signaling of patch information. Such a bit stream structure may permit low delay streaming and random access reconstruction of point clouds amongst other applications.
    Type: Grant
    Filed: May 12, 2021
    Date of Patent: May 9, 2023
    Assignee: Apple Inc.
    Inventors: Jungsun Kim, Alexandros Tourapis, Khaled Mammou, Fabrice A. Robinet, Yeping Su, David W. Singer
  • Patent number: 11647193
    Abstract: In an embodiment, a method involves receiving a pixel array, compressing the pixel array by, for each pixel block of multiple pixel blocks: accessing pixel values associated with pixels in the pixel block, determining a range of the pixel values and an endpoint pixel value in the range, determining quantization levels corresponding to different values within the range of the pixel values, selecting a quantization level from the quantization levels for each of the pixel values in the pixel block, and encoding the pixel values in the pixel block using their respective selected quantization levels and the endpoint pixel value.
    Type: Grant
    Filed: December 18, 2020
    Date of Patent: May 9, 2023
    Assignee: Meta Platforms Technologies, LLC
    Inventor: Richard Webb