Patents Examined by Jae N. Noh
  • Patent number: 11831887
    Abstract: A neural processing unit (NPU) for decoding video or feature map is provided. The NPU may include at least one processing element (PE) for an artificial neural network, the at least one PE configured to receive and decode data included in a bitstream. The data included in the bitstream may include data of a base layer; or the data of the base layer and data of at least one enhancement layer. An NPU for encoding video or feature map is also provided. The encoder NPU may include at least one PE for an artificial neural network, the at least one PE configured to receive and encode a transmitted video or feature map, wherein the at least one PE may be further configured to output a bitstream including data of a base layer and data of at least one enhancement layer.
    Type: Grant
    Filed: August 29, 2022
    Date of Patent: November 28, 2023
    Assignee: DEEPX CO., LTD.
    Inventors: IlMyeong Im, SunMi Lee
  • Patent number: 11831886
    Abstract: Configuration data is obtained and is useable by a decoder to reconstruct a first representation of an image at a first level of quality using a second representation of the image at the first level of quality. The second representation is based on a representation of the image at a second, lower level of quality. The configuration data comprises a value of a configuration parameter, the value having a variable bit-length. The configuration data is arranged into a sequence of bytes comprising a variable-length element arranged to store the value of the configuration parameter. The variable-length element comprises at least one given byte having one or more predetermined bits arranged to indicate whether or not the variable-length element comprises one or more additional bytes to the at least one given byte. The sequence of bytes is output for processing by the decoder.
    Type: Grant
    Filed: November 7, 2022
    Date of Patent: November 28, 2023
    Inventor: Robert Johnson
  • Patent number: 11825124
    Abstract: Video processing, including video coding, video decoding and video transcoding, is described. One example method includes performing a conversion between a video comprising a video picture and a bitstream of a video according to a rule, where the rule specifies that syntax elements indicate a first width and a first height of a scaling window for the video picture, and where the rule specifies that a range of permissible values for the syntax elements include values greater than or equal to two times a second width of the video picture and two times a second height of the video picture.
    Type: Grant
    Filed: November 18, 2022
    Date of Patent: November 21, 2023
    Assignees: BEIJING BYTEDANCET NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Ye-kui Wang, Zhipin Deng, Kai Zhang, Li Zhang
  • Patent number: 11825080
    Abstract: An image decoding method performed by a decoding apparatus, according to the present document, comprises the steps of: deriving a multilayer output layer set (OLS) index of a target OLS in a list of multilayer OLSs; acquiring hypothetical reference decoder (HRD)-related information and decoded picture buffer (DPB)-related information for the target OLS, on the basis of the multilayer OLS index; and decoding a picture within the target OLS, on the basis of the HRD-related information and the DPB-related information, wherein the multilayer OLSs are OLSs including a plurality of layers, and the target OLS is one of the multilayer OLSs.
    Type: Grant
    Filed: October 26, 2022
    Date of Patent: November 21, 2023
    Assignee: LG Electronics Inc.
    Inventor: Hendry Hendry
  • Patent number: 11825114
    Abstract: A coding tool is provided to improve the compression performance of inter prediction and is used at the encoder/decoder side to adjust the correction of a motion vector based on a high level syntax. In addition, a method is provided for simply performing an integer sample search step of searching for an integer offset and a fractional sample refinement step of searching for a sub-pixel offset in relation to motion vector refinement among coding tools.
    Type: Grant
    Filed: July 27, 2022
    Date of Patent: November 21, 2023
    Assignees: Hyundai Motor Company, Kia Corporation, Ewha University-Industry Collaboration Foundation
    Inventors: Je Won Kang, Sang Hyo Park, Seung Wook Park, Wha Pyeong Lim
  • Patent number: 11818371
    Abstract: An apparatus includes at least one processor; and at least one memory including computer program code; wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus at least to: indicate an extraction reference map entry used to assign a group identifier to at least one extraction reference, the extraction reference map entry indicating a subpicture layout; wherein the at least one extraction reference causes extraction of a network abstraction layer unit data by reference from another track; wherein the at least one extraction reference comprises an index of a track reference having a subpicture type within a subpicture order sample group description entry; and indicate, using the at least one extraction reference, subpictures or slices of a coded picture in decoding order.
    Type: Grant
    Filed: October 7, 2021
    Date of Patent: November 14, 2023
    Assignee: Nokia Technologies Oy
    Inventors: Miska Matias Hannuksela, Kashyap Kammachi Sreedhar, Emre Aksu
  • Patent number: 11818367
    Abstract: The present disclosure relates to a method for encoding a video stream. The method comprising: acquiring pixel data of the video stream having a first resolution; extracting a crop corresponding to a region of interest from the pixel data of the video stream, the crop having the first resolution; down-scaling the pixel data of the video stream into a down-scaled video stream having a second resolution lower than the first resolution; processing the down-scaled video stream through one or more video processing operations; processing the crop through the one or more video processing operations; up-scaling the processed down-scaled video stream into an up-scaled video stream having the first resolution; merging the processed crop and the up-scaled video stream into a merged video stream; and encoding the merged video stream. The present disclosure further related to a video encoding device.
    Type: Grant
    Filed: October 11, 2022
    Date of Patent: November 14, 2023
    Assignee: Axis AB
    Inventors: Song Yuan, Viktor Edpalm
  • Patent number: 11818351
    Abstract: In some embodiments, an electronic device for compressing video image data includes a housing, an image sensor, a memory device, and one or more processors. The image sensor can generate image data from light incident on the image sensor. The one or more processors can transform the image data to obtain transform coefficients, quantize the transform coefficients, encode the quantized transform coefficients, and store the quantized transform coefficients to the memory device. The one or more processors can encode the quantized transform coefficients at least by determining a range of multiple ranges in which one transform coefficient is included, determining a value within the range to which the one transform coefficient corresponds, encoding using a first algorithm the range as a range code, and encoding using a second algorithm the value as a value code.
    Type: Grant
    Filed: October 21, 2022
    Date of Patent: November 14, 2023
    Assignee: RED.COM, LLC
    Inventors: James H. Jannard, Peter Jarred Land, Manjunath Subray Bhat
  • Patent number: 11818399
    Abstract: There is included a method and apparatus comprising computer code configured to cause a processor or processors to perform obtaining a video bitstream, coding the video bitstream at least partly by a neural network, determining topology information and parameters of the neural network, signaling the determined topology information and the parameters of the neural network in a plurality of syntax elements associated with the coded video bitstream.
    Type: Grant
    Filed: September 16, 2021
    Date of Patent: November 14, 2023
    Assignee: TENCENT AMERICA LLC
    Inventors: Byeongdoo Choi, Zeqiang Li, Wei Jiang, Wei Wang, Xiaozhong Xu, Stephan Wenger, Shan Liu
  • Patent number: 11812013
    Abstract: Disclosed herein are a method, an apparatus and a storage medium for performing encoding/decoding on an image using a subpicture. A picture may be partitioned into various units such as subpictures and slices, and various syntax elements and structures may be used to specify the units. In an embodiment, there is a method for configuring a reference picture list for motion compensation in the case where the location of a reference subpicture to be referred to for motion compensation is different from the location of a target subpicture. Further, in an embodiment, there is provided a method for providing the configuration of a reference picture list and an override on the number of activated reference indexes.
    Type: Grant
    Filed: September 28, 2022
    Date of Patent: November 7, 2023
    Assignee: Electronics and Telecommunications Research Institute
    Inventors: Gun Bang, Woong Lim
  • Patent number: 11812049
    Abstract: An encoder includes circuitry and a memory coupled to the circuitry, wherein the circuitry, in operation, performs a partition process. The partition process includes calculating first values of a set of pixels between a first partition and a second partition in a current block, using a first motion vector for the first partition; calculating second values of the set of pixels, using a second motion vector for the second partition; and calculating third values of the set of pixels by weighting the first values and the second values. When a ratio of a width to a height of the current block is larger than 4 or a ratio of the height to the width of the current block is larger than 4, the circuitry disables the partition process.
    Type: Grant
    Filed: December 14, 2022
    Date of Patent: November 7, 2023
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Kiyofumi Abe, Takahiro Nishi, Tadamasa Toma, Ryuichi Kanoh, Chong Soon Lim, Ru Ling Liao, Hai Wei Sun, Sughosh Pavan Shashidhar, Han Boon Teo, Jing Ya Li
  • Patent number: 11805279
    Abstract: A method and apparatus for decoding prediction residues in a video coding system operate by receiving input data associated with a current residual block, wherein the input data correspond to coded quantized-transform coefficients associated with the current residual block to be decoded at a decoder side, and wherein the current residual block is divided into one or more sub-blocks. This method further signals a plurality of syntax elements representing coded quantized transform coefficients at the encoder side or parsing the plurality of syntax elements representing the coded quantized transform coefficients at the decoder side, wherein at least two of the plurality of syntax elements are coded in a CABAC regular mode and all syntax elements coded in the CABAC regular mode are signalled or parsed in one coding pass. The method further encodes or decodes the current residual block according to the plurality of syntax elements.
    Type: Grant
    Filed: June 1, 2022
    Date of Patent: October 31, 2023
    Assignee: HFI INNOVATION INC.
    Inventor: Shih-Ta Hsiang
  • Patent number: 11792360
    Abstract: A vehicular vision system includes a forward-viewing camera and an electronic control unit (ECU). The forward-viewing camera views forward of the vehicle through the windshield of the vehicle. The forward-viewing camera is operable to capture image data. The forward-viewing camera is connected with the ECU via a first connecting cable. The first connecting cable (i) carries image data captured by the forward-viewing camera from the camera to the ECU, (ii) carries camera control data from the ECU to the forward-viewing camera and (iii) connects a DC power supply of the ECU to the forward-viewing camera for powering the camera. The camera control data is carried by the cable from the ECU to the camera at a control data carrier frequency that is lower than an image data carrier frequency at which image data captured by the camera is carried by the cable from the camera to the ECU.
    Type: Grant
    Filed: December 19, 2022
    Date of Patent: October 17, 2023
    Assignee: MAGNA ELECTRONICS INC.
    Inventors: Sven Ziegenspeck, Pirmin Bader
  • Patent number: 11789456
    Abstract: A vehicle computing system may implement techniques to determine attributes (or intent) of an object detected by a vehicle operating in the environment. The techniques may include determining a set of features with respect to a detected object by a first model and determining, by a second model and based on the set of features, one or more attributes of the object. The first model and the second model may be configured to process at least one image frame to determine the one or more attributes of the object. A model may receive sensor data as an input, and output features and/or an attribute for the detected object. Based on the attribute(s) of the object, a vehicle computing system may control operation of the vehicle.
    Type: Grant
    Filed: August 9, 2022
    Date of Patent: October 17, 2023
    Assignee: Zoox, Inc.
    Inventors: Qijun Tan, Sarah Tariq
  • Patent number: 11792433
    Abstract: A method of decoding video data comprises: receiving profile tier level syntax; parsing a syntax element, from the profile tier level syntax, indicating a level to which an output layer set conforms, wherein a value of 105 indicates a level where a maximum luma sample rate of 4812963840 samples per second is supported; and performing video decoding based on the indicated level.
    Type: Grant
    Filed: September 24, 2021
    Date of Patent: October 17, 2023
    Assignee: SHARP KABUSHIKI KAISHA
    Inventor: Frank Bossen
  • Patent number: 11785217
    Abstract: Provided are a video decoding method and apparatus including: in a video encoding and decoding process, determining parity information of a current block based on a width and a height of the current block; determining a lookup table of the current block from among a plurality of predefined lookup tables based on the parity information; determining a dequantization scale value of the current block based on the lookup table of the current block; and performing dequantization on the current block by using the dequantization scale value.
    Type: Grant
    Filed: April 18, 2022
    Date of Patent: October 10, 2023
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Narae Choi, Minwoo Park
  • Patent number: 11785251
    Abstract: A coding tool is provided to improve the compression performance of inter prediction and is used at the encoder/decoder side to adjust the correction of a motion vector based on a high level syntax. In addition, a method is provided for simply performing an integer sample search step of searching for an integer offset and a fractional sample refinement step of searching for a sub-pixel offset in relation to motion vector refinement among coding tools.
    Type: Grant
    Filed: July 27, 2022
    Date of Patent: October 10, 2023
    Assignees: Hyundai Motor Company, Kia Corporation, Ewha University-Industry Collaboration Foundation
    Inventors: Je Won Kang, Sang Hyo Park, Seung Wook Park, Wha Pyeong Lim
  • Patent number: 11785204
    Abstract: Various schemes for realizing JCCR mode decision in frequency domain are described. An apparatus receives first and second pixel data of a current block of a picture and transform the pixel data into first and second transformed data in frequency domain. The apparatus generates joint pixel data comprising a pixelwise linear combination of the first and second transformed data. The apparatus generates reconstructed joint pixel data based on the joint pixel data by quantization and inverse quantization operations. The apparatus derives first and second reconstructed pixel data based on the reconstructed joint pixel data. The apparatus accordingly calculates first and second distortion values in frequency domain, based on which a preferred mode may be determined to code the current block.
    Type: Grant
    Filed: June 16, 2022
    Date of Patent: October 10, 2023
    Inventors: Chen-Yen Lai, Tzu-Der Chuang, Ching-Yeh Chen, Chih-Wei Hsu, Chun-Chia Chen, Yu-Wen Huang
  • Patent number: 11770530
    Abstract: Provided are a video decoding method and apparatus including: in a video encoding and decoding process, determining parity information of a current block based on a width and a height of the current block; determining a lookup table of the current block from among a plurality of predefined lookup tables based on the parity information; determining a dequantization scale value of the current block based on the lookup table of the current block; and performing dequantization on the current block by using the dequantization scale value.
    Type: Grant
    Filed: April 18, 2022
    Date of Patent: September 26, 2023
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Narae Choi, Minwoo Park
  • Patent number: 11770561
    Abstract: Provided is an encoder including: circuitry; and memory coupled to the circuitry. In operation, the circuitry: performs a mapping process of Luma Mapping with Chroma Scaling (LMCS) for transforming a first pixel value space applied to a luma display image signal into a second pixel value space applied to a luma encoding process signal, using line segments forming a transform curve, each of which corresponds to a different one of sections obtained by partitioning the first pixel value space; and encodes an image, and in the performing of the LMCS, the circuitry determines the transform curve so that among boundary values in the second pixel value space, a first value obtained by dividing a boundary value by a base width defined according to a bit depth of the image is not equal to a second value obtained by dividing another boundary value by the base width.
    Type: Grant
    Filed: October 24, 2022
    Date of Patent: September 26, 2023
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Masato Ohkawa, Hideo Saitou, Kiyofumi Abe, Takahiro Nishi, Tadamasa Toma, Yusuke Kato