Patents Examined by Jae N. Noh
  • Patent number: 11533511
    Abstract: Provided is an encoder including: circuitry; and memory coupled to the circuitry. In operation, the circuitry: performs a mapping process of Luma Mapping with Chroma Scaling (LMCS) for transforming a first pixel value space applied to a luma display image signal into a second pixel value space applied to a luma encoding process signal, using line segments forming a transform curve, each of which corresponds to a different one of sections obtained by partitioning the first pixel value space; and encodes an image, and in the performing of the LMCS, the circuitry determines the transform curve so that among boundary values in the second pixel value space, a first value obtained by dividing a boundary value by a base width defined according to a bit depth of the image is not equal to a second value obtained by dividing another boundary value by the base width.
    Type: Grant
    Filed: February 2, 2022
    Date of Patent: December 20, 2022
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Masato Ohkawa, Hideo Saitou, Kiyofumi Abe, Takahiro Nishi, Tadamasa Toma, Yusuke Kato
  • Patent number: 11533484
    Abstract: A method and a system described herein provide optimizing image and/or video compression for machine perception. According to an aspect, the method comprises receiving a raw image frame from a camera sensor; detecting a predefined object in the raw image frame and marking a region around the predefined object within the raw image frame as ROI. Based on the ROI, a partitioning scheme, a prediction mode, and quantization parameter are determined for improving coding efficiency. Machine perception efficiency is improved by selecting a quantization parameter table used for compressing and encoding the raw image or video frame based on a selected machine vision task. The selection of the quantization parameter table is based on training of the selected machine vision task using cost function optimization.
    Type: Grant
    Filed: July 15, 2021
    Date of Patent: December 20, 2022
    Assignee: TERAKI GMBH
    Inventors: Jithendar Anumula, Bernhard Kaplan, Daniel Lampert Richart
  • Patent number: 11523126
    Abstract: Methods, systems, and devices for luma mapping with chroma scaling for video and image coding are disclosed. An example method of video processing includes performing, for a current region comprising a luma block, a first chroma block, and a second chroma block, a conversion between the current region of a video and a bitstream representation of the video according to a rule that specifies an order in which, during decoding, the first chroma block and the second chroma block are processed based on mapped sample values of the luma block.
    Type: Grant
    Filed: March 16, 2022
    Date of Patent: December 6, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Kui Fan, Li Zhang, Kai Zhang, Yue Wang
  • Patent number: 11503293
    Abstract: A video processing method includes determining, for a conversion between a current block of a video and a bitstream representation of the video, whether to enable a level mapping operation or a level remapping operation based on a rule, wherein the level mapping operation or the level remapping operation includes changing between a first representation of a residual coefficient of the current block and a second representation of the residual coefficient of the current block based on neighboring residual coefficients of the residual coefficient; and performing the conversion by selectively using the level mapping operation or the level remapping operation based on the determining.
    Type: Grant
    Filed: February 18, 2022
    Date of Patent: November 15, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Jizheng Xu, Hongbin Liu, Yue Wang
  • Patent number: 11503294
    Abstract: In some embodiments, an electronic device for compressing video image data includes a housing, an image sensor, a memory device, and one or more processors. The image sensor can generate image data from light incident on the image sensor. The one or more processors can transform the image data to obtain transform coefficients, quantize the transform coefficients, encode the quantized transform coefficients, and store the quantized transform coefficients to the memory device. The one or more processors can encode the quantized transform coefficients at least by determining a range of multiple ranges in which one transform coefficient is included, determining a value within the range to which the one transform coefficient corresponds, encoding using a first algorithm the range as a range code, and encoding using a second algorithm the value as a value code.
    Type: Grant
    Filed: February 3, 2021
    Date of Patent: November 15, 2022
    Assignee: RED.COM, LLC
    Inventors: James H. Jannard, Peter Jarred Land, Manjunath Subray Bhat
  • Patent number: 11496730
    Abstract: Disclosed herein are a method, an apparatus and a storage medium for performing encoding/decoding on an image using a subpicture. A picture may be partitioned into various units such as subpictures and slices, and various syntax elements and structures may be used to specify the units. In an embodiment, there is a method for configuring a reference picture list for motion compensation in the case where the location of a reference subpicture to be referred to for motion compensation is different from the location of a target subpicture. Further, in an embodiment, there is provided a method for providing the configuration of a reference picture list and an override on the number of activated reference indexes.
    Type: Grant
    Filed: April 2, 2021
    Date of Patent: November 8, 2022
    Assignee: Electronics and Telecommunications Research Institute
    Inventors: Gun Bang, Woong Lim
  • Patent number: 11493745
    Abstract: A cell observation system according to the present invention includes: a first image-acquisition device disposed in an incubator and acquires a first image of cells in a culturing vessel; a second image-acquisition device disposed outside the incubator; a processing device connected to the first image-acquisition device and the second image-acquisition device; and a display displays at least a region of the first image, as well as the second image. The second image-acquisition device includes a second image-acquisition unit that acquires a second image of the interior of the culturing vessel, that removed from the incubator. The processing device extracts target cells in the first image, calculates positions at which the extracted target cells are present and stores the positions in the memory, and causes the display to display the positions at which the target cells are present in a superimposed manner on an indication indicating the culturing vessel.
    Type: Grant
    Filed: December 22, 2019
    Date of Patent: November 8, 2022
    Assignee: Evident Corporation
    Inventors: Takashi Miyoshi, Shinichi Takimoto, Yasunobu Iga, Shintaro Takahashi
  • Patent number: 11496756
    Abstract: Configuration data is obtained and is useable by a decoder to reconstruct a first representation of an image at a first level of quality using a second representation of the image at the first level of quality. The second representation is based on a representation of the image at a second, lower level of quality. The configuration data comprises a value of a configuration parameter, the value having a variable bit-length. The configuration data is arranged into a sequence of bytes comprising a variable-length element arranged to store the value of the configuration parameter. The variable-length element comprises at least one given byte having one or more predetermined bits arranged to indicate whether or not the variable-length element comprises one or more additional bytes to the at least one given byte. The sequence of bytes is output for processing by the decoder.
    Type: Grant
    Filed: October 30, 2019
    Date of Patent: November 8, 2022
    Inventor: Robert Johnson
  • Patent number: 11496757
    Abstract: Residual data is obtained based on first and second representations of an image at a first level of quality. The second representation is based on a representation of the image at a second, lower level of quality. The residual data is useable by a decoder to reconstruct the first representation using the second representation. A configuration message comprising a header part and a payload part is generated and output for processing by the decoder. The payload part comprises obtained configuration data relating to processing of the residual data. The header part comprises: (i) a message type parameter specifying a configuration message type and indicating a given payload format of the payload part, a format size of a payload part having said payload format is predetermined or can be determined from the content of the payload part, and (ii) a payload size parameter specifying the actual size of the payload part.
    Type: Grant
    Filed: October 30, 2019
    Date of Patent: November 8, 2022
    Inventor: Robert Johnson
  • Patent number: 11490083
    Abstract: A video encoder may determine a set of quantization offset parameters for a group of scaled transform coefficients for a block of video data based on side information associated with the block of video data. The video encoder may further quantize the group of scaled transform coefficients for the block of video data to generate quantized transform coefficients for the block of video data based at least in part on the set of quantization offset parameters. The video encoder may further generate an encoded video bitstream based at least in part on the quantized transform coefficients for the block of video data.
    Type: Grant
    Filed: February 3, 2021
    Date of Patent: November 1, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Amir Said, Reza Pourreza
  • Patent number: 11490130
    Abstract: The embodiments disclose a method including capturing video footage of a youth sports event using at least one video camera with a mobile application installed, transmitting to at least one network server with internet and WI-FI connectivity mobile application multi-camera live-streaming video camera captured game footage, recording on at least one database coupled to the network server at least one video camera mobile application multi-camera live-streaming video camera captured game footage, using at least one network computer coupled to at least one network server configured for processing and displaying multi-camera live-streaming video camera captured game footage for live video streaming game broadcast on a plurality of subscribed viewer digital devices, and mixing advertising into the processed multi-camera live-streaming video camera captured game footage broadcast using the at least one network computer.
    Type: Grant
    Filed: July 13, 2021
    Date of Patent: November 1, 2022
    Inventors: Robert Bradley Burkhart, Peter Christian Maurer
  • Patent number: 11483579
    Abstract: Methods, systems, and devices for luma mapping with chroma scaling for video and image coding are disclosed. An example method of video processing includes performing, for a current region comprising a luma block, a first chroma block, and a second chroma block, a conversion between the current region of a video and a bitstream representation of the video according to a rule that specifies an order in which, during decoding, the first chroma block and the second chroma block are processed based on mapped sample values of the luma block.
    Type: Grant
    Filed: March 16, 2022
    Date of Patent: October 25, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Kui Fan, Li Zhang, Kai Zhang, Yue Wang
  • Patent number: 11478132
    Abstract: Apparatuses, including sleeves, intraoral scanning systems to use these sleeves, and methods of using the sleeve, that authenticate the sleeve for use with an intraoral scanning system. Authentication may include verifying that the sleeve is new (unused) and/or verifying that the sleeve is appropriate and/or intended for use with the intraoral scanning system. Once authenticated, operation parameters of the intraoral scanning system can be automatically set based on information from a scanned identifier on the sleeve.
    Type: Grant
    Filed: April 6, 2020
    Date of Patent: October 25, 2022
    Assignee: Align Technology. Inc.
    Inventors: Avi Kopelman, Michael Sabina, Nir Makmel, Adi Levin, Arad Zulti, Arthur Hsieh
  • Patent number: 11463714
    Abstract: A method for visual media processing, including performing a conversion between a current chroma video block of visual media data and a bitstream representation of the current chroma video block, wherein, during the conversion, a chroma residual of the current chroma video block is scaled based on a scaling coefficient, wherein the scaling coefficient is derived at least based on luma samples located in predefined positions.
    Type: Grant
    Filed: August 18, 2021
    Date of Patent: October 4, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Zhipin Deng, Li Zhang, Hongbin Liu, Kai Zhang, Jizheng Xu
  • Patent number: 11460857
    Abstract: A vehicle computing system may implement techniques to determine attributes (or intent) of an object detected by a vehicle operating in the environment. The techniques may include determining a set of features with respect to a detected object by a first model and determining, by a second model and based on the set of features, one or more attributes of the object. The first model and the second model may be configured to process at least one image frame to determine the one or more attributes of the object. A model may receive sensor data as an input, and output features and/or an attribute for the detected object. Based on the attribute(s) of the object, a vehicle computing system may control operation of the vehicle.
    Type: Grant
    Filed: February 21, 2020
    Date of Patent: October 4, 2022
    Assignee: Zoox, Inc.
    Inventors: Qijun Tan, Sarah Tariq
  • Patent number: 11457226
    Abstract: A method for processing a video includes performing a determination, by a processor, that a first video block is partitioned to include a first prediction portion that is non-rectangular and non-square; adding a first motion vector (MV) prediction candidate associated with the first prediction portion to a motion candidate list associated with the first video block, wherein the first MV prediction candidate is derived from a sub-block MV prediction candidate; and performing further processing of the first video block using the motion candidate list.
    Type: Grant
    Filed: June 29, 2021
    Date of Patent: September 27, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Patent number: 11451779
    Abstract: A video decoder can be configured to determine that a new scaling list for a set of scaling lists is to be predicted from a reference scaling list, wherein the new scaling list corresponds to a new scaling matrix; receive a syntax element that identifies an ID number corresponding to a scaling list of the set of scaling lists that is to be used as the reference scaling list; determine that the set of scaling lists does not include a scaling list with the ID number; and in response to determining that the set of scaling lists does not include the scaling list with the ID number, determine the new scaling matrix based on a set of default values.
    Type: Grant
    Filed: March 3, 2021
    Date of Patent: September 20, 2022
    Assignee: Qualcomm Incorporated
    Inventors: Adarsh Krishnan Ramasubramonian, Bappaditya Ray, Luong Pham Van, Geert Van der Auwera, Marta Karczewicz
  • Patent number: 11451785
    Abstract: A method for performing video decoding by a decoding device according to the present document comprises the steps of: acquiring residual information of a current block; deriving residual samples of the current block on the basis of the residual information; and generating a reconstructed picture on the basis of the residual samples.
    Type: Grant
    Filed: February 17, 2022
    Date of Patent: September 20, 2022
    Assignee: LG ELECTRONICS INC.
    Inventors: Jungah Choi, Jin Heo, Sunmi Yoo, Jaehyun Lim, Jangwon Choi, Seunghwan Kim
  • Patent number: 11451828
    Abstract: A method of compressing and storing preview video includes performing colorspace-reduction image compression on a reference frame of a video to generate a colorspace-reduced reference frame; determining difference blocks representing areas of a subsequent image frame that differ from the reference frame and generating a difference frame comprising colorspace-reduced image data of the difference blocks; generating a video stream comprising a color palette, the colorspace-reduced reference frame, and the difference frame, and storing the video stream in an extreme low-voltage memory; and injecting, into the video stream prior to storing the video stream in the extreme low-voltage memory, a plurality of resynchronization codes for each reference frame and a plurality of resynchronization codes for each difference frame, the resynchronization codes comprising a byte sequence unique to resynchronization codes.
    Type: Grant
    Filed: July 16, 2021
    Date of Patent: September 20, 2022
    Assignee: OmniVision Technologies, Inc.
    Inventors: Yu-Wei Chang, Wei-Feng Huang
  • Patent number: 11438623
    Abstract: A coding tool is provided to improve the compression performance of inter prediction and is used at the encoder/decoder side to adjust the correction of a motion vector based on a high level syntax. In addition, a method is provided for simply performing an integer sample search step of searching for an integer offset and a fractional sample refinement step of searching for a sub-pixel offset in relation to motion vector refinement among coding tools.
    Type: Grant
    Filed: July 8, 2020
    Date of Patent: September 6, 2022
    Assignees: Hyundai Motor Company, Kia Motors Corporation, Ehwa University-Industry Collaboration Foundation
    Inventors: Je Won Kang, Sang Hyo Park, Seung Wook Park, Wha Pyeong Lim