Patents Examined by Maryam A Nasri
  • Patent number: 11616899
    Abstract: A camera system may include one or more controllers to perform in-field monitoring of autofocus performance and instability mitigation. The controllers may monitor one or more parameters associated with adjustment of a relative position between a lens group and an image sensor and/or one or more images. The controllers may analyze the parameters and/or images to calculate various metrics. The controllers may evaluate the metrics with respect to corresponding thresholds. The controllers may detect, based at least in part of the evaluation the metrics, one or more instability events associated with controller performance degradation. In response to detecting the instability events, the controllers may perform one or more remedial actions to mitigate the controller performance degradation.
    Type: Grant
    Filed: September 23, 2021
    Date of Patent: March 28, 2023
    Assignee: Apple Inc.
    Inventors: Abhishek Dhanda, Yunfeng Li, Santiago Alban, Andrew D. Fernandez
  • Patent number: 11616974
    Abstract: A method of coding video data, including constructing a history-based motion vector prediction (HMVP) candidate history table that includes motion vector information of previously coded blocks that extend beyond adjacent neighboring blocks of a current block, constructing a motion vector predictor list, and adding one or more HMVP candidates from the HMVP candidate history table to the motion vector predictor list. Adding the one or more HMVP candidates from the HMVP candidate history table comprises comparing a first HMVP candidate in the HMVP candidate history table to two entries in the motion vector predictor list and no other entries, and adding the first HMVP candidate to the motion vector predictor list when the first HMVP candidate is different than both of the two entries in the motion vector predictor list. The method also includes coding the current block of video data using the motion vector predictor list.
    Type: Grant
    Filed: October 25, 2021
    Date of Patent: March 28, 2023
    Assignee: QUALCOMM Incorporated
    Inventors: Yu Han, Wei-Jung Chien, Han Huang, Marta Karczewicz
  • Patent number: 11611754
    Abstract: A method of converting 10-bit pixel data (e.g. 10:10:10:2 data) into 8-bit pixel data involves converting the 10-bit values to 7-bits or 8-bits and generating error values for each of the converted values. Two of the 8-bit output channels comprise a combination of a converted 7-bit value and one of the bits from the fourth input channel. A third 8-bit output channel comprises the converted 8-bit value and the fourth 8-bit output channel comprises the error values. In various examples, the bits of the error values may be interleaved when they are packed into the fourth output channel.
    Type: Grant
    Filed: April 5, 2022
    Date of Patent: March 21, 2023
    Assignee: Imagination Technologies Limited
    Inventors: Ilaria Martinelli, Jeff Bond, Simon Fenney, Peter Malcolm Lacey, Gregory Clark
  • Patent number: 11601679
    Abstract: An image decoding method performed by means of a decoding device according to the present invention comprises the steps of: deriving quantized transform coefficients with respect to a target block from a bitstream; performing inverse quantization with respect to the quantized transform coefficients with respect to the target block and deriving transform coefficients; deriving residual samples with respect to the target block on the basis of reduced inverse transform with respect to the transform coefficients; and generating a reconstructed picture on the basis of the residual samples with respect to the target block and prediction samples with respect to the target block. The reduced inverse transform is performed on the basis of a reduced inverse transform matrix. The reduced inverse transform matrix is a non-square matrix of which the number of columns is smaller than the number of rows.
    Type: Grant
    Filed: October 21, 2021
    Date of Patent: March 7, 2023
    Assignee: LG Electronics Inc.
    Inventors: Mehdi Salehifar, Seunghwan Kim, Moonmo Koo, Jaehyun Lim
  • Patent number: 11595679
    Abstract: Innovations in encoder-side search ranges having horizontal bias or vertical bias are described herein. For example, a video encoder determines a block vector (“BV”) for a current block of a picture, performs intra prediction for the current block using the BV, and encodes the BV. The BV indicates a displacement to a region within the picture. When determining the BV, the encoder checks a constraint that the region is within a BV search range having a horizontal bias or vertical bias. The encoder can select the BV search range from among multiple available BV search ranges, e.g., depending at least in part on BV values of one or more previous blocks, which can be tracked in a histogram data structure.
    Type: Grant
    Filed: January 21, 2022
    Date of Patent: February 28, 2023
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Lihua Zhu, Yongjun Wu, Gary J. Sullivan
  • Patent number: 11575895
    Abstract: In a method of video decoding at a video decoder, a first high level syntax (HLS) element and a second HLS element can be received. The first HLS element can indicate whether an explicit multiple transform selection (MTS) is enabled or disabled for an intra coded block. The second HLS element can indicate whether the explicit MTS is enabled or disabled for an inter coded block. The first and second HLS elements can control a same set of coding blocks that include the intra coded block and the inter coded block. An implicit MTS can be enabled for the intra coded block when the first HLS element indicates the explicit MTS is disabled for the intra coded block, and the second HLS element indicates the explicit MTS is enabled for the inter coded block.
    Type: Grant
    Filed: September 1, 2021
    Date of Patent: February 7, 2023
    Assignee: TENCENT AMERICA LLC
    Inventors: Shan Liu, Xin Zhao, Xiang Li
  • Patent number: 11575877
    Abstract: An eyewear device that adjusts an on time and an off time of a pair of cameras to control heat of the cameras and of the eyewear device. Each of the pair of cameras has a duty cycle determining when the respective camera is on and off. A camera control chart contains the duty cycles. The eyewear may have a temperature sensor such that the on and off times of the cameras are a function of the temperature sensor.
    Type: Grant
    Filed: February 17, 2022
    Date of Patent: February 7, 2023
    Assignee: Snap Inc.
    Inventor: Shu-Fong Tsau
  • Patent number: 11575933
    Abstract: A video coding device may be configured to perform directional Bi-directional optical flow (BDOF) refinement on a coding unit (CU). The device may determine the direction in which to perform directional BDOF refinement. The device may calculate the vertical direction gradient difference and the horizontal direction gradient difference for the CU. The vertical direction gradient difference may indicate the difference between the vertical gradients for a first reference picture and the vertical gradients for a second reference picture. The horizontal direction gradient difference may indicate the difference between the horizontal gradients for the first reference picture and the horizontal gradients for the second reference picture. The video coding device may determine the direction in which to perform directional BDOF refinement based on the vertical direction gradient difference and the horizontal direction gradient difference.
    Type: Grant
    Filed: April 5, 2019
    Date of Patent: February 7, 2023
    Assignee: VID Scale, Inc.
    Inventors: Yuwen He, Xiaoyu Xiu, Yan Ye
  • Patent number: 11575911
    Abstract: A visual media processing method includes determining, for a conversion between a first video block of a visual media data and a bitstream representation of the visual media data, an availability of a second video block of the visual media data using a rule; and performing the conversion based on the determining, wherein the rule is at least based on a coding mode used for coding the first video block into the bitstream representation, wherein the rule specifies disallowing motion information of the second video block from being used in a merge list construction of the first block by treating the second video block as unavailable.
    Type: Grant
    Filed: November 30, 2021
    Date of Patent: February 7, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Patent number: 11553193
    Abstract: Aspects of the disclosure provide methods and apparatuses for video encoding/decoding. In some examples, an apparatus for video decoding includes processing circuitry that decodes prediction information for a plurality of first blocks in a current coded picture that is a part of a coded video sequence. The prediction information indicates that the plurality of first blocks is coded in a local illumination compensation (LIC) mode. The processing circuitry selects a neighboring region for each of the plurality of first blocks. The selected neighboring region and the respective first block form a second block. The processing circuitry performs an inter prediction for the plurality of second blocks in parallel. The processing circuitry determines a set of LIC parameters for each of the plurality of first blocks based on the selected neighboring region of the respective first block and reconstructs the plurality of first blocks based on the sets of LIC parameters.
    Type: Grant
    Filed: August 26, 2021
    Date of Patent: January 10, 2023
    Assignee: Tencent America LLC
    Inventors: Xiang Li, Xin Zhao, Xiaozhong Xu, Shan Liu, Meng Xu
  • Patent number: 11546625
    Abstract: Systems and methods for improved delta angle signaling for blocks in video compression are provided. A method includes decoding a coded picture. The decoding includes obtaining a nominal angle of a current block of the coded picture for intra prediction; obtaining a nominal angle of at least one neighboring block of the current block for intra prediction; determining whether to signal all allowed delta angles of the nominal angle of the current block, or only a subset of the allowed delta angles of the nominal angle of the current block, based on a comparison between the nominal angle of the current block and the nominal angle of the at least one neighboring block; signaling all the allowed delta angles or the subset of the allowed delta angles of the nominal angle of the current block based on the determining; and predicting the current block based on the signaling.
    Type: Grant
    Filed: July 30, 2021
    Date of Patent: January 3, 2023
    Assignee: TENCENT AMERICA LLC
    Inventors: Liang Zhao, Xin Zhao, Shan Liu
  • Patent number: 11528485
    Abstract: A coding device executes coding having divided an image into blocks, and includes: a candidate obtainment unit that obtains a plurality of provisional motion vector candidates in a coding target block; an evaluation information obtainment unit that obtains a correspondence vector that is a vector having a same direction and a same magnitude as a direction and a magnitude of the obtained provisional motion vector candidates, and evaluation information of a search center indicated by the correspondence vector in a coded block; and a selection unit that, on the basis of the evaluation information, selects, from the plurality of provisional motion vector candidates, a number of motion vector candidates that is lower than the number of the plurality of provisional motion vector candidates.
    Type: Grant
    Filed: December 5, 2019
    Date of Patent: December 13, 2022
    Assignee: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
    Inventors: Yuya Omori, Takayuki Onishi, Hiroe Iwasaki, Atsushi Shimizu
  • Patent number: 11516476
    Abstract: A method of deriving a motion vector difference for coding video data, the method comprises determining whether inter-layer prediction is utilized by determining whether both a reference picture in a first reference picture list is not marked as used for long-term reference and a reference picture in a second reference picture list is not marked as used for long-term reference; based on whether the inter-layer prediction is utilized, setting a scaling factor to one of: a value of 1 in a case where the inter-layer prediction is utilized; or a value in the range of ?4096 to 4095 in a case where the inter-layer prediction is not utilized; and deriving the motion vector difference based on the scaling factor.
    Type: Grant
    Filed: July 9, 2021
    Date of Patent: November 29, 2022
    Assignee: SHARP KABUSHIKI KAISHA
    Inventors: Frank Bossen, Sachin G. Deshpande
  • Patent number: 11516464
    Abstract: This disclosure discloses a method for obtaining a candidate motion vector list, an apparatus, an encoder, and a decoder. The method for obtaining a candidate motion vector list comprises: when a first candidate picture block is encoded/decoded and an inter prediction mode is used, determining whether a reference picture of the first candidate picture block is the same as a reference picture of a current block; and constructing a candidate motion vector list of the current block based on a determining result; when the reference picture of the first candidate picture block is different from the reference picture of the current block, the MV of the first candidate picture block is not used to construct the list. Implementing this disclosure can reduce complexity of a motion information derivation process, and improve coding efficiency.
    Type: Grant
    Filed: February 19, 2021
    Date of Patent: November 29, 2022
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Huanbang Chen, Haitao Yang, Lian Zhang
  • Patent number: 11516478
    Abstract: The present disclosure relates to an apparatus for and a method of coding machine vision data by using prediction, and for improving the efficiency of encoding the data used for machine vision, provides an apparatus for Video Coding for Machines (VCM) which sets reference data according to a correlation between the data, generates, based on the reference data, prediction data for original data having a high correlation with the reference data, and generates residual data between the prediction data and the original data, and provides a coding method performed by the apparatus for VCM.
    Type: Grant
    Filed: December 30, 2021
    Date of Patent: November 29, 2022
    Assignees: Hyundai Motor Company, Kia Corporation, Ewha University-Industry Collaboration Foundation
    Inventors: Je Won Kang, Chae Hwa Yoo, Seung Wook Park
  • Patent number: 11503286
    Abstract: Disclosed herein are a video decoding method and apparatus and a video encoding method and apparatus, and more particularly, a method and apparatus for performing filtering in video encoding and decoding. An encoding apparatus may perform filtering on a target, and may generate filtering information indicating whether filtering has been performed on the target. Further, the encoding apparatus may generate a bitstream including filtering information. A decoding apparatus may determine, based on filtering information, whether to perform filtering on a target, and may perform filtering on the target. The decoding apparatus may receive filtering information from the encoding apparatus through a bitstream or may derive filtering information using additional information.
    Type: Grant
    Filed: November 28, 2017
    Date of Patent: November 15, 2022
    Assignees: Electronics and Telecommunications Research Institute, INDUSTRY-ACADEMIA COOPERATION GROUP OF SEJONG UNIVERSITY
    Inventors: Sung-Chang Lim, Jung-Won Kang, Hyunsuk Ko, Jin-Ho Lee, Ha-Hyun Lee, Dong-San Jun, Seung-Hyun Cho, Hui-Yong Kim, Yung-Lyul Lee, Jun-Woo Choi, Jin-Soo Choi, Nam-Uk Kim, Myung-Jun Kim
  • Patent number: 11503330
    Abstract: An encoder includes circuitry and memory connected to the circuitry. In operation, the circuitry: corrects a base motion vector using a correction value for correcting the base motion vector in a predetermined direction; and encodes a current partition to be encoded in an image of a video, using the base motion vector corrected. The correction value is specified by a first parameter and a second parameter, the first parameter indicating a table to be selected from among a plurality of tables each including values, the second parameter indicating one of the values included in the table to be selected indicated by the first parameter. In each of the plurality of tables, a smaller value among the values is assigned a smaller index. Each of the plurality of tables includes a different minimum value among the values.
    Type: Grant
    Filed: May 13, 2021
    Date of Patent: November 15, 2022
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Jing Ya Li, Chong Soon Lim, Ru Ling Liao, Hai Wei Sun, Han Boon Teo, Kiyofumi Abe, Tadamasa Toma, Takahiro Nishi
  • Patent number: 11496765
    Abstract: Provided are a video decoding method and apparatus for, in a video encoding and decoding procedure, when a merge candidate list of a current block is configured, determining whether the number of merge candidates included in the merge candidate list is greater than 1 and is smaller than a predetermined maximum merge candidate number, when the number of the merge candidates included in the merge candidate list is greater than 1 and is smaller than the predetermined maximum merge candidate number, determining an additional merge candidate by using a first merge candidate and a second merge candidate of the merge candidate list of the current block, configuring the merge candidate list by adding the determined additional merge candidate to the merge candidate list, and performing prediction on the current block, based on the merge candidate list.
    Type: Grant
    Filed: December 20, 2019
    Date of Patent: November 8, 2022
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Anish Tamse, Minwoo Park, Minsoo Park
  • Patent number: 11483576
    Abstract: A method for encoding a picture block is disclosed. A predictor is determined as a weighted sum of sample values of a first motion compensated reference block in a first reference image and of a second motion compensated reference block in a second reference image. Then, a residual block determined from the picture block and the predictor is encoded in a bitstream. Advantageously, the weights of the weighted sum are determined by minimizing an error between reconstructed samples neighboring the picture block and samples neighboring the first and second reference blocks.
    Type: Grant
    Filed: March 19, 2019
    Date of Patent: October 25, 2022
    Assignee: InterDigital VC Holdings, Inc.
    Inventors: Tangi Poirier, Philippe Bordes, Fabrice Urban
  • Patent number: 11483531
    Abstract: A system for generating three-dimensional (3D) images from captured images of a target when executing digital magnification. A controller executes a digital magnification on the first image of the target captured by the first image sensor and on the second image captured by the second image sensor of the target. The controller crops the first image and the second image to overlap a first portion of the target captured by the first image sensor with a second portion of the target captured by the second image sensor. The controller adjusts the cropping of the first image and the second image to provide binocular overlap of the first portion of the target with the second portion of target. The displayed cropped first image and the cropped second image display the 3D image at the digital magnification to the user.
    Type: Grant
    Filed: January 4, 2022
    Date of Patent: October 25, 2022
    Assignee: Unify Medical, Inc.
    Inventors: Yang Liu, Maziyar Askari Karchegani