Patents Examined by Irfan Habib
  • Patent number: 11595649
    Abstract: A method of visual media processing, including: determining, fora conversion between a current video block of a visual media data and a bitstream representation of the visual media data, that a partitioning mode coding tool is disabled for the conversion based on a rule that depends on a dimension of the current video block; and performing the conversion based on the determining.
    Type: Grant
    Filed: March 28, 2022
    Date of Patent: February 28, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Patent number: 11595651
    Abstract: Innovations in use of chroma quantization parameter (“QP”) offsets when determining a control parameter for deblock filtering. For example, as part of encoding, an encoder sets a picture-level chroma QP offset and slice-level chroma QP offset for encoding of a slice of a picture. The encoder also performs deblock filtering of at least part of the slice, where derivation of a control parameter considers only the picture-level chroma QP offset. The encoder outputs at least part of a bitstream including the encoded content. As part of decoding, a corresponding decoder sets a picture-level chroma QP offset and a slice-level chroma QP offset for decoding of a slice of a picture, but derivation of a control parameter for deblock filtering considers only the picture-level chroma QP offset.
    Type: Grant
    Filed: March 3, 2021
    Date of Patent: February 28, 2023
    Assignee: Microsoft Technology Licensing, LLC
    Inventor: Gary J. Sullivan
  • Patent number: 11595633
    Abstract: An embodiment of the disclosure discloses an electronic device including at least one camera module to capture an image based on a specified angle of view, a display to display the image, a processor electrically connected with the camera module and the display. The processor detects a plurality of objects in the image, and performs setting of image data associated with at least one object of the plurality of objects such that a region, which corresponds to the at least one object, in a screen region of the display has a specified light transmittance value. Moreover, various embodiment found through the disclosure are possible.
    Type: Grant
    Filed: March 22, 2021
    Date of Patent: February 28, 2023
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Song Yi Lee, Young Mi Shin, Jin Soo Ha, Jang Woon Kim, Hyun Keun Son, Joo Hyung Lee
  • Patent number: 11586668
    Abstract: Disclosed is a method for the physical, in particular optical, detection of at least one usage object. The method includes the step of carrying out at least one physical detection process, for example by a user and/or an implementation device, in particular of at least one photograph, of the usage object, so that the usage object may be detected in such a way that an image of the usage object as detected during the detection process is shown at the same time as the database object shown on the screen in an identical manner or in a manner identical to scale, wherein as a result of the detection process, the usage object is associated with at least one usage object class, for example a vehicle type, by the processing unit and/or the CPU and/or the user.
    Type: Grant
    Filed: June 25, 2021
    Date of Patent: February 21, 2023
    Inventors: Markus Garcia, Thomas Zellweger
  • Patent number: 11575908
    Abstract: A method to derive candidate intra prediction modes, comprising: recording an intra prediction mode of at least one previous coding unit, wherein the previous coding unit is not adjacent to a to-be-processed coding unit; adding at least one recorded intra prediction mode into a set of candidate intra prediction modes, when the number of the candidate intra prediction modes is less than a preset threshold.
    Type: Grant
    Filed: February 8, 2021
    Date of Patent: February 7, 2023
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Biao Wang, Semih Esenlik, Anand Meher Kotra, Han Gao, Jianle Chen
  • Patent number: 11570471
    Abstract: Predicting a component of a current pixel belonging to a current sub-aperture image in a matrix of sub-aperture images captured by a sensor of a type I plenoptic camera can involve, first, determining a location on the sensor based on: a distance from an exit pupil of a main lens of the camera to a micro-lens array of the camera; a focal length of the main lens; a focal length of the micro-lenses of the micro-lens array; and a set of parameters of a model of the camera allowing for a derivation of a two-plane parameterization describing the field of rays corresponding to the pixels of the sensor; and, second, predicting the component based on one reference pixel belonging to a reference sub-aperture image in the matrix and located on the sensor in a neighborhood of the location.
    Type: Grant
    Filed: May 29, 2019
    Date of Patent: January 31, 2023
    Assignee: InterDigital VC Holdings, Inc.
    Inventors: Didier Doyen, Olivier Bureller, Guillaume Boisson
  • Patent number: 11563970
    Abstract: A block of video data that is split into sub-blocks forms a prediction for that sub-block using predictions from neighboring sub-blocks such that a current prediction for the sub-block is combined with weighted versions of the neighboring predictions. The neighboring sub-blocks motion vectors are checked to determine whether they are different than the motion vector of the sub-block being predicted. If so, than that corresponding neighboring sub-block is used to generate the prediction of the current sub-block. In an embodiment, two lines or two columns of pixels within a sub-block are used in forming the prediction for the current sub-block when the size of the block containing the sub-block is under a particular size.
    Type: Grant
    Filed: February 22, 2019
    Date of Patent: January 24, 2023
    Assignee: INTERDIGITAL VC HOLDINGS, INC.
    Inventors: Antoine Robert, Fabrice Leleannec, Tangi Poirier
  • Patent number: 11556728
    Abstract: Systems, methods, and techniques to efficiently and effectively verifying and calibrating a machine learning model. The method can include training a machine learning model by at least processing training data with the machine learning model. The method can further include manipulating a first data set of the training data and applying the manipulated first data set to the machine learning model to thereby determine a first matching rate. In addition, the method can include applying the manipulated first data set to a rule engine to thereby determine a second matching rate and determining a difference between the first matching rate and the second matching rate. The method can further include determining whether the difference is within a predefined threshold range and providing an error indication if the determined difference is outside of the predefined threshold range.
    Type: Grant
    Filed: December 11, 2018
    Date of Patent: January 17, 2023
    Assignee: SAP SE
    Inventors: Stefan Butscher, Frank Krueger
  • Patent number: 11551451
    Abstract: A system for monitoring and recording and processing an activity includes one or more cameras for automatically recording video of the activity. A processor and memory associated and in communication with the camera is disposed near the location of the activity. The system may include AI logic configured to identify a user recorded within a video frame captured by the camera. The system may also detect and identify a user when the user is located within a predetermined area. The system may include a video processing engine configured to process images within the video frame to identify the user and may modify and format the video upon identifying the user and the activity. The system may include a communication module to communicate formatted video to a remote video processing system, which may further process the video and enable access to a mobile app of the user.
    Type: Grant
    Filed: February 25, 2022
    Date of Patent: January 10, 2023
    Assignee: Hole-In-One Media, Inc.
    Inventor: Kevin R. Imes
  • Patent number: 11553182
    Abstract: An image decoding method and apparatus according to an embodiment may extract, from a bitstream, a quantization coefficient generated through core transformation, secondary transformation, and quantization; generate an inverse-quantization coefficient by performing inverse quantization on the quantization coefficient; generate a secondary inverse-transformation coefficient by performing secondary inverse-transformation on a low frequency component of the inverse-quantization coefficient, the secondary inverse-transformation corresponding to the secondary transformation; and perform core inverse-transformation on the secondary inverse-transformation coefficient, the core inverse-transformation corresponding to the core transformation.
    Type: Grant
    Filed: February 4, 2021
    Date of Patent: January 10, 2023
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Elena Alshina, Mikhail Mishurovskiy, Alexander Alshin
  • Patent number: 11546581
    Abstract: A method of visual media processing includes determining, for a conversion between a current video block of visual media data and a bitstream representation of the current video block, a buffer that stores reference samples for prediction in an intra block copy mode; for a sample spatially located at location of the current video block relative to an upper-left position of a coding tree unit including the current video block and having a block vector, computing a corresponding reference in the buffer at a reference location, wherein the reference location is determined using the block vector and the location; and upon determining that the reference location lies outside the buffer, re-computing the reference location based at least in part on a location of the current video block relative to the coding tree unit including the current video block.
    Type: Grant
    Filed: July 23, 2021
    Date of Patent: January 3, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Jizheng Xu, Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Patent number: 11533492
    Abstract: A method for inter-coding video is provided in which transmission bandwidth requirements associated with second motion vectors for bi-directional temporal prediction is reduced. In the method motion vector information for only one of the two motion vectors for bi-directional temporal prediction can be transmitted together with information on how to derive or construct the second motion vector. Thus, rather than sending express information regarding two motion vectors, express information related to only one motion vector along with information related to reconstruction/derivation of the second motion vector is transmitted, thus reducing bandwidth requirements and increasing coding efficiency.
    Type: Grant
    Filed: January 29, 2021
    Date of Patent: December 20, 2022
    Assignee: ARRIS Enterprises LLC
    Inventors: Krit Panusopone, Yue Yu, Limin Wang
  • Patent number: 11533471
    Abstract: An image processing apparatus and an image processing method make it possible to suppress increase of the load of template matching. For each of motion vector candidates of accuracy rougher than accuracy of a motion vector candidate list, template matching between a template of a current block and a template of a reference block is performed to derive a cost, and elements of the motion vector candidate list are sorted on the basis of the derived costs of the motion vector candidates. Alternatively, for each of motion vector candidates of accuracy rougher than accuracy of a motion vector candidate list, template matching between a template of a current block and a template of a search point is performed to derive a cost, and a modification motion vector candidate is derived on the basis of the derived costs of the motion vector candidates.
    Type: Grant
    Filed: June 7, 2019
    Date of Patent: December 20, 2022
    Assignee: SONY CORPORATION
    Inventor: Takeshi Tsukuba
  • Patent number: 11528487
    Abstract: According to embodiments of the present document, symmetric motion vector differences (SMVDs) and merge mode motion vector differences (MMVDs) according to an inter prediction mode may be performed on the basis of reference picture types and, particularly, short term reference pictures may be used. Therefore, prediction performance and coding efficiency in the inter prediction mode can be improved.
    Type: Grant
    Filed: December 14, 2021
    Date of Patent: December 13, 2022
    Assignee: LG ELECTRONICS INC.
    Inventors: Naeri Park, Junghak Nam, Hyeongmoon Jang
  • Patent number: 11521393
    Abstract: A vehicle is configured to image, with an outside camera, an identification mark associated with a content provided by a service provider, output the content associated with the imaged identification mark to an occupant in a cabin of the vehicle, acquire operation information on the occupant relating to the output content, and acquire information regarding the occupant when the occupant performs operation relating to the content in the vehicle cabin. An information processing apparatus is configured to, when determining that the output content is not selected by the occupant based on the operation information on the occupant, determine whether or not to update the content that is not selected, based on the information regarding the occupant.
    Type: Grant
    Filed: February 5, 2020
    Date of Patent: December 6, 2022
    Assignee: TOYOTA JIDOSHA KABUSHIKI KAISHA
    Inventors: Kana Hamagami, Takuya Maekawa, Yosuke Nakayama, Akitoshi Jikumaru, Tae Sugimura, Takao Hishikawa, Shinichi Adachi
  • Patent number: 11523104
    Abstract: The present disclosure provides systems and methods for constructing a merge candidate list used for video processing. One exemplary method includes: inserting a set of spatial merge candidates to a merge candidate list of a coding block, wherein the set of spatial merge candidates are inserted according to an order of: top neighboring block, left neighboring block, top neighboring block, left neighboring block and above-left neighboring block. The method can further include adding to the merge candidate list at least one of: a temporal merge candidate from collocated coding units, a history-based motion vector predictor (HMVP) from a First-In, First-Out (FIFO) table, a pairwise average candidate, or a zero motion vector.
    Type: Grant
    Filed: August 18, 2020
    Date of Patent: December 6, 2022
    Assignee: Alibaba Group Holding Limited
    Inventors: Zhao Wang, Yan Ye, Jiancong Luo
  • Patent number: 11516467
    Abstract: A method of visual media processing includes determining, for a conversion between a current video block of visual media data and a bitstream representation of the current video block, a buffer that stores reference samples for prediction in an intra block copy mode; for a sample spatially located at location of the current video block relative to an upper-left position of a coding tree unit including the current video block and having a block vector, computing a corresponding reference in the buffer at a reference location, wherein the reference location is determined using the block vector and the location; and upon determining that the reference location lies outside the buffer, re-computing the reference location based at least in part on a location of the current video block relative to the coding tree unit including the current video block.
    Type: Grant
    Filed: July 23, 2021
    Date of Patent: November 29, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Jizheng Xu, Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Patent number: 11509904
    Abstract: Techniques, devices, and systems for video processing are described. In one example aspect, a video processing method includes determining, for a conversion between a block of a video and a bitstream representation of the video, a manner in which information for a Matrix-based Intra Prediction (MIP) coding technique is coded in the bitstream representation. A prediction block of the block is determined using the MIP coding technique based on performing a matrix vector multiplication operation on previously coded samples of the video. The method also includes performing the conversion based on the determining.
    Type: Grant
    Filed: October 15, 2021
    Date of Patent: November 22, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Patent number: 11501101
    Abstract: In an embodiment, a method is performed by a computer system and includes intercepting machine learning (ML) input data before the ML input data flows into a ML model. The method also includes scanning the ML input data against a plurality of ML threat signatures, the scanning yielding at least a first result. The method also includes examining a correlation between values of first and second variables in the ML input data, the examining yielding at least a second result. The method also includes validating at least one of the first and second results via a variability analysis of error instances in the ML input data, the validating yielding at least a third result. The method also includes applying thresholding to the ML input data via the third result, where the applying thresholding results in at least a portion of the ML input data being filtered.
    Type: Grant
    Filed: December 16, 2019
    Date of Patent: November 15, 2022
    Assignee: NTT DATA Services, LLC
    Inventors: Dhurai Ganesan, Aananthanarayanan Pandian, Angelene Ravichandran, Harsh Vinayak, Tanvir Khan
  • Patent number: 11503281
    Abstract: An encoder includes circuitry and memory coupled to the circuitry. The circuitry, in operation: determines whether a size of a current block, which is a unit for which a vector candidate list including vector candidates is generated, is less than or equal to a threshold; when the size of the current block is less than or equal to the threshold, generates the vector candidate list by registering a history-based motion vector predictor (HMVP) vector candidate in the vector candidate list from an HMVP table without performing a first pruning process; when the size of the current block is greater than the threshold, generates the vector candidate list by performing the first pruning process and registering the HMVP vector candidate in the vector candidate list from the HMVP table; and encodes the current block using the vector candidate list.
    Type: Grant
    Filed: February 25, 2022
    Date of Patent: November 15, 2022
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Jing Ya Li, Chong Soon Lim, Han Boon Teo, Che Wei Kuo, Hai Wei Sun, Chu Tong Wang, Kiyofumi Abe, Takahiro Nishi, Tadamasa Toma, Yusuke Kato