Patents Examined by Irfan Habib
  • Patent number: 11575908
    Abstract: A method to derive candidate intra prediction modes, comprising: recording an intra prediction mode of at least one previous coding unit, wherein the previous coding unit is not adjacent to a to-be-processed coding unit; adding at least one recorded intra prediction mode into a set of candidate intra prediction modes, when the number of the candidate intra prediction modes is less than a preset threshold.
    Type: Grant
    Filed: February 8, 2021
    Date of Patent: February 7, 2023
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Biao Wang, Semih Esenlik, Anand Meher Kotra, Han Gao, Jianle Chen
  • Patent number: 11570471
    Abstract: Predicting a component of a current pixel belonging to a current sub-aperture image in a matrix of sub-aperture images captured by a sensor of a type I plenoptic camera can involve, first, determining a location on the sensor based on: a distance from an exit pupil of a main lens of the camera to a micro-lens array of the camera; a focal length of the main lens; a focal length of the micro-lenses of the micro-lens array; and a set of parameters of a model of the camera allowing for a derivation of a two-plane parameterization describing the field of rays corresponding to the pixels of the sensor; and, second, predicting the component based on one reference pixel belonging to a reference sub-aperture image in the matrix and located on the sensor in a neighborhood of the location.
    Type: Grant
    Filed: May 29, 2019
    Date of Patent: January 31, 2023
    Assignee: InterDigital VC Holdings, Inc.
    Inventors: Didier Doyen, Olivier Bureller, Guillaume Boisson
  • Patent number: 11563970
    Abstract: A block of video data that is split into sub-blocks forms a prediction for that sub-block using predictions from neighboring sub-blocks such that a current prediction for the sub-block is combined with weighted versions of the neighboring predictions. The neighboring sub-blocks motion vectors are checked to determine whether they are different than the motion vector of the sub-block being predicted. If so, than that corresponding neighboring sub-block is used to generate the prediction of the current sub-block. In an embodiment, two lines or two columns of pixels within a sub-block are used in forming the prediction for the current sub-block when the size of the block containing the sub-block is under a particular size.
    Type: Grant
    Filed: February 22, 2019
    Date of Patent: January 24, 2023
    Assignee: INTERDIGITAL VC HOLDINGS, INC.
    Inventors: Antoine Robert, Fabrice Leleannec, Tangi Poirier
  • Patent number: 11556728
    Abstract: Systems, methods, and techniques to efficiently and effectively verifying and calibrating a machine learning model. The method can include training a machine learning model by at least processing training data with the machine learning model. The method can further include manipulating a first data set of the training data and applying the manipulated first data set to the machine learning model to thereby determine a first matching rate. In addition, the method can include applying the manipulated first data set to a rule engine to thereby determine a second matching rate and determining a difference between the first matching rate and the second matching rate. The method can further include determining whether the difference is within a predefined threshold range and providing an error indication if the determined difference is outside of the predefined threshold range.
    Type: Grant
    Filed: December 11, 2018
    Date of Patent: January 17, 2023
    Assignee: SAP SE
    Inventors: Stefan Butscher, Frank Krueger
  • Patent number: 11551451
    Abstract: A system for monitoring and recording and processing an activity includes one or more cameras for automatically recording video of the activity. A processor and memory associated and in communication with the camera is disposed near the location of the activity. The system may include AI logic configured to identify a user recorded within a video frame captured by the camera. The system may also detect and identify a user when the user is located within a predetermined area. The system may include a video processing engine configured to process images within the video frame to identify the user and may modify and format the video upon identifying the user and the activity. The system may include a communication module to communicate formatted video to a remote video processing system, which may further process the video and enable access to a mobile app of the user.
    Type: Grant
    Filed: February 25, 2022
    Date of Patent: January 10, 2023
    Assignee: Hole-In-One Media, Inc.
    Inventor: Kevin R. Imes
  • Patent number: 11553182
    Abstract: An image decoding method and apparatus according to an embodiment may extract, from a bitstream, a quantization coefficient generated through core transformation, secondary transformation, and quantization; generate an inverse-quantization coefficient by performing inverse quantization on the quantization coefficient; generate a secondary inverse-transformation coefficient by performing secondary inverse-transformation on a low frequency component of the inverse-quantization coefficient, the secondary inverse-transformation corresponding to the secondary transformation; and perform core inverse-transformation on the secondary inverse-transformation coefficient, the core inverse-transformation corresponding to the core transformation.
    Type: Grant
    Filed: February 4, 2021
    Date of Patent: January 10, 2023
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Elena Alshina, Mikhail Mishurovskiy, Alexander Alshin
  • Patent number: 11546581
    Abstract: A method of visual media processing includes determining, for a conversion between a current video block of visual media data and a bitstream representation of the current video block, a buffer that stores reference samples for prediction in an intra block copy mode; for a sample spatially located at location of the current video block relative to an upper-left position of a coding tree unit including the current video block and having a block vector, computing a corresponding reference in the buffer at a reference location, wherein the reference location is determined using the block vector and the location; and upon determining that the reference location lies outside the buffer, re-computing the reference location based at least in part on a location of the current video block relative to the coding tree unit including the current video block.
    Type: Grant
    Filed: July 23, 2021
    Date of Patent: January 3, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Jizheng Xu, Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Patent number: 11533492
    Abstract: A method for inter-coding video is provided in which transmission bandwidth requirements associated with second motion vectors for bi-directional temporal prediction is reduced. In the method motion vector information for only one of the two motion vectors for bi-directional temporal prediction can be transmitted together with information on how to derive or construct the second motion vector. Thus, rather than sending express information regarding two motion vectors, express information related to only one motion vector along with information related to reconstruction/derivation of the second motion vector is transmitted, thus reducing bandwidth requirements and increasing coding efficiency.
    Type: Grant
    Filed: January 29, 2021
    Date of Patent: December 20, 2022
    Assignee: ARRIS Enterprises LLC
    Inventors: Krit Panusopone, Yue Yu, Limin Wang
  • Patent number: 11533471
    Abstract: An image processing apparatus and an image processing method make it possible to suppress increase of the load of template matching. For each of motion vector candidates of accuracy rougher than accuracy of a motion vector candidate list, template matching between a template of a current block and a template of a reference block is performed to derive a cost, and elements of the motion vector candidate list are sorted on the basis of the derived costs of the motion vector candidates. Alternatively, for each of motion vector candidates of accuracy rougher than accuracy of a motion vector candidate list, template matching between a template of a current block and a template of a search point is performed to derive a cost, and a modification motion vector candidate is derived on the basis of the derived costs of the motion vector candidates.
    Type: Grant
    Filed: June 7, 2019
    Date of Patent: December 20, 2022
    Assignee: SONY CORPORATION
    Inventor: Takeshi Tsukuba
  • Patent number: 11528487
    Abstract: According to embodiments of the present document, symmetric motion vector differences (SMVDs) and merge mode motion vector differences (MMVDs) according to an inter prediction mode may be performed on the basis of reference picture types and, particularly, short term reference pictures may be used. Therefore, prediction performance and coding efficiency in the inter prediction mode can be improved.
    Type: Grant
    Filed: December 14, 2021
    Date of Patent: December 13, 2022
    Assignee: LG ELECTRONICS INC.
    Inventors: Naeri Park, Junghak Nam, Hyeongmoon Jang
  • Patent number: 11521393
    Abstract: A vehicle is configured to image, with an outside camera, an identification mark associated with a content provided by a service provider, output the content associated with the imaged identification mark to an occupant in a cabin of the vehicle, acquire operation information on the occupant relating to the output content, and acquire information regarding the occupant when the occupant performs operation relating to the content in the vehicle cabin. An information processing apparatus is configured to, when determining that the output content is not selected by the occupant based on the operation information on the occupant, determine whether or not to update the content that is not selected, based on the information regarding the occupant.
    Type: Grant
    Filed: February 5, 2020
    Date of Patent: December 6, 2022
    Assignee: TOYOTA JIDOSHA KABUSHIKI KAISHA
    Inventors: Kana Hamagami, Takuya Maekawa, Yosuke Nakayama, Akitoshi Jikumaru, Tae Sugimura, Takao Hishikawa, Shinichi Adachi
  • Patent number: 11523104
    Abstract: The present disclosure provides systems and methods for constructing a merge candidate list used for video processing. One exemplary method includes: inserting a set of spatial merge candidates to a merge candidate list of a coding block, wherein the set of spatial merge candidates are inserted according to an order of: top neighboring block, left neighboring block, top neighboring block, left neighboring block and above-left neighboring block. The method can further include adding to the merge candidate list at least one of: a temporal merge candidate from collocated coding units, a history-based motion vector predictor (HMVP) from a First-In, First-Out (FIFO) table, a pairwise average candidate, or a zero motion vector.
    Type: Grant
    Filed: August 18, 2020
    Date of Patent: December 6, 2022
    Assignee: Alibaba Group Holding Limited
    Inventors: Zhao Wang, Yan Ye, Jiancong Luo
  • Patent number: 11516467
    Abstract: A method of visual media processing includes determining, for a conversion between a current video block of visual media data and a bitstream representation of the current video block, a buffer that stores reference samples for prediction in an intra block copy mode; for a sample spatially located at location of the current video block relative to an upper-left position of a coding tree unit including the current video block and having a block vector, computing a corresponding reference in the buffer at a reference location, wherein the reference location is determined using the block vector and the location; and upon determining that the reference location lies outside the buffer, re-computing the reference location based at least in part on a location of the current video block relative to the coding tree unit including the current video block.
    Type: Grant
    Filed: July 23, 2021
    Date of Patent: November 29, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Jizheng Xu, Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Patent number: 11509904
    Abstract: Techniques, devices, and systems for video processing are described. In one example aspect, a video processing method includes determining, for a conversion between a block of a video and a bitstream representation of the video, a manner in which information for a Matrix-based Intra Prediction (MIP) coding technique is coded in the bitstream representation. A prediction block of the block is determined using the MIP coding technique based on performing a matrix vector multiplication operation on previously coded samples of the video. The method also includes performing the conversion based on the determining.
    Type: Grant
    Filed: October 15, 2021
    Date of Patent: November 22, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Patent number: 11501101
    Abstract: In an embodiment, a method is performed by a computer system and includes intercepting machine learning (ML) input data before the ML input data flows into a ML model. The method also includes scanning the ML input data against a plurality of ML threat signatures, the scanning yielding at least a first result. The method also includes examining a correlation between values of first and second variables in the ML input data, the examining yielding at least a second result. The method also includes validating at least one of the first and second results via a variability analysis of error instances in the ML input data, the validating yielding at least a third result. The method also includes applying thresholding to the ML input data via the third result, where the applying thresholding results in at least a portion of the ML input data being filtered.
    Type: Grant
    Filed: December 16, 2019
    Date of Patent: November 15, 2022
    Assignee: NTT DATA Services, LLC
    Inventors: Dhurai Ganesan, Aananthanarayanan Pandian, Angelene Ravichandran, Harsh Vinayak, Tanvir Khan
  • Patent number: 11503281
    Abstract: An encoder includes circuitry and memory coupled to the circuitry. The circuitry, in operation: determines whether a size of a current block, which is a unit for which a vector candidate list including vector candidates is generated, is less than or equal to a threshold; when the size of the current block is less than or equal to the threshold, generates the vector candidate list by registering a history-based motion vector predictor (HMVP) vector candidate in the vector candidate list from an HMVP table without performing a first pruning process; when the size of the current block is greater than the threshold, generates the vector candidate list by performing the first pruning process and registering the HMVP vector candidate in the vector candidate list from the HMVP table; and encodes the current block using the vector candidate list.
    Type: Grant
    Filed: February 25, 2022
    Date of Patent: November 15, 2022
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Jing Ya Li, Chong Soon Lim, Han Boon Teo, Che Wei Kuo, Hai Wei Sun, Chu Tong Wang, Kiyofumi Abe, Takahiro Nishi, Tadamasa Toma, Yusuke Kato
  • Patent number: 11490104
    Abstract: Significance flags in advanced video compression systems are coded using contexts adaptive to the last N significance flags coded taken in a scanning order. One embodiment uses the last N significance flags in scanning order as a predictor to determine which of a plurality of sets of significance flag contexts to use for coding subsequent significance flags. A second embodiment uses the last N significance flags in scanning order as a predictor in order to modulate the probability value associated with significance flag contexts that are used to code significance flags for future coding.
    Type: Grant
    Filed: June 27, 2017
    Date of Patent: November 1, 2022
    Assignee: INTERDIGITAL VC HOLDINGS, INC.
    Inventors: Sebastien Lasserre, Pierre Andrivon, Philippe Bordes
  • Patent number: 11483543
    Abstract: An apparatus and method for hybrid rendering. For example, one embodiment of a method comprises: identifying left and right views of a user's eyes; generating at least one depth map for the left and right views; calculating depth clamping thresholds including a minimum depth value and a maximum depth value; transforming the depth map in accordance with the minimum depth value and maximum depth value; and performing view synthesis to render left and right views using the transformed depth map.
    Type: Grant
    Filed: April 7, 2020
    Date of Patent: October 25, 2022
    Assignee: INTEL CORPORATION
    Inventors: Joshua J. Ratcliff, Tuotuo Li
  • Patent number: 11483557
    Abstract: A method, a non-transitory computer readable medium, and a computer system is provided for encoding or decoding video data. The method may include: receiving video data comprising a chroma component and a luma component; parsing, deriving or selecting a number of presets for the chroma component in one frame, and a number of presets for the luma component in the one frame; and decoding the video data. The method may further comprise: performing a separate Constrained Directional Enhancement Filter (CDEF) process of filtering luma and chroma components independent from each other based on the number of presets for the chroma component in one frame, and the number of presets for the luma component in the one frame.
    Type: Grant
    Filed: November 6, 2020
    Date of Patent: October 25, 2022
    Assignee: TENCENT AMERICA LLC
    Inventors: Yixin Du, Liang Zhao, Xin Zhao, Shan Liu
  • Patent number: 11477363
    Abstract: Exterior lighting on vehicles and buildings is typically used to illuminate scenes for better vision. The same exterior lighting can be used as part of an active sensor at discrete times during the sensor's active imaging cycles. In embodiments, an intelligent control module enables emitter output in accordance with the imaging system during active imaging cycles and enables emitter output in accordance with the non-imaging lighting control unit during non-imaging cycles. Embodiments of intelligent control modules can be used in security applications, in Automatic Driving Alert Systems and Autonomous Control Systems for commercial and passenger vehicles, and in low-altitude aircraft applications.
    Type: Grant
    Filed: December 18, 2020
    Date of Patent: October 18, 2022
    Assignee: 4D Intellectual Properties, LLC
    Inventor: James E. Retterath