Patents Examined by Jeremiah C Hallenbeck-Huber
  • Patent number: 11582445
    Abstract: A visual media processing method includes determining that a first video block of a visual media data uses a geometric partitioning mode (GPM) and a second video block of the visual media data uses a non-GPM mode; constructing, based on a unified pruning process, a first merge list for the first video block and a second merge list for the second video block, wherein the first merge list and the second merge list comprise merge candidates, and the pruning process includes adding a new merge candidate to the merge list based on comparing motion information of the new merge candidate with motion information of at least one merge candidate in the merge list, wherein the GPM comprises splitting the first video block into multiple prediction partitions to apply motion prediction separately, and at least one partition having a non-rectangular shape.
    Type: Grant
    Filed: November 30, 2021
    Date of Patent: February 14, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Patent number: 11575925
    Abstract: The present invention is about an image encoding/decoding method and apparatus. According to present invention, a method of decoding an image, the method comprising, deriving an initial motion vector of a current block; deriving a refined motion vector by using the initial motion vector; and generating a prediction block of the current block by using the refined motion vector.
    Type: Grant
    Filed: March 28, 2019
    Date of Patent: February 7, 2023
    Assignee: Electronics and Telecommunications Research Institute
    Inventors: Ha Hyun Lee, Sung Chang Lim, Jung Won Kang, Jin Ho Lee, Hui Yong Kim
  • Patent number: 11575934
    Abstract: Several improvements for use with Bidirectionally Predictive (B) pictures within a video sequence are provided. In certain improvements Direct Mode encoding and/or Motion Vector Prediction are enhanced using spatial prediction techniques. In other improvements Motion Vector prediction includes temporal distance and subblock information, for example, for more accurate prediction. Such improvements and other presented herein significantly improve the performance of any applicable video coding system/logic.
    Type: Grant
    Filed: February 10, 2022
    Date of Patent: February 7, 2023
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Alexandros Tourapis, Shipeng Li, Feng Wu
  • Patent number: 11575927
    Abstract: Disclosed is a video signal processing method comprising the steps of: acquiring a merge index which indicates a candidate for prediction of a current block among a plurality of candidates for the prediction of the current block, which are included in a merge candidate list; acquiring motion information of the current block on the basis of motion information corresponding to the candidate indicated by the merge index; when the motion information of the current block includes a plurality of motion vectors corresponding to a list of different reference pictures, comparing picture order count (POC) differences between each of the reference pictures corresponding to the plurality of motion vectors and the current picture including the current block; correcting the plurality of motion vectors on the basis of a result of the comparison; and reconstructing the current block on the basis of the plurality of corrected motion vectors.
    Type: Grant
    Filed: May 7, 2021
    Date of Patent: February 7, 2023
    Assignee: HUMAX CO., LTD.
    Inventors: Jaehong Jung, Dongcheol Kim, Geonjung Ko, Juhyung Son, Jinsam Kwak
  • Patent number: 11576127
    Abstract: A network management system manages the operation of a home security system in a communication network, such as a mesh network. The home security system can include multiple components such as a camera, a lighting device, a security alarm, a doorbell switch and doorbell chime, and a fingerprint sensor, which connect with the communication network to perform various operations. The network management system monitors environmental parameters of the communication network, such as parameters associated with the access points and components of the home security system, determines an access point to which a component of the home security system is to be connected for efficient operation of the home security system, and connects the component to the communication network via the determined access point.
    Type: Grant
    Filed: December 21, 2018
    Date of Patent: February 7, 2023
    Assignee: NETGEAR, INC.
    Inventors: Peiman Amini, Joseph Amalan Arul Emmanuel
  • Patent number: 11563972
    Abstract: Devices, systems, and methods for digital video coding, which includes constructing separate motion candidate lists for video coding, are described. An exemplary method for video processing includes constructing, for a first video block of a video, a first motion candidate list using a first motion candidate list construction method that excludes motion candidates that are only derived from temporal blocks, and performing a conversion between the first video block and a bitstream representation of the video including the first video block according to the constructed first motion candidate list.
    Type: Grant
    Filed: February 4, 2021
    Date of Patent: January 24, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Li Zhang, Kai Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • Patent number: 11558633
    Abstract: Systems, methods, and instrumentalities for sub-block motion derivation and motion vector refinement for merge mode may be disclosed herein. Video data may be coded (e.g., encoded and/or decoded). A collocated picture for a current slice of the video data may be identified. The current slice may include one or more coding units (CUs). One or more neighboring CUs may be identified for a current CU. A neighboring CU (e.g., each neighboring CU) may correspond to a reference picture. A (e.g., one) neighboring CU may be selected to be a candidate neighboring CU based on the reference pictures and the collocated picture. A motion vector (MV) (e.g., collocated MV) may be identified from the collocated picture based on an MV (e.g., a reference MV) of the candidate neighboring CU. The current CU may be coded (e.g., encoded and/or decoded) using the collocated MV.
    Type: Grant
    Filed: November 1, 2018
    Date of Patent: January 17, 2023
    Assignee: VID SCALE, Inc.
    Inventors: Xiaoyu Xiu, Yuwen He, Yan Ye
  • Patent number: 11554717
    Abstract: A vehicular vision system includes a camera disposed at a vehicle and operable to capture multiple frames of image data during a driving maneuver of the vehicle. A control includes an image processor that processes frames of captured image data to determine feature points in an image frame when the vehicle is operated within a first range of steering angles, and to determine motion trajectories of those feature points in subsequent image frames for the respective range of steering angles. The control determines a horizon line based on the determined motion trajectories. Responsive to determination that the determined horizon line is non-parallel to the horizontal axis of the image plane, at least one of pitch, roll or yaw of the camera is adjusted. Image data captured by the camera is processed at the control for object detection.
    Type: Grant
    Filed: May 17, 2021
    Date of Patent: January 17, 2023
    Assignee: MAGNA ELECTRONICS INC.
    Inventors: Nikhil Gupta, Hilda Faraji, Daan He, Ghanshyam Rathi
  • Patent number: 11538232
    Abstract: A method for picture processing is described. A first tracking area is obtained. A second tracking area is also obtained. The method includes beginning to track the first tracking area and the second tracking area. Picture processing is performed once a portion of the first tracking area overlapping the second tracking area passes a threshold.
    Type: Grant
    Filed: September 25, 2019
    Date of Patent: December 27, 2022
    Assignee: QUALCOMM Incorporated
    Inventors: Xin Zhong, Dashan Gao, Ning Bi, Steven Douglas Laver, Scott David Beith, Diarmuid MacCormack
  • Patent number: 11528476
    Abstract: A method of video processing includes maintaining, for a conversion between a current video block of a current picture of a visual media data and a bitstream representation of the visual media data, a buffer comprising reference samples from the current picture for a derivation of prediction samples of the current video block. One or more reference samples in the buffer that are marked unavailable for the derivation have values outside of a pixel value range.
    Type: Grant
    Filed: January 7, 2022
    Date of Patent: December 13, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Jizheng Xu, Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Patent number: 11503199
    Abstract: An apparatus, including cameras, microphone, speaker, processor, display, touchscreen keyboard, global positioning system, and collision avoidance sensor. Upon detecting a texting, e-mail, operational mode, game or gaming operational mode, or speakerphone, operational mode, the processor activates a camera and the collision avoidance sensor. The display displays a view in front of, or an anticipated travel path of movement of, the apparatus. The processor monitors a location of the apparatus. If the apparatus is outside of the safe area of travel, the processor activates the camera or a second camera to record a picture or video at the apparatus. The processor generates a notification message containing the picture or the video or containing a link to the picture or the video. The apparatus transmits the notification message to a communication device associated with an authorized individual or law enforcement personnel.
    Type: Grant
    Filed: September 18, 2020
    Date of Patent: November 15, 2022
    Inventors: Gregory Thomas Joao, Raymond Anthony Joao, Christopher Michael Joao
  • Patent number: 11490079
    Abstract: A method of video processing includes maintaining, for a conversion between a current video block of a current picture of a visual media data and a bitstream representation of the visual media data, a buffer comprising reference samples from the current picture for a derivation of prediction samples of the current video block. One or more reference samples in the buffer that are marked unavailable for the derivation have values outside of a pixel value range.
    Type: Grant
    Filed: January 7, 2022
    Date of Patent: November 1, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Jizheng Xu, Li Zhang, Kai Zhang, Hongbin Liu, Yue Wang
  • Patent number: 11477451
    Abstract: Provided is a video decoding method including obtaining split information indicating whether to split a current block; when the split information indicates that the current block is split, splitting the current block into at least two lower blocks; obtaining encoding order information indicating an encoding order of the at least two lower blocks of the current block; determining a decoding order of the at least two lower blocks according to the encoding order information; and decoding the at least two lower blocks according to the decoding order.
    Type: Grant
    Filed: October 1, 2020
    Date of Patent: October 18, 2022
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Yin-ji Piao, Jie Chen, Chan-yul Kim
  • Patent number: 11463693
    Abstract: Techniques for processing video data are described. The techniques include determining a first partition and a second partition for a current block coded in geometric partition mode, determining a first and second prediction block based on a first and second motion vector, blending the first prediction block and the second prediction block based on weights indicative of an amount to scale samples in the first prediction block and the second prediction block to generate a final prediction block, dividing the current block into a plurality of sub-blocks, determining a set of sub-blocks that each include at least one sample that corresponds to a prediction sample in the final prediction block that was generated based on equal weighting of a sample in the first prediction block and a sample in the second prediction block, and storing respective bi-prediction motion vectors for each sub-block in the determined set of sub-blocks.
    Type: Grant
    Filed: August 26, 2020
    Date of Patent: October 4, 2022
    Assignee: Qualcomm Incorporated
    Inventors: Kevin Pascal Andre Reuze, Han Huang, Chun-Chi Chen, Vadim Seregin, Wei-Jung Chien, Cheng-Teh Hsieh, Marta Karczewicz
  • Patent number: 11457152
    Abstract: A device includes an image sensor and an array of optical channels, each optical channel including an optic for projecting a partial field of view of a total field of view onto an image sensor area of the image sensor. A first optical channel of the array is configured to image a first partial field of view of the total field of view. A second optical channel of the array is configured to image a second partial field of view of the total field of view. The device includes a calculating unit configured to obtain image information of the first and second partial fields of view on the basis of the imaged partial fields of view, and to obtain image information of the total field of view, and to combine the image information of the partial fields of view with the image information of the total field of view so as to generate combined image information of the total field of view.
    Type: Grant
    Filed: September 27, 2019
    Date of Patent: September 27, 2022
    Assignee: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
    Inventors: Frank Wippermann, Andreas Brückner, Jacques Duparré, Alexander Oberdörster
  • Patent number: 11438619
    Abstract: A moving picture coding method includes (i) transforming, for each of one or more second processing units included in the first processing unit, a moving picture signal in a spatial domain into a frequency domain coefficient and quantizing the frequency domain coefficient, and (ii) performing arithmetic coding on a luminance CBF flag indicating whether or not a quantized coefficient is included in the second processing unit in which transform and quantization are performed, wherein, in the arithmetic coding, a probability table for use in arithmetic coding is determined according to whether or not the size of the first processing unit is identical to the size of the second processing unit and whether or not the second processing unit has a predetermined maximum size.
    Type: Grant
    Filed: September 22, 2020
    Date of Patent: September 6, 2022
    Assignee: SUN PATENT TRUST
    Inventors: Hisao Sasai, Takahiro Nishi, Youji Shibahara, Toshiyasu Sugio, Kyoko Tanikawa, Toru Matsunobu
  • Patent number: 11436842
    Abstract: Systems and methods are provided for representing a traffic signal device. The method includes receiving a digital image of a traffic signal device that includes one or more traffic signal elements, representing the traffic signal device as a raster image, each traffic signal element of the traffic signal device being represented by a mask corresponding to a location of the traffic signal element on the traffic signal device, representing each mask in a channel in the raster image, providing the raster image as an input to a neural network to classify a state for each of the one or more traffic signal elements, and receiving, from the neural network, a classified raster image, in which the classified raster image includes a plurality of masks, each mask representing a state of one of the one or more traffic signal elements.
    Type: Grant
    Filed: March 13, 2020
    Date of Patent: September 6, 2022
    Assignee: Argo AI, LLC
    Inventors: Guy Hotson, Richard L. Kwant, Ersin Yumer
  • Patent number: 11438576
    Abstract: A method of video decoding in a decoder is described. A first syntax element in a coded video bit stream is received. The first syntax element indicates a maximum allowed number of merge candidates in a set of coding blocks. A maximum allowed number of triangular prediction mode (TPM) candidates for the set of coding blocks is set based on a second syntax element when the second syntax element is received, otherwise it is set based on the first syntax element. When a current coding block in the set of coding blocks is coded in a triangular prediction mode, a triangular prediction candidate list of the current coding block is constructed based on a number of TPM candidates. The number of TPM candidates on the triangular prediction candidate list is equal to the maximum allowed number of TPM candidates.
    Type: Grant
    Filed: July 2, 2020
    Date of Patent: September 6, 2022
    Assignee: Tencent America LLC
    Inventors: Xiang Li, Guichun Li, Xiaozhong Xu, Shan Liu
  • Patent number: 11431964
    Abstract: Devices, systems and methods for digital video coding, which include sub-block based inter prediction methods, are described. An exemplary method for video processing includes determining, for a conversion between a current block of video and a bitstream representation of the video, a maximum number of candidates in a sub-block based merge candidate list and/or whether to add sub-block based temporal motion vector prediction (SbTMVP) candidates to the sub-block based merge candidate list based on whether temporal motion vector prediction (TMVP) is enabled for use during the conversion or whether a current picture referencing (CPR) coding mode is used for the conversion, and performing, based on the determining, the conversion.
    Type: Grant
    Filed: January 28, 2021
    Date of Patent: August 30, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu, Yue Wang
  • Patent number: 11432001
    Abstract: Systems, methods, and instrumentalities are disclosed relating to intra prediction of a video signal based on mode-dependent subsampling. A block of coefficients associated with a first sub block of a video block, one or more blocks of coefficients associated with one or more remaining sub blocks of the video block, and an indication of a prediction mode for the video block may be received. One or more interpolating techniques, a predicted first sub block, and the predicted sub blocks of the one or more remaining sub blocks may be determined. A reconstructed first sub block and one or more reconstructed remaining sub blocks may be generated. A reconstructed video block may be formed based on the prediction mode, the reconstructed first sub block, and the one or more reconstructed remaining sub blocks.
    Type: Grant
    Filed: March 14, 2017
    Date of Patent: August 30, 2022
    Assignee: VID SCALE, Inc.
    Inventors: Yan Ye, Qian Chen, Jie Dong