Patents Examined by Shanika M Brumfield
  • Patent number: 11272183
    Abstract: Devices, systems and methods for digital video coding, which includes matrix-based intra prediction methods for video coding, are described. In a representative aspect, a method for video processing includes performing a conversion between a current video block of a video and a bitstream representation of the current video block using a matrix based intra prediction (MIP) mode in which a prediction block of the current video block is determined by performing, on previously coded samples of the video, a boundary downsampling operation, followed by a matrix vector multiplication operation, and selectively followed by an upsampling operation, where the performing the conversion includes deriving, according to a rule, boundary samples by applying a left bit shift operation or a right bit shift operation on a sum of at least one reference boundary sample, and where the rule determines whether to apply the left bit shift or the right bit shift operation.
    Type: Grant
    Filed: June 9, 2021
    Date of Patent: March 8, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Zhipin Deng, Kai Zhang, Li Zhang, Hongbin Liu, Jizheng Xu
  • Patent number: 11259030
    Abstract: The present invention relates to an intra prediction scheme among video coding techniques and, more particularly, relates to a video decoding method and apparatus for diving a block into a plurality of sub-blocks when intra prediction is performed and sequentially performing infra prediction on each of the sub-blocks. The decoding method performed by a video decoding apparatus includes determining whether to perform sub-block-based intra prediction on a current coding unit, dividing the current coding unit into a plurality of sub-blocks, performing intra prediction on each of the sub-blocks when a result of determination of whether to perform sub-block-based intra prediction has a value of “true”, and directly performing block-based intra prediction on the current coding unit without dividing the current coding unit when the result of the determination has a value of “false”.
    Type: Grant
    Filed: December 28, 2018
    Date of Patent: February 22, 2022
    Assignee: Intellectual Discovery Co., Ltd.
    Inventors: Yong Jo Ahn, Ho Chan Ryu
  • Patent number: 11240477
    Abstract: The present invention provides a method and a device for image rectification, which are applied in the field of image processing. The method includes: receiving two images, the two images are images of a target object captured from different viewpoints; performing an epipolar rectification on the two images; rectifying the two images after the epipolar rectification based on the image contents; and splicing the two images after the rectification based on the image contents. The method can rectify the images captured from different viewpoints, thereby ensuring the pixel alignment, and avoiding visual discomfort to the viewer.
    Type: Grant
    Filed: November 13, 2018
    Date of Patent: February 1, 2022
    Assignee: ArcSoft Corporation Limited
    Inventors: Wang Miao, Li Yu, Xin Fan
  • Patent number: 11240493
    Abstract: Apparatuses and methods for encoding and decoding a video are provided. A method includes determining whether at least one of two blocks of an image in a video is predicted with a combined inter-intra prediction (CIIP), wherein the two blocks include a first block (block Q) and a second block (block P). There is a boundary between the two blocks. The method further includes setting a boundary strength (Bs) for the boundary to a first value based on determining that at least one of the two blocks is predicted with the CIIP, and performing deblocking for the boundary between the first block and the second block based on the Bs to generate a modified reconstructed block for each of the first block and the second block.
    Type: Grant
    Filed: September 8, 2020
    Date of Patent: February 1, 2022
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Biao Wang, Anand Meher Kotra, Semih Esenlik, Han Gao, Jianle Chen
  • Patent number: 11234011
    Abstract: An image decoding apparatus is provided with a CT information decoding unit that decodes division information indicating a division method for binary tree division with respect to a coding node of a coding tree unit, and performs the binary tree division with respect to the coding node by referring to the division information of another decoded coding node.
    Type: Grant
    Filed: November 20, 2020
    Date of Patent: January 25, 2022
    Assignee: SHARP KABUSHIKI KAISHA
    Inventors: Yoshiya Yamamoto, Yukinobu Yasugi, Tomohiro Ikai, Tomoko Aono
  • Patent number: 11228782
    Abstract: Provided is a video decoding method performed by a video decoding apparatus, the video decoding method including: determining prediction mode information of a current block and an index indicating a prediction candidate, from a bitstream; determining a prediction candidate list according to the prediction mode information; when the prediction mode information of the current block indicates a pre-set prediction mode, determining a motion vector indicated by the index indicating the prediction candidate from the prediction candidate list, and determining a prediction motion vector of the current block based on at least one of pieces of motion prediction information related to the motion vector; and determining a motion vector of the current block based on the prediction motion vector, wherein the pre-set prediction mode is a prediction mode different from a skip mode and a merge mode.
    Type: Grant
    Filed: January 29, 2020
    Date of Patent: January 18, 2022
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Seung-soo Jeong, Min-woo Park, Jin-young Lee, Sun-il Lee
  • Patent number: 11205281
    Abstract: The present invention provides a method and a device for image rectification, which is applied to the field of image processing. The method includes: receiving two images, wherein the two images are images of a target object captured at different viewpoints, and an image capturing device configured to capture the two images, includes a first image capturing device and a second image capturing device; determining positions of corresponding feature point pairs in the two images; and aligning the two images according to the positions of the feature point pairs and parameters of the first image capturing device and the second image capturing device. The above-mentioned method can rectify the images captured at different viewpoints, thereby ensuring the alignment of pixels, and avoiding visual discomfort of the viewer.
    Type: Grant
    Filed: November 13, 2018
    Date of Patent: December 21, 2021
    Assignee: ArcSoft Corporation Limited
    Inventors: Li Yu, Wang Miao, Xin Fan
  • Patent number: 11166023
    Abstract: Methods for quantization parameter (QP) prediction are presented. In a coded bitstream that includes QP values, instead of simply embedding all delta QP values in the bitstream, the bitstream may include QP-related syntax elements that allow a decoder to reconstruct the delta QP values using luma-based QP prediction. Encoding and decoding bitstream examples are provided where delta QP values may be predicted using information from just the luminance values of the prediction blocks of the current block or by additional luminance information from its known neighbors (e.g., from the left or above blocks) and a base QP value.
    Type: Grant
    Filed: March 21, 2018
    Date of Patent: November 2, 2021
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Fangjun Pu, Taoran Lu, Peng Yin, Tao Chen
  • Patent number: 11159806
    Abstract: Techniques are described using Position Dependent Intra Prediction Combination (PDPC) and multiple reference lines. For example, a video coder (e.g., an encoder and/or decoder) can predict an initial prediction sample value for a sample of a current block using an intra-prediction mode. The initial prediction sample value can be predicted from a first neighboring block and/or a second neighboring block of the current block. One or more reference sample values can be determined from at least one line of multiple lines of reference samples from the first neighboring block and/or the second neighboring block. At least one of the lines from the multiple lines used for determining the reference sample value(s) is not adjacent to the current block. A final prediction sample value can be determined for the sample of the current block, such as by modifying the initial prediction sample value using the one or more reference sample values.
    Type: Grant
    Filed: June 6, 2019
    Date of Patent: October 26, 2021
    Assignee: QUALCOMM Incorporated
    Inventors: Adarsh Krishnan Ramasubramonian, Geert Van der Auwera, Marta Karczewicz
  • Patent number: 11113841
    Abstract: Techniques are disclosed. The techniques include receiving, from a camera, an image showing a portion of a physical topography and target object. The techniques include determining, based on the image, a location of the target object shown in the image and a physical characteristic of the target object shown in the image, the physical characteristic being common with at least another target object. The techniques then include determining a three dimensional (3D) position of the target object in a 3D representation of the portion of the physical topography, the 3D position determined based on (i) the location of the target object, and (ii) the physical characteristic. Based on detecting a cluster of 3D positions of target objects (over several images), the techniques involve generating a 3D boundary of a zone of a portion of the physical topography.
    Type: Grant
    Filed: June 11, 2019
    Date of Patent: September 7, 2021
    Assignee: Amazon Technologies, Inc.
    Inventors: Lev Zelenskiy, Jon Ducrou, James Eather, Michael Neville
  • Patent number: 11107251
    Abstract: The present invention relates to an image processing device and method which enable encoding efficiency in intra prediction to be improved. In the event that the optimal intra prediction mode is mode 0, adjacent pixels to be used for prediction of the current block are pixels A0, A1, A2, and A3. According to these pixels and a 6-tap FIR filter, pixels a?0.5, a+0.5, and so on with ½ pixel precision are generated, and further, pixels a?0.75, a?0.25, a+0.25, and a+0.75 with ¼ pixel precision are generated by linear interpolation. Subsequently, the optimal shift amount is determined with a value of ?0.75 through +0.75 that is phase difference between an integer pixel and generated fractional pixel precision serving as a candidate of the shift amount in the horizontal direction. The present invention may be applied to an image encoding device which performs encoding using the H.264/AVC system, for example.
    Type: Grant
    Filed: June 9, 2020
    Date of Patent: August 31, 2021
    Assignee: SONY CORPORATION
    Inventor: Kazushi Sato
  • Patent number: 11109038
    Abstract: An intra frame bit rate allocation method being performed by a computer device comprising at least one processor, includes when a current frame of picture is an intra frame in a specified frame sequence, pre-encoding the current frame of picture; calculating a corresponding intra frame encoding cost and an inter frame encoding cost of the pre-encoding; and allocating an intra frame bit rate according to the calculated intra frame encoding cost and the inter frame encoding cost.
    Type: Grant
    Filed: April 26, 2019
    Date of Patent: August 31, 2021
    Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LTD
    Inventors: Xu Nan Mao, Yao Yao Guo, Li Cai Guo, Yong Fang Shi, An Lin Gao, Haibo Deng, Chen Chen Gu, Jing Lv
  • Patent number: 11094191
    Abstract: Systems and methods for assisting navigation of traffic participants are described herein. An exemplary method may commence with collecting street object data by at least one sensor mounted on one of a plurality of poles. The street object data may be associated with at least one street object within a range of the at least one sensor. The method may continue with analyzing the street object data and generating street object metadata corresponding to the at least one street object. The method may continue with broadcasting the street object metadata to at least one traffic participant within the range. The street object metadata may be used to provide at least one warning to the at least one traffic participant of traffic conditions to allow the at least one traffic participant to take at least one proactive action.
    Type: Grant
    Filed: April 27, 2019
    Date of Patent: August 17, 2021
    Inventors: Iurii V. Iuzifovich, Anzhelina Iuzifovich, Natalia Yuzifovich
  • Patent number: 11079303
    Abstract: Vibrometric signatures of portions of a vehicle, such as a joint between two or more aspects of the vehicle, may be generated and used to make determinations regarding the integrity or suitability of the vehicle for one or more missions. Vibrometric signatures are generated based on imaging data captured with the vehicle subjected to excitation over a range of frequencies, and power levels of vibrations of the vehicle are calculated based on the images. Pixels corresponding to surfaces on either side of a joint are selected and vibrometric signatures calculated for such surfaces are compared to determine whether the joint adequately transfers vibrations, or whether the joint is sufficiently tight. Where the vibrometric signatures are sufficiently similar to one another, the joint may be presumed to be tight. Where the vibrometric signatures are not sufficiently similar to one another, the joint is presumed to require maintenance or inspection.
    Type: Grant
    Filed: June 11, 2019
    Date of Patent: August 3, 2021
    Assignee: Amazon Technologies, Inc.
    Inventors: Pragyana Mishra, Kevin Tseng
  • Patent number: 11070844
    Abstract: A method and a video processor for preventing start code confusion. The method includes aligning bytes of a slice header relating to slice data when the slice header is not byte aligned or inserting differential data at the end of the slice header before the slice data when the slice header is byte aligned, performing emulation prevention byte insertion on the slice header, and combine the slice header and the slice data after performing emulation prevention byte insertion.
    Type: Grant
    Filed: January 31, 2019
    Date of Patent: July 20, 2021
    Assignee: TEXAS INSTRUMENTS INCORPORATED
    Inventors: Vivienne Sze, Madhukar Budagavi, Akira Osamoto, Yasutomo Matsuba
  • Patent number: 11050940
    Abstract: The present invention provides a scanning method of a photoelectric remote sensing system including the following steps: providing a photoelectric remote sensing system that is suspended in the air; and S20, driving the photographing device by the pan-tilt device to scan a target area along a plurality of circular trajectories, driving the photographing device by the pan-tilt device to switch between the circular trajectories, so as to enable a scanning area of the photographing device to cover the entire target area; and adjusting an optical parameter of the photographing device while the photographing device is switched between the circular trajectories, so as to enable pictures photographed at all scanning points to have the same spatial resolution. The scanning method of the present invention can ensure that the scanning area fully covers a target area and pictures photographed at different target points have the same spatial resolution.
    Type: Grant
    Filed: June 19, 2019
    Date of Patent: June 29, 2021
    Assignee: DONGGUAN FRONTIER TECHNOLOGY INSTITUTE
    Inventors: Ruopeng Liu, Lin Luan, Faguo Xu
  • Patent number: 11012656
    Abstract: Provided are a gas detection device, an information processing device, and a program which enable a user to accurately estimate a gas leak position. The gas detection device includes a hardware processor that causes a display screen to display a first image captured by a first imaging section and a second image captured by a second imaging section, and changes at least one of a first display position of a specific position included in the first image and a second display position of the specific position included in the second image on the display screen. The hardware processor causes the display screen to display the first display position and the second display position so that the first display position and the second display position can be compared with each other so as to recognize a difference between the first display position and the second display position.
    Type: Grant
    Filed: March 4, 2019
    Date of Patent: May 18, 2021
    Assignee: Konica Minolta, Inc.
    Inventors: Saori Hirata, Mei Yamasaki
  • Patent number: 11006142
    Abstract: A method for decoding an image according to the present invention comprises the steps of: decoding a residual block by quantizing and inverse transforming an entropy-decoded residual block; generating a prediction block via motion compensation; and decoding an image by adding the decoded residual block to the prediction block, wherein on the basis of the maximum number of motion vector candidates of the motion vector candidate list related to the prediction block, a motion vector candidate list is adjusted by adding a particular motion vector candidate or by discarding a portion from among the motion vector candidates, and in the prediction block generation step, a prediction motion vector of the prediction block is determined on the basis of the adjusted motion vector candidate list. Accordingly, the complexity of arithmetic operations is reduced during encoding/decoding of an image.
    Type: Grant
    Filed: March 25, 2020
    Date of Patent: May 11, 2021
    Assignee: Electronics and Telecommunications Research Institute
    Inventors: Sung Chang Lim, Hui Yong Kim, Jin Ho Lee, Jin Soo Choi, Jin Woong Kim
  • Patent number: 11006048
    Abstract: An electronic apparatus according to a variety of embodiments comprises: a rotation part for rotating a plurality of cameras; a memory for storing instructions; and a processor electrically connected to the rotation part and memory, wherein the memory can store, when being executed, instructions for the processor to: acquire at least one item of image data by means of the cameras; check in the image data whether at least a portion of an object is located in an overlap area; and, if at least a portion of an object is located in the overlap area, then modify the filming direction of the cameras by means of the rotation part.
    Type: Grant
    Filed: October 27, 2017
    Date of Patent: May 11, 2021
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Yongsang Yun, Dongil Son, Jongchul Choi, Seungnyun Kim, Changryong Heo
  • Patent number: 10999512
    Abstract: Images may be obtained using a moving camera comprised of two or more rigidly mounted image sensors. Camera motion may change camera orientation when different portions of an image are captured. Pixel acquisition time may be determined based on image exposure duration and position of the pixel in the image array (pixel row index). Orientation of the sensor may at the pixel acquisition time instance may be determined. Image transformation may be performed wherein a given portion of the image may be associated with a respective transformation characterized by the corrected sensor orientation. In some implementations of panoramic image acquisition, multiple source images may be transformed to, e.g., equirectangular plane, using sensor orientation that is corrected for the time of pixel acquisition. Use of orientation correction may improve quality of stitching by, e.g., reducing contrast of border areas between portions of the transformed image obtained by different image sensors.
    Type: Grant
    Filed: February 7, 2020
    Date of Patent: May 4, 2021
    Assignee: GoPro, Inc.
    Inventor: Antoine Meler