Patents Examined by Matthew K Kwan
  • Patent number: 11412209
    Abstract: The present invention relates to a method and apparatus for video encoding/decoding by using a geometric modified picture. The encoding method according to the present invention includes: generating a geometric modified picture by geometrically modifying a reference picture; and generating a first prediction block of a current block by performing inter prediction referencing the geometric modified picture.
    Type: Grant
    Filed: November 18, 2016
    Date of Patent: August 9, 2022
    Assignees: Electronics and Telecommunications Research Institute, UNIVERSITY-INDUSTRY COOPERATION GROUP OF KYUNG HEE UNIVERSITY
    Inventors: Jung Won Kang, Hyun Suk Ko, Sung Chang Lim, Jin Ho Lee, Dong San Jun, Hui Yong Kim, Gwang Hoon Park, Jin Soo Choi, Tae Hyun Kim, Dae Young Lee, Young Su Heo
  • Patent number: 11410251
    Abstract: An information processing system includes a vehicle and an information processing device that acquires information acquired by the vehicle from the vehicle. The vehicle acquires information on an occupant in a passenger compartment of the vehicle, and acquires position information of the vehicle. When it is determined based on the information on the occupant that the vehicle has traveled to the vicinity of a hidden tourist attraction, the information processing device generates tourist attraction information including the position information of the vehicle at a point at which the determination has been performed.
    Type: Grant
    Filed: February 6, 2020
    Date of Patent: August 9, 2022
    Assignee: TOYOTA JIDOSHA KABUSHIKI KAISHA
    Inventors: Kana Hamagami, Takuya Maekawa, Yosuke Nakayama, Akitoshi Jikumaru, Tae Sugimura, Takao Hishikawa, Shinichi Adachi
  • Patent number: 11348271
    Abstract: An image processing device includes a disparity estimating unit configured to estimate a disparity between the first image and the second image based on a method different from stereo matching, a transforming unit configured to perform transformation processing on both the first image and the second image to reduce the number of pixels in the horizontal direction and/or the vertical direction, a setting unit configured to set, based on the disparity thus estimated, a search range for a corresponding point for the stereo matching, and a search unit configured to search only the search range thus set for a corresponding point of each pixel between the first image subjected to the transformation processing and the second image subjected to the transformation processing.
    Type: Grant
    Filed: March 14, 2019
    Date of Patent: May 31, 2022
    Assignee: OMRON CORPORATION
    Inventor: Shinya Matsumoto
  • Patent number: 11330171
    Abstract: A method for blending a left image with a right image along a seam is disclosed. The method comprises selecting collocated pixels from a collocated column of pixels in the left image and the right image; computing differences in the selected collocated pixels; and determining a correction amount to apply to seam pixels along the seam on a row-by-row basis based on the computed differences; and selectively applying the correction amount on a row-by-row basis to a neighborhood of pixels extending transversely across the seam and centered on seam.
    Type: Grant
    Filed: May 24, 2013
    Date of Patent: May 10, 2022
    Inventor: Jason Daniel Tanner
  • Patent number: 11330265
    Abstract: An encoder which encodes a current block to be encoded in an image includes: a transformer which performs a primary transform from residuals of the current block to primary coefficients, determines whether to apply a secondary transform to the current block, and performs the secondary transform from the primary coefficients to secondary coefficients when the secondary transform is applied; a quantizer which calculates quantized primary coefficients by performing a first quantization on the primary coefficients when a secondary transform is not applied, and calculates quantized secondary coefficients by performing a second quantization different from the first quantization on the secondary coefficients when the secondary transform is applied; and an entropy encoder which generates an encoded bitstream by encoding either quantized primary coefficients or quantized secondary coefficients.
    Type: Grant
    Filed: January 24, 2020
    Date of Patent: May 10, 2022
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Ryuichi Kanoh, Kiyofumi Abe, Tadamasa Toma, Takahiro Nishi
  • Patent number: 11310525
    Abstract: Methods and devices for encoding a point cloud. A predictor-copy coding mode is described in which an encoder copies the predicted points for a sub-volume rather than encoding the occupancy data for the original points in the sub-volume. A predictor-copy coding mode flag is coded in the bitstream to signal to the decoder whether predictor-copy coding mode is active or inactive. The predictor-copy coding mode flag may only be coded for sub-volumes that are eligible to use the mode. Eligibility may be based on depth within the coding tree and/or size of the sub-volume. Predictor-copy coding mode has the result of early termination of a branch of the coding tree. Instead of decoding the occupancy for the remainder of the branch, a decoder copies the predicted points that are positioned within the sub-volume as the reconstructed points of the point cloud for that sub-volume.
    Type: Grant
    Filed: July 8, 2019
    Date of Patent: April 19, 2022
    Assignee: BlackBerry Limited
    Inventors: S├ębastien Lasserre, David Flynn
  • Patent number: 11300773
    Abstract: An apparatus and method for generating a mid-infrared region image of a specimen are disclosed. The apparatus includes a mid-infrared region laser that generates a first light beam, and a stage adapted to carry a specimen to be scanned. An optical assembly focuses the first light beam to a point on the specimen. A first light detector measures a first intensity of light leaving the point on the specimen. A stage actuator assembly causes the specimen to move relative to the point in two dimensions. A controller forms a mid-infrared region image from the first intensity. The image can be based on reflected or transmitted light. The maximum size of the imaged area is determined by a scanning assembly that moves in a first direction relative to the stage, the stage moving in a direction orthogonal to the first direction.
    Type: Grant
    Filed: September 29, 2014
    Date of Patent: April 12, 2022
    Assignee: Agilent Technologies, Inc.
    Inventors: Charles Hoke, Varun Raghunathan
  • Patent number: 11284112
    Abstract: A method of decoding or encoding including receiving information regarding a video sequence for encoding or decoding, determining, for the encoding or decoding of the video sequence, whether to use a first transform core matrix that is of a first size type or a second transform core matrix that is of a second size type, and based on the determining, transmitting information that causes the video sequence to be encoded or decoded using the determined first transform core matrix or second transform core matrix.
    Type: Grant
    Filed: April 23, 2019
    Date of Patent: March 22, 2022
    Assignee: TENCENT AMERICA LLC
    Inventors: Xin Zhao, Xiang Li, Shan Liu
  • Patent number: 11265562
    Abstract: A transmitting method for transmitting encoded data obtained by hierarchically encoding a video image includes: generating an encoded stream that includes time information and the encoded data, the time information indicating a time at which decoding or displaying processing of the encoded data is performed, and transmitting the generated encoded stream, wherein the encoded data includes a plurality of sets each including a plurality of access units and the time information includes first time information which indicates a time at which the processing performed on a first access unit of the first set is performed and which is based on a reference clock, and second time information used to specify a time at which the processing performed on a second access unit of the second set is performed and which is based on the reference clock.
    Type: Grant
    Filed: September 4, 2019
    Date of Patent: March 1, 2022
    Assignee: SUN PATENT TRUST
    Inventors: Tadamasa Toma, Noritaka Iguchi, Takahiro Nishi, Hisaya Katou
  • Patent number: 11265539
    Abstract: There is provided an encoding apparatus, an encoding method, a decoding apparatus, and a decoding method that make it possible to improve the performance of a filter process. The encoding apparatus and the decoding apparatus perform classification of classifying, according to a reliability degree determined according to a frequency distribution of inclination directions indicating directions of inclination of pixel values of a plurality of pixels in a frequency distribution generation region including a pixel of interest of a decoded image, the pixel of interest into any of a plurality of classes, and performs a filter process of applying, to the decoded image, a prediction formula for performing product sum calculation of tap coefficients of the class of the pixel of interest obtained by the classification and pixels of the decoded image. The present technology can be applied, for example, to a case in which encoding and decoding of an image are performed.
    Type: Grant
    Filed: May 7, 2019
    Date of Patent: March 1, 2022
    Assignee: SONY CORPORATION
    Inventor: Masaru Ikeda
  • Patent number: 11252438
    Abstract: A method of decoding or encoding including receiving information regarding a video sequence for encoding or decoding, determining, for the encoding or decoding of the video sequence, whether to use a first transform core matrix that is of a first size type or a second transform core matrix that is of a second size type, and based on the determining, transmitting information that causes the video sequence to be encoded or decoded using the determined first transform core matrix or second transform core matrix.
    Type: Grant
    Filed: April 23, 2019
    Date of Patent: February 15, 2022
    Assignee: TENCENT AMERICA LLC
    Inventors: Xin Zhao, Xiang Li, Shan Liu
  • Patent number: 11252390
    Abstract: Provided are a method and apparatus for encoding or decoding a 360-degree image. An image decoding method and apparatus according to an embodiment include: obtaining image data from a bitstream; decoding a first region of a projection image corresponding to a non-clipping region of a 360-degree image from the image data; obtaining information about a clipping region of the 360-degree image from the bitstream; determining a second region of the projection image, based on the information about the clipping region; and converting the projection image including the first region and the second region into the 360-degree image.
    Type: Grant
    Filed: January 10, 2018
    Date of Patent: February 15, 2022
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Elena Alshina, Vladyslav Zakharchenko, Kwang-pyo Choi
  • Patent number: 11240514
    Abstract: A method of and an apparatus for controlling intra prediction for decoding of a video sequence are provided. The method includes determining a ratio of a width to a height of a coding unit, and based on the determined ratio being different than one, adding, to a table including intra prediction modes corresponding to intra prediction angles, first wide angles toward a bottom-left edge of the coding unit, second wide angles toward a top-right edge of the coding unit, and additional intra prediction modes respectively corresponding to the first wide angles and the second wide angles. The method further includes selecting, for decoding the video sequence, one of the intra prediction modes and the additional intra prediction modes added to the table.
    Type: Grant
    Filed: September 29, 2020
    Date of Patent: February 1, 2022
    Assignee: TENCENT AMERICA LLC
    Inventors: Liang Zhao, Xin Zhao, Xiang Li, Shan Liu
  • Patent number: 11234024
    Abstract: A method of three-dimensional (3D)-Tree coding for neural network model compression, is performed by at least one processor, and includes reshaping a four-dimensional (4D) parameter tensor of a neural network into a 3D parameter tensor of the neural network, the 3D parameter tensor comprising a convolution kernel size, an input feature size, and an output feature size, partitioning the 3D parameter tensor along a plane that is formed by the input feature size and the output feature size into 3D coding tree units (CTU3Ds), partitioning each of the CTU3Ds into a plurality of 3D coding units (CU3Ds) recursively until a predetermined depth, using a quad-tree, constructing a 3D tree for each of the plurality of CU3Ds, and entropy encoding each of a plurality of values of a plurality of nodes of the 3D tree.
    Type: Grant
    Filed: October 27, 2020
    Date of Patent: January 25, 2022
    Assignee: TENCENT AMERICA LLC
    Inventors: Wei Wang, Wei Jiang, Shan Liu
  • Patent number: 11234003
    Abstract: An intra-prediction method according to the present invention comprises the steps of: acquiring intra-prediction mode information from a bitstream; deriving neighboring reference samples of a current block; determining an intra-directional mode for the current block; deriving a predicted block for the current block based on the intra-directional mode and the neighboring reference samples; deriving template reference samples based on the neighboring reference samples; a template reference block based on the template reference samples; and generating a modified predicted block based on the predicted block and the template reference block. The present invention can generate a modified predicted block based on an intra-predicted block and a template reference block, thereby improving the intra-prediction performance.
    Type: Grant
    Filed: July 26, 2016
    Date of Patent: January 25, 2022
    Assignee: LG ELECTRONICS INC.
    Inventors: Hyeongmoon Jang, Naeri Park, Junghak Nam
  • Patent number: 11228761
    Abstract: A method for video bitstream processing, comprising: determining that a first portion of a data unit of the video bitstream exceeds beyond one or multiple borders of a second portion of the data unit of the video bitstream; and performing at least one of: extended quad tree (EQT) partitioning, flexible tree (FT) partitioning, or generalized triple tree (GTT) partitioning of the first portion of the data unit based on the determination that the first portion exceeds beyond the border.
    Type: Grant
    Filed: December 2, 2020
    Date of Patent: January 18, 2022
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLOGY CO., LTD., BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Hongbin Liu, Yue Wang
  • Patent number: 11212504
    Abstract: Provided are a method and apparatus for encoding or decoding a 360-degree image. An image decoding method and apparatus according to an embodiment include: obtaining image data from a bitstream; decoding a first region of a projection image corresponding to a non-clipping region of a 360-degree image from the image data; obtaining information about a clipping region of the 360-degree image from the bitstream; determining a second region of the projection image, based on the information about the clipping region; and converting the projection image including the first region and the second region into the 360-degree image.
    Type: Grant
    Filed: January 10, 2018
    Date of Patent: December 28, 2021
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Elena Alshina, Vladyslav Zakharchenko, Kwang-pyo Choi
  • Patent number: 11200704
    Abstract: Aspects of the subject disclosure may include, for example, encoding a point cloud in a first frame of volumetric video in an octree format and identifying a first group of points of the point cloud, resulting in a first base layer including a base layer, a first enhancement layer and a second enhancement layer. Each layer includes different points from the point cloud, with the second enhancement layer including all points in each octet of leaf nodes in the octree format of the point cloud that are not in the base layer and the first enhancement layer. The first base layer of the point cloud is provided over a communication network to a media device and the first enhancement layer is also provided responsive to a determination of sufficient available bandwidth in the communication network. Other embodiments are disclosed.
    Type: Grant
    Filed: March 1, 2021
    Date of Patent: December 14, 2021
    Assignee: AT&T Intellectual Property I, L.P.
    Inventors: Bo Han, Cheuk Yiu Ip, Jackson Jarrell Pair
  • Patent number: 11176367
    Abstract: A disclosed computer-implemented method may include directing an illumination source, positioned at a predetermined position relative to an event camera positioned to receive light from the illumination source reflected by a portion of a cornea of a user during an illumination sequence, to illuminate the portion of the cornea of the user in accordance with the illumination sequence. The method may also include detecting, via the event camera, a set of events, each event in the set of events comprising a change in an intensity of light from the illumination source received by a pixel included in the event camera over a sampling period of the event camera. The method may further include determining a shape of the portion of the cornea of the user based on the predetermined position, the illumination sequence, and the set of events. Various other apparatuses, systems, methods, and computer-readable media are also disclosed.
    Type: Grant
    Filed: May 1, 2019
    Date of Patent: November 16, 2021
    Assignee: Facebook Technologies, LLC
    Inventors: Alexander Jobe Fix, Andrew Wyman MacDonald, Dmitri Model, Mohammadhossein Daraeihajitooei, Javier San Agustin Lopez, Mohamed Hegazy, Scott Robert Ramsby, Sebastian Sztuk
  • Patent number: 11172238
    Abstract: A system for providing video playback includes an interface and a processor. The interface is configured to receive a desired video playback request and receive a video content source switching request from a first video content source to a second video content source. The processor is configured to generate a not-all-I-frame first stream for the first video content source, generate an all-I-frame second stream and a not-all-I-frame second stream for the second video content source, switch from the not-all-I-frame first stream for the first video content source to the all-I-frame second stream for the second video content source, and switch from the all-I-frame second stream for the second video content source to the not-all-I-frame second stream for the second video content source on a next I-frame occurrence in the not-all-I-frame second stream for the second video content source.
    Type: Grant
    Filed: February 5, 2020
    Date of Patent: November 9, 2021
    Assignee: VisualOn, Inc.
    Inventors: Cheng-Ta Hsieh, Hyoheon Hong, Ming-Mao Chiang