Patents Examined by Yulin Sun
  • Patent number: 11973967
    Abstract: Examples of video encoding methods and apparatus and video decoding methods and apparatus are described. An example method of video processing includes performing a conversion between a video and a bitstream of the video. The bitstream includes one or more layers including one or more network abstraction layer (NAL) units according to a format rule that specifies that a first layer identifier in a header of an end of sequence network abstraction layer (EOS NAL) unit is required to be equal to a second layer identifier of one of the one or more layers in the bitstream.
    Type: Grant
    Filed: November 17, 2022
    Date of Patent: April 30, 2024
    Assignee: BYTEDANCE INC.
    Inventor: Ye-kui Wang
  • Patent number: 11973961
    Abstract: A decoder for block-based decoding of picture data of a picture is configured to decode a current block of the picture by determining first and second sets of luma in a neighborhood of the current block, the first set of luma samples having smaller luma values than the second set of luma samples, fitting a straight-line having a linear function through first and second pairs of luma-chroma samples, wherein the first and second pairs of luma-chroma samples are determined based on the first and second sets of luma samples, respectively, and on first and second corresponding chroma samples, respectively, in said neighborhood of the current block, and predicting chroma samples of the current block using luma samples of the current block and said linear function. The present proposal further concerns a respective encoder and corresponding methods for encoding and decoding.
    Type: Grant
    Filed: June 3, 2021
    Date of Patent: April 30, 2024
    Assignee: Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e. V.
    Inventors: Christian Helmrich, Heiko Schwarz, Detlev Marpe, Thomas Wiegand
  • Patent number: 11949901
    Abstract: A method of deriving intra prediction data based on a planar prediction mode includes the following operations: obtaining multiple first reconstructed row samples and a second reconstructed row sample in an adjacent above row to a current block, the first reconstructed row samples extending from first to last columns of the current block, the second reconstructed row sample corresponding to an adjacent right column to the current block; obtaining multiple first reconstructed column samples and a second reconstructed column sample in an adjacent left column to the current block, the first reconstructed column samples extending from first to last rows of the current block, the second reconstructed column sample corresponding to an adjacent below row to the current block; and deriving the intra prediction data corresponding to the current block based on a width and a height of the current block and the obtained reconstructed row and column samples.
    Type: Grant
    Filed: January 28, 2022
    Date of Patent: April 2, 2024
    Assignees: SHARP KABUSHIKI KAISHA, FG Innovation Company Limited
    Inventors: Kiran Mukesh Misra, Jie Zhao, Christopher Andrew Segall
  • Patent number: 11948282
    Abstract: An image processing apparatus generates a normal image, when lighting correction of an image is performed using three-dimensional shape data. Three-dimensional shape data of a predetermined object is adjusted with a subject in position, based on a feature pattern detected in image data, and lighting processing for correcting a pixel value of the image data is performed based on the adjusted three-dimensional shape data, distance information of the subject, and a position of a virtual light source. When the three-dimensional shape data is adjusted with the image data in position, a region having a large irregularity in the three-dimensional shape data is preferentially adjusted in position.
    Type: Grant
    Filed: August 4, 2021
    Date of Patent: April 2, 2024
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Yuichi Nakada, Shugo Higuchi
  • Patent number: 11943480
    Abstract: Disclosed herein are innovations for bitstreams having clean random access (CRA) pictures and/or other types of random access point (RAP) pictures. New type definitions and strategic constraints on types of RAP pictures can simplify mapping of units of elementary video stream data to a container format. Such innovations can help improve the ability for video coding systems to more flexibly perform adaptive video delivery, production editing, commercial insertion, and the like.
    Type: Grant
    Filed: March 8, 2022
    Date of Patent: March 26, 2024
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Gary J. Sullivan, Sandeep Kanumuri
  • Patent number: 11917173
    Abstract: A video coding mechanism is disclosed. The mechanism includes receiving a bitstream comprising one or more sub-pictures partitioned from a picture such that each sub-picture includes a sub-picture width that is an integer multiple of a coding tree unit (CTU) size when the each sub-picture includes a right boundary that does not coincide with a right boundary of the picture. The bitstream is parsed to obtain the one or more sub-pictures. The one or more sub-pictures are decoded to create a video sequence. The video sequence is forwarded for display.
    Type: Grant
    Filed: July 8, 2021
    Date of Patent: February 27, 2024
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Ye-Kui Wang, FNU Hendry
  • Patent number: 11910026
    Abstract: The present disclosure relates to an image processing apparatus and a method that enable decoding of encoded data of an octree in various processing orders. The octree corresponding to point cloud data is encoded after the context is initialized for each layer of the octree. Further, a breadth-first order or a depth-first order is selected as the decoding order for the encoded data of the octree corresponding to point cloud data, and the encoded data is decoded in the selected decoding order. The present disclosure can be applied to an image processing apparatus, an electronic apparatus, an image processing method, a program, or the like, for example.
    Type: Grant
    Filed: September 13, 2019
    Date of Patent: February 20, 2024
    Assignee: SONY CORPORATION
    Inventors: Koji Yano, Tsuyoshi Kato, Satoru Kuma, Ohji Nakagami
  • Patent number: 11909952
    Abstract: A three-dimensional data encoding method encodes a plurality of three-dimensional points, and includes: selecting one of two or more prediction modes for calculating a predicted value of an attribute information item of the first three-dimensional point, in accordance with attribute information items of one or more second three-dimensional points in the vicinity of a first three-dimensional point; calculating the predicted value by the selected prediction mode; calculating, as a prediction residual, a difference between a value of the attribute information item of the first three-dimensional point and the calculated predicted value; and generating a bit stream that includes the one prediction mode and the prediction residual.
    Type: Grant
    Filed: September 10, 2021
    Date of Patent: February 20, 2024
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventor: Toshiyasu Sugio
  • Patent number: 11910001
    Abstract: A method comprising: receiving a high frame rate video stream of a scene, wherein the scene comprises at least one object in motion relative to an imaging device acquiring the video stream; continuously dividing, in real time, the video stream into at least one consecutive sequences of n frames each; with respect to each current sequence: (i) estimating pixel motion between at least some pairs of frames in the sequence, (ii) calculating a motion vector field for each pixel in the sequence, (iii) generating a representative frame which co-locates all of the pixels to respective pixel positions, based on the calculated motion vector fields, and (iv) aggregating, for each of the respective pixel positions, pixel values from all frames in the sequence; and outputting, in real time, a stream of the representative frames, wherein the stream has a lower frame rate than the high frame rate.
    Type: Grant
    Filed: July 9, 2020
    Date of Patent: February 20, 2024
    Assignee: VOYAGE81 LTD.
    Inventor: Shmuel Mangan
  • Patent number: 11909970
    Abstract: The present invention provides an image encoding method and an image decoding method. The image encoding method of the present invention comprises: a first dividing step of dividing a current image into a plurality of blocks; and a second dividing step of dividing, into a plurality of sub blocks, a block, which is to be divided and includes a boundary of the current image, among the plurality of blocks, wherein the second dividing step is recursively performed by setting a sub block including the boundary of the current images as the block to be divided, until the sub block including the boundary of the current image does not exist among the sub blocks.
    Type: Grant
    Filed: September 15, 2023
    Date of Patent: February 20, 2024
    Assignee: Industry Academy Cooperation Foundation of Sejong University
    Inventors: Joo Hee Moon, Sung Won Lim, Dong Jae Won
  • Patent number: 11909971
    Abstract: The present invention provides an image encoding method and an image decoding method. The image encoding method of the present invention comprises: a first dividing step of dividing a current image into a plurality of blocks; and a second dividing step of dividing, into a plurality of sub blocks, a block, which is to be divided and includes a boundary of the current image, among the plurality of blocks, wherein the second dividing step is recursively performed by setting a sub block including the boundary of the current images as the block to be divided, until the sub block including the boundary of the current image does not exist among the sub blocks.
    Type: Grant
    Filed: September 15, 2023
    Date of Patent: February 20, 2024
    Assignee: Industry Academy Cooperation Foundation of Sejong University
    Inventors: Joo Hee Moon, Sung Won Lim, Dong Jae Won
  • Patent number: 11909996
    Abstract: Examples of video encoding methods and apparatus and video decoding methods and apparatus are described. An example method of video processing includes performing a conversion between a video and a bitstream of the video. The bitstream includes one or more layers including one or more network abstraction layer (NAL) units according to a format rule that specifies that a first layer identifier in a header of an end of sequence network abstraction layer (EOS NAL) unit is required to be equal to a second layer identifier of one of the one or more layers in the bitstream.
    Type: Grant
    Filed: November 17, 2022
    Date of Patent: February 20, 2024
    Assignee: BYTEDANCE INC.
    Inventor: Ye-kui Wang
  • Patent number: 11902521
    Abstract: The present invention provides an image encoding method and an image decoding method. The image encoding method of the present invention comprises: a first dividing step of dividing a current image into a plurality of blocks; and a second dividing step of dividing, into a plurality of sub blocks, a block, which is to be divided and includes a boundary of the current image, among the plurality of blocks, wherein the second dividing step is recursively performed by setting a sub block including the boundary of the current images as the block to be divided, until the sub block including the boundary of the current image does not exist among the sub blocks.
    Type: Grant
    Filed: September 15, 2023
    Date of Patent: February 13, 2024
    Assignee: Industry Academy Cooperation Foundation of Sejong University
    Inventors: Joo Hee Moon, Sung Won Lim, Dong Jae Won
  • Patent number: 11882296
    Abstract: An image decoding method carried out by a decoding device, according to the present document, comprises the steps of: acquiring a sign data hiding enable flag; acquiring a transform skip residual coding (TSRC) enable flag on the basis of the sign data hiding enable flag; acquiring residual information for a current block, on the basis of the TSRC enable flag; deriving a residual sample of the current block, on the basis of the residual information; and generating a reconstructed picture on the basis of the residual sample, wherein the sign data hiding enable flag is a flag indicating whether sign data hiding is enabled, the TSRC enable flag is a flag indicating whether TSRC is enabled, and the TSRC enable flag is acquired on the basis of the sign data hiding enable flag having a value of zero.
    Type: Grant
    Filed: September 30, 2022
    Date of Patent: January 23, 2024
    Assignee: LG Electronics Inc.
    Inventors: Jungah Choi, Sunmi Yoo, Junghak Nam, Jin Heo, Jangwon Choi, Seunghwan Kim
  • Patent number: 11854179
    Abstract: A camera abnormality detecting device according to an embodiment includes an acquiring section and a notifying section. The acquiring section acquires, from an image photographed by a camera provided in a conveyance body to be capable of photographing an inside of a basket placed on a basket receiving section of the conveyance body, an image of a region where an upper edge of the basket is surmised to be reflected. The notifying section notifies, based on the image acquired by the acquiring section, whether an angle of view of the camera is blocked.
    Type: Grant
    Filed: August 17, 2021
    Date of Patent: December 26, 2023
    Assignee: TOSHIBA TEC KABUSHIKI KAISHA
    Inventor: Atsushi Okamura
  • Patent number: 11812062
    Abstract: Methods, devices and systems for signaling the use of subpictures in coded video pictures are described. One example method of video processing includes performing a conversion between a video and a bitstream of a video, wherein the bitstream conforms to a format rule, wherein the format rule specifies that a first syntax element signaled in a sequence parameter set (SPS) of the bitstream is indicative of a length of identifiers of subpictures in the SPS, and wherein the signaling of the first syntax element is independent of a value of a second syntax element that is indicative of explicit signaling of the identifiers of the subpictures in the SPS or a picture parameter set (PPS).
    Type: Grant
    Filed: June 27, 2022
    Date of Patent: November 7, 2023
    Assignee: BYTEDANCE INC.
    Inventor: Ye-Kui Wang
  • Patent number: 11812063
    Abstract: A video processing method includes performing a conversion between a video comprising one or more pictures and a bitstream of the video according to a format rule. The format rule specifies that, in response to satisfying one or more conditions, a syntax element indicating whether a first syntax structure providing a profile, a tier and a level information and a second syntax structure providing decoded picture buffer information are present in a sequence parameter set is set to be equal to 1 to indicate that the first syntax structure and the second syntax structure are present in the sequence parameter set.
    Type: Grant
    Filed: September 30, 2022
    Date of Patent: November 7, 2023
    Assignee: BYTEDANCE INC.
    Inventors: Ye-kui Wang, Li Zhang, Kai Zhang
  • Patent number: 11812067
    Abstract: A method includes performing a conversion between a video that includes at least a video tile and a bitstream of the video according to a rule. The rule specifies that a height of a slice in the video tile in units of coding tree units is derived based on a value of a first syntax element in the bitstream indicating a number of explicitly provided slice heights for slices in the video tile that includes the slice.
    Type: Grant
    Filed: August 22, 2022
    Date of Patent: November 7, 2023
    Assignees: BEIJING BYTEDANCE NETWORK TECHNOLGY CO., LTD., BYTEDANCE INC.
    Inventors: Kai Zhang, Li Zhang, Ye-kui Wang, Zhipin Deng, Kui Fan, Jizheng Xu, Hongbin Liu
  • Patent number: 11804049
    Abstract: An autonomous vehicle is configured to detect an active turn signal indicator on another vehicle. An image-capture device of the autonomous vehicle captures an image of a field of view of the autonomous vehicle. The autonomous vehicle captures the image with a short exposure to emphasize objects having brightness above a threshold. Additionally, a bounding area for a second vehicle located within the image is determined. The autonomous vehicle identifies a group of pixels within the bounding area based on a first color of the group of pixels. The autonomous vehicle also calculates an oscillation of an intensity of the group of pixels. Based on the oscillation of the intensity, the autonomous vehicle determines a likelihood that the second vehicle has a first active turn signal. Additionally, the autonomous vehicle is controlled based at least on the likelihood that the second vehicle has a first active turn signal.
    Type: Grant
    Filed: March 25, 2021
    Date of Patent: October 31, 2023
    Assignee: Waymo LLC
    Inventors: Abhijit Ogale, Dave Ferguson
  • Patent number: 11792409
    Abstract: Disclosed are an image encoding/decoding method and apparatus. The method and apparatus select at least one reference pixel line from among multiple reference pixel lines and derive a predicted value of a pixel within a current block by using the value of at least one pixel within the selected reference pixel line(s). Alternatively, the method and apparatus derive an intra prediction mode of a reconstructed pixel region on the basis of a reference pixel region of at least one reconstructed pixel region, derive an intra prediction mode of a current block on the basis of the derived intra prediction mode of the reconstructed pixel region, obtain an intra prediction block of the current block by using the derived intra prediction mode, and reconstruct the current block by summing the obtained intra prediction block and a residual block of the current block.
    Type: Grant
    Filed: May 12, 2021
    Date of Patent: October 17, 2023
    Assignee: Industry Academy Cooperation Foundation of Sejong University
    Inventors: Joo Hee Moon, Sung Won Lim, Dong Jae Won