Patents Examined by Yulin Sun
  • Patent number: 11336919
    Abstract: There is provided an image processing apparatus and a method that can suppress an increase in the memory capacity necessary for an orthogonal transform and an inverse orthogonal transform. A submatrix as part of a transform matrix in a first size is used to derive a transform matrix in a second size that is a size smaller than the first size. The derived transform matrix is used to apply an inverse orthogonal transform to coefficient data in which a predicted residual of an image is orthogonally transformed. In this way, an image is generated. The present disclosure can be applied to, for example, an image processing apparatus, an image decoding apparatus, an image encoding apparatus, or the like.
    Type: Grant
    Filed: March 18, 2019
    Date of Patent: May 17, 2022
    Assignee: SONY CORPORATION
    Inventor: Takeshi Tsukuba
  • Patent number: 11323727
    Abstract: Systems and methods for performing polar decoding using a transformation of the coded bits prior to polar decoding and an inverse transformation of the resulting data bits after polar decoding are disclosed. In some embodiments, a method of operation of a receiving node to perform polar decoding comprises transforming a received code bit vector yN in accordance with a transformation TN to thereby provide a transformed code bit vector Y?N=YNTN, performing polar decoding of the transformed code bit vector y?N to thereby provide a transformed data bit vector v?N, and inversely transforming the transformed data bit vector v?N in accordance with an inverse transformation TN?1 to thereby provide an estimated data bit vector vN=v?NTN?1. In some embodiments, the transformation TN re-orders coded bits in the coded bit vector yN such that some future frozen bit(s) are swapped in front of some information bit(s) prior to performing polar decoding.
    Type: Grant
    Filed: February 5, 2018
    Date of Patent: May 3, 2022
    Assignee: Telefonaktiebolaget LM Ericsson (publ)
    Inventors: Dennis Hui, Yufei Blankenship
  • Patent number: 11308347
    Abstract: The invention is related to a method of determining a similarity transformation between first coordinates and second coordinates of 3D features, comprising providing a first plurality of 3D features having first coordinates in a first coordinate system which is associated with a first geometrical model of a first real object, wherein the first plurality of 3D features describes physical 3D features of the first real object, providing a second coordinate system, providing image information associated with a plurality of images captured by at least one camera, for each respective 3D feature of at least part of the first plurality of 3D features, wherein the respective 3D feature is captured by at least two of the plurality of images, determining camera poses of the at least one camera in the second coordinate system while the at least two of the plurality of images are captured, determining for the respective 3D feature a second coordinate in the second coordinate system according to the at least two of the plu
    Type: Grant
    Filed: August 25, 2020
    Date of Patent: April 19, 2022
    Assignee: Apple Inc.
    Inventors: Daniel Ulbricht, Thomas Olszamowski
  • Patent number: 11310521
    Abstract: Given that decoder side motion vector refinement/derivation is a normative aspect of a coding system, the encoder will also have to perform the same error surface technique in order to not have any drift between the encoder's reconstruction and the decoder's reconstruction. Hence, all aspects of all embodiments are applicable to both encoding and decoding systems. In template matching, the refinement movement occurs only in the reference starting from the sub-pixel accurate center that is derived based on the explicitly signaled merge index or implicitly through cost evaluations. In bilateral matching (with or without averaged template), the refinements start in the reference lists L0 and L1 starting from the respective sub-pixel accurate centers that are derived based on the explicitly signaled merge index or implicitly through cost evaluations.
    Type: Grant
    Filed: November 22, 2020
    Date of Patent: April 19, 2022
    Inventors: Sriram Sethuraman, Jeeva Raj A, Sagar Kotecha
  • Patent number: 11303933
    Abstract: Disclosed herein are innovations for bitstreams having clean random access (CRA) pictures and/or other types of random access point (RAP) pictures. New type definitions and strategic constraints on types of RAP pictures can simplify mapping of units of elementary video stream data to a container format. Such innovations can help improve the ability for video coding systems to more flexibly perform adaptive video delivery, production editing, commercial insertion, and the like.
    Type: Grant
    Filed: September 30, 2019
    Date of Patent: April 12, 2022
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Gary J. Sullivan, Sandeep Kanumuri
  • Patent number: 11303823
    Abstract: A camera array for a mediated-reality system includes a plurality of hexagonal cells arranged in a honeycomb pattern in which a pair of inner cells include respective edges adjacent to each other and a pair of outer cells are separated from each other by the inner cells. A plurality of cameras are mounted within each of the plurality of hexagonal cells. The plurality of cameras include at least one camera of a first type and at least one camera of a second type. The camera of the first type may have a longer focal length than the camera of the second type.
    Type: Grant
    Filed: March 3, 2020
    Date of Patent: April 12, 2022
    Assignee: Proprio, Inc.
    Inventors: James Andrew Youngquist, David Julio Colmenares, Adam Gabriel Jones
  • Patent number: 11277634
    Abstract: The present invention relates to a method and apparatus for processing a video signal, which can increase the accuracy of the motion vector prediction through motion vector scaling which takes a difference in the temporal distance between reference pictures into consideration. To this end, the present invention provides a video signal processing method and a video signal processing apparatus using the same, and the method comprises the steps of: scaling at least one neighboring partition motion vector for a motion vector prediction of the current partition; scaling the neighboring partition motion vector, which has been selected, when the reference picture of the neighboring partition motion vector is different from the reference picture of the current partition; acquiring a motion vector prediction value of the current partition using the scaled motion vector; and acquiring a motion vector of the current partition using the motion vector prediction value.
    Type: Grant
    Filed: July 7, 2020
    Date of Patent: March 15, 2022
    Assignee: LG ELECTRONICS INC.
    Inventors: Joonyoung Park, Seungwook Park, Jaehyun Lim, Jungsun Kim, Younghee Choi, Jaewon Sung, Byeongmoon Jeon, Yongjoon Jeon
  • Patent number: 11272202
    Abstract: A method for coding video data is disclosed. The method comprising: receiving a rectangular array of coefficient level values having a width and a height; and for each coefficient level value included in the rectangular array, generating a corresponding transform coefficient value, wherein generating a corresponding transform coefficient value includes scaling a coefficient level value based on a quantization parameter and the width and the height of the rectangular array.
    Type: Grant
    Filed: December 27, 2017
    Date of Patent: March 8, 2022
    Assignees: SHARP KABUSHIKI KAISHA, FG Innovation Company Limited
    Inventors: Kiran Mukesh Misra, Jie Zhao, Christopher Andrew Segall
  • Patent number: 11272205
    Abstract: Given that decoder side motion vector refinement/derivation is a normative aspect of a coding system, the encoder will also have to perform the same error surface technique in order to not have any drift between the encoder's reconstruction and the decoder's reconstruction. Hence, all aspects of all embodiments are applicable to both encoding and decoding systems. In template matching, the refinement movement occurs only in the reference starting from the sub-pixel accurate center that is derived based on the explicitly signaled merge index or implicitly through cost evaluations. In bilateral matching (with or without averaged template), the refinements start in the reference lists L0 and L1 starting from the respective sub-pixel accurate centers that are derived based on the explicitly signaled merge index or implicitly through cost evaluations.
    Type: Grant
    Filed: November 22, 2020
    Date of Patent: March 8, 2022
    Inventors: Sriram Sethuraman, Jeeva Raj A, Sagar Kotecha
  • Patent number: 11259037
    Abstract: A method of decoding a received set of encoded data representing information that has been compressed, wherein the encoded data set is divided into a hierarchy of subsets, is provided. The method comprises: obtaining, from at least one first subset, a respective set of offset values; and decoding a plurality of second subsets, each comprising a data structure of metadata and data, to derive a series of data values, wherein each second subset corresponds to a region of the information that has been compressed. Each offset value is associated with a second subset and indicates a relative position within the encoded data set that corresponds to the earliest element of the associated second subset with respect to the position within the encoded data set that corresponds to an element of another subset of the hierarchy of subsets.
    Type: Grant
    Filed: December 6, 2018
    Date of Patent: February 22, 2022
    Assignee: V-NOVA INTERNATIONAL LIMITED
    Inventors: Ivan Makeev, Balázs Keszthelyi, Stergios Poularakis, Michele Sanna, Robert Ettinger
  • Patent number: 11259024
    Abstract: A method, computer program, and computer system for video coding is provided. Video data including one or more quantized coefficients is received. One or more index values associated with the quantized coefficients are mapped to one or more step values based on an exponential mapping. The video data is decoded based on the one or more step values.
    Type: Grant
    Filed: November 16, 2020
    Date of Patent: February 22, 2022
    Assignee: TENCENT AMERICA LLC
    Inventors: Madhu Peringassery Krishnan, Xin Zhao, Shan Liu
  • Patent number: 11245916
    Abstract: The present disclosure relates to means to enable reduction of memory access in motion vector determination and/or refinement for a prediction block. In particular, the present disclosure relates to means to enable reduction of memory access in motion vector determination and/or refinement performed on a sub prediction block basis. In other words, a prediction block is split into sub prediction blocks for which at least the motion vector refinement is performed individually. The memory access window which limits the samples accessible during the motion vector determination and refinement of the sub prediction blocks does not exceed the memory access window for performing the motion vector determination and/or refinement for the prediction block.
    Type: Grant
    Filed: April 9, 2020
    Date of Patent: February 8, 2022
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Semih Esenlik, Zhijie Zhao, Anand Meher Kotra, Han Gao
  • Patent number: 11228752
    Abstract: A display device may include a panel including a plurality of pixels and an optical layer. The display device may include a processor configured to generate an image of the panel based on a location relationship between the pixels and the optical elements so that a plurality of rays corresponding to the image propagate evenly at a viewing distance. The location relationship is based on an optical parameter of the optical layer.
    Type: Grant
    Filed: April 8, 2016
    Date of Patent: January 18, 2022
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Jinho Lee, Yang Ho Cho, Dong Kyung Nam, Juyong Park
  • Patent number: 11206423
    Abstract: A moving picture coding method including: determining whether or not (a) a picture including a co-located block and (b) a current picture to be coded are included in a same view, the co-located block being a block that is included in a picture different from the current picture and is at a position corresponding to a position of a current block to be coded included in the current picture; adjusting the position of the co-located block when the picture including the co-located block and the current picture are included in different views; and adding to the list an entry including a motion vector derived from the co-located block, wherein the adjusting includes: obtaining a disparity vector between the view including the picture including the co-located block and the view including the current picture; and adjusting the position of the co-located block by the obtained disparity vector.
    Type: Grant
    Filed: December 18, 2019
    Date of Patent: December 21, 2021
    Assignee: SUN PATENT TRUST
    Inventors: Toshiyasu Sugio, Takahiro Nishi, Youji Shibahara, Kyoko Tanikawa, Hisao Sasai, Toru Matsunobu, Kengo Terada
  • Patent number: 11180085
    Abstract: An exterior rearview device includes a base suited to be fixed to a vehicle, a head mounted on the base, at least one of a mirror and a display attached to the head and at least one of a camera and an illumination device attached to the base, a locking system with a locked state and an unlocked state, where the head is removable from the base in the unlocked state, and the locking system is suited to be actuated by a driver of the vehicle to switch between the locked and the unlocked state, and vice versa. A vehicle includes the at least one exterior rearview device.
    Type: Grant
    Filed: June 12, 2018
    Date of Patent: November 23, 2021
    Assignee: SMR Patents S.à.r.l.
    Inventor: Philipp Hottmann
  • Patent number: 11184643
    Abstract: A system and method for processing a video stream are provided. When coding or decoding a video stream a de-blocking filtering may be applied for reducing discontinuities caused by use of a block-based video coding. The de-blocking filtering is performed using a filter grid. The size of the filter grid is chosen adaptively based on the processing parameters. The adaptive size of the filtering grid is determined based on the number of samples used and modified in de-blocking filtering of an edge of a coding block. The filtering grid may be used both for vertical and horizontal edge filtering.
    Type: Grant
    Filed: August 5, 2019
    Date of Patent: November 23, 2021
    Assignee: Huawei Technologies Co., Ltd.
    Inventors: Anand Meher Kotra, Semih Esenlik, Zhijie Zhao
  • Patent number: 11166012
    Abstract: A three-dimensional data encoding method encodes a plurality of three-dimensional points, and includes: selecting one of two or more prediction modes for calculating a predicted value of an attribute information item of the first three-dimensional point, in accordance with attribute information items of one or more second three-dimensional points in the vicinity of a first three-dimensional point; calculating the predicted value by the selected prediction mode; calculating, as a prediction residual, a difference between a value of the attribute information item of the first three-dimensional point and the calculated predicted value; and generating a bit stream that includes the one prediction mode and the prediction residual.
    Type: Grant
    Filed: December 2, 2020
    Date of Patent: November 2, 2021
    Assignee: Panasonic Intellectual Property Corporation of America
    Inventor: Toshiyasu Sugio
  • Patent number: 11138713
    Abstract: A camera abnormality detecting device according to an embodiment includes an acquiring section and a notifying section. The acquiring section acquires, from an image photographed by a camera provided in a conveyance body to be capable of photographing an inside of a basket placed on a basket receiving section of the conveyance body, an image of a region where an upper edge of the basket is surmised to be reflected. The notifying section notifies, based on the image acquired by the acquiring section, whether an angle of view of the camera is blocked.
    Type: Grant
    Filed: July 25, 2019
    Date of Patent: October 5, 2021
    Assignee: TOSHIBA TEC KABUSHIKI KAISHA
    Inventor: Atsushi Okamura
  • Patent number: 11106938
    Abstract: An image processing apparatus generates a normal image, when lighting correction of an image is performed using three-dimensional shape data. Three-dimensional shape data of a predetermined object is adjusted with a subject in position, based on a feature pattern detected in image data, and lighting processing for correcting a pixel value of the image data is performed based on the adjusted three-dimensional shape data, distance information of the subject, and a position of a virtual light source. When the three-dimensional shape data is adjusted with the image data in position, a region having a large irregularity in the three-dimensional shape data is preferentially adjusted in position.
    Type: Grant
    Filed: April 12, 2019
    Date of Patent: August 31, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Yuichi Nakada, Shugo Higuchi
  • Patent number: 11089214
    Abstract: A system and method are provided for generating an output video, such as a video panorama, from a plurality of video streams representing different recordings of a scene. The plurality of video streams may be analyzed to identify at least one part of at least one of the plurality of video streams which is to be used in the output video, thereby identifying a contributing part of a video stream. Orchestration metadata may be generated identifying the contributing part. The orchestration metadata may be provided to a stream source from which the video stream originated to enable the stream source to selectively stream the contributing part of the video stream. Effectively, a selection of the stream's video data may be made to avoid or reduce unnecessary bandwidth usage.
    Type: Grant
    Filed: December 16, 2016
    Date of Patent: August 10, 2021
    Assignees: KONINKLIJKE KPN N.V., NEDERLANDSE ORGANISATIE VOOR TOEGEPAST-NATUURWETENSCHAPPELIJK ONDERZOEK TNO
    Inventors: Hans Maarten Stokking, Emmanuel Thomas, Omar Aziz Niamut, Martin Prins