Patents Examined by Neil R Mikeska
  • Patent number: 11743447
    Abstract: A gaze tracking system comprising a first camera operable to capture images of a user within an environment, a second camera, having a smaller field of view than the first camera, operable to capture images of at least one of the user's eyes, an eye identification unit operable to identify a location of at least one of the user's eyes from images captured by the first camera, a camera control unit operable to modify the position and/or orientation of the second camera in dependence upon the detected location of the at least one of the user's eyes, so as to cause the second camera to be able to capture images of at least one of the user's eyes, and a gaze direction identification unit operable to identify a gaze direction of the user from images captured by the second camera.
    Type: Grant
    Filed: June 7, 2021
    Date of Patent: August 29, 2023
    Assignee: sony Interactive Entertainment Inc.
    Inventors: Fabio Cappello, Maria Chiara Monti, Alexander Smith
  • Patent number: 11736679
    Abstract: A device for providing a reverse pass-through view of a user of a headset display to an onlooker includes an eyepiece comprising an optical surface configured to provide an image to a user on a first side of the optical surface. The device also includes a first camera configured to collect an image of a portion of a face of the user reflected from the optical surface in a first field of view, a display adjacent to the optical surface and configured to project forward an image of the face of the user, and a screen configured to receive light from the display and provide the image of the face of the user to an onlooker.
    Type: Grant
    Filed: August 6, 2021
    Date of Patent: August 22, 2023
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Nathan Matsuda, Brian Wheelwright, Joel Hegland
  • Patent number: 11729426
    Abstract: A previously encoded or reconstructed version of a neighborhood of a predetermined block to be predicted is exploited so as to result into a more efficient predictive coding of the prediction block. In particular, a spectral decomposition of a region composed of this neighborhood and a first version of a predicted filling of the predetermined block results into a first spectrum which is subject to noise reduction and the thus resulting second spectrum may be subject to a spectral composition, thereby resulting in a modified version of this region including a second version of the predicted filling of the predetermined block. Owing to the exploitation of the already processed, i.e. encoded/reconstructed, neighborhood of the predetermined block, the second version of the predicted filling of the predetermined block tends to improve the coding efficiency.
    Type: Grant
    Filed: September 2, 2021
    Date of Patent: August 15, 2023
    Assignee: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
    Inventors: Jonathan Pfaff, Martin Winken, Christian Rudat, Heiko Schwarz, Thomas Wiegand, Detlev Marpe
  • Patent number: 11716488
    Abstract: An example device includes a memory and one or more processors implemented in circuitry and communicatively coupled to the memory. The one or more processors are configured to determine a value of a first syntax element indicative of a number of subpictures in a picture of video data. The one or more processors are configured to determine, for each subpicture among the subpictures in the picture, a value of a respective second syntax element indicative of an identification of a respective subpicture. The one or more processors are also configured to code the respective subpicture identified by the respective second syntax element.
    Type: Grant
    Filed: September 16, 2020
    Date of Patent: August 1, 2023
    Assignee: QUALCOMM INCORPORATED
    Inventors: Yao-Jen Chang, Vadim Seregin, Muhammed Zeyd Coban, Marta Karczewicz
  • Patent number: 11711513
    Abstract: Video processing methods and apparatuses include receiving input video data associated with a current picture composed of multiple Coding Tree Units (CTUs) for encoding or decoding, determining a number of subpictures, partitioning the current picture into one or more subpictures, and encoding or decoding each subpicture in the current picture. Each subpicture contains multiple complete CTUs and boundaries of each subpicture are aligned with grids of the current picture in units of CTUs. The number of subpictures in the current picture is limited by an allowed maximum number of slices.
    Type: Grant
    Filed: June 10, 2021
    Date of Patent: July 25, 2023
    Assignee: HFI INNOVATION INC.
    Inventor: Shih-Ta Hsiang
  • Patent number: 11706404
    Abstract: An apparatus to facilitate encoding video data is disclosed. The apparatus includes rendering logic to render graphics video data as frame data, fade extractor logic to extract fade effects data to be applied to the frame data to generate frame auxiliary metadata comprising the fade effects data, weighted prediction logic to receive the frame data and the auxiliary metadata and compute one or more weighted predictions on the frame data at one or more frame sequences indicated in the fade effects data and encoding logic to encode the frame data based on the one or more weighted predictions.
    Type: Grant
    Filed: April 28, 2018
    Date of Patent: July 18, 2023
    Assignee: INTEL CORPORATON
    Inventors: Junhua Hou, Zhihong Yu, Yesheng Xu, Hongbo Lv, Jiangming Wu
  • Patent number: 11695954
    Abstract: A method for signalling an intra chroma prediction mode and a method for implementing the signalled intra chroma prediction mode, the intra chroma prediction mode taking an intropolation of previously predicted luma samples from neighboring blocks of video data to attain an intra chroma prediction of a current chroma prediction unit.
    Type: Grant
    Filed: November 3, 2021
    Date of Patent: July 4, 2023
    Assignee: LG Electronics Inc.
    Inventors: Jungsun Kim, Seungwook Park, Jaehyun Lim, Joonyoung Park, Younghee Choi, Jaewon Sung, Byeongmoon Jeon, Yongjoon Jeon
  • Patent number: 11689739
    Abstract: An encoder includes memory and circuitry configured to determine a merge mode to be applied to a current block, wherein the merge mode includes a sub-block merge mode and a first merge mode. In the merge mode, inter-prediction parameters are inferred from a neighboring block neighboring the current block. In the sub-block merge mode, the current block includes a plurality of sub-blocks, and inter-prediction parameters are provided for each of the plurality of sub-blocks. When the merge mode is determined to be the first merge mode, the circuitry generates a prediction image for the current block by performing a bi-directional optical flow prediction process, wherein the bi-directional optical flow prediction process uses a spatial gradient for the current block. When the merge mode is determined to be the sub-block merge mode, the circuitry generates a prediction image for the current block by not performing the bi-directional optical flow prediction process.
    Type: Grant
    Filed: July 29, 2021
    Date of Patent: June 27, 2023
    Assignee: Panasonic Intellectual Property Corporation of America
    Inventors: Tadamasa Toma, Takahiro Nishi, Kiyofumi Abe, Ryuichi Kanoh
  • Patent number: 11689724
    Abstract: A method of deriving prediction sample values for decoding video data by a device is provided. A reference wraparound offset syntax specifying an offset used for computing a horizontal wrap-around position is decoded. A luma location is derived based on a product of a value of the reference wraparound offset syntax and a minimum coding block size. A predicted luma sample value is derived by using the luma location.
    Type: Grant
    Filed: October 29, 2019
    Date of Patent: June 27, 2023
    Assignees: SHARP KABUSHIKI KAISHA, FG Innovation Company Limited
    Inventor: Sachin G. Deshpande
  • Patent number: 11677977
    Abstract: Disclosed are an intra prediction method of a chrominance block using a luminance sample and an apparatus using the same. An image decoding method comprises the steps of: calculating an intra prediction mode of a chrominance block on the basis of an LM mapping table when the chrominance block uses an LM; and generating a prediction block for the chrominance block on the basis of the calculated intra prediction mode of the chrominance block. When intra prediction mode information of chrominance blocks are decoded, mutually different tables are used depending on whether or not an LM is used, so that encoding and decoding can be performed without an unnecessary waste of bits.
    Type: Grant
    Filed: October 20, 2021
    Date of Patent: June 13, 2023
    Assignee: LG Electronics Inc.
    Inventors: Yong Joon Jeon, Seung Wook Park, Jae Hyun Lim, Jung Sun Kim, Joon Young Park, Young Hee Choi, Jae Won Sung, Byeong Moon Jeon
  • Patent number: 11671626
    Abstract: An image decoding apparatus including a header decoder configured to decode, from coded data, a flag indicating whether dependent quantization is enabled and a flag prohibiting transform skip residual quantization, and a TU decoder configured to decode a transform coefficient in a TU block in an RRC mode in which a LAST position is coded, the LAST position corresponding to a decoding start position for the transform coefficient, or a TSRC mode in which the LAST position is not coded. The TU decoder performs dependent quantization in the RRC mode in a case that the transform coefficient for transform skip is decoded in the TSRC mode, and does not perform dependent quantization in the RRC mode in a case that the transform coefficient for transform skip is decoded in the RRC mode.
    Type: Grant
    Filed: March 31, 2022
    Date of Patent: June 6, 2023
    Assignee: SHARP KABUSHIKI KAISHA
    Inventors: Tomonori Hashimoto, Eiichi Sasaki, Tomohiro Ikai, Tomoko Aono
  • Patent number: 11671605
    Abstract: An image encoding method includes: determining respective decoding times of a plurality of pictures included in a motion picture such that decoding times of a plurality of lower layer picture which do not belong to a highest layer of a plurality of layers are spaced at regular intervals, and decoding timing for each of the plurality of lower layer pictures is identical between a case where the plurality of encoded pictures included in the motion picture are decoded and a case where only the plurality of lower layer pictures are decoded, encoding each of the plurality of pictures included in the motion picture in accordance with the encoding order according to the determined respective decoding times, and generating an encoded stream including the plurality of encoded pictures and the determined respective decoding times for the plurality of pictures.
    Type: Grant
    Filed: October 5, 2021
    Date of Patent: June 6, 2023
    Assignee: PANASONIC HOLDINGS CORPORATION
    Inventors: Tadamasa Toma, Takahiro Nishi, Kengo Terada
  • Patent number: 11659196
    Abstract: Methods and systems for improving coding efficiency of video.
    Type: Grant
    Filed: June 4, 2021
    Date of Patent: May 23, 2023
    Assignee: DOLBY INTERNATIONAL AB
    Inventors: Yeping Su, Christopher A. Segall
  • Patent number: 11652984
    Abstract: An example device for coding (encoding or decoding) video data includes a memory configured to store video data; and one or more processors implemented in circuitry and configured to: determine a first number of neighboring blocks to a current block of the video data that are intra-predicted; determine a second number of the neighboring blocks that are inter-predicted; determine a first weight value to be applied to intra-prediction samples of an intra-prediction block for the current block; determine a second weight value to be applied to inter-prediction samples of an inter-prediction block for the current block; generate a prediction block for the current block as a weighted combination of the intra-prediction block to which the first weight value is applied and the inter-prediction block to which the second weight value is applied; and code the current block using the prediction block.
    Type: Grant
    Filed: November 14, 2019
    Date of Patent: May 16, 2023
    Assignee: QUALCOMM INCORPORATED
    Inventors: Geert Van der Auwera, Luong Pham Van, Adarsh Krishnan Ramasubramonian, Marta Karczewicz
  • Patent number: 11650045
    Abstract: Disclosed is a 3D scanner for recording the 3D topography of an object, the 3D scanner including: a projector unit configured for projecting a structured beam of probe light onto the object; an imaging unit arranged to acquire 2D images of the object when the object is illuminated by the structured probe light beam; and an actuator unit arranged to control the position of the structured probe light beam at the object by rotating a movable portion of the projector unit around a pivoting axis, the actuator unit including a rotation motor including or arranged to drive a wheel, where the surface of the wheel operatively coupled to the movable portion of the projector unit has a radial distance from the axis of the rotation motor which changes with the rotation.
    Type: Grant
    Filed: June 23, 2017
    Date of Patent: May 16, 2023
    Assignee: 3SHAPE A/S
    Inventors: Rasmus Kjaer, Thomas Allin Højgaard, Herman Scherling
  • Patent number: 11641466
    Abstract: The present disclosure relates to methods and devices to be employed for encoding and decoding of image or video signal. They include determination of whether or not the size of a current block is larger than a minimum allowed quadtree leaf node size. If the size of the current block is not larger than the minimum allowed quadtree leaf node size, multi-type tree splitting is applied to the current block. The minimum allowed quadtree leaf node size is not larger than a maximum allowed binary tree root node size or the minimum allowed quadtree leaf node size is not larger than a maximum allowed ternary tree root node size.
    Type: Grant
    Filed: March 2, 2021
    Date of Patent: May 2, 2023
    Assignee: HUAWEI TECHNOLOGIES CO., LTD.
    Inventors: Han Gao, Semih Esenlik, Jianle Chen, Zhijie Zhao, Anand Meher Kotra, Biao Wang
  • Patent number: 11632557
    Abstract: A method for decoding a video performed by a decoding device according to the present document comprises: a step for receiving residual information for a current block; a step for parsing one sign flag for a current sub-block of the current block, wherein the one sign flag indicates whether all signs of non-zero residual coefficients of the current sub-block are the same; a step for deriving the non-zero residual coefficients on the basis of sign information for the non-zero residual coefficients when the value of the one sign flag is 1; a step for deriving residual samples on the basis of the non-zero residual coefficients; and a step for restoring a current picture on the basis of the residual samples.
    Type: Grant
    Filed: December 31, 2019
    Date of Patent: April 18, 2023
    Assignee: LG ELECTRONICS INC.
    Inventors: Sunmi Yoo, Jin Heo, Ling Li, Jangwon Choi, Jungah Choi, Seunghwan Kim, Junghak Nam
  • Patent number: 11616979
    Abstract: Video/picture coding of improved coding efficiency with supporting varying resolution and/or efficiently handling region-wise packing.
    Type: Grant
    Filed: August 11, 2020
    Date of Patent: March 28, 2023
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Robert Skupin, Cornelius Hellge, Valeri George, Thomas Schierl, Yago Sánchez De La Fuente, Karsten Sühring, Thomas Wiegand
  • Patent number: 11606569
    Abstract: Support for additional components may be specified in a coding scheme for image data. A layer of a coding scheme that specifies color components may also specify additional components. Characteristics of the components may be specified in the same layer or a different layer of the coding scheme. An encoder or decoder may identify the specified components and determine the respective characteristics to perform encoding and decoding of image data.
    Type: Grant
    Filed: September 25, 2019
    Date of Patent: March 14, 2023
    Assignee: Apple Inc.
    Inventors: Alexandros Tourapis, Yeping Su, Khaled Mammou, Jungsun Kim, David W. Singer, Fabrice A. Robinet, Guy Cote, Jim C. Chou, Hsi-Jung Wu
  • Patent number: 11601607
    Abstract: An electronic device includes one or more processors and memory storing instructions for execution by the one or more processors. The stored instructions include instructions for: receiving infrared image information for a three-dimensional area; receiving non-infrared image information for the same three-dimensional area; performing nonlinear intensity adjustment for the received infrared image information; performing nonlinear intensity adjustment for the received non-infrared image information; blending the intensity-adjusted infrared image information and the intensity-adjusted non-infrared image information to obtain a merged image information; and providing the merged image information for determining a depth map. Also disclosed are a corresponding method performed by the electronic device and a computer readable storage medium storing instructions for execution by one or more processors of an electronic device.
    Type: Grant
    Filed: October 13, 2020
    Date of Patent: March 7, 2023
    Assignee: META PLATFORMS TECHNOLOGIES, LLC
    Inventors: Rajesh Lachhmandas Chhabria, Shuochen Su, Monica Stewart, David Vakrat, Shengqiong Xie, Michael Hall