Patents by Inventor Fnu Hendry

Fnu Hendry has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10582201
    Abstract: A device for determining information for video data includes one or more processors implemented in circuitry that are configured to determine one or more most-interested regions of a plurality of regions of an image of video data based on data representative of the one or more most-interested regions. The data representative of the one or more most-interested regions is external to video coding layer (VCL) data of a bitstream including the video data. The processors output a request for relatively high-quality video data for the one or more most-interested regions of the image and output, after outputting the request for the relatively high-quality video data, a request for relatively low-quality video data for one or more other regions of the image.
    Type: Grant
    Filed: May 8, 2017
    Date of Patent: March 3, 2020
    Assignee: Qualcomm Incorporated
    Inventors: Ye-Kui Wang, Fnu Hendry
  • Patent number: 10565463
    Abstract: A device for determining information for video data includes one or more processors implemented in circuitry that are configured to determine one or more most-interested regions of a plurality of regions of an image of video data from data representative of the one or more most-interested regions. The one or more processors are further configured to generate a request specifying the one or more most-interested regions using the data representative of the one or more most-interested regions and output the request to a server device.
    Type: Grant
    Filed: May 10, 2017
    Date of Patent: February 18, 2020
    Assignee: Qualcomm Incorporated
    Inventors: Ye-Kui Wang, Fnu Hendry
  • Patent number: 10560710
    Abstract: Methods for coding recovery point supplemental enhancement information (SEI) messages and region refresh SEI messages in multi-layer coding are disclosed. In one aspect, the method may include determining at least one picture among a plurality of pictures included within an access unit with which to associate at least one recovery point SEI message, the access unit being included within the multi-layer bitstream. The method may further include associating the at least one recovery point SEI message with the determined at least one picture. The method may also include coding the video information based at least in part on the association of the at least one recovery point SEI message with the determined at least one picture.
    Type: Grant
    Filed: December 29, 2014
    Date of Patent: February 11, 2020
    Assignee: Qualcomm Incorporated
    Inventors: Fnu Hendry, Ye-Kui Wang, Adarsh Krishnan Ramasubramonian
  • Patent number: 10542261
    Abstract: Techniques and systems are provided for decoding video data. For example, a method of decoding video data includes receiving, by a decoding device, an encoded video bitstream generated according to a first coding protocol, and determining that a base layer is to be provided to the decoding device as part of an external bitstream that is different from the received encoded video bitstream. The external bitstream is provided to the decoding device by an external source and is not provided as part of the encoded video bitstream. The base layer is encoded using a second coding protocol that is different from the first coding protocol. The method further includes determining to ignore a profile, tier, and level syntax structure assigned to the base layer in the video parameter set in response to determining the base layer is to be provided to the decoding device as part of an external bitstream.
    Type: Grant
    Filed: January 30, 2018
    Date of Patent: January 21, 2020
    Assignee: QUALCOMM Incorporated
    Inventors: Ye-Kui Wang, Fnu Hendry, Adarsh Krishnan Ramasubramonian
  • Patent number: 10419768
    Abstract: A device generates a Network Abstraction Layer (NAL) Unit Map Entry box in a file. The NAL Unit Map Entry box associates NAL units with a tile set that includes two or more tiles of a plurality of tiles into which a current picture is partitioned. A region of the current picture covered by the tile set may be non-rectangular. Additionally, the device generates a tile set group entry in the file. The tile set group entry includes a horizontal offset, a vertical offset, a width, and a height. The horizontal offset specifies a horizontal offset of a top-left pixel of a minimum rectangular region that covers tiles in the tile set. The vertical offset specifies a vertical offset of the top-left pixel of the minimum rectangular region. The width specifies a width of the minimum rectangular region. The height specifies a height of the minimum rectangular region.
    Type: Grant
    Filed: March 27, 2017
    Date of Patent: September 17, 2019
    Assignee: QUALCOMM Incorporated
    Inventors: Fnu Hendry, Ye-Kui Wang
  • Patent number: 10404990
    Abstract: An apparatus for coding video information according to certain aspects includes a memory and a processor configured to: determine a value of a first flag indicative of whether preceding pictures that precede a current picture in a current layer in decoding order are used for temporal motion vector prediction (TMVP) of subsequent pictures that follow the current picture in the current layer in decoding order, the first flag associated with the current picture; and refrain from using the preceding pictures in the current layer as reference pictures for TMVP of the current picture, in response to determining that the value of the first flag indicates that the preceding pictures in the current layer should not be used for TMVP of the subsequent pictures in the current layer.
    Type: Grant
    Filed: January 30, 2018
    Date of Patent: September 3, 2019
    Assignee: Qualcomm Incorporated
    Inventors: Fnu Hendry, Adarsh Krishnan Ramasubramonian, Ye-Kui Wang
  • Patent number: 10389999
    Abstract: In various implementations, modifications and/or additions to the ISOBMFF can indicate that a file that has been formatted according to the ISOBMFF, or a format derived from the ISOBMFF, includes virtual reality content. The file can include a restricted scheme information box, written into a track box in the file. The restricted scheme information box can indicate a virtual reality scheme for the contents of the track. For example, the restricted scheme information box can include a scheme type box, where the type indicates a virtual reality scheme. As a further example, the restricted scheme information box can include a scheme information box that can provide parameters relating to the virtual reality scheme.
    Type: Grant
    Filed: February 14, 2017
    Date of Patent: August 20, 2019
    Assignee: Qualcomm Incorporated
    Inventors: Ye-Kui Wang, Fnu Hendry, Marta Karczewicz
  • Patent number: 10390087
    Abstract: A video processing device is configured to obtain, from a bitstream, one or more syntax elements indicating one or more partitioning schemes for an output layer set. For each respective partitioning scheme of the one or more partitioning schemes, the respective partitioning scheme specifies a division of the output layer set into one or more partitions. Each layer in the output layer set belongs to exactly one partition in the respective partitioning scheme. Additionally, the video processing device obtains, from a Supplemental Enhancement Information (SEI) message or video usability information (VUI) in a video parameter set (VPS), hypothetical reference decoder (HRD) parameters for each of the one or more partitioning schemes. For each respective partition of the respective partitioning scheme, the video processing device tests, based on the HRD parameters for the respective partitioning scheme, the respective partition for conformance to a video coding standard.
    Type: Grant
    Filed: April 30, 2015
    Date of Patent: August 20, 2019
    Assignee: Qualcomm Incorporated
    Inventors: Adarsh Krishnan Ramasubramonian, Ye-Kui Wang, Fnu Hendry, Krishnakanth Rapaka
  • Publication number: 20190253733
    Abstract: This disclosure describes techniques for signaling 360-degree video information in syntax structures. As one example, this disclosure describes examples for signaling projection types and related information for 360-degree video in syntax structures that include one or more syntax elements. In some examples, the same syntax structures may include non-360-degree video information as well. Accordingly, the syntax structure may be used for encoding and decoding a bitstream carrying only non-360-degree video data, only 360-degree video data, or both non-360-degree video data and 360-degree video data.
    Type: Application
    Filed: February 13, 2019
    Publication date: August 15, 2019
    Inventors: Fnu Hendry, Muhammed Zeyd Coban, Geert Van der Auwera, Marta Karczewicz
  • Publication number: 20190253622
    Abstract: An example method includes, receiving an encoded picture of 360-degree video data, the encoded picture of 360-degree video data being arranged in packed faces obtained from a projection of a sphere of the 360-degree video data; decoding the picture of encoded 360-degree video data to obtain a reconstructed picture of 360-degree video data, the reconstructed picture of 360-degree video data being arranged in the packed faces; padding the reconstructed picture of 360-degree video data to generate a padded reconstructed picture of 360-degree video data; in-loop filtering the padded reconstructed picture of 360-degree video data to generate a padded and filtered reconstructed picture of 360-degree video data; and storing the padded and filtered reconstructed picture of 360-degree video data in a reference picture memory for use in predicting subsequent pictures of 360-degree video data.
    Type: Application
    Filed: February 7, 2019
    Publication date: August 15, 2019
    Inventors: Geert Van der Auwera, Muhammed Zeyd Coban, Fnu Hendry, Marta Karczewicz
  • Publication number: 20190253732
    Abstract: A video coder may determine reference samples based on a location of a current block of a current picture of the 360-degree video data and a packing arrangement that defines an arrangement of a plurality of regions in the current picture. The current picture is in a projected domain and each respective region of the plurality of regions is a respective face defined by a projection of 360-degree video data. The regions are arranged in the current picture according to the packing arrangement. Based on the location of the current block being at a border of the first region that is adjacent to the second region and there being a discontinuity at the border due to the packing arrangement, the reference samples are samples of the current picture that spatially neighbor the current block in a spherical domain and not in the projected domain.
    Type: Application
    Filed: February 8, 2019
    Publication date: August 15, 2019
    Inventors: Fnu Hendry, Geert Van der Auwera, Muhammed Zeyd Coban, Marta Karczewicz
  • Publication number: 20190253703
    Abstract: A device for decoding 360-degree video data is configured to store a decoded picture of 360-degree video as a reference frame; derive an extended reference frame from the stored reference frame based on a padding amount by extending a first cube face in the reference frame; inter-predict a block of a current picture from a block of the extended reference frame by determining a motion vector for the block of the current picture; in response to a determination that the motion vector points to a cube face in the extended reference frame other than the first cube face, clipping the motion vector such that the motion vector points to a location in the first cube face; and locating a prediction block for a current block using the clipped motion vector.
    Type: Application
    Filed: February 13, 2019
    Publication date: August 15, 2019
    Inventors: Muhammed Zeyd Coban, Geert Van der Auwera, Fnu Hendry, Marta Karczewicz
  • Patent number: 10356415
    Abstract: Techniques and systems are provided for encoding video data. For example, a method of encoding video data includes generating an encoded video bitstream including multiple layers. The encoded video bitstream includes one or more sequence parameter sets and a video parameter set. The method further includes generating, according to a constraint, one or more representation format parameters for a sequence parameter set assigned to a base layer of the encoded video bitstream. The constraint limits values of the one or more representation format parameters in the sequence parameter set to be less than or equal to values of corresponding representation format parameters that are assigned to the base layer in the video parameter set.
    Type: Grant
    Filed: June 17, 2015
    Date of Patent: July 16, 2019
    Assignee: QUALCOMM Incorporated
    Inventors: Ye-Kui Wang, Fnu Hendry, Adarsh Krishnan Ramasubramonian
  • Patent number: 10349067
    Abstract: In various implementations, techniques are described herein to resolve issues related to the location of an EOB NAL unit in an ISO base media file. In various implementations, these techniques include relaxing the requirement that a file include only one EOB NAL unit. These techniques further include providing the EOB NAL unit from the highest layer when reconstructing the bitstream. This EOB NAL unit can be added to a last access unit in the reconstructed bitstream. When the EOB NAL unit from the highest layer is not present, an EOB NAL unit from a lower layer can be provided instead.
    Type: Grant
    Filed: February 14, 2017
    Date of Patent: July 9, 2019
    Assignee: Qualcomm Incorporated
    Inventors: Fnu Hendry, Ye-Kui Wang
  • Patent number: 10306253
    Abstract: A device generates, stores, or obtains a file that complies with a restriction specified in a file format to which the file conforms. The restriction requires that for each respective Intra Random Access Point (IRAP) picture, a parameter set required for decoding the respective IRAP picture is in at least one of the following: a sample entry of the respective IRAP picture's track that is applicable to the respective IRAP picture's sample, a sample entry of a non-corresponding track for the respective IRAP picture carrying a reference layer of the respective IRAP picture's layer, the respective IRAP picture's sample, or a temporally collocated sample of the respective IRAP picture's sample in a track of that carries the reference layer.
    Type: Grant
    Filed: September 23, 2016
    Date of Patent: May 28, 2019
    Assignee: QUALCOMM Incorporated
    Inventors: Ye-Kui Wang, Fnu Hendry
  • Patent number: 10306269
    Abstract: A device for processing a bitstream including video data, such as a demultiplexer, extracts a descriptor from the bitstream, wherein the bitstream includes layers of video data for operation points, separate from the descriptor, such that each operation point includes one or more of the layers of video data, and wherein the descriptor includes a set of profile, tier, and level (PTL) structures and data that associates each of the layers of each of the operation points with a corresponding one of the PTL structures, extracts video data for one of the operation points from the bitstream based at least in part on the PTL structures to which the layers of the one of the operation points correspond, and provides the extracted video data to a video decoder.
    Type: Grant
    Filed: October 8, 2015
    Date of Patent: May 28, 2019
    Assignee: Qualcomm Incorporated
    Inventors: Fnu Hendry, Ying Chen, Ye-Kui Wang
  • Patent number: 10298938
    Abstract: A video device for processing multi-layer video data includes a data storage medium configured to store the multi-layer video data and one or more processors configured to obtain the multi-layer video data; store the multi-layer video data in a file format; store representation format information for each operation point of the multi-layer video data in an operation points information (oinf) box for the file format; and generate a file of video data formatted according to the file format.
    Type: Grant
    Filed: November 7, 2018
    Date of Patent: May 21, 2019
    Assignee: QUALCOMM Incorporated
    Inventors: Fnu Hendry, Ye-Kui Wang
  • Patent number: 10291923
    Abstract: A computing device receive a bitstream comprising a plurality of coded slice NAL units encapsulating RBSPs for respective slice segments of a slice of a picture. The slice segments including an independent slice segment and one or more dependent slice segments. The picture is partitioned into a plurality of tiles, including a first tile and a second tile. The slice segments include one or more slice segments that contain CTUs of the first tile and one or more slice segments that contain CTUs of the second tile. The computing device generates a file storing the bitstream. As part of generating the file, the computing device defines a tile region in the file. The tile region comprises an integer number of tiles forming a rectangular region encoded in one or more of the slice segments. The rectangular tile region includes the first tile and not the second tile.
    Type: Grant
    Filed: May 23, 2017
    Date of Patent: May 14, 2019
    Assignee: QUALCOMM Incorporated
    Inventors: Fnu Hendry, Ye-Kui Wang
  • Patent number: 10250884
    Abstract: Techniques and systems are provided for encoding and decoding video data. For example, a method of decoding video data includes obtaining an encoded video bitstream comprising one or more layer sets and one or more additional layer sets. The encoded video bitstream includes a video parameter set defining parameters of the encoded video bitstream. The one or more layer sets are defined in a base part of the video parameter set, and the one or more additional layer sets are defined in an extension part of the video parameter set. The method further includes decoding one or more syntax elements from the video parameter set. The one or more syntax elements include rate information for the one or more layer sets defined in the base part of the video parameter set and for the one or more additional layer sets defined in the extension part of the video parameter set.
    Type: Grant
    Filed: June 18, 2015
    Date of Patent: April 2, 2019
    Assignee: QUALCOMM Incorporated
    Inventors: Ye-Kui Wang, Fnu Hendry, Adarsh Krishnan Ramasubramonian
  • Patent number: 10244242
    Abstract: A device for processing video data includes a memory configured to store at least a portion of a multi-layer bitstream of video data; and one or more processors configured to receive the portion of the multi-layer bitstream, the multi-layer bitstream comprising a plurality of layers, the plurality of layers comprising a non-independently decodable non-base layer (non-INBL) and an independently decodable non-base layer (INBL); receive a video parameter set (VPS) associated with the coded video data, the VPS comprising first representation format parameters; receive a sequence parameter set (SPS) associated with the INBL, the SPS comprising second representation format parameters; process the non-INBL based on the first representation format parameters; and process the INBL based on the second representation format parameters.
    Type: Grant
    Filed: June 24, 2015
    Date of Patent: March 26, 2019
    Assignee: QUALCOMM Incorporated
    Inventors: Ye-Kui Wang, Fnu Hendry, Adarsh Krishnan Ramasubramonian