Patents by Inventor Yaming He

Yaming He has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11546596
    Abstract: Embodiments are described for dynamically adapting video encoding to maintain a nearly stable frame rate based on processor capabilities and bandwidth, for example, by varying a quantization parameter. The quality of the encoded video can be varied to maintain the nearly constant frame rate, which may be measured from the number of encoded video frames being transmitted over a network interface.
    Type: Grant
    Filed: December 20, 2019
    Date of Patent: January 3, 2023
    Assignee: Meta Platforms, Inc.
    Inventors: Yaming He, Zhengping Zuo
  • Patent number: 11190570
    Abstract: A video encoder may be put in a starve mode during a low latency operation in which the video encoder may be operated in a mode that allows video frames to be encoded without any interdependencies such as motion compensation. At least one encoding parameter of the video encoding is selected such that, for each resulting encoded video frame, the video frame fits in exactly one application layer packet.
    Type: Grant
    Filed: August 20, 2020
    Date of Patent: November 30, 2021
    Assignee: Facebook, Inc.
    Inventors: Yaming He, Zhengping Zuo
  • Publication number: 20200382575
    Abstract: A video encoder may be put in a starve mode during a low latency operation in which the video encoder may be operated in a mode that allows video frames to be encoded without any interdependencies such as motion compensation. At least one encoding parameter of the video encoding is selected such that, for each resulting encoded video frame, the video frame fits in exactly one application layer packet.
    Type: Application
    Filed: August 20, 2020
    Publication date: December 3, 2020
    Inventors: Yaming He, Zhengping Zuo
  • Patent number: 10785279
    Abstract: A video encoder may be put in a starve mode during a low latency operation in which the video encoder may be operated in a mode that allows video frames to be encoded without any interdependencies such as motion compensation. At least one encoding parameter of the video encoding is selected such that, for each resulting encoded video frame, the video frame fits in exactly one application layer packet.
    Type: Grant
    Filed: December 29, 2016
    Date of Patent: September 22, 2020
    Assignee: Facebook, Inc.
    Inventors: Yaming He, Zhengping Zuo
  • Publication number: 20200128246
    Abstract: Embodiments are described for dynamically adapting video encoding to maintain a nearly stable frame rate based on processor capabilities and bandwidth, for example, by varying a quantization parameter. The quality of the encoded video can be varied to maintain the nearly constant frame rate, which may be measured from the number of encoded video frames being transmitted over a network interface.
    Type: Application
    Filed: December 20, 2019
    Publication date: April 23, 2020
    Inventors: Yaming He, Zhengping Zuo
  • Patent number: 10587669
    Abstract: In one embodiment, a method includes receiving multimedia content information associated with at least one segment of a multimedia content, receiving a request to view the at least one segment of the multimedia content from a client device, logging playback information associated with the viewing of the at least one segment of the multimedia content, determining a multimedia quality metric associated with the at least one segment of multimedia content based in part upon a portion of the received multimedia content information and a portion of the logged playback information, and classifying the at least one segment of the multimedia content with the multimedia quality metric.
    Type: Grant
    Filed: December 20, 2017
    Date of Patent: March 10, 2020
    Assignee: Facebook, Inc.
    Inventors: Minchuan Chen, Shankar Lakshmi Regunathan, Sonal Gandhi, Yaming He, Amit Puntambekar, Michael Hamilton Coward
  • Patent number: 10523939
    Abstract: Embodiments are described for dynamically adapting video encoding to maintain a nearly stable frame rate based on processor capabilities and bandwidth, for example, by varying a quantization parameter. The quality of the encoded video can be varied to maintain the nearly constant frame rate, which may be measured from the number of encoded video frames being transmitted over a network interface.
    Type: Grant
    Filed: June 8, 2016
    Date of Patent: December 31, 2019
    Assignee: Facebook, Inc.
    Inventors: Yaming He, Zhengping Zuo
  • Publication number: 20190190976
    Abstract: In one embodiment, a method includes receiving multimedia content information associated with at least one segment of a multimedia content, receiving a request to view the at least one segment of the multimedia content from a client device, logging playback information associated with the viewing of the at least one segment of the multimedia content, determining a multimedia quality metric associated with the at least one segment of multimedia content based in part upon a portion of the received multimedia content information and a portion of the logged playback information, and classifying the at least one segment of the multimedia content with the multimedia quality metric.
    Type: Application
    Filed: December 20, 2017
    Publication date: June 20, 2019
    Inventors: Minchuan Chen, Shankar Lakshmi Regunathan, Sonal Gandhi, Yaming He, Amit Puntambekar, Michael Hamilton Coward
  • Publication number: 20180192061
    Abstract: A video encoder may be put in a starve mode during a low latency operation in which the video encoder may be operated in a mode that allows video frames to be encoded without any interdependencies such as motion compensation. At least one encoding parameter of the video encoding is selected such that, for each resulting encoded video frame, the video frame fits in exactly one application layer packet.
    Type: Application
    Filed: December 29, 2016
    Publication date: July 5, 2018
    Inventors: Yaming He, Zhengping Zuo
  • Publication number: 20170195672
    Abstract: Embodiments are described for dynamically adapting video encoding to maintain a nearly stable frame rate based on processor capabilities and bandwidth, for example, by varying a quantization parameter. The quality of the encoded video can be varied to maintain the nearly constant frame rate, which may be measured from the number of encoded video frames being transmitted over a network interface.
    Type: Application
    Filed: June 8, 2016
    Publication date: July 6, 2017
    Inventors: Yaming He, Zhengping Zuo
  • Patent number: 9161034
    Abstract: Decoding tasks are identified for decoding encoded video. Decoding tasks may include entropy decoding tasks, motion compensation tasks, inverse frequency transform tasks, inverse quantization tasks, intra decoding tasks, loop filtering tasks, or other tasks. Task dependencies are identified for the video decoding tasks. For example, one or more decoding tasks may depend on prior completion of entropy decoding tasks. The decoding tasks are prioritized based at least in part on the task dependencies. For example, a higher priority may be assigned to tasks that must be completed before other tasks that depend on them can begin. Prioritized decoding tasks are selected to be performed by hardware threads. For example, a first hardware thread may perform a first decoding task that does not depend on any uncompleted tasks while a second hardware thread performs a second decoding task that does not depend on any uncompleted tasks.
    Type: Grant
    Filed: April 30, 2014
    Date of Patent: October 13, 2015
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Weidong Zhao, Yaming He
  • Publication number: 20140233652
    Abstract: Decoding tasks are identified for decoding encoded video. Decoding tasks may include entropy decoding tasks, motion compensation tasks, inverse frequency transform tasks, inverse quantization tasks, intra decoding tasks, loop filtering tasks, or other tasks. Task dependencies are identified for the video decoding tasks. For example, one or more decoding tasks may depend on prior completion of entropy decoding tasks. The decoding tasks are prioritized based at least in part on the task dependencies. For example, a higher priority may be assigned to tasks that must be completed before other tasks that depend on them can begin. Prioritized decoding tasks are selected to be performed by hardware threads. For example, a first hardware thread may perform a first decoding task that does not depend on any uncompleted tasks while a second hardware thread performs a second decoding task that does not depend on any uncompleted tasks.
    Type: Application
    Filed: April 30, 2014
    Publication date: August 21, 2014
    Applicant: Microsoft Corporation
    Inventors: Weidong Zhao, Yaming He
  • Patent number: 8743948
    Abstract: Decoding tasks are identified for decoding encoded video. Decoding tasks may include entropy decoding tasks, motion compensation tasks, inverse frequency transform tasks, inverse quantization tasks, intra decoding tasks, loop filtering tasks, or other tasks. Task dependencies are identified for the video decoding tasks. For example, one or more decoding tasks may depend on prior completion of entropy decoding tasks. The decoding tasks are prioritized based at least in part on the task dependencies. For example, a higher priority may be assigned to tasks that must be completed before other tasks that depend on them can begin. Prioritized decoding tasks are selected to be performed by hardware threads. For example, a first hardware thread may perform a first decoding task that does not depend on any uncompleted tasks while a second hardware thread performs a second decoding task that does not depend on any uncompleted tasks.
    Type: Grant
    Filed: March 21, 2013
    Date of Patent: June 3, 2014
    Assignee: Microsoft Corporation
    Inventors: Weidong Zhao, Yaming He
  • Patent number: 8705616
    Abstract: A multiple bitrate (MBR) video encoding management tool utilizes available processing units for parallel MBR video encoding. Instead of focusing only on multi-threading of encoding tasks for a single picture or group of pictures (GOP), the management tool parallelizes the encoding of multiple GOPs between different processing units and/or different computing systems. With this parallel MBR video encoding architecture, different GOPs can be encoded in parallel. To facilitate such parallel encoding, data dependencies between GOPs are removed. The management tool can adjust the number of GOPs to encode in parallel on a computing system so as to favor parallelism of encoding for different GOPs at the expense of parallelism of encoding inside a GOP, or vice versa, and thereby set a suitable balance between encoding latency and throughput.
    Type: Grant
    Filed: June 11, 2010
    Date of Patent: April 22, 2014
    Assignee: Microsoft Corporation
    Inventors: Yaming He, Florin Folta, Chun-Wei Chan, Stacey Spears, Chuang Gu
  • Patent number: 8588534
    Abstract: Various examples are disclosed herein that relate to staged element classification. For example, one disclosed example provides a method of classifying elements by forming elements for classification into a plurality of first-level sets in a first stage, generating primary groups within the first-level sets based on element similarity, forming a plurality of second-level sets from the first-level sets in a second stage, generating secondary groups within the second-level sets based on element similarity, and merging a plurality of the primary and/or secondary groups based on element similarity.
    Type: Grant
    Filed: May 6, 2011
    Date of Patent: November 19, 2013
    Assignee: Microsoft Corporation
    Inventors: Yaming He, Chuang Gu
  • Patent number: 8494231
    Abstract: The subject disclosure relates to face recognition in video. Face detection data in frames of input data are used to generate face galleries, which are labeled and used in recognizing faces throughout the video. Metadata that associates the video frame and the face are generated and maintained for subsequent identification. Faces other than those found by face detection may be found by face tracking, in which facial landmarks found by the face detection are used to track a face over previous and/or subsequent video frames. Once generated, the maintained metadata may be accessed to efficiently determine the identity of a person corresponding to a viewer-selected face.
    Type: Grant
    Filed: November 1, 2010
    Date of Patent: July 23, 2013
    Assignee: Microsoft Corporation
    Inventors: Florin O. Folta, Yaming He, King Wei Hor, Minesh G. Shilotri, Stacey Spears, Chuang Gu
  • Patent number: 8411734
    Abstract: Decoding tasks are identified for decoding encoded video. Decoding tasks may include entropy decoding tasks, motion compensation tasks, inverse frequency transform tasks, inverse quantization tasks, intra decoding tasks, loop filtering tasks, or other tasks. Task dependencies are identified for the video decoding tasks. For example, one or more decoding tasks may depend on prior completion of entropy decoding tasks. The decoding tasks are prioritized based at least in part on the task dependencies. For example, a higher priority may be assigned to tasks that must be completed before other tasks that depend on them can begin. Prioritized decoding tasks are selected to be performed by hardware threads. For example, a first hardware thread may perform a first decoding task that does not depend on any uncompleted tasks while a second hardware thread performs a second decoding task that does not depend on any uncompleted tasks.
    Type: Grant
    Filed: February 6, 2007
    Date of Patent: April 2, 2013
    Assignee: Microsoft Corporation
    Inventors: Weidong Zhao, Yaming He
  • Publication number: 20120281886
    Abstract: Various examples are disclosed herein that relate to staged element classification. For example, one disclosed example provides a method of classifying elements by forming elements for classification into a plurality of first-level sets in a first stage, generating primary groups within the first-level sets based on element similarity, forming a plurality of second-level sets from the first-level sets in a second stage, generating secondary groups within the second-level sets based on element similarity, and merging a plurality of the primary and/or secondary groups based on element similarity.
    Type: Application
    Filed: May 6, 2011
    Publication date: November 8, 2012
    Applicant: MICROSOFT CORPORATION
    Inventors: Yaming He, Chuang Gu
  • Patent number: 8270473
    Abstract: A video encoding system encodes video streams for multiple bit rate video streaming using an approach that permits the encoded resolution to vary based, at least in part, on motion complexity. The video encoding system dynamically decides an encoding resolution for segments of the multiple bit rate video streams that varies with video complexity so as to achieve a better visual experience for multiple bit rate streaming. Motion complexity may be considered separately, or along with spatial complexity, in making the resolution decision.
    Type: Grant
    Filed: June 12, 2009
    Date of Patent: September 18, 2012
    Assignee: Microsoft Corporation
    Inventors: William Chen, Chun-Wei Chan, Stacey Spears, Yaming He, Florin Folta, Chuang Gu, King Wei Hor
  • Publication number: 20120106806
    Abstract: The subject disclosure relates to face recognition in video. Face detection data in frames of input data are used to generate face galleries, which are labeled and used in recognizing faces throughout the video. Metadata that associates the video frame and the face are generated and maintained for subsequent identification. Faces other than those found by face detection may be found by face tracking, in which facial landmarks found by the face detection are used to track a face over previous and/or subsequent video frames. Once generated, the maintained metadata may be accessed to efficiently determine the identity of a person corresponding to a viewer-selected face.
    Type: Application
    Filed: November 1, 2010
    Publication date: May 3, 2012
    Applicant: Microsoft Corporation
    Inventors: Florin O. Folta, Yaming He, King Wei Hor, Minesh G. Shilotri, Stacey Spears, Chuang Gu