Patents by Inventor Yaming He
Yaming He has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11546596Abstract: Embodiments are described for dynamically adapting video encoding to maintain a nearly stable frame rate based on processor capabilities and bandwidth, for example, by varying a quantization parameter. The quality of the encoded video can be varied to maintain the nearly constant frame rate, which may be measured from the number of encoded video frames being transmitted over a network interface.Type: GrantFiled: December 20, 2019Date of Patent: January 3, 2023Assignee: Meta Platforms, Inc.Inventors: Yaming He, Zhengping Zuo
-
Patent number: 11190570Abstract: A video encoder may be put in a starve mode during a low latency operation in which the video encoder may be operated in a mode that allows video frames to be encoded without any interdependencies such as motion compensation. At least one encoding parameter of the video encoding is selected such that, for each resulting encoded video frame, the video frame fits in exactly one application layer packet.Type: GrantFiled: August 20, 2020Date of Patent: November 30, 2021Assignee: Facebook, Inc.Inventors: Yaming He, Zhengping Zuo
-
Publication number: 20200382575Abstract: A video encoder may be put in a starve mode during a low latency operation in which the video encoder may be operated in a mode that allows video frames to be encoded without any interdependencies such as motion compensation. At least one encoding parameter of the video encoding is selected such that, for each resulting encoded video frame, the video frame fits in exactly one application layer packet.Type: ApplicationFiled: August 20, 2020Publication date: December 3, 2020Inventors: Yaming He, Zhengping Zuo
-
Patent number: 10785279Abstract: A video encoder may be put in a starve mode during a low latency operation in which the video encoder may be operated in a mode that allows video frames to be encoded without any interdependencies such as motion compensation. At least one encoding parameter of the video encoding is selected such that, for each resulting encoded video frame, the video frame fits in exactly one application layer packet.Type: GrantFiled: December 29, 2016Date of Patent: September 22, 2020Assignee: Facebook, Inc.Inventors: Yaming He, Zhengping Zuo
-
Publication number: 20200128246Abstract: Embodiments are described for dynamically adapting video encoding to maintain a nearly stable frame rate based on processor capabilities and bandwidth, for example, by varying a quantization parameter. The quality of the encoded video can be varied to maintain the nearly constant frame rate, which may be measured from the number of encoded video frames being transmitted over a network interface.Type: ApplicationFiled: December 20, 2019Publication date: April 23, 2020Inventors: Yaming He, Zhengping Zuo
-
Patent number: 10587669Abstract: In one embodiment, a method includes receiving multimedia content information associated with at least one segment of a multimedia content, receiving a request to view the at least one segment of the multimedia content from a client device, logging playback information associated with the viewing of the at least one segment of the multimedia content, determining a multimedia quality metric associated with the at least one segment of multimedia content based in part upon a portion of the received multimedia content information and a portion of the logged playback information, and classifying the at least one segment of the multimedia content with the multimedia quality metric.Type: GrantFiled: December 20, 2017Date of Patent: March 10, 2020Assignee: Facebook, Inc.Inventors: Minchuan Chen, Shankar Lakshmi Regunathan, Sonal Gandhi, Yaming He, Amit Puntambekar, Michael Hamilton Coward
-
Patent number: 10523939Abstract: Embodiments are described for dynamically adapting video encoding to maintain a nearly stable frame rate based on processor capabilities and bandwidth, for example, by varying a quantization parameter. The quality of the encoded video can be varied to maintain the nearly constant frame rate, which may be measured from the number of encoded video frames being transmitted over a network interface.Type: GrantFiled: June 8, 2016Date of Patent: December 31, 2019Assignee: Facebook, Inc.Inventors: Yaming He, Zhengping Zuo
-
Publication number: 20190190976Abstract: In one embodiment, a method includes receiving multimedia content information associated with at least one segment of a multimedia content, receiving a request to view the at least one segment of the multimedia content from a client device, logging playback information associated with the viewing of the at least one segment of the multimedia content, determining a multimedia quality metric associated with the at least one segment of multimedia content based in part upon a portion of the received multimedia content information and a portion of the logged playback information, and classifying the at least one segment of the multimedia content with the multimedia quality metric.Type: ApplicationFiled: December 20, 2017Publication date: June 20, 2019Inventors: Minchuan Chen, Shankar Lakshmi Regunathan, Sonal Gandhi, Yaming He, Amit Puntambekar, Michael Hamilton Coward
-
Publication number: 20180192061Abstract: A video encoder may be put in a starve mode during a low latency operation in which the video encoder may be operated in a mode that allows video frames to be encoded without any interdependencies such as motion compensation. At least one encoding parameter of the video encoding is selected such that, for each resulting encoded video frame, the video frame fits in exactly one application layer packet.Type: ApplicationFiled: December 29, 2016Publication date: July 5, 2018Inventors: Yaming He, Zhengping Zuo
-
Publication number: 20170195672Abstract: Embodiments are described for dynamically adapting video encoding to maintain a nearly stable frame rate based on processor capabilities and bandwidth, for example, by varying a quantization parameter. The quality of the encoded video can be varied to maintain the nearly constant frame rate, which may be measured from the number of encoded video frames being transmitted over a network interface.Type: ApplicationFiled: June 8, 2016Publication date: July 6, 2017Inventors: Yaming He, Zhengping Zuo
-
Patent number: 9161034Abstract: Decoding tasks are identified for decoding encoded video. Decoding tasks may include entropy decoding tasks, motion compensation tasks, inverse frequency transform tasks, inverse quantization tasks, intra decoding tasks, loop filtering tasks, or other tasks. Task dependencies are identified for the video decoding tasks. For example, one or more decoding tasks may depend on prior completion of entropy decoding tasks. The decoding tasks are prioritized based at least in part on the task dependencies. For example, a higher priority may be assigned to tasks that must be completed before other tasks that depend on them can begin. Prioritized decoding tasks are selected to be performed by hardware threads. For example, a first hardware thread may perform a first decoding task that does not depend on any uncompleted tasks while a second hardware thread performs a second decoding task that does not depend on any uncompleted tasks.Type: GrantFiled: April 30, 2014Date of Patent: October 13, 2015Assignee: Microsoft Technology Licensing, LLCInventors: Weidong Zhao, Yaming He
-
Publication number: 20140233652Abstract: Decoding tasks are identified for decoding encoded video. Decoding tasks may include entropy decoding tasks, motion compensation tasks, inverse frequency transform tasks, inverse quantization tasks, intra decoding tasks, loop filtering tasks, or other tasks. Task dependencies are identified for the video decoding tasks. For example, one or more decoding tasks may depend on prior completion of entropy decoding tasks. The decoding tasks are prioritized based at least in part on the task dependencies. For example, a higher priority may be assigned to tasks that must be completed before other tasks that depend on them can begin. Prioritized decoding tasks are selected to be performed by hardware threads. For example, a first hardware thread may perform a first decoding task that does not depend on any uncompleted tasks while a second hardware thread performs a second decoding task that does not depend on any uncompleted tasks.Type: ApplicationFiled: April 30, 2014Publication date: August 21, 2014Applicant: Microsoft CorporationInventors: Weidong Zhao, Yaming He
-
Patent number: 8743948Abstract: Decoding tasks are identified for decoding encoded video. Decoding tasks may include entropy decoding tasks, motion compensation tasks, inverse frequency transform tasks, inverse quantization tasks, intra decoding tasks, loop filtering tasks, or other tasks. Task dependencies are identified for the video decoding tasks. For example, one or more decoding tasks may depend on prior completion of entropy decoding tasks. The decoding tasks are prioritized based at least in part on the task dependencies. For example, a higher priority may be assigned to tasks that must be completed before other tasks that depend on them can begin. Prioritized decoding tasks are selected to be performed by hardware threads. For example, a first hardware thread may perform a first decoding task that does not depend on any uncompleted tasks while a second hardware thread performs a second decoding task that does not depend on any uncompleted tasks.Type: GrantFiled: March 21, 2013Date of Patent: June 3, 2014Assignee: Microsoft CorporationInventors: Weidong Zhao, Yaming He
-
Patent number: 8705616Abstract: A multiple bitrate (MBR) video encoding management tool utilizes available processing units for parallel MBR video encoding. Instead of focusing only on multi-threading of encoding tasks for a single picture or group of pictures (GOP), the management tool parallelizes the encoding of multiple GOPs between different processing units and/or different computing systems. With this parallel MBR video encoding architecture, different GOPs can be encoded in parallel. To facilitate such parallel encoding, data dependencies between GOPs are removed. The management tool can adjust the number of GOPs to encode in parallel on a computing system so as to favor parallelism of encoding for different GOPs at the expense of parallelism of encoding inside a GOP, or vice versa, and thereby set a suitable balance between encoding latency and throughput.Type: GrantFiled: June 11, 2010Date of Patent: April 22, 2014Assignee: Microsoft CorporationInventors: Yaming He, Florin Folta, Chun-Wei Chan, Stacey Spears, Chuang Gu
-
Patent number: 8588534Abstract: Various examples are disclosed herein that relate to staged element classification. For example, one disclosed example provides a method of classifying elements by forming elements for classification into a plurality of first-level sets in a first stage, generating primary groups within the first-level sets based on element similarity, forming a plurality of second-level sets from the first-level sets in a second stage, generating secondary groups within the second-level sets based on element similarity, and merging a plurality of the primary and/or secondary groups based on element similarity.Type: GrantFiled: May 6, 2011Date of Patent: November 19, 2013Assignee: Microsoft CorporationInventors: Yaming He, Chuang Gu
-
Patent number: 8494231Abstract: The subject disclosure relates to face recognition in video. Face detection data in frames of input data are used to generate face galleries, which are labeled and used in recognizing faces throughout the video. Metadata that associates the video frame and the face are generated and maintained for subsequent identification. Faces other than those found by face detection may be found by face tracking, in which facial landmarks found by the face detection are used to track a face over previous and/or subsequent video frames. Once generated, the maintained metadata may be accessed to efficiently determine the identity of a person corresponding to a viewer-selected face.Type: GrantFiled: November 1, 2010Date of Patent: July 23, 2013Assignee: Microsoft CorporationInventors: Florin O. Folta, Yaming He, King Wei Hor, Minesh G. Shilotri, Stacey Spears, Chuang Gu
-
Patent number: 8411734Abstract: Decoding tasks are identified for decoding encoded video. Decoding tasks may include entropy decoding tasks, motion compensation tasks, inverse frequency transform tasks, inverse quantization tasks, intra decoding tasks, loop filtering tasks, or other tasks. Task dependencies are identified for the video decoding tasks. For example, one or more decoding tasks may depend on prior completion of entropy decoding tasks. The decoding tasks are prioritized based at least in part on the task dependencies. For example, a higher priority may be assigned to tasks that must be completed before other tasks that depend on them can begin. Prioritized decoding tasks are selected to be performed by hardware threads. For example, a first hardware thread may perform a first decoding task that does not depend on any uncompleted tasks while a second hardware thread performs a second decoding task that does not depend on any uncompleted tasks.Type: GrantFiled: February 6, 2007Date of Patent: April 2, 2013Assignee: Microsoft CorporationInventors: Weidong Zhao, Yaming He
-
Publication number: 20120281886Abstract: Various examples are disclosed herein that relate to staged element classification. For example, one disclosed example provides a method of classifying elements by forming elements for classification into a plurality of first-level sets in a first stage, generating primary groups within the first-level sets based on element similarity, forming a plurality of second-level sets from the first-level sets in a second stage, generating secondary groups within the second-level sets based on element similarity, and merging a plurality of the primary and/or secondary groups based on element similarity.Type: ApplicationFiled: May 6, 2011Publication date: November 8, 2012Applicant: MICROSOFT CORPORATIONInventors: Yaming He, Chuang Gu
-
Patent number: 8270473Abstract: A video encoding system encodes video streams for multiple bit rate video streaming using an approach that permits the encoded resolution to vary based, at least in part, on motion complexity. The video encoding system dynamically decides an encoding resolution for segments of the multiple bit rate video streams that varies with video complexity so as to achieve a better visual experience for multiple bit rate streaming. Motion complexity may be considered separately, or along with spatial complexity, in making the resolution decision.Type: GrantFiled: June 12, 2009Date of Patent: September 18, 2012Assignee: Microsoft CorporationInventors: William Chen, Chun-Wei Chan, Stacey Spears, Yaming He, Florin Folta, Chuang Gu, King Wei Hor
-
Publication number: 20120106806Abstract: The subject disclosure relates to face recognition in video. Face detection data in frames of input data are used to generate face galleries, which are labeled and used in recognizing faces throughout the video. Metadata that associates the video frame and the face are generated and maintained for subsequent identification. Faces other than those found by face detection may be found by face tracking, in which facial landmarks found by the face detection are used to track a face over previous and/or subsequent video frames. Once generated, the maintained metadata may be accessed to efficiently determine the identity of a person corresponding to a viewer-selected face.Type: ApplicationFiled: November 1, 2010Publication date: May 3, 2012Applicant: Microsoft CorporationInventors: Florin O. Folta, Yaming He, King Wei Hor, Minesh G. Shilotri, Stacey Spears, Chuang Gu