Patents by Inventor Mei-Hsuan Lu
Mei-Hsuan Lu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20230319292Abstract: Implementations of the subject matter described herein provide a solution for rate control based on reinforcement learning. In this solution, an encoding state of a video encoder is determined, the encoding state being associated with encoding of a first video unit by the video encoder. An encoding parameter associated with rate control in the video encoder is determined by a reinforcement learning model and based on the encoding state of the video encoder. A second video unit different from the first video unit is encoded based on the encoding parameter. In this way, it is possible to achieve a better quality of experience (QOE) for real time communication with computation overhead being reduced.Type: ApplicationFiled: June 30, 2020Publication date: October 5, 2023Applicant: Microsoft Technology Licensing, LLCInventors: Jiahao LI, Bin LI, Yan LU, Tom W. HOLCOMB, Mei-Hsuan LU, Andrey MEZENTSEV, Ming-Chieh LEE
-
Publication number: 20230209066Abstract: Techniques are described for efficiently encoding video data by skipping evaluation of certain encoding modes based on various evaluation criteria. In some solutions, intra-block evaluation is performed in a specific order during encoding, and depending on encoding cost calculations of potential intra-block encoding modes, evaluation of some of the potential modes can be skipped. In some solutions, some encoding modes can be skipped depending on whether blocks are simple (e.g., simple vertical, simple horizontal, or both) or non-simple. In some solutions, various criteria are applied to determine whether chroma-from-luma mode evaluation can be skipped. The various solutions can be used independently and/or in combination.Type: ApplicationFiled: February 28, 2023Publication date: June 29, 2023Applicant: Microsoft Technology Licensing, LLCInventors: Thomas W. Holcomb, Jiahao Li, Bin Li, Yan Lu, Mei-Hsuan Lu, Andrey Mikhaylovic Mezentsev, Ming-Chieh Lee
-
Patent number: 11622118Abstract: Techniques are described for efficiently encoding video data by skipping evaluation of certain encoding modes based on various evaluation criteria. In some solutions, intra-block evaluation is performed in a specific order during encoding, and depending on encoding cost calculations of potential intra-block encoding modes, evaluation of some of the potential modes can be skipped. In some solutions, some encoding modes can be skipped depending on whether blocks are simple (e.g., simple vertical, simple horizontal, or both) or non-simple. In some solutions, various criteria are applied to determine whether chroma-from-luma mode evaluation can be skipped. The various solutions can be used independently and/or in combination.Type: GrantFiled: November 9, 2021Date of Patent: April 4, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Thomas W. Holcomb, Jiahao Li, Bin Li, Yan Lu, Mei-Hsuan Lu, Andrey Mikhaylovic Mezentsev, Ming-Chieh Lee
-
Publication number: 20220070470Abstract: Techniques are described for efficiently encoding video data by skipping evaluation of certain encoding modes based on various evaluation criteria. In some solutions, intra-block evaluation is performed in a specific order during encoding, and depending on encoding cost calculations of potential intra-block encoding modes, evaluation of some of the potential modes can be skipped. In some solutions, some encoding modes can be skipped depending on whether blocks are simple (e.g., simple vertical, simple horizontal, or both) or non-simple. In some solutions, various criteria are applied to determine whether chroma-from-luma mode evaluation can be skipped. The various solutions can be used independently and/or in combination.Type: ApplicationFiled: November 9, 2021Publication date: March 3, 2022Applicant: Microsoft Technology Licensing, LLCInventors: Thomas W. Holcomb, Jiahao Li, Bin Li, Yan Lu, Mei-Hsuan Lu, Andrey Mikhaylovic Mezentsev, Ming-Chieh Lee
-
Patent number: 11265357Abstract: Techniques are described for encapsulating AV1 encoded video data within NAL units. For example, the NAL units can be H.264 or HEVC NAL units. Encapsulation can comprise using a reserved NAL unit type. For example, an open bitstream unit comprising AV1 encoded video data can be encapsulated within a NAL unit using a reserved NAL unit type. The NAL unit can be packetized for delivery to another computing device via a computer network.Type: GrantFiled: November 1, 2019Date of Patent: March 1, 2022Assignee: Microsoft Technology Licensing, LLCInventors: Mei-Hsuan Lu, Satya Sasikanth Bendapudi, Chun-Wei Chan, Ming-Chieh Lee
-
Publication number: 20210392346Abstract: Innovations in hash table construction and hash-based block matching for image encoding or video encoding are described. For example, an encoder determines hash values for base-size candidate blocks in a reference picture. The encoder stores, in a hash table, the hash values for the base-size candidate blocks. The encoder encodes a trial-size current block in a current picture. In some cases, the trial-size current block has a block size larger than the base block size. As part of the encoding, the encoder uses hash-based block matching, between base-size current blocks of the trial-size current block and the base-size candidate blocks, to identify a trial-size matching block, if any, in the reference picture. The encoder stores hash values only for the base-size candidate blocks. This can significantly reduce the computational cost and memory cost for hash table construction during encoding, without hurting compression efficiency or the overall speed of encoding.Type: ApplicationFiled: June 12, 2020Publication date: December 16, 2021Applicant: Microsoft Technology Licensing, LLCInventors: Thomas W. HOLCOMB, Bin LI, Yan LU, Mei-Hsuan LU, Ming-Chieh LEE
-
Patent number: 11202085Abstract: Innovations in hash table construction and hash-based block matching for image encoding or video encoding are described. For example, an encoder determines hash values for base-size candidate blocks in a reference picture. The encoder stores, in a hash table, the hash values for the base-size candidate blocks. The encoder encodes a trial-size current block in a current picture. In some cases, the trial-size current block has a block size larger than the base block size. As part of the encoding, the encoder uses hash-based block matching, between base-size current blocks of the trial-size current block and the base-size candidate blocks, to identify a trial-size matching block, if any, in the reference picture. The encoder stores hash values only for the base-size candidate blocks. This can significantly reduce the computational cost and memory cost for hash table construction during encoding, without hurting compression efficiency or the overall speed of encoding.Type: GrantFiled: June 12, 2020Date of Patent: December 14, 2021Assignee: Microsoft Technology Licensing, LLCInventors: Thomas W. Holcomb, Bin Li, Yan Lu, Mei-Hsuan Lu, Ming-Chieh Lee
-
Publication number: 20210377544Abstract: Techniques are described for efficiently encoding video data by skipping evaluation of certain encoding modes based on various evaluation criteria. In some solutions, intra-block evaluation is performed in a specific order during encoding, and depending on encoding cost calculations of potential intra-block encoding modes, evaluation of some of the potential modes can be skipped. In some solutions, some encoding modes can be skipped depending on whether blocks are simple (e.g., simple vertical, simple horizontal, or both) or non-simple. In some solutions, various criteria are applied to determine whether chroma-from-luma mode evaluation can be skipped. The various solutions can be used independently and/or in combination.Type: ApplicationFiled: May 29, 2020Publication date: December 2, 2021Applicant: Microsoft Technology Licensing, LLCInventors: Thomas W. Holcomb, Jiahao Li, Bin Li, Yan Lu, Mei-Hsuan Lu, Andrey Mikhaylovic Mezentsev, Ming-Chieh Lee
-
Patent number: 11190774Abstract: Techniques are described for efficiently encoding video data by skipping evaluation of certain encoding modes based on various evaluation criteria. In some solutions, intra-block evaluation is performed in a specific order during encoding, and depending on encoding cost calculations of potential intra-block encoding modes, evaluation of some of the potential modes can be skipped. In some solutions, some encoding modes can be skipped depending on whether blocks are simple (e.g., simple vertical, simple horizontal, or both) or non-simple. In some solutions, various criteria are applied to determine whether chroma-from-luma mode evaluation can be skipped. The various solutions can be used independently and/or in combination.Type: GrantFiled: May 29, 2020Date of Patent: November 30, 2021Assignee: Microsoft Technology Licensing, LLCInventors: Thomas W. Holcomb, Jiahao Li, Bin Li, Yan Lu, Mei-Hsuan Lu, Andrey Mikhaylovic Mezentsev, Ming-Chieh Lee
-
Patent number: 11089343Abstract: Innovations described herein provide a framework for advertising encoder capabilities, initializing encoder configuration, and signaling run-time control messages for video coding and decoding. For example, an encoding controller receives a request for encoder capability data from a decoding host controller, determines the capability data, and sends the capability data in reply. The capability data can include data that indicate a number of bitstreams, each providing an alternative version of input video, as well as data that indicate scalable video coding capabilities. The decoding host controller creates stream configuration request data based on the encoder capability data, and sends the configuration request data to the encoding controller. During decoding, the decoding host controller can create and send a control message for run-time control of encoding, where the control message includes a stream identifier for a bitstream and layer identifiers for a given layer of the bitstream.Type: GrantFiled: January 11, 2012Date of Patent: August 10, 2021Assignee: Microsoft Technology Licensing, LLCInventors: Mei-Hsuan Lu, Ming-Chieh Lee
-
Patent number: 11061800Abstract: Technologies for assigning a user-generated issue report to an appropriate team for investigation are disclosed. A log file associated with an issue report is parsed to create an object model. The object model is a hierarchy of objects containing data emitted over time by a computer application associated with the issue report. Rules analyze the content of the object model, and when a rule is satisfied, the issue report is assigned to a team associated with the rule for investigation. Rules may access objects in the object model on a per-component level, thereby allowing issues to be assigned to teams at the level of individual components. Rules may also perform a root cause analysis of the issue based on the object model.Type: GrantFiled: May 31, 2019Date of Patent: July 13, 2021Assignee: Microsoft Technology Licensing, LLCInventors: Rama Krishna Prasad Kasapura Satya Prakash, Mei-Hsuan Lu, Arihant Nahata, Diego Villasenor, Siddharth Deepak Mehta, Pritesh Kanani, William Edward Miao, Rajasekaran Subramanian, Sivakumar Gobichettypalayam Ananthakrishnan, Yong Liu
-
Publication number: 20210112109Abstract: Techniques are described for encapsulating AV1 encoded video data within NAL units. For example, the NAL units can be H.264 or HEVC NAL units. Encapsulation can comprise using a reserved NAL unit type. For example, an open bitstream unit comprising AV1 encoded video data can be encapsulated within a NAL unit using a reserved NAL unit type. The NAL unit can be packetized for delivery to another computing device via a computer network.Type: ApplicationFiled: November 1, 2019Publication date: April 15, 2021Applicant: Microsoft Technology Licensing, LLCInventors: Mei-Hsuan Lu, Satya Sasikanth Bendapudi, Chun-Wei Chan, Ming-Chieh Lee
-
Publication number: 20200379871Abstract: Technologies for assigning a user-generated issue report to an appropriate team for investigation are disclosed. A log file associated with an issue report is parsed to create an object model. The object model is a hierarchy of objects containing data emitted over time by a computer application associated with the issue report. Rules analyze the content of the object model, and when a rule is satisfied, the issue report is assigned to a team associated with the rule for investigation. Rules may access objects in the object model on a per-component level, thereby allowing issues to be assigned to teams at the level of individual components. Rules may also perform a root cause analysis of the issue based on the object model.Type: ApplicationFiled: May 31, 2019Publication date: December 3, 2020Inventors: Rama Krishna Prasad Kasapura Satya PRAKASH, Mei-Hsuan LU, Arihant NAHATA, Diego VILLASENOR, Siddharth Deepak MEHTA, Pritesh KANANI, William Edward MIAO, Rajasekaran SUBRAMANIAN, Sivakumar Gobichettypalayam ANANTHAKRISHNAN, Yong LIU
-
Patent number: 10819951Abstract: Techniques for recording video from a bitstream are described. In at least some implementations, video data generated as part of a communication session is recorded. According to various implementations, techniques described herein enable portions of an encoded bitstream of video data to be directly recorded as encoded frames and without requiring re-encoding of decoded frames.Type: GrantFiled: February 6, 2017Date of Patent: October 27, 2020Assignee: Microsoft Technology Licensing, LLCInventors: You Zhou, Chih-lung Lin, Mei-Hsuan Lu, Binlong Li, Ming-Chieh Lee
-
Publication number: 20190268601Abstract: Techniques are described for streaming video content between computing devices. For example, a computing device can stream encoded video content to one or more receiving devices. The computing device can detect whether video content to be encoded is static content or dynamic content and switch the coding structure accordingly. For example, if the video content is determined to be static video content, then the static content can be encoded using a first predictive coding structure in which the first video frame is encoded as a single key frame and subsequent video frames are encoded as predicted frames that are non-reference frames and that only reference the single key frame. If the video content is determined to be dynamic video content, then the dynamic content can be encoded using a second predictive coding structure different from the first predictive coding structure.Type: ApplicationFiled: February 26, 2018Publication date: August 29, 2019Applicant: Microsoft Technology Licensing, LLCInventors: Mei-Hsuan Lu, Ming-Chieh Lee, Siddharth Deepak Mehta
-
Patent number: 10313035Abstract: Displaying video on a video display device is disclosed. A first video stream from a first video streaming source is displayed on the display device. A second video stream from a second video streaming source is processed on the display device without displaying the second video stream. Displaying the first video stream is ceased and instead the second video stream is displayed. Supporting operations on a video stream is also disclosed. At least one video chunk is received at a first granularity. A determination is made that an operation is to be performed at a different granularity. At least one video chunk is requested at the different granularity.Type: GrantFiled: October 14, 2015Date of Patent: June 4, 2019Assignee: Conviva Inc.Inventors: Ningning Hu, John W. Heffner, Mei-Hsuan Lu, Aditya Ravikumar Ganjam, Ion Stoica
-
Patent number: 10313734Abstract: Displaying video on a video display device is disclosed. A first video stream from a first video streaming source is displayed on the display device. A second video stream from a second video streaming source is processed on the display device without displaying the second video stream. Displaying the first video stream is ceased and instead the second video stream is displayed. Supporting operations on a video stream is also disclosed. At least one video chunk is received at a first granularity. A determination is made that an operation is to be performed at a different granularity. At least one video chunk is requested at the different granularity.Type: GrantFiled: October 14, 2015Date of Patent: June 4, 2019Assignee: Conviva Inc.Inventors: Ningning Hu, John W. Heffner, Mei-Hsuan Lu, Aditya Ravikumar Ganjam, Ion Stoica
-
Patent number: 10104415Abstract: A user device within a communication architecture, the user device comprising: an image capture device configured to determine image data for the creation of a video channel defining the shared scene; an intrinsic/extrinsic data determiner configured to determine intrinsic/extrinsic capture device data associated with the image capture device; and a video encoder configured to encode the image data and intrinsic/extrinsic capture device data within the video channel.Type: GrantFiled: January 21, 2015Date of Patent: October 16, 2018Assignee: Microsoft Technology Licensing, LLCInventors: Ming-Chieh Lee, Mei-Hsuan Lu, Robert Aichner, Ryan S. Menezes, Abhishek Abhishek, Bofan Hsu, Ermin Kozica
-
Publication number: 20180152670Abstract: Techniques for recording video from a bitstream are described. In at least some implementations, video data generated as part of a communication session is recorded. According to various implementations, techniques described herein enable portions of an encoded bitstream of video data to be directly recorded as encoded frames and without requiring re-encoding of decoded frames.Type: ApplicationFiled: February 6, 2017Publication date: May 31, 2018Applicant: Microsoft Technology Licensing, LLCInventors: You Zhou, Chih-lung Lin, Mei-Hsuan Lu, Binlong Li, Ming-Chieh Lee
-
Patent number: D1019023Type: GrantFiled: March 30, 2020Date of Patent: March 19, 2024Assignee: Amazon Technologies, Inc.Inventors: Michael Edward James Paterson, Chia-Wei Chan, Mei Hsuan Chen, Benjamin Wild, Matthew J. England, Wen-Yo Lu, James Siminoff, Mark Siminoff, Yen-Chi Tsai