Patents by Inventor Mei-Hsuan Lu

Mei-Hsuan Lu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230319292
    Abstract: Implementations of the subject matter described herein provide a solution for rate control based on reinforcement learning. In this solution, an encoding state of a video encoder is determined, the encoding state being associated with encoding of a first video unit by the video encoder. An encoding parameter associated with rate control in the video encoder is determined by a reinforcement learning model and based on the encoding state of the video encoder. A second video unit different from the first video unit is encoded based on the encoding parameter. In this way, it is possible to achieve a better quality of experience (QOE) for real time communication with computation overhead being reduced.
    Type: Application
    Filed: June 30, 2020
    Publication date: October 5, 2023
    Applicant: Microsoft Technology Licensing, LLC
    Inventors: Jiahao LI, Bin LI, Yan LU, Tom W. HOLCOMB, Mei-Hsuan LU, Andrey MEZENTSEV, Ming-Chieh LEE
  • Publication number: 20230209066
    Abstract: Techniques are described for efficiently encoding video data by skipping evaluation of certain encoding modes based on various evaluation criteria. In some solutions, intra-block evaluation is performed in a specific order during encoding, and depending on encoding cost calculations of potential intra-block encoding modes, evaluation of some of the potential modes can be skipped. In some solutions, some encoding modes can be skipped depending on whether blocks are simple (e.g., simple vertical, simple horizontal, or both) or non-simple. In some solutions, various criteria are applied to determine whether chroma-from-luma mode evaluation can be skipped. The various solutions can be used independently and/or in combination.
    Type: Application
    Filed: February 28, 2023
    Publication date: June 29, 2023
    Applicant: Microsoft Technology Licensing, LLC
    Inventors: Thomas W. Holcomb, Jiahao Li, Bin Li, Yan Lu, Mei-Hsuan Lu, Andrey Mikhaylovic Mezentsev, Ming-Chieh Lee
  • Patent number: 11622118
    Abstract: Techniques are described for efficiently encoding video data by skipping evaluation of certain encoding modes based on various evaluation criteria. In some solutions, intra-block evaluation is performed in a specific order during encoding, and depending on encoding cost calculations of potential intra-block encoding modes, evaluation of some of the potential modes can be skipped. In some solutions, some encoding modes can be skipped depending on whether blocks are simple (e.g., simple vertical, simple horizontal, or both) or non-simple. In some solutions, various criteria are applied to determine whether chroma-from-luma mode evaluation can be skipped. The various solutions can be used independently and/or in combination.
    Type: Grant
    Filed: November 9, 2021
    Date of Patent: April 4, 2023
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Thomas W. Holcomb, Jiahao Li, Bin Li, Yan Lu, Mei-Hsuan Lu, Andrey Mikhaylovic Mezentsev, Ming-Chieh Lee
  • Publication number: 20220070470
    Abstract: Techniques are described for efficiently encoding video data by skipping evaluation of certain encoding modes based on various evaluation criteria. In some solutions, intra-block evaluation is performed in a specific order during encoding, and depending on encoding cost calculations of potential intra-block encoding modes, evaluation of some of the potential modes can be skipped. In some solutions, some encoding modes can be skipped depending on whether blocks are simple (e.g., simple vertical, simple horizontal, or both) or non-simple. In some solutions, various criteria are applied to determine whether chroma-from-luma mode evaluation can be skipped. The various solutions can be used independently and/or in combination.
    Type: Application
    Filed: November 9, 2021
    Publication date: March 3, 2022
    Applicant: Microsoft Technology Licensing, LLC
    Inventors: Thomas W. Holcomb, Jiahao Li, Bin Li, Yan Lu, Mei-Hsuan Lu, Andrey Mikhaylovic Mezentsev, Ming-Chieh Lee
  • Patent number: 11265357
    Abstract: Techniques are described for encapsulating AV1 encoded video data within NAL units. For example, the NAL units can be H.264 or HEVC NAL units. Encapsulation can comprise using a reserved NAL unit type. For example, an open bitstream unit comprising AV1 encoded video data can be encapsulated within a NAL unit using a reserved NAL unit type. The NAL unit can be packetized for delivery to another computing device via a computer network.
    Type: Grant
    Filed: November 1, 2019
    Date of Patent: March 1, 2022
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Mei-Hsuan Lu, Satya Sasikanth Bendapudi, Chun-Wei Chan, Ming-Chieh Lee
  • Publication number: 20210392346
    Abstract: Innovations in hash table construction and hash-based block matching for image encoding or video encoding are described. For example, an encoder determines hash values for base-size candidate blocks in a reference picture. The encoder stores, in a hash table, the hash values for the base-size candidate blocks. The encoder encodes a trial-size current block in a current picture. In some cases, the trial-size current block has a block size larger than the base block size. As part of the encoding, the encoder uses hash-based block matching, between base-size current blocks of the trial-size current block and the base-size candidate blocks, to identify a trial-size matching block, if any, in the reference picture. The encoder stores hash values only for the base-size candidate blocks. This can significantly reduce the computational cost and memory cost for hash table construction during encoding, without hurting compression efficiency or the overall speed of encoding.
    Type: Application
    Filed: June 12, 2020
    Publication date: December 16, 2021
    Applicant: Microsoft Technology Licensing, LLC
    Inventors: Thomas W. HOLCOMB, Bin LI, Yan LU, Mei-Hsuan LU, Ming-Chieh LEE
  • Patent number: 11202085
    Abstract: Innovations in hash table construction and hash-based block matching for image encoding or video encoding are described. For example, an encoder determines hash values for base-size candidate blocks in a reference picture. The encoder stores, in a hash table, the hash values for the base-size candidate blocks. The encoder encodes a trial-size current block in a current picture. In some cases, the trial-size current block has a block size larger than the base block size. As part of the encoding, the encoder uses hash-based block matching, between base-size current blocks of the trial-size current block and the base-size candidate blocks, to identify a trial-size matching block, if any, in the reference picture. The encoder stores hash values only for the base-size candidate blocks. This can significantly reduce the computational cost and memory cost for hash table construction during encoding, without hurting compression efficiency or the overall speed of encoding.
    Type: Grant
    Filed: June 12, 2020
    Date of Patent: December 14, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Thomas W. Holcomb, Bin Li, Yan Lu, Mei-Hsuan Lu, Ming-Chieh Lee
  • Publication number: 20210377544
    Abstract: Techniques are described for efficiently encoding video data by skipping evaluation of certain encoding modes based on various evaluation criteria. In some solutions, intra-block evaluation is performed in a specific order during encoding, and depending on encoding cost calculations of potential intra-block encoding modes, evaluation of some of the potential modes can be skipped. In some solutions, some encoding modes can be skipped depending on whether blocks are simple (e.g., simple vertical, simple horizontal, or both) or non-simple. In some solutions, various criteria are applied to determine whether chroma-from-luma mode evaluation can be skipped. The various solutions can be used independently and/or in combination.
    Type: Application
    Filed: May 29, 2020
    Publication date: December 2, 2021
    Applicant: Microsoft Technology Licensing, LLC
    Inventors: Thomas W. Holcomb, Jiahao Li, Bin Li, Yan Lu, Mei-Hsuan Lu, Andrey Mikhaylovic Mezentsev, Ming-Chieh Lee
  • Patent number: 11190774
    Abstract: Techniques are described for efficiently encoding video data by skipping evaluation of certain encoding modes based on various evaluation criteria. In some solutions, intra-block evaluation is performed in a specific order during encoding, and depending on encoding cost calculations of potential intra-block encoding modes, evaluation of some of the potential modes can be skipped. In some solutions, some encoding modes can be skipped depending on whether blocks are simple (e.g., simple vertical, simple horizontal, or both) or non-simple. In some solutions, various criteria are applied to determine whether chroma-from-luma mode evaluation can be skipped. The various solutions can be used independently and/or in combination.
    Type: Grant
    Filed: May 29, 2020
    Date of Patent: November 30, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Thomas W. Holcomb, Jiahao Li, Bin Li, Yan Lu, Mei-Hsuan Lu, Andrey Mikhaylovic Mezentsev, Ming-Chieh Lee
  • Patent number: 11089343
    Abstract: Innovations described herein provide a framework for advertising encoder capabilities, initializing encoder configuration, and signaling run-time control messages for video coding and decoding. For example, an encoding controller receives a request for encoder capability data from a decoding host controller, determines the capability data, and sends the capability data in reply. The capability data can include data that indicate a number of bitstreams, each providing an alternative version of input video, as well as data that indicate scalable video coding capabilities. The decoding host controller creates stream configuration request data based on the encoder capability data, and sends the configuration request data to the encoding controller. During decoding, the decoding host controller can create and send a control message for run-time control of encoding, where the control message includes a stream identifier for a bitstream and layer identifiers for a given layer of the bitstream.
    Type: Grant
    Filed: January 11, 2012
    Date of Patent: August 10, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Mei-Hsuan Lu, Ming-Chieh Lee
  • Patent number: 11061800
    Abstract: Technologies for assigning a user-generated issue report to an appropriate team for investigation are disclosed. A log file associated with an issue report is parsed to create an object model. The object model is a hierarchy of objects containing data emitted over time by a computer application associated with the issue report. Rules analyze the content of the object model, and when a rule is satisfied, the issue report is assigned to a team associated with the rule for investigation. Rules may access objects in the object model on a per-component level, thereby allowing issues to be assigned to teams at the level of individual components. Rules may also perform a root cause analysis of the issue based on the object model.
    Type: Grant
    Filed: May 31, 2019
    Date of Patent: July 13, 2021
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Rama Krishna Prasad Kasapura Satya Prakash, Mei-Hsuan Lu, Arihant Nahata, Diego Villasenor, Siddharth Deepak Mehta, Pritesh Kanani, William Edward Miao, Rajasekaran Subramanian, Sivakumar Gobichettypalayam Ananthakrishnan, Yong Liu
  • Publication number: 20210112109
    Abstract: Techniques are described for encapsulating AV1 encoded video data within NAL units. For example, the NAL units can be H.264 or HEVC NAL units. Encapsulation can comprise using a reserved NAL unit type. For example, an open bitstream unit comprising AV1 encoded video data can be encapsulated within a NAL unit using a reserved NAL unit type. The NAL unit can be packetized for delivery to another computing device via a computer network.
    Type: Application
    Filed: November 1, 2019
    Publication date: April 15, 2021
    Applicant: Microsoft Technology Licensing, LLC
    Inventors: Mei-Hsuan Lu, Satya Sasikanth Bendapudi, Chun-Wei Chan, Ming-Chieh Lee
  • Publication number: 20200379871
    Abstract: Technologies for assigning a user-generated issue report to an appropriate team for investigation are disclosed. A log file associated with an issue report is parsed to create an object model. The object model is a hierarchy of objects containing data emitted over time by a computer application associated with the issue report. Rules analyze the content of the object model, and when a rule is satisfied, the issue report is assigned to a team associated with the rule for investigation. Rules may access objects in the object model on a per-component level, thereby allowing issues to be assigned to teams at the level of individual components. Rules may also perform a root cause analysis of the issue based on the object model.
    Type: Application
    Filed: May 31, 2019
    Publication date: December 3, 2020
    Inventors: Rama Krishna Prasad Kasapura Satya PRAKASH, Mei-Hsuan LU, Arihant NAHATA, Diego VILLASENOR, Siddharth Deepak MEHTA, Pritesh KANANI, William Edward MIAO, Rajasekaran SUBRAMANIAN, Sivakumar Gobichettypalayam ANANTHAKRISHNAN, Yong LIU
  • Patent number: 10819951
    Abstract: Techniques for recording video from a bitstream are described. In at least some implementations, video data generated as part of a communication session is recorded. According to various implementations, techniques described herein enable portions of an encoded bitstream of video data to be directly recorded as encoded frames and without requiring re-encoding of decoded frames.
    Type: Grant
    Filed: February 6, 2017
    Date of Patent: October 27, 2020
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: You Zhou, Chih-lung Lin, Mei-Hsuan Lu, Binlong Li, Ming-Chieh Lee
  • Publication number: 20190268601
    Abstract: Techniques are described for streaming video content between computing devices. For example, a computing device can stream encoded video content to one or more receiving devices. The computing device can detect whether video content to be encoded is static content or dynamic content and switch the coding structure accordingly. For example, if the video content is determined to be static video content, then the static content can be encoded using a first predictive coding structure in which the first video frame is encoded as a single key frame and subsequent video frames are encoded as predicted frames that are non-reference frames and that only reference the single key frame. If the video content is determined to be dynamic video content, then the dynamic content can be encoded using a second predictive coding structure different from the first predictive coding structure.
    Type: Application
    Filed: February 26, 2018
    Publication date: August 29, 2019
    Applicant: Microsoft Technology Licensing, LLC
    Inventors: Mei-Hsuan Lu, Ming-Chieh Lee, Siddharth Deepak Mehta
  • Patent number: 10313035
    Abstract: Displaying video on a video display device is disclosed. A first video stream from a first video streaming source is displayed on the display device. A second video stream from a second video streaming source is processed on the display device without displaying the second video stream. Displaying the first video stream is ceased and instead the second video stream is displayed. Supporting operations on a video stream is also disclosed. At least one video chunk is received at a first granularity. A determination is made that an operation is to be performed at a different granularity. At least one video chunk is requested at the different granularity.
    Type: Grant
    Filed: October 14, 2015
    Date of Patent: June 4, 2019
    Assignee: Conviva Inc.
    Inventors: Ningning Hu, John W. Heffner, Mei-Hsuan Lu, Aditya Ravikumar Ganjam, Ion Stoica
  • Patent number: 10313734
    Abstract: Displaying video on a video display device is disclosed. A first video stream from a first video streaming source is displayed on the display device. A second video stream from a second video streaming source is processed on the display device without displaying the second video stream. Displaying the first video stream is ceased and instead the second video stream is displayed. Supporting operations on a video stream is also disclosed. At least one video chunk is received at a first granularity. A determination is made that an operation is to be performed at a different granularity. At least one video chunk is requested at the different granularity.
    Type: Grant
    Filed: October 14, 2015
    Date of Patent: June 4, 2019
    Assignee: Conviva Inc.
    Inventors: Ningning Hu, John W. Heffner, Mei-Hsuan Lu, Aditya Ravikumar Ganjam, Ion Stoica
  • Patent number: 10104415
    Abstract: A user device within a communication architecture, the user device comprising: an image capture device configured to determine image data for the creation of a video channel defining the shared scene; an intrinsic/extrinsic data determiner configured to determine intrinsic/extrinsic capture device data associated with the image capture device; and a video encoder configured to encode the image data and intrinsic/extrinsic capture device data within the video channel.
    Type: Grant
    Filed: January 21, 2015
    Date of Patent: October 16, 2018
    Assignee: Microsoft Technology Licensing, LLC
    Inventors: Ming-Chieh Lee, Mei-Hsuan Lu, Robert Aichner, Ryan S. Menezes, Abhishek Abhishek, Bofan Hsu, Ermin Kozica
  • Publication number: 20180152670
    Abstract: Techniques for recording video from a bitstream are described. In at least some implementations, video data generated as part of a communication session is recorded. According to various implementations, techniques described herein enable portions of an encoded bitstream of video data to be directly recorded as encoded frames and without requiring re-encoding of decoded frames.
    Type: Application
    Filed: February 6, 2017
    Publication date: May 31, 2018
    Applicant: Microsoft Technology Licensing, LLC
    Inventors: You Zhou, Chih-lung Lin, Mei-Hsuan Lu, Binlong Li, Ming-Chieh Lee
  • Patent number: D1019023
    Type: Grant
    Filed: March 30, 2020
    Date of Patent: March 19, 2024
    Assignee: Amazon Technologies, Inc.
    Inventors: Michael Edward James Paterson, Chia-Wei Chan, Mei Hsuan Chen, Benjamin Wild, Matthew J. England, Wen-Yo Lu, James Siminoff, Mark Siminoff, Yen-Chi Tsai