Patents by Inventor Ming-Chieh Lee
Ming-Chieh Lee has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 12627818Abstract: When encoding/decoding a current block of a current picture using intra block copy (“BC”) prediction, the location of a reference block is constrained so that it can be entirely within an inner search area of the current picture or entirely within an outer search area of the current picture, but cannot overlap both the inner search area and the outer search area. In some hardware-based implementations, on-chip memory buffers sample values of the inner search area, and off-chip memory buffers sample values of the outer search area. By enforcing this constraint on the location of the reference block, an encoder/decoder can avoid memory access operations that are split between on-chip memory and off-chip memory when retrieving the sample values of the reference block. At the same time, a reference block close to the current block may be used for intra BC prediction, helping compression efficiency.Type: GrantFiled: August 2, 2024Date of Patent: May 12, 2026Assignee: Microsoft Technology Licensing, LLCInventors: You Zhou, Chih-Lung Lin, Ming-Chieh Lee
-
Publication number: 20250364001Abstract: Techniques and solutions are described for encoding and decoding signals, such as audio data. Disclosed innovations can find particular use in speech coding applications, such as for real time communications. Using a neural network, contextual coding can be used to encode latent features for a current frame using a prediction from reconstructed latent features of past frames as a context. An extractor learns a residual-like feature based on such prediction and latent features of the current frame obtained using an encoder. The residual-like feature is then quantized. At a decoder portion of a coding framework, the quantized feature is dequantized and then combined with a prediction from prior reconstructed latent features to provide reconstructed features of a current frame, which can then be processed by a decoder to provide a reconstructed signal.Type: ApplicationFiled: June 14, 2022Publication date: November 27, 2025Applicant: Microsoft Technology Licensing, LLCInventors: Xiulian PENG, Yan LU, Huaying XUE, Vinod PRAKASH, Ming-Chieh LEE, Mahmood MOVASSAGH
-
Publication number: 20250317597Abstract: A format for use in encoding moving image data, comprising: a sequence of frames including plurality of the frames in which at least a region is encoded using motion estimation; a respective set of motion vector values representing motion vectors of the motion estimation for each respective one of these frames or each respective one of one or more regions within each of such frames; and at least one respective indicator associated with each of the respective frames or regions, indicating whether the respective motion vector values of the respective frame or region are encoded at a first resolution or a second resolution.Type: ApplicationFiled: June 17, 2025Publication date: October 9, 2025Applicant: Microsoft Technology Licensing, LLCInventors: You Zhou, Sergey Silkin, Sergey Sablin, Chih-Lung Lin, Ming-Chieh Lee, Gary J. Sullivan
-
Patent number: 12368884Abstract: A format for use in encoding moving image data, comprising: a sequence of frames including plurality of the frames in which at least a region is encoded using motion estimation; a respective set of motion vector values representing motion vectors of the motion estimation for each respective one of these frames or each respective one of one or more regions within each of such frames; and at least one respective indicator associated with each of the respective frames or regions, indicating whether the respective motion vector values of the respective frame or region are encoded at a first resolution or a second resolution.Type: GrantFiled: November 28, 2022Date of Patent: July 22, 2025Assignee: Microsoft Technology Licensing, LLCInventors: You Zhou, Sergey Silkin, Sergey Sablin, Chih-Lung Lin, Ming-Chieh Lee, Gary J. Sullivan
-
Patent number: 12367394Abstract: Apparatus and methods are disclosed for using machine learning models with private and public domains. Operations can be applied to transform input to a machine learning model in a private domain that is kept secret or otherwise made unavailable to third parties. In one example of the disclosed technology, a method includes applying a private transform to produce transformed input, providing the transformed input to a machine learning model that was trained using a training set modified by the private transform, and generating inferences with the machine learning model using the transformed input. Examples of suitable transforms that can be employed include matrix multiplication, time or spatial domain to frequency domains, and partitioning a neural network model such that an input and at least one hidden layer form part of the private domain, while the remaining layers form part of the public domain.Type: GrantFiled: June 23, 2023Date of Patent: July 22, 2025Assignee: Microsoft Technology Licensing, LLCInventors: Sriram Srinivasan, David Yuheng Zhao, Ming-Chieh Lee, Mu Han
-
Publication number: 20250203098Abstract: Implementations of the subject matter described herein provide a solution for rate control based on reinforcement learning. In this solution, an encoding state of a video encoder is determined, the encoding state being associated with encoding of a first video unit by the video encoder. An encoding parameter associated with rate control in the video encoder is determining by a reinforcement learning model and based on the encoding state of the video encoder. A second video unit different from the first video unit is encoded based on the encoding parameter. In this way, it is possible to achieve a better quality of experience (QOE) for real time communication with computation overhead being reduced.Type: ApplicationFiled: February 26, 2025Publication date: June 19, 2025Applicant: Microsoft Technology Licensing, LLCInventors: Jiahao LI, Bin LI, Yan LU, Tom W. HOLCOMB, Mei-Hsuan LU, Andrey MEZENTSEV, Ming-Chieh LEE
-
Patent number: 12262032Abstract: Implementations of the subject matter described herein provide a solution for rate control based on reinforcement learning. In this solution, an encoding state of a video encoder is determined, the encoding state being associated with encoding of a first video unit by the video encoder. An encoding parameter associated with rate control in the video encoder is determined by a reinforcement learning model and based on the encoding state of the video encoder. A second video unit different from the first video unit is encoded based on the encoding parameter. In this way, it is possible to achieve a better quality of experience (QOE) for real time communication with computation overhead being reduced.Type: GrantFiled: June 30, 2020Date of Patent: March 25, 2025Assignee: Microsoft Technology Licensing, LLCInventors: Jiahao Li, Bin Li, Yan Lu, Tom W. Holcomb, Mei-Hsuan Lu, Andrey Mezentsev, Ming-Chieh Lee
-
Publication number: 20240397061Abstract: When encoding/decoding a current block of a current picture using intra block copy (“BC”) prediction, the location of a reference block is constrained so that it can be entirely within an inner search area of the current picture or entirely within an outer search area of the current picture, but cannot overlap both the inner search area and the outer search area. In some hardware-based implementations, on-chip memory buffers sample values of the inner search area, and off-chip memory buffers sample values of the outer search area. By enforcing this constraint on the location of the reference block, an encoder/decoder can avoid memory access operations that are split between on-chip memory and off-chip memory when retrieving the sample values of the reference block. At the same time, a reference block close to the current block may be used for intra BC prediction, helping compression efficiency.Type: ApplicationFiled: August 2, 2024Publication date: November 28, 2024Applicant: Microsoft Technology Licensing, LLCInventors: You Zhou, Chih-Lung Lin, Ming-Chieh Lee
-
Patent number: 12088829Abstract: When encoding/decoding a current block of a current picture using intra block copy (“BC”) prediction, the location of a reference block is constrained so that it can be entirely within an inner search area of the current picture or entirely within an outer search area of the current picture, but cannot overlap both the inner search area and the outer search area. In some hardware-based implementations, on-chip memory buffers sample values of the inner search area, and off-chip memory buffers sample values of the outer search area. By enforcing this constraint on the location of the reference block, an encoder/decoder can avoid memory access operations that are split between on-chip memory and off-chip memory when retrieving the sample values of the reference block. At the same time, a reference block close to the current block may be used for intra BC prediction, helping compression efficiency.Type: GrantFiled: January 24, 2023Date of Patent: September 10, 2024Assignee: Microsoft Technology Licensing, LLCInventors: You Zhou, Chih-Lung Lin, Ming-Chieh Lee
-
Patent number: 11949877Abstract: Innovations in adaptive encoding of screen content based on motion type are described. For example, a video encoder system receives a current picture of a video sequence. The video encoder system determines a current motion type for the video sequence and, based at least in part on the current motion type, sets one or more encoding parameters. Then, the video encoder system encodes the current picture according to the encoding parameter(s). The innovations can be used in real-time encoding scenarios when encoding screen content for a screen sharing application, desktop conferencing application, or other application. In some cases, the innovations allow a video encoder system to adapt compression to different characteristics of screen content at different times within the same video sequence.Type: GrantFiled: October 1, 2021Date of Patent: April 2, 2024Assignee: Microsoft Technology Licensing, LLCInventors: Satya Sasikanth Bendapudi, Ming-Chieh Lee, Yan Lu, Bin Li, Jizhe Jin, Jiahao Li, Shao-Ting Wang
-
Publication number: 20230334322Abstract: Apparatus and methods are disclosed for using machine learning models with private and public domains. Operations can be applied to transform input to a machine learning model in a private domain that is kept secret or otherwise made unavailable to third parties. In one example of the disclosed technology, a method includes applying a private transform to produce transformed input, providing the transformed input to a machine learning model that was trained using a training set modified by the private transform, and generating inferences with the machine learning model using the transformed input. Examples of suitable transforms that can be employed include matrix multiplication, time or spatial domain to frequency domains, and partitioning a neural network model such that an input and at least one hidden layer form part of the private domain, while the remaining layers form part of the public domain.Type: ApplicationFiled: June 23, 2023Publication date: October 19, 2023Applicant: Microsoft Technology Licensing, LLCInventors: Sriram Srinivasan, David Yuheng Zhao, Ming-Chieh Lee, Mu Han
-
Publication number: 20230319292Abstract: Implementations of the subject matter described herein provide a solution for rate control based on reinforcement learning. In this solution, an encoding state of a video encoder is determined, the encoding state being associated with encoding of a first video unit by the video encoder. An encoding parameter associated with rate control in the video encoder is determined by a reinforcement learning model and based on the encoding state of the video encoder. A second video unit different from the first video unit is encoded based on the encoding parameter. In this way, it is possible to achieve a better quality of experience (QOE) for real time communication with computation overhead being reduced.Type: ApplicationFiled: June 30, 2020Publication date: October 5, 2023Applicant: Microsoft Technology Licensing, LLCInventors: Jiahao LI, Bin LI, Yan LU, Tom W. HOLCOMB, Mei-Hsuan LU, Andrey MEZENTSEV, Ming-Chieh LEE
-
Patent number: 11763157Abstract: Apparatus and methods are disclosed for using machine learning models with private and public domains. Operations can be applied to transform input to a machine learning model in a private domain that is kept secret or otherwise made unavailable to third parties. In one example of the disclosed technology, a method includes applying a private transform to produce transformed input, providing the transformed input to a machine learning model that was trained using a training set modified by the private transform, and generating inferences with the machine learning model using the transformed input. Examples of suitable transforms that can be employed include matrix multiplication, time or spatial domain to frequency domains, and partitioning a neural network model such that an input and at least one hidden layer form part of the private domain, while the remaining layers form part of the public domain.Type: GrantFiled: March 24, 2020Date of Patent: September 19, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Sriram Srinivasan, David Yuheng Zhao, Ming-Chieh Lee, Mu Han
-
Publication number: 20230209066Abstract: Techniques are described for efficiently encoding video data by skipping evaluation of certain encoding modes based on various evaluation criteria. In some solutions, intra-block evaluation is performed in a specific order during encoding, and depending on encoding cost calculations of potential intra-block encoding modes, evaluation of some of the potential modes can be skipped. In some solutions, some encoding modes can be skipped depending on whether blocks are simple (e.g., simple vertical, simple horizontal, or both) or non-simple. In some solutions, various criteria are applied to determine whether chroma-from-luma mode evaluation can be skipped. The various solutions can be used independently and/or in combination.Type: ApplicationFiled: February 28, 2023Publication date: June 29, 2023Applicant: Microsoft Technology Licensing, LLCInventors: Thomas W. Holcomb, Jiahao Li, Bin Li, Yan Lu, Mei-Hsuan Lu, Andrey Mikhaylovic Mezentsev, Ming-Chieh Lee
-
Patent number: 11677248Abstract: An electronic device selectively coupled to a first charger and/or a second charger includes a power supply interface, a first comparator, a second comparator, a controller, a first switch circuit, and a second switch circuit. The power supply interface receives a first input voltage and a second input voltage. The first comparator compares the first input voltage with a first reference voltage, so as to generate a first comparison voltage. The second comparator compares the second input voltage with a second reference voltage, so as to generate a second comparison voltage. The controller generates a first control voltage and a second control voltage according to the first comparison voltage and the second comparison voltage. The first switch circuit is selectively enabled or disabled according to the first control voltage. The second switch circuit is selectively enabled or disabled according to the second control voltage.Type: GrantFiled: February 1, 2021Date of Patent: June 13, 2023Assignee: QUANTA COMPUTER INC.Inventors: Hsin-Chih Kuo, Ming-Chieh Lee
-
Publication number: 20230108645Abstract: Innovations in adaptive encoding of screen content based on motion type are described. For example, a video encoder system receives a current picture of a video sequence. The video encoder system determines a current motion type for the video sequence and, based at least in part on the current motion type, sets one or more encoding parameters. Then, the video encoder system encodes the current picture according to the encoding parameter(s). The innovations can be used in real-time encoding scenarios when encoding screen content for a screen sharing application, desktop conferencing application, or other application. In some cases, the innovations allow a video encoder system to adapt compression to different characteristics of screen content at different times within the same video sequence.Type: ApplicationFiled: October 1, 2021Publication date: April 6, 2023Applicant: Microsoft Technology Licensing, LLCInventors: Satya Sasikanth BENDAPUDI, Ming-Chieh LEE, Yan LU, Bin LI, Jizhe JIN, Jiahao LI, Shao-Ting WANG
-
Publication number: 20230108722Abstract: Innovations in allocation of bit rate between video streams using machine learning are described. For example, a controller of a video encoder system receives first feedback values that indicate results of encoding part of a first video sequence (e.g., screen content). The controller also receives second feedback values that indicate results of encoding part of a second video sequence (e.g., camera video content). A machine learning model accepts, as inputs, the first feedback values and second feedback values. The machine learning model produces, as output, a reallocation parameter. The controller determines a first target bit rate and a second target bit rate using the reallocation parameter. A first video encoder encodes one or more pictures of the first video sequence at the first target bit rate, and a second video encoder encodes one or more pictures of the second video sequence at the second target bit rate.Type: ApplicationFiled: October 1, 2021Publication date: April 6, 2023Applicant: Microsoft Technology Licensing, LLCInventors: Satya Sasikanth BENDAPUDI, Ming-Chieh LEE, Yan LU, Bin LI, Jiahao LI
-
Patent number: 11622118Abstract: Techniques are described for efficiently encoding video data by skipping evaluation of certain encoding modes based on various evaluation criteria. In some solutions, intra-block evaluation is performed in a specific order during encoding, and depending on encoding cost calculations of potential intra-block encoding modes, evaluation of some of the potential modes can be skipped. In some solutions, some encoding modes can be skipped depending on whether blocks are simple (e.g., simple vertical, simple horizontal, or both) or non-simple. In some solutions, various criteria are applied to determine whether chroma-from-luma mode evaluation can be skipped. The various solutions can be used independently and/or in combination.Type: GrantFiled: November 9, 2021Date of Patent: April 4, 2023Assignee: Microsoft Technology Licensing, LLCInventors: Thomas W. Holcomb, Jiahao Li, Bin Li, Yan Lu, Mei-Hsuan Lu, Andrey Mikhaylovic Mezentsev, Ming-Chieh Lee
-
Publication number: 20230086944Abstract: A format for use in encoding moving image data, comprising: a sequence of frames including plurality of the frames in which at least a region is encoded using motion estimation; a respective set of motion vector values representing motion vectors of the motion estimation for each respective one of these frames or each respective one of one or more regions within each of such frames; and at least one respective indicator associated with each of the respective frames or regions, indicating whether the respective motion vector values of the respective frame or region are encoded at a first resolution or a second resolution.Type: ApplicationFiled: November 28, 2022Publication date: March 23, 2023Applicant: Microsoft Technology Licensing, LLCInventors: You Zhou, Sergey Silkin, Sergey Sablin, Chih-Lung Lin, Ming-Chieh Lee, Gary J. Sullivan
-
Patent number: 11595667Abstract: When encoding/decoding a current block of a current picture using intra block copy (“BC”) prediction, the location of a reference block is constrained so that it can be entirely within an inner search area of the current picture or entirely within an outer search area of the current picture, but cannot overlap both the inner search area and the outer search area. In some hardware-based implementations, on-chip memory buffers sample values of the inner search area, and off-chip memory buffers sample values of the outer search area. By enforcing this constraint on the location of the reference block, an encoder/decoder can avoid memory access operations that are split between on-chip memory and off-chip memory when retrieving the sample values of the reference block. At the same time, a reference block close to the current block may be used for intra BC prediction, helping compression efficiency.Type: GrantFiled: March 11, 2021Date of Patent: February 28, 2023Assignee: Microsoft Technology Licensing, LLCInventors: You Zhou, Chih-Lung Lin, Ming-Chieh Lee