Patents by Inventor Taoran Lu
Taoran Lu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20220150548Abstract: In a method to improve the coding efficiency of high-dynamic range (HDR) images, a decoder parses sequence processing set (SPS) data from an input coded bitstream to detect that an HDR extension syntax structure is present in the parsed SPS data. It extracts from the HDR extension syntax structure post-processing information that includes one or more of a color space enabled flag, a color enhancement enabled flag, an adaptive reshaping enabled flag, a dynamic range conversion flag, a color correction enabled flag, or an SDR viewable flag. It decodes the input bitstream to generate a preliminary output decoded signal, and generates a second output signal based on the preliminary output signal and the post-processing information.Type: ApplicationFiled: January 21, 2022Publication date: May 12, 2022Applicant: Dolby Laboratories Licensing CorporationInventors: Peng YIN, Taoran LU, Fangjun PU, Tao CHEN, Walter J. HUSAK
-
Patent number: 11323728Abstract: Methods and systems for frame rate scalability are described. Support is provided for input and output video sequences with variable frame rate and variable shutter angle across scenes, or for input video sequences with fixed input frame rate and input shutter angle, but allowing a decoder to generate a video output at a different output frame rate and shutter angle than the corresponding input values. Techniques allowing a decoder to decode more computationally-efficiently a specific backward compatible target frame rate and shutter angle among those allowed are also presented.Type: GrantFiled: March 25, 2021Date of Patent: May 3, 2022Assignee: Dolby Laboratories Licensing CorporationInventors: Robin Atkins, Peng Yin, Taoran Lu, Fangjun Pu, Sean Thomas McCarthy, Walter J. Husak, Tao Chen, Guan-Ming Su
-
Patent number: 11284095Abstract: The precision of up-sampling operations in a layered coding system is preserved when operating on video data with high bit-depth. In response to bit-depth requirements of the video coding or decoding system, scaling and rounding parameters are determined for a separable up-scaling filter. Input data are first filtered across a first spatial direction using a first rounding parameter to generate first up-sampled data. First intermediate data are generated by scaling the first up-sampled data using a first shift parameter. The intermediate data are then filtered across a second spatial direction using a second rounding parameter to generate second up-sampled data. Second intermediate data are generated by scaling the second up-sampled data using a second shift parameter. Final up-sampled data may be generated by clipping the second intermediate data.Type: GrantFiled: March 19, 2021Date of Patent: March 22, 2022Assignee: Dolby Laboratories Licensing CorporationInventors: Peng Yin, Taoran Lu, Tao Chen
-
Patent number: 11277623Abstract: To support lossless mode at the block level when in-loop reshaping (LMCS) is enabled, the following changes are proposed to the existing LMCS pipeline. In intra mode, encode lossless blocks in the original domain, thus bypassing inverse mapping after reconstruction in the decoder. In inter mode, encode lossless blocks in the original domain, thus bypassing both forward mapping after motion compensation and inverse mapping after reconstruction in the decoder. In both modes, disable any LMCS-related color scaling.Type: GrantFiled: September 1, 2020Date of Patent: March 15, 2022Assignee: Dolby Laboratories Licensing CorporationInventors: Peng Yin, Taoran Lu, Fangjun Pu, Sean Thomas McCarthy
-
Publication number: 20220038723Abstract: Methods and systems for frame rate scalability are described. Support is provided for input and output video sequences with variable frame rate and variable shutter angle across scenes, or for input video sequences with fixed input frame rate and input shutter angle, but allowing a decoder to generate a video output at a different output frame rate and shutter angle than the corresponding input values. Techniques allowing a decoder to decode more computationally-efficiently a specific backward compatible target frame rate and shutter angle among those allowed are also presented.Type: ApplicationFiled: March 11, 2020Publication date: February 3, 2022Applicant: Dolby Laboratories Licensing CorporationInventors: Robin Atkins, Peng Yin, Taoran Lu, Fangjun Pu, Sean Thomas McCarthy, Walter J. Husak, Tao Chen, Guan-Ming Su
-
Patent number: 11234021Abstract: In a method to improve the coding efficiency of high-dynamic range (HDR) images, a decoder parses sequence processing set (SPS) data from an input coded bitstream to detect that an HDR extension syntax structure is present in the parsed SPS data. It extracts from the HDR extension syntax structure post-processing information that includes one or more of a color space enabled flag, a color enhancement enabled flag, an adaptive reshaping enabled flag, a dynamic range conversion flag, a color correction enabled flag, or an SDR viewable flag. It decodes the input bitstream to generate a preliminary output decoded signal, and generates a second output signal based on the preliminary output signal and the post-processing information.Type: GrantFiled: March 16, 2021Date of Patent: January 25, 2022Assignee: Dolby Laboratories Licensing CorporationInventors: Peng Yin, Taoran Lu, Fangjun Pu, Tao Chen, Walter J. Husak
-
Patent number: 11172237Abstract: Methods, processes, and systems are presented for inter-layer scaling and mapping to perform dynamic-range scalability in video coding using single-loop video decoders. Two approaches are proposed: a) A mapping function is applied to each of the color components, b) a mapping function is applied to the luma component and luma-based scaling is applied to the chroma components. Both schemes may be combined with existing schemes for in-loop reshaping, such as luma mapping and chroma residual scaling employed in the versatile video codec (VVC).Type: GrantFiled: August 28, 2020Date of Patent: November 9, 2021Assignee: Dolby Laboratories Licensing CorporationInventors: Taoran Lu, Peng Yin, Fangjun Pu
-
Patent number: 11166023Abstract: Methods for quantization parameter (QP) prediction are presented. In a coded bitstream that includes QP values, instead of simply embedding all delta QP values in the bitstream, the bitstream may include QP-related syntax elements that allow a decoder to reconstruct the delta QP values using luma-based QP prediction. Encoding and decoding bitstream examples are provided where delta QP values may be predicted using information from just the luminance values of the prediction blocks of the current block or by additional luminance information from its known neighbors (e.g., from the left or above blocks) and a base QP value.Type: GrantFiled: March 21, 2018Date of Patent: November 2, 2021Assignee: Dolby Laboratories Licensing CorporationInventors: Fangjun Pu, Taoran Lu, Peng Yin, Tao Chen
-
Publication number: 20210289212Abstract: Sample data and metadata related to spatial regions in images may be received from a coded video signal. It is determined whether specific spatial regions in the images correspond to a specific region of luminance levels. In response to determining the specific spatial regions correspond to the specific region of luminance levels, signal processing and video compression operations are performed on sets of samples in the specific spatial regions. The signal processing and video compression operations are at least partially dependent on the specific region of luminance levels.Type: ApplicationFiled: May 28, 2021Publication date: September 16, 2021Applicant: DOLBY LABORATORIES LICENSING CORPORATIONInventors: Peng YIN, Guan-Ming SU, Taoran LU, Tao CHEN, Walter J. HUSAK
-
Publication number: 20210281866Abstract: The precision of up-sampling operations in a layered coding system is preserved when operating on video data with high bit-depth. In response to bit-depth requirements of the video coding or decoding system, scaling and rounding parameters are determined for a separable up-scaling filter. Input data are first filtered across a first spatial direction using a first rounding parameter to generate first up-sampled data. First intermediate data are generated by scaling the first up-sampled data using a first shift parameter. The intermediate data are then filtered across a second spatial direction using a second rounding parameter to generate second up-sampled data. Second intermediate data are generated by scaling the second up-sampled data using a second shift parameter. Final up-sampled data may be generated by clipping the second intermediate data.Type: ApplicationFiled: March 19, 2021Publication date: September 9, 2021Applicant: DOLBY LABORATORIES LICENSING CORPORATIONInventors: Peng YIN, Taoran LU, Tao CHEN
-
Publication number: 20210274222Abstract: In a method to improve the coding efficiency of high-dynamic range (HDR) images, a decoder parses sequence processing set (SPS) data from an input coded bitstream to detect that an HDR extension syntax structure is present in the parsed SPS data. It extracts from the HDR extension syntax structure post-processing information that includes one or more of a color space enabled flag, a color enhancement enabled flag, an adaptive reshaping enabled flag, a dynamic range conversion flag, a color correction enabled flag, or an SDR viewable flag. It decodes the input bitstream to generate a preliminary output decoded signal, and generates a second output signal based on the preliminary output signal and the post-processing information.Type: ApplicationFiled: March 16, 2021Publication date: September 2, 2021Applicant: Dolby Laboratories Licensing CorporationInventors: Peng YIN, Taoran LU, Fangjun PU, Tao CHEN, Walter J. HUSAK
-
Publication number: 20210243478Abstract: In a method to improve backwards compatibility when decoding high-dynamic range images coded in a wide color gamut (WCG) space which may not be compatible with legacy color spaces, hue and/or saturation values of images in an image database are computed for both a legacy color space (say, YCbCr-gamma) and a preferred WCG color space (say, IPT-PQ). Based on a cost function, a reshaped color space is computed so that the distance between the hue values in the legacy color space and rotated hue values in the preferred color space is minimized. HDR images are coded in the reshaped color space. Legacy devices can still decode standard dynamic range images assuming they are coded in the legacy color space, while updated devices can use color reshaping information to decode HDR images in the preferred color space at full dynamic range.Type: ApplicationFiled: April 20, 2021Publication date: August 5, 2021Applicant: Dolby Laboratories Licensing CorporationInventors: Robin ATKINS, Peng YIN, Taoran LU, Jaclyn Anne PYTLARZ
-
Publication number: 20210243477Abstract: In a method to improve backwards compatibility when decoding high-dynamic range images coded in a wide color gamut (WCG) space which may not be compatible with legacy color spaces, hue and/or saturation values of images in an image database are computed for both a legacy color space (say, YCbCr-gamma) and a preferred WCG color space (say, IPT-PQ). Based on a cost function, a reshaped color space is computed so that the distance between the hue values in the legacy color space and rotated hue values in the preferred color space is minimized HDR images are coded in the reshaped color space. Legacy devices can still decode standard dynamic range images assuming they are coded in the legacy color space, while updated devices can use color reshaping information to decode HDR images in the preferred color space at full dynamic range.Type: ApplicationFiled: April 20, 2021Publication date: August 5, 2021Applicant: Dolby Laboratories Licensing CorporationInventors: Robin ATKINS, Peng YIN, Taoran LU, Jaclyn Anne PYTLARZ
-
Publication number: 20210211738Abstract: Given a sequence of images in a first codeword representation, methods, processes, and systems are presented for image reshaping using rate distortion optimization, wherein reshaping allows the images to be coded in a second codeword representation which allows more efficient compression than using the first codeword representation. Syntax methods for signaling reshaping parameters are also presented.Type: ApplicationFiled: February 13, 2019Publication date: July 8, 2021Applicant: DOLBY LABORATORIES LICENSING CORPORATIONInventors: Peng Yin, Fangjun Pu, Taoran Lu, Tao Chen, Walter J. Husak, Sean Thomas McCarthy
-
Publication number: 20210211688Abstract: Methods and systems for frame rate scalability are described. Support is provided for input and output video sequences with variable frame rate and variable shutter angle across scenes, or for input video sequences with fixed input frame rate and input shutter angle, but allowing a decoder to generate a video output at a different output frame rate and shutter angle than the corresponding input values. Techniques allowing a decoder to decode more computationally-efficiently a specific backward compatible target frame rate and shutter angle among those allowed are also presented.Type: ApplicationFiled: March 25, 2021Publication date: July 8, 2021Applicant: Dolby Laboratories Licensing CorporationInventors: Robin Atkins, Peng Yin, Taoran Lu, Fangjun Pu, Sean Thomas McCarthy, Walter J. Husak, Tao Chen, Guan-Ming Su
-
Patent number: 11032553Abstract: Sample data and metadata related to spatial regions in images may be received from a coded video signal. It is determined whether specific spatial regions in the images correspond to a specific region of luminance levels. In response to determining the specific spatial regions correspond to the specific region of luminance levels, signal processing and video compression operations are performed on sets of samples in the specific spatial regions. The signal processing and video compression operations are at least partially dependent on the specific region of luminance levels.Type: GrantFiled: February 19, 2015Date of Patent: June 8, 2021Assignee: Dolby Laboratories Licensing CorporationInventors: Peng Yin, Guan-Ming Su, Taoran Lu, Tao Chen, Walter J. Husak
-
Patent number: 11025961Abstract: In a method to improve backwards compatibility when decoding high-dynamic range images coded in a wide color gamut (WCG) space which may not be compatible with legacy color spaces, hue and/or saturation values of images in an image database are computed for both a legacy color space (say, YCbCr-gamma) and a preferred WCG color space (say, IPT-PQ). Based on a cost function, a reshaped color space is computed so that the distance between the hue values in the legacy color space and rotated hue values in the preferred color space is minimized HDR images are coded in the reshaped color space. Legacy devices can still decode standard dynamic range images assuming they are coded in the legacy color space, while updated devices can use color reshaping information to decode HDR images in the preferred color space at full dynamic range.Type: GrantFiled: August 6, 2019Date of Patent: June 1, 2021Assignee: Dolby Laboratories Licensing CorporationInventors: Robin Atkins, Peng Yin, Taoran Lu, Jaclyn Anne Pytlarz
-
Patent number: 10999585Abstract: Methods and systems for frame rate scalability are described. Support is provided for input and output video sequences with variable frame rate and variable shutter angle across scenes, or for input video sequences with fixed input frame rate and input shutter angle, but allowing a decoder to generate a video output at a different output frame rate and shutter angle than the corresponding input values. Techniques allowing a decoder to decode more computationally-efficiently a specific backward compatible target frame rate and shutter angle among those allowed are also presented.Type: GrantFiled: June 15, 2020Date of Patent: May 4, 2021Assignee: Dolby Laboratories Licensing CorporationInventors: Robin Atkins, Peng Yin, Taoran Lu, Fangjun Pu, Sean Thomas McCarthy, Walter J. Husak, Tao Chen, Guan-Ming Su
-
Patent number: 10992941Abstract: Given a sequence of images in a first codeword representation, methods, processes, and systems are presented for integrating reshaping into a next generation video codec for encoding and decoding the images, wherein reshaping allows part of the images to be coded in a second codeword representation which allows more efficient compression than using the first codeword representation. A variety of architectures are discussed, including: an out-of-loop reshaping architecture, an in-loop-for intra pictures only reshaping architecture, an in-loop architecture for prediction residuals, and a hybrid in-loop reshaping architecture. Syntax methods for signaling reshaping parameters, and image-encoding methods optimized with respect to reshaping are also presented.Type: GrantFiled: June 29, 2018Date of Patent: April 27, 2021Assignee: Dolby Laboratories Licensing CorporationInventors: Taoran Lu, Fangjun Pu, Peng Yin, Tao Chen, Walter J. Husak
-
Patent number: 10972756Abstract: In a method to improve the coding efficiency of high-dynamic range (HDR) images, a decoder parses sequence processing set (SPS) data from an input coded bitstream to detect that an HDR extension syntax structure is present in the parsed SPS data. It extracts from the HDR extension syntax structure post-processing information that includes one or more of a color space enabled flag, a color enhancement enabled flag, an adaptive reshaping enabled flag, a dynamic range conversion flag, a color correction enabled flag, or an SDR viewable flag. It decodes the input bitstream to generate a preliminary output decoded signal, and generates a second output signal based on the preliminary output signal and the post-processing information.Type: GrantFiled: December 11, 2019Date of Patent: April 6, 2021Assignee: Dolby Laboratories Licensing CorporationInventors: Peng Yin, Taoran Lu, Fangjun Pu, Tao Chen, Walter J. Husak