Patents by Inventor Fangjun PU
Fangjun PU has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11490095Abstract: Given a sequence of images in a first codeword representation, methods, processes, and systems are presented for integrating reshaping into a next generation video codec for encoding and decoding the images, wherein reshaping allows part of the images to be coded in a second codeword representation which allows more efficient compression than using the first codeword representation. A variety of architectures are discussed, including: an out-of-loop reshaping architecture, an in-loop-for intra pictures only reshaping architecture, an in-loop architecture for prediction residuals, and a hybrid in-loop reshaping architecture. Syntax methods for signaling reshaping parameters, and image-encoding methods optimized with respect to reshaping are also presented.Type: GrantFiled: April 26, 2021Date of Patent: November 1, 2022Assignee: DOLBY LABORATORIES LICENSING CORPORATIONInventors: Taoran Lu, Fangjun Pu, Peng Yin, Tao Chen, Walter J. Husak
-
Publication number: 20220286667Abstract: Methods, systems, and bitstream syntax are described for canvas size, single layer or multi-layer, sealable decoding, with support for regions of interest (ROI). using a decoder supporting reference picture resampling. Offset parameters for a region of interest in a current picture and offset parameters for an ROI in a reference picture are taken into consideration when computing scaling factors to apply reference picture resampling Syntax elements for supporting ROI regions under reference picture resampling arc also presented.Type: ApplicationFiled: March 11, 2020Publication date: September 8, 2022Applicant: Dolby Laboratories Licensing CorporationInventors: Taoran LU, Fangjun PU, Peng YIN, Sean Thomas McCarthy, Tao CHEN
-
Publication number: 20220279210Abstract: A quantization parameter signalling mechanism for both SDR and HDR content in video coding is described using two approaches. The first approach is to send the user-defined Qpc table directly in high level syntax. This leads to more flexible and efficient QP control for future codec development and video content coding. The second approach is to signal luma and chroma QPs independently. This approach eliminates the need for Qpc tables and removes the dependency of chroma quantization parameter on luma QP.Type: ApplicationFiled: May 27, 2020Publication date: September 1, 2022Applicant: Dolby Laboratories Licensing CorporationInventors: Fangjun PU, Toaran LU, Peng Yin, Sean Thomas MCCARTHY
-
Patent number: 11395009Abstract: Given a sequence of images in a first codeword representation, methods, processes, and systems are presented for image reshaping using rate distortion optimization, wherein reshaping allows the images to be coded in a second codeword representation which allows more efficient compression than using the first codeword representation. Syntax methods for signaling reshaping parameters are also presented.Type: GrantFiled: February 13, 2019Date of Patent: July 19, 2022Assignee: Dolby Laboratories Licensing CorporationInventors: Peng Yin, Fangjun Pu, Taoran Lu, Tao Chen, Walter J. Husak, Sean Thomas McCarthy
-
Publication number: 20220224946Abstract: Given a sequence of images in a first codeword representation, methods, processes, and systems are presented for image reshaping using rate distortion optimization, wherein reshaping allows the images to be coded in a second codeword representation which allows more efficient compression than using the first codeword representation. Syntax methods for signaling reshaping parameters are also presented.Type: ApplicationFiled: March 29, 2022Publication date: July 14, 2022Applicant: DOLBY LABORATORIES LICENSING CORPORATIONInventors: Peng Yin, Fangjun Pu, Taoran Lu, Tao Chen, Walter J. Husak, Sean Thomas McCarthy
-
Publication number: 20220166991Abstract: Methods and systems for frame rate scalability are described. Support is provided for input and output video sequences with variable frame rate and variable shutter angle across scenes, or for input video sequences with fixed input frame rate and input shutter angle, but allowing a decoder to generate a video output at a different output frame rate and shutter angle than the corresponding input values. Techniques allowing a decoder to decode more computationally-efficiently a specific backward compatible target frame rate and shutter angle among those allowed are also presented.Type: ApplicationFiled: February 8, 2022Publication date: May 26, 2022Applicant: Dolby Laboratories Licensing CorporationInventors: Robin Atkins, Peng YIN, Taoran LU, Fangjun PU, Sean Thomas MCCARTHY, Walter J. HUSAK, Tao CHEN, Guan-Ming SU
-
Publication number: 20220150548Abstract: In a method to improve the coding efficiency of high-dynamic range (HDR) images, a decoder parses sequence processing set (SPS) data from an input coded bitstream to detect that an HDR extension syntax structure is present in the parsed SPS data. It extracts from the HDR extension syntax structure post-processing information that includes one or more of a color space enabled flag, a color enhancement enabled flag, an adaptive reshaping enabled flag, a dynamic range conversion flag, a color correction enabled flag, or an SDR viewable flag. It decodes the input bitstream to generate a preliminary output decoded signal, and generates a second output signal based on the preliminary output signal and the post-processing information.Type: ApplicationFiled: January 21, 2022Publication date: May 12, 2022Applicant: Dolby Laboratories Licensing CorporationInventors: Peng YIN, Taoran LU, Fangjun PU, Tao CHEN, Walter J. HUSAK
-
Patent number: 11323728Abstract: Methods and systems for frame rate scalability are described. Support is provided for input and output video sequences with variable frame rate and variable shutter angle across scenes, or for input video sequences with fixed input frame rate and input shutter angle, but allowing a decoder to generate a video output at a different output frame rate and shutter angle than the corresponding input values. Techniques allowing a decoder to decode more computationally-efficiently a specific backward compatible target frame rate and shutter angle among those allowed are also presented.Type: GrantFiled: March 25, 2021Date of Patent: May 3, 2022Assignee: Dolby Laboratories Licensing CorporationInventors: Robin Atkins, Peng Yin, Taoran Lu, Fangjun Pu, Sean Thomas McCarthy, Walter J. Husak, Tao Chen, Guan-Ming Su
-
Patent number: 11277623Abstract: To support lossless mode at the block level when in-loop reshaping (LMCS) is enabled, the following changes are proposed to the existing LMCS pipeline. In intra mode, encode lossless blocks in the original domain, thus bypassing inverse mapping after reconstruction in the decoder. In inter mode, encode lossless blocks in the original domain, thus bypassing both forward mapping after motion compensation and inverse mapping after reconstruction in the decoder. In both modes, disable any LMCS-related color scaling.Type: GrantFiled: September 1, 2020Date of Patent: March 15, 2022Assignee: Dolby Laboratories Licensing CorporationInventors: Peng Yin, Taoran Lu, Fangjun Pu, Sean Thomas McCarthy
-
Publication number: 20220038723Abstract: Methods and systems for frame rate scalability are described. Support is provided for input and output video sequences with variable frame rate and variable shutter angle across scenes, or for input video sequences with fixed input frame rate and input shutter angle, but allowing a decoder to generate a video output at a different output frame rate and shutter angle than the corresponding input values. Techniques allowing a decoder to decode more computationally-efficiently a specific backward compatible target frame rate and shutter angle among those allowed are also presented.Type: ApplicationFiled: March 11, 2020Publication date: February 3, 2022Applicant: Dolby Laboratories Licensing CorporationInventors: Robin Atkins, Peng Yin, Taoran Lu, Fangjun Pu, Sean Thomas McCarthy, Walter J. Husak, Tao Chen, Guan-Ming Su
-
Patent number: 11234021Abstract: In a method to improve the coding efficiency of high-dynamic range (HDR) images, a decoder parses sequence processing set (SPS) data from an input coded bitstream to detect that an HDR extension syntax structure is present in the parsed SPS data. It extracts from the HDR extension syntax structure post-processing information that includes one or more of a color space enabled flag, a color enhancement enabled flag, an adaptive reshaping enabled flag, a dynamic range conversion flag, a color correction enabled flag, or an SDR viewable flag. It decodes the input bitstream to generate a preliminary output decoded signal, and generates a second output signal based on the preliminary output signal and the post-processing information.Type: GrantFiled: March 16, 2021Date of Patent: January 25, 2022Assignee: Dolby Laboratories Licensing CorporationInventors: Peng Yin, Taoran Lu, Fangjun Pu, Tao Chen, Walter J. Husak
-
Patent number: 11172237Abstract: Methods, processes, and systems are presented for inter-layer scaling and mapping to perform dynamic-range scalability in video coding using single-loop video decoders. Two approaches are proposed: a) A mapping function is applied to each of the color components, b) a mapping function is applied to the luma component and luma-based scaling is applied to the chroma components. Both schemes may be combined with existing schemes for in-loop reshaping, such as luma mapping and chroma residual scaling employed in the versatile video codec (VVC).Type: GrantFiled: August 28, 2020Date of Patent: November 9, 2021Assignee: Dolby Laboratories Licensing CorporationInventors: Taoran Lu, Peng Yin, Fangjun Pu
-
Patent number: 11166023Abstract: Methods for quantization parameter (QP) prediction are presented. In a coded bitstream that includes QP values, instead of simply embedding all delta QP values in the bitstream, the bitstream may include QP-related syntax elements that allow a decoder to reconstruct the delta QP values using luma-based QP prediction. Encoding and decoding bitstream examples are provided where delta QP values may be predicted using information from just the luminance values of the prediction blocks of the current block or by additional luminance information from its known neighbors (e.g., from the left or above blocks) and a base QP value.Type: GrantFiled: March 21, 2018Date of Patent: November 2, 2021Assignee: Dolby Laboratories Licensing CorporationInventors: Fangjun Pu, Taoran Lu, Peng Yin, Tao Chen
-
Publication number: 20210274222Abstract: In a method to improve the coding efficiency of high-dynamic range (HDR) images, a decoder parses sequence processing set (SPS) data from an input coded bitstream to detect that an HDR extension syntax structure is present in the parsed SPS data. It extracts from the HDR extension syntax structure post-processing information that includes one or more of a color space enabled flag, a color enhancement enabled flag, an adaptive reshaping enabled flag, a dynamic range conversion flag, a color correction enabled flag, or an SDR viewable flag. It decodes the input bitstream to generate a preliminary output decoded signal, and generates a second output signal based on the preliminary output signal and the post-processing information.Type: ApplicationFiled: March 16, 2021Publication date: September 2, 2021Applicant: Dolby Laboratories Licensing CorporationInventors: Peng YIN, Taoran LU, Fangjun PU, Tao CHEN, Walter J. HUSAK
-
Publication number: 20210211738Abstract: Given a sequence of images in a first codeword representation, methods, processes, and systems are presented for image reshaping using rate distortion optimization, wherein reshaping allows the images to be coded in a second codeword representation which allows more efficient compression than using the first codeword representation. Syntax methods for signaling reshaping parameters are also presented.Type: ApplicationFiled: February 13, 2019Publication date: July 8, 2021Applicant: DOLBY LABORATORIES LICENSING CORPORATIONInventors: Peng Yin, Fangjun Pu, Taoran Lu, Tao Chen, Walter J. Husak, Sean Thomas McCarthy
-
Publication number: 20210211688Abstract: Methods and systems for frame rate scalability are described. Support is provided for input and output video sequences with variable frame rate and variable shutter angle across scenes, or for input video sequences with fixed input frame rate and input shutter angle, but allowing a decoder to generate a video output at a different output frame rate and shutter angle than the corresponding input values. Techniques allowing a decoder to decode more computationally-efficiently a specific backward compatible target frame rate and shutter angle among those allowed are also presented.Type: ApplicationFiled: March 25, 2021Publication date: July 8, 2021Applicant: Dolby Laboratories Licensing CorporationInventors: Robin Atkins, Peng Yin, Taoran Lu, Fangjun Pu, Sean Thomas McCarthy, Walter J. Husak, Tao Chen, Guan-Ming Su
-
Patent number: 10999585Abstract: Methods and systems for frame rate scalability are described. Support is provided for input and output video sequences with variable frame rate and variable shutter angle across scenes, or for input video sequences with fixed input frame rate and input shutter angle, but allowing a decoder to generate a video output at a different output frame rate and shutter angle than the corresponding input values. Techniques allowing a decoder to decode more computationally-efficiently a specific backward compatible target frame rate and shutter angle among those allowed are also presented.Type: GrantFiled: June 15, 2020Date of Patent: May 4, 2021Assignee: Dolby Laboratories Licensing CorporationInventors: Robin Atkins, Peng Yin, Taoran Lu, Fangjun Pu, Sean Thomas McCarthy, Walter J. Husak, Tao Chen, Guan-Ming Su
-
Patent number: 10992941Abstract: Given a sequence of images in a first codeword representation, methods, processes, and systems are presented for integrating reshaping into a next generation video codec for encoding and decoding the images, wherein reshaping allows part of the images to be coded in a second codeword representation which allows more efficient compression than using the first codeword representation. A variety of architectures are discussed, including: an out-of-loop reshaping architecture, an in-loop-for intra pictures only reshaping architecture, an in-loop architecture for prediction residuals, and a hybrid in-loop reshaping architecture. Syntax methods for signaling reshaping parameters, and image-encoding methods optimized with respect to reshaping are also presented.Type: GrantFiled: June 29, 2018Date of Patent: April 27, 2021Assignee: Dolby Laboratories Licensing CorporationInventors: Taoran Lu, Fangjun Pu, Peng Yin, Tao Chen, Walter J. Husak
-
Patent number: 10972756Abstract: In a method to improve the coding efficiency of high-dynamic range (HDR) images, a decoder parses sequence processing set (SPS) data from an input coded bitstream to detect that an HDR extension syntax structure is present in the parsed SPS data. It extracts from the HDR extension syntax structure post-processing information that includes one or more of a color space enabled flag, a color enhancement enabled flag, an adaptive reshaping enabled flag, a dynamic range conversion flag, a color correction enabled flag, or an SDR viewable flag. It decodes the input bitstream to generate a preliminary output decoded signal, and generates a second output signal based on the preliminary output signal and the post-processing information.Type: GrantFiled: December 11, 2019Date of Patent: April 6, 2021Assignee: Dolby Laboratories Licensing CorporationInventors: Peng Yin, Taoran Lu, Fangjun Pu, Tao Chen, Walter J. Husak
-
Publication number: 20210084307Abstract: To support lossless mode at the block level when in-loop reshaping (LMCS) is enabled, the following changes are proposed to the existing LMCS pipeline. In intra mode, encode lossless blocks in the original domain, thus bypassing inverse mapping after reconstruction in the decoder. In inter mode, encode lossless blocks in the original domain, thus bypassing both forward mapping after motion compensation and inverse mapping after reconstruction in the decoder. In both modes, disable any LMCS-related color scaling.Type: ApplicationFiled: September 1, 2020Publication date: March 18, 2021Applicant: Dolby Laboratories Licensing CorporationInventors: Peng Yin, Taoran Lu, Fangjun Pu, Sean Thomas McCarthy