Patents by Inventor Fangjun PU
Fangjun PU has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20260075235Abstract: Methods and systems for canvas size scalability across the same or different bitstream layers of a video coded bitstream are described. Offset parameters for a conformance window, a reference region of interest (ROI) in a reference layer, and a current ROI in a current layer are received. The width and height of a current ROI and a reference ROI are computed based on the offset parameters and they are used to generate a width and height scaling factor to be used by a reference picture resampling unit to generate an output picture based on the current ROI and the reference ROI.Type: ApplicationFiled: July 2, 2025Publication date: March 12, 2026Applicant: Dolby Laboratories Licensing CorporationInventors: Taoran Lu, Fangjun Pu, Peng Yin, Sean Thomas McCarthy, Tao Chen
-
Publication number: 20260019599Abstract: Methods and systems are described for intra-prediction using template matching (TM) in video coding. The proposed methods include adaptive fusion when using template-based intra mode derivation using the most probable modes (TIMD), and fusion in intra mode prediction with template matching (Intra TMP).Type: ApplicationFiled: December 18, 2023Publication date: January 15, 2026Applicant: DOLBY LABORATORIES LICENSING CORPORATIONInventors: Jeeva Raj Arumugam, Ashwin Natesan, Vaibhav Pandurang Valvaiker, Jay Nitin Shingala, Taoran Lu, Fangjun Pu, Peng Yin, Gary J. Sullivan
-
Patent number: 12506894Abstract: An input image represented in an input domain is received from an input video signal. Forward reshaping is performed on the input image to generate a forward reshaped image represented in a reshaped image domain. Non-reshaping encoding operations are performed to encode the reshaped image into an encoded video signal. At least one of the non-reshaping encoding operations is implemented with an ML model that has been previously trained with training images in one or more training datasets in a preceding training stage. A recipient device of the encoded video signal is caused to generate a reconstructed image from the forward reshaped image.Type: GrantFiled: August 5, 2022Date of Patent: December 23, 2025Assignee: DOLBY LABORATORIES LICENSING CORPORATIONInventors: Peng Yin, Fangjun Pu, Taoran Lu, Arjun Arora, Guan-Ming Su, Tao Chen, Sean Thomas McCarthy, Walter J. Husak
-
Patent number: 12501056Abstract: Given a sequence of images in a first codeword representation, methods, processes, and systems are presented for integrating reshaping into a next generation video codec for encoding and decoding the images, wherein reshaping allows part of the images to be coded in a second codeword representation which allows more efficient compression than using the first codeword representation. A variety of architectures are discussed, including: an out-of-loop reshaping architecture, an in-loop-for intra pictures only reshaping architecture, an in-loop architecture for prediction residuals, and a hybrid in-loop reshaping architecture. Syntax methods for signaling reshaping parameters, and image-encoding methods optimized with respect to reshaping are also presented.Type: GrantFiled: May 16, 2024Date of Patent: December 16, 2025Assignee: Dolby Laboratories Licensing CorporationInventors: Taoran Lu, Fangjun Pu, Peng Yin, Tao Chen, Walter J. Husak
-
Publication number: 20250337880Abstract: Methods are described for template matching (TM) in video coding. The proposed methods include: the use of constrained top and left neighbors in template matching, enabling TM only in coding tree unit boundaries, using approximated reconstructed samples, a new processing pipeline for deriving decoder side intra mode derivation (DIMD) combined with template based intra mode derivation (TIMD), and using filtered pixels from the neighbors, instead of using the reconstructed pixels. Furthermore, methods are described on how template matching may be applied in combination with Intra, sub-partitioning mode, interpolation filtering in intra prediction, block partitioning, bi-prediction with coding unit-level weights, and adaptive motion vector resolution.Type: ApplicationFiled: April 5, 2023Publication date: October 30, 2025Applicant: DOLBY LABORATORIES LICENSING CORPORATIONInventors: Jeeva Raj Arumugam, Jay Nitin Shingala, Ashwin Natesan, Manasi Mahendra Remane, Taoran Lu, Fangjun Pu, Peng Yin
-
Patent number: 12413769Abstract: Methods and systems for canvas size scalability across the same or different bitstream layers of a video coded bitstream are described. Offset parameters for a conformance window, a reference region of interest (ROI) in a reference layer, and a current ROI in a current layer are received. The width and height of a current ROI and a reference ROI are computed based on the offset parameters and they are used to generate a width and height scaling factor to be used by a reference picture resampling unit to generate an output picture based on the current ROI and the reference ROI.Type: GrantFiled: December 18, 2023Date of Patent: September 9, 2025Assignee: Dolby Laboratories Licensing CorporationInventors: Taoran Lu, Fangjun Pu, Peng Yin, Sean Thomas McCarthy, Tao Chen
-
Publication number: 20250254301Abstract: Methods related to the geometric partition mode (GPM) in video coding are described. The proposed methods include: applying adaptive ordering of merge candidates with template matching (ARMC-TM) to derive GPM inter candidate lists, candidates list applying merge motion vector differences in GPM, enabling GPM for all-intra coding units (CUs), using inter and intra template costs in intra-prediction modes of GPM, using GPM partitions to generate templates in template matching, and using neighboring reconstructed samples and an edge criterion to derive top and left-edge intercepts to generate partitioning candidates.Type: ApplicationFiled: April 5, 2023Publication date: August 7, 2025Applicant: DOLBY LABORATORIES LICENSING CORPORATIONInventors: Ashwin Natesan, Jay Nitin Shingala, Jeeva Raj Arumugam, Manasi Mahendra Remane, Vaibhav Pandurang Valvaiker, Taoran Lu, Fangjun Pu, Peng Yin
-
Publication number: 20250254325Abstract: Methods, systems, and bitstream syntax are described for sign prediction in video coding. The method include: selection of top and left neighbors based on an image continuity check, the intra mode of the current coded unit (CU), the merge motion vector, or adaptive motion vector prediction, sign prediction based on residue domain of current CU or neighbor CUs, sign prediction based on approximated reconstruction samples, reducing the number of selected coefficients for sorting, simplifying the sequential search cost, and by combining sign prediction with sign data hiding.Type: ApplicationFiled: April 11, 2023Publication date: August 7, 2025Applicant: DOLBY LABORATORIES LICENSING CORPORATIONInventors: Jay Nitin SHINGALA, Jeeva Raj ARUMUGAM, Manasi Mahendra REMANE, Ashwin NATESAN, Taoran LU, Fangjun PU, Peng YIN
-
Publication number: 20250211799Abstract: Methods, systems, and bitstream syntax are described for the carriage of neural network topology and parameters as related to neural-network-based post filtering (NNPF) in image and video coding. Examples of NNPF SEI messaging as applicable to the MPEG standards for coding video pictures are described at the sequence layer and at the picture layer.Type: ApplicationFiled: April 3, 2023Publication date: June 26, 2025Applicant: DOLBY LABORATORIES LICENSING CORPORATIONInventors: Peng Yin, Arjun Arora, Tong Shao, Taoran Lu, Fangjun Pu, Sean Thomas McCarthy
-
Publication number: 20250203120Abstract: Given a sequence of images in a first codeword representation, methods, processes, and systems are presented for image reshaping using rate distortion optimization, wherein reshaping allows the images to be coded in a second codeword representation which allows more efficient compression than using the first codeword representation. Syntax methods for signaling reshaping parameters are also presented.Type: ApplicationFiled: February 27, 2025Publication date: June 19, 2025Applicant: DOLBY LABORATORIES LICENSING CORPORATIONInventors: Peng Yin, Fangjun Pu, Taoran Lu, Tao Chen, Walter J. Husak, Sean Thomas McCarthy
-
Patent number: 12335500Abstract: Methods and systems for frame rate scalability are described. Support is provided for input and output video sequences with variable frame rate and variable shutter angle across scenes, or for input video sequences with fixed input frame rate and input shutter angle, but allowing a decoder to generate a video output at a different output frame rate and shutter angle than the corresponding input values. Techniques allowing a decoder to decode more computationally-efficiently a specific backward compatible target frame rate and shutter angle among those allowed are also presented.Type: GrantFiled: April 29, 2024Date of Patent: June 17, 2025Assignee: Dolby Laboratories Licensing CorporationInventors: Robin Atkins, Peng Yin, Taoran Lu, Fangjun Pu, Sean Thomas McCarthy, Walter J. Husak, Tao Chen, Guan-Ming Su
-
Publication number: 20250175651Abstract: In a method to improve the coding efficiency of high-dynamic range (HDR) images, a decoder parses sequence processing set (SPS) data from an input coded bitstream to detect that an HDR extension syntax structure is present in the parsed SPS data. It extracts from the HDR extension syntax structure post-processing information that includes one or more of a color space enabled flag, a color enhancement enabled flag, an adaptive reshaping enabled flag, a dynamic range conversion flag, a color correction enabled flag, or an SDR viewable flag. It decodes the input bitstream to generate a preliminary output decoded signal, and generates a second output signal based on the preliminary output signal and the post-processing information.Type: ApplicationFiled: January 27, 2025Publication date: May 29, 2025Applicant: DOLBY LABORATORIES LICENSING CORPORATIONInventors: Peng YIN, Taoran LU, Fangjun PU, Tao CHEN, Walter J. HUSAK
-
Patent number: 12244869Abstract: Given a sequence of images in a first codeword representation, methods, processes, and systems are presented for image reshaping using rate distortion optimization, wherein reshaping allows the images to be coded in a second codeword representation which allows more efficient compression than using the first codeword representation. Syntax methods for signaling reshaping parameters are also presented.Type: GrantFiled: March 29, 2022Date of Patent: March 4, 2025Assignee: DOLBY LABORATORIES LICENSING CORPORATIONInventors: Peng Yin, Fangjun Pu, Taoran Lu, Tao Chen, Walter J. Husak, Sean Thomas McCarthy
-
Patent number: 12244867Abstract: A quantization parameter signalling mechanism for both SDR and HDR content in video coding is described using two approaches. The first approach is to send the user-defined QpC table directly in high level syntax. This leads to more flexible and efficient QP control for future codec development and video content coding. The second approach is to signal luma and chroma QPs independently. This approach eliminates the need for QpC tables and removes the dependency of chroma quantization parameter on luma QP.Type: GrantFiled: November 10, 2023Date of Patent: March 4, 2025Assignee: Dolby Laboratories Licensing CorporationInventors: Fangjun Pu, Taoran Lu, Peng Yin, Sean Thomas McCarthy
-
Publication number: 20250063199Abstract: A quantization parameter signaling mechanism for both SDR and HDR content in video coding is described using two approaches. The first approach is to send the user-defined QpC table directly in high level syntax. This leads to more flexible and efficient QP control for future codec development and video content coding. The second approach is to signal luma and chroma QPs independently. This approach eliminates the need for QpC tables and removes the dependency of chroma quantization parameter on luma QP.Type: ApplicationFiled: November 4, 2024Publication date: February 20, 2025Applicant: Dolby Laboratories Licensing CorporationInventors: Fangjun Pu, Taoran Lu, Peng Yin, Sean Thomas McCarthy
-
Patent number: 12212786Abstract: In a method to improve the coding efficiency of high-dynamic range (HDR) images, a decoder parses sequence processing set (SPS) data from an input coded bitstream to detect that an HDR extension syntax structure is present in the parsed SPS data. It extracts from the HDR extension syntax structure post-processing information that includes one or more of a color space enabled flag, a color enhancement enabled flag, an adaptive reshaping enabled flag, a dynamic range conversion flag, a color correction enabled flag, or an SDR viewable flag. It decodes the input bitstream to generate a preliminary output decoded signal, and generates a second output signal based on the preliminary output signal and the post-processing information.Type: GrantFiled: September 19, 2023Date of Patent: January 28, 2025Assignee: DOLBY LABORATORIES LICENSING CORPORATIONInventors: Peng Yin, Taoran Lu, Fangjun Pu, Tao Chen, Walter J. Husak
-
Publication number: 20240422345Abstract: An input image represented in an input domain is received from an input video signal. Forward reshaping is performed on the input image to generate a forward reshaped image represented in a reshaped image domain. Non-reshaping encoding operations are performed to encode the reshaped image into an encoded video signal. At least one of the non-reshaping encoding operations is implemented with an ML model that has been previously trained with training images in one or more training datasets in a preceding training stage. A recipient device of the encoded video signal is caused to generate a reconstructed image from the forward reshaped image.Type: ApplicationFiled: August 5, 2022Publication date: December 19, 2024Applicant: DOLBY LABORATORIES LICENSING CORPORATIONInventors: Peng YIN, Fangjun PU, Taoran LU, Arjun ARORA, Guan-Ming SU, Tao CHEN, Sean Thomas MCCARTHY, Walter J. HUSAK
-
Publication number: 20240357112Abstract: Methods, systems, and bitstream syntax are described for the fusion of latent features in multi-level, end-to-end, neural networks used in image and video compression. The fused architecture may be static or dynamic based on image characteristics (e.g., natural images versus screen content images) or other coding parameters, such as bitrate constrains or rate-distortion optimization. A variety of multi-level fusion architectures are discussed.Type: ApplicationFiled: August 3, 2022Publication date: October 24, 2024Applicant: Dolby Laboratories Licensing CorporationInventors: Arunkumar MOHANANCHETTIAR, Jay Nitin SHINGALA, Pankaj SHARMA, Nijil KOLLERI, Peng YIN, Arjun ARORA, Fangjun PU, Taoran LU, Sean Thomas MCCARTHY, Walter J. HUSAK
-
Patent number: 12108061Abstract: Methods and systems for frame rate scalability are described. Support is provided for input and output video sequences with variable frame rate and variable shutter angle across scenes, or for input video sequences with fixed input frame rate and input shutter angle, but allowing a decoder to generate a video output at a different output frame rate and shutter angle than the corresponding input values. Techniques allowing a decoder to decode more computationally-efficiently a specific backward compatible target frame rate and shutter angle among those allowed are also presented.Type: GrantFiled: March 26, 2024Date of Patent: October 1, 2024Assignee: Dolby Laboratories Licensing CorporationInventors: Robin Atkins, Peng Yin, Taoran Lu, Fangjun Pu, Sean Thomas McCarthy, Walter J. Husak, Tao Chen, Guan-Ming Su
-
Patent number: 12108060Abstract: Methods and systems for frame rate scalability are described. Support is provided for input and output video sequences with variable frame rate and variable shutter angle across scenes, or for input video sequences with fixed input frame rate and input shutter angle, but allowing a decoder to generate a video output at a different output frame rate and shutter angle than the corresponding input values. Techniques allowing a decoder to decode more computationally-efficiently a specific backward compatible target frame rate and shutter angle among those allowed are also presented.Type: GrantFiled: September 28, 2023Date of Patent: October 1, 2024Assignee: Dolby Laboratories Licensing CorporationInventors: Robin Atkins, Peng Yin, Taoran Lu, Fangjun Pu, Sean Thomas McCarthy, Walter J. Husak, Tao Chen, Guan-Ming Su