Patents by Inventor Fangjun PU

Fangjun PU has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20260075235
    Abstract: Methods and systems for canvas size scalability across the same or different bitstream layers of a video coded bitstream are described. Offset parameters for a conformance window, a reference region of interest (ROI) in a reference layer, and a current ROI in a current layer are received. The width and height of a current ROI and a reference ROI are computed based on the offset parameters and they are used to generate a width and height scaling factor to be used by a reference picture resampling unit to generate an output picture based on the current ROI and the reference ROI.
    Type: Application
    Filed: July 2, 2025
    Publication date: March 12, 2026
    Applicant: Dolby Laboratories Licensing Corporation
    Inventors: Taoran Lu, Fangjun Pu, Peng Yin, Sean Thomas McCarthy, Tao Chen
  • Publication number: 20260019599
    Abstract: Methods and systems are described for intra-prediction using template matching (TM) in video coding. The proposed methods include adaptive fusion when using template-based intra mode derivation using the most probable modes (TIMD), and fusion in intra mode prediction with template matching (Intra TMP).
    Type: Application
    Filed: December 18, 2023
    Publication date: January 15, 2026
    Applicant: DOLBY LABORATORIES LICENSING CORPORATION
    Inventors: Jeeva Raj Arumugam, Ashwin Natesan, Vaibhav Pandurang Valvaiker, Jay Nitin Shingala, Taoran Lu, Fangjun Pu, Peng Yin, Gary J. Sullivan
  • Patent number: 12506894
    Abstract: An input image represented in an input domain is received from an input video signal. Forward reshaping is performed on the input image to generate a forward reshaped image represented in a reshaped image domain. Non-reshaping encoding operations are performed to encode the reshaped image into an encoded video signal. At least one of the non-reshaping encoding operations is implemented with an ML model that has been previously trained with training images in one or more training datasets in a preceding training stage. A recipient device of the encoded video signal is caused to generate a reconstructed image from the forward reshaped image.
    Type: Grant
    Filed: August 5, 2022
    Date of Patent: December 23, 2025
    Assignee: DOLBY LABORATORIES LICENSING CORPORATION
    Inventors: Peng Yin, Fangjun Pu, Taoran Lu, Arjun Arora, Guan-Ming Su, Tao Chen, Sean Thomas McCarthy, Walter J. Husak
  • Patent number: 12501056
    Abstract: Given a sequence of images in a first codeword representation, methods, processes, and systems are presented for integrating reshaping into a next generation video codec for encoding and decoding the images, wherein reshaping allows part of the images to be coded in a second codeword representation which allows more efficient compression than using the first codeword representation. A variety of architectures are discussed, including: an out-of-loop reshaping architecture, an in-loop-for intra pictures only reshaping architecture, an in-loop architecture for prediction residuals, and a hybrid in-loop reshaping architecture. Syntax methods for signaling reshaping parameters, and image-encoding methods optimized with respect to reshaping are also presented.
    Type: Grant
    Filed: May 16, 2024
    Date of Patent: December 16, 2025
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Taoran Lu, Fangjun Pu, Peng Yin, Tao Chen, Walter J. Husak
  • Publication number: 20250337880
    Abstract: Methods are described for template matching (TM) in video coding. The proposed methods include: the use of constrained top and left neighbors in template matching, enabling TM only in coding tree unit boundaries, using approximated reconstructed samples, a new processing pipeline for deriving decoder side intra mode derivation (DIMD) combined with template based intra mode derivation (TIMD), and using filtered pixels from the neighbors, instead of using the reconstructed pixels. Furthermore, methods are described on how template matching may be applied in combination with Intra, sub-partitioning mode, interpolation filtering in intra prediction, block partitioning, bi-prediction with coding unit-level weights, and adaptive motion vector resolution.
    Type: Application
    Filed: April 5, 2023
    Publication date: October 30, 2025
    Applicant: DOLBY LABORATORIES LICENSING CORPORATION
    Inventors: Jeeva Raj Arumugam, Jay Nitin Shingala, Ashwin Natesan, Manasi Mahendra Remane, Taoran Lu, Fangjun Pu, Peng Yin
  • Patent number: 12413769
    Abstract: Methods and systems for canvas size scalability across the same or different bitstream layers of a video coded bitstream are described. Offset parameters for a conformance window, a reference region of interest (ROI) in a reference layer, and a current ROI in a current layer are received. The width and height of a current ROI and a reference ROI are computed based on the offset parameters and they are used to generate a width and height scaling factor to be used by a reference picture resampling unit to generate an output picture based on the current ROI and the reference ROI.
    Type: Grant
    Filed: December 18, 2023
    Date of Patent: September 9, 2025
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Taoran Lu, Fangjun Pu, Peng Yin, Sean Thomas McCarthy, Tao Chen
  • Publication number: 20250254301
    Abstract: Methods related to the geometric partition mode (GPM) in video coding are described. The proposed methods include: applying adaptive ordering of merge candidates with template matching (ARMC-TM) to derive GPM inter candidate lists, candidates list applying merge motion vector differences in GPM, enabling GPM for all-intra coding units (CUs), using inter and intra template costs in intra-prediction modes of GPM, using GPM partitions to generate templates in template matching, and using neighboring reconstructed samples and an edge criterion to derive top and left-edge intercepts to generate partitioning candidates.
    Type: Application
    Filed: April 5, 2023
    Publication date: August 7, 2025
    Applicant: DOLBY LABORATORIES LICENSING CORPORATION
    Inventors: Ashwin Natesan, Jay Nitin Shingala, Jeeva Raj Arumugam, Manasi Mahendra Remane, Vaibhav Pandurang Valvaiker, Taoran Lu, Fangjun Pu, Peng Yin
  • Publication number: 20250254325
    Abstract: Methods, systems, and bitstream syntax are described for sign prediction in video coding. The method include: selection of top and left neighbors based on an image continuity check, the intra mode of the current coded unit (CU), the merge motion vector, or adaptive motion vector prediction, sign prediction based on residue domain of current CU or neighbor CUs, sign prediction based on approximated reconstruction samples, reducing the number of selected coefficients for sorting, simplifying the sequential search cost, and by combining sign prediction with sign data hiding.
    Type: Application
    Filed: April 11, 2023
    Publication date: August 7, 2025
    Applicant: DOLBY LABORATORIES LICENSING CORPORATION
    Inventors: Jay Nitin SHINGALA, Jeeva Raj ARUMUGAM, Manasi Mahendra REMANE, Ashwin NATESAN, Taoran LU, Fangjun PU, Peng YIN
  • Publication number: 20250211799
    Abstract: Methods, systems, and bitstream syntax are described for the carriage of neural network topology and parameters as related to neural-network-based post filtering (NNPF) in image and video coding. Examples of NNPF SEI messaging as applicable to the MPEG standards for coding video pictures are described at the sequence layer and at the picture layer.
    Type: Application
    Filed: April 3, 2023
    Publication date: June 26, 2025
    Applicant: DOLBY LABORATORIES LICENSING CORPORATION
    Inventors: Peng Yin, Arjun Arora, Tong Shao, Taoran Lu, Fangjun Pu, Sean Thomas McCarthy
  • Publication number: 20250203120
    Abstract: Given a sequence of images in a first codeword representation, methods, processes, and systems are presented for image reshaping using rate distortion optimization, wherein reshaping allows the images to be coded in a second codeword representation which allows more efficient compression than using the first codeword representation. Syntax methods for signaling reshaping parameters are also presented.
    Type: Application
    Filed: February 27, 2025
    Publication date: June 19, 2025
    Applicant: DOLBY LABORATORIES LICENSING CORPORATION
    Inventors: Peng Yin, Fangjun Pu, Taoran Lu, Tao Chen, Walter J. Husak, Sean Thomas McCarthy
  • Patent number: 12335500
    Abstract: Methods and systems for frame rate scalability are described. Support is provided for input and output video sequences with variable frame rate and variable shutter angle across scenes, or for input video sequences with fixed input frame rate and input shutter angle, but allowing a decoder to generate a video output at a different output frame rate and shutter angle than the corresponding input values. Techniques allowing a decoder to decode more computationally-efficiently a specific backward compatible target frame rate and shutter angle among those allowed are also presented.
    Type: Grant
    Filed: April 29, 2024
    Date of Patent: June 17, 2025
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Robin Atkins, Peng Yin, Taoran Lu, Fangjun Pu, Sean Thomas McCarthy, Walter J. Husak, Tao Chen, Guan-Ming Su
  • Publication number: 20250175651
    Abstract: In a method to improve the coding efficiency of high-dynamic range (HDR) images, a decoder parses sequence processing set (SPS) data from an input coded bitstream to detect that an HDR extension syntax structure is present in the parsed SPS data. It extracts from the HDR extension syntax structure post-processing information that includes one or more of a color space enabled flag, a color enhancement enabled flag, an adaptive reshaping enabled flag, a dynamic range conversion flag, a color correction enabled flag, or an SDR viewable flag. It decodes the input bitstream to generate a preliminary output decoded signal, and generates a second output signal based on the preliminary output signal and the post-processing information.
    Type: Application
    Filed: January 27, 2025
    Publication date: May 29, 2025
    Applicant: DOLBY LABORATORIES LICENSING CORPORATION
    Inventors: Peng YIN, Taoran LU, Fangjun PU, Tao CHEN, Walter J. HUSAK
  • Patent number: 12244869
    Abstract: Given a sequence of images in a first codeword representation, methods, processes, and systems are presented for image reshaping using rate distortion optimization, wherein reshaping allows the images to be coded in a second codeword representation which allows more efficient compression than using the first codeword representation. Syntax methods for signaling reshaping parameters are also presented.
    Type: Grant
    Filed: March 29, 2022
    Date of Patent: March 4, 2025
    Assignee: DOLBY LABORATORIES LICENSING CORPORATION
    Inventors: Peng Yin, Fangjun Pu, Taoran Lu, Tao Chen, Walter J. Husak, Sean Thomas McCarthy
  • Patent number: 12244867
    Abstract: A quantization parameter signalling mechanism for both SDR and HDR content in video coding is described using two approaches. The first approach is to send the user-defined QpC table directly in high level syntax. This leads to more flexible and efficient QP control for future codec development and video content coding. The second approach is to signal luma and chroma QPs independently. This approach eliminates the need for QpC tables and removes the dependency of chroma quantization parameter on luma QP.
    Type: Grant
    Filed: November 10, 2023
    Date of Patent: March 4, 2025
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Fangjun Pu, Taoran Lu, Peng Yin, Sean Thomas McCarthy
  • Publication number: 20250063199
    Abstract: A quantization parameter signaling mechanism for both SDR and HDR content in video coding is described using two approaches. The first approach is to send the user-defined QpC table directly in high level syntax. This leads to more flexible and efficient QP control for future codec development and video content coding. The second approach is to signal luma and chroma QPs independently. This approach eliminates the need for QpC tables and removes the dependency of chroma quantization parameter on luma QP.
    Type: Application
    Filed: November 4, 2024
    Publication date: February 20, 2025
    Applicant: Dolby Laboratories Licensing Corporation
    Inventors: Fangjun Pu, Taoran Lu, Peng Yin, Sean Thomas McCarthy
  • Patent number: 12212786
    Abstract: In a method to improve the coding efficiency of high-dynamic range (HDR) images, a decoder parses sequence processing set (SPS) data from an input coded bitstream to detect that an HDR extension syntax structure is present in the parsed SPS data. It extracts from the HDR extension syntax structure post-processing information that includes one or more of a color space enabled flag, a color enhancement enabled flag, an adaptive reshaping enabled flag, a dynamic range conversion flag, a color correction enabled flag, or an SDR viewable flag. It decodes the input bitstream to generate a preliminary output decoded signal, and generates a second output signal based on the preliminary output signal and the post-processing information.
    Type: Grant
    Filed: September 19, 2023
    Date of Patent: January 28, 2025
    Assignee: DOLBY LABORATORIES LICENSING CORPORATION
    Inventors: Peng Yin, Taoran Lu, Fangjun Pu, Tao Chen, Walter J. Husak
  • Publication number: 20240422345
    Abstract: An input image represented in an input domain is received from an input video signal. Forward reshaping is performed on the input image to generate a forward reshaped image represented in a reshaped image domain. Non-reshaping encoding operations are performed to encode the reshaped image into an encoded video signal. At least one of the non-reshaping encoding operations is implemented with an ML model that has been previously trained with training images in one or more training datasets in a preceding training stage. A recipient device of the encoded video signal is caused to generate a reconstructed image from the forward reshaped image.
    Type: Application
    Filed: August 5, 2022
    Publication date: December 19, 2024
    Applicant: DOLBY LABORATORIES LICENSING CORPORATION
    Inventors: Peng YIN, Fangjun PU, Taoran LU, Arjun ARORA, Guan-Ming SU, Tao CHEN, Sean Thomas MCCARTHY, Walter J. HUSAK
  • Publication number: 20240357112
    Abstract: Methods, systems, and bitstream syntax are described for the fusion of latent features in multi-level, end-to-end, neural networks used in image and video compression. The fused architecture may be static or dynamic based on image characteristics (e.g., natural images versus screen content images) or other coding parameters, such as bitrate constrains or rate-distortion optimization. A variety of multi-level fusion architectures are discussed.
    Type: Application
    Filed: August 3, 2022
    Publication date: October 24, 2024
    Applicant: Dolby Laboratories Licensing Corporation
    Inventors: Arunkumar MOHANANCHETTIAR, Jay Nitin SHINGALA, Pankaj SHARMA, Nijil KOLLERI, Peng YIN, Arjun ARORA, Fangjun PU, Taoran LU, Sean Thomas MCCARTHY, Walter J. HUSAK
  • Patent number: 12108061
    Abstract: Methods and systems for frame rate scalability are described. Support is provided for input and output video sequences with variable frame rate and variable shutter angle across scenes, or for input video sequences with fixed input frame rate and input shutter angle, but allowing a decoder to generate a video output at a different output frame rate and shutter angle than the corresponding input values. Techniques allowing a decoder to decode more computationally-efficiently a specific backward compatible target frame rate and shutter angle among those allowed are also presented.
    Type: Grant
    Filed: March 26, 2024
    Date of Patent: October 1, 2024
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Robin Atkins, Peng Yin, Taoran Lu, Fangjun Pu, Sean Thomas McCarthy, Walter J. Husak, Tao Chen, Guan-Ming Su
  • Patent number: 12108060
    Abstract: Methods and systems for frame rate scalability are described. Support is provided for input and output video sequences with variable frame rate and variable shutter angle across scenes, or for input video sequences with fixed input frame rate and input shutter angle, but allowing a decoder to generate a video output at a different output frame rate and shutter angle than the corresponding input values. Techniques allowing a decoder to decode more computationally-efficiently a specific backward compatible target frame rate and shutter angle among those allowed are also presented.
    Type: Grant
    Filed: September 28, 2023
    Date of Patent: October 1, 2024
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Robin Atkins, Peng Yin, Taoran Lu, Fangjun Pu, Sean Thomas McCarthy, Walter J. Husak, Tao Chen, Guan-Ming Su