Patents by Inventor Guan-Ming Su
Guan-Ming Su has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 10701359Abstract: Noise levels in pre-reshaped codewords of a pre-reshaped bit depth in pre-reshaped images within a time window of a scene are calculated. Per-bin minimal bit depth values are computed for pre-reshaped codeword bins based on the calculated noise levels in the pre-reshaped codewords. Each per-bin minimal bit depth value corresponds to a minimal bit depth value for a respective pre-reshaped codeword bin. A specific codeword mapping function for a specific pre-reshaped image in the pre-reshaped image is generated based on the pre-reshaped bit depth, the per-bin minimal bit depth values, and a target bit depth smaller than the pre-reshaped bit depth. The specific codeword mapping function is applied to specific pre-reshaped codewords of the specific pre-reshaped image to generate specific target codewords of the target bit depth for a specific output image.Type: GrantFiled: March 1, 2016Date of Patent: June 30, 2020Assignee: Dolby Laboratories Licensing CorporationInventor: Guan-Ming Su
-
Patent number: 10701375Abstract: A tone-mapping function that maps input images of a high dynamic range into reference tone-mapped images of a relatively narrow dynamic range is generated. A luma forward reshaping function is derived, based on first bit depths and second bit depths, for forward reshaping luma codewords of the input images into forward reshaped luma codewords of forward reshaped images approximating the reference tone-mapped images. A chroma forward reshaping mapping is derived for predicting chroma codewords of the forward reshaped images. Backward reshaping metadata that is to be used by recipient devices to generate a luma backward reshaping function and a chroma backward reshaping mapping is transmitted with the forward reshaped images to the recipient devices. Techniques for the joint derivation of forward luma and chroma reshaping functions are also presented.Type: GrantFiled: March 22, 2017Date of Patent: June 30, 2020Assignee: Dolby Laboratories Licensing CorporationInventors: Guan-Ming Su, Jon Scott Miller, Walter J. Husak, Yee Jin Lee, Harshad Kadu
-
Patent number: 10701404Abstract: Real-time forward reshaping, comprising selecting a statistical sliding window that indexes with the current frame, having also, a look-back frame and a look-ahead frame, determining whether they are part of the current scene, determining a noise parameter, a luma transfer function and a luma forward reshaping function based on the luma transfer function and the noise parameter within the current scene, selecting a central tendency sliding window of the current frame and the look-back frame within the current scene, and determining a central tendency luma forward reshaping function. The chroma reshaping comprises analyzing statistics for the extended dynamic range (EDR) weights and EDR upper bounds, mapping these to standard dynamic range (SDR) weights and SDR upper bounds based on the central tendency luma forward reshaping function, determining a chroma content-dependent polynomial and a central tendency chroma forward reshaping polynomial and generating chroma MMR coefficients.Type: GrantFiled: August 28, 2017Date of Patent: June 30, 2020Assignee: Dolby Laboratories Licensing CorporationInventors: Qing Song, Harshad Kadu, Qian Chen, Guan-Ming Su
-
Publication number: 20200169742Abstract: In some embodiments, an encoder device is disclosed to generate single-channel standard dynamic range/high dynamic range content predictors. The device receives a standard dynamic range image content and a representation of a high dynamic range image content. The device determines a first mapping function to map the standard dynamic range image content to the high dynamic range image content. The device generates a single channel prediction metadata based on the first mapping function, such that a decoder device can subsequently render a predicted high dynamic range image content by applying the metadata to transform the standard dynamic range image content to the predicted high definition image content.Type: ApplicationFiled: July 24, 2018Publication date: May 28, 2020Applicant: Dolby Laboratories Licensing CorporationInventors: Guan-Ming SU, Tao CHEN, Qian CHEN
-
Patent number: 10659749Abstract: In a method to reconstruct a high dynamic range video signal, a decoder receives parameters in the input bitstream to generate a prediction function. Using the prediction function, it generates a first set of nodes for a first prediction lookup table, wherein each node is characterized by an input node value and an output node value. Then, it modifies the output node values of one or more of the first set of nodes to generate a second set of nodes for a second prediction lookup table, and generates output prediction values using the second lookup table. Low-complexity methods to modify the output node value of a current node in the first set of nodes based on computing modified slopes between the current node and nodes surrounds the current node are presented.Type: GrantFiled: June 28, 2017Date of Patent: May 19, 2020Assignee: Dolby Laboratories Licensing CorporationInventors: Harshad Kadu, Guan-Ming Su
-
Patent number: 10645403Abstract: Methods and systems for adaptive chroma reshaping are discussed. Given an input image, a luma-reshaped image is first generated based on its luma component. For each chroma component of the input image, the range of the pixel values in the luma reshaped image is divided into bins, and for each bin a maximal scale factor is generated based on the chroma pixel values in the input image corresponding to the pixels of the luma reshaped image in the bin. A forward reshaping function is generated based on a reference reshaped function and the maximal scale factors, and reshaped chroma pixel values for the chroma component are generated based on the forward reshaping function and the corresponding pixel values in the luma reshaped image. Implementations options using look-up tables for mobile platforms with limited computational resources are also described.Type: GrantFiled: May 17, 2017Date of Patent: May 5, 2020Assignee: Dolby Laboratories Licensing CorporationInventors: Qing Song, Guan-Ming Su, Qian Chen, Tao Chen
-
Patent number: 10609424Abstract: A standard dynamic range (SDR) image is received. Composer metadata of the first level through the N-th level is generated. Composer metadata of the j-th level is generated based on the composer metadata of the first level through (j?1)-th level. The composer metadata of the first level through the composer metadata of the j-th level is to be used for mapping the SDR image to the j-th target image specifically optimized for the j-th reference target display. The SDR image is encoded with the composer metadata of the first level through the k-th level in an output SDR video signal, where 1<=k<=N. A display device renders a display image derived from a composed target image composed from the SDR image based on the composer metadata of the first level through the k-th level in the output SDR video signal.Type: GrantFiled: March 6, 2019Date of Patent: March 31, 2020Assignee: Dolby Laboratories Licensing CorporationInventors: Qing Song, Harshad Kadu, Guan-Ming Su
-
Patent number: 10609372Abstract: Input minimal noise levels of are computed over input codeword bins based on image content in input images of an input bit depth. The minimal noise levels are adjusted to generate approximated minimal noise levels of a higher bit depth. The approximated minimal noise levels are used to generate per-bin bit depths over the input codeword bins. The input codeword bins are classified into first codeword bins that have relatively high risks of banding artifacts and some other input codeword bins that have relatively low or zero risks of banding artifacts based on the per-bin bit depths. Portions of bit depths from the other input codeword bins are moved to the first input codeword bins to generate modified per-bin bit depths. A forward reshaping function constructed from the modified per-bin bit depths is used to reshape the input images into reshaped images used to generate output images.Type: GrantFiled: September 24, 2018Date of Patent: March 31, 2020Assignee: Dolby Laboratories Licensing CorporationInventors: Guan-Ming Su, Amin Kheradmand, Navaneeth Kamballur Kottayil
-
Patent number: 10602110Abstract: Methods and systems for chroma reshaping are applied to images or video frames. The method comprises receiving at least one image or video frame. The color space of the at least one image or video frame is partitioned in M1×M2×M3 non-overlapping bins. For each bin it is determined whether it is a valid bin, for which the at least one image or video frame has at least one pixel with a color value falling within said bin. For each chroma channel, a required number of codewords is calculated for representing two color values in said valid bin that have consecutive codewords for the respective chroma channel without a noticeable difference. At least one content-aware chroma forward reshaping function is generated based on the calculated required numbers of codewords and applied to the at least one image or video frame.Type: GrantFiled: August 28, 2017Date of Patent: March 24, 2020Assignee: Dolby Laboratories Licensing CorporationInventors: Cheng-Chi Li, Guan-Ming Su
-
Patent number: 10587897Abstract: Coding syntaxes in compliance with same or different VDR specifications may be signaled by upstream coding devices such as VDR encoders to downstream coding devices such as VDR decoders in a common vehicle in the form of RPU data units. VDR coding operations and operational parameters may be specified as sequence level, frame level, or partition level syntax elements in a coding syntax. Syntax elements in a coding syntax may be coded directly in one or more current RPU data units under a current RPU ID, predicted from other partitions/segments/ranges previously sent with the same current RPU ID, or predicted from other frame level or sequence level syntax elements previously sent with a previous RPU ID. A downstream device may perform decoding operations on multi-layered input image data based on received coding syntaxes to construct VDR images.Type: GrantFiled: February 16, 2017Date of Patent: March 10, 2020Assignee: Dolby Laboratories Licensing CorporationInventors: Sheng Qu, Peng Yin, Yan Ye, Yuwen He, Walter Gish, Guan-Ming Su, Yufei Yuan, Samir Hulyalkar
-
Patent number: 10575005Abstract: In a method to code and transmit scalable HDR video signals, HDR signals are processed and encoded in the IPT-PQ color space to generate a base layer at reduced spatial resolution and/or dynamic range, and an enhancement layer with a residual signal. A signal reshaping block before the base layer encoder allows for improved coding of HDR signals using a reduced bit depth. A decoder can use a BL decoder and backward reshaping to generate a decoded BL HDR signal at a reduced dynamic range and/or spatial resolution, or it can combine the decoded BL HDR signal and the EL stream to generate a decoded HDR signal at full dynamic range and full resolution.Type: GrantFiled: July 20, 2016Date of Patent: February 25, 2020Assignee: Dolby Laboratories Licensing CorporationInventors: Guan-Ming Su, Sheng Qu, Samir N. Hulyalkar, David Brooks
-
Patent number: 10575028Abstract: Given HDR and SDR video inputs representing the same content, segment-based methods are described to generate a backward-compatible reshaped SDR video which preserves the artistic intent or “look” of the inputs and satisfies other coding requirements. For each frame in a segment, reshaping functions are generated based on a support frames set determined based on a sliding window of frames that is adjusted based on scene cuts in the segment and which may include frames from both the current segment and neighboring segments. For luma reshaping, a mapping that preserves the cumulative density function of the luminance histogram values in the EDR and SDR inputs is combined with a minimum codeword allocation derived based on the EDR signal and the support frame set. For chroma reshaping, methods for segment-based forward and backward reshaping using multivariate, multi-regression models are also presented.Type: GrantFiled: September 11, 2017Date of Patent: February 25, 2020Assignee: Dolby Laboratories Licensing CorporationInventors: Harshad Kadu, Qian Chen, Guan-Ming Su
-
Patent number: 10542269Abstract: In a method to reconstruct a high dynamic range video signal, a decoder receives parameters in the input bitstream to generate a prediction function. Using the prediction function, it generates a first set of nodes for a first prediction lookup table, wherein each node is characterized by an input node value and an output node value. Then, it modifies the output node values of one or more of the first set of nodes to generate a second set of nodes for a second prediction lookup table, and generates output prediction values using the second lookup table. Low-complexity methods to modify the output node value of a current node in the first set of nodes based on computing modified slopes between the current node and nodes surrounding the current node are presented.Type: GrantFiled: December 7, 2016Date of Patent: January 21, 2020Assignee: Dolby Laboratories Licensing CorporationInventors: Harshad Kadu, Guan-Ming Su, Hanyang Sun
-
Patent number: 10542265Abstract: Relatively low dynamic range images or image partitions are converted into relatively high dynamic range images or image partitions that comprise reconstructed pixel values having a higher dynamic range than pixel values of the relatively low dynamic range images. Information relating to reconstructed pixel values of the relatively high dynamic range images and pixel values of the relatively low dynamic range images is collected. Prediction parameters are derived from the collected information. A predicted image or image partition is predicted from a relatively low dynamic range image or image partition based on the prediction parameters and comprises predicted pixel values having the higher dynamic range than pixel values of the relatively low dynamic range image or image partition.Type: GrantFiled: September 8, 2015Date of Patent: January 21, 2020Assignee: Dolby Laboratories Licensing CorporationInventor: Guan-Ming Su
-
Patent number: 10531109Abstract: The present invention relates generally to images. More particularly, an embodiment of the present invention relates to the pixel group segmented quantization and de-quantization of the residual signal in layered coding of high dynamic range images. By assigning the pixels in the residual image to different pixel groups based on the pixel value of the corresponding pixel in the decoded base layer signal, and by applying pixel group quantizing functions to assigned pixels a more efficient coding can be achieved.Type: GrantFiled: January 25, 2016Date of Patent: January 7, 2020Assignees: Dolby Laboratories Licensing Corporation, Dolby International ABInventors: Klaas Heinrich Schueuer, Uwe Michael Kowalik, Arion Neddens, Philipp Kraetzer, Guan-Ming Su
-
Patent number: 10499084Abstract: In a method to improve the dynamic range of high-dynamic range (HDR) signals using an enhancement layer, a piecewise-linear inter-layer predictor and a residual masking operator are applied. The generation of the piecewise-linear inter-layer prediction function is based on a computed scene-significance histogram based on the average of frame-significance histograms indicating pixel values where coding artifacts are most likely to occur. For each segment in the prediction function, its slope is inversely proportional to a measure of energy in the segment under the scene-significance histogram. Bit rate constrains for the enhancement layer are also taken into consideration in determining the piecewise-linear prediction function.Type: GrantFiled: October 26, 2016Date of Patent: December 3, 2019Assignee: Dolby Laboratories Licensing CorporationInventors: Navaneeth Kamballur Kottayil, Guan-Ming Su
-
Publication number: 20190349607Abstract: Given HDR and SDR video inputs representing the same content, segment-based methods are described to generate a backward-compatible reshaped SDR video which preserves the artistic intent or “look” of the inputs and satisfies other coding requirements. For each frame in a segment, reshaping functions are generated based on a support frames set determined based on a sliding window of frames that is adjusted based on scene cuts in the segment and which may include frames from both the current segment and neighboring segments. For luma reshaping, a mapping that preserves the cumulative density function of the luminance histogram values in the EDR and SDR inputs is combined with a minimum codeword allocation derived based on the EDR signal and the support frame set. For chroma reshaping, methods for segment-based forward and backward reshaping using multivariate, multi-regression models are also presented.Type: ApplicationFiled: September 11, 2017Publication date: November 14, 2019Applicant: Dolby Laboratories Licensing CorporationInventors: Harshad Kadu, Qian Chen, Guan-Ming Su
-
Patent number: 10469871Abstract: Representation and coding of multi-view images using tapestry encoding are described for standard and enhanced dynamic ranges compatibility. A tapestry comprises information on a tapestry image, a left-shift displacement map and a right-shift displacement map. Perspective images of a scene can be generated from the tapestry and the displacement maps. Different methods for achieving compatibility are described.Type: GrantFiled: December 10, 2015Date of Patent: November 5, 2019Assignee: Dolby Laboratories Licensing CorporationInventors: Guan-Ming Su, Gregory John Ward, Timo Kunkel, Scott Daly, Samir N. Hulyalkar
-
Publication number: 20190320191Abstract: Methods and systems for adaptive chroma reshaping are discussed. Given an input image, a luma-reshaped image is first generated based on its luma component. For each chroma component of the input image, the range of the pixel values in the luma reshaped image is divided into bins, and for each bin a maximal scale factor is generated based on the chroma pixel values in the input image corresponding to the pixels of the luma reshaped image in the bin. A forward reshaping function is generated based on a reference reshaped function and the maximal scale factors, and reshaped chroma pixel values for the chroma component are generated based on the forward reshaping function and the corresponding pixel values in the luma reshaped image. Implementations options using look-up tables for mobile platforms with limited computational resources are also described.Type: ApplicationFiled: May 17, 2017Publication date: October 17, 2019Applicant: Dolby Laboratories Licensing CorporationInventors: Qing SONG, Guan-Ming SU, Qian CHEN, Tao CHEN
-
Patent number: 10440401Abstract: A processor for video coding receives a full-frame rate (FFR) HDR video signal and a corresponding FFR SDR video signal. An encoder generates a scalable bitstream that allows decoders to generate half-frame-rate (HFR) SDR, FFR SDR, HFR HDR, or FFR HDR signals. Given odd and even frames of the input FFR SDR signal, the scalable bitstream combines a base layer of coded even SDR frames with an enhancement layer of coded packed frames, where each packed frame includes a downscaled odd SDR frame, a downscaled even HDR residual frame, and a downscaled odd HDR residual frame. In an alternative implementation, the scalable bitstream combines four signals layers: a base layer of even SDR frames, an enhancement layer of odd SDR frames, a base layer of even HDR residual frames and an enhancement layer of odd HDR residual frames. Corresponding decoder architectures are also presented.Type: GrantFiled: April 6, 2017Date of Patent: October 8, 2019Assignee: Dolby Laboratories Licensing CorporationInventors: Guan-Ming Su, Qian Chen, Tao Chen, David Brooks, Samir N. Hulyalkar, Peng Yin