Patents by Inventor Xiaogang Dong
Xiaogang Dong has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 10467730Abstract: An image-processing apparatus and method for reducing or removing staircase artifacts comprises an image sensor and circuitry. The image sensor is configured to capture an input image signal. The circuitry is configured to identify a first portion of the input image signal that exhibits a staircase artifact. The circuitry is further configured to generate a slope signal based on a steepness parameter of a slope that corresponds to the first region-of-interest based on the identification. The circuitry is configured to generate a difference signal based on a difference between the first portion of the input image signal and the generated slope signal. The circuitry is configured to generate a de-noised image signal based on the generated difference signal and the generated slope signal to reduce the staircase artifact in the first portion of the input image signal.Type: GrantFiled: March 15, 2018Date of Patent: November 5, 2019Assignee: SONY CORPORATIONInventor: Xiaogang Dong
-
Publication number: 20190287218Abstract: An image-processing apparatus and method for reducing or removing staircase artifacts comprises an image sensor and circuitry. The image sensor is configured to capture an input image signal. The circuitry is configured to identify a first portion of the input image signal that exhibits a staircase artifact. The circuitry is further configured to generate a slope signal based on a steepness parameter of a slope that corresponds to the first region-of-interest based on the identification. The circuitry is configured to generate a difference signal based on a difference between the first portion of the input image signal and the generated slope signal. The circuitry is configured to generate a de-noised image signal based on the generated difference signal and the generated slope signal to reduce the staircase artifact in the first portion of the input image signal.Type: ApplicationFiled: March 15, 2018Publication date: September 19, 2019Inventor: XIAOGANG DONG
-
Patent number: 10362288Abstract: Various aspects of a method and a system for image processing are disclosed herein. The method includes processing an input image, which comprises structure information and detail information, using image processing (IP) blocks in an image processing pipeline. One or more of the IP blocks, such as the “lossy” IP blocks, process the input image with at least a partial loss of the detail information. By replacing the “lossy” IP blocks with redesigned image processing (IP) modules, the image processing pipeline reduces or avoids such loss of the detail information. A more efficient implementation of the improved pipeline is realized by using a master IP module when the “lossy” IP blocks are reordered and grouped together in the image processing pipeline. The method is further extended to process 3-D images to reduce or avoid loss of detail information in a 3-D image processing pipeline.Type: GrantFiled: January 9, 2015Date of Patent: July 23, 2019Assignee: SONY CORPORATIONInventors: Xiaogang Dong, Hiroaki Ebi, Jiro Takatori, Alexander Berestov, Kenichi Nishio, Tak Shing Wong
-
Patent number: 10140689Abstract: An efficient patch-based method for video denoising is described herein. A noisy patch is selected from a current frame and a motion-compensated patch in the previous denoised frame is found. The two patches go through a patch-denoising process to generate a denoised patch. A rotational buffer and aggregation technique is used to generate the denoised current video frame.Type: GrantFiled: January 20, 2017Date of Patent: November 27, 2018Assignee: Sony CorporationInventor: Xiaogang Dong
-
Publication number: 20180211365Abstract: An efficient patch-based method for video denoising is described herein. A noisy patch is selected from a current frame and a motion-compensated patch in the previous denoised frame is found. The two patches go through a patch-denoising process to generate a denoised patch. A rotational buffer and aggregation technique is used to generate the denoised current video frame.Type: ApplicationFiled: January 20, 2017Publication date: July 26, 2018Inventor: Xiaogang Dong
-
Patent number: 9977998Abstract: Various aspects of a method and device to process one or more multi-channel images are disclosed herein. The method to process one or more multi-channel images is executed within an electronic device. A channel distance value between each channel of a target patch and corresponding channel of one or more neighbor patches of one or more multi-channel images is determined. The determination of the channel distance value is based on channel data in each channel of the one or more multi-channel images. Based on relative signal information in each channel of the target patch, a channel weight for each channel is dynamically determined. Based on the determined channel distance value and the dynamically determined channel weight for each channel, a patch matching score is determined.Type: GrantFiled: April 27, 2015Date of Patent: May 22, 2018Assignee: SONY CORPORATIONInventors: Tak Shing Wong, Jiro Takatori, Xiaogang Dong
-
Patent number: 9928575Abstract: A method for processing a multi-channel image includes modification of adjusted pixel values of one or more pixels in a region of the multi-channel image, in accordance with a pre-specified signal pattern based on one or more parameters. A score is determined based on a ratio of a pixel difference value and a maximum pixel step value. The maximum pixel step value corresponds to modified pixel values of the one or more pixels in the region when the maximum pixel step value exceeds a threshold noise level for the region. False color is suppressed in a selected region of the multi-channel image based on the determined score when the false color is identified in the region.Type: GrantFiled: March 1, 2016Date of Patent: March 27, 2018Assignee: SONY CORPORATIONInventors: Jiro Takatori, Tak Shing Wong, Xiaogang Dong
-
Patent number: 9866809Abstract: An image processing system, and a method of operation thereof, includes: an imaging sensor and lens assembly for receiving a first shot; and a defocus blur unit for calculating a defocus blur based on the first shot; wherein: the imaging sensor is for receiving a second shot with the defocus blur; and further comprising: a low-pass filter for generating a low-pass image by filtering the first shot based on the defocus blur; a comparison unit for comparing the low-pass image with the second shot for detecting a color aliasing; and a correction unit for correcting the color aliasing in the first shot.Type: GrantFiled: November 19, 2015Date of Patent: January 9, 2018Assignee: Sony CorporationInventors: Xiaogang Dong, Jiro Takatori, Tak-Shing Wong
-
Patent number: 9794588Abstract: An image processing system, and a method of operation thereof, includes: an edge motion generation unit for detecting edges in a first image frame and a second image frame stored by a storage device or a memory and for generating edge motion vectors between the first image frame and the second image frame based on the edges; a motion vector list generation unit for extracting dominant motion vectors from a group of the edge motion vectors and for generating a motion vector list based on the dominant motion vectors; an image segmentation unit for generating a segmentation of the first image frame; an initial motion generation unit for generating initial motion vectors based on the segmentation and the motion vector list; and a smooth motion generation unit for generating smooth motion vectors based on the initial motion vectors and for generating a dense optical flow field by combining the smooth motion vectors.Type: GrantFiled: September 30, 2015Date of Patent: October 17, 2017Assignee: Sony CorporationInventors: Xiaogang Dong, Jiro Takatori, Tak-Shing Wong
-
Publication number: 20170256035Abstract: A method for processing a multi-channel image includes modification of adjusted pixel values of one or more pixels in a region of the multi-channel image, in accordance with a pre-specified signal pattern based on one or more parameters. A score is determined based on a ratio of a pixel difference value and a maximum pixel step value. The maximum pixel step value corresponds to modified pixel values of the one or more pixels in the region when the maximum pixel step value exceeds a threshold noise level for the region. False color is suppressed in a selected region of the multi-channel image based on the determined score when the false color is identified in the region.Type: ApplicationFiled: March 1, 2016Publication date: September 7, 2017Inventors: JIRO TAKATORI, TAK SHING WONG, XIAOGANG DONG
-
Publication number: 20170150111Abstract: An image processing system, and a method of operation thereof, includes: an imaging sensor and lens assembly for receiving a first shot; and a defocus blur unit for calculating a defocus blur based on the first shot; wherein: the imaging sensor is for receiving a second shot with the defocus blur; and further comprising: a low-pass filter for generating a low-pass image by filtering the first shot based on the defocus blur; a comparison unit for comparing the low-pass image with the second shot for detecting a color aliasing; and a correction unit for correcting the color aliasing in the first shot.Type: ApplicationFiled: November 19, 2015Publication date: May 25, 2017Inventors: Xiaogang Dong, Jiro Takatori, Tak-Shing Wong
-
Publication number: 20170094310Abstract: An image processing system, and a method of operation thereof, includes: an edge motion generation unit for detecting edges in a first image frame and a second image frame stored by a storage device or a memory and for generating edge motion vectors between the first image frame and the second image frame based on the edges; a motion vector list generation unit for extracting dominant motion vectors from a group of the edge motion vectors and for generating a motion vector list based on the dominant motion vectors; an image segmentation unit for generating a segmentation of the first image frame; an initial motion generation unit for generating initial motion vectors based on the segmentation and the motion vector list; and a smooth motion generation unit for generating smooth motion vectors based on the initial motion vectors and for generating a dense optical flow field by combining the smooth motion vectors.Type: ApplicationFiled: September 30, 2015Publication date: March 30, 2017Inventors: Xiaogang Dong, Jiro Takatori, Tak-Shing Wong
-
Patent number: 9508020Abstract: An image processing system, and a method of operation thereof, includes: a local patch ternarization module for receiving an input image, for calculating a mean value of a local patch of pixels in the input image, and for calculating ternary values for the pixels based on the mean value; and an artifact removal module, coupled to the local patch ternarization module, for removing a residue artifact based on the ternary values and for generating an output image with the residue artifact removed for sending to an image signal processing hardware.Type: GrantFiled: July 16, 2014Date of Patent: November 29, 2016Assignee: Sony CorporationInventors: Xiaogang Dong, Jiro Takatori, Tak-Shing Wong
-
Publication number: 20160314379Abstract: Various aspects of a method and device to process one or more multi-channel images are disclosed herein. The method to process one or more multi-channel images is executed within an electronic device. A channel distance value between each channel of a target patch and corresponding channel of one or more neighbor patches of one or more multi-channel images is determined. The determination of the channel distance value is based on channel data in each channel of the one or more multi-channel images. Based on relative signal information in each channel of the target patch, a channel weight for each channel is dynamically determined. Based on the determined channel distance value and the dynamically determined channel weight for each channel, a patch matching score is determined.Type: ApplicationFiled: April 27, 2015Publication date: October 27, 2016Inventors: TAK SHING WONG, JIRO TAKATORI, XIAOGANG DONG
-
Patent number: 9466094Abstract: A method to improve video quality by suppressing noise and artifacts in difference frames of a video is described herein.Type: GrantFiled: March 26, 2015Date of Patent: October 11, 2016Assignee: Sony CorporationInventors: Xiaogang Dong, Jiro Takatori, Tak Shing Wong
-
Publication number: 20160284066Abstract: A method to improve video quality by suppressing noise and artifacts in difference frames of a video is described herein.Type: ApplicationFiled: March 26, 2015Publication date: September 29, 2016Inventors: Xiaogang Dong, Jiro Takatori, Tak Shing Wong
-
Publication number: 20160205331Abstract: Various aspects of a method and a system for image processing are disclosed herein. The method includes processing an input image, which comprises structure information and detail information, using image processing (IP) blocks in an image processing pipeline. One or more of the IP blocks, such as the “lossy” IP blocks, process the input image with at least a partial loss of the detail information. By replacing the “lossy” IP blocks with redesigned image processing (IP) modules, the image processing pipeline reduces or avoids such loss of the detail information. A more efficient implementation of the improved pipeline is realized by using a master IP module when the “lossy” IP blocks are reordered and grouped together in the image processing pipeline. The method is further extended to process 3-D images to reduce or avoid loss of detail information in a 3-D image processing pipeline.Type: ApplicationFiled: January 9, 2015Publication date: July 14, 2016Inventors: XIAOGANG DONG, HIROAKI EBI, JIRO TAKATORI, ALEXANDER BERESTOV, KENICHI NISHIO, TAK SHING WONG
-
Publication number: 20160019677Abstract: An image processing system, and a method of operation thereof, includes: a local patch ternarization module for receiving an input image, for calculating a mean value of a local patch of pixels in the input image, and for calculating ternary values for the pixels based on the mean value; and an artifact removal module, coupled to the local patch ternarization module, for removing a residue artifact based on the ternary values and for generating an output image with the residue artifact removed for sending to an image signal processing hardware.Type: ApplicationFiled: July 16, 2014Publication date: January 21, 2016Inventors: Xiaogang Dong, Jiro Takatori, Tak-Shing Wong
-
Patent number: 9014490Abstract: A method for effectively performing local image similarity measurement is proposed. A system equipped with such a method for effectively performing an image processing task includes an image processor that performs an intermediate-results calculation procedure to calculate intermediate result values that are based upon corresponding pixels of a target patch and one or more similar patches. The image processor typically moves the target patch of the intermediate-results calculation to different locations in a raster order or some other organized order. The image processor then performs an intermediate-results combination procedure by calculating appropriate statistics of the intermediate result values to produce processed pixel values. A processor device typically controls the image processor to effectively perform the image processing tasks including, but not limited to, demosaicing and denoising.Type: GrantFiled: February 15, 2011Date of Patent: April 21, 2015Assignee: Sony CorporationInventors: Xiaogang Dong, Farhan Baqai, Kenichi Nishio
-
Publication number: 20140267432Abstract: A method to select an appropriate window size for local image processing uses two window sizes: a very large but impractical size and a small and practical size. Two images are generated for the desired image processing under both window sizes. The difference of these two images eliminates common non-linear nature of the local image processing and only contains low-frequency artifacts generated under a smaller window size. By taking the Fourier transform of the difference image, an approximated noise spectrum of low-frequency artifacts introduced by the small and practical window size is able to be observed. Alternatively, a frequency analysis of the smaller window size is able to be conducted by calculating the difference of cross-correlation functions and noise spectra under the same two window sizes. An appropriate window size is able to be selected based on such frequency analysis.Type: ApplicationFiled: March 12, 2013Publication date: September 18, 2014Applicant: SONY CORPORATIONInventors: Xiaogang Dong, Farhan A. Baqai, Nobuyuki Matsushita, Kenichi Nishio