Interpolation Patents (Class 382/300)
  • Patent number: 11501783
    Abstract: An apparatus for decoding an encoded audio signal to obtain a reconstructed audio signal includes a receiving interface for receiving one or more frames comprising information on a plurality of audio signal samples of an audio signal spectrum of the encoded audio signal, and a processor for generating the reconstructed audio signal. The processor is configured to generate the reconstructed audio signal by fading a modified spectrum to a target spectrum, if a current frame is not received by the receiving interface or if the current frame is received by the receiving interface but is corrupted, wherein the modified spectrum includes a plurality of modified signal samples, wherein, for each of the modified signal samples of the modified spectrum, an absolute value of the modified signal sample is equal to an absolute value of one of the audio signal samples of the audio signal spectrum.
    Type: Grant
    Filed: February 19, 2020
    Date of Patent: November 15, 2022
    Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
    Inventors: Michael Schnabel, Goran Markovic, Ralph Sperschneider, Jérémie Lecomte, Christian Helmrich
  • Patent number: 11475549
    Abstract: High dynamic range (HDR) support is provided for legacy application programs, such as games that are configured to display standard dynamic range (SDR) frames. HDR frames may be generated without modifying the legacy application program. The buffer creation process of the legacy application program is intercepted and modified before creation of the SDR format buffer so that the buffer is configured to use an upgraded SDR format having an increased bit depth compared with a conventional SDR buffer. Rather than tone mapping and quantizing rendered image data to the lower bit depth for storage in the conventional SDR buffer, the rendered image data is tone mapped and quantized for storage at the increased bit depth of the upgraded SDR buffer. Therefore, the luminance and greater dynamic range of the tone mapped data is better preserved compared with outputting conventional SDR frames.
    Type: Grant
    Filed: June 4, 2021
    Date of Patent: October 18, 2022
    Assignee: NVIDIA Corporation
    Inventor: Shaveen Kumar
  • Patent number: 11451774
    Abstract: An embodiment of the present disclosure discloses an intra-prediction-based encoding and decoding method, apparatus and filter, and belongs to a video coding technical field.
    Type: Grant
    Filed: March 26, 2019
    Date of Patent: September 20, 2022
    Inventors: Ronggang Wang, Kui Fan, Guisen Xu, Wen Gao
  • Patent number: 11393068
    Abstract: A method for interpolating values of an attribute for an image grid may include determining a root value of the attribute for a root node located centrally in the image grid, pre-calculating metadata for multiple child nodes in one or more hierarchical levels based on one or more gradients of the attribute, and deriving values of the attribute for each of the child nodes at each of the hierarchical levels based on the corresponding root value and metadata for the hierarchical level of each child node, wherein each child node may be used as a root node in the next hierarchical level. The image grid may have multiple outer cells arranged radially around a central cell, and the root node may be located in the central cell.
    Type: Grant
    Filed: October 29, 2019
    Date of Patent: July 19, 2022
    Inventors: Rahul Kumar, Fnu Gurupad, David Tannenbaum
  • Patent number: 11297337
    Abstract: A method is described to greatly improve the efficiency of and reduce the complexity of image compression when using single-sensor color imagers for video acquisition. The method in addition allows for this new image compression type to be compatible with existing video processing tools, improving the workflow for film and television production.
    Type: Grant
    Filed: February 24, 2020
    Date of Patent: April 5, 2022
    Assignee: GoPro, Inc.
    Inventor: David A. Newman
  • Patent number: 11200827
    Abstract: A chromaticity compensation method, a chromaticity compensation device and a storage medium are disclosed. The chromaticity compensation method includes that, according to a preset standard chromaticity value and measured chromaticity values corresponding to a plurality of sub-display regions in a display region, chromaticity compensation values of the sub-display regions are determined, and the display region is divided into the plurality of sub-display regions in close arrangement, and each of the sub-display regions includes a plurality of sub-pixels; a data smoothing treatment is performed between the chromaticity compensation values of the sub-display regions that are adjacent, so as to determine the smoothed chromaticity compensation values of the sub-pixels in the sub-display regions; and upon display, chromaticity compensation of the sub-pixels are performed by adopting the smoothed chromaticity compensation values.
    Type: Grant
    Filed: June 3, 2019
    Date of Patent: December 14, 2021
    Assignees: Hefei Xinsheng Optoelectronics Technology Co., Ltd., BOE Technology Group Co., Ltd.
    Inventors: Wenchao Bao, Xiaolong Wei, Dongxu Han
  • Patent number: 11184553
    Abstract: A processor generates a depth map from two images, including a high-dynamic range (HDR) image. The processor receives, from a first image sensor, one or more first images, wherein the one or more first images have a first field-of-view (FOV) and a first resolution, and receives, from a second image sensor, one or more second images, wherein the one or more second images have a second FOV and a second resolution. The processor generates a first HDR image from the one or more first images, and performs tone alignment on the one or more second images based on the first HDR image to produce a second HDR image. The processor generates a depth map using the first HDR image and the second HDR image. The processor may use the depth map to apply a bokeh effect to the first HDR image.
    Type: Grant
    Filed: September 23, 2020
    Date of Patent: November 23, 2021
    Assignee: QUALCOMM Incorporated
    Inventors: Tai-Hsin Liu, Wei-Chih Liu, Wen-Chun Feng
  • Patent number: 11166020
    Abstract: An encoder includes processing circuitry and memory. Using the memory, the processing circuitry: encodes and reconstructs an image to generate a reconstructed image; determines, according to a characteristic of a block in the reconstructed image, an interpolation method for interpolating pixels located outside a referable region including the block; interpolates the pixels located outside the referable region, using the interpolation method determined; and applies a filter to the block using the pixels interpolated.
    Type: Grant
    Filed: December 3, 2019
    Date of Patent: November 2, 2021
    Inventors: Ryuichi Kanoh, Tadamasa Toma, Takahiro Nishi, Kiyofumi Abe, Takashi Hashimoto
  • Patent number: 11095890
    Abstract: A memory-efficient filtering approach is used to code images and video. A buffer having a fixed size based on a size of processing units to use for filtering a video frame is allocated. For each of the processing units, pre-filtered pixel values are copied from a respective region of the video frame to the buffer based on a writing point for the video frame and an offset applied to the writing point, filtering is performed against the pre-filtered pixel values from the buffer to produce filtered pixel values, and the filtered pixel values are written to the video frame based on the writing point and the offset. The filtering may be performed using a loop restoration tool, such as where the pre-filtered pixel values are output from a constrained directional enhancement filter (CDEF) tool. Alternatively, the filtering may be performed using the CDEF tool or another coding tool.
    Type: Grant
    Filed: April 27, 2020
    Date of Patent: August 17, 2021
    Assignee: GOOGLE LLC
    Inventors: Cheng Chen, Jingning Han
  • Patent number: 11035665
    Abstract: An inspection system is disclosed. In one embodiment, the inspection system includes an interferometer sub-system configured to acquire an interferogram of a sample. The inspection system may further include a controller communicatively coupled to the interferometer sub-system. The controller is configured to: receive the interferogram from the interferometer sub-system; generate a phase map of the sample based on the received interferogram, wherein the phase map includes a plurality of pixels; select a sub-set of pixels of the plurality of pixels of the phase map to be used for phase unwrapping procedures; perform one or more phase unwrapping procedures on the sub-set of pixels of the phase map to generate an unwrapped phase map; and generate a surface height map of the sample based on the unwrapped phase map.
    Type: Grant
    Filed: November 19, 2019
    Date of Patent: June 15, 2021
    Assignee: KLA Corporation
    Inventors: Helen (Heng) Liu, GuoQing Zhang
  • Patent number: 11032510
    Abstract: A video processing method is provided. In the method, circuitry of a terminal determines a second video frame portion associated with a second time point that is after a first time point associated with a first video frame portion of a video. The circuitry generates a transitional video frame based on the first video frame portion and the second video frame portion. A color value of a pixel at a target pixel location in the transitional video frame is within a target color interval. The target color interval is determined according to a color value of a pixel at the target pixel location in the first video frame portion and a color value of a pixel at the target pixel location in the second video frame portion. The circuitry performs display control of the video according to the transitional video frame.
    Type: Grant
    Filed: October 2, 2019
    Date of Patent: June 8, 2021
    Inventor: Yang Zhou
  • Patent number: 10909658
    Abstract: A Bayer-mask image is decoded by forming a decoded green array; calculating a slope at each pixel of the array, expressed as an angle; calculating an activity at each pixel; converting the slope angle and the activity into a complex number for each pixel, of modulus equal to the activity and argument equal to twice the slope angle; expressing said complex numbers in Cartesian coordinates to form a Cartesian slope signal and filtering the Cartesian slope signal with a linear spatial filter to derive a slope measure. Blue-green and red-green values are calculated and interpolated using a slope-adaptive interpolation filter steered by said slope measure.
    Type: Grant
    Filed: April 6, 2020
    Date of Patent: February 2, 2021
    Inventor: Michael James Knee
  • Patent number: 10846830
    Abstract: Disclosed is a display apparatus including: a signal receiver configured to receive an image signal; a display configured to display an image; a processor configured to: calculate a change degree and a change direction of pixel value differences between at least one first pixel and two or more second pixels of an image, and change a pixel value of the first pixel based on the pixel value difference which is relatively small among the pixel value differences obtained by the calculated change degree and the calculated change direction. According to this, it is possible to enhance the image details without generating or and increasing of the noises.
    Type: Grant
    Filed: May 18, 2018
    Date of Patent: November 24, 2020
    Inventors: Hyung-jun Lim, Seok-bong Yoo, Tae-gyoung Ahn, Young-su Moon, Seong-hoon Choi
  • Patent number: 10750181
    Abstract: A method and apparatus for video encoding or decoding performed by a video encoder or a video decoder incorporating advanced multiple transform (AMT) are disclosed. According to this method, a transform set consisting of two type candidates designated as a first type and a second type is determined, where the first type and the second type are different. If AMT is used by the current block, a vertical transform is selected from the transform set and a horizontal transform is selected from the transform set. A transform index, for indicating both vertical transform selection and horizontal transform selection, can be signaled at the encoder side or the transform index is parsed at the decoder side. Another method and apparatus incorporating AMT are also disclosed where the transform set is determined according to the resolution of current MVD.
    Type: Grant
    Filed: April 27, 2018
    Date of Patent: August 18, 2020
    Assignee: MEDIATEK INC.
    Inventor: Han Huang
  • Patent number: 10692176
    Abstract: A Bayer-mask is decoded by forming a decoded green array, calculating red green and blue-green color difference signals, deriving a first full-resolution grid of each colour difference signal using a first interpolation filter; deriving a second full-resolution grid of each colour difference signal using a second interpolation filter taking a larger number of colour difference signal inputs than the first; generating a cross-colour weighting signal; and forming a mixed colour difference signal from the first and second full-resolution grids in accordance with the cross-colour weighting signal.
    Type: Grant
    Filed: February 19, 2018
    Date of Patent: June 23, 2020
    Inventor: Michael James Knee
  • Patent number: 10652430
    Abstract: An image processing method includes determining whether image data acquired by reading a document with a reading unit is color or monochrome, saving color image data determined to be color and monochrome image data generated by monochrome conversion of the color image data, in association with each other as a learning sample, deciding a color conversion parameter to be used when image data read by the reading unit and determined to be monochrome image data is converted into a color image, using the saved learning sample, and converting the image data read by the reading unit and determined to be the monochrome image data into color image data, using the decided color conversion parameter.
    Type: Grant
    Filed: February 8, 2019
    Date of Patent: May 12, 2020
    Inventors: Masanori Ichikawa, Shigeki Hasui, Yosuke Obayashi, Yoshihisa Nomura, Hiroaki Niitsuma
  • Patent number: 10649580
    Abstract: In one embodiment, an electronic device is provided, comprising: at least one non-transitory memory; a touch screen; a camera; and one or more processors in communication with the at least one non-transitory memory, the touch screen, and the camera, wherein the one or more processors execute instructions stored in the non-transitory memory to cause the apparatus to: display, via the touch screen, a first virtual display layer including contents; display, via the touch screen, at least one user interface element; detect, via the touch screen, at least a portion of touch on the least one user interface element; when an aspect of the touch is detected to surpass a threshold, display, via the touch screen, a plurality of markings in a second virtual display layer that appears to have a lesser depth than the first virtual display layer, where at least a portion of the second virtual display layer is at least partially translucent so that at least a portion of the contents of the first virtual display layer is visi
    Type: Grant
    Filed: October 25, 2019
    Date of Patent: May 12, 2020
    Assignee: P4TENTS1, LLC
    Inventor: Michael S Smith
  • Patent number: 10650496
    Abstract: Systems and methods are provided for image scaling with efficient pixel resolution conversion. One embodiment is an image scaling system that includes a processor that receives an instruction to scale an input image having a first resolution by a scaling ratio to create an output image having a second resolution, and determines a rational fraction approximation of the scaling ratio to obtain a numerator integer representing a first block of consecutive pixels in the output image and a denominator integer representing a second block of consecutive pixels in the input image. The processor also calculates pixel values of the first block of pixels by: bit shifting pixel values of the second block of pixels, obtaining a sum of bit shifting operations of neighboring pixel values of the second block of pixels, and correcting the sum with a correction value to compensate for rounding errors in the bit shifting.
    Type: Grant
    Filed: February 13, 2018
    Date of Patent: May 12, 2020
    Assignee: Ricoh Company, Ltd.
    Inventors: Larry M Ernst, Mikel John Stanich, John Thomas Varga
  • Patent number: 10636126
    Abstract: An image processing device includes: a high-resolution combining unit that generates a high-resolution combined image by combining a standard image with at least one reference image other than the standard image in a high-resolution image space having higher resolution than the standard image or the at least one reference image, the standard image and the at least one reference image being acquired by photographing a subject in a time-series manner by using an imaging element having a plurality of types of color filters arranged for each pixel; a moving-object detecting unit that determines at least one correlation amount by calculating a magnitude relationship between a plurality of correlation values within an arbitrary region of the high-resolution combined image generated by the high-resolution combining unit; and an image correcting unit that corrects the high-resolution combined image based on the correlation amount determined by the moving-object detecting unit.
    Type: Grant
    Filed: April 5, 2018
    Date of Patent: April 28, 2020
    Inventor: Kosuke Kajimura
  • Patent number: 10609282
    Abstract: A wide-area image acquiring method which includes capturing a global image in a preset wide-area visual area, capturing at least two partial images whose definition is preset and that are in the preset wide-area visual area, where the global image covers at least an overlap portion of view ranges of the partial images in the preset wide-area visual area, and a sum of the view ranges of the at least two partial images is greater than or equal to a view range of the global image, determining, in the global image, positions of edges of the partial images, based on same shot objects in the partial images and the global image, and performing splice processing on the at least two partial images according to the positions of the edges, to obtain a composite wide-area image of the wide-area visual area.
    Type: Grant
    Filed: December 27, 2016
    Date of Patent: March 31, 2020
    Inventors: Changqi Hu, Yong Tian, Zijin Yuan
  • Patent number: 10600167
    Abstract: A method, computer readable medium, and system are disclosed for performing spatiotemporal filtering. The method includes the steps of applying, utilizing a processor, a temporal filter of a filtering pipeline to a current image frame, using a temporal reprojection, to obtain a color and auxiliary information for each pixel within the current image frame, providing the auxiliary information for each pixel within the current image frame to one or more subsequent filters of the filtering pipeline, and creating a reconstructed image for the current image frame, utilizing the one or more subsequent filters of the filtering pipeline.
    Type: Grant
    Filed: January 18, 2018
    Date of Patent: March 24, 2020
    Inventors: Christoph H. Schied, Marco Salvi, Anton S. Kaplanyan, Aaron Eliot Lefohn, John Matthew Burgess, Anjul Patney, Christopher Ryan Wyman
  • Patent number: 10546216
    Abstract: A method comprising: receiving a source image and a target image, each depicting a dense recurring pattern comprising an array of objects arranged in close proximity to one another; applying a trained machine learning classifier to obtain a classification of each pixel in said source image and said target image into one of at least two classes; determining a pixel-level transformation between said classified source and target images, based, at least in part, on a set of transformation parameters; training a neural network to optimize said set of transformation parameters, based, at least in part, on minimizing a loss function which calculates a weighted sum of per-pixel matches between said classified source and target images; and applying said optimized set of transformation parameters to said target image. to align said target image with said source image.
    Type: Grant
    Filed: April 11, 2019
    Date of Patent: January 28, 2020
    Inventors: Ori Shachar, Michael Yushchuk, Guy Salton-Morgenstern
  • Patent number: 10460747
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for frequency based audio analysis using neural networks. One of the methods includes training a neural network that includes a plurality of neural network layers on training data, wherein the neural network is configured to receive frequency domain features of an audio sample and to process the frequency domain features to generate a neural network output for the audio sample, wherein the neural network comprises (i) a convolutional layer that is configured to map frequency domain features to logarithmic scaled frequency domain features, wherein the convolutional layer comprises one or more convolutional layer filters, and (ii) one or more other neural network layers having respective layer parameters that are configured to process the logarithmic scaled frequency domain features to generate the neural network output.
    Type: Grant
    Filed: May 10, 2016
    Date of Patent: October 29, 2019
    Assignee: Google LLC
    Inventors: Dominik Roblek, Matthew Sharifi
  • Patent number: 10448015
    Abstract: The present invention relates to a method for performing adaptive filtering according to a block boundary, comprising the steps of: determining whether a current pixel is within a block boundary; determining the shape of a filter depending on the location of the current pixel, when the current pixel is within the block boundary; calculating a filter coefficient based on the shape of the filter; and performing an adaptive loop filtering using the filter coefficient.
    Type: Grant
    Filed: June 16, 2016
    Date of Patent: October 15, 2019
    Inventors: Junghak Nam, Chulkeun Kim
  • Patent number: 10349058
    Abstract: Disclosed is a method for predicting depth map coding distortion of a two-dimensional free viewpoint video, including: inputting sequences of texture maps and depth maps of two or more viewpoint stereoscopic videos; synthesizing a texture map of a first intermediate viewpoint of a current to-be-coded viewpoint and a first adjacent viewpoint, and synthesizing a texture map of a second intermediate viewpoint of the current to-be-coded viewpoint and a second adjacent viewpoint by using a view synthesis algorithm; recording a synthetic characteristic of each pixel according to the texture map and generating a distortion prediction weight; and calculating to obtain total distortion according to the synthetic characteristic and the distortion prediction weight.
    Type: Grant
    Filed: July 26, 2017
    Date of Patent: July 9, 2019
    Inventors: Xin Jin, Chenyang Li, Qionghai Dai
  • Patent number: 10317336
    Abstract: A spectral measurement method of the present invention includes: a measuring step of measuring optical spectra of some sections specified among a plurality of sections on a specimen; a scalar-value calculating step of calculating, for individual measured sections, scalar values that represent information contained in the obtained optical spectra; an interpolating step of interpolating scalar values of unmeasured sections by using the calculated scalar values and by using two types of interpolation methods; an identifying step of identifying sections in which absolute values of differences between the two scalar values interpolated by using the two types of interpolation methods are equal to or greater than a predetermined threshold; and a repeating step of re-executing steps from the measuring step to the identifying step after specifying the identified sections.
    Type: Grant
    Filed: August 3, 2016
    Date of Patent: June 11, 2019
    Inventors: Akira Sato, Shinichi Takimoto
  • Patent number: 10306196
    Abstract: It is determined whether an image before pixel mixture has a high frequency. In a partial image obtained by an imaging device having a Bayer array, a Gr pixel which indicates a green component and is arranged in the same row as an R pixel indicating a red component is distinguished from a Gb pixel which indicates a green component and is arranged in the same row as a B pixel indicating a blue component. The Gr pixels and the Gb pixels which are distinguished from each other are separately mixed. When an image before pixel mixture has a high-frequency component, the level of the Gr pixel and the level of the Gb pixel are different from each other after pixel mixture. It is determined whether the image before pixel mixture has a high-frequency component based on levels of the Gr pixel and Gb pixel after pixel mixture.
    Type: Grant
    Filed: November 20, 2015
    Date of Patent: May 28, 2019
    Assignee: FUJIFILM Corporation
    Inventor: Seiji Tanaka
  • Patent number: 10178359
    Abstract: Tone mapping is performed by digital image processing circuitry on a macro-pixel basis. A luminance value of a macro-pixel of a digital image in a color space is determined. The macro-pixel includes a plurality of individual pixels. Respective tone-mapping gain values of each pixel of the macro-pixel are determined based on the determined luminance value of the macro-pixel. The determined tone-mapping gains are applied to the respective pixels of the macro-pixel. The color space may be a CFA color space, such as a Bayer color space.
    Type: Grant
    Filed: April 1, 2016
    Date of Patent: January 8, 2019
    Inventors: Mathieu Thivin, Grégory Roffet
  • Patent number: 10148926
    Abstract: An imaging apparatus may include an image sensor that includes a Bayer color filter array (CFA) of 2-by-2 cell groups each of which includes a red pixel, a blue pixel, and two green pixels, and an image signal processor for processing raw data from the Bayer CFA. The image signal processor corrects the raw data to reduce artifacts such as image contrast degradation caused by using green pixels with wide transmission spectrum.
    Type: Grant
    Filed: December 7, 2015
    Date of Patent: December 4, 2018
    Assignee: Samsung Electronics Co., Ltd.
    Inventors: Alexander Getman, Ilia Ovsiannikov
  • Patent number: 10122986
    Abstract: The present technique relates to an image processing device and an image processing method for realizing accurate depth image warping operations at the receiving side when depth images with reduced resolutions are transmitted. A parallax image generating unit reduces the resolutions of parallax images B1? and C1?. A boundary information generating unit generates boundary information about the parallax images B1? and C1?. A multiplexing unit transmits a multiplexed stream containing the parallax images B1? and C1? with the reduced resolutions and the boundary information. The present technique can be applied to encoding devices that encode glasses-free 3D images, for example.
    Type: Grant
    Filed: February 16, 2012
    Date of Patent: November 6, 2018
    Inventors: Shinobu Hattori, Yoshitomo Takahashi
  • Patent number: 9967459
    Abstract: First and second images are captured at first and second focal lengths, the second focal length being longer than the first focal length. Element sets are defined with a first element of the first image and a corresponding second element of the second image. Element sets are identified as background if the second element thereof is more in-focus than or as in-focus as the first element. Background elements are subtracted from further analysis. Comparisons are based on relative focus, e.g. whether image elements are more or less in-focus. Measurement of absolute focus is not necessary, nor is measurement of absolute focus change; images need not be in-focus. More than two images, multiple element sets, and/or multiple categories and relative focus relationships also may be used.
    Type: Grant
    Filed: December 8, 2014
    Date of Patent: May 8, 2018
    Assignee: Atheer, Inc.
    Inventors: Mohamed Nabil Hajj Chehade, Sina Fateh, Sleiman Itani, Allen Yang Yang
  • Patent number: 9911399
    Abstract: A method of image processing includes determining a supplement pixel and original pixels adjacent to the supplement pixel, deriving luminance data of the original pixels from input image data, calculating a difference value among the luminance data of the original pixels, selecting an original pixel of the original pixels as an effective pixel when the difference value of luminance data of the original pixel and a nearest original pixel to the supplement pixel is smaller than a predetermined threshold value, setting a weighted value of the effective pixel based on a distance between the supplement pixel and the effective pixel, and calculating luminance data of the supplement pixel based on luminance data of the effective pixel and the weighted value.
    Type: Grant
    Filed: January 15, 2016
    Date of Patent: March 6, 2018
    Inventors: Sung-Yeol Baek, Eun-Ho Lee
  • Patent number: 9912864
    Abstract: In various embodiments a camera with multiple optical chains, e.g., camera modules, is controlled to operate in one of a variety of supported modes of operation. The modes include a non-motion mode, a motion mode, a normal burst mode and/or a reduced data burst mode. Motion mode is well suited for capturing an image including motion, e.g., moving object(s) with some modules being used to capture scene areas using a shorter exposure time than other modules and the captured images then being combined taking into consideration locations of motion. A reduced data burst mode is supported in some embodiments in which camera modules with different focal lengths capture images at different rates. While the camera modules of different focal length operate at different image capture rates in the reduced data burst mode, images are combined to support a desired composite image output rate, e.g., a desired frame rate.
    Type: Grant
    Filed: October 17, 2015
    Date of Patent: March 6, 2018
    Assignee: Light Labs Inc.
    Inventors: Rajiv Laroia, Nitesh Shroff, Sapna A. Shroff
  • Patent number: 9860429
    Abstract: Embodiments of the present disclosure relate to a sensor interface circuit that performs scaling of image data in a Bayer pattern without spreading defective pixels across multiple pixels. The sensor interface circuit may include a register circuit storing operating parameters of the sensor interface circuit. The sensor interface circuit includes a scaling circuit with a first defect pixel detection circuit to detect a first defective pixel in an input image by analyzing pixels in a line of an input image data along a first direction. A first scaling circuit is coupled to the first defect pixel detection circuit and generates a scaled line of pixels representing the line of the input image scaled along the first direction according to the operating parameters.
    Type: Grant
    Filed: June 30, 2016
    Date of Patent: January 2, 2018
    Assignee: Apple Inc.
    Inventors: D. Amnon Silverstein, Jaewon Shin
  • Patent number: 9762904
    Abstract: In general, techniques are described for performing motion vector prediction for video coding. A video coding device comprising a processor may perform the techniques. The processor may be configured to determine a plurality of candidate motion vectors for a current block of the video data so as to perform the motion vector prediction process and scale one or more of the plurality of candidate motion vectors determined for the current block of the video data to generate one or more scaled candidate motion vectors. The processor may then be configured to modify the scaled candidate motion vectors to be within a specified range.
    Type: Grant
    Filed: December 10, 2012
    Date of Patent: September 12, 2017
    Assignee: QUALCOMM Incorporated
    Inventors: Jianle Chen, Muhammed Zeyd Coban, Ye-Kui Wang, Xianglin Wang, Marta Karczewicz, Wei-Jung Chien
  • Patent number: 9639918
    Abstract: A method for image edge anti-aliasing with super-resolution is provided and used to achieve enlargement conversion from low resolution to high resolution, by applying the steps of: detecting a received image data and saving as an original edge pixel frame; enlarging the original edge pixel frame in double size along the horizontal and vertical directions, respectively; retaining the original edge pixel information; replacing pixels to be interpolated with a zero grayscale; and compensating the pixels to be interpolated which are temporarily replaced by the zero grayscale along edge directions of the original edge pixel, such that the jagged phenomenon of output picture is output picture is significantly decreased, such that the jagged phenomena of an output picture is significantly decreased, with a detailed image information is well-maintained. The method is simple, with fewer calculations and faster operating speed, the cost can be effectively reduced.
    Type: Grant
    Filed: May 15, 2014
    Date of Patent: May 2, 2017
    Inventors: Hao Li, Houliang Hu, Li-Wei Chu, JhenWei He
  • Patent number: 9602762
    Abstract: A system for frame rate conversion of a video that includes detecting low quality of a received frame and determining an interpolated frame of the video based upon the detected low quality of the received frame.
    Type: Grant
    Filed: June 12, 2015
    Date of Patent: March 21, 2017
    Assignee: Sharp Laboratories of America, Inc.
    Inventors: Xu Chen, Petrus J. L. Van Beek
  • Patent number: 9542730
    Abstract: Image processing is performed in view of the difference between the chroma component and the brightness component in an image, with a relatively smaller amount of data processed during the image processing. A frequency decomposing unit 110 performs frequency decomposition directly on Bayer image signals from an imaging element 3. With this, a high frequency component representing color information and a low frequency component representing brightness information are obtained. A filter coefficient obtaining unit 131 of a correction processing unit 130 obtains filter coefficients and the filter coefficients for the high frequency component are different from those for the low frequency component. A filtering processing unit performs a filtering process on subimages based on the filter coefficients obtained by the filter coefficient obtaining unit 131 in such a manner that processing details of the filtering process for the high frequency component are different from those for the low frequency component.
    Type: Grant
    Filed: June 19, 2014
    Date of Patent: January 10, 2017
    Inventor: Isao Yamada
  • Patent number: 9521380
    Abstract: An image sensor may have an array of image sensor pixels arranged in color filter unit cells each having one red image pixel that generates red image signals, one blue image pixel that generate blue image signals, and two clear image sensor pixels that generate white image signals. The image sensor may be coupled to processing circuitry that performs filtering operations on the red, blue, and white image signals to increase noise correlations in the image signals that reduce noise amplification when applying a color correction matrix to the image signals. The processing circuitry may extract a green image signal from the white image signal. The processing circuitry may compute a scaling value that includes a linear combination of the red, blue, white and green image signals. The scaling value may be applied to the red, blue, and green image signals to produce corrected image signals having improved image quality.
    Type: Grant
    Filed: September 30, 2015
    Date of Patent: December 13, 2016
    Inventors: Marko Mlinar, Brian Keelan
  • Patent number: 9521411
    Abstract: An Encoder Assisted Frame Rate Up Conversion (EA-FRUC) system that utilizes video coding and pre-processing operations at the video encoder to exploit the FRUC processing that will occur in the decoder in order to improve compression efficiency and reconstructed video quality is disclosed. One operation of the EA-FRUC system involves determining whether to encode a frame in a sequence of frames of a video content by determining a spatial activity in a frame of the sequence of frames; determining a temporal activity in the frame; determining a spatio-temporal activity in the frame based on the determined spatial activity and the determined temporal activity; determining a level of a redundancy in the source frame based on at least one of the determined spatial activity, the determined temporal activity, and the determined spatio-temporal activity; and, encoding the non-redundant information in the frame if the determined redundancy is within predetermined thresholds.
    Type: Grant
    Filed: February 6, 2013
    Date of Patent: December 13, 2016
    Assignee: QUALCOMM Incorporated
    Inventors: Vijayalakshmi R. Raveendran, Fang Shi, Gordon Kent Walker
  • Patent number: 9485482
    Abstract: An imaging apparatus (10) includes: an image pickup device (14) including plural photoelectric conversion elements arrayed in a predetermined first direction and second direction; a color filter that has a repeatedly disposed basic array pattern that includes a first filter corresponding to a first color that contributes most to obtaining a brightness signal, and second filters corresponding second colors, placed in a predetermined pattern; a drive section (22) that drives the image pickup device (14) such that, for an array of pixels to read from the image pickup device (14), pixel data of pixels placed at a set cycle in at least one direction of the first direction or the second direction is read to give a second array that is different from a first array expressing an array of all the pixels read from the image pickup device (14); and an image processing section (20) that corrects pixel data of a subject pixel for color mixing correction based on pixel data of a pixel that is the same color as an adjacent
    Type: Grant
    Filed: June 26, 2014
    Date of Patent: November 1, 2016
    Assignee: FUJIFILM Corporation
    Inventors: Hidekazu Kurahashi, Hayato Yamashita
  • Patent number: 9460545
    Abstract: An apparatus for generating a new viewpoint image includes: a new viewpoint image generation unit that shifts the foreground image region in the input image, based on a depth map to generate a new viewpoint image including a missing pixel region; a representative background pixel selection unit that selects background pixels located a predetermined number of pixels away from edge pixels, as representative background pixels; a texture direction map calculation unit that calculates a texture direction of each of the selected representative background pixels, to calculate a texture direction map indicating texture directions, each corresponding to one of missing pixels, based on locations of the representative background pixels and locations of the missing pixels included in the missing pixel region; and a hole-filling processing unit that fills the missing pixel region with the obtained background pixels in accordance with the texture direction map.
    Type: Grant
    Filed: November 29, 2012
    Date of Patent: October 4, 2016
    Inventors: Kuniaki Isogai, Pongsak Lasang, Sheng Mei Shen, Yusuke Monobe
  • Patent number: 9430973
    Abstract: A image signal processing method of a liquid crystal display according to an exemplary embodiment of the present invention includes: receiving a previous image signal and a current image signal as two sequential input image signals; performing a first correction (DCC) and a doubling for the current image signal to generate a correction image signal comprising a plurality of doubled frames for the current image signal; and post-processing the portion of the plurality of doubled frames to generate a final correction image signal.
    Type: Grant
    Filed: August 12, 2013
    Date of Patent: August 30, 2016
    Inventors: Nam-Gon Choi, Yong Jun Jang, Jung-Won Kim, Geun Jeong Park, Ji-Woong Jeong, Uk Chul Choi, Joon-Chul Goh, Cheol Woo Park, Bong Hyun You
  • Patent number: 9400929
    Abstract: An object detection device includes a raster scan execution unit that executes a raster scan on an input image using a scan window in order to detect an object within the input image which is input by an image input unit, a scan point acquisition unit that acquires scan points of the scan window which are positions on the input image during the execution of the raster scan, and a size-changing unit that changes a relative size of the input image with respect to the scan window. When the relative size is changed by the size-changing unit, an offset is given to the starting positions of the scan points after the change with respect to the starting positions of the scan points before the change.
    Type: Grant
    Filed: March 5, 2013
    Date of Patent: July 26, 2016
    Inventors: Yuichi Matsumoto, Megumi Nagata
  • Patent number: 9401005
    Abstract: An image processing circuit includes a determination unit configured to classify the input image data into a first image area being a gradation area, a second image area being a non-gradation area, or a third image area being an intermediate area between the gradation area and the non-gradation area; a first pixel interpolation unit configured to generate a first output pixel value interpolated by applying a theoretically calculated coefficient to a pixel value of the input image data; a second pixel interpolation unit configured to generate a second output pixel value interpolated by applying a coefficient obtained by learning to the pixel value of the input image data; and a mixing unit configured to output the first output pixel value, the second output pixel value, or a third output pixel value, obtained by processing the first and second output pixel values, according to a classification result of the determination unit.
    Type: Grant
    Filed: November 18, 2013
    Date of Patent: July 26, 2016
    Inventor: Takashi Yasuoka
  • Patent number: 9374500
    Abstract: An image processing apparatus includes a processor and a memory storing computer-readable instructions therein. The computer-readable instructions, when executed by the processor, cause the image processing apparatus to: acquire scan data from a scan data generating unit, the scan data generating unit being configured to generate the scan data by optically reading a sheet being conveyed, the scan data representing a scanned image that includes an image indicative of the sheet, the sheet having a plurality of sides; detect a plurality of edge lines from the scanned image by analyzing the scan data, the plurality of edge lines representing the plurality of sides, respectively; determine whether the plurality of edge lines include a non-linear edge line; and correct, when the plurality of edge lines is determined to include a non-linear edge line, the scan data so that the non-linear edge line is changed to a linear edge line.
    Type: Grant
    Filed: March 26, 2015
    Date of Patent: June 21, 2016
    Inventor: Koichi Tsugimura
  • Patent number: 9361725
    Abstract: Provided are an image generation apparatus, three-dimensional image display apparatus, image generation method and non-transitory computer readable medium.
    Type: Grant
    Filed: April 19, 2013
    Date of Patent: June 7, 2016
    Inventors: Di Wu, Michiaki Sakamoto
  • Patent number: 9357105
    Abstract: To determine if a pixel exhibits artifacts, statistics are generated for the pixel and its neighbors. These statistics are compared with thresholds. If the comparison of the statistics and the thresholds suggests that the pixel exhibits a pixel artifact, then recourse can be taken, either to adjust the pixel value in some way, or to reject the angle of interpolation used in computing the value for the target pixel.
    Type: Grant
    Filed: March 15, 2013
    Date of Patent: May 31, 2016
    Assignee: Pixelworks, Inc.
    Inventors: Yue Ma, Hongmin Zhang
  • Patent number: 9299128
    Abstract: An apparatus comprising one or more processors configured to process a first image at a first resolution to generate a first solved image at the first resolution, determine a difference between the first solved image and a function of the first image, and generate a second solved image at a second resolution higher than the first resolution based at least in part on the difference between the first solved image and the function of the first image.
    Type: Grant
    Filed: May 23, 2014
    Date of Patent: March 29, 2016
    Assignee: Futurewei Technologies, Inc.
    Inventors: Jun Tian, Wenjun Zeng
  • Patent number: 9282253
    Abstract: A digital camera system for super resolution image processing constructed to receive a plurality of input frames and output at least one digitally zoomed frame is provided. The digital camera system includes a motion registration module configured to generate motion information associated with the plurality of input frames, an interpolation module configured to generate a plurality of interpolated input frames based at least in part on the plurality of input frames and the motion information, a weights calculation module configured to calculate one or more weights associated with the plurality of input frames based on at least the motion information, and a weighted merging module configured to merge the plurality interpolated input frames consistent with the one or more weights to generate the at least one digitally zoomed frame.
    Type: Grant
    Filed: February 18, 2014
    Date of Patent: March 8, 2016
    Assignee: QUALCOMM Technologies, Inc.
    Inventors: Amichay Amitay, Noam Levy