Using Frame Or Field Delays (e.g., Motion Adaptive) Patents (Class 348/620)
  • Patent number: 11715183
    Abstract: Methods and apparatuses are disclosed herein for performing tone mapping and/or contrast enhancement. In some examples, a block mapping curve is low-pass filtered with block mapping curves of surrounding blocks to form a smoothed block mapping curve. In some examples, overlapped curve mapping of block mapping curves, including smoothed block mapping curves, is performed, including weighting, based on a pixel location, block mapping curves of a group of blocks to generate an interpolated block mapping curve and applying the interpolated block mapping curve to a pixel to perform ton mapping and/or contrast enhancement.
    Type: Grant
    Filed: June 1, 2022
    Date of Patent: August 1, 2023
    Assignee: Advanced Micro Devices, Inc.
    Inventor: Ying-Ru Chen
  • Patent number: 11477452
    Abstract: Provided are a method and a device for decoding a video signal to provide stereographic image content with high resolution. The method may include: determining whether a coding block is partitioned into 4 child coding blocks or not; in response to the coding block not partitioned into 4 child coding blocks, determining whether the coding block is partitioned into 2 child coding block or not; in response to the coding block partitioned into the 2 child coding block, partitioning the coding block into 2 child coding block in either a horizontal direction or a vertical direction; determining motion information of the current block in response to the prediction mode of the current block being an inter mode; obtaining a prediction sample of the current block; obtaining a residual sample of the current block; and obtaining a reconstruction sample of the current block based on the prediction sample and the residual sample.
    Type: Grant
    Filed: November 12, 2020
    Date of Patent: October 18, 2022
    Assignee: KT CORPORATION
    Inventors: Bae Keun Lee, Joo Young Kim
  • Patent number: 10777823
    Abstract: A secondary ionomer that enhances activity and stability of a cathode catalyst in a polymer electrolyte membrane fuel cell includes the ionic liquid, 1-methyl-2,3,4,6,7,8-hexahydro-1H-pyrimido[1,2-a]pyrimidin-9-ium 1,1,2,2,3,3,4,4,4-nonafluorobutane-1-sulfonate ([MTBD][C4F9SO3]). When contacting the catalyst, [MTBD][C4F9SO3] enhances catalyst activity and stability more effectively than previously known ionomers, likely by preventing oxide formation and water adsorption at the catalyst surface. The disclosed secondary ionomer is thus most effective when completely coating the catalyst.
    Type: Grant
    Filed: April 3, 2017
    Date of Patent: September 15, 2020
    Assignees: TOYOTA JIDOSHA KABUSHIKI KAISHA, TOYOTA MOTOR ENGINEERING & MANUFACTURING NORTH AMERICA, INC., THE UNIVERSITY OF NOTRE DAME
    Inventors: Kan Huang, Oscar Morales Collazo, Joan Brennecke, Hongfei Jia, Hisao Kato
  • Patent number: 10674045
    Abstract: Implementations disclose mutual noise estimation for videos. A method includes determining an optimal frame noise variance for intensity values of each frame of frames of a video, the optimal frame noise variance based on a determined relationship between spatial variance and temporal variance of the intensity values of homogeneous blocks in the frame, identifying an optimal video noise variance for the video based on optimal frame noise variances of the frames of the video, selecting, for each frame of the video, one or more of the blocks having a spatial variance that is less than the optimal video noise variance, the one or more frames selected as the homogeneous blocks, and utilizing the selected homogeneous blocks to estimate a noise signal of the video.
    Type: Grant
    Filed: May 31, 2017
    Date of Patent: June 2, 2020
    Assignee: Google LLC
    Inventors: Neil Birkbeck, Mohammad Izadi, Anil Kokaram, Balineedu C. Adsumilli, Damien Kelly
  • Patent number: 10645392
    Abstract: Overlapped block disparity estimation and compensation is described. Compensating for images with overlapped block disparity compensation (OBDC) involves determining if OBDC is enabled in a video bit stream, and determining if OBDC is enabled for one or more macroblocks that neighbor a first macroblock within the video bit stream. The neighboring macroblocks may be transform coded. If OBDC is enabled in the video bit stream and for the one or more neighboring macroblocks, predictions may be made for a region of the first macroblock that has an edge adjacent with the neighboring macroblocks. OBDC can be causally applied. Disparity compensation parameters or modes may be shared amongst views or layers. A variety of predictions may be used with causally-applied OBDC.
    Type: Grant
    Filed: July 19, 2019
    Date of Patent: May 5, 2020
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Alexandros Tourapis, Athanasios Leontaris
  • Patent number: 10621703
    Abstract: An image processing apparatus includes a noise level calculation circuit, an inter-frame change amount calculation circuit, a recursive coefficient calculation circuit, and a composite processing circuit. The noise level calculation circuit detects a noise level of a signal of a focused frame in moving images. The inter-frame change amount calculation circuit detects the amount of change between the focused frame and the previous frame by using the noise level of the focused frame, the signal of the focused frame, and a signal of the previous frame after a noise reduction process. The recursive coefficient calculation circuit sets a coefficient for use in the noise reduction process according to the amount of change. The composite processing circuit performs the noise reduction process on the signal of the focused frame by using the signal of the focused frame, the signal of the previous frame after the noise reduction process, and the coefficient.
    Type: Grant
    Filed: July 1, 2019
    Date of Patent: April 14, 2020
    Assignee: Canon Kabushiki Kaisha
    Inventor: Hirotaka Omori
  • Patent number: 10572980
    Abstract: An image processing apparatus includes a noise level calculation circuit, an inter-frame change amount calculation circuit, a recursive coefficient calculation circuit, and a composite processing circuit. The noise level calculation circuit detects a noise level of a signal of a focused frame in moving images. The inter-frame change amount calculation circuit detects the amount of change between the focused frame and the previous frame by using the noise level of the focused frame, the signal of the focused frame, and a signal of the previous frame after a noise reduction process. The recursive coefficient calculation circuit sets a coefficient for use in the noise reduction process according to the amount of change. The composite processing circuit performs the noise reduction process on the signal of the focused frame by using the signal of the focused frame, the signal of the previous frame after the noise reduction process, and the coefficient.
    Type: Grant
    Filed: May 3, 2018
    Date of Patent: February 25, 2020
    Assignee: Canon Kabushiki Kaisha
    Inventor: Hirotaka Omori
  • Patent number: 10574994
    Abstract: Overlapped block disparity estimation and compensation is described. Compensating for images with overlapped block disparity compensation (OBDC) involves determining if OBDC is enabled in a video bit stream, and determining if OBDC is enabled for one or more macroblocks that neighbor a first macroblock within the video bit stream. The neighboring macroblocks may be transform coded. If OBDC is enabled in the video bit stream and for the one or more neighboring macroblocks, predictions may be made for a region of the first macroblock that has an edge adjacent with the neighboring macroblocks. OBDC can be causally applied. Disparity compensation parameters or modes may be shared amongst views or layers. A variety of predictions may be used with causally-applied OBDC.
    Type: Grant
    Filed: March 11, 2019
    Date of Patent: February 25, 2020
    Assignee: Dolby Laboratories Licensing Corporation
    Inventors: Alexandros Tourapis, Athanasios Leontaris
  • Patent number: 10425582
    Abstract: An image processing system generates 360-degree stabilized videos with higher robustness, speed, and smoothing ability using a hybrid 3D-2D stabilization model. The image processing system first receives an input video data (e.g., a 360-degree video data) for rotation stabilization. After tracking feature points through the input video data, the image processing system determines key frames and estimates rotations of key frames using a 3D reasoning based on the tracked feature points. The image processing system also optimizes inner frames between key frames using a 2D analysis based on the estimated key frame rotation. After the 3D reasoning and the 2D analysis, the image processing system may reapply a smoothed version of raw rotations to preserve desirable rotations included in the original input video data, and generates a stabilized version of the input video data (e.g., a 360-degree stabilized video).
    Type: Grant
    Filed: August 25, 2016
    Date of Patent: September 24, 2019
    Assignee: Facebook, Inc.
    Inventor: Johannes Peter Kopf
  • Patent number: 10305620
    Abstract: Blind polarization demultiplexing algorithms based on complex independent component analysis (ICA) by negentropy maximization for quadrature amplitude modulation (QAM) coherent optical systems are disclosed. The polarization demultiplexing is achieved by maximizing the signal's non-Gaussianity measured by the information theoretic quantity of negentropy. An adaptive gradient optimization algorithm and a Quasi-Newton algorithm with accelerated convergence are employed to maximize the negentropy. Certain approximate nonlinear functions can be substitutes for the negentropy which is strictly derived from the probability density function (PDF) of the received noisy QAM signal with phase noise, and this reduces the computational complexity.
    Type: Grant
    Filed: May 2, 2014
    Date of Patent: May 28, 2019
    Assignee: ZTE (USA) Inc.
    Inventors: Jianjun Yu, Jin Tang
  • Patent number: 10200649
    Abstract: An image processing device comprising: a recording unit configured to record a previous frame image input before a target frame image that is to be a processing target or an output frame image from the previous frame image; an alignment unit configured to align the target frame image with the previous frame image or with the output frame image from the previous frame image; a correction unit configured to perform a temporal correction process to correct a pixel value of the target frame image by use of a pixel value of the previous frame image or a pixel value of the output frame image from the previous frame image that has been aligned by the alignment unit, with reference to the recording unit; and a generation unit configured to generate an output frame image from the target frame image by use of the target frame image corrected by the correction unit.
    Type: Grant
    Filed: February 5, 2015
    Date of Patent: February 5, 2019
    Assignee: Morpho, Inc.
    Inventors: Masaki Satoh, Shun Hirai
  • Patent number: 10181181
    Abstract: A method of mitigating noise in source image data representing pixels of a 3-D image. The “3-D image” may be any type of 3-D image, regardless of whether the third dimension is spatial, temporal, or some other parameter. The 3-D image is divided into three-dimensional chunks of pixels. These chunks are apodized and a three-dimensional Fourier transform is performed on each chunk, thereby producing a three-dimensional spectrum of each chunk. The transformed chunks are processed to estimate a noise floor based on spectral values of the pixels within each chunk. A noise threshold is then determined, and the spectrum of each chunk is filtered with a denoising filter based on the noise threshold. The chunks are then inverse transformed, and recombined into a denoised 3-D image.
    Type: Grant
    Filed: May 10, 2017
    Date of Patent: January 15, 2019
    Assignee: SOUTHWEST RESEARCH INSTITUTE
    Inventor: Craig E. DeForest
  • Patent number: 10158790
    Abstract: An image memory is reduced in an image processing apparatus that generates a background image from which the influence of rain or the like is removed. In the image processing apparatus, a selection unit selects two image signals having a shorter distance in a color space from among an input image signal input during a focused processing cycle among processing cycles executed for respective time-series frames each constituted by the input image signal, an immediately preceding output image signal which is an output image signal generated during a processing cycle immediately preceding the focused processing cycle, and an already output image signal which is an image signal based on the output image signal generated during a processing cycle preceding the focused processing cycle by two cycles. An output image signal generation unit generates the output image signal by mixing the two selected image signals on the basis of a predetermined mixing ratio.
    Type: Grant
    Filed: January 12, 2016
    Date of Patent: December 18, 2018
    Assignee: Sony Semiconductor Solutions Corporation
    Inventor: Masaaki Hayashi
  • Patent number: 10140514
    Abstract: Enable image based communication between mobile devices and servers. Propagating an image entity to a specific device/user and or to a plurality of devices/user enabling the people networks to be viable. The digital image entity comes into existence at a specified time, exists for a desired duration of time, and ceases to exist at a set time. A virtual network of people joined together for a specific purpose such as social networks, professional networks, enterprise networks, family networks, friends networks and other networks. Each user in such people networks has one or more profiles and is enabled to form multiple people networks. Each image entity each further comprises of one or more sub image entities that are connected to a specific image entity by their own sub relationships. The visual experience is formed by viewing a series of super images that are refreshed and updated at an optimal frequency.
    Type: Grant
    Filed: June 15, 2016
    Date of Patent: November 27, 2018
    Assignee: IP Holdings, Inc.
    Inventors: Sunil K. Rao, Raman K. Rao
  • Patent number: 10102643
    Abstract: An endoscope apparatus includes: a reference image generating section that generates a reference image to be used for determining whether an inspection object is non-defective or defective; and a mixer that outputs the reference image in a superimposed manner on an endoscopic image from an endoscope, the endoscopic image being obtained by photographing the inspection object, in a predetermined inspection mode, and an image of the inspection object and the reference image are displayed in a superimposed manner, to thereby facilitate a non-defective/defective determination and improve an operability in an inspection.
    Type: Grant
    Filed: April 14, 2016
    Date of Patent: October 16, 2018
    Assignee: OLYMPUS CORPORATION
    Inventor: Saichi Sato
  • Patent number: 10031058
    Abstract: Techniques for gas analysis using a parallel dipole line (PDL) trap viscometer are provided. In one aspect, a gas analysis system is provided which includes: a PDL trap including: a pair of diametric cylindrical magnets, and a diamagnetic rod levitating above the magnets; and a motion detector for capturing motion of the diamagnetic rod. The motion detector can include a digital video camera positioned facing a top of the PDL trap so as to permit capturing video images of the diamagnetic rod and the system can include a computer for receiving and analyzing video images from the video camera. Methods for measuring gas viscosity and pressure using the PDL trap system are also provided.
    Type: Grant
    Filed: August 14, 2015
    Date of Patent: July 24, 2018
    Assignee: International Business Machines Corporation
    Inventors: Oki Gunawan, Yudistira Virgus
  • Patent number: 9984472
    Abstract: An image processing system receives a sequence of frames including a current input frame and a next input frame (the next input frame is captured subsequent in time with respect to capturing of the current input frame). The image processing system stores a previously outputted output frame. The previously outputted output frame is derived from previously processed input frames in the sequence. The image processing modifies the current input frame based on detected first motion and second motion. The first motion is detected based on an analysis of the current input frame with respect to the next input frame. The second motion is detected based on an analysis of the current input frame with respect to the previously outputted output frame. According to one configuration, the image processing system implements multi-sized analyzer windows to more precisely detect the first motion and second motion.
    Type: Grant
    Filed: June 16, 2014
    Date of Patent: May 29, 2018
    Assignee: A9.COM, INC.
    Inventors: Daniel B. Grunberg, Anantharanga Prithviraj, Douglas M. Chin, Peter D. Besen
  • Patent number: 9944237
    Abstract: A proximity switch assembly and method for detecting activation of a proximity switch assembly is provided. The method includes steps of generating activation fields with a plurality of proximity sensors associated with a plurality of proximity switches, monitoring amplitude of a signal generated in response to each of the activation fields, subtracting the smallest signal from each of the other signals, and determining activation of one of the plurality of proximity switches based on the subtracted signals. A proximity sensor assembly and method of suppressing noise for a plurality of proximity sensors is also provided, which includes subtracting the smallest signal from each of other signals associated with a plurality of proximity sensors and determining activation of one of the plurality of proximity sensors based on the subtracted signals.
    Type: Grant
    Filed: April 17, 2015
    Date of Patent: April 17, 2018
    Assignee: Ford Global Technologies, LLC
    Inventors: Pietro Buttolo, Stuart C. Salter, James Stewart Rankin, II, Dipanjan Ghosh
  • Patent number: 9852519
    Abstract: A detection system including a light source, an image sensor and a processor is provided. The light source is configured to illuminate an object. The image sensor is configured to output a picture. The processor is configured to generate an IR picture and a color picture according to the picture captured by the image sensor, identify a skin-color object in the color picture and determine an object image in the IR picture according to the skin-color object.
    Type: Grant
    Filed: July 14, 2014
    Date of Patent: December 26, 2017
    Assignee: PIXART IMAGING INC.
    Inventors: Chung-Yuo Wu, Yu-Hao Huang
  • Patent number: 9842383
    Abstract: An image processing device is constituted by a device for detecting motion of the subject, with the entire effective pixel region as a range; a device for successively setting each of the pixels in the effective pixel region as a pixel of interest; a device for detecting motion of the subject, with a local pixel region that includes the successively set pixel of interest as a range; a device for, for each of the pixels of interest, determining a mixing ratio for the pixel signal of the current imaging period and the pixel signal of one imaging period earlier based on the two detection results; and a device for, for each of the pixels of interest, correcting the pixel signal of the current imaging period based on the determined mixing ratio.
    Type: Grant
    Filed: March 26, 2015
    Date of Patent: December 12, 2017
    Assignee: HOYA CORPORATION
    Inventor: Fumika Yokouchi
  • Patent number: 9715727
    Abstract: Image data representing an image captured by a video endoscopic device is converted from a first color space to a second color space. The image data in the second color space is used to determine the location of features in the image.
    Type: Grant
    Filed: February 22, 2013
    Date of Patent: July 25, 2017
    Assignee: Smith & Nephew, Inc.
    Inventors: Gheorghe Mihalca, Baoduy Tran, Carlos A. Rodriguez
  • Patent number: 9697583
    Abstract: An image processing apparatus includes a pre-processing unit and a coding unit. The pre-processing unit acquires, from an image, a patch obtained by extracting a partial area of the image. The coding unit determines a value of a design parameter relating to processing of the patch according to the amount of information contained in the acquired patch and representing a state of distribution of pixel values and generates a high-frequency patch from the patch by using the determined value of the design parameter.
    Type: Grant
    Filed: May 13, 2015
    Date of Patent: July 4, 2017
    Assignee: RICOH COMPANY, LTD.
    Inventors: Naoki Motohashi, Satoshi Nakamura
  • Patent number: 9654673
    Abstract: A method for detecting the presence of a television signal embedded in a received signal including the television signal and noise is disclosed. Either first-order or second order cyclostationary property of the signals may be used for their detection. When the first-order cyclostationary property is used, the following method is used, the method comprising the steps of upsampling the received signal by a factor of N, performing a synchronous averaging of a set of M segments of the upsampled received signal, performing an autocorrelation of the signal; and detecting the presence of peaks in the output of the autocorrelation function. When the second order cyclostationary property of the signal is used, the method comprising the steps of delaying the received signal by a fixed delay (symbol time), multiplying the received signal with the delayed version, looking for a tone (single frequency) in the output.
    Type: Grant
    Filed: January 16, 2007
    Date of Patent: May 16, 2017
    Assignee: KONINKLIJKE PHILIPS N.V.
    Inventors: Kiran Challapali, Bin Dong, Dagnachew Birru
  • Patent number: 9626745
    Abstract: Systems, methods, and computer readable media to fuse digital images are described. In general, techniques are disclosed that use multi-band noise reduction techniques to represent input and reference images as pyramids. Once decomposed in this manner, images may be fused using novel low-level (noise dependent) similarity measures. In some implementations similarity measures may be based on intra-level comparisons between reference and input images. In other implementations, similarity measures may be based on inter-level comparisons. In still other implementations, mid-level semantic features such as black-level may be used to inform the similarity measure. In yet other implementations, high-level semantic features such as color or a specified type of region (e.g., moving, stationary, or having a face or other specified shape) may be used to inform the similarity measure.
    Type: Grant
    Filed: September 30, 2015
    Date of Patent: April 18, 2017
    Assignee: Apple Inc.
    Inventors: Farhan A. Baqai, Fabio Riccardi, Russell A. Pflughaupt, Claus Molgaard, Gijesh Varghese
  • Patent number: 9609343
    Abstract: Combining intra-frame and inter-frame prediction is described. A first combined prediction block for a first block is formed by combining weighted pixel values of a first inter prediction block and a first intra prediction block. The weighting is based on the intra prediction mode. A second combined prediction block is formed by selecting a second intra prediction block using a first partitioned area of the first block, selecting a second inter prediction block using a second partitioned area of the second block, the first and second partitioned areas separated by a border at an angle to an orientation of a row or column of pixels, and combining pixel values of the second inter and intra prediction blocks that are weighted by a weighting function based on a distance of a pixel from the border. One of the combined prediction blocks is selected to encode the first block.
    Type: Grant
    Filed: December 20, 2013
    Date of Patent: March 28, 2017
    Assignee: GOOGLE INC.
    Inventors: Yue Chen, Debargha Mukherjee
  • Patent number: 9569819
    Abstract: Various implementations are described. Several implementations relate to filtering of depth maps. According to a general aspect, a first depth picture is accessed that corresponds to a first video picture. For a given portion of the first depth picture, a co-located video portion of the first video picture is determined. A video motion vector is accessed that indicates motion of the co-located video portion of the first video picture with respect to a second video picture. A second depth picture is accessed that corresponds to the second video picture. A depth portion of the second depth picture is determined, from the given portion of the first depth picture, based on the video motion vector. The given portion of the first depth picture is updated based on the depth portion of the second depth picture.
    Type: Grant
    Filed: January 27, 2010
    Date of Patent: February 14, 2017
    Assignee: THOMSON LICENSING
    Inventors: Po-Lin Lai, Dong Tian
  • Patent number: 9449371
    Abstract: To denoise video data, a temporal IIR filter is applied to video data. The temporally filtered frame is used as a guide to spatially filter the video data without introducing temporal artifacts. The spatially filtered frame can then be temporally filtered again using a temporal IIR filter. The results of the second temporal filtering can then be used as a guide to eliminate noise that the spatial filter did not eliminate.
    Type: Grant
    Filed: March 6, 2014
    Date of Patent: September 20, 2016
    Assignee: Pixelworks, Inc.
    Inventors: Xiaojie Sheng, Guohua Cheng, Neil Woodall, Bob Zhang
  • Patent number: 9367900
    Abstract: An image noise removing apparatus which removes, after removal of noise from a first image, noise included in a second image includes: a spatial noise removing unit executing an operation for removing the noise included in the second image using a pixel value included in the second image, thereby generating a spatial noise-free image; a reliability calculating unit calculating a reliability indicating how dynamic the second image is, based on the spatial noise-free image, the second image, and a first noise-free image which is generated from the first image with the noise therein removed; and a temporal blending unit performing, based on the reliability, a weighted summation on the second image and the first noise-free image, thereby removing the noise included in the second image.
    Type: Grant
    Filed: October 1, 2013
    Date of Patent: June 14, 2016
    Assignee: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
    Inventors: Masao Hamada, Tadanori Tezuka, Tsuyoshi Nakamura
  • Patent number: 9275295
    Abstract: Systems and methods are provided for determining a characteristic of video data. A set of N frames of the video data is obtained and filtered using at least one filter to produce a set of N×T blocks of filtered video data, where T is a partition size associated with the at least one filter. Each block in the set of N×T blocks is classified as either a first type block or a second type block. A subset of blocks in the set of N×T blocks is associated with a corresponding frame from the set of N frames. The characteristic of video data is determined based, at least in part, on the subset of blocks in the set of N×T blocks that are associated with the frame.
    Type: Grant
    Filed: February 25, 2011
    Date of Patent: March 1, 2016
    Assignee: MARVELL INTERNATIONAL LTD.
    Inventors: Ashish Kejriwal, Byas Muni, Sujith Srinivasan
  • Patent number: 9277136
    Abstract: Imaging systems, such as time-of-flight imaging systems, and methods with pixel sensitivity adjustments. An embodiment includes a method, comprising: for a plurality of pixels having a first output and a second output, measuring the first outputs and the second outputs in response to a demodulation signal; and adjusting the demodulation signal such that a combination of the first outputs is substantially similar to a combination of the second outputs.
    Type: Grant
    Filed: March 13, 2014
    Date of Patent: March 1, 2016
    Assignee: SAMSUNG ELECTRONICS CO., LTD.
    Inventors: Ilia Ovsiannikov, Gregory M. Waligorski, Deokha Shin, Wang-Hyun Kim, Yibing M. Wang, Hongyu Wang
  • Patent number: 9277167
    Abstract: A motion compensation de-interlacing image processing apparatus is provided. The apparatus includes a motion compensation module, a still compensation module, a motion detection module, and a de-interlacing blending module. The motion compensation module generates a motion compensation pixel according to at least one of a current field, a previous field, and a next field of a target pixel to be interpolated. The still compensation module generates a still compensation pixel according to the previous field and the next field of the target pixel. The motion detection module determines a motion index according to the previous field and the next field of the target pixel. The de-interlacing blending module generates the target pixel by weighted averaging the motion compensation pixel and the still compensation pixel according to the motion index.
    Type: Grant
    Filed: December 27, 2011
    Date of Patent: March 1, 2016
    Assignee: MSTAR SEMICONDUCTOR, INC.
    Inventors: Yu-Jen Wang, Chung-Yi Chen
  • Patent number: 9262811
    Abstract: A method for improving quality of low light video images including: receiving a current video frame; temporally enhancing it by applying a first weight matrix including higher weight factors for stationary regions and lower weight factors for moving regions to the received frame and a reference frame to generate an enhanced temporal video frame; spatially enhancing the enhanced temporal video frame by applying a second weight matrix including higher weight factors for stationary regions and lower weight factors for moving regions to generate an enhanced spatial video frame; and motion enhancing the enhanced temporal video frame by extracting matched rigid moving objects in a previous or future frame and processing each of the extracted matched rigid moving objects with a corresponding rigid object in the enhanced temporal or spatial or raw current video frame.
    Type: Grant
    Filed: January 23, 2015
    Date of Patent: February 16, 2016
    Assignee: ARECONT VISION, LLC.
    Inventor: Sri Rama Prasanna Pavani
  • Patent number: 9247245
    Abstract: An adaptive temporal motion filter for a video decoder system operates in an infinite impulse response (IIR), a max or a bypass mode. The adaptive temporal motion filter includes an adaptive time constant control module and a filter gain module. A gain factor of the filter gain module is varied by the adaptive time constant control module for every pixel in a current composite video signal. The adaptive time constant control module selects a variable gain for the filter gain module based on the motion magnitude, motion polarity and chroma luma status of the pixel.
    Type: Grant
    Filed: May 2, 2014
    Date of Patent: January 26, 2016
    Assignee: STMicroelectronics International N.V.
    Inventor: Ravi Ananthapur Bacche
  • Patent number: 9202263
    Abstract: A method for improving quality of low light video images including: receiving a current video frame; temporally enhancing it by applying a first weight matrix including higher weight factors for stationary regions and lower weight factors for moving regions to the received frame and a reference frame to generate an enhanced temporal video frame; spatially enhancing the enhanced temporal video frame by applying a second weight matrix including higher weight factors for stationary regions and lower weight factors for moving regions to generate an enhanced spatial video frame; and motion enhancing the enhanced temporal video frame by extracting matched rigid moving objects in a previous or future frame and processing each of the extracted matched rigid moving objects with a corresponding rigid object in the enhanced temporal or spatial or raw current video frame.
    Type: Grant
    Filed: January 23, 2015
    Date of Patent: December 1, 2015
    Assignee: ARECONT VISION, LLC
    Inventor: Sri Rama Prasanna Pavani
  • Patent number: 9118932
    Abstract: A method includes determining, through a processor and/or a hardware engine, edge pixels and flat pixels of a video frame of a video sequence during decoding thereof or post-processing associated with the decoding based on a predetermined threshold, and quantifying spatial correlation of pixels of the video frame around edges thereof to estimate strength of ringing artifacts and spatial and temporal persistence thereof across the video frame and across video frames of the video sequence. The method also includes adaptively and spatially filtering the pixels around the edges of the video frame, adaptively and temporally filtering the video frame, and blending an output of the adaptive spatial filtering and the adaptive temporal filtering to generate an output with suppressed ringing artifacts, spatial and temporal persistence thereof and artifacts resulting from the cumulative effect of compression therein.
    Type: Grant
    Filed: June 14, 2013
    Date of Patent: August 25, 2015
    Assignee: NVIDIA Corporation
    Inventors: Niranjan Avadhanam, Ravi Kumar Boddeti
  • Patent number: 9041834
    Abstract: Disclosed are apparatus and methods for denoising a video stream of a camera. A current frame of the video stream and a temporally adjacent frame of the video stream that has been previously spatially and temporally denoised are obtained. The current frame is first spatially denoised, while preserving edges in such current frame to generate a plurality of spatially denoised pixels for the current frame. A particular pixel of the current frame is then both spatially and temporally denoised based on a weighted averaging of the particular pixel's associated spatially denoised pixel from the current frame and a plurality of pixels from the temporally adjacent frame that have already been spatially and temporally denoised.
    Type: Grant
    Filed: September 19, 2012
    Date of Patent: May 26, 2015
    Assignee: ZiiLabs Inc., Ltd.
    Inventor: Aaron DeBattista
  • Patent number: 9001274
    Abstract: An image processing method for processing an input image is provided. The image processing method includes: performing a plurality of first imaging processing operations on the input image to generate a first image; and performing a plurality of second imaging processing operations on the first image. Each of the first imaging processing operations is along a first direction, and the plurality of first imaging processing operations include a first scaling operation for increasing resolution. Each of the second imaging processing operations is along a second direction different from the first direction, and the plurality of second imaging processing operations include a second scaling operation for increasing resolution.
    Type: Grant
    Filed: July 29, 2014
    Date of Patent: April 7, 2015
    Assignee: Novatek Microelectronics Corp.
    Inventors: Teng-Yi Lin, Wei-Fu Chen, Wei-Jen Lo
  • Patent number: 8928813
    Abstract: A method of operating a computer system to reduce structured noise in a video is described. Patches in a frame of a sequence of video frames are selected using a modified non-local means (NLM) search algorithm with a reduced search complexity compared to conventional NLM search algorithms. The set of spatial neighboring patches in a frame is extended to include patches in adjacent frames of the video sequence. Patches in the adjacent frames are selected based, at least in part, on a projection of a location of a pixel in the frame into the adjacent frames using a motion estimation algorithm. An average value determined from the combined set of patches is used to replace the pixel currently being processed.
    Type: Grant
    Filed: October 28, 2010
    Date of Patent: January 6, 2015
    Assignee: Microsoft Corporation
    Inventor: Ce Liu
  • Patent number: 8922712
    Abstract: In an embodiment, there is provided a video processing component comprising a compensation engine configured to generate pixels of a first video frame from a second video frame based at least in part on specified pixel motion; and an access buffer configured to store pixel data corresponding to pixels of the second video frame for reference by the compensation engine, wherein the pixel data is stored by the access buffer at different vertical resolutions depending on vertical distances of the pixels corresponding to the pixel data from a target pixel that is indicated by the compensation engine.
    Type: Grant
    Filed: March 24, 2014
    Date of Patent: December 30, 2014
    Assignee: Marvell International Ltd.
    Inventor: Vipin Namboodiri
  • Patent number: 8875200
    Abstract: A method and apparatus for outputting video frames while changing channels using a digital broadcast receiver are provided. The method includes sequentially tuning to a plurality of channels and receiving a plurality of digital broadcast signals from the respective channels; extracting a plurality of video frames from the respective digital broadcast signals and storing the video frames; receiving a digital broadcast signal from a desired channel to be tuned upon receiving a channel-change command; and outputting at least one of the stored video frames before a digital broadcast signal of the desired channel is output.
    Type: Grant
    Filed: January 18, 2008
    Date of Patent: October 28, 2014
    Assignee: Samsung Electronics Co., Ltd.
    Inventor: Min-Kyu Park
  • Patent number: 8872977
    Abstract: According to one embodiment, a method is disclosed. The method includes performing a local content analysis on video data to classify pixels into singular pixels, motion pixels and static pixels.
    Type: Grant
    Filed: March 29, 2011
    Date of Patent: October 28, 2014
    Assignee: Intel Corporation
    Inventor: Yi-Jen Chiu
  • Patent number: 8854544
    Abstract: A system is disclosed for controlling operation of an electronic device, such as a TV. The system includes a first sensor located at or near the electronic device and a second sensor spaced apart from the first sensor, wherein the first and second sensors are configured to detect motion of a user within an operating zone associated with the electronic device. A processor is coupled to the electronic device and the first and second sensors, the processor being configured to input a signal from the first and second sensors. Memory is coupled to the processor, the memory comprising a sensing algorithm configured to process the input signal from the first and second sensors and determine the location of the user with respect to the operating zone. The processor is configured to send a control command to the electronic device based on an output of the sensing algorithm.
    Type: Grant
    Filed: December 13, 2013
    Date of Patent: October 7, 2014
    Assignees: Sony Corporation, Sony Electronics Inc.
    Inventor: Ling Jun Wong
  • Patent number: 8830393
    Abstract: Spatial or temporal interpolation may be performed upon source video content to create interpolated video content. A video signal including the interpolated video content and non-interpolated video content (e.g. the source video content) may be generated. At least one indicator for distinguishing the non-interpolated video content from the interpolated video content may also be generated. The video signal and indicator(s) may be passed from a video source device to a video sink device. The received indicator(s) may be used to distinguish the non-interpolated video content from the interpolated video content in the received video signal. The non-interpolated video content may be used to “redo” the interpolation or may be recorded to a storage medium.
    Type: Grant
    Filed: December 18, 2008
    Date of Patent: September 9, 2014
    Assignee: ATI Technologies ULC
    Inventor: David Glen
  • Patent number: 8830402
    Abstract: An image processing circuit and a method thereof are provided herein. The image processing circuit has a first scaling circuit, one or more line buffers, a first sharpness circuit, a second scaling circuit, and a second sharpness circuit. The first scaling circuit enlarges an input image along a first direction to generate a first enlarged image. The one or more line buffers temporarily store the pixel values of a plurality of pixel rows of the first enlarged image. The first sharpness circuit vertically sharpens the first enlarged image to generate a first sharpened image. The second scaling circuit enlarges the first sharpened image along a second direction to generate a second enlarged image. The second sharpness circuit horizontally sharpens the second enlarged image to generate a second sharpened image. Accordingly, it is possible to use the one or more line buffers having shorter data lengths to perform the vertical sharpening.
    Type: Grant
    Filed: September 25, 2013
    Date of Patent: September 9, 2014
    Assignee: Novatek Microelectronics Corp.
    Inventors: Teng-Yi Lin, Wei-Fu Chen, Wei-Jen Lo
  • Patent number: 8817190
    Abstract: A general moving image includes a plurality of objects in a frame image. At the time of playback, the temporal visual characteristic is taken into consideration uniformly in the overall frame image. It is therefore impossible to perform playback while particularly considering an object of interest. In this invention, when playing back a moving image including a plurality of time-divided frame images, the object adaptation time of each object image is acquired first in the frame image of interest of the plurality of frame images. An adaptation weight is calculated based on the acquired object adaptation time, and a low-pass image reflecting the adaptation weight is generated for each object image. Color adaptation conversion using the low-pass image makes it possible to perform, for the frame image of interest, color conversion based on the adaptation time of each object image and perform color conversion particularly considering an object of interest.
    Type: Grant
    Filed: November 25, 2008
    Date of Patent: August 26, 2014
    Assignee: Canon Kabushiki Kaisha
    Inventors: Mikiko Sugiyama, Yosuke Hayase
  • Publication number: 20140226071
    Abstract: An image display apparatus which divides the 1-frame period of input image data into a plurality of periods and displays image data in the respective divided periods separates high frequency component data by using the input image data, and distributes the amplitude of the high frequency component data for the image data in the respective divided periods to make the amplitude of the separated high frequency component data fall within a difference between the gradation of the input image data, and 0 gradation or the maximum gradation of an image.
    Type: Application
    Filed: February 7, 2014
    Publication date: August 14, 2014
    Inventor: Akihiro Ouchi
  • Patent number: 8797462
    Abstract: A band processing circuit which generates image signals corresponding to different frequency bands from an image signal in which signals corresponding to different colors are arranged and which suppresses noise by synthesizing the image signals of the different frequency bands, a sampling circuit which generates image signal corresponding to the colors by sampling the image signal input from the band processing circuit in accordance with a predetermined arrangement, and a luminance/color generation circuit which generates a luminance signal in which aliasing is suppressed using an image signal output from the sampling circuit.
    Type: Grant
    Filed: February 10, 2011
    Date of Patent: August 5, 2014
    Assignee: Canon Kabushiki Kaisha
    Inventor: Shinya Hirai
  • Patent number: 8792053
    Abstract: An image processing apparatus includes: a normal interpolated image generation unit to generate an image that is interpolated between a plurality of original images reproduced along time series, the image being a normal interpolated image, based on each of the plurality of original images; a high-frequency area extraction unit to extract a high-frequency area having a spatial frequency higher than a predetermined value in each of the plurality of original images; a high-frequency area interpolated image generation unit to generate an image that is interpolated between the plurality of original images, the image being a high-frequency area interpolated image, based on a change in position of the high-frequency area along with an elapse of time on the time series and on each of the plurality of original images; and a combination unit to execute combining processing to combine the normal interpolated image and the high-frequency area interpolated image.
    Type: Grant
    Filed: December 10, 2013
    Date of Patent: July 29, 2014
    Assignee: Sony Corporation
    Inventors: Shigeo Fujishiro, Yoshito Suzuki, Eiji Ozeki, Kazuhiro Takahashi, Takayoshi Fujiwara
  • Patent number: 8773588
    Abstract: A method for de-interlacing interlaced video includes receiving a first video field and a second video field of an interlaced video frame, generating a first video frame from the first video field and a first synthesized video field, where video data of the first synthesized video field is based exclusively on video data of the first and second video fields, generating a second video frame from the second video field and a second synthesized video field, where video data of the second synthesized video field is based exclusively on the video data of the first and second video fields, and outputting two de-interlaced video frames for every received interlaced video frame. The first (second) synthesized video field is generated by combining image data from the second (first) video field with image data from corresponding lines of an up-scaled first (second) field generated by a scaler.
    Type: Grant
    Filed: February 6, 2014
    Date of Patent: July 8, 2014
    Assignee: Axis AB
    Inventor: Stefan Lundberg
  • Patent number: RE48583
    Abstract: When a plurality of X-ray images in a time sequence is stored in an image data storing unit (25), a marker coordinate detecting unit (26a) detects coordinates of a stent marker in each X-ray image, and a motion vector calculating unit (26b) calculates, with coordinates of the stent marker detected in a first frame as reference coordinates, a motion vector of the coordinates of the stent marker detected in each X-ray image of a second and subsequent frames with respect to the reference coordinates. Then, a filter application range determining unit (26c) moves and determines an application range of a smoothing filter in each X-ray image based on the motion vector, and the filtered image generating unit (26d) generates a filtered image by performing a process by the smoothing filter between application ranges determined in a process target image and a reference image.
    Type: Grant
    Filed: July 24, 2015
    Date of Patent: June 8, 2021
    Assignee: CANON MEDICAL SYSTEMS CORPORATION
    Inventors: Takuya Sakaguchi, Kunio Shiraishi, Masayuki Nishiki, Kyojiro Nambu