Abstract: A system and method for generating a multi-dimensional image of an object in a scene is disclosed. One inventive aspect includes a spectral estimation module configured to convert a two-dimensional (2D) high-resolution light intensity image of the scene to a spectral-augmented image of a selected channel. The system further includes a high-resolution depth image generation module configured to generate a high-resolution depth image of the object based on a three-dimensional (3D) low-resolution depth image of the scene and the spectral-augmented image.

Abstract: Provided is an image interpolation method and apparatus using a reference block depending on a direction. The image interpolation method may generate a horizontal reference block and a vertical reference block each with respect to an inputted image, and determine interpolation directivity with respect to the inputted image using the generated horizontal reference block and vertical reference block, thereby performing an interpolation on an image based on accurate interpolation directivity. In particular, the image interpolation method may determine whether to verify interpolation directivity depending on an edge intensity of an inputted image, thereby performing a color filter array (CFA) interpolation on an image based on an edge direction without determining the interpolation directivity, when the edge intensity is strong.

Abstract: Vertex data can be accessed for a graphics primitive. The vertex data includes homogeneous coordinates for each vertex of the primitive. The homogeneous coordinates can be used to determine perspective-correct barycentric coordinates that are normalized by the area of the primitive. The normalized perspective-correct barycentric coordinates can be used to determine an interpolated value of an attribute for the pixel. These operations can be performed using adders and multipliers implemented in hardware.

Abstract: To determine if a pixel exhibits artifacts, statistics are generated for the pixel and its neighbors. These statistics are compared with thresholds. If the comparison of the statistics and the thresholds suggests that the pixel exhibits a pixel artifact, then recourse can be taken, either to adjust the pixel value in some way, or to reject the angle of interpolation used in computing the value for the target pixel.

Abstract: A method and system for interpolating video pixels is described, in which the value of a first fractional pixel is calculated based on the values of the first set of integer pixels, while the value of a second fractional pixel is calculated based on the values of the second set of integer pixels. The first set of integer pixels is not equal to the second set of integer pixels. For example, the first and second set may contain different integer pixels and may contain different numbers of integer pixels.

Abstract: Aspects of the present invention are related to methods and systems for image processing, in particular, to methods and systems for computationally efficient and robust image alignment. Initially, larger image features may be used to approximate an alignment measurement. Results of the initial measurement may be used to narrow the search range used in conjunction with higher-resolution images in subsequent alignment measurements. The narrowed search range may insure that if the alignment measurement using the fine-detail images fails, then the measured results may have the accuracy as indicated by the prior, reduced-image-based measurement.

Abstract: Systems and methods for generating a movement model that requires less storage space than movement models of the prior art are disclosed. This movement model may be based on x-ray images of a patient and may be configured for estimating movement of organs within the patient during medical treatment. The movement model comprises at least two deformation fields associated with strong time points and a plurality of interpolation parameters associated with weak time points. In contrast with the prior art, the stored movement model does not include deformation fields associated with all time points. Because interpolation parameters rather than deformation fields are associated with the weak time points, the movement model requires less storage than movement models of the prior art. The stored movement model is optionally used to calculate interpolation fields that can be used to model movement of a patient.

Abstract: A display color-correcting system is provided. Color response values are measured that go into the vertices of polyhedra in a cubic color output space of the display. A set of corresponding values for the display is built from intermediate values determined between the measured color response values. The intermediate values are determined by decomposition and interpolation of interpolation volumes in the cubic color output space. Each of the interpolation volumes is the combined volume of a selected polyhedron within the cubic color output space and a predetermined volume of space between the selected polyhedron and the next polyhedron within the cubic color output space. The set of corresponding values is converted into decoupled RGB adjustment values that specify the RGB signals independently for the display to produce corrected colors. The RGB adjustment values are saved into one or more look-up tables.

Abstract: An image interpolation method includes: obtaining pixel values of integer pixel points and/or sub-pixel points in the row, column or any other directions of pixel points; obtaining pre-calculated interpolation coefficients, and interpolating the pixel points. A method for obtaining image interpolation coefficients includes: solving a one-dimensional Wiener-Hopf equation to obtain needed interpolation coefficients in different directions. An image interpolation apparatus performs interpolation filter processing on pixel points by using a first obtaining module, a second obtaining module, and a first calculating module. With the image interpolation method and apparatus, and the method for obtaining interpolation coefficients, the interpolation filter accuracy of the pixel points may be improved, the search accuracy of pixel points may be improved, and thus a more accurate matching block may be obtained in a reference image.

Abstract: An image or other sample processor has a resampling filter adapted to provide output samples at an output sampling frequency which can be selected to be higher or lower than the input sampling frequency. The width of the resampling filter aperture is scaled according to either the input sampling frequency or the output sampling frequency so as to obtain the wider of the two possible filter apertures.

Abstract: [Problem] An object of the present invention is to provide an image processing apparatus used for acquisition aid of optimal low-resolution image set for super-resolution processing.

Abstract: An interpolation method and an interpolation circuit are provided. The interpolation method calculates a difference between values of a first point and a second point and calculates an absolute value of the difference. Then, the absolute value of the difference is used to mix a first function and a second function to obtain a transformation function, which is then used to calculate an interpolation value of an interpolation point between the first point and the second point. Accordingly, the present invention may obtain a result close to high order interpolation without increasing hardware expense.

Abstract: Image processing apparatus and image processing method including an image separation processing section for separating an inputted image signal into a transparent image portion having transparency and a background image by detecting a pixel data common among a plurality of frames within the inputted image signal; a frame interpolator that performs frame interpolation using the separated background image; and a composition processing section for combining the frame-interpolated background image with the separated transparent image portion, wherein the frame interpolation is performed only to the background image so that the influence on the frame interpolation of the transparent image portion is reduced.

Abstract: Provided are an apparatus for processing adaptive video and a method of scaling video, which generate a graphical user interface (GUI) so that a GUI suitable for the screen size of a display device can be displayed according to the screen size of the display device. The apparatus can realize a GUI most suitable for the screen size of an external display device connected to the apparatus by enlarging or reducing the size of the GUI according to the screen size of the external display device, or by changing the arrangement of items arranged on the GUI.

Abstract: An output image that corresponds to a higher-resolution version of a source image is produced. In this process, source pixels of the source image are processed with a set of linear non-separable filter kernels to produce the output image with a corresponding output pixel block of constituent output pixels for each of the source pixels. The set of filter kernels has a mean substantially equal to an identity filter such that a downscaling of the of the output image to a resolution level of the source image produces a downscaled image that is substantially identical to the source image. For each of the source pixels, each of the filter kernels in the set is applied to a local neighborhood of the source pixel to produce a respective value of each of the constituent output pixels of the corresponding output pixel block.

Abstract: Methods and systems for achieving high sub-pixel precision while processing a video signal are provided. Aspects of the method may include selecting IIR filter coefficients for implementing an IIR filter for filtering a video signal during scaling. Polyphase filter coefficients may be selected for implementing a polyphase filter for filtering the video signal during the scaling. The video signal may be filtered using a combination of the IIR filter having the selected IIR filter coefficients and the polyphase filter having the selected polyphase filter coefficients. The polyphase filter coefficients may implement a finite impulse response (FIR) filter for filtering the video signal. The video signal may be phase-shifted. The scaling of the video signal may comprise upscaling or downscaling the video signal. The video signal may be converted from a first format to a second format by combined IIR-filtering and polyphase filtering.

Abstract: A method of image edge enhancement comprises: determining the edge trend for an image in accordance with the second order gradient value of a center pixel in different directions; performing interpolation operation with the center pixel; calculating absent color component of pixels; performing edge enhancement for the image in the interpolation module in accordance with original color component of the center pixel and the image edge trend based on the Bayer data. The image edge enhancement process takes into account the influence of the green component values of different pixels surrounding the center pixel, and adopts a noise-resistant, self-adaptive edge enhancement algorithm, to suppress noise on the image edge. Thus, the resulting image has a clear image edge. In addition, the fact that the process performs image edge enhancement in the interpolation module based on the Bayer data can significantly reduce the consumption of memory space.

Abstract: An image signal processing device improving quality of three-dimensional image is provided. The device includes a determination section; deinterlace sections and a synchronous control section. The determination section determines whether first and/or second input image signals, having horizontal parallax there between, are interlaced signals derived from video signal or from pull down-converted film signal. The deinterlace sections perform deinterlace on each of the first and second input image signals, through interpolation for a video signal or pull down reverse conversion for a film signal, and generate first and second output image signals as progressive signals, having horizontal parallax there between. The synchronous control section synchronously controls the deinterlace, based on result of the determination section, such that deinterlace process onto the first and second input image signals, synchronized with each other for each of fields, are of same type.

Abstract: An image display apparatus that displays an image on the basis of input image signals corresponding to sub-pixels forming one pixel includes a shift-amount storing unit that stores shift amounts of display positions of the sub-pixels relative to given reference positions in a display image, an image-signal correcting unit that corrects the input image signals according to the shift amounts, and an image display unit that displays an image on the basis of the image signals corrected by the image-signal correcting unit.

Abstract: A method for reducing motion artifacts and the systems for implementing the same are provided. The method includes receiving a full-resolution image at a first time point; extracting a first partial-resolution image from the full-resolution image; and calculating a second partial-resolution image for a second time point after the first time point. The first and the second partial-resolution images are complementary.

Abstract: Method for up-scaling a color image prior to performing subsequent processing on said color image, comprising the steps of converting the color image into multiple image layers distinguishable from each other and up-scaling at least one of said multiple image layers. The up-scaling is tuned towards the subsequent processing, for example luminance is upscaled at higher quality than chrominance. Further, a method for interpreting information present on digitally acquired documents, comprising the steps of: (i) determining a country; (ii) identifying a list of languages and character sets in use in said country; (iii) performing optical character recognition simultaneously using all languages and character sets of the list; (iv) performing field parsing to identify fields in the digitally acquired document on the basis of international as well as country-specific field recognition rules; (v) storing the recognized information according to the identified fields in a database.

Abstract: An image processing method and apparatus capable of easily detecting an edge of an object from an input image, in which the edge is detected using one step, without a pre-processing step, and a complicated trigonometric function is not used for gradient detection. The image processing method includes setting a window within an input image, analyzing the window to determine directions of edges of objects within the image included in the window, detecting edge information including the edge directions, and processing and outputting the window using the edge information.

Abstract: Image processing includes generating image data for an image, the image data including an array of original pixels. Respective first pixels for the image are interpolated from respective pluralities of original pixels adjacent the interpolated first pixels. Respective second pixels for the image are interpolated from respective pluralities of original pixels adjacent the interpolated second pixels using image information generated in the interpolation of the interpolated first pixels.

Abstract: There is provided a matching method, capable of positioning with higher accuracy at higher speed. The method includes the steps of: constructing a pattern model of a registered image in which a plurality of reference points are set on an extracted contour and a corresponding point search line having a predetermined length and passing through each reference point; acquiring an image and acquiring an initial position corresponding to the registered image to arrange the corresponding point search line of the pattern model; finding a corresponding point on the image corresponding to each reference point with regard to each corresponding point search line at a position along the corresponding point search line on the image; and regarding a relation between each reference point and the corresponding point as an evaluation value and performing fine positioning such that an accumulated value of the evaluation values becomes minimal or maximal.

Abstract: A method comprises searching in a video stream a first frame and a second frame that each has enough point correspondence with a image model, wherein the first frame is the nearest previous frame prior to a third frame, and the second frame is the nearest subsequent frame to follow the third frame. The method further comprises calculating an interpolation between a first mapping matrix of the first frame and a second mapping matrix of the second frame to obtain a third mapping matrix of the third frame that has insufficient point correspondence with the image model.

Abstract: Disclosed herein is an image processing apparatus, including an expansion section configured to expand an input image by interpolation using peripheral pixel values; a positioning section configured to carry out positioning of an expanded image obtained by expansion of the input image and an output image obtained in an immediately preceding operation cycle; a separation section configured to separate the output image into low frequency components and high frequency components; and a mixture-addition section configured to mix the low frequency components with the expanded image and add the high frequency components to the image obtained by the mixture to produce a new output image.

Abstract: An embodiment has: weighting interpolation section for obtaining a pixel value for a missing pixel by a one-dimensional weighting interpolating method, using pixels in the vicinity of the missing pixel as reference pixels, and for generating a primarily interpolated image signal including the interpolated pixel value in place; frequency decomposition section for decomposing the primarily interpolated image signal into frequency components; halftone dot extraction sections for obtaining a halftone dot degree indicating a degree for the vicinity of the missing pixel to be in the halftone dot region, by using higher ones of these frequency components; correction value calculation section for calculating a correction value for the missing pixel, by using lower ones of these frequency components; and correction section for correcting the pixel value of the missing pixel in the primarily interpolated image signal using the correction value depending on the halftone dot degree.

Abstract: A method for generating an image is provided. The method includes estimating a high resolution image from a plurality of low resolution images and downsampling the estimated high resolution image to obtain estimates of a plurality of low resolution images. The method also includes generating a desired high resolution image based upon comparison of the downsampled low resolution images and the plurality of low resolution images.

Abstract: Motion picture scenes to be colorized/depth enhanced (2D->3D) are broken into separate elements, backgrounds/sets or motion/onscreen-action. Background and motion elements are combined into composite frame which becomes a visual reference database that includes data for all frame offsets used later for the computer controlled application of masks within a sequence of frames. Masks are applied to subsequent frames of motion objects based on various differentiating image processing methods, including automated mask fitting/reshaping. Colors and/or depths are automatically applied to masks throughout a scene from the composite background and to motion objects.

Abstract: Disclosed are FIFO type methods, systems and apparatus for electronically registering image data relative to a raster or other marking device. According to an exemplary method, a FIFO type data queuing configuration is provided, where the length of data memory segments associated with the FIFO are selected to correspond to the number of raster lines from the most upstream point of the physical raster to the point where the given pixel column intersects the physical raster.

Abstract: A method for interpolation includes receiving an input image having a plurality of pixels. The edge direction proximate a first pixel of the input image is estimated using a first technique from a plurality of discrete potential directions. An edge direction is selected based upon the estimating the edge direction proximate the first pixel of the input image using a second technique. The pixels proximate the first pixel are interpolated based upon the selected edge direction. The pixels proximate the first pixel are interpolated based upon another technique. An output image is determined.

Abstract: An image resolution enhancing device and method for a display panel are provided. The image resolution enhancing method includes the following steps. Enlarge the image resolution of a first image to obtain a second image. Shrink the image resolution of the second image to obtain a third image. Implement a subtraction operation on the first image and the third image, so as to obtain a difference image. Enlarge the image resolution of the difference image to obtain an enhancing image. Implement an addition operation on the enhancing image and the second image, so as to obtain a fourth image with high image resolution.

Abstract: An image processing apparatus includes: a coefficient calculation unit that calculates a coefficient for converting image data having a predetermined number of pixels to image data having a smaller number of pixels than the predetermined number of pixels, including a coefficient multiplied by an integer power of 2, as a conversion coefficient; a calculation unit that multiplies each pixel value of image data prior to image reduction processing by the conversion coefficient previously calculated by the coefficient calculation unit thereby to calculate each pixel value of the image data subjected to the image reduction processing; and a shift unit that shifts each of the pixel values calculated by the calculation unit by a number of bits to counteract the integer power of 2-multiplied coefficient included in the conversion coefficient.

Abstract: In one embodiment, a plurality of target pixels within a digital representation of an image are selected, and a corner gradient pattern is determined for each of the target pixels. The corner gradient pattern is analyzed to classify the target pixel as an edge pixel or a non-edge pixel. If the target pixel is a non-edge pixel, target pixel is replaced with a plurality of non-edge output pixels. If the target pixel is an edge pixel, the target pixel is replaced with a plurality of edge output pixels, including determination of an orientation of an edge, and selection, based on the orientation, and application of a filter kernel to produce the edge output pixels to replace the target pixel.

Abstract: Methods and apparatus for achieving color and luminance uniformity in color output devices. In one embodiment, measurements of luminance and chrominance are taken at various regions of the display surface for a range of color inputs. Using the collected data, a color volume is formed for each of the measured regions. This color volume comprises a set of all colors producible at the measured region. The color volumes for each of the measured regions are then used to generate a common color gamut, i.e., a volume of colors that are producible in each of the measured regions. A gamut mapping can then be performed for all or a portion of the positions on the display surface to a target color gamut. Input data for the gamut mapping process may be determined by conventional interpolative techniques.

Abstract: Nonlinear image filter defined by local edge intensity and slope and is useful noise and artifact removal during image processing; applications include digital still cameras and video cameras.

Abstract: A direction-adaptive image upsampling system and method using double interpolation is disclosed. Each of double interpolation (DI) units with different interpolation functions receives an input image and generates a corresponding double-interpolated image and an associated double-interpolated difference. A decision unit receives the double-interpolated differences from the DI units for deciding the DI unit that has an optimal interpolation around a pixel under process. An adaptive selector selects the double-interpolated image associated with the DI unit having the optimal interpolation as an output image.

Abstract: When analyzing an image signal having pixel values defined on a sampling grid, the method detects at least one direction of regularity of the image signal in relation to a pixel of the sampling grid. This detection comprises computing a respective loss value associated with at least one direction in a set of directions, and selecting at least one direction of regularity by minimizing the loss value. The loss value associated with a direction (u, v), where u is a horizontal coordinate and v a vertical coordinate, has an axial loss component measuring variations of the pixel values in at least one linear array of pixels. This linear array is a horizontal array |u/v|>1 and a vertical array |u/v|<1.

Abstract: This invention makes it possible to obtain an enlarged image while suppressing noise and maintaining the sharpness of an original image only by setting a simple enlargement ratio without no special knowledge. Original image data (Ia) is enlarged in accordance with a set enlargement ratio (E) to generate an enlarged image (IA). The enlarged image (IA) is smoothed by using a smoothing filter with a size depending on the enlargement ratio (E) to generate smoothed image data (IB). Difference image data (IC) is generated by calculating the difference between the enlarged image data (IA) and the smoothed image data (IB). The generated difference image data is multiplied by an emphasis coefficient. The product is added to the enlarged image data, thereby obtaining image data (IS) that has undergone enlargement/unsharp masking.

Abstract: Described is a technology in which a low resolution image is processed into a high-resolution image, including by a two interpolation passes. In the first pass, missing in-block pixels, which are the pixels within a block formed by four neighboring original pixels, are given values by gradient diffusion based upon interpolation of the surrounding original pixels. In the second interpolation pass, missing on-block pixels, which are the pixels on a block edge formed by two adjacent original pixels, are given values by gradient diffusion based upon interpolation of the values of those adjacent original pixels and the previously interpolated values of their adjacent in-block pixels. Also described is a difference projection process that varies the values of the interpolated pixels according to a computed difference projection.

Abstract: Upon enabling an automatic cropping feature, a computer-implemented method for cropping a plurality of images retrieves a number of images to process among the plurality of images, and selects an image from the plurality of images to determine a set of crop values for the image until the set of crop values for each image have been determined. Determining a set of crop values for an image includes scanning the image from a first side to an opposing side to determine for each scan line of the image an amount representing a degree of color variation among the pixels for that scan line. The amount determined for each scan line is then compared to a threshold value until a crop value for a first area of the image can be determined.

Abstract: An image processing system, which corrects an aberration generated in an optical system by executing coordinate conversion of pixels of an image, has a table which holds correspondence between the positions of pixels before and after the coordinate conversion, acquires coordinates after conversion corresponding to the coordinates of representative points to be converted from the table, and calculates coordinates after conversion of a pixel between the acquired representative points by an interpolation calculation using a Lagrange interpolation formula.

Abstract: The interpolation unit comprises: a fetching unit for fetching a first value of a first original pixel of a first input image, based on a first motion vector applicable to the new pixel; a projection unit for projecting a second value of a second original pixel of a second input image, based on a second motion vector applicable to the second original pixel; and a selection unit for assigning the value of the new pixel by means of comparing the first value with the second value.

Abstract: In a method of realism assessment of an image composite, the foreground and the background are transformed into a color space, such as YCbCr, followed by projecting the foreground and the background to a subspace represented by the axes representing chromatic information. The image composite is assessed in the projected subspace, according to linearity of color distributions of the foreground/the background, or according to distance between the color distributions of the foreground/the background and a center of the transformed color space.

Abstract: A method and apparatus to providing higher resolution images on an embedded device by performing a super resolution technique on a compressed image sequence and one or more motion vectors are described. In one example, the method includes compressing an image sequence using a video compression technique, wherein the image sequence comprises a plurality of lower resolution images and applying a super resolution technique to the compressed image sequence to generate a higher resolution image.

Abstract: Methods and systems for image upscaling are disclosed. In one embodiment, a low frequency band image intermediate is obtained from an input image. The input image is upsampled by a scale factor to obtain an upsampled image intermediate. A result image is estimated based at least in part on the upsampled image intermediate, the low frequency band image intermediate, and the input image, wherein the input image is of a smaller scale than the result image.

Abstract: Systems and methods for upsampling input images may evaluate potential upsampling solutions with respect to an objective function that is dependent on a sparse derivative prior on second derivative(s) of the potential upsampling solutions to identify an acceptable higher-resolution output image. The objective function may also be dependent on fidelity term(s) and/or sparse derivative prior(s) on first derivative(s) of potential upsampling solutions. The methods may include applying the iteratively re-weighted least squares procedure in minimizing the objective function and generating improved candidate solutions from an initial solution. The identified solution may be stored as a higher-resolution version of the input image in memory, and made available to subsequent operations in an image editing application or other graphics application. The methods may produce sharp results that are also smooth along edges.

Abstract: To facilitate setting of development condition an image developing apparatus is provided. The image developing apparatus performs a development process to first image data generated by a digital camera, each pixel of which lacks a part of color information, the image developing apparatus carries out a first type of development process on the first image data to generate developed image data; and a second type of development process on the first undeveloped image data to generate for-display image data with lower resolution. The first type of development process includes: a first specific process performed on the first image data to generate second image data; and a first interpolation process performed on the second image data, the second type of development process includes: a process to generate third image data through a second interpolation process performed on the first image data and a resolution converting process; and a second specific process performed on the third image data.

Abstract: An embodiment provides a method for image upscaling. The method includes anti-aliasing an input image and downsampling the input image to create a lower resolution image. The method also includes interpolating the lower resolution image to obtain a higher resolution image and creating a filter map from the input image and the higher resolution image. The method also includes upsampling the input image using the filter map to create a high-resolution image.

Abstract: A first aberration correcting unit respectively correcting, for the first wavelength and the second wavelength, amount of distortion by a correction value for a chromatic aberration of magnification at the image height, and a first position calculating unit estimating, for respective pixels corresponding to the reference wavelength, amount of displacement of an image location due to a distortion by using a basic equation expressing a relation between amount of distortion at the image height and amount of displacement, and estimating, for respective pixels corresponding to the first wavelength and the second wavelength, amount of displacement of an image location due to a distortion including a correction for the chromatic aberration of magnification by replacing the amount of distortion in the basic equation with the amount of corrected distortion.