Abstract: A method and system for modeling light in time and space are provided. The method and system of the present disclosure collect light readings, e.g., on a motion picture set, at different positions and times to build a light model to be used for visual effects (VFX) compositing. The light model represents the light distribution across space and/or time for a predetermined physical space. Using the light model, the lighting can then be predicted or interpolated at intermediate or other positions and/or times for which no specific light readings were obtained. The light models can be used for rendering objects (e.g., natural or CG elements) in a scene as if they were in that space.

Abstract: An image pickup apparatus determines from which position in a plurality of photographed frames a pixel of each of lines of an image to be output is read out, on the basis of a motion amount at a photographing time of each of the lines of a photographed predetermined frame, and if the determined read-out position is located on the outside of a photographing range of the predetermined frame, then determines to read out a pixel in a frame photographed before and/or after a photographing of the predetermine frame as the pixel of the output image and calculates a read-out position of the pixel on the basis of the motion amount at a photographing time of each of the lines in the frame.

Abstract: Disclosed is an apparatus and method for obtaining a motion adaptive high dynamic range image, in which a motion degree of a first image and a second taken using different exposure times is calculated. The motion calculation intensity is adjusted based on the calculated motion degree. The motion compensation intensity involves a global motion compensation and/or a location motion compensation. Images subjected to compensation are synthesized and output, so that an image having high dynamic range is obtained.

Abstract: A focusing image display device is equipped with an autofocus processor, a spatial frequency detector, a magnification determiner and a focusing image display processor. The autofocus processor performs an autofocus operation using an image within a partial area of an effective pixel area. The spatial frequency detector calculates a spatial frequency of a focusing image within the partial area after the autofocus operation is completed. The magnification determiner determines the magnification of the focusing image in accordance to the spatial frequency. The focusing image display processor modifies the resolution of the focusing image with respect to the magnification.

Abstract: Captured image data is inputted, and a type of light source in capturing the image data is determined. Then a recovery file corresponding to the determination result and the uncertainty of the determination result is set, and a recovery process for the image data is performed using the set recovery filter.

Abstract: A method for aligning and unwarping distorted images in which lens profiles for a variety of lens and camera combinations are precomputed. Metadata stored with images is used to automatically determine if a set of component images include an excessive amount of distortion, and if so the metadata is used to determine an appropriate lens profile and initial unwarping function. The initial unwarping function is applied to the coordinates of feature points of the component images to generate substantially rectilinear feature points, which are used to estimate focal lengths, centers, and relative rotations for pairs of the images. A global nonlinear optimization is applied to the initial unwarping function(s) and the relative rotations to generate optimized unwarping functions and rotations for the component images. The optimized unwarping functions and rotations may be used to render a panoramic image.

Abstract: An auto focus image system that includes a pixel array coupled to a focus signal generator. The pixel array captures an image that has at least one edge with a width. The focus signal generator may generate a focus signal that is a function of the edge width and/or statistics of edge widths. A processor receives the focus signal and/or the statistics of edge widths and adjusts a focus position of a focus lens. The edge width can be determined by various techniques including the use of gradients. A histogram of edge widths may be used to determine whether a particular image is focused or unfocused. A histogram with a large population of thin edge widths is indicative of a focused image. The generator may eliminate an edge having an asymmetry of a gradient profile of an image signal.

Abstract: A system for detecting motion blur may include a process in which one or more digital images taken by a camera having a shutter are obtained, wherein the digital image depicts objects in a physical world. Further, the system may estimate the motion blur in the digital image using a ratio of one or more values obtained from the projection of a 2D spectrum of the image and a Fourier transform of a sequence of the shutter used in obtaining the image.

Abstract: Object motion during camera exposure often leads to noticeable blurring artifacts. Proper elimination of this blur is challenging because the blur kernel is unknown, varies over the image as a function of object velocity, and destroys high frequencies. In the case of motions along a 1D direction (e.g. horizontal), applicants show that these challenges can be addressed using a camera that moves during the exposure. Through the analysis of motion blur as space-time integration, applicants show that a parabolic integration (corresponding to constant sensor acceleration) leads to motion blur that is not only invariant to object velocity, but preserves image frequency content nearly optimally. That is, static objects are degraded relative to their image from a static camera, but all moving objects within a given range of motions reconstruct well.

Abstract: Systems and methods are directed to acquiring, generating, manipulating and/or editing refocusable video data/frames. The refocusable video frames may be light field video frames that may be focused and/or refocused after acquisition or recording of such video frames. In one aspect, a method comprises: selecting a first key frame, wherein the first key frame corresponds to one of a plurality of refocusable light field video frames; selecting a second key frame, wherein the second key frame corresponds to one of the plurality of refocusable light field video frames which is temporally spaced apart from the first key frame such that a plurality of refocusable light field video frames are temporally disposed between the first and the second key frames; determining virtual focus parameters for the first key frame and the second key frame; and generating video data.

Abstract: A method of processing a plurality of source documents into scanned images of the source documents includes evaluating the plurality of source documents to thereby assign one or more source document quality metrics indicative of source document image quality. The plurality of source documents are comprised by a project and the source documents of the project are from a common source document type. The source document types include, for example, book pages, paper documents, microfilm documents, machine-printed documents, handwritten documents, print media documents, public records, microfiche documents, and/or the like. The method also includes scanning each of the plurality of source documents to thereby create one or more electronic image files comprising the scanned images and coupling the source document quality metrics to the electronic image files such that the source document quality metrics are thereafter accessible for post-production activities.

Abstract: A system and method for a blur brush performing adaptive bilateral filtering is disclosed. The method may include receiving user input selecting an area of an image to be filtered, such as by pointing to the image area using the blur brush. The selected image may comprise an edge and a plurality of pixels. The method may operate to the blur brush identifying the edge in the selected image area. The method may operate to apply a filter tool (e.g., a bilateral filter) to the selected image area, while preserving the edge. The methods may be implemented by program instructions executing in parallel on CPU(s) or GPUs.

Abstract: A method for selecting images from a set of images (according to sharpness and contrast criteria), comprising pre-selecting images by a simplified sharpness and/or contrast analysis of each image in the set of images, and of selecting images by a finer analysis of the sharpness and/or contrast of each pre-selected image. This method is particularly useful to perform an identification by recognition of the iris.

Abstract: Fractional Fourier transform properties inherent in lens systems and other light and particle-beam environments are used to correct optical misfocus utilizing numerical operations. The invention produces a focused image from a partially-focused operation computed by at least one processor and a misfocused lens or other imaging system. Image data is operated on by a two-dimensional discrete fractional Fourier transform operation and a two-dimensional discrete fractional Fourier transform phase operation to create misfocused phase-adjusted image data comprising some amount of misfocus, the misfocus resulting from the application of the two-dimensional discrete fractional Fourier transform operation. The misfocused phase-adjusted image is presented to a misfocused exogenous optical system to create a resulting image. The power parameter of the fractional Fourier transform is adjusted to maximize sharp edge content of the resulting image.

Abstract: A method corrects unfocus and misfocus in original image data using an origin-centered two-dimensional discrete fractional Fourier transform. The origin-centered two-dimensional discrete fractional Fourier transform numerically corrects a modeled evolution of an image propagating through a medium, aligning a propagation model centerline with the center of image data and the center an index-shifted numerical fractional Fourier transform operation. A zero transform-image domain origin is accordingly aligned to the center of modified image data. The corrective fractional Fourier transform power may be determined automatically or by human operator. The image correction can be applied to lens-systems or other systems obeying Fourier optics including electron microscopes, particle beams, radiation accelerators.

Abstract: At least one approximation image is created of the image at one or multiple scales. Translation difference images are created by pixel-wise subtracting the values of an approximation image at scale s and the values of a translated version of the approximation image. A non-linear modification is applied to the values of the translation difference image (s) and at least one enhanced center difference image at a specific scale is computed by combining the modified translation difference images at that scale or a smaller scale with weights Wi,j. An enhanced image is computed by applying a reconstruction algorithm to the enhanced center difference images. The non-linear modification of the values of the translation difference images is steered by the values of an orientation map which comprises for each pixel a local direction of interest.

Abstract: A method for simultaneously optimizing a digital image taken in or through a scattering medium and obtaining information regarding optical properties of the scattering medium is provided. Digital image data are received by a computer. The digital image is evaluated according to an objective image quality metric and a resulting image quality value is compared to a previously stored image quality value for the image. A revised optical transfer function is derived by modeling the optical properties of the medium to be used to generate a restored digital image, which is derived from the original image and the revised optical transfer function. The restored digital image is evaluated according to the objective image quality metric and an optimized restored image is identified. The optical properties associated with the optical transfer function producing the optimized restored image represent a close approximation of the true optical properties of the medium.

Abstract: A system and method for distributing at least one digital photographic image is presented, the system and method comprising at least one capturing device and at least one receiving device disposed in a communicative relation with one another via at least one wireless network. In particular, the capturing device is structured to capture the at least one digital photographic image via, for example, a capture assembly, whereas the receiving device is cooperatively structured to receive the digital photographic image via, for example, the at least one wireless network. In addition, the capturing device(s) and receiving device(s) may be disposed in a selectively paired relationship via one or more common pre-defined pairing criteria. Further, the at least one digital photographic image may be filtered via at least one pre-defined transfer criteria disposed on the capturing device and/or receiving device.

Abstract: An image processing apparatus is configured to reduce a color blur in a color image, and includes a color blur process determination part configured to change at least one of a color blur that serves as a reduction object and an estimation method of an amount of the color blur according to at least one of a characteristic of an image and an imaging condition.

Abstract: A method for calculating an image quality metric for evaluating the quality of a digital image including the steps of denoising the data of the image, identifying edges in the denoised data, determining an edge profile of the edges, determining a grayscale angle for each identified edge in the edge profile that is associated with the edge, and calculating the image quality metric based on a weighted average of the grayscale angles for all the edges.

Abstract: An information processing apparatus includes a first generating unit, a second generating unit, and an updating unit. The first generating unit generates a point spread function representing the degree of blurring generated in the input image. The second generating unit generates a plurality of corrected block images obtained by correcting blurring of structure components of plural input block images based on the point spread function. The updating unit executes one or more times an updating process to update the corrected block images, followed by making structure components of the updated corrected block images into new corrected block images.

Abstract: A projection system comprises an image input element and an optical imaging element. The image input element is configured to input an original image or a processed image. The optical imaging element, an optical system with axisymmetrical structure and specific spherical aberration, is configured to generate an image with extended depth of field on an image projection surface in accordance with the original image or the processed image.

Abstract: A digital image signal is decomposed into a multi-scale representation comprising detail images and approximation images. Translation difference images are computed by subtracting an approximation image at scale s and a translated version of that approximation image. The values of the translation difference images are non-linearly modified. An amplification image is computed at least one scale as the ratio of a first image being computed by combining the modified translation difference images at the same or smaller scale and a second image created by combining unenhanced translation difference images at the same or smaller scale. Next, an enhanced multi-scale detail representation is computed by modifying at least one scale the detail image according to the amplification image at that scale. An enhanced image representation is computed by applying a reconstruction algorithm to the enhanced multi-scale detail representation.

Abstract: Embodiments of the present invention employ robust filtering at each of a number of scales, or resolutions, within a signal, such as a still image or video sequence. In certain embodiments of the present invention, robust filtering comprises or includes a non-linear neighborhood operation at each scale in order to produce both a denoised, sharpened and contrast-enhanced signal and a correction signal at each scale. Correction signals and sharpened and contrast-enhanced signals are combined to produce a denoised, sharpened and contrast-enhanced output signal. Scale-appropriate enhancements at each scale or resolution, including denoising, sharpening and contrast enhancement, ameliorate artifacts introduced by re-enhancement, at a second scale or resolution, features previously enhanced at another scale or resolution and inhibit over enhancement.

Abstract: A method and apparatus for providing image processing. For one embodiment of the invention, an image processing apparatus is arranged to process a first relatively underexposed and sharp image of a scene, and a second relatively well exposed and blurred image, nominally of the same scene, the first and second images being derived from respective image sources. The apparatus provides a portion of the relatively first underexposed image as an input signal to an adaptive filter; and a corresponding portion of the second relatively well exposed image as a desired signal to the adaptive filter. The adaptive filter produces an output signal from the input signal and the desired signal; and an image generator constructs a first filtered image from the output signal, relatively less blurred than the second image.

Abstract: An instruction system including: a capture device; a projection device; a control device including: a judgment portion that judges visibility of an annotation image; a specifying portion that specifies a projection mode of the annotation image from projection modes of the annotation image stored into a storage portion, based on a result of the judgment; a notification portion that notifies the projection mode specified by the specifying portion; and a projection control portion that causes the projection device to project the annotation image corresponding to an instruction on the basis of the projection mode notified from the notification portion; and a terminal including: a reception portion receiving the captured image, and the projection mode notified from the notification portion; and a transmission portion transmitting the instruction on the basis of the received captured image, and the instruction on the basis of the notified projection mode, to the control device.

Abstract: A method for image processing a two-dimensional (2D) code, including: obtaining an image by scanning a screen displaying the 2D code using a plurality of pixels, where the image includes multiple hard edges corresponding multiple spaces on the screen between the multiple pixels; identifying a pixel pitch of the screen; reducing the multiple hard edges by applying a filter based on the pixel pitch to the image; and generating, after reducing the multiple hard edges, a binary image including the 2D code by applying a threshold function to the image.

Abstract: Systems, methods and computer program products are disclosed for automatic image sharpening. Automatic image sharpening techniques are disclosed that automatically bring a blurred image into focus. Techniques for reducing edge ringing in sharpened images are also disclosed. According to implementations, a computer-implemented method includes determining a normalized entropy of a first image, calculating a correlation target based on the normalized entropy, automatically determining a blur radius of a de-convolution kernel that causes a cosine of a first radial power spectrum of the kernel and a second radial power spectrum of a reconstruction of the first image to approximate the correlation target and generating a second image based on the blur radius.

Abstract: Provided is an image processing method and apparatus for removing blur in a screen image, including detecting blur in an input image, segmenting the image according to an amount of the detected blur, performing a high pass filtering of the segmented image in a horizontal direction and a vertical direction, detecting corresponding weights by using corresponding coefficients of each direction obtained from filtering; and restoring the image by applying the detected weights to one of: an iterative form or a closed form of an image restoration.

Abstract: There is provided a data processing device that includes an obtaining unit that obtains a first image data set, a second image data set generated by reading an image formed using the first image data set, and a property data set indicating the properties of a recording medium on which the image is to be reproduced. The data processing device also includes a specifying unit that determines a threshold for a density difference between the first image data set and the second image data set, wherein the threshold depends on the property data set. The specifying unit also determines an error area where the density difference between images expressed by the first and second image data sets is equal to or greater than the threshold.

Abstract: Systems and methods of performing quantitative measurements of image blur in digital images and digital image sequences that are computationally efficient, and that employ no reference information in the measurement process. Each of the image blur measurements is performed using a Markov Chain, where a gradient image array is calculated for a pixel array derived from a given digital image, and a transition probability matrix is constructed for the transition probabilities between adjacent elements in the gradient image array. The transition probability data contained in the transition probability matrix can be pooled or otherwise accumulated to obtain a quantitative measurement of image blur in the given digital image.

Abstract: An image processing device includes: a first expansion unit which expands a part of first compression image data in a first predetermined area compressed as unit of compression to produce first expansion part data; a second expansion unit which expands a part of second compression image data in a second predetermined area compressed as unit of compression to produce second expansion part data; a cutting unit which cuts data in a predetermined range from the first expansion part data; a first producing unit which produces third expansion part data based on the cut data in the predetermined range and the second expansion part data; and a second producing unit which combines the second compression image data and compressed part data produced by compressing the third expansion part data in the second predetermined area as unit of compression to produce third compression image data.

Abstract: A processor or other device, such as a programmable and/or massively parallel processor or other device, includes processing elements designed to perform arithmetic operations (possibly but not necessarily including, for example, one or more of addition, multiplication, subtraction, and division) on numerical values of low precision but high dynamic range (“LPHDR arithmetic”). Such a processor or other device may, for example, be implemented on a single chip. Whether or not implemented on a single chip, the number of LPHDR arithmetic elements in the processor or other device in certain embodiments of the present invention significantly exceeds (e.g., by at least 20 more than three times) the number of arithmetic elements, if any, in the processor or other device which are designed to perform high dynamic range arithmetic of traditional precision (such as 32 bit or 64 bit floating point arithmetic).

Abstract: Image defogging method and system, the method including: constructing a pixel-based dark channel map of a fogging image; constructing a local area-based dark channel map of the image; acquiring a final dark channel map of the image; acquiring intensity values of R, G, B channels of a pixel having a maximum grey value of all pixels in an area, covered by a brightest area in the local map, in the fogging map, as R, G, B components of an air light value of the image; acquiring a transmission map of the image by using the final map, a maximum value of the components of the air light value, and a defogging parameter; and acquiring intensity values of the channels of pixels in a defogged image by using the transmission map, the air light value, and the intensity values of the R, G, B channels of the pixels in the image.

Abstract: An apparatus includes an attention region determining unit and a blurring unit. The attention region determining unit is configured to determine an attention region of an image that includes an intended subject of the image. The blurring unit is configured to blur all of the image regions outside of the attention region.

Abstract: Provided are a method and apparatus for processing an image. The method includes receiving a first luminance image of an image including airlight, which is a type of light that occurs in a foggy environment, and generating an airtight map based on a ratio between an average luminance of the first luminance image, and a standard deviation; and removing the airtight by subtracting the airtight map from the first luminance image and outputting a second luminance image. According to the present invention, airlight components may be effectively removed.

Abstract: An information processing apparatus includes: a first generating unit which generates, based on feature points detected on a cepstrum from an input image, a point-spread function that represents the degree of blurring generated in the input image; a second generating unit which generates a structure that represents an image obtained by reducing the input image with a size based on the point-spread function and enlarging this with the size, based on the point-spread function; and an updating unit which executes an updating process to update at least either the point-spread function or the structure such that the point-spread function and the structure approximate to a true value, with the updating unit repeatedly executing the updating process to set, of a structure component and a texture component making up the updated structure, the structure component as a new updated structure, and set the updated point-spread function as a new updated target.

Abstract: A method, apparatus, and computer readable recording medium for processing an image. The method includes detecting a face area and a blur area from an image; checking a degree of overlap between the face area and the blur area by comparing a location of the face area with a location of the blur area; and determining whether the image is an abnormal image according to the degree of overlap between the face area and the blur area.

Abstract: Various embodiments of methods and apparatus for motion deblurring are disclosed. In one embodiment, an estimate of a latent image of a blurred image at a current scale from an estimate of a latent image at a previous coarse scale is generated using an upsampling super-resolution function, and a blur kernel is estimated based on the estimate of the latent image and the blurred image; and are repeated from a course to fine scale. A final image estimate is generated. The generating the final image estimate includes performing a deconvolution of the latent image using the blur kernel and the blurred image.

Abstract: A method and apparatus for image processing a lens-distorted image (e.g., a fisheye image) is provided. The method includes partitioning coordinate points in a selected output image into tiles. The output image is an undistorted rendition of a subset of the lens-distorted image. Coordinate points on a border of the tiles in the output image are selected. For each tile, coordinate points in the lens-distorted image corresponding to each selected coordinate point in the output image are calculated. In addition, for each tile, a bounding box on the lens-distorted image is selected. The bounding box includes the calculated coordinates in the lens-distorted image. The bounding boxes are expanded so that they encompass all coordinate points in the lens-distorted image that map to all coordinate points in their respective corresponding tiles. Output pixel values are generated for each tile from pixel values in their corresponding expanded bounding boxes.

Abstract: Various embodiments of methods and apparatus for motion deblurring in text images are disclosed. In one embodiment, a threshold-based text prediction for a blurred image is generated. A point spread function for the blurred image is estimated. A result of the threshold-based text prediction function is deconvolved based on the point spread function. The generating, estimating, and deconvolving are iterated at a plurality of scales, and a final deconvolution of a result of the iteratively deconvolving is executed.

Abstract: Methods and apparatus, including computer program products, for filtering an image including a plurality of pixels. A forward kernel centered at a first pixel in the image is received. The forward kernel assigns forward weights to pixels in a neighborhood surrounding the first pixel. A backward kernel centered at a second pixel within the neighborhood surrounding the first pixel is specified based on a local attribute of the image at the second pixel. The backward kernel assigns backward weights to pixels in a neighborhood surrounding the second pixel. A convolution weight of the second pixel is determined based on the backward kernel and the forward kernel. The convolution weight and a pixel value of the second pixel are used to generate a new value of the first pixel.

Abstract: Tap coefficients of a filter include one reference tap coefficient having a maximum value that is applied to a pixel of interest in a pixel signal array, and negative tap coefficients having negative values that are applied to surrounding pixels around the pixel of interest located in an image height direction. In a tap coefficient array in which the tap coefficients to be applied to pixel signals located sequentially in the image height direction are sequentially arranged, the reference tap coefficient is positioned off center at a position other than the center of the tap coefficients. Among the negative tap coefficients located on both sides of the reference tap coefficient in the tap coefficient array, the number of the negative tap coefficient on a first side is one, and the number of the negative tap coefficients on a second side is two or more.

Abstract: A method for determining a deblurred image, the method implemented at least in part by a data processing system and comprising: receiving a sharp image of a scene captured with a short exposure time; receiving a blurred image of the scene captured with a longer exposure time than the sharp image, wherein the blurred image has a higher level of motion blur and a lower level of image noise than the sharp image; determining a blur kernel responsive to the sharp image and the blurred image; determining one or more reference differential images responsive to the sharp image; determining a deblurred image responsive to the blurred image, the blur kernel and the one or more reference differential images; and storing the deblurred image in a processor-accessible memory system.

Abstract: A coefficient learning apparatus includes: a student-image generation section configured to generate a student image from the teacher image; a class classification section configured to sequentially set each of pixels in the teacher image as a pixel of interest and generate a class for the pixel of interest from the values of a plurality of specific pixels; a weight computation section configured to add up feature quantities; and a processing-coefficient generation section configured to generate a prediction coefficient on the basis of a determinant including said deterioration equation and a weighted constraint condition equation.

Abstract: Provided is an image capturing apparatus (100) that can improve coding efficiency, and record a still image with a wide dynamic range and smooth moving images. The apparatus includes: an image capturing unit (110) capturing images by exposure for a first exposure time and a second exposure time longer than the first exposure time to generate a short-time exposure image and a long-time exposure image; a short-time exposure image storage unit (120) storing the short-time exposure image; a long-time exposure image storage unit (130) storing the long-time exposure image; a motion blur adding unit (140) generating a predicted image of the long-time exposure image by adding motion blur to the short-time exposure image; a subtracting unit (150) calculating a difference between the long-time exposure image and the predicted image to generate a difference image; and a coding unit (170) coding the short-time exposure image and the difference image.

Abstract: A system, method, and computer program product for capturing images for later refocusing. Embodiments estimate a distance map for a scene, determine a number of principal depths, capture a set of images, with each image focused at one of the principal depths, and process captured images to produce an output image. The scene is divided into regions, and the depth map represents region depths corresponding to a particular focus step. Entries having a specific focus step value are placed into a histogram, and depths having the most entries are selected as the principal depths. Embodiments may also identify scene areas having important objects and include different important object depths in the principal depths. Captured images may be selected according to user input, aligned, and then combined using blending functions that favor only scene regions that are focused in particular captured images.

Abstract: Disclosed is an apparatus and method for obtaining a motion adaptive high dynamic range image, in which a motion degree of a first image and a second taken using different exposure times is calculated. The motion calculation intensity is adjusted based on the calculated motion degree. The motion compensation intensity involves a global motion compensation and/or a location motion compensation. Images subjected to compensation are synthesized and output, so that an image having high dynamic range is obtained.

Abstract: A method for determining a deblurred image comprising: receiving a blurred image of a scene; receiving a blur kernel; initializing a candidate deblurred image; determining a plurality of differential images representing differences between neighboring pixels in the candidate deblurred image; determining a combined differential image by combining the differential images; repeatedly updating the candidate deblurred image responsive to the blurred image, the blur kernel, the candidate deblurred image and the combined differential image until a convergence criterion is satisfied; and storing the final candidate deblurred image in a processor-accessible memory system.

Abstract: A method of deblurring an image by which blur can be easily and rapidly eliminated from one image and the quality of the image can be improved is provided. The method includes receiving a blurred image, an image estimation step of estimating a non-blurred image from the blurred image, a blur information estimation step of estimating blur information from the blurred image and the estimated non-blurred image, and a deblurring step of deblurring the blurred image based on the blurred image and the estimated blur information, wherein the image estimation step and the blur information estimation step are iteratively performed. Thus, blur can be rapidly and effectively eliminated from one image, thereby improving the quality of an image.