Abstract: Systems and methods are provided for processing image data captured by a device. In one implementation, a system is provided to process primary image data based on motion of the device during generation of the image data, as detected by a secondary image sensor. In another implementation, a method is provided for processing image data by generating primary image data, generating secondary image data, calculating, using the secondary image data, at least one motion vector based on motion of the device during generation of the primary image data, processing the primary image data based on the at least one motion vector, and outputting the processed primary image data.

Abstract: An apparatus and method for suppressing color rolling are provided. The apparatus includes a digital signal processor which detects first motion information on a current frame and second motion information on at least one of a plurality of neighboring frames, calculates a gain based on the first and second motion information, and applies the gain to at least one channel of the current frame.

Abstract: An imaging device capable of detecting and correcting, with high accuracy, the motion (image rotation) in the rolling direction of the image caused by the camera shake during imaging without being influenced by the individual variation, temperature characteristic, and variation with time of the sensor. To correct the motion (image rotation) in the rolling direction of the image caused by the camera shake during imaging, the result of detection of the angle of inclination of the device by an angle sensor (8a) is corrected with the result of detection of the angle of inclination of the image on the basis of the feature of the captured image by an image inclination detecting section (7), and the imaging device (3) is rotated around the optical axis or an axis parallel to the optical axis according to the corrected angle of inclination of the device.

Abstract: This image capture device includes an image capturing section 100 which captures two images in mutually different exposure times, and an image processing section 220 which performs restoration processing on the images that have been captured by the image capturing section 100. The image processing section 220 includes a blur kernel determining section which determines a blur kernel that defines the camera-shake-induced motion blur of the image captured; and an image restoration section which generates the restored image. The blur kernel determining section changes the size of the blur kernel according to the exposure time in which the image is captured.

Abstract: A coefficient learning apparatus includes: a student-image generation section configured to generate a student image from the teacher image; a class classification section configured to sequentially set each of pixels in the teacher image as a pixel of interest and generate a class for the pixel of interest from the values of a plurality of specific pixels; a weight computation section configured to add up feature quantities; and a processing-coefficient generation section configured to generate a prediction coefficient on the basis of a determinant including said deterioration equation and a weighted constraint condition equation.

Abstract: Provided is an image capturing apparatus (100) that can improve coding efficiency, and record a still image with a wide dynamic range and smooth moving images. The apparatus includes: an image capturing unit (110) capturing images by exposure for a first exposure time and a second exposure time longer than the first exposure time to generate a short-time exposure image and a long-time exposure image; a short-time exposure image storage unit (120) storing the short-time exposure image; a long-time exposure image storage unit (130) storing the long-time exposure image; a motion blur adding unit (140) generating a predicted image of the long-time exposure image by adding motion blur to the short-time exposure image; a subtracting unit (150) calculating a difference between the long-time exposure image and the predicted image to generate a difference image; and a coding unit (170) coding the short-time exposure image and the difference image.

Abstract: A method of compensating for vibration and an imaging apparatus are provided. The method of compensating for vibration includes determining whether a vibration compensation starting condition is satisfied, and starting compensating for vibration prior to operating a shutter, if the vibration compensation starting condition is satisfied. Accordingly, a shutter lag is reduced and power consumption is reduced, and accuracy of vibration compensation is improved.

Abstract: Upon correcting blur of image capture data of an image capturing device by coded exposure processing, an exposure time and aperture value, which are set by a photometry unit of the image capturing device according to an object, are input, and the exposure time or aperture value is adjusted based on a ratio of shutter open periods in an opening and closing pattern of a shutter used in the coded exposure processing. Then, a gain adjustment value of the image capture data corresponding to a deficiency of an exposure amount by the adjusted exposure time or aperture value is set, image capture by an image capturing unit of the image capturing device is controlled based on the opening and closing pattern, exposure time, and aperture value.

Abstract: Disclosed is an apparatus and method for obtaining a motion adaptive high dynamic range image, in which a motion degree of a first image and a second taken using different exposure times is calculated. The motion calculation intensity is adjusted based on the calculated motion degree. The motion compensation intensity involves a global motion compensation and/or a location motion compensation. Images subjected to compensation are synthesized and output, so that an image having high dynamic range is obtained.

Abstract: Apparatuses and methods for recording and reproducing RAW image data to more precisely correct for hand tremble in response to an electronic hand tremble correction when an image is recorded. The recording apparatus includes an image developing processor performing an image developing process on raw data sequentially output from an image sensor in frames and generating completely developed image data in frames, an electronic hand tremble correction unit performing an electronic hand tremble correction process on the completely developed image data and generating completely electronic hand tremble correction processed image data, a moving quantity data obtaining unit obtaining data of moving quantity in frames used for the electronic hand tremble correction process performed by the electronic hand tremble correction unit, and a storage medium recorder sequentially recording in frames the RAW data, the completely developed image data, and the data of moving quantity to a storage medium per frame.

Abstract: A plurality of image capturing data time-divisionally exposed by a capturing unit are input. By first and second processes, the plurality of image capturing data are divided into synthesis images or motion detection images, a motion amount of the capturing unit at the time of time-division exposure is detected from the image capturing data of the motion detection images, synthesized image capturing data is generated by synthesizing the synthesis images, and a vibration of the synthesized image capturing data is corrected based on a divide pattern indicating divisions and the motion amount. Corrected image capturing data obtained by the first and second processes are integrated to obtain image capturing data after image stabilization.

Abstract: Vehicle attitude is estimated relative to a ground surface over which the vehicle is traveling. An actual image of the ground surface over which the vehicle is traveling is compared with stored or predicted model images of the ground surface. The model images have corresponding known vehicle attitudes associated therewith. For one of the model images that most closely matches the actual image, the known vehicle attitude associated therewith is an estimate of an actual vehicle attitude relative to the ground surface over which the vehicle is traveling.

Abstract: Systems and methods for performing fast zero recovery with alpha blending with digital image stabilization implemented in a digital camera. The digital camera includes a gyroscope to measure motion of the digital camera and processes the signals from the gyroscope to track the total displacement of an image sensor over a series of frames of video. If the motion is a sustained motion in a substantially uniform direction, then the digital camera recognizes the motion as a panning-type motion and activates a fast-zero recovery with alpha blending operation to retrace the displacement of active pixel locations to the center of the image sensor. Alpha blending is performed to smooth the transition from a normal image stabilization operation to the fast-zero recovery with alpha blending operation.

Abstract: Provided are a method and apparatus for correcting a shake of a digital photographing apparatus. The method includes sensing a shake via an inertial sensor comprised in the digital photographing apparatus, and calculating a first shake value; comparing the first shake value with a predetermined threshold value and, when the first shake value is greater than the predetermined threshold value, driving an OIS (optical image stabilizer); detecting an edge component of an image of a target subject, wherein the image is input via an imaging device of the digital photographing apparatus, and calculating a second shake value from a difference value between edge values of sequential frames of the input image; and comparing the second shake value with the first shake value, and according to a result of the comparing, controlling a shake of the target subject to be corrected.

Abstract: An image processing apparatus includes a region extracting section that extracts a first predetermined region including a target pixel in a current frame and a second predetermined region including a pixel located at the same position as the target pixel in a previous frame, a motion vector calculating section that calculates a motion vector of the first predetermined region with respect to the previous frame based on part or all of the pixels in the first predetermined region and part of the pixels in the second predetermined region, a filter coefficient determining section that determines a filter coefficient for a plurality of pixels in the second predetermined region based on the motion vector, and a noise reducing section that reduces noise in the target pixel based on the plurality of pixels in the second predetermined region and the filter coefficient.

Abstract: An auto stabilization method and a photographing apparatus using the same are provided. The photographing apparatus having the auto stabilization function includes a voice coil motor actuator (VCMA) to move a photographing element. In the generation of hand tremor, the photographing apparatus controls compensating of the hand tremor. Because one or more dynamic characteristics according to a structure of the VCMA is considered, saturation or delay of displacement of the VCMA is avoided, and a clearer image is provided.

Abstract: A method for measuring the spatial frequency response (SFR) of an imaging system (299) including a display device (280) and an image capture device (290) is disclosed. The method displays a sequence of displayable test pattern images on the display device, the sequence comprising a first test pattern image and at least two subsequent test pattern images, each of the displayable test pattern images including a test pattern having at least one sinusoidal pattern at one or more spatial frequencies such that a phase shift of the sinusoidal pattern has a plurality of pre-determined values. The displayed images are captured with the image capture device to generate a corresponding sequence of captured test pattern images. The captured test pattern images are then compared with the displayable test pattern images to calculate the SFR at a plurality of image locations in the imaging system at the one or more spatial frequencies.

Abstract: The invention concerns a method for digital image stabilization for removing jitter from an original sequence of images (10) generated by a camera. The original sequence (10) is applied to a stabilization algorithm (11). The global motion of a camera is estimated and filtered (110) using a default motion filter. Predetermined parameters (13, 140, 141) are extracted from both the original (10) and stabilized (12) sequences of images. A measure value is computed in order to evaluate (15) the stabilization quality and compared to a threshold. Depending on the results of the evaluation (O15, O?15) the stabilization algorithm (11) uses an alternative filter, in order to improve stabilization quality, or continues to use the default filter.

Abstract: An image processing device includes: a motion vector receiving unit configured to receive, from frame image data made up of frame images, motion vectors representing motion of the frame images; a modeling unit configured to model the motion vector, received from the motion vector receiving unit, to a component separation expression in which a camera motion component and a focal plane distortion component are separated, using component parameters respectively representing camera motion which is motion of a camera, and the amount in change in focal plane distortion; and a component calculation unit configured to calculate the component parameters used in the component separation expression, thereby calculating the focal plane distortion component in the motion vector.

Abstract: A digital cinematographic and projection process that automatically adjusts for object motion within motion pictures in order to eliminate blur while increasing perceived impact of fast motion. The process includes, capturing an image having static and moving elements at a first frame rate, analyzing the image for motion/velocity components to detect the fast moving elements, reducing the static elements to a second frame rate, the second frame rate being slower than the first frame rate and retaining the fast moving element at the first frame rate.

Abstract: Embodiments of the present disclosure utilize captured image information to dynamically determine a lens shading surface being experienced by an imaging device or camera under current conditions. The lens shading surface is then used to apply a correction to the pixels of captured images to compensate for effects of lens shading.

Abstract: Embodiments of the present application use motion information of an imaging device in encoding video or image frames captured by the imaging device. In one embodiment, a video encoding system that processes image data captured by an image sensor comprises at least one encoder that receives motion information describing motion of the imaging sensor during capturing of the image data and that encodes the image data with assistance of the motion information.

Abstract: A method and apparatus for removing a non-uniform motion blur using a multi-frame may estimate non-uniform motion blur information using a multi-frame including a non-uniform motion blur, and may remove the non-uniform motion blur using the estimated non-uniform motion blur and the multi-frame. The apparatus may also obtain more accurate non-uniform motion blur information by iteratively performing the estimation of the non-uniform motion blur information, and the removal of the non-uniform motion blur.

Abstract: An image processing apparatus includes an at-rest-state determination unit that determines whether the image processing apparatus is at rest or not based on motion vectors of image data, and an image change detecting unit that detects the change in image data sequentially inputted. Then, in a state in which it is determined by a determination unit that an image processing apparatus is at rest, an image change detecting unit detects a change in image data, and in a case in which the image data has changed, records the data of the captured image.

Abstract: A portable hand-held apparatus is provided having a memory for storing images, a motion sensor for detecting motion of the device, and a processor for receiving image manipulation instructions via encoded media. The processor processes the stored images based on the detected device motion and the received image manipulation instructions to produce output images.

Abstract: A handheld digital camera device including: an image sensor for capturing images and generating image data; a two-dimensional motion sensor for generating motion data; and an integral processor configured for: controlling operation of the image sensor; estimating an angular velocity of the camera device relative to an external environment using the motion data; decoding an imaged coding pattern printed on a substrate; and performing an action in the handheld electronic device based on the decoded coding pattern.

Abstract: A portable hand-held device is provided having an image sensor for sensing an image of a scene, a motion sensor for detecting motion of the device relative to the scene, and a processor for receiving image manipulation instructions via encoded media. The processor processes the sensed image to remove blur therein based on the detected relative device motion and the received image manipulation instructions.

Abstract: An image processing apparatus includes a geometric converter configured to perform a geometric conversion process to a first frame image among frame images that are sequentially generated through imaging, based on motion information obtained by using a motion detector sensor, a motion vector detector configured to detect a motion vector between a geometric conversion image obtained through the geometric conversion process and a second frame image that has not undergone the geometric conversion process, an image stabilization parameter calculator configured to calculate an image stabilization parameter for different motions by using the motion information and the motion vector, and a stabilized image generator configured to generate a stabilized image through a deformation process to the second frame image or a frame image generated subsequent to the second frame image by utilizing the image stabilization parameter.

Abstract: To provide an image processing device that calculates a parameter used for correcting large video jitter with high accuracy even when the accuracy of a sensor for measuring a movement of a photographing device is low. The image processing device includes: a constraint condition generating unit (130) that generates a constraint condition using sensor information such that a parameter value falls within a range; and a parameter calculating unit (140) that calculates the parameter according to the constraint condition.

Abstract: Provided are a digital photographing apparatus by which a clear image may be obtained despite shaking of the digital photographing apparatus during a photographing operation, a method of controlling the digital photographing apparatus, and a recording medium having recorded thereon a program for executing the method.

Abstract: An image capturing device, including an rectangular image capturing element having long sides and short sides; an image capturing optical system forming an image of a subject on the rectangular image capturing element; a first driving device which moves the rectangular image capturing element in a first direction slanted by a predetermined angle from the long side and the short side of an outer shape of the rectangular image capturing element in a plane perpendicular to an optical axis of the image capturing optical system; and a second driving device which moves the rectangular image capturing element in a second direction slanted by a predetermine angle from the long side and the short side of the outer shape of the rectangular image capturing element in the plane perpendicular to the optical axis of the image capturing optical system, but the second direction differs from the first direction.

Abstract: The image processing apparatus is provided with a subject movement data creation unit that detects the movement of subjects in a plurality of partitioned blocks that partition a screen area of moving images, and creates subject movement data that specifies a partitioned block where there is movement in the subject and the movement of the subject in that partitioned block; a still image acquisition unit that acquires still images; and a still image processor that causes the image of the still image blocks corresponding to the partitioned blocks specified by the subject movement data to move in accordance with the movement of the subject specified by the subject movement data, on the still image acquired by the still image acquisition unit using the subject movement data created by the subject movement data creation unit.

Abstract: An image stabilization system includes: a region vector detection unit configured to detect a motion vector of each of a plurality of regions in an image; a reliability determination unit configured to determine reliability of the motion vector of each of the regions; a region indicator configured to indicate, to the region vector detection unit, a new detection target region instead of a region whose motion vector is determined to have low reliability; an image vector computing unit configured to compute a motion vector of the entire image using a motion vector determined to have high reliability; and a stabilization unit configured to move an entire image to be output according to the motion vector of the entire image to compensate for sway of the image.

Abstract: A method for detecting a moving target is disclosed that receives a plurality of images from at least one camera; receives a measurement of scale from one of a measurement device and a second camera; calculates the pose of the at least one camera over time based on the plurality of images and the measurement of scale; selects a reference image and an inspection image from the plurality of images of the at least one camera; and detects a moving target from the reference image and the inspection image based on the orientation of corresponding portions in the reference image and the inspection image relative to a location of an epipolar direction common to the reference image and the inspection image; and displays any detected moving target on a display. The measurement of scale can derived from a second camera or, for example, a wheel odometer.

Abstract: Provided is an image shake correction device which can be miniaturized without degrading a correction performance thereof. The image shake correction device includes a support supporting a lens; a moving portion installed independently from the support and moving the support on a plane that is approximately perpendicular to an optical axis of the lens, wherein the moving portion comprises a first moving portion moving the support in a first direction and a second moving portion moving the support in a second direction that is perpendicular to the first direction; a prop supporting the support; a pressurizing member pressurizing the support toward the prop by applying force to the moving portion; a first driving portion driving the first moving portion; and a second driving portion driving the second moving portion.

Abstract: A method for sharpening an input digital image captured using a digital camera having a zoom lens, determining a parameterized representation of lens acuity of the zoom lens as a function of at least the lens focal length and lens F# by fitting a parameterized function to lens acuity data for the zoom lens at a plurality of lens focal length and lens F/#; using a processor to sharpen the input digital image responsive to the particular lens focal length and lens F/#corresponding to the input digital image using the parameterized representation of the lens acuity.

Abstract: Method, device and computer program product for stabilizing a video signal. A plurality of frames of the video signal are captured using a camera. A motion sensor associated with the camera is used to generate a plurality of samples representing motion of the camera. The samples are used to determine a displacement of the camera between a first time and a second time, wherein the first time corresponds to an exposure time midpoint of a first frame of the video signal and the second time corresponds to an exposure time midpoint of a second frame of the video signal. The determined displacement is used to compensate for motion in the video signal between the first and second frames caused by the motion of the camera, to thereby stabilize the video signal.

Abstract: Several methods, devices and systems for stabilizing images and correcting rolling shutter effects are described. In one embodiment, a computer implemented method for image stabilization for an image-capturing device with associated calibration data includes determining motion data for the image-capturing device using a motion-estimating device. The method also includes matching motion data to a sequence of frames captured by the image-capturing device to determine motion data for each frame, constructing a target motion path of the image-capturing device based on the motion data for each frame, and computing a desired motion correction from a motion path observed in the motion data to the target motion path.

Abstract: A first equalizer generates a vibration-component signal indicating the amount of movement of an image pickup apparatus according to an output signal of a vibration detecting element for detecting the vibration of the image pickup apparatus. The second equalizer generates a drive signal used to control a driver element to correct the position of a lens or image pickup devices, based on the output signal of a position detecting element for detecting the position of the lens to be driven or the image pickup devices to be driven and the vibration-component signal. A control unit verifies the operations of the driver element, the position detecting element, the vibration detecting element and the first equalizer, based on the output signal of the position detecting element and the vibration-component signal.

Abstract: A video processing apparatus comprises a signal input unit which receives a video signal, a shift detection unit which detects a shift period in shooting and a maximum shift amount during the shift period from the video signal input from the signal input unit, an effective area detection unit which detects an object area common throughout the shift period as an effective area on the basis of the shift period and the maximum shift amount, a correction unit which corrects a shift during the shift period by reading out data from the effective area, and a resolution conversion unit which performs enlarge processing to convert a size of the effective area read out by the correction unit into an output image size.

Abstract: Provision is made for obtaining a high-quality image with noise, such as ringing, reduced. An image processing device includes an image correction means for applying image-shake correction processing to an input image; a correction-image characteristic detection means for detecting a characteristic of a correction image obtained through the image-shake correction processing; a first characteristic-determination means for outputting selection information, based on a characteristic-detected correction image obtained through detection of the characteristic of the correction image; and an image outputting means for outputting the input image or the correction image, based on the selection information. As a result, it is made possible to obtain a high-quality image with noise reduced.

Abstract: Methods are disclosed for digital cameras to gain tilt information of an image sensor of the camera in order to achieve a fast correction for this tilt. By moving the lens of the camera to positions providing a maximum sharpness of at least three regions of interest (ROI) in the image sensor the tilt of the image sensor is calculated by using the correspondent lens/sensor distances and the distances of the different ROIs to the center of the image sensor. Yaw and pitch values of the tilt of the image sensor are calculated to enable an alignment of the sensor.

Abstract: An imaging apparatus includes an image capturing unit including an image sensor capable of photoelectrically converting a subject image and configured to generate moving image data based on an output signal of the image sensor, a storage unit configured to store foreign substance information including information relating to at least a position and a size of a foreign substance adhered to an optical element disposed on a front side of the image sensor, a detection unit configured to detect a shake amount of the image sensor, a control unit configured to control an image clipping position on an entire screen of the image sensor according to the shake amount of the image sensor detected by the detection unit, and a recording unit configured to record the foreign substance information and information indicating the image clipping position in association with the moving image data.

Abstract: A method including using an optical image stabilization function in an imaging apparatus comprising a lens and an image sensor; acquiring system change information, the system change information concerning changes that affect optical path through the lens to the image sensor during capturing of an image through the lens; adjusting a lens shading correction function on the basis of the acquired system change information; and applying the adjusted lens shading correction function to image data representing the captured image.

Abstract: There is provided an image processing apparatus including an HDR (High Dynamic Range) processing unit inputting images picked up while exposure control that changes an exposure time is being carried out with a predetermined spatial period and a predetermined temporal period on pixels that compose an image sensor, and carrying out image processing. The HDR processing unit generates a first combined image by combining pixel values of a plurality of images with different sensitivities generated by an interpolation process using a plurality of consecutively picked-up images, generates a second combined image by combining pixel values of a plurality of images with different sensitivities generated by an interpolation process that uses a single picked-up image, and generates an HDR image by executing a pixel value blending process on the first combined image and the second combined image in accordance with a blending ratio calculated in accordance with movement detection information.

Abstract: An imaging apparatus includes a correction unit, a vibration detection unit, a filter passing and outputting frequency of a predetermined band of vibration signals periodically entered from the vibration detection unit: the filter setting, as intermediate value, sum of a value based on a vibration signal of current period and a value based on a vibration signal of last period and setting, as output signal, a value obtained by adding a value based on intermediate value of the current period and a value based on intermediate value of the last period, a calculation unit calculating vibration correction amount, a driving control unit driving the correction unit by using the vibration correction amount, and an offset unit performing feedback control so that an intermediate value is shifted to predetermined value by changing the intermediate value and an offset value added to a signal based on output from the vibration detection unit.

Abstract: An image stabilization control apparatus includes a vibration correction unit configured to correct an image shake occurring due to vibration, a first vibration detection unit configured to detect and output an angular velocity of the vibration, a second vibration detection unit configured to detect and output an acceleration of the vibration, a first extractor configured to extract a signal in a predetermined frequency band based on an output of the first vibration detection unit, a second extractor configured to extract a signal in a predetermined frequency band based on an output of the second vibration detection unit, an output correction unit configured to correct the output of the first vibration detection unit based on the signals extracted by the first and second extractors, and a driving unit configured to drive the vibration correction unit based on the output of the first vibration detection unit as corrected.

Abstract: An image-blur correction device includes a vibration detection unit which detects vibrations of two different detection axes in a plane orthogonal to an optical axis, a correction unit which corrects vibration using a correction optical system which is displaced in directions of at least two correction axes different from the detection axes in the plane, a calculation unit that calculates amounts of displacements used to drive the correction optical system so that image-blur generated due to the vibrations is corrected based on amounts of vibrations obtained using the vibration detection unit, a coordinate conversion unit which rotates amounts of vibrations in the two detection axes relative to the corresponding at least two correction axes for conversion through calculations, and a restriction unit which restricts a driving range of the correction unit based on a displacement-amount restriction value obtained from a performance limitation region of the correction optical system.

Abstract: An image stabilizer includes a stationary frame with four sidewalls, a moveable frame including four side panels, magnets, a plurality of fine pattern coils, and a resilient plate holding the moveable frame in the stationary frame. Each sidewall includes a receiving hole, a support portion received in the receiving hole, and a raised engagement portion extending from the support portion. The magnets are fixed on the side panels. The fine pattern coils are fixed in the receiving holes and aligned with the magnets and compensate for vibration and movement of the device to which it is affixed. The resilient plate is configured for returning the moveable frame to a resting position when a power supply is cut off.

Abstract: Upon correcting blur of image capture data of an image capturing device by coded exposure processing, an exposure time and aperture value, which are set by a photometry unit of the image capturing device according to an object, are input, and the exposure time or aperture value is adjusted based on a ratio of shutter open periods in an opening and closing pattern of a shutter used in the coded exposure processing. Then, a gain adjustment value of the image capture data corresponding to a deficiency of an exposure amount by the adjusted exposure time or aperture value is set, image capture by an image capturing unit of the image capturing device is controlled based on the opening and closing pattern, exposure time, and aperture value.