Abstract: A motion detector comprising a sensor apparatus and a calculator arranged for: generating first and second successive frames comprising each a 3-D cloud of points, wherein each point represents a position in space of a surface of at least an object in the field of vision of said sensor apparatus; transforming each of the first and second frames by: mapping each cloud of 3-D points into a 2-D grid of cells associated each to a sequence of predetermined volumes; and associating to each cell of the 2-D grid of cells a sequence of the lists of the points contained in corresponding volumes of the sequence of predetermined volumes; comparing the sequences of lists associated to the same cells of the 2-D grids obtained for the first and second frames; and indicating that motion occurred based on the sequence of lists being different in the first and second frames.

Abstract: The present invention relates to an image processing device arranged for image stabilization of a video stream comprising image frames captured by a video camera, the image processing device comprising: an electronic image stabilization module arranged to perform electronic image stabilization to sub-sets of image frames of the image frames of the video stream to compensate for a oscillating movement of the video camera; and a masking module arranged to apply an edge mask to each sub-set of image frames, wherein each edge mask is having a fixed width, wherein the fixed width is based on a camera oscillation amplitude being specific for the sub-set of image frames to which the edge mask is applied. The present invention also relates to a method for image stabilization of a video stream.

Abstract: An image processing apparatus for reducing fluctuations due to a heat haze in an image including a stationary region and a moving object obtains histogram of gradation distribution for each of a target image to be corrected and a frame for correction, and corrects the target image by using the frame for correction while changing a mixing ratio between the target image and the frame for correction depending on similarity between histograms. To adaptively control a size of image blocks for the histograms, the apparatus calculates two indices having different robustness to deformation of an object from image blocks of each of the target image and the frame for correction, and determines suitability of the image block size based on a relationship of the indices. The difference between the histograms and the sum of absolute differences (SAD) between the pixel values can be used as the two indices.

Abstract: Aspects of the technology described herein provide a method of editing video to improve the apparent stability of the video footage. In one aspect, the apparent stability of the video image is improved by adding a border around an image captured within individual video frames and adjusting the relative position of consecutive video frames according to a negative of a movement vector calculated between the two consecutive frames.

Abstract: A reproducer is provided with members shown below. Namely, the reproducer is provided with a storage part for storing images, a vibration detection part for detecting a vibration operation by a user, a switching instruction part for instructing switching of reproduction content in slide show reproduction based on a detection result from the vibration detection part, a synthesis processing part for performing creation processing of slide show images, which are images for the slide show reproduction, based on instructions of the switching instruction part, and a slide show control part for performing the slide show reproduction of the images stored in the storage part and the slide show images.

Abstract: An imaging apparatus includes an image capturing unit including an image sensor capable of photoelectrically converting a subject image and configured to generate moving image data based on an output signal of the image sensor, a storage unit configured to store foreign substance information including information relating to at least a position and a size of a foreign substance adhered to an optical element disposed on a front side of the image sensor, a detection unit configured to detect a shake amount of the image sensor, a control unit configured to control an image clipping position on an entire screen of the image sensor according to the shake amount of the image sensor detected by the detection unit, and a recording unit configured to record the foreign substance information and information indicating the image clipping position in association with the moving image data.

Abstract: The present invention relates to the field of image processing and image stabilization methodologies used on image acquisition and processing systems. A method and apparatus to generate an image sequence output that is stable and free of any sudden jumps from an image sequence input acquired with an imaging system whose line of sight is fixed but may drift in time, and by efficiently updating the reference frames that are used in the image stabilization, the method can be optimized.

Abstract: A pair of cameras having an overlapping field of view is aligned based on images captured by image sensors of the pair of cameras. A pixel shift is identified between the images. Based on the identified pixel shift, a calibration is applied to one or both of the pair of cameras. To determine the pixel shift, the camera applies correlation methods including edge matching. Calibrating the pair of cameras may include adjusting a read window on an image sensor. The pixel shift can also be used to determine a time lag, which can be used to synchronize subsequent image captures.

Abstract: Upon detecting the start of a panning operation, an adder-subtractor applies an offset from an offset change circuit to the output of an HPF (High-Pass Filter) representing the shake amount of an image capturing apparatus to decrease the shake amount. The offset value is set to be larger as the value of shake correction data output from a focal length calculation circuit is closer to the correction limit of a blur correction circuit. Upon detecting the end of the panning operation, the offset value is returned to zero. This invention provides a blur correction apparatus capable of suppressing degradation of a blur correction effect even when in a panning state.

Abstract: An image pickup apparatus performs image shake correction by driving a correction member which is movable for image shake correction. An image sensing device receives light focused by an imaging optical system and then photoelectrically converts the optical image into an image signal so as to output the image signal. An attitude sensor unit detects the attitude of the image pickup apparatus, and a drive control unit performs drive control of the correction member and position detection. A geometric deformation amount calculating unit decomposes distortion of an image into a first distortion component which varies due to the driving of the correction member and a second distortion component which does not vary due to the driving of the correction member so as to calculate correction values for the first and second distortion components. An image processing unit corrects the first and second distortion components by image processing based on the calculated correction values.

Abstract: A surveillance system includes a video capturing device and a power controller. The video capturing device includes an auto focusing module, an auto exposure module, and an auto white balance module. The video capturing device captures a number of images in a first time interval and also captures a number of images in a second time interval next to the first time interval. The power controller includes an object detecting module and a switching module. The object detecting module detects whether there is a moving object in the images captured in the first time interval. The switching module switches off the auto focusing module, the auto exposure module, and the auto white balance module in the second time interval when the objecting detecting module detects that there is no moving object.

Abstract: A method for determining correspondences between a first and a second image, comprising the steps providing a first image and a second image of the real environment, defining a warping function between the first and second image, determining the parameters of the warping function between the first image and the second image by means of an image registration method, determining a third image by applying the warping function with the determined parameters to the first image, determining a matching result by matching the third image and the second image, and determining correspondences between the first and the second image using the matching result and the warping function with the determined parameters. The method may be used in a keyframe based method for determining the pose of a camera based on the determined correspondences.

Abstract: An exemplary image stabilizer includes a shaking sensor, a control module, a driving module, an image module, and a data adjusting module. The shaking sensor detects a shake of a lens associated with the image stabilizer. The control module stores a shake correcting setting having one or more error ranges. The driving module is controlled by the control module to move the lens according to the shake correcting setting. The image module captures an image through the corrected lens. The data adjusting module adjusts the shake correcting setting within one or more of the error ranges when a resolution value of the captured image is lower than a preset reference value.

Abstract: A PSF cost function used for determining a PSF kernel (438) of at least a portion of an image (16) includes (i) a first fidelity term having a first direction derivative, (ii) a first fidelity term weight for the first fidelity term, (iii) a second fidelity term having a second direction derivative, and (iv) a second fidelity term weight for the second fidelity term. Another PSF cost function for determining a PSF kernel (638) includes (i) a first fidelity term with a first derivative in a dominant edge direction (d), and (ii) a second fidelity term having a second derivative in a perpendicular direction(p) to the dominant edge direction.

Abstract: Techniques relating to correction of image distortion caused by movement of a camera unit during image capture. In one embodiment, an apparatus may include a camera unit and a scaling circuit. The apparatus may be configured to calculate a shift value for a line of an image captured by the camera unit, where the shift value is indicative of an amount of movement of the camera unit during at least a portion of capture of the image. The scaling circuit may be configured to operate on the line starting at a line position that is based on the calculated shift value. The calculated shift value may be based on movement information generated by a motion sensor. The scaling circuit may include a digital differential analyzer and one or more multi-tap polyphase filters. The line position may be specified as a fractional pixel value.

Abstract: There is provided an imaging apparatus including an imaging unit, an orthogonal axis information detecting unit that detects orthogonal axis information indicating an inclination of an orthogonal axis perpendicular to an optical axis of the imaging unit after imaging by the imaging unit, and a specifying unit that specifies a shooting posture of an apparatus body at time of imaging, based on the orthogonal axis information detected by the orthogonal axis information detecting unit.

Abstract: An image processing apparatus includes a first pixel output variation detecting section, a second pixel output variation detecting section, and a pixel correcting section. The first pixel output variation detecting section detects a variation between pixel outputs of the phase difference detecting pixel and the imaging pixel of the same color as the phase difference detecting pixel. The second pixel output variation detecting section detects a variation in pixel output between imaging pixels positioned in vicinities of the phase difference detecting pixel and the imaging pixel used by the first pixel output variation detecting section. The pixel correcting section corrects the pixel output of each phase difference detecting pixel based on results of the first and second pixel output variation detecting sections.

Abstract: A method for detecting distance in a smart portable device includes acquiring an image of a target object, calculating a length of a side of the target object in the image, acquiring a predicted length of the side of the target object, and determining a distance between the smart portable device and the target object according to the length of the side of the target object in the image and the predicted length.

Abstract: In a method for calculating corrections for tilt in an image, one or more processors receive a digitized image from a camera. The one or more processors initiate display of the digitized image in a screen on the camera, the screen having user-selectable focus points. The one or more processors receive from a user a focus point selection of an area of the displayed image to correct for tilt, and in response, the one or more processors correct the digitized image for tilt in the area such that an object is in focus in the area.

Abstract: A rifle scope including a display, at least one optical sensor to capture video of a view area, and image processing circuitry coupled to the display and the at least one optical sensor. The image processing circuitry is configured to select visual elements within a sequence of frames of the video and to align the visual elements within adjacent frames of the sequence of frames to produce a video output corresponding to the view area that is stabilized relative to a target. The image processing circuit is configured to provide the video output to the display.

Abstract: An image capture device includes: an image capturing section configured to capture a subject image and to generate an image; an acceleration sensor configured to detect acceleration; a controller configured to set, according to a result of detection obtained by the acceleration sensor, a reference angle for the device's own tilt when a predetermined instruction is issued; and an image processing section configured to rotate the generated image by using the set reference angle as a reference for tilt correction processing.

Abstract: A rifle scope includes an image sensor configured to capture visual data corresponding to a view area, a display, and a controller coupled to the display and the image sensor. The controller is configured to apply a first stabilization parameter to at least a portion of the visual data to produce a stabilized view, to provide the stabilized view and a reticle to the display, and to apply a second stabilization parameter to stabilize the reticle relative to the stabilized view in response to motion.

Abstract: An image processing device includes a stable imaging state estimation portion that performs a stable imaging state estimation process of estimating whether or not a stable imaging state occurs, and a main subject determination portion that performs a main subject determination process. The main subject determination portion outputs a result of the main subject determination process when it is estimated that the stable imaging state occurs due to the stable imaging state estimation process.

Abstract: Image capture can be improved by capturing a sequence of images and analyzing the images to select the image with the least blur and/or an acceptable amount of blur. Gradients can be calculated for at least a portion of the images, and gradient histograms generated. Two or more component curves can be fit to each histogram, such as by using a Gaussian mixture model, and the curves can be compared to determine an amount of variation between the curves. The image with the smallest differences between component curves, or with differences less than a specified blur threshold, can be selected as a sufficiently sharp image and provided for viewing, processing, or another intended purpose of the image to be captured.

Abstract: Methods and apparatus for controlling the read out of rows of pixel values from sensors corresponding to different optical chains used to capture portions of the same image area are described. The readout is controlled based on user input and/or determinations with regard to the rate of motion in captured images or portions of captured images. For a low rate of motion i, the readout rate of a sensor corresponding to a small focal length is slowed down while the pixel row readout rate of one or more sensors corresponding to one or more optical chains have larger focal lengths are allowed to proceed at a normal rate. For a high rate of motion, the read out rate of the sensor corresponding to the optical chain having the smaller focal length is allowed to proceed at the normal rate.

Abstract: An exemplary image capture device 100 includes: an image capturing section 270 configured to generate an image based on a subject image formed; a first sensor 260 configured to detect acceleration of gravity on the device 100 itself to output a first detection signal; a second sensor 250 configured to detect a variation in the device's own attitude to output a second detection signal; and a processor 290 configured to calculate a first magnitude of correction based on a frequency component in the first detection signal, which is equal to or lower than a first frequency, configured to calculate a second magnitude of correction based on a frequency component in the second detection signal, which is equal to or higher than a second frequency, and configured to correct, based on the calculated first and second magnitudes of correction, tilt of at least one of the subject image and the image.

Abstract: An image pickup apparatus includes a shake detecting unit configured to detect a shake of the image pickup apparatus; and a first optical correcting unit and a second optical correcting unit configured to correct optically an image shake by using a shake signal output from the shake detecting unit, wherein the first optical correcting unit is used to correct optically the image shake based on frequency components lower than predetermined frequency components extracted from the shake signal, and wherein the second optical correcting unit is used to correct optically the image shake based on frequency components higher than the predetermined frequency components extracted from the shake signal.

Abstract: A method for displaying a live preview image on a mobile device is disclosed. The method comprises computing a history color value and confidence value for each pixel of a sensor of a camera on the device. Further, it comprises obtaining a new frame of pixels from the camera. Subsequently, for each pixel in the new frame, the method comprises: (a) determining if a pixel color is similar to a corresponding history color value and if a confidence corresponding to a pixel is above a predetermined threshold; (b) if the pixel color is not similar to the history color value and the confidence is above the predetermined threshold, displaying the history color value on the preview when displaying the new frame; and (c) if the pixel color is similar to the history color value or the confidence is below the threshold, displaying the pixel color on the preview instead.

Abstract: An image processing apparatus includes an image acquisition unit that acquires a plurality of images, a corresponding point acquisition unit, a first fundamental matrix calculation unit, a depth calculation unit, a corresponding point extraction unit, and a fundamental matrix determination unit. The corresponding point acquisition unit acquires a plurality of first corresponding points of the images. The first fundamental matrix calculation unit calculates a first fundamental matrix based on the first corresponding points. The depth calculation unit calculates depths for the first corresponding points based on the first fundamental matrix. The corresponding point extraction unit extracts a plurality of second corresponding points from the first corresponding points based on the depths. The fundamental matrix determination unit calculates a second fundamental matrix based on the second corresponding points.

Abstract: A method of controlling a digital photographing apparatus successively photographs one short exposure image and a plurality of long exposure images. A global motion of each of the long exposure images is compensated based on the one short exposure image. A Point Spread Function (PSF) of each of the one short exposure image and the long exposure images are extracted. A shake correction image is extracted through a repeat estimation by determining an initial value of the repeat estimation based on the one short exposure image and the long exposure images and using each PSF.

Abstract: An image stabilizing apparatus and method for correcting an image that is shaken due to a movement of a camera is provided. The image stabilizing apparatus includes a reference image setting unit including: a sample frame extract unit which extracts a plurality of image frames taken for a certain period of time from image data generated by photographing an object; and a reference frame extract unit which the plurality of image frames with one another to extract a most stabilized image frame and set the extracted image frame as a reference image frame.

Abstract: Methods, devices, and computer program products for high fidelity, high dynamic range scene reconstruction with frame stacking are described herein. One system and method includes systems and software for capturing a plurality of images with the same exposure parameters, including a first exposure length. The plurality of images is then combined into a first image using a motion compensation algorithm. A second image is also captured with a second exposure length, where the second exposure length is longer than the first exposure length. Finally, the first and the second images are combined to provide a high dynamic range image.

Abstract: An image processing device of the present invention includes: a motion amount estimating unit which estimates, using feature points extracted from each of a first picture and a second picture, a motion amount indicating an amount of displacement of the second picture with respect to the first picture, the second picture being captured temporally after the first picture; a determining unit which determines, using the feature points, whether or not correction is made using the motion amount estimated by the motion amount estimating unit; and a picture correcting unit which corrects the displacement of the second picture with respect to the first picture using the motion amount so as to correct the displacement between the pictures, in the case where the determining unit determines that the correction is made using the motion amount.

Abstract: Methods and apparatus for correcting blurred images captured by an imaging device. A method comprising recording image data and recording motion information, transmitting a portion of the image data and/or a portion of the motion information to a computer for processing. The computer may calculate an inverse filter from at least the motion information, and the computer may generate a corrected image by applying an inverse filter to the image data.

Abstract: Determining an amount of motion in a second frame of video with reference to a first frame of video. Adaptively predicting a cropping factor for the second frame in response to the determined amount of motion. The cropping factor specifies a portion of the second frame that is to be excluded from the second frame. The predicted cropping factor is adaptively changed for a successive plurality of frames by buffering the first frame to predict a desired cropping factor for the second frame, wherein the first frame occurs prior to the second frame.

Abstract: In an embodiment, an image processing device is provided. The image processing device may include: a first image acquirer configured to acquire a first image of a first spatial resolution; a second image acquirer configured to acquire a second image of a second spatial resolution, wherein the second spatial resolution may be higher than the first spatial resolution; a determiner configured to determine in the first image a location of a part of the first image that corresponds to a pre-determined part of the second image based on a pre-determined similarity criterion; and a copying circuit configured to copy the pre-determined part of the second image to a location in an output image based on the determined location.

Abstract: In-stream rolling shutter compensation may be utilized to modify image data to compensate for detected camera motion. An image processor may perform motion matching on image data received from a camera sensor to determine whether and how the camera is moving. Strips of image data are analyzed to find matching locations between the current image and a previous image by generating graphical profiles for each image strip. The graphical profiles for the current strip are compared to corresponding profiles from the previous image to determine matching locations between the two frames. A motion vector for the strip may be computed based on spatial distances between the match locations of the current image and corresponding match locations of the previous frame. Image data for the current strip may be modified based on the motion vector to compensate for perceived camera motion as it is written out to memory.

Abstract: A method of operating a video processor is provided. The method includes receiving a first image data representing a first frame of a scene, dividing at least a central portion of the first frame into a plurality of tiles, identifying feature point candidates in the first image data, selecting a set of feature points within each specific tile based on the luminance variance ?2 of the specific tile, receiving a second image data representing a second frame of the scene, deriving feature point motion vectors between the first and second frames corresponding to the identified feature, grouping the motion vectors into motion vector groups based on vector magnitude ratios and angular differences, and calculating the affine transform of each group of motion vectors.

Abstract: Provided is an image stabilizing apparatus and method for correcting an image that is shaken due to a movement of a camera. The image stabilizing apparatus includes a characterizing point checking region setting unit including: a sample frame extract unit which extracts a plurality of image frames obtained for a certain period of time in image data obtained by photographing an object; and a frame analyzing unit which detects a plurality of characterizing points in the extracted plurality of image frames, and sets a characterizing point checking region which is used to check characterizing points in a currently input image frame.

Abstract: An electronic device includes a camera module and an image module. The camera module captures a number of static images of an object. The image module includes a detecting unit and an image combining unit. The image module detects an edge response value of each image. The image combining unit selects and combines two images having maximum edge response values in turn according to a rate of the edge response values.

Abstract: Image stabilization, which shifts the center of an image sensing device radially away from the optical axis of an imaging lens is performed multiple times in one frame. A path in a case where the movement of the center of the image sensing device at this time is viewed from the front is generated. A turning point, at which there has been a change in direction from the positive direction to the negative direction or vice versa along the vertical or horizontal direction, is detected in the path generated. The positional relationship between the position of the center of the shifted image sensing device and the optical axis of the imaging lens is determined from the turning point detected. Optical distortion of the image of the subject is corrected by utilizing this positional relationship.

Abstract: An image stabilization system applies a “pinned-edge” or “soft pinned edge” image stabilization technique to digital video to compensate for unwanted camera motion in a captured video. In these stabilization techniques, a warping function is applied to an image frame to achieve a non-uniform shifting of depicted points in the image frame such that a reference point is stabilized with respect to a reference frame. In pinned-edge image stabilization, the final stabilized output video has the same dimensions as the pre-stabilized input video captured by the image sensor. In soft pinned-edge image stabilization, the pre-stabilized input video has slightly larger dimensions than the stabilized output video but these larger dimensions are still reduced compared to traditional electronic image stabilization.

Abstract: Signal processing techniques are applied to digital image data to remove the distortion caused by motion of the camera, or the movement of the subject being photographed, or defective optics, or optical distortion from other sources. When the image is captured, the effect of relative motion between the camera and the subject is that it transforms the true image into a blurred image according to a 2-dimensional transfer function. The 2-dimensional transfer function representing the motion is derived using blind estimation techniques or by using information from sensors that detect the motion. The transfer function is inverted and used to define a corrective filter. The filter is applied to the image and the blur due to the motion is removed, restoring the correct image. Another embodiment uses the transfer function to avoid blur by combining multiple consecutive images taken at a fast shutter speed.

Abstract: An image processing apparatus includes: a histogram computation block configured to compute a histogram of a plurality of motion vectors of each image detected for each of continuously taken images; an acceleration vector computation block configured to compute an acceleration vector corresponding to a change in the histogram; and a camera-shake correction amount computation block configured, on the basis of the acceleration vector and first motion vector for correction used in processing on an image preceding an image subject to processing, by assuming a second motion vector for correction for use in processing on the image subject to processing, to compute a camera-shake correction amount corresponding to the second motion vector for correction.

Abstract: An image processing apparatus of the present invention includes a shake detector 109 which detects a shake of an image pickup apparatus, a shake analyzer 112 which obtains features of a plurality of shake components whose kinds are different from each other, a parameter calculator 113 which calculates a filtering process parameter depending on the features for each of the shake components, and a processor 114 which performs a filtering process using the filtering process parameter calculated for each of the shake components to calculate a shake reduction amount and performs a shake reduction process based on the shake reduction amount with respect to the image.

Abstract: An Engineer's View (EV) wireless video system for powered and unpowered model railroad engines is disclosed. The invention uses commercially available wireless spy cameras, powered by a custom power supply circuit which is compatible with either DC or DCC track systems. The present invention is compatible with all commercial model railroad gauge diesel engines including HO and N Gauge or may be factory installed. The EV system demonstrates a remarkably stable and realistic image of a model railroad layout. Moreover, the present invention may also provide a stable source of power to the engine where stalling could occur at points of track defects.

Abstract: In accordance with an example embodiment a method, apparatus and computer program product are provided. The method comprises configuring a pre-determined movement of at least one of a lens element (210) and a sensor element (212). The method further comprises performing the pre-determined movement of the at least one of the lens element (210) and the sensor element (212) during capturing of an image.

Abstract: Video image stabilization provides better performance on a generic platform for computing devices by evaluating available multimedia digital signal processing components, and selecting the available components to utilize according to a hierarchy structure for video stabilization performance for processing parts of the video stabilization. The video stabilization has improved motion vector estimation that employs refinement motion vector searching according to a pyramid block structure relationship starting from a downsampled resolution version of the video frames. The video stabilization also improves global motion transform estimation by performing a random sample consensus approach for processing the local motion vectors, and selection criteria for motion vector reliability. The video stabilization achieves the removal of hand shakiness smoothly by real-time one-pass or off-line two-pass temporal smoothing with error detection and correction.

Abstract: An electronic apparatus that reduces fixed pattern noise by performing dark current subtraction is described. The electronic apparatus includes: an image sensor; a photographing control unit that photographs a plurality of images; a vibration reduction control unit that performs control to shift a coordinate position of a photographing region in which a subject image is formed by a predetermined pixel count within a photographable region of the image sensor whenever each of a plurality of images is photographed; a coordinate transformation unit that performs coordinate transformation such that a coordinate position of a plurality of photographed images matches a coordinate position of any photographed image; and an image combining unit that combines a plurality of coordinate-transformed photographed images.

Abstract: An image pickup apparatus that is capable of reducing the load of the process required to combine images with different exposures to generate a composite image. An image pickup unit performs continuous image pickup that shoots a subject continuously under different exposure conditions. A control unit controls the image pickup unit so that the exposure condition for the first shot in a current set, which is a second or later set, is coincident with the exposure condition for the last shot in the previous set when a plurality of sets of the continuous image pickup are performed. A composing unit composes the images acquired by one set of the continuous image pickup by the image pickup unit to generate one output image.