Abstract: Method for detecting edge of fixed pattern includes receiving and analyzing a first image to obtain a first edge information. Second image and a corresponding second edge information are received, in which the second image includes an accumulation of image history information. According to the first edge information and the second edge information, a consistent number and an inconsistent number for pairs of pixels at the corresponding location of the first image and the second image are calculated, in which the consistent number represents how many pairs of pixels of which two compared pixels of each pair are both edge pixels, and the inconsistent number represents one of the two compared pixels is not the edge pixel. When the consistent number is greater than first predetermined value and meanwhile the inconsistent number is less than second predetermined value, first image and second image have a fixed pattern with fixed edge.

Abstract: The subject matter disclosed herein relates to electromagnetic force generation for an imaging device having a small form factor.

Abstract: The present invention provides an image processing apparatus capable of obtaining good shake-corrected images in electronic image stablization irrespective of changes of image-taking conditions. An image processing apparatus comprises a shake correcting part that performs coordinate transformation processing based on shake information to an input image that is generated by use of an image-pickup device, and a method changing part that changes a coordinate transformation method for the coordinate transformation processing.

Abstract: An image blurring correction device includes a correction member which moves in a direction perpendicular to the optical axis of an imaging optical system to correct blurring of an optical image, two driving units which drive the correction member in different directions, a shake detection unit which detects a shake applied to the image blurring correction device, a correction amount calculation unit which calculates, based on shake information detected by the shake detection unit, a correction amount for correcting blurring of the optical image, and a conversion unit which converts the correction amount to cancel a driving error generated by a rotation moment applied to the correction member. The driving units drive the correction member based on the correction amount converted by the conversion unit, correcting blurring of the optical image.

Abstract: A digital image processing apparatus and a method of controlling the digital image processing apparatus, the method including: generating a live view image; performing a preprocessing operation on the live view image; driving a vibration mode of a handshake correction module in response to a result of the preprocessing operation; and if a photographing signal is input, generating a photographing image after terminating the vibration mode of the handshake correction module.

Abstract: An actuator includes a stationary member defining a first receiving room and a center axis, a moveable member received in the first receiving room and being apart from the stationary member, a driving member, and a resilient spring assembly. The moveable member is coaxial with the stationary member. The driving member comprises a first magnetic assembly fixed to the stationary member and a second magnetic assembly fixed to the moveable member. The first magnetic assembly faces the second magnetic assembly. The driving member is configured for driving the moveable member to move along a first axis and a second axis perpendicular to the first axis. The first axis and the second axis are perpendicular to the central axis. The spring assembly is positioned between the stationary member and the moveable member and connects the moveable member to the stationary member. The spring assembly elastically deforms when the moveable member moves.

Abstract: A night vision device and method for filtering a series of image frames that depict a moving subject, which thereby improves the signal-to-noise ratio of each image frame, is provided. A composite image is formed for each image frame by combining pixel values in a current image frame with pixel values in composite images corresponding to image frames acquired before the current image frame. Additionally, pixels values in image frames acquired subsequent to the acquisition of the current image frame are included when forming the composite image. A bi-directional recursive filter is used to weight the contributions from the previous composite images and subsequent image frames with a decay constant. Motion of the imaging system is optionally compensated for by establishing a moving reference frame and shifting the image frames to account for this motion; thus, registering the image frames before filtering the current image frame.

Abstract: An image capturing apparatus includes: an image capturing unit capturing an image of an object; an image capture controller that causes the image capturing unit to capture first color component images having a first color component by multi-shot exposure, and causes the image capturing unit to capture second and third color component images, a displacement information acquiring unit that acquires displacement information; an image adding unit that aligns and adds the first color component images based on the displacement information to generate an added image; a calculator that calculates a first point spread function based on the displacement information; a first correcting unit that corrects the second and third color component images using the first point spread function; and a combining unit that combines the added image with the corrected second and third color component images.

Abstract: An information processing device that is connected to a projecting device that projects an annotation image input from an external, terminal a projection area including an object and a background, and is connected to an image capture device that captures an image of the projection area including the object and the background, includes: a detecting unit that detects movement of the object from an image captured by the image capture device; an extracting unit that extracts a changed region that is caused in the captured image by the movement of the object; and a processing unit that performs processing on at least one of the captured image and the annotation image, when the annotation image exists in the changed region.

Abstract: Blur correction device (100) includes: a blur information generation unit (203) which generates blur information based on sensor data indicating camera motion; a blur correction unit (204) which corrects blur in a captured image, based on the blur information, to generate a candidate corrected image; an evaluation value calculation unit (205) which calculates an evaluation value indicating a blur correction level for the candidate corrected image; a termination judgment unit (206) which judges whether the blur correction should be terminated, based on a predetermined condition; and a blur information updating unit which updates the blur information, when the blur correction should not be terminated. When the blur information is updated, the blur correction unit (204) corrects the blur, based on the updated blur information, to generate a new candidate corrected image.

Abstract: A shake correction apparatus comprises a shake detection unit which detects a shake of an image capture apparatus, a calculation unit which calculates a shake correction amount for correcting an image blur based on an output from the shake detection unit, a shake correction unit which corrects the image blur based on the shake correction amount, a shake level determination unit which determines a shake level of the image capture apparatus based on an output from the shake detection unit, an offset determination unit which determines an offset value based on the shake correction amount and the shake level, and a subtraction unit which subtracts the offset value from the output from the shake detection unit.

Abstract: An image processing unit includes a memory unit, a comparative image generator to generate a comparative image from a non-reference image, an image divider to divide a reference image, a non-reference image, and a comparative image into image blocks of a predetermined size, a motion data calculator to calculate motion data between the reference image and comparative image, an average calculator to calculate an average of pixel output values for each image block of the reference image and the comparative image, a threshold determiner to determine a threshold for synthesis determination according to the average of pixel output values of an image block of the reference image, a synthesis determiner to determine whether or not the image blocks of the reference image and of the non-reference image are suitable for synthesis, and a ratio determiner to determine a synthesis ratio of the image blocks determined as suitable for synthesis.

Abstract: A motion blur correction device includes a motion blur correction section which performs motion blur correction processing on an intended video data, and a correction intensity judgment section which instructs the motion blur correction section to cancel the execution of the motion blur correction processing when the frame rate of the video data is equal to or less than a predetermined value. As a result, motion blur correction is prevented from being automatically performed when motion blur correction is not required.

Abstract: A method of removing an artefact from an image captured with a motion invariant camera is disclosed. The captured image is de-blurred using a spatially invariant blur kernel. An edge filter with a fixed offset is applied to the de-blurred image to identify the location of at least one artefact. A parameter is estimated based on a region either side of the identified location. The at least one artefact is removed from the de-blurred image using the parameter.

Abstract: The present invention comprises: an analog/digital conversion means for converting vibration detection signals output from a vibration detection element that detects vibrations of an imaging device into digital signals; a gyro filter that obtains the amount of movement of the imaging device based on the vibration detection signals digitalized by the analog/digital conversion means; a rotation control means for generating an amount of rotary drive in a stepping motor based on both the current position and amount of movement of an optical component or an imaging element; and a stepping control means for generating and outputting pulse signals that drive the rotation of the stepping motor in each phase according to the amount of rotary drive, wherein the stepping control means enables pulse-width modulation of the ratio between the periods in which high-level pulse signals and low-level pulse signals are respectively applied to the same phase of the stepping motor.

Abstract: Embodiments of the present invention provide a control system for video processes that selectively control the operation of motion stabilization processes. According to the present invention, motion sensor data indicative of motion of a mobile device may be received and processed. A determination may be made by comparing processed motion sensor data to a threshold. Based on the determination, motion stabilization may be suspended on select portions of a captured video sequence.

Abstract: An image pickup apparatus includes: an image pickup element; a shake detection device configured to detect a vibration applied to a main body of the image pickup apparatus; and an image blur correction device configured to perform a correction of removing an image blur of the image due to the vibration, the image blur correction device including: a holding member configured to hold the image pickup element; a first driving device configured to move the holding member between a first position where the center of the image pickup element substantially corresponds to the optical axis and a second position; a heat exhausting member arranged to be in contact with the holding member when the holding member is located at the second position; and a control device configured to drive the first driving device based on the vibration.

Abstract: A kernel estimation section (222) of an image processing device of the present invention is configured such that, when performing estimation of a blur kernel based on a contracted degraded image that has a first resolution, the kernel estimation section performs the estimation based on an initial value of a blur kernel that has a resolution corresponding to the first resolution. Thereafter, when performing estimation of a blur kernel based on a contracted degraded image that has a second resolution that is higher than the first resolution, the kernel estimation section performs the estimation based on an initial value of a blur kernel that has a resolution corresponding to the second resolution.

Abstract: A semiconductor device with an “anti-shake” function includes a logic chip having a digital circuit which obtains a value indicating the amount of vibration of device such as an imaging apparatus based on a vibration detection signal supplied from a vibration detection element to generate a correction signal. The logic chip includes a correction signal processing unit which generates the correction signal, and a control signal output unit which outputs a vibration control signal in accordance with the correction signal to a vibration correction control unit which executes vibration correction control for an optical component. The control signal output unit includes a plurality of types of signal output sections and outputs a vibration control signal corresponding to a driving unit from one signal output section selected from among the plurality of types of signal output sections.

Abstract: The present disclosure provides motion enhanced image capture methods and devices. Sensed motion is used to adjust for non-motion related imaging problems, such as low light conditions and imaging stitching image alignment, to improve image capture and post-capture image processing.

Abstract: A reference line detection unit 12 extracts an edge from a distorted image taken by a fisheye camera to thereby determine a curved reference line. A distortion parameter calculation unit 13 calculates a distortion parameter such that the reference line is made linear. A distortion correction unit 14 corrects distortion of the distorted image by a distortion correction equation by using the distortion parameter.

Abstract: Systems and methods for providing a substantially de-blurred image of a scene from a motion blurred image of the scene are disclosed. An exemplary system includes a primary detector for sensing the motion blurred image and generating primary image information representing the blurred image, a secondary detector for sensing two or more secondary images of the scene and for generating secondary image information representing the two or more secondary images, and a processor for determining motion information from the secondary image information, estimating a point spread function for the motion blurred image from the motion information, and applying the estimated point spread function to the primary image information to generate information representing the substantially de-blurred image.

Abstract: A data thinning unit prepares thinned images by extracting only one component in raw data of each of a standard image and reference image, a block extracting unit extracts a search block and a template block for finding residual differences, a luminance difference comparing unit obtains a difference between the maximum value and the minimum value of luminance values of each block, and, when smaller than a threshold value, excludes this from a scope of acquisition of residual differences. The residual difference acquiring unit acquires residual differences from blocks which were not excluded, a block selecting unit selects a predetermined number of blocks having small residual differences, and a hand shake (blur or unintentional movement) acquiring unit finds a position of the template block at which the residual difference becomes the minimum, calculates a center value of all positions, and defines the same as the amount of hand shake.

Abstract: A gain-adjusting apparatus and method thereof are described. The gain-adjusting apparatus includes an integrator, a first register, a control unit, and a second register. The integrator integrates the gyro signal data to generate the integral data. The control unit is coupled to the first register and the second register, respectively. The control unit determines whether the gyro signal data is either greater than an upper gyro threshold or less than a lower gyro threshold to detect the gyro signal data and decrease the gain value stored in the second register.

Abstract: This invention provides a system and method captures a moving image of a scene that can be more readily de-blurred as compared to images captured through the above-referenced and other known methods operating on an equivalent exposure-time interval. Rather than stopping and starting the integration of light measurement during the exposure-time interval, photo-generated current is switched between multiple charge storage sites in accordance with a temporal switching pattern that optimizes the conditioning of the solution to the inverse blur transform. By switching the image intensity signal between storage sites all of the light energy available during the exposure-time interval is transduced to electronic charge and captured to form a temporally decomposed representation of the moving image.

Abstract: An image display device built into electronic apparatuses, the device including a laser beam source unit emitting laser beams of various colors; a light modulation element modulating the laser beams emitted from the laser beam source unit, based on video signals; a projecting optical system projecting the modulated laser beams formed by the light modulation element on a screen; a control portion controlling the laser beam source unit and the light modulation element; and a movable body provided to be drawn out of and inserted into the case of electronic apparatuses. The movable body includes at least a first unit having the projecting optical system and a second unit rotatably supporting the first unit through a hinge portion. The hinge portion is featured by rotating the first unit.

Abstract: An integration circuit integrates an angular velocity signal outputted from a vibration detection element and generates a shift amount signal indicating the shift amount of an imaging device. The integration circuit is formed by a digital filter, which includes a register for holding an accumulation value serving as a shift amount signal. A control unit acquires an accumulation values held in the register at a predetermined interval and obtains a change amount between the accumulation value previously obtained and the accumulation value currently obtained. When the change value exceeds a predetermined threshold value, the control unit subtracts a correction value from the currently obtained accumulation value so that the value approaches zero and resets the obtained value in the register.

Abstract: Provision is made for obtaining a high-quality image with noise, such as ringing, reduced. An image processing device includes an image correction means for applying image-shake correction processing to an input image; a correction-image characteristic detection means for detecting a characteristic of a correction image obtained through the image-shake correction processing; a first characteristic-determination means for outputting selection information, based on a characteristic-detected correction image obtained through detection of the characteristic of the correction image; and an image outputting means for outputting the input image or the correction image, based on the selection information. As a result, it is made possible to obtain a high-quality image with noise reduced.

Abstract: An image obtaining unit continuously obtains plural images each showing a moving subject and motionless subject. Dark current noise is removed from the plural images. Image portions of the moving subject are extracted from the plural images with noise removed, which image portions occupy different positions in the plural images, respectively. Image portions of the motionless subject are extracted from the plural images with noised removed, which image portions occupy the fixed positions in the plural images, respectively. The extracted image portions of the moving subject are moved in the plural images with noise removed based on the corresponding positions in the respective images. The moved image portions of the moving subject are combined with the mage portions of the motionless subject held at the fixed positions in the plural images with noise removed, whereby a shooting image is composed.

Abstract: A mobile device uses data from one or more sensors to determine a user context, such as a motion state of the user, and adjusts at least one camera feature selected form a group consisting of continuous auto-focus, auto-white balance, video encode quality, frame rate, search range used for focusing, and exposure mode based on the user context. The user context may include, e.g., at least one of panning, walking, standing, sitting, and traveling in a moving vehicle.

Abstract: An electronic image capture device including an image capture array, an optional image stabilization gyro, a processor, and a display is configured to detect the amount shaking of the device either prior to, or during image capture. When the shaking of the device exceeds a threshold required for the capture of quality images, the user of the image capture device is notified through the display that excessive shake has been detected and may be advised on methods to reduce or eliminate the shake.

Abstract: An imaging apparatus that determines in-focus conditions according to a user's taste by using auto-focus (AF). The imaging apparatus including an AF unit, that allows the user to input an in-focus operation start command, and that allows the user to input a main photographing start command. The imaging apparatus includes a photographing environment storing unit that stores photographing stop and start data, an assumed in-focus condition group generating unit that generates an assumed in-focus condition group based on at least the photographing stop data, an assumption confirming unit that confirms the assumed in-focus condition group, and an in-focus condition group changing unit that, if an in-focus success rate for the assumed in-focus condition group is higher than for the default in-focus condition group, changes the default in-focus condition group to the assumed in-focus condition group.

Abstract: A jitter sensing mechanism for a gimbaled optical sensor system. In one example, the jitter sensing mechanism includes a faceted retro-mirror configured to allow a double-pass line-of-sight monitoring beam to sense line-of-sight jitter in a multi-axis gimbaled optical sensor system where the inner-most gimbal axis includes a 2:1 gain mirror.

Abstract: An image display system having a generation unit to generate a video signal which is composed of a partial image cut out from a still image; and a display unit to display a video signal inputted from said generation unit at a frame rate higher than that of said inputted video signal by creating an interpolated frame based on a motion vector, wherein said generation unit has a movement unit to move a cut-out position of said partial image, and an output unit to output movement information including at least information indicative of the direction of movement of said cut-out position together with said video signal, and wherein said display unit has a setting unit to set a motion vector used for the creation of said interpolated frame by using said movement information.

Abstract: The interval designation section 222 sequentially alters and designates a movement interval D and a non-movement interval D? in an entire interval. Each time a movement interval D is designated, the value determination section 223 determines the average value of the image variation amount array E in the movement interval D as a function value a of the unit rectangular function r[x] and the average value of the image variation amount array E in the non-movement intervals D? as a function value b of the unit rectangular function r[x]. Each time a movement interval D is designated, a degree of divergence J between the function values a, b and the image variation amount array E is calculated by the divergence calculation section 224. Then, only the frame images contained in the movement interval D designated when the degree of divergence J is at a minimum are extracted.

Abstract: An image capturing apparatus having a camera shake correction function, includes an optical system, a movable member that is movable on a plane perpendicular to an optical axis of the optical system to achieve the camera shake correction function, an angular velocity detector configured to detect an angular velocity of shake of the image capturing apparatus and generate a detection signal, and a controller configured to drive the movable member based on the output from the angular velocity detector. The controller includes a time change rate limiter configured to limit a time rate of change of angular velocity indicated by the detection signal output from the angular velocity detector to be no greater than a predetermined limiting value, and drive the movable member based on the detection signal output through the time change rate limiter.

Abstract: A method of motion compensation in a camera may include deriving a motion signal representative of a motion of the camera, processing video frames of a video signal from an image sensor of the camera during a viewfinder mode to derive motion vectors between pairs of frames, and processing the motion signal with a number of combinations of gain and offset factors during the viewfinder mode. The method may also include determining combinations for producing threshold motion vectors, and applying the combination producing the threshold motion vectors for processing the motion signal during a still capture mode to produce a control signal for a motion compensating element for optics of the camera.

Abstract: A method of using an image capture device to identify range information for objects in a scene includes providing an image capture device having an image sensor, at least two coded apertures, and a lens; storing in a memory a set of blur parameters derived from range calibration data for each coded aperture; capturing images of the scene having a plurality of objects using each of the coded apertures; providing a set of deblurred images using the captured images from each coded aperture and each of the blur parameters from the stored set; and using the set of deblurred images to determine the range information for the objects in the scene.

Abstract: An image capture device of the present invention includes: a first image capture element 10A and a second image capture element 10B; and an optical system which is capable of forming a first image which is in focus on an image capture plane of the first image capture element 10A and forming a second image which is out of focus on an image capture plane of the second image capture element 10B. An image processing section 220 processes a signal obtained from the first image capture element 10A and a signal obtained from the second image capture element 10B and produces a restored image from an image obtained by the second image capture element 10B, the restored image having reduced camera shake blur and reduced out-of-focus blur.

Abstract: A method of removing an artefact from an image captured with a motion invariant camera is disclosed. The captured image is de-blurred using a spatially invariant blur kernel. An edge filter with a fixed offset is applied to the de-blurred image to identify the location of at least one artefact. A parameter is estimated based on a region either side of the identified location. The at least one artefact is removed from the de-blurred image using the parameter.

Abstract: A video stabilization method includes detecting a plurality of feature points of an inputted image frame. Next, a block motion estimation is performed onto the inputted image frame according to the feature points, thereby generating a plurality of block motion vectors corresponding to the feature points. Then, the block motion vectors are converted to a histogram to perform a statistical process. Thereafter, an initial static background motion vector is determined according to a statistic value of the histogram. Thereafter, a Gaussian distribution model and a Maximum a Posteriori (MAP) estimation are adopted to correct the initial static background motion vector to generate a global motion vector. Then, a smoothing process is performed onto the global motion vector to generate a smoothed global motion vector. A video stabilization system is also provided here.

Abstract: A method of estimating a point spread function (PSF) includes: estimating a global motion between a short-exposure image and a long-exposure image that are continuously captured using different exposure times, and compensating for the global motion; calculating a first resultant image by applying a band pass filter to the short-exposure image; calculating a second resultant image by applying the band pass filter to the long-exposure image; converting the first resultant image and the second resultant image into n-level images, where n is an odd natural number greater than or equal to 3, by deducing a first n-level resultant image and a second n-level resultant image from the first resultant image and the second resultant image, respectively; correlating the first n-level resultant image and the second n-level resultant image, and calculating a correlation map; and deducing the PSF from the correlation map.

Abstract: A camera-shake correction apparatus includes an image capturing unit configured to capture an object image, a camera-shake detection unit configured to detect a camera-shake applied to the camera-shake correction apparatus, a correction unit configured to correct the camera-shake of the object image by moving a correction member based on a camera-shake signal detected by the camera-shake detection unit, and a control unit configured to measure an amplitude of the camera-shake or a frequency of the camera-shake, or both the amplitude of the camera-shake and the frequency of the camera-shake, based on the camera-shake signal supplied from the camera-shake detection unit, and the control unit further configured to control to hold the correction member at a latest position if it is determined that the measured amplitude is smaller than a predetermined amplitude or if it is determined that the measured frequency is lower than a predetermined frequency, or if it is determined that the measured amplitude is smaller

Abstract: An apparatus capable of capturing a still image in a moving image capturing mode includes an instruction unit configured to instruct still image capturing, a vibration detection unit configured to detect vibration applied to the apparatus, a control unit configured to control driving of a correction member in a driving range according to whether still image capturing or moving image capturing is performed, based on an output from the vibration detection unit, a position detection unit configured to detect a position of the correction member, and a determination unit configured to determine a reference position of a range in which the correction member is driven, wherein, if the instruction unit instructs image capturing in the moving image capturing mode, the detected position is set as the reference position.

Abstract: An anti-shake apparatus comprises an angular velocity sensor and a controller. The angular velocity sensor detects an angular velocity. The controller controls the angular velocity sensor and performs an anti-shake operation based on the output signal from the angular velocity sensor. The controller calculates an angular velocity signal, based on the output signal from the angular velocity sensor before a predetermined period which is longer than a predetermined time interval and the output signal from the angular velocity sensor after the predetermined period, at the predetermined time interval, during the predetermined period.

Abstract: An imaging apparatus with an image sensor and a correction optical system movable in a direction perpendicular to an optical axis includes a vibration detection unit configured to detect a vibration applied to the imaging apparatus, a vibration correction unit configured to drive the correction optical system to correct an image vibration according to an output from the vibration detection unit, a motion vector detection unit configured to detect a motion vector based on an image signal output from the image sensor, an amplifier unit configured to amplify the output from the vibration detection unit, a gain setting unit configured to set a gain of the amplifier unit based on the motion vector; and a gain control unit configured to allow or inhibit the setting of the gain of the amplifier unit set based on the motion vector, according to a change of an imaging condition of the imaging apparatus, wherein the vibration correction unit performs a vibration correction based on the output from the vibration detecti

Abstract: A method and device are provided for method for stabilization of image data by an imaging device. In one embodiment, a method includes detecting image data for a first frame and a second frame, performing motion estimation to determine one or more motion vectors associated with global frame motion for image data of the first frame, performing an outlier rejection function to select at least one of the one or more motion vectors, and determining a global transformation for image data of the first frame based, at least in part, on motion vectors selected by the outlier rejection function. The method may further include determining a stabilization transformation for image data of the first frame by refining the global transformation to correct for unintentional motion and applying the stabilization transformation to image data of the first frame to stabilize the image data of the first frame.

Abstract: A frame is divided into blocks each having a predetermined size, and motion vectors are calculated for respective blocks. The blocks are classified into an object group including an object image and a background group as a background image based on the calculated motion vectors, and representative motion vectors of the respective groups are calculated. The number of blocks included in the object group is compared with a threshold. When the number of blocks is larger than the threshold, the representative motion vector of the object group is selected as a motion vector for the entire frame. On the other hand, when the number of blocks included in the object group is smaller than the threshold, the representative motion vector of the background group is selected as the motion vector for the entire frame.

Abstract: An image deblurring system deblurs motion blurred images of a video stream captured from a moving object. An image deblurring method selects a blurred image from the video stream, selects blurred pixels from the blurred image, and calculates a movement offset for each of the blurred pixels according to coordinates of the blurred pixel in a frequency domain during the movement of the moving object. The method generates a point spread function according to the movement offset, and generates an image conversion formula according to the point spread function. The method converts each of the blurred pixels into a sharp pixel according to the image conversion formula, and generates a sharp image based on all of the sharp pixels.

Abstract: An image processing device for super resolution is disclosed. The device comprises an upsampling section, a motion compensated image generating section, a blend processing section and an output image generating section wherein filtering processing necessary for generating a difference information is performed twice or less, so that miniaturization of the device and an improvement in processing efficiency are achieved.