Abstract: A motion estimation method is provided for processing successive images in an image sequence, with a motion vector being associated with each of the processed images. For a current image, motion vectors associated with images that precede the current image in the sequence are selected. Candidate motion vectors are generated from the motion vectors that are selected. A motion vector is elected from among the candidate motion vectors. Information that associates the elected motion vector with the current image is stored in memory. At least one of candidate motion vectors is an acceleration vector generated from the acceleration between first and second motion vectors averaged relative to a first and second images, with the first and second images being distinct and preceding the current image in the image sequence. A motion vector averaged relative to a given image is obtained from selected motion vectors associated with images preceding the given image.

Abstract: It is possible to definitely identify a relative position of a moving subject in an infrared image captured by an infrared camera in a relation with the background of the moving subject. The present invention provides an imaging device including an infrared camera for imaging an area under surveillance by infrared radiation measurement, a moving-subject detector for detecting a moving subject in the surveillance area on the basis of an infrared image signal acquired by the infrared camera, an image signal processor for coloring a moving part of the infrared image signal, detected by the moving-subject detector, with a predetermined color, and an image display for displaying an image resulted from the coloring of the moving part of the infrared image signal by the image signal processor.

Abstract: Disclosed herein is a drive device including an imaging element creating a image signal relating to an object image, a securing body, a displacement body capable of displacement in a predetermined direction in a predetermined plane having a light-receiving surface of the imaging element with respect to the securing body with the imaging element mounted to the displacement body, and a first guide mechanism and a second guide mechanism adapted each to guide displacement of the displacement body in the predetermined direction. The second guide mechanism includes a guide device, and a guided device. The guide device is configured to be positionally changeable in a plane parallel to the predetermined plane. The displacement body is turnably displaced with the first guide mechanism serving as a fulcrum when the guided device is displaced in response to the positional change of the guide device.

Abstract: There is provided an image processing apparatus allowing a user to easily process a captured image. This image processing apparatus displays an image generated based on image data and an item representing processing for the image data on a screen, detects a change in the orientation thereof, and performs processing upon the image data corresponding to the displayed image based on a detection result of the change in the orientation thereof.

Abstract: An image processing apparatus includes a motion prediction processor configured to detect a motion vector that indicates inter-image motion between a current image and a reference image; a motion compensation processor configured to perform a motion compensation process for the reference image by using the motion vector and generate a motion compensated image; an addition processor configured to generate a noise reduced image in which noise of the current image is reduced by adding the current image and the motion compensated image; an addition determination unit configured to compute an addition weight in units of pixels of the motion compensated image; a down-sampling processor configured to perform a process for reducing the current image and the motion compensated image; and an up-sampling processor configured to perform a process for expanding an addition coefficient map that is an output of the addition determination unit.

Abstract: An image pickup apparatus according to the present invention comprises an image pickup unit for obtaining an image, the image pickup unit including an image pickup element and an image pickup optical system which includes an aperture stop and forms the image on the image pickup element, a synthesis instruction unit for providing an instruction to form a multiple exposure image by making registration of a plurality of images and synthesizing the plurality of images into one image, an aperture value control unit for controlling setting of an aperture value of an aperture stop when the synthesis instruction unit provides the instruction to form the multiple exposure image, and an image processing unit for forming the multiple exposure image by synthesizing, into one image, a plurality of images obtained by the image pickup unit with the aperture value set by the aperture value control unit.

Abstract: A MCP semiconductor device with an “anti-shake” function includes a driver chip and a logic chip. The logic chip includes a correction signal processing unit which obtains a value for vibration of apparatus based on a vibration detection signal to generate a correction signal and a control signal output unit having a plurality of types of signal output sections which output a vibration control signal in accordance with the correction signal to a vibration correction control unit which executes vibration correction control for an optical component. The logic chip further includes a driver output terminal which outputs the vibration control signal to the driver chip, an external output terminal which outputs the control signal to an external circuit other than the driver chip, and also an output switch unit which connects one of the plurality of signal output sections with the driver output terminal or the external output terminal.

Abstract: A method for adjusting photographing settings of a digital camera through motion detection, for determine to adjust the photographing settings of the digital camera according to vibrations of the digital camera or shaking of a photographed object. The adjusting method includes the following steps. At least two continuous pre-photographed images are captured. A central area and an edge area are set at same positions in the pre-photographed images respectively. Feature points are found in the pre-photographed images. A local motion vector and a camera motion vector are respectively determined according to a relation of the feature points on the central area and the edge area. A subject motion vector is generated according to a difference between the local motion vector and the camera motion vector. Adjustment of the photographing settings of the digital camera is determined according to a maximum value in the subject motion vector and camera motion vector.

Abstract: A processing device (D) is dedicated to image frame stabilization of digital video sequences in an electronic equipment (E1), such as a digital camera, for instance. This processing device (D) comprises processing means (PM) arranged, for each current image frame of a video sequence, for determining a type of motion present in the video sequence from global motion parameters of the current image frame and the ones of at least one preceding image frame of this video sequence. These parameters are determined from a motion estimation between the current image frame and the preceding one of the video sequence. The motion determination is followed by a selection of a jitter extraction technique amongst at least two jitter extraction techniques depending on this determined motion type. The jitter extraction technique thus chosen is used to determine a jitter intended to be removed from the determined global motion parameter(s) in order to remove unwanted motion(s) present into the current image frame.

Abstract: A camera motion parameter retrieving system and solving process begins with using the equation of that the vector field divergence volume integral is equal to the total outgoing throughput passing through the surface area of the volume through the vector in conjunction with camera motion detection to solve the Motion Vectors (MVs) in the domain, followed by operation to further solve camera motion parameter respectively contains that for PAN, TILT and ZOOM while the value of the parameter represents the motion value; upon obtaining those three parameters, the moving direction of the camera motion of the present image being indicated after simple addition and subtraction operation.

Abstract: A internet based method and apparatus is described for automatically processing a captured digital image taken by a smart device at a fixed-location, mobile or virtual event, and synchronizing the combination of that captured primary image with a secondary image, be it a picture frame, or a watermark to create a combined media image. If desired, the combined image may also contain an audio file. Once combined, the image may be stored for later viewing, and/or automatically returned to the user of the smart device or the PC of the user who captured the primary image, forwarded to an online print service website, posted to a photo sharing website, and/or forwarded to a distribution list. The automated post processing of said captured images is handled by a process engine hosted at an Application Provider's website, the process engine containing instructions for the media combining and metadata tagging of said images.

Abstract: A machine-implemented method of generating a stabilized video sequence includes receiving an input video sequence captured by an image capture device. The input video sequence includes a plurality of pairs of successive frames. Motion sensor data indicative of motion of the image capture device while the input video sequence was being captured is received. A set of matching features for each pair of successive frames is identified. Global motion features are identified in each set of matching features and qualified based on the motion sensor data. The global motion features are indicative of movement of the image capture device. A stabilized video sequence is generated based on the input video sequence and the identified global motion features.

Abstract: A camera shake corrector includes: a first moving member that holds an image sensor or a prescribed lens and is capable of moving in a first direction; a first motor that moves the first moving member; a second moving member that holds the first moving member and is capable of moving in a second direction that is different from the first direction; a second motor that moves a second moving member; a single detecting member; and a section to be detected by the single detecting member, which is formed on the first moving member. Initial positions of the first moving member and the second moving member are detected by the section to be detected and the single detecting member.

Abstract: An imaging system is provided that includes an area determiner and readout processor. The area determiner defines an area used in an auto focus operation within an effective pixel area of an image sensor. The readout processor reads out only pixel signals within the defined area. The size of the area is determined according to at least one of a focal length or a magnitude of camera shake.

Abstract: Disclosed herein is a method for global motion estimation for video stabilization. The method enables selecting a video frame from a video stream. The method further enables downscaling the video frames by factor close to 2 in a two dimensional range, dividing the downscaled video frame into a plurality of macroblocks, performing motion estimation for the macroblocks to generate a set of local motion vectors. Further, the method enables selecting macroblocks representing global motion vectors from the set of local motion vectors, computing a single global motion vector for the selected macroblocks and determining occurrence of at least one of: scene change, illumination change or crossing object and modifying the single global vector to compensate for errors induced due to occurrence of at least one of: scene change, illumination change or crossing object.

Abstract: An electronic apparatus has a first sending unit that sends predetermined data to an external apparatus, the predetermined data is generated by mixing video data and first error data; a second sending unit that sends second error data to the external apparatus without mixing video data and the second error data; and a selecting unit that selects one of the first sending unit and the second sending unit based on a state of the external apparatus to cause the external apparatus to notify an error associated with the electronic apparatus.

Abstract: A motion detection apparatus includes a CPU. The CPU detects partial motion vectors of an object scene corresponding to motion detection blocks based on raw image data. The CPU also reduces a weighted amount allocated to a motion detection block which captures a partial object scene having a contrast below a reference out of the motion detection blocks. Furthermore, the CPU performs a weighted average process referring to the weighted amount on the partial motion vectors so as to detect a motion of the entire object scene. The CPU obtains a minimum correlation value of a luminance difference between frames of the raw image data corresponding to each of the motion detection blocks, and executes a process for increasing the reference according to an increase of the obtained minimum correlation value corresponding to the motion detection block which captures the partial object scene having a contrast below the reference.

Abstract: Provided are an image capturing apparatus and method for use in a mobile terminal. The image capturing method includes when an image capturing menu is selected during a preview operation, pausing the preview operation; releasing an image sub-processing of the preview operation; and resuming the preview operation and capturing the image. Accordingly, the mobile terminal can minimize the difference between the preview operation stop time and the capture time, which may be generated by the data processing time increased during capturing the image at high pixel resolution. Therefore, the mobile terminal can provide the captured image naturally.

Abstract: In an anti-shake circuit for an imaging device, a differential circuit receives an analog sensing signal and a target signal and then generates a difference signal. An analog mathematical circuit performs at least one mathematical operation on the difference signal, resulting in generation of at least one mathematical output signal. A driver receives the at least one mathematical output signal, and, accordingly, generates a driving signal and controls an actuator in order to correct the shaking movement.

Abstract: An image capture apparatus comprises an image capture unit, a shake detection unit, a reference value calculation unit, an image blur correction unit, a motion vector detection unit, a determination unit which determines whether the motion vector indicates a movement of an object, and a control unit which controls one of the calculation methods of the reference value and the reference value, wherein the reference value calculation unit calculates the reference value using both an output from the shake detection unit and an output from the motion vector detection unit as one of the plurality of calculation methods, and when the determination unit determines that the motion vector indicates the movement of the object, the control unit controls not to calculate the reference value using the output from the shake detection unit and the output from the motion vector detection unit.

Abstract: An image capture apparatus comprises an image capture unit which photo-electrically converts an object image, a shake detection unit which detects a shake of the image capture apparatus, a motion vector detection unit which detects a motion vector, a reference value calculation unit which calculates a reference value serving as an output from the shake detection unit when the image capture apparatus stands still, a correction amount calculation unit which calculates a shake correction amount, and an image blur correction unit which corrects a blur of the object image, wherein the reference value calculation unit calculates the reference value based on an integrated value of the output from the shake detection unit, an integrated value of an output from the motion vector detection unit, and a variation of the output from the correction amount calculation unit in a predetermined period.

Abstract: A digital photographing method and apparatus include determining a motion vector of an object in a preview image, determining whether the motion vector meets a predetermined condition and, when it does, generating an image capturing signal to photograph a scene desired by a user.

Abstract: A method for adjusting a shooting condition of a digital camera through motion detection is applied to determine a shooting parameter of the digital camera. The adjusting method includes the following steps. At least two consecutive images, namely a first pre-capture image and a second pre-capture image, are selected. The first pre-capture image and the second pre-capture image are divided into a plurality of selection blocks. A motion vector of each selection block is calculated. The motion vector of each selection block is used to generate a background dominant motion vector of the camera sloshing and a self-movement vector of the shot object. The background dominant motion vector is subtracted from the self-movement vector of the shot object, so as to obtain a corrected foreground motion vector. According to the size of the corrected foreground motion vector, the corresponding shooting parameter is determined.

Abstract: A method for estimating egomotion of a camera mounted on a vehicle that uses infra-red images is disclosed, comprising the steps of (a) receiving a pair of frames from a plurality of frames from the camera, the first frame being assigned to a previous frame and an anchor frame and the second frame being assigned to a current frame; (b) extracting features from the previous frame and the current frame; (c) finding correspondances between extracted features from the previous frame and the current frame; and (d) estimating the relative pose of the camera by minimizing reprojection errors from the correspondences to the anchor frame.

Abstract: An optical shake correction unit corrects an optical axis in response to an output signal of an vibration detecting element. An electronic shake correction unit adaptively varies an effective region in image signals of an image pickup region formed by image pickup devices. A control unit performs control such that either the optical shake correction unit or the electronic shake correction unit is enabled by switching between a first image pickup mode and a second image pickup mode.

Abstract: An information processing apparatus of the present invention includes a shot image obtaining portion, an image processing portion, a data conversion portion and a control portion. The shot image obtaining portion includes an imaging element and obtains a shot image in a time-series from the imaging element. The image processing portion performs image processing on the shot image and analyzes movement of the shot image resulting from movement of the information processing apparatus. The data conversion portion converts the analyzed movement of the shot image into control data, and the control portion controls functions based on the control data.

Abstract: A method of calculating camera shake using first and second images obtained by continuous shooting includes: extracting first and second feature points located in positions symmetrical about a central point in the first image; searching for the first and second feature points in the second image; and calculating the camera shake based on coordinates of the first and second feature points extracted from the first image and coordinates of the first and second feature points searched for in the second image.

Abstract: A solid-state electronic image sensing device senses the image of a subject repeatedly for an exposure time over which camera shake is thought not to occur, and repeatedly outputs image data representing the image of the subject. A combining device generates one frame of a combined image obtained by combining the image of the subject represented by image data that has been output from the solid-state electronic image sensing device with the image of the subject represented by image data that was output from the solid-state electronic image sensing device by an immediately preceding image sensing operation, in such a manner that the images of the subject coincide.

Abstract: An imaging apparatus includes: an imaging device for subjecting an optical subject image to photoelectric conversion to generate an image signal; an angular velocity sensor for detecting angular velocity with the imaging apparatus; a first shaking amount calculation unit for integrating detection values from the angular velocity sensor to calculate first shaking amount of the imaging apparatus; a second shaking amount calculation unit for calculating second shaking amount of the imaging apparatus based on image data from the imaging device; a third shaking amount calculation unit for correcting the first shaking amount to calculate third shaking amount of the imaging apparatus based on first amplitude which is a fluctuation range relating to the first shaking amount, and second amplitude which is a fluctuation range relating to the second shaking amount; and a correction control unit for correcting the shaking of the imaging apparatus based on the third shaking amount.

Abstract: A method and apparatus for image stabilization while mitigating the amplification of image noise by using a motion adaptive system employing spatial and temporal filtering of pixel signals from multiple captured frames of a scene.

Abstract: A motion stabilizing techniques are described. A frame of video is represented at least by frame position information. Savitzky-Golay filtering may be applied on frame position information. The resulting filtered video may have reduced visible jitteriness.

Abstract: An image pickup apparatus includes an image pickup optical system having an optical axis and configured to form a subject image, an image pickup element configured to pick up the subject image and output the picked-up subject image as an image, an optical axis controller configured to displace an optical axis position relative to the image pickup element every time image capturing is performed, an image addition processor configured to correct positional displacement between a plurality of images output from the image pickup element and add the resulting images together, and an operation unit.

Abstract: Still image apparatus and methods that are suitable for compact camera environments are described. In another aspect, image segments are captured during corresponding exposure intervals of a frame exposure period. Respective motion sensor signals are generated during the respective exposure intervals of the image segments. One or more corresponding movement measures are determined from the respective motion sensor signals for each of the exposure intervals. The image segments are combined into an output image based on the one or more corresponding movement measures.

Abstract: An imaging device and methods of stabilizing video captured using a rolling shutter operation. Motion estimation is used to determine a row motion vector for individual rows of a current frame of a pixel array. The row motion vectors are used to map the location of pixels in the current frame to a mapped frame representing a single acquisition time for the current frame.

Abstract: A method and apparatus for receiving motion data and determining acceleration vectors based on biomechanical data and the received motion data. The method further comprises creating an improved image based on the acceleration vectors.

Abstract: An image display device includes a display, an attitude angle detection unit and a controller. The display displays an image based on image data with photography information. The photography information includes position information and attitude angle information of a camera at a time of photography. If the attitude angle of the display is altered, the controller controls the display, based on the position information and the attitude angle information of the image displayed at the display and based on the attitude angle detected by the attitude angle detection unit, so as to display an image that was photographed within a predetermined region with respect to the position information of the image displayed at the display and that includes attitude angle information corresponding to the detected attitude angle.

Abstract: A motion estimation apparatus and method for estimating a global motion vector of an image due to hand trembling by using zoom information and focus information are provided. The motion estimation method includes: dividing a photographed image into a plurality of image blocks; determining a weight value for a motion vector of each of a plurality of image blocks based on focus information and zoom magnification information; predicting a motion vector for each image block; and estimating a global motion by applying the weight value determined for the motion vector for each image block to the predicted motion vector.

Abstract: Whether a digital camera body (1) is in a horizontal shooting attitude (a) or in either of vertical shooting attitudes (b), (c) is detected by using drive means of an image blurring compensation device. In the case where a focus drive means detects that the digital camera body (1) is either in an upward attitude (d) or in a downward attitude (e), a shooting attitude thereof can be inputted. The inputted shooting attitude is recorded together with an image, whereby the image can be displayed in the same orientation as the image at the time of shooting thereof, even if the image is shot either in the upward attitude (e) or in the downward attitude (e).

Abstract: The imaging apparatus includes an image sensor for obtaining a picture image from an optical image that is projected to the image sensor through an optical system, an image moving portion for moving the optical image on the image sensor, a motion detecting portion for detecting a movement on the picture image of a moving subject that appears in the optical image, and a control portion for controlling, during an exposure period after a predetermined operation, the image moving portion in the direction of canceling the movement of the moving subject on the image sensor due to a movement of the moving subject in the real space, based on a movement of the moving subject detected in advance. The control portion sets length of the exposure period based on the movement of the moving subject detected in advance.

Abstract: An imaging apparatus includes a shake detector configures to detect a shake applied to the imaging apparatus, a first calculation unit configured to calculate a first shake correction amount based on an output of the shake detector, a vector detector configured to detect a motion vector on an imaging surface, a first integration unit configured to integrate an output of the vector detector, a second calculation unit configured to calculate a second shake correction amount based on the output of the vector detector, a shake correction unit configured to correct an image-shake based of the first shake correction amount and the second shake correction amount; and an angle-of-view change determination unit configured to detect an angle-of-view changing operation of the imaging apparatus, wherein the angle-of-view change determination unit determines the start of the angle-of-view changing operation when a signal obtained based on the output of the shake detector is greater than a predetermined value or an output

Abstract: The present invention describes systems and methods of incorporating detailed snapshots of targeted areas of interest into a video or digitized recording of the overall scene including metadata to link the snapshots to the time and location in the overall scene from which the snapshot was acquired. A single fixed high-resolution scene camera or a fixed standard resolution scene camera of analog or IP connected type is used, co-located with at least one pan-tilt-zoom (PTZ) camera or by using the same scene camera in a mode where less than full resolution of the scene camera is used for video but snapshots of areas are captured by the same camera where higher resolution thereof is used for snapshots than for video. The area of interest is selected by the object-tracking feature of an intelligent video system, operated without human intervention, by electronically-implemented identification of the existence of area-specific subjects or targets of interest in the scene image field.

Abstract: An image sensor has an array of photo-sensitive pixels and supports a line-by-line read out of rows. In a normal resolution each row has the same nominal gain and exposure time. In a down-sampling mode the exposure times of the rows are varied according to an alternating sequence having at least two different exposure times. During down-sampling, raw pixel data from rows with different exposure times is combined to simultaneously achieve down-sampling and a high dynamic range.

Abstract: A method for detecting moving interlaced text in a video sequence originating through telecine is disclosed. The method generally includes the steps of (A) checking a motion condition of a current block in a current field in the video sequence for motion both (i) from a previous field in the video sequence to the current field and (ii) from the current field to a next field in the video sequence, (B) checking an artifact condition of the current block for a plurality of symmetric interlaced artifacts in both (i) a forward temporal direction and (ii) a backward temporal direction and (C) asserting a block motion indicator for the current block if all of (i) the motion condition is true and (ii) the artifact condition is true.

Abstract: Exposed images from a CCD are each captured to Surfaces A, B and C in an SDRAM in a repeated sequence from A, B to C, and the latest image among the images thus captured is displayed. While an image on Surface B is being transferred, an image on Surface A is used as the image to be displayed. The next exposure is started, and images to be displayed are switched, at the same timing as the transfer is started. An image to be displayed on an LCD monitor is stopped from being updated when camera shake compensating device starts to be released from the mechanical holding. The next switching of images and the transfer of an exposed image from the CCD to the SDRAM are prohibited. When the release of the mechanical holding is completed, the next exposed image is transferred from the CCD to the SDARM. Updating is permitted for displaying the image which is transferred to the SDRAM on a display device.

Abstract: A video recorder includes at least one broadcast receiver for receiving broadcast data, a captured image receiver for receiving captured image data captured by the camera device, a storage unit capable of storing the broadcast data received by the broadcast receiver and the captured image data received by the captured image receiver, and an information storage unit for storing, when the storage unit does not store received data though the captured image receiver has received the captured image data, event occurrence information related to such a situation.

Abstract: A digital camera 100 is provided with an optical unit 1, CCD 3, a CCD holder 27 for holding CCD 3, actuator 10 for connecting the CCD holder 27 with the optical unit 1, wherein the actuator changes in shape when a voltage is applied across a front surface and rear surface thereof, and flexible printed circuits 8, 9 for applying voltages to driving members 10a, 10b, 10c and 10d in response to detection of camera shake to move the CCD holder 27 such that an optical axis Z of the optical unit 1 passes through the center of the image capturing plane 300 of CCD 3.

Abstract: An image stabilizing apparatus includes a motion vector calculating part that calculates a motion vector between a plurality of images including a displacement caused by a motion of an image-pickup apparatus, a shake-correction parameter calculating part that receives the motion vector as input to calculate a shake correction amount, and an image transforming part that performs geometric transformation of the image in accordance with the shake correction amount. The shake-correction parameter calculating part performs variation amount calculation, variation amount correction and correction amount calculation based on the motion information between the plurality of images. The image stabilizing apparatus preserves a motion in video from an intended camera work and allows image stabilization for an unintended shake.

Abstract: Systems and methods for providing a substantially de-blurred image of a scene from a motion blurred image of the scene are disclosed. An exemplary system includes a primary detector for sensing the motion blurred image and generating primary image information representing the blurred image, a secondary detector for sensing two or more secondary images of the scene and for generating secondary image information representing the two or more secondary images, and a processor for determining motion information from the secondary image information, estimating a point spread function for the motion blurred image from the motion information, and applying the estimated point spread function to the primary image information to generate information representing the substantially de-blurred image.

Abstract: The present invention relates to a method and system for obtaining a point spread function for deblurring image data captured by an imaging device comprising a motion sensor. First, motion path values indicating the motion of the imaging device during the exposure time are acquired. The motion path values of the imaging device are then projected onto the sensor plane and for each sensor pixel the projected motion path values are integrated over time. Said integrated value represents for each sensor pixel an initial estimate of the point spread function. Optionally, the size of the point spread function can also be estimated based on the distance of the focused object and taken into account during the projecting step.

Abstract: An imaging device includes an imager, with which an optical image of an object scene is repetitively captured. A first movement detector detects, as to each of a plurality of object scene images according to a time series output from the imager, a movement of a first feature point between the object scene image and the object scene images immediately before, and a clipper performs clipping processing on each of the plurality of object scene images on the basis of the detection result.