Abstract: An image processing device is provided. The image processing device includes a determination unit configured to determine a scheme of capturing a pixel value of an imaging element at a time of imaging operation of moving image contents using a feature amount which is obtained from a plurality of regions in a frame which configures the moving image contents; and a correction unit configured to perform a correction of focal plane distortion with respect to the moving image contents based on the determined capturing scheme. An image processing system is also provided.

Abstract: A vision system of a vehicle includes a camera configured to be disposed at a vehicle so as to have a field of view exterior of the vehicle. The camera may include a fisheye lens. An image processor is operable to process image data captured by the camera. The vision system provides enhanced camera calibration using a monoview noncoplanar three dimensional calibration pattern. The system may include a plurality of cameras configured to be disposed at the vehicle so as to have respective fields of view exterior of the vehicle.

Abstract: The invention relates to a method wherein at least one output signal of a movement sensor (105; 505) is taken into account for the potential division of an integrating period (T; T?) of an image sensor (101; 501) into a plurality of sub-periods (Ti; Ti?).

Abstract: The present invention relates to an auto-focus system and method based on a sensor, using hierarchical extraction and motion estimation for an image. The auto-focus method may include the steps of: (a) extracting a phase difference image from a sensed image; (b) extracting a robust feature image which satisfies a preset reference with respect to noise and out-of-focus blur, from the phase difference image; and (C) estimating a motion vector for lens shift from the feature image.

Abstract: An imaging apparatus and an imaging method are provided. The imaging apparatus includes an imager configured to output image data for a subject, a motion detector configured to detect motion of the imaging apparatus, and a controller configured to control the imager to suspend output of the image data in response to the motion detector detecting the motion.

Abstract: There is provided a focus adjustment device including an image sensor including a plurality of phase difference detection pixels that each perform pupil division of a photographing lens, a correction value acquisition unit for acquiring a correction value for a focus position in a spatial frequency of a subject which is obtained by the image sensor, and a focus adjustment unit for adjusting a focus position of the photographing lens based on the correction value acquired by the correction value acquisition unit.

Abstract: In a camera system that includes a lens unit and a camera body, the camera body includes: an image blur detecting unit that detects image blur in a plurality of directions; an image blur correcting unit that performs image blur correction in the plurality of directions; a determining unit that determines whether a mounted lens unit is a lens unit that performs the image blur correction; and an image blur correction control unit that performs control in such a way that, when a determination result of the determining unit is true (Yes), the image blur correcting unit performs the image blur correction only in specific directions from among the plurality of directions, and that performs control in such a way that, when the determination result of the determining unit is false (No), the image blur correcting unit performs the image blur correction in the plurality of directions.

Abstract: A stage apparatus includes a control circuit board, a stationary support member facing the control circuit board, a stage member superposing the stationary support member and provided on the opposite side of the stationary support member to the control circuit board, the stage member being movable relative to the stationary support member in a plane; an electronic component fixed to the stage member; a flexible conductive member, one end thereof connected to the electronic component and the other end thereof connected to the control circuit board; and a driver generating a driving force for moving the stage plate. The stationary support member includes a conductive member escape recess, recessed from a peripheral edge toward a central portion thereof and extending through the stationary support member in the thickness direction. Part of the flexible conductive member is inside the conductive member escape recess.

Abstract: An image processing apparatus includes a lighting unit configured to emit light to an object, a first image capturing unit configured to output a first image signal acquired by photographing the object when light is emitted by the lighting unit, a second image capturing unit configured to output a second image signal acquired by photographing the object when no light is emitted by the lighting unit, and a controller configured to acquire an object image by using a difference image between a first image generated based on the first image signal and a second image generated based on the second image signal.

Abstract: The exemplary embodiment of the present disclosure relates to a camera module including a bobbin, a housing positioned at an outside of the bobbin, an elastic member coupled to the bobbin and the housing, a foreign object exhaust passage concavely formed at an upper surface of the housing, and an opening formed at the housing to open at least a part of the foreign object exhaust passage to an inside of the housing, wherein the foreign object exhaust passage is overlapped on at least a part of the housing-coupled elastic member to a vertical direction, whereby it is easy to wash foreign objects positioned between an elastic member and a housing to reduce an auto focus tilt defects generated after assembly.

Abstract: The present application provides an image processing circuit, a hand-held electronic device and a method for compensating for motion in an image received by an image sensor. The method includes sub-dividing an array of individual sensor cells from an image sensor adapted for receiving an image into at least a first sub-group and a second sub-group of sensor cells. Multiple timing signals are then generated for use in reading data out of the individual sensor cells of the image sensor. Data values are then read out from the individual sensor cells, wherein the data values from the individual sensor cells of the first sub-group of sensor cells are read out at a first rate using a first timing signal, and the data values from the individual sensor cells of the second sub-group of sensor cells are read out at a second rate using a second timing signal.

Abstract: The present disclosure provides a line-of-sight (LOS) processing method, an LOS processing system and a wearable device. The LOS processing method includes steps of: collecting a head deflection angle and an eyeball deflection angle of a user; determining a position of the user's LOS at a display interface in accordance with the head deflection angle and the eyeball deflection angle of the user; acquiring action information of the user's eyeball; identifying an action command corresponding to the action information of the user's eyeball; and performing a corresponding operation on a display image at the position of the user's LOS in accordance with the identified action command.

Abstract: Embodiments that relate to displaying an image via a display device worn on a head of a user are disclosed. In one example embodiment, an image is displayed at an initial registration position with respect to a user's eye. Composite motion data is received from one or more sensors, with the composite motion data comprising a head motion component and a relative motion component which is relative motion between the head and the display device. The composite motion data is filtered to remove the head motion component and yield the relative motion component. Using the relative motion component, the initial registration position of the image is adjusted to an adjusted registration position that compensates for the relative motion component. The image is then displayed at the adjusted registration position.

Abstract: An image pickup system includes an image pickup unit and a confirmation unit that displays a picked-up image transmitted from the image pickup unit, the image pickup unit and the confirmation unit being separable from each other, and the image pickup system is provided with: a first motion determination section that determines a motion of the image pickup unit; and a control section that instructs the image pickup unit to perform continuous shooting based on a determination result by the first motion determination section when the image pickup unit and the confirmation unit are separated from each other, which enables photographing without missing a photo opportunity.

Abstract: Devices, systems, and methods for estimating blur in an image obtain an image, identify pixels in the image that have intensity values that equal or exceed a first intensity threshold in a first color channel, and identify a trajectory based on the pixels in the image that have intensity values that exceed the first intensity threshold in the first color channel. Also, the devices, systems, and methods identify multiple instances of the trajectory in the image, identify an instance of the trajectory that includes pixels that have intensity values that do not equal or exceed a second intensity threshold in a second color channel, and generate a blur kernel based on the intensity values in the second color channel of the pixels in the instance of the trajectory.

Abstract: An image processor includes a correction signal generator configured to generate a correction signal by calculating a difference between an image and an image obtained by applying an unsharp mask generated based on a PSF corresponding to an image-pickup conditions of an image-pickup optical system to the image, and a correction signal applier configured to sharpen the image by multiplying the correction signal generated by the generator by a constant and by adding a multiplied correction signal to the image.

Abstract: The invention relates to a method for encoding, a method for decoding, an apparatus, computer program products, an encoder and a decoder for video information. The motion vector for a block in a video image is predicted from a set of motion vector prediction candidates determined based on previously-coded motion vectors. A motion vector prediction candidate is included in the set based on the location of the block associated with the first spatial motion vector prediction candidate and in comparison with motion vector prediction candidates already in the set.

Abstract: For detecting an obstacle with a camera, a first image is viewed by the camera at a first location during a first time. Points on a surface would project onto first pixels of the first image. A second image is viewed by the camera at a second location during a second time. The points on the surface would project onto second pixels of the second image. Coordinates of the second pixels are identified in response to coordinates of the first pixels, in response to a displacement between the first and second locations, and in response to a distance between the camera and the surface. The obstacle is detected in response to whether the first pixels substantially match the second pixels.

Abstract: A method for stabilizing a first sequence of digital image frames is provided including determining a dominant motion vector of a dominant motion layer of said sequence; determining a first part of the dominant motion vector representative of an intended motion in said sequence; determining a second part of the dominant motion vector representative of an unintended motion in said sequence; and generating a second sequence from the first sequence based on the second part. A corresponding image stabilization unit is provided as well.

Abstract: A camera module including a camera module carrier having a lens actuator attached thereto and at least two conductive carrier traces that are electrically connected to electrical contact points of the lens actuator. The camera module having a lens barrel connected to the camera module carrier, the lens barrel having a first conductive barrel trace and a second conductive barrel trace formed therein, the first conductive barrel trace and the second conductive barrel trace forming an alternating pattern of first contact regions and second contact regions along a top edge of the lens barrel and being electrically connected to respective ones of the at least two conductive carrier traces such that electrical signals can be routed between the camera module carrier and the lens barrel. The camera module further including an electronic device electrically connected to the lens actuator by the camera module carrier and the lens barrel.

Abstract: A method for generating a sharp image based on a blurry image is provided. The method includes acquiring pixel values of pixels in the blurry image, and a convolution kernel of the blurry image, determining a deconvolution kernel of the blurry image based on a preset image gradient operator and the convolution kernel, determining pixel values of pixels in the sharp image based on the deconvolution kernel and the pixel values of the pixels in the blurry image, and generating the sharp image based on the pixel values of the pixels in the sharp image. A deconvolution kernel in the embodiments of the present disclosure is determined based on a gradient operator and a convolution kernel, in other words, the deconvolution kernel introduces the gradient operator as a regularization constraint, which prevents noise from affecting an image recovery process, and improves the quality of a recovered sharp image.

Abstract: An image blur correction apparatus, comprises a blur correction amount calculation unit configured to calculate a blur correction amount based on a shake amount of the apparatus; an estimation calculation unit configured to calculate an estimated value of the blur correction amount using a blur correction amount calculated up until a previous time; a correction unit configured to correct an image blur by cutting out an image using the blur correction amount or the estimated value; and a determination unit configured to determine whether or not to calculate the estimated value in accordance with a frame rate of a moving image.

Abstract: Stereo image reconstruction techniques are described. An image from a root viewpoint is translated to an image from another viewpoint. Homography fitting is used to translate the image between viewpoints. Inverse compositional image alignment is used to determine a homography matrix and determine a pixel in the translated image.

Abstract: An image stabilization apparatus comprises an image stabilization unit configured to move a correction member based on a shake detected by a shake detection unit and stabilize an image blur based on the shake of the apparatus; a zoom unit configured to change a focal length of the imaging optical system; a calculation unit configured to calculate a movement amount of the correction member to reduce at least one of a variation in a light amount and a variation in a resolution; and a control unit configured to control, when changing the focal length, an actual movement amount to follow a target value of a movement position of the correction member by setting a limitation of a variation amount of the movement position per unit time on the movement amount calculated by the calculation unit.

Abstract: When interval capturing by an imaging section is performed, a CPU acquires a blur state at a capture timing from the detection result by an acceleration sensor, and performs pre-processing (camera-shake processing: trimming processing in consideration of a blur) on the captured image corresponding to the blur state. Also, when the blur is larger than a predetermined value, the CPU further performs post-processing (camera-shake processing: trimming processing in consideration of a blur) also on images captured at capture timings preceding to and subsequent to the capture timing for capturing the image based on the blur state (more specifically, processing lighter in load than the pre-processing at the capture timing).

Abstract: Disclosed herein is an image processing apparatus of a vehicle camera, including a light source extraction unit configured to extract light sources from a first frame exposed to light sources during a first time and to extract light sources including motion blurs from a second frame exposed to the light sources during a second time longer than the first time, a target light source classification unit configured to classify a first target light source that belongs to the light sources of the first frame and that does not move and a second target light source that belongs to the light sources of the second frame and that does not move, and a motion determination unit configured to estimate a first location that is the central point of the first target light source and a second location that is the central line including the central point of the second target light source, compare the first location with the second location, and determine whether or not a pitch motion of the vehicle has occurred.

Abstract: An apparatus and method for reducing or preventing image degradation due to shaking of a camera upon image acquisition is provided. The method includes determining illuminance corresponding to a subject, automatically determining a capturing mode of an electronic device based on at least the illuminance, acquiring a first resulting image of the subject based on a first exposure time, if the capturing mode is a first capturing mode, and acquiring a plurality of images of the subject based on a second exposure time, if the capturing mode is a second capturing mode, and generating a second resulting image based on at least two images among the plurality of images.

Abstract: Several methods, devices and systems for correcting rolling shutter artifacts are described. In one embodiment, an image capturing system includes a rolling shutter image sensor that may cause a rolling shutter artifact (e.g., warping). The system includes a processing system that is configured to perform an automatic rolling shutter correction mechanism that utilizes calibration data based on a relationship between pixel locations in an image plane of the image sensor and their corresponding rays of light in a coordinate space. The rolling shutter mechanism determines pixel velocity components based on the calibration data and estimates for each image an aggregate pixel velocity based on an aggregation of the pixel velocity components.

Abstract: An image captured with flash light and an image captured without flash light are each divided into a plurality of regions, and a luminance value is calculated for each region. Based on a ratio of a difference between the luminance value of each region in the image captured with flash light and the luminance value of the corresponding region in the image captured without flash light to the luminance value of the corresponding region in the image captured without flash light, a degree of influence of light representing the influence of light emitted by the light emitting device on the luminance value of each region in the image captured with flash light is calculated. Regions in which the degrees of influence of light are larger than a predetermined threshold are determined as illuminated regions.

Abstract: The invention relates to a method for encoding, a method for decoding, an apparatus, computer program products, an encoder and a decoder for video information. The motion vector for a block in a video image is predicted from a set of motion vector prediction candidates determined based on previously-coded motion vectors. A motion vector prediction candidate is included in the set based on the location of the block associated with the first spatial motion vector prediction candidate and in comparison with motion vector prediction candidates already in the set.

Abstract: An image stabilization apparatus includes an image stabilization unit that compensates image blurring by moving a compensation member, a first shake detection unit that detects an angular velocity of the shake, a second shake detection unit that detects shake by a different method, an orientation detection unit that detects an inclination status of an optical apparatus, a calculation unit that calculates a compensation value from signals of the first and second shake detection units, and an output unit that compensates the output of the first shake detection unit using the compensation value, with the calculation unit performing weighting on the compensation value of a drive axis of an image stabilization mechanism, based on a correlation between the first signal and the second signal.

Abstract: An image processor includes a correction signal generator configured to generate a correction signal by calculating a difference between an image and an image obtained by applying an unsharp mask generated based on a PSF corresponding to an image-pickup conditions of an image-pickup optical system to the image, and a correction signal applier configured to sharpen the image by multiplying the correction signal generated by the generator by a constant and by adding a multiplied correction signal to the image.

Abstract: Methods and systems for processing a video for stabilization are described. A recorded video may be stabilized by removing at least a portion of shake introduced in the video. An original camera path for a camera used to record the video may be determined. A crop window size may be selected, a crop window transform may accordingly be determined, and the crop window transform may be applied to the original video to provide a modified video from a viewpoint of the modified motion camera path.

Abstract: There are provided a device and method that correct a false color occurring in a locally highlighted region in an image. A false color pixel is detected in data conversion processing of generating an RGB array image from an RGBW array image, low-band signals corresponding to respective RGBW colors that are different according to whether a pixel is a false color pixel, and the RGBW array is converted by interpolation processing to which the calculated low-band signals are applied to generate the RGB array image. The interpolation processing is performed using the low-band signals on an assumption that a W low-band signal mW, and RGB respective low-band signals mR, mG, and mB have a proportional relation in a local region. When a pixel of interest is a false color pixel, the low-band signal is calculated by an application of a low-pass filter having a coefficient in which a contribute rate of pixel values in the vicinity of the pixel of interest is made relatively lower than that of separated pixels.

Abstract: An optical unit may include a movable body holding an optical element; a fixed body surrounding the movable body; a plate-shaped spring member with a fixed body side connection part, a movable body side connection part, and an arm part which connects the fixed body side connection part with the movable body side connection part; and a drive mechanism to displace the movable body. The cover may be provided with a side plate part. The fixed body side connection part may include a frame part; and a plurality of protruded parts protruded from the frame part. The protruded parts may be separately provided from each other for every welding portion and an entire tip end side of the protruded part is formed as a melted part by welding.

Abstract: A wide angle lens consists of a front group, a stop, and a positive rear group in order from the object side. A positive lens with a convex surface on the object side and a lens having a negative meniscus shape with a convex surface on the object side are respectively disposed first and second from the object side in the front group. When Abbe number with respect to the d-line and the partial dispersion ratio between the g-line and the F-line of the lens having a negative meniscus shape are taken as ?df and ?gFf respectively, the wide angle lens satisfies a conditional expression (1): 0.038<?gFf ?0.6415+0.001618×?df and a conditional expression (2): ?df<19.

Abstract: Systems and related methods are provided to perform optical characterization of system under tests (SUT), including one or more optical elements (OE), for various purposes including evaluation of optical resolution needed to distinguish image elements, blur, line of sight jitter, and/or pointing stability. Various testing systems and methods are provided including an embodiment having a vibration loading system (VLS), a first acceleration sensor coupled with the VLS, and a mounting structure adapted to receive the SUT. An illumination target system (ITS) emits light that passes through the SUT OE's lens and is captured by the SUT's imaging system. A light control system controls the ITS based on a plurality of activation commands and a Test Control System (TCS). The TCS receives ITS input through the SUT that is synchronized with acceleration sensor data (e.g. phase of VLS position) and analyzed via real-time or post-processing including image distortion analysis.

Abstract: Methods of processing a frame in a video sequence of digital images are provided. The methods include determining a global motion vector for the frame relative to a previous frame in the sequence, deriving a jitter function from the global motion vector, the jitter function including an estimate of undesired motion of the frame relative to the previous frame, and determining whether the frame is blurred above a first predetermined threshold. If the frame is blurred above the first predetermined threshold, stabilizing the frame using the jitter function and applying a deblur function to the frame.

Abstract: A small form-factor gimbal system that provides for stabilization of payload assets in a manner that provides improved stabilization capability. Such a small form-factor gimbal system provides for precision payload asset steering functionality through integration of an inertially stabilized two-axis gimbal in combination with a beam stabilization mechanism (BSM). In a preferred embodiment, such a small form-factor gimbal system has a gimbal diameter of about 5? or less and employs a laser assembly having a Coudé path arrangement in which the laser beam passes from the azimuth subassembly to the elevation subassembly along the elevation subassembly rotational axis.

Abstract: In a method, a first image of a subject is taken from a first viewpoint. The first image of the subject is composed of a first plurality of pixels. A second image of the subject is taken from a second viewpoint. The second image of the subject is composed of a second plurality of pixels. Pixels in the first plurality of pixels in the first image correspond to pixels in the second plurality of pixels in the second image. Corresponding pixels lie on first epipolar lines in the first image and on second epipolar lines in the second image. The first and second images are rectified to make the first and second epipolar lines parallel to one another and to place corresponding pixels in the first and second images on one of a plurality of pairs of common scanlines. For at least one pair of common scanlines, a corresponding pixel is found in the second image for each pixel in the first image such that a visual perception matching cost (VPMC) is minimized.

Abstract: A method of enhancing pictures recorded by a digital imaging device, including, activating the imaging device to record a burst of multiple consecutive digital pictures, recording the pictures of the burst, selecting one of the digital pictures of the burst to serve as a base picture, estimating alignment of each picture to compensate for motion relative to the base picture, enhancing the base picture by combining with details from the other recorded pictures of the burst while compensating for the motion, providing the enhanced picture as output.

Abstract: A method for recognizing a text block in an object is disclosed. The text block includes a set of characters. A plurality of images of the object are captured and received. The object in the received images is then identified by extracting a pattern in one of the object images and comparing the extracted pattern with predetermined patterns. Further, a boundary of the object in each of the object images is detected and verified based on predetermined size information of the identified object. Text blocks in the object images are identified based on predetermined location information of the identified object. Interim sets of characters in the identified text blocks are generated based on format information of the identified object. Based on the interim sets of characters, a set of characters in the text block in the object is determined.

Abstract: An image-pickup apparatus to which a lens unit that includes an image-pickup optical system including a focus lens is attachable includes an image sensor configured to photoelectrically convert an object image formed via the lens unit that has been attached, and to generate an image signal, and a controller configured to generate information on driving of the focus lens in the lens unit based upon the image signal and to provide focus control, the controller communicating data with the lens unit, wherein the controller transmits information on a driving target position of the focus lens to the lens unit in a first control, and transmits information on a driving direction and driving speed of the focus lens to the lens unit in a second control different from the first control.

Abstract: A device for manipulating an emission characteristic of a light-emitting diode includes an optical element configured to be movably arranged between a first position and at least one additional position relative to the light-emitting diode. The optical element is configured to bring about a first light distribution of the light emitted by the light-emitting diode if the optical element is arranged in the first position. The optical element is further configured to bring about a further light distribution of the light emitted by the light-emitting diode if the optical element is arranged in the at least one additional position. The device further includes at least one micromechanical actuator configured to move the optical elements between the first and the at least one additional position in order to manipulate the emission characteristic.

Abstract: An image capture apparatus has an image sensor and an optical anti-shake mechanism that reduces a shake of a captured image by driving an optical correction element in a different direction from an optical axis of an imaging optical system in accordance with a detected shake. Reference coordinates for geometric deformation processing applied to the captured image are determined based on an amount and direction of a movement of the optical correction element. The geometric deformation processing is applied to the captured image using these reference coordinates and an amount of geometric deformation based on the detected shake. Coordinates of the captured image corresponding to an intersection of the optical axis and the image sensor after the optical correction element is moved through the driving are determined as the reference coordinates.

Abstract: An image capturing apparatus having an image sensor including focus detection pixels capable of outputting a pair of image signals for focus detection determines whether each line of the pixels of the image sensor is an addition/non-addition line that outputs the image signal suitable/unsuitable for detection of a correlation amount, obtains the correlation amount for each addition line based on the pair of image signals, add the obtained correlation amount of the addition line, counts the number of addition lines, obtains a defocus amount based on the added correlation amount, and drives a focus lens based on the defocus amount when a product of an evaluation value representing reliability of the defocus amount and a predetermined standard number of additions is smaller than the product of the number of addition lines and a standard evaluation value representing a predetermined evaluation value.

Abstract: A method of enhancing pictures recorded by a digital imaging device, including, activating the imaging device to record a burst of multiple consecutive digital pictures, recording the pictures of the burst, selecting one of the digital pictures of the burst to serve as a base picture, estimating alignment of each picture to compensate for motion relative to the base picture, enhancing the base picture by combining with details from the other recorded pictures of the burst while compensating for the motion, providing the enhanced picture as output.

Abstract: A first image frame is gathered. The first image frame, a first white balance value, and a first exposure value are stored. Information is sensed from an inertial sensor. A second image frame and intermediate image frames are gathered. A distance traversed by a camera is determined. In response to one or more of: the distance exceeding a predetermined threshold, or a new white balance value significantly differing from a previous white balance value, or a new exposure value significantly differing from a previous exposure value, a second white balance value and a second exposure value are determined for the second image frame. A smoothed white balance value and a smoothed exposure value are determined for the intermediate image frames.

Abstract: Techniques are disclosed for selectively capturing, retaining, and combining multiple sub-exposure images or brackets to yield a final image having diminished motion-induced blur and good noise characteristics. More specifically, after or during the capture of N brackets, the M best may be identified for combining into a single output image, (N>M). As used here, the term “best” means those brackets that exhibit the least amount of relative motion with respect to one another—with one caveat: integer pixel shifts may be preferred over sub-pixel shifts.

Abstract: In embodiments, a camera device includes HDR monochromatic image sensors that capture an image as an HDR clear image in monochrome, and the camera device includes HDR color image sensors that capture the image as a Bayer image. The HDR monochromatic image sensors may be implemented as interlaced pixel lines having alternating higher exposure times and lower exposure times, or may be implemented as a checkerboard pixel pattern with white pixels of the checkerboard pixel pattern having an exposure duration and black pixels of the checkerboard pixel pattern having a different exposure duration. The camera device implements image processing algorithms that demosaic the Bayer image to generate an initial color image, and demosaic the HDR clear image to generate a clear image. An image fusion application then produces an enhanced, high-resolution HDR color image based on the initial color image and the clear image.