Abstract: Focus detection is to determine whether an image is in focus or not. Focus detection is able to be used for improving camera autofocus performance. Focus detection by using only one feature does not provide enough reliability to distinguish in-focus and slightly out-of-focus images. A focus detection algorithm of combining multiple features used to evaluate sharpness is described herein. A large image data set with in-focus and out-of-focus images is used to develop the focus detector for separating the in-focus images from out-of-focus images. Many features such as iterative blur estimation, FFT linearity, edge percentage, wavelet energy ratio, improved wavelet energy ratio, Chebyshev moment ratio and chromatic aberration features are able to be used to evaluate sharpness and determine big blur images.

Abstract: Focus detection is to determine whether an image is in focus or not. Focus detection is able to be used for improving camera autofocus performance. Focus detection by using only one feature does not provide enough reliability to distinguish in-focus and slightly out-of-focus images. A focus detection algorithm of combining multiple features used to evaluate sharpness is described herein. A large image data set with in-focus and out-of-focus images is used to develop the focus detector for separating the in-focus images from out-of-focus images. Many features such as iterative blur estimation, FFT linearity, edge percentage, wavelet energy ratio, improved wavelet energy ratio, Chebyshev moment ratio and chromatic aberration features are able to be used to evaluate sharpness and determine big blur images.

Abstract: An image processing system and method of operation includes: a source image having source pixels; homogeneous blocks in the source image having a block color; a homogeneous region in the source image formed by merging the homogeneous blocks having the block color within a color threshold; a text background region having text pixels and background pixels in the homogeneous region with the text background region having a texture feature above a texture threshold and a region size above a region size threshold; and a binary text mask representing the text pixels and the background pixels for displaying on a device.

Abstract: A method to position multiple camera using camera ordering is described herein. Based on two known camera positions, a third camera position is able to be determined using acquired information and calculations.

Abstract: Various aspects of a method and system for object tracking are disclosed herein. The method comprises computation of an overlap value between a first bounding box and a second bounding box, associated with an object in an image frame of a video stream. The overlap values are utilized to track the object in the video stream. The first bounding box encompasses at least a partial first portion of an object. The second bounding box encompasses at least a partial second portion of the object. A first score associated with the first bounding box and a second score associated with the second bounding box is computed based on a comparison of the computed overlap value with a pre-defined threshold value. The first bounding box is updated to a new bounding box that at least partially encompasses the object, based on the computed first score and the computed second score.

Abstract: Various aspects of a method and system to track one or more objects in a video stream are disclosed herein. In accordance with an embodiment, the method includes computation of a first confidence score of a first geometrical shape that encompasses at least a portion of an object in a first image frame of the video stream. The first geometrical shape is utilized to track the object in the video stream. The first geometrical shape is split into a plurality of second geometrical shapes. The split of the first geometrical shape is based on a comparison of the computed first confidence score with a pre-defined threshold score.

Abstract: A text recognition system and method of operation thereof including: a storage unit for storing a text unit; and a processing unit, connected to the storage unit, the processing unit including: a communication interface for receiving the text unit, a feature detection module for determining an isolated feature of the text unit, an angle detection module for determining angle features of the text unit, a feature vector module for generating a feature vector for the text unit based on the isolated feature and the angle features, and a text recognition module for determining recognized text using the feature vector for display on a display interface.

Abstract: Automatic scaling of image objects being moved or copied to a target object location is presented. An original image and its depth map are received within which the user selects an original object and a target location for the object to be moved or copied. A center of scaling is found and a base location selected at which depth value is to be obtained at the target location for use in scaling. Target object is then scaled in response to a ratio between original object depth and target object depth. An occlusion check is made, after which non-occluded pixels are pasted to the target location to complete the move/copy which is in proper proportion and accounts for surrounding structures.

Abstract: A system and method of operation of an imaging system includes: a capture module for receiving an input sequence with an image pair, the image pair having a first image and a second image and for determining a first patch from the first image and a second patch from the second image; an iteration module for generating an iteration map from the first patch of the first image and the second patch of the second image; and a position module for generating a final depth map from the iteration map and for determining a focus position from the final depth map.

Abstract: A system for implementing and utilizing a lens array in an electronic device includes a sensor array coupled to the electronic device for capturing image data corresponding to a photographic target. The lens array includes a plurality of lenses that each has a different respective principal focal length to transmit reflected light from the photographic target to the sensor array. The sensor array captures a set of MFP images that each corresponds with a respective one of the lenses in the MFP lens array. The electronic device may further include an image processor that performs one or more digital signal processing procedures on the captured MFP images to thereby generate a rendered final image.

Abstract: The thick lens calibration method enables better calibration of complex camera devices such as devices with thick lens systems. The thick lens calibration method includes a two step process of calibrating using the distance between a second nodal point and an image sensor, and calibrating using the distance between the first and second nodal point.

Abstract: A method to estimate a set of camera locations, in clockwise or counter-clockwise order, according to the videos captured by these cameras is described herein. In some embodiments, the cameras are assumed to be fixed, with no or very mild tilting angles and no rolling angles (the horizon is horizontal in each camera image). The difference of orientation (rolling angle) between each neighboring (closest) camera pair is able to be up to 45 degrees. Each camera is assumed to have overlapped views with at least one other camera. Each camera has one right neighboring camera and one left neighboring camera, except the first and the last cameras which have only one neighboring camera at one side. The locations of the cameras then are able to be expressed as a unique list counter-clockwise. The input videos are assumed to be synchronized in time.

Abstract: A text recognition system and method of operation thereof including: a storage unit for storing a text unit; and a processing unit, connected to the storage unit, the processing unit including: a communication interface for receiving the text unit, a feature detection module for determining an isolated feature of the text unit, an angle detection module for determining angle features of the text unit, a feature vector module for generating a feature vector for the text unit based on the isolated feature and the angle features, and a text recognition module for determining recognized text using the feature vector for display on a display interface.

Abstract: An image processing system and method of operation includes: a source image having source pixels; homogeneous blocks in the source image having a block color; a homogeneous region in the source image formed by merging the homogeneous blocks having the block color within a color threshold; a text background region having text pixels and background pixels in the homogeneous region with the text background region having a texture feature above a texture threshold and a region size above a region size threshold; and a binary text mask representing the text pixels and the background pixels for displaying on a device.

Abstract: Various aspects of a method and a system for image processing are disclosed herein. The method includes processing an input image, which comprises structure information and detail information, using image processing (IP) blocks in an image processing pipeline. One or more of the IP blocks, such as the “lossy” IP blocks, process the input image with at least a partial loss of the detail information. By replacing the “lossy” IP blocks with redesigned image processing (IP) modules, the image processing pipeline reduces or avoids such loss of the detail information. A more efficient implementation of the improved pipeline is realized by using a master IP module when the “lossy” IP blocks are reordered and grouped together in the image processing pipeline. The method is further extended to process 3-D images to reduce or avoid loss of detail information in a 3-D image processing pipeline.

Abstract: Automatic scaling of image objects being moved or copied to a target object location is presented. An original image and its depth map are received within which the user selects an original object and a target location for the object to be moved or copied. A center of scaling is found and a base location selected at which depth value is to be obtained at the target location for use in scaling. Target object is then scaled in response to a ratio between original object depth and target object depth. An occlusion check is made, after which non-occluded pixels are pasted to the target location to complete the move/copy which is in proper proportion and accounts for surrounding structures.

Abstract: A Depth Map (DM) is able to be utilized for many parameter settings involving cameras, camcorders and other devices. Setting parameters on the imaging device includes zoom setting, aperture setting and shutter speed setting.

Abstract: A natural user interface system and method of operation thereof including: a display device having a display screen and a display device camera; a mobile device having a mobile device camera, an optical axis of the mobile device camera positioned at an angle to an optical axis of the display device camera; wherein: the mobile device includes a first device pairing module for pairing the mobile device with the display device; the mobile device camera and the display device camera are for: detecting a user's hand, and determining posture and movement of the user's hand; and the display device includes a motion translation module for translating the posture and movement of the user's hand into a gesture for controlling an element of a user interface on the display screen.

Abstract: Apparatus and methods for estimating defocus direction from a single image obtained, such as in a digital camera apparatus, are presented. To determine defocus direction, point spread function (PSF) differences for the image are evaluated in the frequency domain, with frequency pairs being found having largest difference in their Fourier transform magnitudes, from which a direction estimate feature is extracted, and defocus direction estimated based on relation of estimated feature and statistics derived from camera image tests. The method can be applied for controlling autofocus mechanisms in cameras, or other applications requiring rapid determination of defocus directions, such as from a single image.

Abstract: Apparatus and methods for estimating defocus direction from a single image obtained, such as in a digital camera apparatus, are presented. To determine defocus direction, point spread function (PSF) differences for the image are evaluated in the frequency domain, with frequency pairs being found having largest difference in their Fourier transform magnitudes, from which a direction estimate feature is extracted, and defocus direction estimated based on relation of estimated feature and statistics derived from camera image tests. The method can be applied for controlling autofocus mechanisms in cameras, or other applications requiring rapid determination of defocus directions, such as from a single image.