Abstract: A CMOS imaging system is capable of self-calibrating to correct for lens shading by use of images captured in the normal environment of use, apart from a production calibration facility.

Abstract: A projector-camera system includes a projector coupled to back project a first image on a translucent diffusing screen. A camera is coupled to capture a second image from a back side of the translucent diffusing screen. The second image includes the first image back projected on the translucent diffusing screen and a shadow of a pointing device cast on a front side of the translucent diffusing screen. The pointing device is on the front side of the translucent diffusing screen and is in close proximity to the translucent diffusing screen. A processing block is coupled to the projector and the camera to generate a third image including the shadow of the pointing device. The processing block is further coupled to activate a command in a main computer coupled to the processing block in response to a relative position of the shadow of the pointing device in the third image.

Abstract: An example method of multi-target automatic exposure and gain control based on pixel intensity distribution includes capturing a series of digital images with an image sensor. As the series of digital images are captured, exposure time and/or gain are adjusted to adjust a mean intensity value of the digital images until a target mean intensity value is reached. The method includes dynamically selecting the target mean intensity value from a plurality of target mean intensity values based on a relative number of pixels, in each captured digital image, that have an intensity value that falls outside a range of intensity values.

Abstract: A method determines a pixel value in a high dynamic range image from two images of different brightness by obtaining corresponding input pixel intensities from the two images, determining combination weights, and calculating the pixel value in the high dynamic range image as a weighted average of the input pixel intensities. Another method determines a pixel value in a high dynamic range image from more than two images by forming pairs of corresponding input pixel intensities, determining relative combination weights for the input pixels intensities for each pair, applying a normalization condition to determine absolute combination weights, and calculating the pixel value in the high dynamic range image as a weighted average of the input pixel intensities. Systems for generating high dynamic range image generation from two or more input images include a processor, a memory, a combination weight module, and a pixel value calculation module.

Abstract: An example method of multi-target automatic exposure and gain control based on pixel intensity distribution includes capturing a series of digital images with an image sensor. As the series of digital images are captured, exposure time and/or gain are adjusted to adjust a mean intensity value of the digital images until a target mean intensity value is reached. The method includes dynamically selecting the target mean intensity value from a plurality of target mean intensity values based on a relative number of pixels, in each captured digital image, that have an intensity value that falls outside a range of intensity values.

Abstract: A method of white balancing an image includes mapping pixels of the image to a color space diagram. Each of the pixels of the image include a red (“R”), a green (“G”), and a blue (“B”) subvalue. A first central tendency of each of the RGB subvalues of pixels mapped in a first pre-defined region of the color space diagram is determined and a second central tendency of each of the RGB subvalues of pixels mapped in a second pre-defined region of the color space diagram is determined. The first pre-defined region is associated with a first illuminating source and the second pre-defined region is associated with a second illuminating source. RGB values of a white pixel are generated based on the first and second central tendencies.

Abstract: A method for generating a control signal to control an information technology device includes the following steps: (1) capturing, using an image sensor, a current control image of a light source of a remote controller positioned within a field of view of the image sensor; (2) identifying, within the current control image, a current location of light emitted from the light source; (3) determining movement between (a) the current location of the light emitted from the light source and (b) a previous location of the light emitted from the light source determined from a previously captured image; (4) generating a movement control signal based upon the movement; and (5) sending the movement control signal to the information technology device. The method is executed, for example, by a movement control module of an information technology device input system.

Abstract: A method and apparatus for correcting for vignetting include associating each pixel in the two-dimensional array with a pair of polar coordinates referenced to a preselected origin pixel and partitioning the two-dimensional array of image pixels into a plurality of sectors. For each sector, the method includes computing an average R value, an average G value and an average B value; converting the average R value, the average G value and the average B value for each sector to logarithm space; comparing color gradients along a radial sector line to a gradient threshold; selecting gradients that do not exceed the threshold; using the selected gradients, estimating parameters of a model of a lens which produced the image; and, using the parameters, updating the model of the lens and correcting the image.

Abstract: An image sensor apparatus is disclosed. The image sensor apparatus includes an image sensor for generating image data corresponding to an optical image. The image sensor apparatus also includes a color filter customized for a lens distortion model. A processor processes the image data with a plurality of distortion correction routines to generate a digital image.

Abstract: An apparatus and method for correcting for distortion in distorted digital data for a distorted image to produce corrected digital data for a corrected image partitions the distorted digital data into a plurality of distorted data blocks. Each distorted data block is separately encoded into an encoded distorted data block. A plurality of corrected regions of the corrected image is defined, each corrected region being associated with a respective corrected data block. For each corrected data block, a plurality of associated encoded distorted data blocks is identified, the plurality of associated encoded distorted data blocks is decoded into a respective plurality of associated decoded distorted data blocks, and corrected image data for the corrected data block are generated using the associated decoded distorted data blocks.

Abstract: A mobile computing device includes a first video camera on a first side of the mobile computing device producing a first camera video stream. A second video camera is on a second side of the mobile computing device producing a second camera video stream. A video processor is coupled to the first video camera and the second video camera to receive the first camera video stream and the second camera video stream, respectively. The video processor is coupled to merge the first camera video stream and the second camera video stream to generate a merged video stream. The video processor includes a network interface coupled to upload the merged video stream to a server in real-time using an Internet wireless network. The server broadcasts the merged video stream to a plurality of receivers in real-time.

Abstract: A mobile computing device includes first, second and third cameras coupled to produce first, second and third camera video streams, respectively. The first camera is on a first side of the mobile computing device, and the second and third cameras are included in a stereo camera on a second side of the mobile computing device. A video processor is coupled to generate an output video stream including a first video layer generated from the first camera video stream. The video processor is further coupled to generate the output video stream to include second and third video layers from the second camera video stream in response to the second and the third camera video streams. The video processor is further coupled to overlay the first video layer between the second video layer and the third video layer in the output video stream.

Abstract: An image sensor includes an array of light sensitive elements and a filter array. Each filter element is in optical communication with a respective light sensitive element. The image sensor receives filtered light having a repeating pattern. Light sensitive elements in at least two successive rows alternately receive light having a first color and a second color, and light sensitive elements in common columns of the successive rows alternately receive light having the first color and the second color. Light sensitive elements in at least two additional successive rows alternately receive light having a third and a fourth color, and light sensitive elements in common columns of the additional successive rows alternately receive light having the third color and the fourth color. Output values of pairs of sampled light sensitive elements receiving light of a common color and from successive rows are combined to generate a down-sampled image.

Abstract: Systems and methods resume capture of a base image from an object by a mobile scanner operated by a user. An indication of an overlap area on a base image displayed within a computer display is received. A scan image is received from the mobile scanner positioned on the object at a location corresponding to the overlap area. A match between a segment of the scan image and a corresponding segment of the base image is determined, where the match defines a location and orientation of the mobile scanner relative to the base image. An indication that the scan has resumed is made to the user when the match is found, and images that are subsequently received from the mobile scanner are stitched to the base image based upon the determined location and orientation. The partially formed base image and the scanner image are concurrently displayed to the user.

Abstract: Systems and methods resume capture of a base image from an object by a mobile scanner operated by a user. An indication of an overlap area on a base image displayed within a computer display is received. A scan image is received from the mobile scanner positioned on the object at a location corresponding to the overlap area. A match between a segment of the scan image and a corresponding segment of the base image is determined, where the match defines a location and orientation of the mobile scanner relative to the base image. An indication that the scan has resumed is made to the user when the match is found, and images that are subsequently received from the mobile scanner are stitched to the base image based upon the determined location and orientation. The partially formed base image and the scanner image are concurrently displayed to the user.

Abstract: A system and method for generating an image includes a plurality of imaging units coupled together and a system controller coupled to the plurality of imaging units for providing at least one signal to each of the plurality of imaging units. Each of the imaging units comprises: an image sensing unit for generating an in-situ image, each in-situ image being a portion of the image; an input for receiving the in-situ image; a composition unit for receiving a first composite image and producing a second composite image, the second composite image being a combination of the first composite image and the in-situ image; and an output at which the second composite image is provided.

Abstract: An image sensor includes an array of light sensitive elements and a filter array. Each filter element is in optical communication with a respective light sensitive element. The image sensor receives filtered light having a repeating pattern. Light sensitive elements in at least two successive rows alternately receive light having a first color and a second color, and light sensitive elements in common columns of the successive rows alternately receive light having the first color and the second color. Light sensitive elements in at least two additional successive rows alternately receive light having a third and a fourth color, and light sensitive elements in common columns of the additional successive rows alternately receive light having the third color and the fourth color. Output values of pairs of sampled light sensitive elements receiving light of a common color and from successive rows are combined to generate a down-sampled image.

Abstract: A method and apparatus for correcting for vignetting include associating each pixel in the two-dimensional array with a pair of polar coordinates referenced to a preselected origin pixel and partitioning the two-dimensional array of image pixels into a plurality of sectors. For each sector, the method includes computing an average R value, an average G value and an average B value; converting the average R value, the average G value and the average B value for each sector to logarithm space; comparing color gradients along a radial sector line to a gradient threshold; selecting gradients that do not exceed the threshold; using the selected gradients, estimating parameters of a model of a lens which produced the image; and, using the parameters, updating the model of the lens and correcting the image.

Abstract: An apparatus and method for correcting for distortion in distorted digital data for a distorted image to produce corrected digital data for a corrected image partitions the distorted digital data into a plurality of distorted data blocks. Each distorted data block is separately encoded into an encoded distorted data block. A plurality of corrected regions of the corrected image is defined, each corrected region being associated with a respective corrected data block. For each corrected data block, a plurality of associated encoded distorted data blocks is identified, the plurality of associated encoded distorted data blocks is decoded into a respective plurality of associated decoded distorted data blocks, and corrected image data for the corrected data block are generated using the associated decoded distorted data blocks.

Abstract: A method for combining images includes capturing a first image including a subject from a first camera. A second image is captured from a second camera and the second image includes the subject. First pre-processing functions are applied on the first image to produce a first processed image. The first pre-processing functions include applying a distortion component of a rotation matrix to the first image. The rotation matrix defines a corrected relationship between the first and the second image. Second pre-processing functions are applied on the second image to produces a second processed image. The second pre-processing functions include applying the rotation matrix to the second image. The first processed image and the second processed image are blended in a processing unit to form a composite image.