Abstract: A system for providing stitched video from a first camera and a second camera to an electronic display system includes a processing circuit configured to associate a view a first camera with an approximate location. The processing circuit is further configured to build relationship data between the first camera and a second camera using the approximate location. The processing circuit is further configured to transform video from the first camera relative to video from the second camera, the transformation based on the relationship data. The processing circuit is further configured to use the transformed video to cause the stitched video to be provided to the electronic display system.

Abstract: A method and a system for generating image content. The method and system allow segments of a panoramic scene, to be generated with reduced distortion. The method and system reduce the amount of distortion by mapping pixel data onto a pseudo camera focal plane which is provided substantially perpendicularly to the focal location of the camera that captured the image. A camera arrangement can implement the method and system.

Abstract: An image processing apparatus includes: a first image storing unit that stores a first history image including a first picked-up image forming a picked-up moving image; an image transforming unit that transforms, on the basis of transformation information concerning the first picked-up image and a second picked-up image forming the picked-up moving image located after the first picked-up image on a time axis of the picked-up moving image, the second picked-up image; and an image combining unit that causes a second image storing unit different from the first image storing unit to store the transformed second picked-up image, overwrites the first history image stored in the first image storing unit on the second picked-up image stored in the second image storing unit, and combines the first history image and the second picked-up image.

Abstract: Disclosed are an apparatus and a method for automatic control of multiple cameras capable of supporting an effective camera view angle in a broadcast, a movie, etc. The automatic control apparatus of multiple cameras includes: a first main camera; a first camera driver controlling an operation of the first main camera; a second main camera; a second camera driver controlling an operation of the second main camera; at least one auxiliary camera; at least one third camera driver controlling an operation of the at least one auxiliary camera; and an interoperation processor changing a view angle of the at least one auxiliary camera by controlling the at least one third camera driver in accordance with a view angle changing reference changed by changing the view angle of the first main camera, the second main camera, or the first and second main cameras.

Abstract: For example, samples included in a frame constituted by a 3840×2160/24P,25P,30P/4:4:4,4:2:2,4:2:0/10,12-bit signal are mapped into first to fourth sub-images specified in the HD-SDI format, in units of two adjoining samples. Thus, it is possible to transmit through a transmission constitution for the HD-SDI format. The signal can be converted into serial digital data permitting a bit rate of 10.692 Gbps or the like and transmitted, and the receiving side can accurately reproduce original data.

Abstract: The present invention provides a method of decoding a video signal. The method includes the steps of obtaining view information of a picture from the video signal and generating information for reference picture management using the view information.

Abstract: A digital camera includes a plurality of channels and a processing component operatively coupled to the plurality of channels. Each channel of the plurality of channels includes an optics component and a sensor that includes an array of photo-detectors. The processing component is configured to separately control an integration time of each channel, where a first integration time of a first channel is less than a second integration time of a second channel. The processing component is also configured to combine data from the plurality of channels to generate an image.

Abstract: A system for automatically expanding the zoom capability of a wide-angle video camera using images from multiple camera locations. One preferred embodiment achieves this using images from the wide-angle video camera that are analyzed to identify regions of interest (RoI). Pan-Tilt-Zoom (PTZ) controls are then sent to aim slave cameras toward the RoI. Processing circuitry is then used to replace the RoI from the wide-angle images with the higher-resolution images from one of the slave cameras. In addition, motion-detecting software can be utilized to automatically detect, track, and/or zoom in on moving objects.

Abstract: A sensor array module with wide angle for creating a composite image includes a first image sensor, a second image sensor, a storage unit and a processor. The first image sensor is for capturing a first image. The second image sensor is for capturing a second image and has a relative spatial relationship with respective to the first image sensor. The storage unit stores at least one transformation matrix obtained according to the relative spatial relationship between the first and the second image sensors. The processor combines the first image and the second image by using the transformation matrix to create the composite image. The present invention also provides an image calibration method, an operation method and an application for a sensor array module with wide angle.

Abstract: When photographs are to be combined into a single image, haze correction and/or color balancing may be performed. The photographs may be analyzed and left-clipped in order to darken the photographs and to increase the density of pixels in the low-luminosity region, thereby decreasing the perception of haze. When the photographs are combined into one continuous image, tie points are selected that lie in regions where the photographs overlap. The tie points may be selected based on visual similarity of the photographs in the region around the tie point, using a variety of algorithms. Functions are then chosen to generate saturation and luminosity values that minimize, at the tie points, the cost of using the generated values as opposed to the actual saturation and luminosity values. These functions are then used to generate saturation and luminosity values for the full image.

Abstract: An electronic device includes an image capture module, an image processing module, and a display module. The image capture module includes a first capture unit for capturing a first image and a second capture unit for capturing a second image. The first capture unit is simultaneously enabled with the second capture unit. The second image has an overlapping view with the first image. The image processing module includes an image cropping unit and an image stitching unit. The image cropping unit crops the first image to keep a first section of the first image, and further crops the second image to keep a second section of the second image. The first section is different from the second section. The image stitching unit stitches the first section and the second section into an integrated image. The display module displays the integrated image.

Abstract: A digital photographing apparatus capable of precisely and immediately performing autofocusing on a person being photographed, and a method of controlling the same are provided. The digital photographing apparatus comprises a face detecting unit that detects a face, a body detecting unit that detects a body, which may or may not exclude the face, an autofocus information obtaining unit, and an autofocus object determining unit. The autofocus object determining unit analyzes face autofocus information obtained from the face by the autofocus information obtaining unit and body autofocus information obtained from the body, and then selects the face part and/or the body as an object of autofocusing.

Abstract: An image processing apparatus includes: a straight edge detection section that detects a straight edge of an object in at least one of first and second original images obtained by capturing the identical object from two different viewpoints; a first morphing processing section that performs a first morphing process, which does not include parallelization of the original images, on the original images to generate a first intermediate image seen from a virtual viewpoint between the two viewpoints; a distortion determination section that determines whether or not an edge of the object in the first intermediate image that corresponds to the straight edge detected by the straight edge detection section is distorted; and a second morphing processing section that, if the edge is distorted, performs a second morphing process, which includes parallelization of the original images, on the original images to generate a second intermediate image seen from the virtual viewpoint.

Abstract: The invention enables a verifier to easily confirm that the image data was captured in the multiple exposure mode, and also to easily confirm which area in the image captured in the multiple exposure mode was greatly affected by multiple exposure. An image generating unit generates exposure image data pieces by exposing an image sensor a plurality of times. An image composition unit combines exposure image data pieces to generate a single piece of composite image data. A reference image generating unit generates reference image data composed of data pieces for distinguishing pixel positions at which the exposure amount exceeds a threshold from the other pixel positions. A verification data generating unit generates verification data for determining whether alteration has been made from the composite image data and the reference image data to output a single file.

Abstract: A system for providing stitched video from a first camera and a second camera to an electronic display system includes a processing circuit configured to associate a view a first camera with an approximate location. The processing circuit is further configured to build relationship data between the first camera and a second camera using the approximate location. The processing circuit is further configured to transform video from the first camera relative to video from the second camera, the transformation based on the relationship data. The processing circuit is further configured to use the transformed video to cause the stitched video to be provided to the electronic display system.

Abstract: When picked up images picked up by an image pickup apparatus are accessed, the contents of the picked up images are grasped readily. A dynamic picture storage section 200 stores image data produced by an image pickup section 110. A metadata storage section 210 stores transformation information regarding a first picked up image and a second picked up image. An image memory 180 retains images as history images. An image transformation section 150 transforms the second picked up image based on the transformation information. An image synthesis section 170 synthesizes the transformed second picked up image with the history images to form a synthesized image. An operation acceptance section 160 accepts a designation operation which designates a display magnification of the second picked up image.

Abstract: Systems and methods are provided for detecting an object of object class, such as faces, in an image sensor. In some embodiments, the image sensor can provide a scan sequence that scans a scene over multiple time intervals. The image sensor can scan, in succession, portions of a scene, where each of the portions covers a different amount or location of the scene. This way, the scanned portions can be saved in an image buffer that is sized significantly smaller than an entire frame. In some embodiments, when the image sensor detects the presence of an object of the object class, the image sensor can store positional information (e.g., location and size of the object) in a region of interest buffer. The image sensor can output the positional information to aid an electronic device, such as a camera, perform various functions, such as automatic exposure and color balancing.

Abstract: Assets of raw geo-located imagery can be divided into tiles and coverage masks can be generated for each tile. For each tile, fragments of pixels from coverage masks of neighboring tiles can be extracted and tagged. The fragments can be sorted and stored in a data structure so that fragments having the same tag can be grouped together in the data structure. The fragments can be used to feather the coverage mask of the tile to produce a blend mask. Multi-resolution imagery and mask pyramids can be generated by extracting fragments from tiles and minified (e.g., down-sampled). The minified fragments can be tagged (e.g., by ancestor tile name), sorted and stored in a data structure, so that fragments having like tags can be stored together in the data structure. The fragments can be assembled into fully minified tiles for each level in the pyramid. Input tiles in a first projection are re-projected into a second projection using techniques that minimize distortion in the re-projected imagery.

Abstract: An image pickup apparatus and method is disclosed by which moving pictures of a high frame rate can be displayed. The image pickup apparatus for picking up moving pictures, includes: a distribution section for distributing light incoming through an optical lens to n directions; n image pickup elements for converting the light distributed by the distribution section into signals at time intervals of 1/m second to pick up images; and a control section for controlling timings at which the light is to be converted into the signals by the image pickup elements; the control section controlling the n image pickup elements to convert the light into the signals at timings successively displaced by 1/m×n second to pick up images.

Abstract: A computer peripheral that operates either as a computer mouse or as a scanner. The peripheral includes navigation sensors that generate information on motion of the device and an image array that captures successive image frames of an object being scanned. In a mouse mode, the peripheral periodically transfers readings from the navigation sensors to a computing device so that the computing device can track a position of the device. In a scanner mode, in addition to obtaining navigation information from the navigation sensors, the peripheral also captures image frames as it is moved across the object. Operation of the navigation sensors and image array may be synchronized such that an association between the image data and the navigation information may be generated and maintained as image frames are transferred to the computing device, even if some of the frames are dropped in transmission between the scanner-mouse and a computer.

Abstract: A method for generating an image is provided. The method includes estimating a high resolution image from a plurality of low resolution images and downsampling the estimated high resolution image to obtain estimates of a plurality of low resolution images. The method also includes generating a desired high resolution image based upon comparison of the downsampled low resolution images and the plurality of low resolution images.

Abstract: An image processing apparatus and method relate to an imaging process which is applied to image data captured by an image capturing apparatus such as a multi-eye camera, multi-view camera, and the like. The image processing apparatus and method generates synthetic image data which focused on a curved focus surface by compositing multi-view image data captured from multi-viewpoints.

Abstract: An image capturing apparatus and a control method thereof relate to an image capturing apparatus such as a camera array. The image capturing apparatus comprises a plurality of image capturing units. An image capturing unit to be activated out of a plurality of image capturing units is decided based on the capturing distance of an object included in a captured scene. Electricity is supplied to the image capturing unit decided to be activated.

Abstract: According to one embodiment of the present disclosure, a system for generating a reconstructed image generally includes a carrier substrate, a number of image sensors, and an image processing circuit. The image sensors are mounted on a surface of the carrier substrate. The image processing circuit is coupled to each of the image sensors and operable to receive a raw image from each of a plurality of image sensors and combine the raw image of each of the image sensors into the reconstructed image.

Abstract: The present invention relates to camera arrangements with backlighting detection. The camera arrangements are capable of simultaneously capturing real scene data from various viewpoints. This data may include illumination data impinging the scene. The illumination data may then be utilized to alter the apparent illumination of a second image, either real or virtual, which is to be superimposed over the real scene so that the illumination across the entire superimposed scene is consistent. The camera arrangements may utilize combinations of umbilical cables and light tubes to expand or contract the field of capture. The camera arrangements may also include in-line signal processing of the data output.

Abstract: Systems and methods for transmitting and receiving image data captured by an imager array including a plurality of focal planes are described. One embodiment of the invention includes capturing image data using a plurality of active focal planes in a camera module, where an image is formed on each active focal plane by a separate lens stack, generating lines of image data by interleaving the image data captured by the plurality of active focal planes, and transmitting the lines of image data and the additional data.

Abstract: A multi-channel imaging device is provided. The multi-channel imaging device includes a focal plane array having an array of pixels configured to detect radiation in a predetermined wavelength band. Subsets of the array of pixels are arranged to define a plurality of unit cell image areas. The multi-channel imaging device also includes a lens array having a plurality of lens elements configured to image a scene onto the plurality of unit cell image areas. The lens elements and the unit cell image areas define a plurality of unit cells having at least one lens element and at least one unit cell image area. Each of the plurality of unit cells is configured to create a complete image of the scene. Additionally, a plurality of unit cell filters corresponding to the plurality of unit cells is configured to filter radiation such that each unit cell is dedicated to an image channel is also provided.

Abstract: This invention relates to a case for portable, handheld electronic devices such as those manufactured by Apple Inc., including the iPod touch, iPad and/or the iPhone, which case supplements the functional properties which are not present on a particular model of the portable, handheld electronic devices such as the iPod touch, iPad and/or the iPhone by providing an integrated speaker and/or microphone and/or at least one camera, in addition to providing the usual protective and/or cushioning aspects of an ordinary case.

Abstract: An image processing system includes an illumination unit and an illumination control unit configured to adjust light emitted from the illumination unit so as to illuminate a limited area in a space, the system generates a timing signal for controlling emission/non-emission of light from the illumination unit, captures a first image of an imaging area including the limited area or part of the limited area based on the timing signal, the first image being taken from a position different from the illumination unit when the illumination unit emits light, captures a second image of the imaging area based on the timing signal, the second image being taken from the position when the illumination unit emits no light, and acquires a third image which is a difference image between the first image and the second image.

Abstract: A technique of generating a panoramic image involves acquiring a set of at least two main image frames, as well as corresponding generating and/or acquiring corresponding relatively low-resolution image frames, of overlapping portions of a panoramic scene. A map or other information is stored relating to the generation of a low-res panorama. A main panorama image is formed by joining main image frames based on the map or other information gained in the low-res process.

Abstract: In a motion picture capturing system for generating a virtual viewpoint image by a plurality of cameras, if image-capturing is performed with timing being shifted to improve frame rate performance, estimation accuracy is deteriorated due to an error in corresponding point detection between images or the presence of a moving subject. The image-capturing timing is controlled such that two or more of a plurality of image-capturing units perform simultaneous image-capturing, and motion of the whole of an image-capturing apparatus is estimated from a plurality of images captured by the simultaneous image-capturing. The virtual viewpoint image is synthesized from the images captured by the simultaneous image-capturing by the plurality of image-capturing units and the estimated motion.

Abstract: A camera module includes a plurality of lenses with different focal lengths, a supporting plate, an image sensor, and a processor. The supporting plate defines a plurality of through holes receiving the corresponding lenses. The image sensor includes a sensing area. The sensing area is configured for receiving light through the lenses and the through holes and converting the light into electrical signals. The processor is electrically connected to the image sensor. The processor is configured for processing the electrical signals to form sub-images of a same view of same objects with different depths of field and then combining the sub-images into a final image.

Abstract: An image acquisition system comprises: a single set of focussing optics focussing an incident beam from a scene to be imaged on a first sensor and a second sensor exhibiting identical spectral response curves; followed by separation means separating the irradiance of the beam coming from the focussing optics into first and second predetermined fractions, the separation means orienting the first fraction towards the first sensor and the second fraction towards the second sensor; control means for controlling a first acquisition time of the scene to be imaged by the first sensor to obtain a first image and/or a second acquisition time of the scene to be imaged by the second sensor to obtain a second image; and merging means that merge the first image coming from the first sensor and the second image coming from the second sensor to generate a final image.

Abstract: An information processing apparatus includes a video obtaining unit configured to obtain a plurality of items of video data captured by a plurality of image-capturing devices; a position information obtaining unit configured to obtain position information including an orientation and an angle of view of each of the image-capturing devices; a reproduction position calculation unit configured to calculate a reproduction position of each item of the video data so that a projection direction and an angle of view of the item of the video data matches the orientation and the angle of view of a corresponding one of the image-capturing devices by using the position information; and a reproduction controller configured to reproduce each item of the video data at the corresponding reproduction position.

Abstract: The invention provides an image processing apparatus comprising: an acquisition unit configured to acquire a plurality of captured images captured by an image capturing apparatus; a determination unit configured to determine position information of the image capturing apparatus for each of the plurality of captured images so that an evaluation value becomes smaller; and a connecting unit configured to connect the plurality of captured images projected onto a reconstruction plane using the determined position information of the image capturing apparatus, wherein the determination unit comprises a calculation unit configured to project each of the plurality of captured images onto the reconstruction plane based on the set position information and to calculate, as the evaluation value, an image difference between the projected images in a overlapping region between the projected images.

Abstract: An electronic camera includes an imaging device. The imaging device has an imaging surface capturing an object scene and repeatedly outputs an object scene image. An orientation of the imaging surface is repeatedly changed by a CPU corresponding to a group photograph mode under which a group of a plurality of faces is captured. The CPU detects a face image from the object scene image outputted from the imaging device in association with a changing process of the orientation of the imaging surface. Furthermore, the CPU decides an angle range within which the group of a plurality of faces is contained based on a detection result of the face image. In addition, the CPU combines the plurality of object scene images outputted from the imaging device so as to create a combined image corresponding to the decided angle range. The created combined image is recorded in a recording medium.

Abstract: Embodiments of the invention disclose a system and a method for generating an output video having a first temporal resolution from input videos acquired synchronously of a scene by at least three cameras, wherein each input video has a second temporal resolution, wherein the second temporal resolution is less than the first temporal resolution. The method obtains frames of each input video, wherein the frames are sampled according to a code selected such that an integration time of the corresponding camera is greater than a frame time of the output video. Next, the method combines intensities of pixels of corresponding frames in a linear system; and solves the linear system independently for each corresponding frame to generate the output video.

Abstract: A system for providing stitched video from a first camera and a second camera to an electronic display system includes a processing circuit configured to associate a view a first camera with an approximate location. The processing circuit is further configured to build relationship data between the first camera and a second camera using the approximate location. The processing circuit is further configured to transform video from the first camera relative to video from the second camera, the transformation based on the relationship data. The processing circuit is further configured to use the transformed video to cause the stitched video to be provided to the electronic display system.

Abstract: Assets of raw geo-located imagery can be divided into tiles and coverage masks can be generated for each tile. For each tile, fragments of pixels from coverage masks of neighboring tiles can be extracted and tagged. The fragments can be sorted and stored in a data structure so that fragments having the same tag can be grouped together in the data structure. The fragments can be used to feather the coverage mask of the tile to produce a blend mask. Multi-resolution imagery and mask pyramids can be generated by extracting fragments from tiles and minified (e.g., down-sampled). The minified fragments can be tagged (e.g., by ancestor tile name), sorted and stored in a data structure, so that fragments having like tags can be stored together in the data structure. The fragments can be assembled into fully minified tiles for each level in the pyramid. Input tiles in a first projection are re-projected into a second projection using techniques that minimize distortion in the re-projected imagery.

Abstract: Included are embodiments for reducing undesirable motion in a video. At least one embodiment of a method includes receiving a plurality of video frames that comprise at least one segment of a video, the plurality of video frames being captured by a capture device and determining a maximum undesired movement of the capture device for the plurality of video frames during the at least one segment. Some embodiments include trimming at least a portion of the video frames according to the determined maximum undesired movement such that the undesirable movement in the video is reduced.

Abstract: This invention makes it possible to produce a high quality synthesized panoramic image when it is difficult to highly precisely shift the image pickup direction.

Abstract: A method for combining images in a camera device, includes following steps. The camera device takes a first image. A first inclination angle of the camera device at the time of taking the first image is saved. A view finder of the camera device finds a next view, and compares the current inclination angle of the camera device with the first inclination angle. If the angles are not the same, the view finder inclines to adjust the current inclination angle of the camera device until the angles are the same. The camera device takes a second image. The first image and the second image are combined to generate a new image.

Abstract: An imaging apparatus includes a first and a second imaging unit, a clipping unit, an image processing control unit. The first imaging unit is provided on a front face of an apparatus main body. The second imaging unit is provided on a back face of the apparatus main body. The clipping unit clips image data of the second main subject from the second acquired image data. The image processing control unit combines the first acquired image data with the image data of the second main subject clipped by the clipping unit to meet combining conditions determined by the first image data.

Abstract: A synchronized multiple imager system includes a plurality of imagers having pixels arranged in rows and columns. The pixels generate pixel data responsive to light directed onto the imagers. One or more respective sensors are coupled to the imagers. The sensors sense the pixel data from the columns and output a vertical raster stream representative of the pixel data in the columns, thereby generating a plurality of vertical raster streams. A clock circuit synchronizes the sensors to sense selected columns in the imagers and to output the vertical raster streams from the selected columns. A processor circuit is configured to receive the vertical raster streams from the imagers and to process the vertical raster streams to generate a plurality of stitched raster streams. The processor circuit stitches seam vertical raster streams from adjacent pairs of imagers.

Abstract: An imaging apparatus includes: an imaging section configured to acquire a plurality of images that are consecutively taken in time series by an imaging device; a reference region setting section configured to employ one of the images acquired by the imaging section as a reference image and to set a region of the reference image as reference region, the region having high-frequency components; and an image processing section configured to combine the images including the reference image by positioning the images so as to overlap subject portions in each images, the subject portions being defined in the reference region set by the reference region setting section.

Abstract: An image sensor array for capturing image information for automatic image data processing. The image sensor array includes a multiplicity of identical sensor cells. Each sensor cell respectively comprises at least one image sensor with a dedicated sensor optical system. A frame buffer is configured to store image information from the at least one image sensor. An evaluation unit is configured to process the image information. At least one data interface to a directly adjacent sensor cell. The sensor cells are arranged in at least one row so that a capture region of an image sensor of the directly adjacent sensor cell overlaps. The at least one data interface to the directly adjacent sensor cell is configured to access the image data of the capture region.

Abstract: A method and system for forming a surrounding seamless bird-view image by processing a plurality of surrounding images associated with a carrier captured by different imaging devices is provided in the present invention. During the process, the surrounding images are converted into corresponding bird-images respectively and then an overlapping area corresponding to each two adjacent bird-view images is determined. After that, distances between the pixel in the overlapping area and the boundary of the overlapping area in each adjacent bird-view image is calculated so as to determine a weighting value for each corresponding pixel in each adjacent bird-view image thereby forming an overlapping image, wherein each pixel in the overlapping image is determined according to the weighting value and information of the corresponding pixel in each adjacent image. After determining the overlapping image for each two adjacent bird-view image, it is capable of forming the surrounding seamless bird-view image.

Abstract: A system and method utilizing two image sensors to simultaneously capture images of a FOV (field of view). The image sensors are arranged along the same optical path for viewing the FOV. The FOV is illuminated by an illuminator of a specific frequency band. An image is captured by the first image sensor which has a filter that passes at least a portion of the light of the frequency band of the illuminator. An image is captured by the second image sensor that has a filter to pass a band of frequencies adjacent to, but generally not including the frequency band of the illuminator. The images may be manipulated, for example, to provide enhanced performance and/or compensate for variables in the system. A processor subtracts the images to produce an image that represents light reflected back from the illuminator, excluding ambient light at the frequency of the illuminator.

Abstract: A system constructs an image using virtual lenslets.

Abstract: A method and apparatus for creating and rendering multiple-view images. A camera includes an image sensor to receive images, sampling logic to digitize the images and a processor programmed to combine the images based upon a spatial relationship between the images.