Abstract: The present invention relates to a method for use in the concurrent display of medical images from different imaging modalities. A system and a computer program product for use in relation to the method are also disclosed. In the method, a primary image and a secondary image from a different imaging modality are fused. In the fused image, a first pixel group from the primary image having primary image data values within a first range are mapped to grayscale image values. A second pixel group from the primary image having primary image data values within at least a second range are identified, and the secondary image data values of corresponding pixels in the secondary image are mapped to color image values in the fused image.

Abstract: An image sensor provides a first image with a first exposure and a second image with a second exposure. An exposure controller sets the first exposure in dependence on pixel intensities of at least one of the images. It sets the second exposure in dependence on a factor and the first exposure. The factor is determined in dependence on pixel intensities of at least one of the images.

Abstract: An image capturing apparatus includes: an image sensor; a focus adjusting unit configured to adjust a focus state of the subject image; an acquisition unit configured to acquire luminance signals of colors from signals obtained from a plurality of unit focus detection areas; a normalization unit configured to normalize the acquired luminance signals of the colors of the unit focus detection areas; a calculation unit configured to calculate normalized focus evaluation values of the colors that indicate a focus state of the subject image; and a determination unit configured to determine a driving direction of the focus adjusting unit based on magnitude relations of a first normalized focus evaluation value that corresponds to a first color and a second normalized focus evaluation value that corresponds to a second color.

Abstract: If it is determined that an imaging optical system is not in an in-focus state, an interval for obtaining a phase-difference signal is set to a second time interval that is faster than a first time interval when a defocus amount that is obtained using the phase-difference signal that is output from an image sensor is a predetermined threshold or more, and the interval for obtaining a phase-difference signal is set to the first time interval when the defocus amount is less than the predetermined threshold.

Abstract: An image processor, a lighting processor, and a method therefore are provided. According to one aspect of the invention, the lighting processor can extract information related to defuse lighting applied to a real object using a colored image and a depth image of the real object. The lighting processor can recover the diffuse image for the real object using the extracted information related to diffuse lighting, and generate either a speculum image or a shadow image using the recovered diffuse image and the colored image.

Abstract: A solid-state image sensor is provided. The sensor includes a substrate having a light-receiving surface. The substrate includes a charge accumulation portion that forms part of a photoelectric conversion element, a charge holding portion arranged at a position deeper than the charge accumulation portion from the light-receiving surface, and a first transfer portion configured to transfer charges generated by the photoelectric conversion element to the charge holding portion along a depth direction of the substrate. A distance between the charge holding portion and the light-receiving surface is not less than 4 ?m.

Abstract: An image sensor comprising: an image sensing matrix, comprising at least one image sensing unit, for generating at least one image sensing signal according to a sensed image; an analog to digital converter, for converting the image sensing signal to a digital image sensing signal; an adjusting unit, for adjusting the digital image sensing signal to be an adjusted digital image sensing signal according to at least one adjusting parameter and the digital image sensing signal; an operational circuit, for computing at least part of brightness of the sensed image sensed by the image sensing unit according to the adjusted digital image sensing signal to generate at least one operational brightness signal; and a control unit, for adjusting the adjusting parameter, such that brightness information generated based on brightness values, which corresponds to the operational brightness signal, falls in a predetermined range.

Abstract: An image processing apparatus includes: a use-image selector configured to generate use-image selection information for selecting one image, from a plurality of images of a subject which are captured for a plurality of exposure time periods, to be used for each region of a synthesized image; an average processor configured to acquire averaged use-image selection information by averaging previous use-image selection information and current use-image selection information; and a synthesizer configured to generate the synthesized image by synthesizing at least two images, among the plurality of images, to constitute the each region according to the averaged use-image selection information.

Abstract: A method adjusts an auto exposure target in an auto-exposure operation on a sequence of images, such as a sequence of infrared images. The method comprises: obtaining a histogram of at least one of the images; applying a weighted histogram table to the histogram to obtain weighted histogram bins wherein at least some bins in the histogram containing saturated pixels are assigned a higher weighting value and at least some bins in the histogram containing unsaturated pixels are assigned a lower weighting value, and summing the weighted histogram bins to obtain a saturation score and decreasing an auto exposure target for an auto exposure operation when the saturation score exceeds a first threshold value, and increasing the auto-exposure target when the saturation score is below the first threshold value and the image is underexposed.

Abstract: Methods and apparatus to generate wide dynamic range images are disclosed. An example apparatus includes a first processing block having first input, second input to receive input data from an image sensor, and first output; a second processing block having third input, fourth input to receive input data from the image sensor, and second output, at least one of the first and second outputs to output a WDR image based on at least two of the first, second, third and fourth inputs; an architecture recognizer having fifth input and third output, the third output to convey an architecture type of the image sensor; a function selector having fourth output to identify at least one of the first and second processing blocks based on the third output; and a sensor adapter having seventh input coupled to the fourth output and having fifth output coupled to the first and third inputs.

Abstract: A drive-mode oscillator module generates at least one proof-mass drive signal for use within a micro-electro-mechanical system (MEMS) device. The drive-mode oscillator module comprises at least one gain control component arranged to receive at least one proof-mass motion measurement signal, and to generate a digital modulation control signal based at least partly on the at least one proof-mass motion measurement signal, and at least one modulation component arranged to receive the digital amplitude modulation control signal, and to output at least one proof-mass drive signal. The at least one modulation component is arranged to digitally modulate the at least one proof-mass drive signal based at least partly on the received digital amplitude modulation control signal.

Abstract: In a method to generate a tone-mapped image from a high-dynamic range image (HDR), an input HDR image is converted into a logarithmic domain and a global tone-mapping operator generates a high-resolution gray scale ratio image from the input HDR image. Based at least in part on the high-resolution gray scale ratio image, at least two different gray scale ratio images are generated and are merged together to generate a local multiscale gray scale ratio image that represents a weighted combination of the at least two different gray scale ratio images, each being of a different spatial resolution level. An output tone-mapped image is generated based on the high-resolution gray scale image and the local multiscale gray scale ratio image.

Abstract: An imaging device is provided with the following: a trial shading-correction unit that performs trial shading correction on image data for each of a plurality of types of light source on the basis of correction information stored in a correction-information storage unit for each light-source type; a correction-information selection unit (whereby the results of the shading correction performed by the trial shading-correction unit for each light-source type are compared to each other and correction information corresponding to an appropriate shading-correction result is selected from among the correction information stored by the correction-information storage unit per light-source type; and a shading correction unit that performs color-shading correction on the image data on the basis of the correction information selected by the correction-information selection unit.

Abstract: An electronic camera is capable of recording image, voice, text, line-drawn information and the like. A release switch in the electronic camera is operated to photograph a subject image. When recording voice with the electronic camera, shutter sound effects are not output with the recorded voice. Further, the photographic operation can be indicated to the user by lighting a light-emitting diode in a finder when the release switch is operated.

Abstract: Systems capable of acquiring polarimetry data using a single camera with or without a polarizing filter. When a polarizing filter is used, the data acquisition method comprises: (1) maneuvering the aircraft (or other vehicle) to orient the polarizing filter (and camera) in various directions when images are captured, (2) registering the various images to each other, and (3) computing polarimetry values (such as the Stokes parameters) for points of interest in the images. When a polarizing filter is not used, the data acquisition method comprises maneuvering the aircraft (or other vehicle) to orient the camera in various directions when images are captured and then performing the same operations (2) and (3). These methods measure the amount of polarization in a given scene by taking multiple camera images at different angles.

Abstract: An image pickup apparatus includes an image pickup element including a plurality of focus detection pixels configured to generate a pair of image signals based on light beams passing through pupil regions different from each other in an image pickup optical system, a detection unit configured to detect a base line length of the plurality of focus detection pixels and a pupil division direction based on position information of a focus detection region in the image pickup element and information relating to the image pickup optical system, and a calculation unit configured to calculate a phase difference in the pupil division direction by using the pair of image signals.

Abstract: A method for controlling exposure of a camera is disclosed. The method comprises calculating a darkness level and a saturation level with respect to a first image in a video sequence. If the saturation level exceeds a first limit, a target value for a mean intensity value of pixels in images captured by the camera is decreased by an amount which is an increasing function of the darkness level. The decreased target value is used to control the exposure of the camera for images subsequent to the first image in the video sequence, such that the mean intensity value of pixels in the subsequent images approaches the decreased target value.

Abstract: An image recording device capable of obtaining a moving image with less noise even in a low illuminance environment when obtaining a moving image having a wide dynamic range. An image pickup device picks up an image of an object over different exposure time periods to output a plurality of image signals. The plurality of image signals output from the image pickup device are synthesized to thereby obtain a synthesized image. The synthesized image is recorded in a memory at a predetermined frame rate. Respective vertical transfer periods for reading out the plurality of image signals are differentiated according to the different exposure time periods, and the sum of the vertical transfer periods is controlled to a time period defined by the predetermined frame rate.

Abstract: An apparatus and a method are provided, which realize image pickup processing in which setting of an exposure time is performed in units of regions in an image pickup apparatus. An electronic shutter control unit that controls an exposure start time of an image pickup device by an electronic shutter operation and a mechanical shutter control unit that controls an exposure end time of the image pickup device by a mechanical shutter operation. The electronic shutter control unit calculates the exposure start time in units of image regions based on an exposure time individually set in units of image regions, and an operation time of the mechanical shutter in units of image regions, and controls the electronic shutter to operate at the calculated exposure start time in units of image regions.

Abstract: An imaging apparatus includes: an imaging device configured to convert light into an electric signal and to output the electric signal; an exposure control section configured to variably control an exposure period of the imaging device with use of an electronic shutter; and a flicker detection section configured to detect a flicker based on variation in an output signal from the imaging device when speed of the electronic shutter is varied from relatively-high speed to relatively-low speed.

Abstract: An image capture apparatus includes an image data acquisition unit which acquires image data, a photometry unit which performs photometry using the image data, an exposure control unit which performs exposure control when the image data acquisition unit acquires image data, a gain control unit which performs gain control for the image data, a display unit which displays a captured image reflecting the exposure compensation value set by a setting unit, and a control unit which controls to, when the exposure compensation value falls within a predetermined range, reflect the exposure compensation value on the exposure control by the exposure control unit, and when the exposure compensation value falls outside the predetermined range, reflect the exposure compensation value on the exposure control by the exposure control unit and the gain control by the gain control unit.

Abstract: Provided is a fundus image acquiring apparatus in which eyeball tracking can be performed by template matching even if sufficient luminance of a characteristic image of blood vessels or the like is not secured in a case where eye movement is detected accurately from a fundus image. The fundus image acquiring apparatus includes a fundus imaging unit for obtaining a fundus image, an extraction unit for extracting a characteristic image from an initial fundus image taken by the fundus image acquiring apparatus, an evaluation unit for evaluating luminance information of a characteristic point obtained through the extraction, and a setting unit for setting a frame rate for imaging by the fundus image acquiring apparatus. The frame rate is determined based on a result of the evaluation by the evaluation unit.

Abstract: There is provided a server including a database configured to store position information and priority of a landmark, a reception unit configured to receive, from a client terminal, position information of the client terminal, and a transmission unit configured to transmit, to the client terminal, the position information of the landmark corresponding to the position information received by the reception unit, and the priority of the landmark. The reception unit receives position information of a subject captured by the client terminal. Based on the position information of the subject received by the reception unit, the server further includes a control unit configured to perform control in a manner that the priority of the landmark stored in the database is updated.

Abstract: A ramp signal generating circuit and ramp signal generator, an array substrate and a display apparatus.

Abstract: In a method to generate a tone-mapped image from a high-dynamic range image (HDR), an input HDR image is converted into a logarithmic domain and a global tone-mapping operator generates a high-resolution gray scale ratio image from the input HDR image. Based at least in part on the high-resolution gray scale ratio image, at least two different gray scale ratio images are generated and are merged together to generate a local multiscale gray scale ratio image that represents a weighted combination of the at least two different gray scale ratio images, each being of a different spatial resolution level. An output tone-mapped image is generated based on the high-resolution gray scale image and the local multiscale gray scale ratio image.

Abstract: To improve the speed of AD conversion. An amplifier amplifies, by a magnification larger than 1, signals of a pixel that outputs a signal in which there is no accumulation of a charge by a photon as a reset signal, and outputs a signal in which there is accumulation of a charge by a photon as an accumulation signal. A calculation unit generates an offset amount signal corresponding to an amount of own offset component using the amplified signal, and calculates a digital value corresponding to the own offset component using the generated offset amount signal and accuracy set for AD conversion of the amplified accumulated signal.

Abstract: A photographing apparatus according to the present invention comprises: an accumulation control section controlling an accumulation operation in an imaging section; an accumulation start timing setting section setting a timing of accumulation start in the imaging section; and a flash light emission control section controlling the start and stop of light emission in the flash light emission section, wherein the accumulation control section instructs the flash light emission control section to start the flash light emission and causes the imaging section to start the accumulation based on an output of the accumulation start timing setting section, and the flash light emission control section causes the flash light emission to be started in response to the flash light emission start instruction of the accumulation control section and causes the flash light emission section to stop the light emission based on an appropriate light emission amount output by an exposure calculation section.

Abstract: There is provided an image processing apparatus including an image information combining unit that performs a pixel value combining process on a long-time exposure pixel and a short-time exposure pixel. The pixel information combining unit calculates a plurality of blending ratios based on pixel values of a plurality of pixels of different periods of exposure time, determines an applied blending ratio, which is applied to a blending process for the long-time exposure pixel and the short-time exposure pixel, based on the plurality of blending ratios, and determines pixel values of an output image or an intermediate image which is applied to produce the output image, by the blending process for the long-time exposure pixel and the short-time exposure pixel to which the applied blending ratio is applied.

Abstract: Disclosed is a portable device adapted to enable its user to manually adjust the focus and photometry locations during photography and a method for taking images with the device. A GUI for indicating the focus or photometry location is provided on the screen so that the user can manually move the GUI on the screen with a keypad or a touch panel. In this manner, a desired object is taken at the focus or photometry location.

Abstract: Provided are an image processing program and an image processing apparatus that support imaging setting in an imaging apparatus. In a focus value display window, temporal change of a focus value (index value) in an input image is outputted. A user operates the imaging apparatus with reference to graph display in the focus value display window to adjust the focus. The focus value displayed in the focus value display window indicates a relatively high value in a “focused” state to a subject such as a work. In the focus value display window, a maximum focus value indicating bar is displayed in association with a focus value indication. The user adjusts the focus state in the imaging apparatus so that the focus value indication “approaches” or “exceeds” this maximum focus value indicating bar as much as possible.

Abstract: The invention provides an ambient light sensing device and an ambient light sensing method. The ambient light sensing device includes at least one pixel, a read out circuit, and a combination unit. The invention detects ambient light to obtain plural lower resolution exposure values corresponding to different dynamic ranges respectively, and combines the plural lower resolution exposure values to generate a higher resolution code combination, indicating the result of ambient light detection.

Abstract: A transformed image, that is transformed by making a position of an image of a same subject correspond to a reference image, is generated for a non-reference image, and noise reduction is carried out on the reference image so as to generate a noise reduced image, and a weighting coefficient of the reference image with respect to the transformed image is set, and combining processing of the reference image and the transformed image is carried out so as to generate an intermediate composite image, and a weighting coefficient of the noise reduced image with respect to the intermediate composite image is set and combining processing of the intermediate composite image and the noise reduced image is carried out so as to generate a final image.

Abstract: A commodity recognition apparatus comprises an image capturing unit for capturing image of a commodity in an image capturing area, a first unit for illuminating a first illumination area closer to the image capturing unit within the image capturing area according to an exposure period of the image capturing unit, a second unit for illuminating a second illumination area including part of the first illumination area and an area further than the first illumination area from the image capturing unit within the image capturing area for an illumination period according to the exposure period, and a control module for controlling, if overexposure of the image is detected, an execution timing of the second unit so that a shifting amount of the illumination period of the second unit to an exposure period next to the exposure period in which the overexposure is detected is different from a predetermined reference value.

Abstract: In one embodiment, a method includes receiving information indicative of an amount of light present for capturing an image frame of a video clip, and, based on the amount of light present, determining a candidate exposure time for the image frame. The method also includes determining a maximum exposure time for the image frame. If the candidate exposure time is less than or substantially equal to the maximum exposure time, the method includes capturing the image frame with approximately the candidate exposure time. If the candidate exposure time is greater than the maximum exposure time, the method includes capturing the image frame with approximately the maximum exposure time.

Abstract: An imaging apparatus is equipped with an analog block, an imaging condition determination section, and an analog gain control section. Current consumption of the analog block changes in accordance with an analog gain, which is an amplification ratio of outputs of an imaging device. The imaging condition determination section determines imaging conditions, including the analog gain, in accordance with the brightness of an imaging object. Depending on a state of the imaging apparatus, the analog gain control section alters the analog gain determined by the imaging condition determination section so as to reduce the current consumption of the analog block. Thus, in this imaging apparatus, the current consumption of the analog block may be reduced by the performance of control that alters the analog gain in accordance with the state of the imaging apparatus. Thus, the state of the imaging apparatus may be regulated.

Abstract: A method for reading a pixel, including at least two integration periods, at least one of said periods including at least one integration sub-period, wherein an output value of the pixel is determined by taking into account the amounts of photogenerated charges contained in the pixel at the end of each of said periods and the amount of photogenerated charges stored in a photodiode of the pixel beyond a threshold during said at least one sub-period.

Abstract: A dual pixel-size color image sensor, including an imaging surface, for imaging of incident light, and a plurality of color pixels, each color pixel including (a) four large photosites, including two large first-color photosites sensitive to a first color of the incident light, and (b) four small photosites including two small first-color photosites sensitive to the first color of the incident light. The large and small first-color photosites are arranged such that connected regions of the imaging surface, not associated with large and/or small first-color photosites, are not continuous straight lines. A method for manufacturing a color filter array on an imaging surface of a dual pixel-size image sensor includes forming a first-color coating on first portions of the imaging surface to form large and small first-color photosites sensitive to a first color, wherein connected portions of the imaging surface, different from the first portions, are not continuous straight lines.

Abstract: A pixel array comprises at least one long exposure pixel, short exposure pixel, and a control circuit. The long exposure pixel comprises a first photodiode to generate charges, a first image signal generating module for generating a first image sensing signal; and a first transfer switch device for passing the charges to the first image signal generating module via a first transfer control signal. The control circuit sets the first transfer control signal to be a first predetermined control voltage when the long exposure pixel is in an long exposure phase, and then sets the first transfer control signal to be a second predetermined control voltage when the short exposure pixel is in a short exposure phase.

Abstract: A backside illumination image sensor is provided. The backside illumination image sensor includes a plurality of different types of pixels, each pixel including a photodiode configured to accumulate photogenerated charges corresponding to light incident on a backside of a semiconductor substrate and a transfer transistor configured to transfer the photogenerated charges to a floating diffusion node; and a plurality of transfer lines disposed at a front side of the semiconductor substrate, the plurality of transfer lines connected to a gate of the transfer transistor of a respective one of the pixels, wherein transfer control signals respectively transmitted through the transfer lines produce different effective integration times in the pixels.

Abstract: The present invention discloses a method of filming a high dynamic range video. The method includes: using an image sensor to capture an original frame which is interlaced by a plurality of long exposure areas and a plurality of short exposure areas; forming a long exposure field via a plurality of long exposure areas and forming a short exposure field via a plurality of short exposure areas; forming a reconstructed long exposure field and a reconstructed short exposure field having the same resolution as the original frame via a reconstruction process by a pixel value of each pixel in the long exposure field and the short exposure field; and forming a high dynamic range image based on the pixel value of each pixel of the reconstructed long exposure field and the reconstructed short exposure field via a merging process.

Abstract: A ghost detection method for high-dynamic range (HDR) image creation using multi-level median threshold bitmapping. At each of multiple levels, median threshold bitmaps (MTBs) are generated for each original low-dynamic range image. At each level, the MTBs of the multiple original images are compared to generate a ghost map for each original image which indicates the locations of ghost pixels in the original image. For each original image, the ghost maps generated at the multiple levels are combined to generate a combined ghost map. The multiple combined ghost maps can then be used in creating the HDR image, for example, by discarding pixels in an original image that are indicated by the corresponding combined ghost map as being a ghost pixel.

Abstract: By utilizing scene metrics in an image processing system (such as night vision goggles or a camera), a setpoint controller can set a setpoint used by a gain controller. Using the setpoint and an average video level of a frame, the gain controller can set gain control signals sent to an image sensor and/or a high voltage power supply to adaptively adjust for higher and lower light scenarios. Scene metrics can include an amount of saturation in a frame, a number or percentage of pixels above a first threshold and a number or percentage of pixels below a second threshold.

Abstract: An image capturing apparatus is provided. A synchronizing signal generation unit generates a short-term vertical synchronizing signal VDS and a long-term vertical synchronizing signal VDL, one cycle of which is equal to N cycles of VDS. An exposure control unit performs short-term exposure and long-term exposure for the predetermined number of lines of an image sensor according to VDS and VDL. The exposure control unit starts a read operation of pixel signals for a long-term exposure line in synchronism with VDL, and starts a read operation of pixel signals for a short-term exposure line in synchronism with VDS, which does not overlap a read period Fr_L Readout of pixel signals of a long-term exposure line.

Abstract: The present disclosure illustrates a camera array correction method. The method comprises steps of calculating the gain values between the images captured by cameras with the pre-measured characteristic of each of the cameras. By such correction method, the different cameras in the camera array can capture images of the same brightness values and color values simultaneously. In addition, the huge computation requirement due to the increasing of the cameras can be reduced effectively.

Abstract: The inventive concept relates to a CMOS image sensor and an operating method of the CMOS image sensor. The operating method according to an embodiment of the inventive concept includes generating photoelectrons at a photo sensor element during a first time; generating photoelectrons at the photo sensor element during a second time shorter than the first time; and sensing the photoelectrons generated at the photo sensor element. A gate voltage of a transfer transistor connected to the photo sensor element is set differently at the first time and the second time. With an embodiment of the inventive concept, a dynamic range of the CMOS image sensor increases.

Abstract: A first plurality of images of a scene may be captured. Each image of the first plurality of images may be captured using a different TET. Based at least on the first plurality of images, a long TET, a short TET, and a TET sequence that includes the long TET and the short TET may be determined. A second plurality of images of the scene may be captured. The images in the second plurality of images may be captured sequentially in an image sequence using a sequence of TETs corresponding to the TET sequence. Based on one or more images in the image sequence, an output image may be constructed.

Abstract: A focus detection apparatus which performs a center-of-gravity adjustment of a pair of image restoration filters for restoring the pair of image signals, on the basis of an image shift amount which is calculated from a pair of image signals of an object which are formed by focus-detecting pixels of an image pickup element having a plurality of focus-detecting pixels for respectively receiving light which passes through different exit pupil areas of a photographing lens; calculates the image restoration filters; generates a pair of restored image signals by restoring the pair of image signals by the calculated pair of image restoration filters; and detects a defocus amount of the photographing lens by using the pair of restored image signals.

Abstract: A lens shading correction (LSC) system includes an illuminant estimator configured to calculate at least one spectral association-measurement of a current frame according to pixel data of an LSC circuit, and then to correlate the at least one calculated spectral association-measurement with spectral association-measurements of a plurality of pre-defined illuminants to determine at least one correlated illuminant. An LSC parameter generator retrieves at least one set of pre-calibrated LSC parameters from a pre-calibrated LSC parameter memory. The LSC parameter generator generates a set of LSC parameters based on the at least one retrieved set of pre-calibrated LSC parameters according to the at least one correlated illuminant.

Abstract: An image capturing device includes: a pre-capturing module which captures an imaging target at each of different focus positions in a predetermined focus range and outputs, as a capturing result, a plurality of pre-captured images lower in resolution than the output image; an object sharpness evaluating module which computes a sharpness level of each of the pre-captured images captured by the pre-capturing module; a focus varying range determining module which determines a focus position varying range within the predetermined focus range based on sharpness levels computed by the object sharpness evaluating module, such that a signal-to-noise ratio of the output image is greater than or equal to a predetermined threshold; and an image capturing module which captures the imaging target while varying the focus position according to the focus position varying range determined by the focus varying range determining module, and outputs the output image as a capturing result.

Abstract: Techniques are described to combine image data from multiple images with different exposures into a relatively high dynamic range image. A first image of a scene may be generated with a first operational mode of an image processing system. A second image of the scene may be generated with a second different operational mode of the image processing system. The first image may be of a first spatial resolution, while the second image may be of a second spatial resolution. For example, the first spatial resolution may be higher than the second spatial resolution. The first image and the second image may be combined into an output image of the scene. The output image may be of a higher dynamic range than either of the first image and the second image and may be of a spatial resolution higher than the second spatial resolution.