Abstract: A method of joint denoising and demosaicing using a neural network to generate an output image and to a computing device for implementing the method is provided. The method includes obtaining image data collected by a color filter array (CFA), and jointly performing denoising and demosaicing on the CFA image data using a trained neural network to generate an output image, wherein the neural network has a lightweight U-Net architecture and is trained on a plurality of pairs of training images. One image in each pair of training images is obtained with a lower ISO value than another image in the pair of training images, and is processed by a processing algorithm (image signal processor (ISP)), and the other image in each pair of training images is in a format of CFA image data.

Abstract: Various embodiments of the present technology generally relate to technology for controlling diodes and producing colored light displays. More specifically, some embodiments of the present technology relate to controlling one or more diodes individually capable of producing multiple colors of light and producing various colors of light in said diodes. In some embodiments, a color control software instructs a set of diodes to produce smooth gradients between adjacent colors in a color sequence. In additional embodiments, a color control system instructs the set of diodes to display smooth transitions between color sequences.

Abstract: A trailer assist system for a vehicle includes a camera disposed at a rear portion of a vehicle and having a field of view exterior and at least rearward of the vehicle, the field of view encompassing at least a portion of a trailer coupler of a trailer stationary a distance from the vehicle. The camera captures image data that is representative of at least the trailer coupler of the trailer. An ECU includes an image processor operable to process image data captured by the camera. The ECU, responsive to image processing at the ECU of image data captured by the camera, determines a location of the trailer coupler using a detector model, which is based on an ensemble regression tree algorithm.

Abstract: An image processing apparatus: obtains a captured image captured by the image capturing apparatus after an orientation adjustment is performed by using a first target image generated based on a three-dimensional model of a structure in an image capturing region; determines a correction amount for correcting a difference between an orientation of the image capturing apparatus and a target orientation based on the first target image and the obtained captured image; and corrects the captured image by using the correction amount. The corrected captured image can be used as a second target image for further adjusting the posture of the imaging device.

Abstract: A method of processing image data for an image, the image data including colour data expressed in a first colour space, transforms the colour data to a luminance-normalised colour space, and performs one or more image processing operations on the transformed colour data to generate processed image data.

Abstract: The disclosed method may include (1) receiving an input datum to be processed using a non-linear function to produce an output datum, (2) comparing the input datum to a plurality of indexes of a lookup table, where the indexes designate input endpoints of a plurality of piecewise-linear sections approximating the non-linear functions, and where the lookup table further includes, for each of the indexes (a) a slope of the piecewise-linear section corresponding to the index, and (b) an axis intercept of the piecewise-linear section corresponding to the index (2) selecting, based on comparing the input datum to the plurality of indexes, an index that designates the piecewise-linear section associated with the input datum, and (4) calculating, using the slope and the axis intercept corresponding to the selected index, the output data corresponding to the input datum. Video processing systems employing such a method are also disclosed.

Abstract: An imaging element includes: a pixel portion in which a plurality of pixels are disposed in a two-dimensional matrix; and a color filter including a plurality of filters that have different spectral transmission characteristics from each other in each of a visible region and a near-infrared region and that are disposed on the plurality of pixels, each filter corresponding to each pixel, any one or more of the plurality of filters being configured to transmit light in the near-infrared region, the plurality of filters including a first same-color filter and a second same-color filter which have different transmission wavelength characteristics from each other in a same color wavelength band, have a region with a constant spectral transmittance in each of the visible region and the near-infrared region, and have different spectral transmittances from each other in at least one of the visible region and the near-infrared region.

Abstract: An image processing apparatus obtains a plurality of captured images captured by an image capturing unit under different conditions, performs HDR development of the plurality of captured images to obtain a plurality of HDR images, generates composition information for compositing the plurality of HDR images, using a plurality of images corresponding to the plurality of captured images, the plurality of images being not influenced by or less influenced by tone processing resulting from the HDR development, and composites the plurality of HDR images using the composition information.

Abstract: An image capturing apparatus is provided with an image sensor having phase difference detection pixels for performing focus detection, an exposure control unit for causing at least the phase difference detection pixels to perform a plurality of accumulations whose exposure periods are a second exposure period shorter than a first exposure period which is a target for obtaining a main image by the image sensor, and a prediction unit for predicting an in-focus position of a subject based on signals of at least two phase difference detection pixels obtained by at least two accumulations among the plurality of accumulations whose exposure periods are the second exposure period.

Abstract: An image processing method acquires an image, restores a saturated region in which a pixel in the image has a first reference value based on a first illuminance component of the image, enhances a dark region in which a value of a pixel in the image is less than a second reference value based on the restored saturated region and the first illuminance component, and outputs a dark region-enhanced image.

Abstract: Systems and methods are disclosed for image signal processing. For example, methods may include receiving an image from an image sensor; applying a filter to the image to obtain a low-frequency component image and a high-frequency component image; determining a first enhanced image based on a weighted sum of the low-frequency component image and the high-frequency component image, where the high-frequency component image is weighted more than the low-frequency component image; determining a second enhanced image based on the first enhanced image and a tone mapping; and storing, displaying, or transmitting an output image based on the second enhanced image.

Abstract: A blur correction device includes: an input unit to which a blur quantity in at least either an image-capturing optical system or an image sensor that captures a subject image formed via the image-capturing optical system, is input; and a calculation unit that calculates, based upon the blur quantity, a correction quantity for correcting blur in the subject image, wherein: the calculation unit calculates a second correction quantity different from a first correction quantity for correcting blur in the subject image occurring on an optical axis.

Abstract: The present invention discloses a system and a method for phase contrast microscopy imaging. The system includes a microscope, a light source array, an image acquisition module and a calculation module. The light source array includes a fixture having a through hole and two light source groups arranged around the through hole. The two light source groups emit a first beam and a second beam symmetrically arranged about a optical axis of the microscope to illuminate a specimen. The light beams enter and get scattered in the specimen and are obliquely transmitted through the specimen, and collected by the microscope after passing through the through hole. The image acquisition module acquires a first image corresponding to the first beam and a second image corresponding to the second beam. The calculation module obtains a phase contrast image according to the first and second image.

Abstract: An image processing method includes receiving an image source, and detecting whether the image source is a high dynamic range (HDR) image. If the image source is the HDR image, reading a first image adjustment value, and performing color adjustment to the image source according to the first image adjustment value.

Abstract: A method for identifying a color of an object may include obtaining a target image including the object and identifying in the target image a region of interest (ROI) including the object. The method may also include identifying at least one sub-region of the object from the ROI of the object and determining at least one first characteristic vector respectively corresponding to the at least one sub-region. The method may further include determining a second characteristic vector of the ROI of the object and identifying, based on the at least one first characteristic vector and the second characteristic vector, the color of the object using a color identification model. The method may further include correcting the color of the target image.

Abstract: Disclosed herein is a camera system including, a camera apparatus having, an image sensor, a correction section, a first transmission processing section, and a synchronization processing section, and a video processing apparatus having a second transmission processing section and a conversion section, wherein the video processing apparatus outputs the video data obtained by the conversion by the conversion section.

Abstract: In an embodiment, an image-capture system, includes an image-capture device and computing circuitry. The image-capture device is configured to capture an image of a region of space that includes an object. And the computing circuitry is coupled to the image-capture device and is configured to detect a representation of the object in the image, to determine a representation of a boundary of the detected representation, to provide image information corresponding to the detected representation to an image-analysis system, to receive, from the image-analysis system, an identifier of a category to which the object belongs, and a descriptor of the object, and to generate a representation of a list that includes the identifier and the descriptor.

Abstract: A method, an image processing apparatus, and computer program product for multilevel bilateral noise filtering of digital images are provided. The method includes receiving from an image sensor an image frame including a color mosaic having a color filter array (CFA) pattern, decomposing the image frame into at least one color plane image for each of a plurality of color planes, sequentially and separately reducing noise in the at least one color plane image by performing multilevel bilateral noise filtering of the at least one color plane image, and reconstructing the at least one color plane image to generate a noise filtered image frame.

Abstract: There is provided an image processing apparatus. An obtaining unit obtains a first image to which tone conversion processing conforming to a first input/output characteristic having a first maximum output luminance value has been applied. A generation unit generates first correction information for correcting a luminance value of the first image based on a difference regarding an output luminance value between the first input/output characteristic and a second input/output characteristic having a second maximum output luminance value, and on second correction information for correcting a luminance value of a second image to which tone conversion processing conforming to the second input/output characteristic has been applied. A correction unit corrects a luminance value of the first image in conformity to the first correction information.

Abstract: The disclosure relates to a method, apparatus and system for detecting and reducing the effects of color fringing in digital video acquired by a camera comprising an iris. The method comprises: acquiring, by the camera, a first digital image frame using a first camera setting, including a first iris aperture size; acquiring, by the camera, a second digital image frame using a second camera setting, including a second iris aperture size, wherein the second aperture size is smaller than the first aperture size; comparing the first and the second digital image frame, at least a specific color component thereof; localizing regions having a disproportional intensity ratio in the specific color component between the first digital image frame and the second digital image frame; and reducing the specific color component in the localized regions for subsequently acquired digital image frames.

Abstract: The present disclosure is directed to a process to partially or fully suppress, or limit, pixel coloration errors. These pixel coloration errors, represented by small noise values, can be introduced during signal processing of high dynamic range (HDR) video signals. Converting visual content to a half precision floating point representation, for example, FP16, can introduce small amounts of signal noise due to value rounding. The noise can be multiplied and accumulated during HDR signal processing resulting in visual artifacts and degraded image quality. The disclosure can detect these noise amounts in pixel color component values, and suppress, or partially suppress, the noise to prevent the noise from accumulating during subsequent HDR signal processing.

Abstract: Disclosed herein is a camera system including, a camera apparatus having, an image sensor, a correction section, a first transmission processing section, and a synchronization processing section, and a video processing apparatus having a second transmission processing section and a conversion section, wherein the video processing apparatus outputs the video data obtained by the conversion by the conversion section.

Abstract: Disclosed herein is a camera system including, a camera apparatus having, an image sensor, a correction section, a first transmission processing section, and a synchronization processing section, and a video processing apparatus having a second transmission processing section and a conversion section, wherein the video processing apparatus outputs the video data obtained by the conversion by the conversion section.

Abstract: An imaging apparatus, comprising a movement section having a thrust mechanism capable of movement, an imaging section that acquires image data, an imaging control section that acquires first image data using the imaging section with an examination chart under a first shooting condition, and that acquires second image data using the imaging section with a physical object under a second shooting condition, and a determination section for determining illuminated state for the physical object and the examination chart based on the first and second image data.

Abstract: An imaging device including a condenser lens and an image sensor is provided. The image sensor is configured to sense light penetrating the condenser lens and includes a pixel matrix, an opaque layer, a plurality of microlenses and an infrared filter layer. The pixel matrix includes a plurality of infrared pixels, a plurality of first pixels and a plurality of second pixels. The opaque layer covers upon a first region of the first pixels and a second region of the second pixels, wherein the first region and the second region are mirror-symmetrically arranged in a first direction. The plurality of microlenses is arranged upon the pixel matrix. The infrared filter layer covers upon the infrared pixels.

Abstract: There is provided an image sensor including: a control unit configured to control pixels in a manner that a readout of a focus pixel signal from a focus detection pixel used for focusing and a readout of a main pixel signal from a pixel used for image generation are conducted independently; and an output unit configured to output the focus pixel signal and the main pixel signal independently from each other.

Abstract: Disclosed herein is a camera system including, a camera apparatus having, an image sensor, a correction section, a first transmission processing section, and a synchronization processing section, and a video processing apparatus having a second transmission processing section and a conversion section, wherein the video processing apparatus outputs the video data obtained by the conversion by the conversion section.

Abstract: A change degree deriving apparatus includes a receiving unit and a change acquiring unit. The receiving unit receives image data and new product image data. The image data is obtained by capturing an object, through/from which a light source having a known spectral characteristic is transmitted/reflected, under a condition with no influence of sunlight. The new product image data is obtained by capturing the object in a new product state under an identical condition. The change acquiring unit acquires a change degree of the object by comparing a ratio of first data on a first specific color to second data on a second specific color that is different from the first specific color in relation to the received image data, with a ratio of third data on the first specific color to fourth data on the second specific color in relation to the received new product image data.

Abstract: There is provided an image pickup device including: an optical filter including a first birefringent member; a second birefringent member; a liquid crystal layer disposed between the first and second birefringent members and configured to control polarization; and an electrode configured to apply an electric field to the liquid crystal layer; and a drive circuit configured to apply an intermediate voltage or an intermediate frequency to the electrode.

Abstract: An image capturing apparatus is provided capable of recording an appropriate HDR still image when shooting a still image during HDR video recording. An HDR video frame having a high dynamic range is generated by generating video frames from frames of different exposure conditions and composing the video frames, and the HDR video frame is recorded in a recording medium as an HDR video. When a still image shooting instruction is accepted during the generation of the HDR video frame, an HDR still image frame having a high dynamic range is generated by generating still image frames of different exposure conditions during the generation of the HDR video frame and composing the still image frames, and the HDR still image frame is recorded in the recording medium as an HDR still image.

Abstract: Methods, apparatuses and systems may provide for creating a reference signal for a restoration process using a plurality of pixels corresponding to various color channels within a spatial neighborhood of a target pixel location. Additionally, first weights may be set in pixel locations within the spatial neighborhood to control contributions of pixel values and values of the reference signal in calculating one or more intermediate restoration factors. Moreover, second weights may be set in pixel locations within the spatial neighborhood to control contributions of the intermediate restoration factors in calculating one or more final restoration factors. In one example, at least one of the one or more final restoration factors and the reference signal are combined in the target pixel location to restore one or more values in the target pixel location.

Abstract: The disclosure provides a method and a system for multi-lens module alignment, adapted to perform alignment on a multi-lens module having at least a first lens and a second lens during its manufacturing stage, where the method includes the following steps. A calibration object is first captured by using the first lens and the second lens to accordingly generate intrinsic parameters and external parameters of the first lens and the second lens, where the external parameters of the first lens and the second lens are associated with a common reference coordinate system. A target object is next captured by using the first lens and the second lens, and captured images of the target object are processed by using the intrinsic parameters and the external parameters to generate rectified images. The first lens and the second lens are adjusted and aligned according to the rectified images.

Abstract: The present disclosure relates to a control device, a control method, and an electronic device that enable an adequate exposure amount to be set at high speed. A control unit controls an exposure amount of a pixel group that is a two-dimensional arrangement of a plurality of pixels. Specifically, in a first mode before recording of a photographed image is started, the control unit sets a plurality of types of exposure amounts to the pixel group, and in a second mode in which the photographed image is recorded, the control unit sets fewer types of exposure amounts than in the first mode to the pixel group. The present technology can be applied to, for example, a control device that controls a solid state imaging element.

Abstract: Embodiments relate to color correction circuit operations performed by an image signal processor. The color correction circuit computes optimal color correction matrix on a per-pixel basis and adjusts it based on relative noise standard deviations of the color channels to steer the matrix.

Abstract: The present disclosure relates to a solid-state imaging device, a signal processing method therefor, and an electronic apparatus enabling sensitivity correction in which a sensitivity difference between solid-state imaging devices is suppressed. The solid-state imaging device includes a pixel unit in which one microlens is formed for a plurality of pixels in a manner such that a boundary of the microlens coincides with boundaries of the pixels. The correction circuit corrects a sensitivity difference between the pixels inside the pixel unit based on a correction coefficient. The present disclosure is applicable to, for example, a solid-state imaging device and the like.

Abstract: An image processing system, and a method of operation thereof, includes: an imaging sensor and lens assembly for receiving a first shot; and a defocus blur unit for calculating a defocus blur based on the first shot; wherein: the imaging sensor is for receiving a second shot with the defocus blur; and further comprising: a low-pass filter for generating a low-pass image by filtering the first shot based on the defocus blur; a comparison unit for comparing the low-pass image with the second shot for detecting a color aliasing; and a correction unit for correcting the color aliasing in the first shot.

Abstract: An electrowetting element comprising a first subpixel with a first color filter, a second subpixel with a second color filter, and a first white filter positioned between the first color filter and the second color filter.

Abstract: A system determines for each color channel of each portion of the image, a corresponding adjustment value to apply to the color channel to correct for a color irregularity. The system determines a corrected adjustment value based on a difference between twice the pixel value and the maximum saturation value. If the adjustment value as applied is larger than the corrected adjustment value, the system applies the adjustment value to the corresponding color channel of the image portion to produce the adjusted color channel. Otherwise, the system applies the corrected adjustment to the corresponding color channel of the image portion to produce an adjusted color channel. The system generates a modified image based on the adjusted color channel.

Abstract: The invention relates to a system for detection and infrared imaging by spectral analysis in several wavelength bands comprising: —an imaging sensor comprising a plurality of elementary sensors together forming a matrix sensitive surface; —an imaging optic adapted for forming on the sensitive surface of the imaging sensor, a first image of the scene to be analyzed in a first wavelength band, and at least one second image of the scene to be analyzed in a second wavelength band, characterized in that said detection and imaging system furthermore comprises an optical device consisting of a fixed optical plate adapted for shifting the first image with respect to the second image in the plane of the sensitive surface, the shift between the images being along a direction defined by a row, a column or a diagonal of elementary sensors, the shift distance being equal to the spacing of the elementary sensors of the matrix sensitive surface along this direction or to a multiple of this spacing.

Abstract: Disclosed herein is a camera system including, a camera apparatus having, an image sensor, a correction section, a first transmission processing section, and a synchronization processing section, and a video processing apparatus having a second transmission processing section and a conversion section, wherein the video processing apparatus outputs the video data obtained by the conversion by the conversion section.

Abstract: A sampling period control circuit according to an example embodiment of the inventive concepts is configured to derive a ramp voltage range of a row signal when analyzing a previous row signal in order to control a ramp voltage range of a next row signal.

Abstract: Disclosed herein is a camera system including, a camera apparatus having, an image sensor, a correction section, a first transmission processing section, and a synchronization processing section, and a video processing apparatus having a second transmission processing section and a conversion section, wherein the video processing apparatus outputs the video data obtained by the conversion by the conversion section.

Abstract: Provided is an image signal processing apparatus including multiple color support distortion correcting units receiving a color signal of a correction target image, performing image distortion correction of a color based on a lens distortion characteristic and generating a correction image supporting the color. Each of the multiple color support distortion correcting units performs processing of receiving a reference signal indicating a pixel position in an input image applied to calculate a pixel value of an output correction image, and setting a pixel value of the pixel position indicated by the reference signal in the input image as an output pixel value.

Abstract: An imaging system includes an encoding apparatus that performs a multiple sampling process on charge signals in a plurality of wavelength bands and encodes image information and a decoding apparatus that decodes the image information. In the multiple sampling process, the charge signals of pixels in a pixel group having a predetermined arrangement pattern are analog-summed and the sum is converted into a new digital signal. The encoding apparatus performs the multiple sampling process on charge signals in at least two of the wavelength bands and outputs a digital image signal in each of the wavelength band. The at least two pixel groups have different arrangement patterns, and combinations of the arrangement patterns for all the wavelength bands differ from one another. The decoding apparatus generates a reconstructed image from the digital image signals in the wavelength bands using multiple sampling information and outputs the image.

Abstract: A method for correcting pixel information of color pixels on a color filter array of an image sensor includes: establishing an M×M distance factor table, selecting M×M pixels of the color filter array, calculating a red/green/blue-color contribution from the red/green/blue pixels to a target pixel in the selected M×M pixels, calculating a red/blue/green-color pixel performance of the target pixel, calculating a red/blue/green-color correcting factor, obtaining a corrected pixel information of each of the red/green/blue pixels, by applying the red/green/blue-color correcting factor to the measured pixel information of each of the red/green/blue pixels.

Abstract: An image processing apparatus which enables to suppress coloring in an image after image recovery processing, and a control method for the image processing apparatus are disclosed. After the chromatic difference of magnification of an optical imaging system is corrected, a first value relating to coloring is obtained before application of an image recovery filter. Then, an image recovery filter which, preferably, does not correct a chromatic difference of magnification and is based on a function indicating the aberrations of the optical imaging system is applied. A second value associated with coloring is obtained from the image after application of the image recovery filter. According to the difference between the first and second values obtained before and after application of the image recovery filter respectively, pixel value correction for correcting coloring is performed.

Abstract: A low-resolution image having a low resolution and low frequency band is generated from an image sensed by using a single board color image sensor, and pseudo color suppression and color noise suppression are performed on each of the image and low-resolution image. The resolution of the low-resolution image is then restored, and weighted combination is performed on this image and the former image. If it is determined that a pixel of interest belongs to a region where a pseudo color is generated, a MIX ratio calculator (205, 225) for calculating a ratio coefficient for combination calculates a ratio coefficient by which a color signal of a pixel of the low-resolution image having the restored resolution is the result of the weighted combination. This makes it possible to effectively suppress both a pseudo color and color noise.

Abstract: An imaging system includes: an image module configured to produce image frames at a frame rate F, the image module being configured to capture first and second portions of each of the image frames at different times; a frequency determination module, communicatively coupled to the image module, configured to determine frequency components associated with the first and second portions over a plurality, N, of the image frames; and a flicker analysis module, communicatively coupled to the frequency determination module, configured to determine whether any of the frequency components of the first and second portions are indicative of perceptible flicker.

Abstract: An image reduction processing section 16 includes a data acquisition section 70 that acquires whether shooting condition data is included in image capture data (including image pickup data) 30 and contents of the shooting condition data, and reduction processing discrimination unit for discriminating at least any of whether reduction association processing (such as low-pass filter processing) associated with reduction processing of generating reduced image data from the image pickup data is executed, a processing parameter (such as a cutoff frequency of low-pass filter processing) of the reduction association processing, and a processing parameter (such as a reduction ratio) of the reduction processing, on the basis of an acquisition result of the shooting condition data. The shooting condition data includes information on the presence or absence of the optical low-pass filter and information on the array of the color filters.

Abstract: There is provided an image sensor including a normal pixel group composed of a plurality of normal pixels, each of the normal pixels having a photoelectric conversion device for photoelectrically converting an incident light, and a detection pixel configured to detect a light incident from a neighboring pixel by the photoelectric conversion device within an effective pixel area of the normal pixel group.