Abstract: A camera calibration method which calculates camera parameters of at least three cameras (a1) acquires three-dimensional coordinate set of a calibration point and image coordinate pair of the calibration point in each camera image, (a2) acquires camera parameters of each camera, (a3) calculates a view angle-corresponding length corresponding to a view angle of each pair of cameras viewing the calibration point, (a4) calculates a three-dimensional position of a measurement point corresponding to a three-dimensional position of the calibration point for each camera pair using parallax of the calibration point between the cameras in the camera pair, (a5) weights the three-dimensional position of each measurement point using the view angle-corresponding length corresponding to the measurement point, (a6) calculates a three-dimensional position of a unified point of the weighted measurement points, and (a7) updates the camera parameters based on the three-dimensional coordinate set of the calibration point and the

Abstract: A camera-parameter-set calculation apparatus includes a three-dimensional point group calculator that calculates a plurality of three-dimensional coordinates, based on first and second images respectively captured by first and second cameras and first and second camera parameter sets of the first and second cameras; an evaluation value calculator that determines a plurality of pixel coordinates in the second image, based on the plurality of three-dimensional coordinates and the second camera parameter set, determines a plurality of third pixel coordinates in a third image captured by a third camera, based on the plurality of three-dimensional coordinates and a third camera parameter set of the third camera, and calculates an evaluation value, based on pixel values at the plurality of second and third pixel coordinates in the second and third images; and a camera-parameter-set determiner that determines a fourth camera parameter set for the third camera, based on the evaluation value.

Abstract: An imaging apparatus includes an imaging optical system that forms an optical signal, an imaging device that includes a plurality of pixels and that converts the optical signal formed on the plurality of pixels into an electrical signal, a color filter that is arranged between the imaging optical system and the imaging device and that has a different optical transmittance for each of the plurality of pixels and each of a plurality of wavelength ranges, and a transmission data compression circuit that compresses the electrical signal obtained by the imaging device. The sum of products of an optical transmittance group relating to a plurality of optical transmittances of the color filter for each of the plurality of pixels in the plurality of wavelength ranges and coefficients common to the plurality of pixels is the same between the plurality of pixels.

Abstract: A camera parameter set calculation method includes acquiring a first image from a first camera, a second image from a second camera, first and second camera parameter sets of the first camera and the second camera, calculating three-dimensional coordinate sets on the basis of the first image, the second image, the first camera parameter set, and the second camera parameter set, determining first pixel coordinate pairs obtained by projecting the three-dimensional coordinate sets onto the first image and second pixel coordinate pairs obtained by projecting the three-dimensional coordinate sets onto the second image, calculating an evaluation value on the basis of the pixel values at the first pixel coordinate pairs and the pixel values at the second pixel coordinate pairs, and updating the first camera parameter set and the second camera parameter set on a basis of the evaluation value.

Abstract: A learning device includes a memory and a processing circuit. The processing circuit: (a) obtains, from the memory, a first computational imaging image which includes an object, the first computational imaging image including a plurality of first pixels; (b) obtains, from the memory, a captured image which includes the object, the captured image including a plurality of second pixels; (c) obtains an identification result of identifying the object included in the captured image; (d) generates, with reference to correspondences between the plurality of first pixels and the plurality of second pixels, an identification model for identifying the first computational imaging image based on the identification result of identifying the object included in the captured image; and (e) outputs the identification model to an image identification device which identifies a second computational imaging image.

Abstract: A crossing point detector includes memory and a crossing point detection unit that reads out a square image from a captured image in the memory, and detects a crossing point of two boundary lines in a checker pattern depicted in the square image. The crossing point detection unit decides multiple parameters of a function model treating two-dimensional image coordinates as variables, the parameters optimizing an evaluation value based on a difference between corresponding pixel values represented by the function model and the square image, respectively, and computes the position of a crossing point of two straight lines expressed by the decided multiple parameters to thereby detect the crossing point with subpixel precision. The function model uses a curved surface that is at least first-order differentiable to express pixel values at respective positions in a two-dimensional coordinate system at the boundary between black and white regions.

Abstract: An imaging system serving as an image generation device is provided with: a random color filter array that has a plurality of concave lenses and a plurality of color filters having different transmission characteristics; a photodiode that receives light that has passed through the random color filter array; an AD converter that converts the light received by the photodiode into digital data; and a color image generation circuit that generates an image using the digital data and modulation information of the random color filter array, in which the plurality of concave lenses are located between the plurality of color filters and the photodiode, or the plurality of color filters are located between the plurality of concave lenses and the photodiode.

Abstract: An image generation apparatus includes a processing circuit and a memory storing at least one computational image. The at least one computational image is a light-field image, a compressive sensing image, or a coded image. The processing circuit (a1) identifies a position of an object in the at least one computational image using a classification device, (a2) generates, using the at least one computational image, a display image in which an indication for highlighting the position of the object is superimposed, and (a3) outputs the display image.

Abstract: A crossing point detector includes memory and a crossing point detection unit that reads out a square image from a captured image in the memory, and detects a crossing point of two boundary lines in a checker pattern depicted in the square image. The crossing point detection unit decides multiple parameters of a function model treating two-dimensional image coordinates as variables, the parameters optimizing an evaluation value based on a difference between corresponding pixel values represented by the function model and the square image, respectively, and computes the position of a crossing point of two straight lines expressed by the decided multiple parameters to thereby detect the crossing point with subpixel precision. The function model uses a curved surface that is at least first-order differentiable to express pixel values at respective positions in a two-dimensional coordinate system at the boundary between black and white regions.

Abstract: An image capturing apparatus includes a first camera that captures a first image, a second camera that captures a second image, a lens cover that includes transparent parts and ridgelines and that covers the first camera and the second camera, and a processing circuit that identifies a pixel located in an area, in which it is necessary to interpolate a pixel value, in the first image, and generates an output image using the first image and interpolation pixel information for interpolating a pixel value of the identified pixel. Each ridgeline between adjacent parts of the lens cover is twisted with respect to a base line extending between a center of a first lens of the first camera and a center of a second lens of the second camera. An upper part of the lens cover opposes a base on which the first camera and the second camera are disposed.

Abstract: A disparity estimation device calculates, for each of first pixels of a first image and each of second pixels of a second image, a first census feature amount and a second census feature amount, calculates, for each of the first pixels, a first disparity value of the first pixel with integer accuracy, extracts, for each of the first pixels, reference pixels located in positions corresponding to the first disparity value and a near disparity value close to the first disparity value from the second pixels, calculates sub-pixel evaluation values based on the relationship between the pixel values of the first pixel and the neighboring pixel and the pixel values of each of the reference pixels and the neighboring pixel, and estimates a second disparity value of the first pixel with sub-pixel accuracy by equiangular fitting.

Abstract: An imaging apparatus includes an imaging optical system that forms an optical signal, an imaging device that includes a plurality of pixels and that converts the optical signal formed on the plurality of pixels into an electrical signal, a color filter that is arranged between the imaging optical system and the imaging device and that has a different optical transmittance for each of the plurality of pixels and each of a plurality of wavelength ranges, and a transmission data compression circuit that compresses the electrical signal obtained by the imaging device. The sum of products of an optical transmittance group relating to a plurality of optical transmittances of the color filter for each of the plurality of pixels in the plurality of wavelength ranges and coefficients common to the plurality of pixels is the same between the plurality of pixels.

Abstract: Provided are: a point group obtainer that obtains three-dimensional point group data indicating three-dimensional locations of each of a plurality of three-dimensional points included in an imaging space of one or more cameras; a camera parameter calculator that (i) obtains corresponding points, for each of the plurality of three-dimensional points, in individual images captured using the one or more cameras, based on the three-dimensional point group data and an initial camera parameter of each camera, and (ii) calculates a camera parameter of each camera on the basis of the initial camera parameter of each camera and pixel values, included in the individual images, at the corresponding points; and a camera parameter outputter that outputs the calculated camera parameter of each camera.

Abstract: An imaging apparatus includes an imaging optical system that forms an optical signal, an imaging device that includes a plurality of pixels and that converts the optical signal formed on the plurality of pixels into an electrical signal, a color filter that is arranged between the imaging optical system and the imaging device and that has a different optical transmittance for each of the plurality of pixels and each of a plurality of wavelength ranges, and a transmission data compression circuit that compresses the electrical signal obtained by the imaging device. The sum of products of an optical transmittance group relating to a plurality of optical transmittances of the color filter for each of the plurality of pixels in the plurality of wavelength ranges and coefficients common to the plurality of pixels is the same between the plurality of pixels.

Abstract: An imaging apparatus includes an image-forming optical system that forms an image by using optical signals; an imaging device that includes a plurality of pixels, receives, with the plurality of pixels, the optical signals used to form the image, and converts the optical signals into electric signals; and a color filter that is located between the image-forming optical system and the imaging device and has a light transmittance which differs according to positions on the color filter corresponding to the plurality of pixels and according to a plurality of wavelength bands.

Abstract: An imaging system serving as an image generation device is provided with: a random optical filter array that has a plurality of types of optical filters and a scattering unit; photodiodes that receive light transmitted through the random optical filter array; an AD conversion unit that converts the light received by the photodiodes, into digital data; and a color image generation circuit that generates an image, using the digital data and modulation information of the random optical filter array, in which the scattering unit is located between the plurality of types of optical filters and the photodiodes, and in which the scattering unit includes a material having a first refractive index, and a material having a second refractive index that is different from the first refractive index.

Abstract: A camera parameter set calculation apparatus calculates three-dimensional coordinate sets based on a first image obtained by a first camera mounted on a mobile apparatus, a second image obtained by a second camera arranged on or in an object different from the mobile apparatus, a camera parameter set of the first camera, and a camera parameter set of the second camera, determines first pixel coordinate pairs obtained by projecting the three-dimensional coordinate sets onto the first image based on the first camera parameter set and second pixel coordinate pairs obtained by projecting the three-dimensional coordinate sets onto the second image based on the second camera parameter set, calculates an evaluation value based on pixel values at the first pixel coordinate pairs and pixel values at the second pixel coordinate pairs, and updates the camera parameter set of the first camera based on the evaluation value.

Abstract: A camera parameter set calculation apparatus calculates three-dimensional coordinate sets corresponding to overlapping regions including images of a portion of a subject, based on a first and second images captured by a first and second cameras, a first camera parameter set of the first camera and a second camera parameter set of the second camera; determines first pixel coordinate pairs based on the first camera parameter set by projecting the three-dimensional coordinate sets on the first image; determines second pixel coordinate pairs based on the second camera parameter set by projecting the three-dimensional coordinate sets on the second image; calculates an evaluation value, based on pixel values at the first pixel coordinate pairs on the first image and pixel values at the second pixel coordinate pairs on the second image; and updates the first and second camera parameter sets based on the evaluation value.

Abstract: A camera parameter set calculation method including (a1) acquiring a first image captured by a first camera and a second image captured by a second camera, (a2) acquiring camera parameter sets of the first and second cameras, (a3) extracting, from the first image, a predetermined portion having assumed three-dimensional position information, (a4) calculating three-dimensional coordinate sets corresponding to the predetermined portion on a basis of the assumed three-dimensional position information, the first image, and the first camera parameter set, (a5) determining first pixel coordinate pairs and second pixel coordinate pairs corresponding to the predetermined portion in the first image and second image, respectively, on the basis of the three-dimensional coordinate sets, (a6) calculating an evaluation value on the basis of pixel values at the first pixel coordinate pairs and pixel values at the second coordinate pairs, (a7) updating the camera parameter sets on the basis of the evaluation value.

Abstract: An image capturing apparatus: calculates, for each of pairs of images, based on the pairs of images and camera parameters, position information including information specifying a three-dimensional position of a measurement point with respect to a pair of pixels respectively included in the pair of images, and information specifying a position of each of the pair of pixels; performs, based on the position information and the camera parameters, weighted addition on the information specifying the three-dimensional position of the measurement point in each of the pair of images, with information using an effective baseline length or a viewing angle, with respect to the three-dimensional position, of a pair of the cameras corresponding to the pair of images; and outputs position information of the measurement point to which a weighted addition value is applied.