Patents by Inventor Takeo Azuma

Takeo Azuma has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20180316912
    Abstract: Three-dimensional point group data indicating three-dimensional coordinate sets of three-dimensional points included in a common imaging space of one or more cameras is received, one or more images captured by the one or more cameras are transmitted, the one or more transmitted images are received, initial camera parameters of each cameras are decided based on one or more mounting locations and one or more directions of the cameras, corresponding points in the one or more images are calculated for each of the three-dimensional points, based on the three-dimensional point group data and the initial camera parameters, and one or more camera parameters of the one or more cameras are calculated based on pixel values at the corresponding points in the one or more images.
    Type: Application
    Filed: April 24, 2018
    Publication date: November 1, 2018
    Inventors: NOBUHIKO WAKAI, TAKEO AZUMA, KUNIO NOBORI, SATOSHI SATO, MIKIYA NAKATA
  • Publication number: 20180316905
    Abstract: A camera parameter set calculation method including (a1) acquiring a first image captured by a first camera and a second image captured by a second camera, (a2) acquiring camera parameter sets of the first and second cameras, (a3) extracting, from the first image, a predetermined portion having assumed three-dimensional position information, (a4) calculating three-dimensional coordinate sets corresponding to the predetermined portion on a basis of the assumed three-dimensional position information, the first image, and the first camera parameter set, (a5) determining first pixel coordinate pairs and second pixel coordinate pairs corresponding to the predetermined portion in the first image and second image, respectively, on the basis of the three-dimensional coordinate sets, (a6) calculating an evaluation value on the basis of pixel values at the first pixel coordinate pairs and pixel values at the second coordinate pairs, (a7) updating the camera parameter sets on the basis of the evaluation value.
    Type: Application
    Filed: April 24, 2018
    Publication date: November 1, 2018
    Inventors: KUNIO NOBORI, NOBUHIKO WAKAI, SATOSHI SATO, TAKEO AZUMA, MIKIYA NAKATA
  • Publication number: 20180316907
    Abstract: An image capturing apparatus: calculates, for each of pairs of images, based on the pairs of images and camera parameters, position information including information specifying a three-dimensional position of a measurement point with respect to a pair of pixels respectively included in the pair of images, and information specifying a position of each of the pair of pixels; performs, based on the position information and the camera parameters, weighted addition on the information specifying the three-dimensional position of the measurement point in each of the pair of images, with information using an effective baseline length or a viewing angle, with respect to the three-dimensional position, of a pair of the cameras corresponding to the pair of images; and outputs position information of the measurement point to which a weighted addition value is applied.
    Type: Application
    Filed: April 24, 2018
    Publication date: November 1, 2018
    Inventors: TAKEO AZUMA, NOBUHIKO WAKAI, KUNIO NOBORI, SATOSHI SATO
  • Publication number: 20180309978
    Abstract: A camera parameter set calculation method includes acquiring a first image from a first camera, a second image from a second camera, first and second camera parameter sets of the first camera and the second camera, calculating three-dimensional coordinate sets on the basis of the first image, the second image, the first camera parameter set, and the second camera parameter set, determining first pixel coordinate pairs obtained by projecting the three-dimensional coordinate sets onto the first image and second pixel coordinate pairs obtained by projecting the three-dimensional coordinate sets onto the second image, calculating an evaluation value on the basis of the pixel values at the first pixel coordinate pairs and the pixel values at the second pixel coordinate pairs, and updating the first camera parameter set and the second camera parameter set on a basis of the evaluation value.
    Type: Application
    Filed: April 13, 2018
    Publication date: October 25, 2018
    Inventors: KUNIO NOBORI, NOBUHIKO WAKAI, SATOSHI SATO, TAKEO AZUMA
  • Patent number: 10110808
    Abstract: In an imaging device, a difference calculation unit calculates a differential signal between charge signals that have been accumulated and are held by first and charge holding units with different timings. A multiple sampling unit performs multiple sampling processing on the differential signal, and an analog digital conversion unit converts a signal that has undergone multiple sampling processing to a digital signal. That is, multiple sampling processing is performed on a differential signal with a higher sparisty than that of an image signal.
    Type: Grant
    Filed: January 27, 2017
    Date of Patent: October 23, 2018
    Assignee: Panasonic Intellectual Property Management Co., Ltd.
    Inventors: Satoshi Sato, Takeo Azuma, Hiroyuki Motoyama, Jun Ozawa
  • Publication number: 20180300900
    Abstract: A camera calibration method which calculates camera parameters of at least three cameras (a1) acquires three-dimensional coordinate set of a calibration point and image coordinate pair of the calibration point in each camera image, (a2) acquires camera parameters of each camera, (a3) calculates a view angle-corresponding length corresponding to a view angle of each pair of cameras viewing the calibration point, (a4) calculates a three-dimensional position of a measurement point corresponding to a three-dimensional position of the calibration point for each camera pair using parallax of the calibration point between the cameras in the camera pair, (a5) weights the three-dimensional position of each measurement point using the view angle-corresponding length corresponding to the measurement point, (a6) calculates a three-dimensional position of a unified point of the weighted measurement points, and (a7) updates the camera parameters based on the three-dimensional coordinate set of the calibration point and the
    Type: Application
    Filed: April 11, 2018
    Publication date: October 18, 2018
    Inventors: NOBUHIKO WAKAI, TAKEO AZUMA, KUNIO NOBORI, SATOSHI SATO
  • Publication number: 20180300901
    Abstract: A camera calibration method, which calculates camera parameters of two cameras using calibration points, includes: (a1) acquiring three-dimensional coordinate sets of the calibration points and image coordinate pairs of the calibration points in a camera image of each camera; (a2) acquiring multiple camera parameters of each camera; (a3) for each calibration point, calculating a view angle-corresponding length corresponding to a view angle of the two cameras viewing the calibration point; (a4) for each calibration point, calculating a three-dimensional position of a measurement point corresponding to a three-dimensional position of the calibration point using parallax of the calibration point between the two cameras; (a5) for each calibration point, weighting a difference between the three-dimensional coordinate set of the calibration point and the three-dimensional position of the measurement point corresponding to the calibration point using the view angle-corresponding length corresponding to the calibrati
    Type: Application
    Filed: April 11, 2018
    Publication date: October 18, 2018
    Inventors: NOBUHIKO WAKAI, TAKEO AZUMA, KUNIO NOBORI, SATOSHI SATO
  • Publication number: 20180286906
    Abstract: An imaging system serving as an image generation device is provided with: a random color filter array that has a plurality of concave lenses and a plurality of color filters having different transmission characteristics; a photodiode that receives light that has passed through the random color filter array; an AD converter that converts the light received by the photodiode into digital data; and a color image generation circuit that generates an image using the digital data and modulation information of the random color filter array, in which the plurality of concave lenses are located between the plurality of color filters and the photodiode, or the plurality of color filters are located between the plurality of concave lenses and the photodiode.
    Type: Application
    Filed: March 8, 2018
    Publication date: October 4, 2018
    Inventors: SATOSHI SATO, HISASHI WATANABE, TAKEO AZUMA, KUNIO NOBORI, NOBUHIKO WAKAI, TAKAMASA ANDO
  • Patent number: 10032253
    Abstract: An imaging apparatus includes an optical imaging system that converges light from an object; an imaging device that includes a plurality of pixels, receives the converged light, and converts the received light to an electric signal; a filter unit that is disposed between the optical imaging system and the imaging device and includes a plurality of color filters having different light transmission rate characteristics; and a transmission data compressing circuit that codes the electric signal. An overall light transmission rate characteristic of the filter unit differs randomly in different pixels of the imaging device, and the transmission data compressing circuit weights and codes the electric signal of each of the pixels by using a reciprocal of a proportion of the overall light transmission rate characteristic of the filter unit corresponding to each of the plurality of pixels of the imaging device relative to a wavelength characteristic common among the pixels.
    Type: Grant
    Filed: January 24, 2017
    Date of Patent: July 24, 2018
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Satoshi Sato, Kunio Nobori, Takeo Azuma, Ayako Maruyama, Nobuhiko Wakai
  • Publication number: 20180184052
    Abstract: An imaging system serving as an image generation device is provided with: a random optical filter array that has a plurality of types of optical filters and a scattering unit; photodiodes that receive light transmitted through the random optical filter array; an AD conversion unit that converts the light received by the photodiodes, into digital data; and a color image generation circuit that generates an image, using the digital data and modulation information of the random optical filter array, in which the scattering unit is located between the plurality of types of optical filters and the photodiodes, and in which the scattering unit includes a material having a first refractive index, and a material having a second refractive index that is different from the first refractive index.
    Type: Application
    Filed: December 14, 2017
    Publication date: June 28, 2018
    Inventors: SATOSHI SATO, TAKEO AZUMA, KUNIO NOBORI, HISASHI WATANABE, TAKAMASA ANDO, NOBUHIKO WAKAI
  • Publication number: 20180144502
    Abstract: A crossing point detector includes memory and a crossing point detection unit that reads out a square image from a captured image in the memory, and detects a crossing point of two boundary lines in a checker pattern depicted in the square image. The crossing point detection unit decides multiple parameters of a function model treating two-dimensional image coordinates as variables, the parameters optimizing an evaluation value based on a difference between corresponding pixel values represented by the function model and the square image, respectively, and computes the position of a crossing point of two straight lines expressed by the decided multiple parameters to thereby detect the crossing point with subpixel precision. The function model uses a curved surface that is at least first-order differentiable to express pixel values at respective positions in a two-dimensional coordinate system at the boundary between black and white regions.
    Type: Application
    Filed: November 5, 2017
    Publication date: May 24, 2018
    Inventors: NOBUHIKO WAKAI, TAKEO AZUMA, KUNIO NOBORI, SATOSHI SATO, AYAKO MARUYAMA
  • Publication number: 20180109763
    Abstract: An imaging apparatus in an embodiment includes lens optical systems each including a lens whose surface closest to the target object is shaped to be convex toward the target object, imaging regions which respectively face the lens optical systems and output a photoelectrically converted signal corresponding to an amount of light transmitting the lens optical systems and received by the imaging regions, and a light-transmissive cover which covers an exposed portion of the lens of each of the lens optical systems and a portion between the lens of one of the lens optical systems and the lens of another one of the lens optical systems adjacent to the one of the lens optical systems, the cover having a curved portion which is convex toward the target object. The optical axes of the lens optical systems are parallel to each other.
    Type: Application
    Filed: December 15, 2017
    Publication date: April 19, 2018
    Inventors: Norihiro IMAMURA, Tsuguhiro KORENAGA, Kunio NOBORI, Takeo AZUMA, Kazufumi MIZUSAWA
  • Publication number: 20180068462
    Abstract: Provided are: a point group obtainer that obtains three-dimensional point group data indicating three-dimensional locations of each of a plurality of three-dimensional points included in an imaging space of one or more cameras; a camera parameter calculator that (i) obtains corresponding points, for each of the plurality of three-dimensional points, in individual images captured using the one or more cameras, based on the three-dimensional point group data and an initial camera parameter of each camera, and (ii) calculates a camera parameter of each camera on the basis of the initial camera parameter of each camera and pixel values, included in the individual images, at the corresponding points; and a camera parameter outputter that outputs the calculated camera parameter of each camera.
    Type: Application
    Filed: August 28, 2017
    Publication date: March 8, 2018
    Inventors: NOBUHIKO WAKAI, KUNIO NOBORI, TAKEO AZUMA, SATOSHI SATO, AYAKO MARUYAMA, MIKIYA NAKATA
  • Publication number: 20180070074
    Abstract: A camera-parameter-set calculation apparatus includes a three-dimensional point group calculator that calculates a plurality of three-dimensional coordinates, based on first and second images respectively captured by first and second cameras and first and second camera parameter sets of the first and second cameras; an evaluation value calculator that determines a plurality of pixel coordinates in the second image, based on the plurality of three-dimensional coordinates and the second camera parameter set, determines a plurality of third pixel coordinates in a third image captured by a third camera, based on the plurality of three-dimensional coordinates and a third camera parameter set of the third camera, and calculates an evaluation value, based on pixel values at the plurality of second and third pixel coordinates in the second and third images; and a camera-parameter-set determiner that determines a fourth camera parameter set for the third camera, based on the evaluation value.
    Type: Application
    Filed: September 1, 2017
    Publication date: March 8, 2018
    Inventors: KUNIO NOBORI, NOBUHIKO WAKAI, TAKEO AZUMA, SATOSHI SATO, AYAKO MARUYAMA, MIKIYA NAKATA
  • Patent number: 9876992
    Abstract: An imaging apparatus in an embodiment includes lens optical systems each including a lens whose surface closest to the target object is shaped to be convex toward the target object, imaging regions which respectively face the lens optical systems and output a photoelectrically converted signal corresponding to an amount of light transmitting the lens optical systems and received by the imaging regions, and a light-transmissive cover which covers an exposed portion of the lens of each of the lens optical systems and a portion between the lens of one of the lens optical systems and the lens of another one of the lens optical systems adjacent to the one of the lens optical systems, the cover having a curved portion which is convex toward the target object. The optical axes of the lens optical systems are parallel to each other.
    Type: Grant
    Filed: April 23, 2015
    Date of Patent: January 23, 2018
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Norihiro Imamura, Tsuguhiro Korenaga, Kunio Nobori, Takeo Azuma, Kazufumi Mizusawa
  • Patent number: 9866779
    Abstract: An imaging apparatus includes a photoelectric converter that converts light signals generated from light received by three or more pixels into electric charge signals, each of the electric charge signals corresponding to one of the three or more pixels; an electric charge holder that holds the electric charge signals; an analog selective adder that generates added electric charge signals by adding electric charge signals of certain pixels among the three or more pixels by using analog addition patterns which are rules of adding pieces of electric charge information corresponding to individual positions of the certain pixels; an analog-to-digital converter that converts the added electric charge signals into digital signals; and an addition data compressor that compresses the digital signals by using a total number of pixels for which pieces of electric charge information are added in the analog addition patterns and thereby generates compressed digital signals.
    Type: Grant
    Filed: December 8, 2015
    Date of Patent: January 9, 2018
    Assignee: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
    Inventors: Satoshi Sato, Takeo Azuma, Kunio Nobori, Mikiya Nakata
  • Publication number: 20170366792
    Abstract: An imaging apparatus includes an imaging optical system that forms an optical signal, an imaging device that includes a plurality of pixels and that converts the optical signal formed on the plurality of pixels into an electrical signal, a color filter that is arranged between the imaging optical system and the imaging device and that has a different optical transmittance for each of the plurality of pixels and each of a plurality of wavelength ranges, and a transmission data compression circuit that compresses the electrical signal obtained by the imaging device. The sum of products of an optical transmittance group relating to a plurality of optical transmittances of the color filter for each of the plurality of pixels in the plurality of wavelength ranges and coefficients common to the plurality of pixels is the same between the plurality of pixels.
    Type: Application
    Filed: June 2, 2017
    Publication date: December 21, 2017
    Inventors: SATOSHI SATO, KUNIO NOBORI, TAKEO AZUMA, AYAKO MARUYAMA, NOBUHIKO WAKAI
  • Publication number: 20170352275
    Abstract: An image generating apparatus generates an image to be displayed on a display and includes at least one memory and a control circuit. The control circuit acquires a plurality of camera images captured by a plurality of cameras installed in a vehicle, calculates a distance between one of the cameras and a target to be projected in the camera images, detects a position of a light-transmissive object or a reflective object in the camera images, and generates an image from a point of view that is different from points of view of the plurality of camera images by using the plurality of camera images and the distance, the generated image including a predetermined image that is displayed at the position of the light-transmissive object or the reflective object.
    Type: Application
    Filed: May 30, 2017
    Publication date: December 7, 2017
    Inventors: AYAKO MARUYAMA, KUNIO NOBORI, TAKEO AZUMA, SATOSHI SATO, NOBUHIKO WAKAI
  • Publication number: 20170251198
    Abstract: An imaging apparatus includes an imaging device, a first imaging optical system and a second imaging optical system that form respective input images from mutually different viewpoints onto the imaging device, and a first modulation mask and a second modulation mask that modulate the input images formed by the first imaging optical system and the second imaging optical system. The imaging device captures a superposed image composed of the two input images that have been formed by the first imaging optical system and the second imaging optical system, modulated by the first modulation mask and the second modulation mask, and optically superposed on each other, and the first modulation mask and the second modulation mask have mutually different optical transmittance distribution characteristics.
    Type: Application
    Filed: February 14, 2017
    Publication date: August 31, 2017
    Inventors: KUNIO NOBORI, SATOSHI SATO, TAKEO AZUMA, TAKAMASA ANDO, TSUGUHIRO KORENAGA, TOSHIYA FUJII
  • Publication number: 20170223324
    Abstract: An imaging apparatus includes an optical imaging system that converges light from an object; an imaging device that includes a plurality of pixels, receives the converged light, and converts the received light to an electric signal; a filter unit that is disposed between the optical imaging system and the imaging device and includes a plurality of color filters having different light transmission rate characteristics; and a transmission data compressing circuit that codes the electric signal. An overall light transmission rate characteristic of the filter unit differs randomly in different pixels of the imaging device, and the transmission data compressing circuit weights and codes the electric signal of each of the pixels by using a reciprocal of a proportion of the overall light transmission rate characteristic of the filter unit corresponding to each of the plurality of pixels of the imaging device relative to a wavelength characteristic common among the pixels.
    Type: Application
    Filed: January 24, 2017
    Publication date: August 3, 2017
    Inventors: SATOSHI SATO, KUNIO NOBORI, TAKEO AZUMA, AYAKO MARUYAMA, NOBUHIKO WAKAI