Patents by Inventor Masatoshi Okutomi

Masatoshi Okutomi has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11758110
    Abstract: A camera calibration information acquisition device acquires captured images of a camera calibration target from two or more cameras, detects, from each image, a coordinate of a feature point in the image, calculates—an internal parameter for each camera by using the feature point, calculates, for each camera, a magnitude of error in the coordinate of the feature point, calculates a value for an external parameter of the cameras by using the magnitude of the error, the coordinate of the feature point, and an error function set so that a penalty for error in calculating the external parameter decreases as the magnitude of the error in the coordinate of the feature point in the image increases.
    Type: Grant
    Filed: February 27, 2020
    Date of Patent: September 12, 2023
    Assignees: NEC CORPORATION, TOKYO INSTITUTE OF TECHNOLOGY
    Inventors: Takashi Shibata, Masatoshi Okutomi, Masayuki Tanaka, Thapanapong Rukkanchanunt
  • Patent number: 11669997
    Abstract: An image processing system, which estimates a position and a pose of a camera and performs three-dimensional reconstruction processing of an object having a cylindrical shape by using a photographed image acquired by photographing an inside of the object with the camera, includes a processor. The processor estimates a first center axis of the cylindrical shape by using a group of three-dimensional points obtained by reconstructing, in a three-dimensional space, a group of feature points extracted from the photographed image. In addition, the processor performs bundle adjustment for correcting the position and the pose of the camera and the coordinates of the group of three-dimensional points by using a condition for minimizing a total sum of differences between a radius of the cylindrical shape and respective distances from the first center axis to individual three-dimensional points that constitute the group of three-dimensional points.
    Type: Grant
    Filed: May 26, 2021
    Date of Patent: June 6, 2023
    Assignees: Tokyo Institute of Technology
    Inventors: Naoyuki Miyashita, Masatoshi Okutomi, Sho Kagami
  • Publication number: 20220132092
    Abstract: A camera calibration information acquisition device acquires captured images of a camera calibration target from two or more cameras, detects, from each image, a coordinate of a feature point in the image, calculates—an internal parameter for each camera by using the feature point, calculates, for each camera, a magnitude of error in the coordinate of the feature point, calculates a value for an external parameter of the cameras by using the magnitude of the error, the coordinate of the feature point, and an error function set so that a penalty for error in calculating the external parameter decreases as the magnitude of the error in the coordinate of the feature point in the image increases.
    Type: Application
    Filed: February 27, 2020
    Publication date: April 28, 2022
    Applicants: NEC CORPORATION, TOKYO INSTITUTE OF TECHNOLOGY
    Inventors: Takashi SHIBATA, Masatoshi OKUTOMI, Masayuki TANAKA, Thapanapong RUKKANCHANUNT
  • Publication number: 20210374990
    Abstract: An image processing system, which estimates a position and a pose of a camera and performs three-dimensional reconstruction processing of an object having a cylindrical shape by using a photographed image acquired by photographing an inside of the object with the camera, includes a processor. The processor estimates a first center axis of the cylindrical shape by using a group of three-dimensional points obtained by reconstructing, in a three-dimensional space, a group of feature points extracted from the photographed image. In addition, the processor performs bundle adjustment for correcting the position and the pose of the camera and the coordinates of the group of three-dimensional points by using a condition for minimizing a total sum of differences between a radius of the cylindrical shape and respective distances from the first center axis to individual three-dimensional points that constitute the group of three-dimensional points.
    Type: Application
    Filed: May 26, 2021
    Publication date: December 2, 2021
    Applicants: OLYMPUS CORPORATION, TOKYO INSTITUTE OF TECHNOLOGY
    Inventors: Naoyuki Miyashita, Masatoshi Okutomi, Sho Kagami
  • Patent number: 11010876
    Abstract: An image processing system includes: a weight determination circuitry configured to determine a band containing important information from among a group of images, which are acquired by a plurality of sensors, and to express a degree of importance of the band as a weight; a calculation circuitry configured to calculate, using the weight, an amount calculated based on a gradient of an image based on a gradient of each image, that is calculated based on the group of images, in order to restrict a gradient of an output image; and an image optimization circuitry configured to compose the output image using the amount calculated based on the gradient of the image.
    Type: Grant
    Filed: June 10, 2016
    Date of Patent: May 18, 2021
    Assignees: NEC Corporation, TOKYO INSTITUTE OF TECHNOLOGY
    Inventors: Takashi Shibata, Masayuki Tanaka, Masatoshi Okutomi
  • Patent number: 10943561
    Abstract: The image data display system according to the present invention makes it possible to comprehend a global distribution of measurement values and a change in details of the measurement values simultaneously. In the present invention, a color information conversion unit converts the measurement values to color information for representing the global distribution of the measurement values. A detail extraction unit extracts detail information of the measurement values from the measurement values. A detail adjustment unit adjusts the strength of detail information and generates adjusted detail information. A color information adding unit adds color information on the basis of the adjusted detail information.
    Type: Grant
    Filed: September 7, 2017
    Date of Patent: March 9, 2021
    Assignees: NEC Corporation, TOKYO INSTITUTE OF TECHNOLOGY
    Inventors: Takashi Shibata, Masayuki Tanaka, Masatoshi Okutomi
  • Patent number: 10943339
    Abstract: The present invention enables a high-quality filtered image to be generated even from multimodal and multispectral images containing positional deviations. An image perturbation part generates a perturbed guide image group comprising first to K-th perturbed guide images obtained by deforming a guide image. A filtering part generates a filtered image group comprising first to K-th filtered images by applying first to K-th filtering processing to a target image by using the perturbed guide image group. A reliability calculation part calculates a reliability group comprising first to K-th reliabilities for the first to K-th filtered images of the filtered image group on the basis of first to K-th correlation values between the first to K-th perturbed guide images and the target image. A weight optimization part generates, on the basis of the first to K-th reliabilities, a weight group comprising first to K-th weights to be respectively used when compositing the first to K-th filtered images.
    Type: Grant
    Filed: October 26, 2017
    Date of Patent: March 9, 2021
    Assignees: NEC CORPORATION, TOKYO INSTITUTE OF TECHNOLOGY
    Inventors: Takashi Shibata, Masatoshi Okutomi, Masayuki Tanaka
  • Patent number: 10699455
    Abstract: An image processing system in which, in order to easily analyze input images acquired by sensors, output image quality is improved so that is suitable for a user. It includes: a gradient calculation unit that calculates a desired gradient based on input images; an indication function calculation unit that calculates an indication function for the input images, the indication function defining a range that can be taken by an output image and pixel values of a reference image; a pixel value renewal unit that renews pixel values of one of the input images so as to approximate the desired gradient to produce a renewed image; and a pixel value constraint unit that updates pixel values of the renewed image so as to fall within the range that can be taken by the output image and to approximate the pixel values of the reference image, to thereby obtain the output image.
    Type: Grant
    Filed: September 14, 2016
    Date of Patent: June 30, 2020
    Assignees: NEC CORPORATION, TOKYO INSTITUTE OF TECHNOLOGY
    Inventors: Takashi Shibata, Masayuki Tanaka, Masatoshi Okutomi
  • Publication number: 20200074604
    Abstract: The present invention enables a high-quality filtered image to be generated even from multi modal and multispectral images containing positional deviations. An image perturbation part generates a perturbed guide image group comprising first to K-th perturbed guide images obtained by deforming a guide image. A filtering part generates a filtered image group comprising first to K-th filtered images by applying first to K-th filtering processing to a target image by using the perturbed guide image group. A reliability calculation part calculates a reliability group comprising first to K-th reliabilities for the first to K-th filtered images of the filtered image group on the basis of first to K-th correlation values between the first to K-th perturbed guide images and the target image. A weight optimization part generates, on the basis of the first to K-th reliabilities, a weight group comprising first to K-th weights to be respectively used when compositing the first to K-th filtered images.
    Type: Application
    Filed: October 26, 2017
    Publication date: March 5, 2020
    Applicants: NEC Corporation, TOKYO INSTITUTE OF TECHNOLOGY
    Inventors: Takashi SHIBATA, Masatoshi OKUTOMI, Masayuki TANAKA
  • Publication number: 20190206361
    Abstract: The image data display system according to the present invention makes it possible to comprehend a global distribution of measurement values and a change in details of the measurement values simultaneously. In the present invention, a color information conversion unit converts the measurement values to color information for representing the global distribution of the measurement values. A detail extraction unit extracts detail information of the measurement values from the measurement values. A detail adjustment unit adjusts the strength of detail information and generates adjusted detail information. A color information adding unit adds color information on the basis of the adjusted detail information.
    Type: Application
    Filed: September 17, 2017
    Publication date: July 4, 2019
    Applicants: NEC Corporation, TOKYO INSTITUTE OF TECHNOLOGY
    Inventors: Takashi SHIBATA, Masayuki TANAKA, Masatoshi OKUTOMI
  • Patent number: 10249020
    Abstract: An image processing unit has an image acquisition part, a correlation determination part, a reference image generation part, and an interpolation image generation part. The image acquisition part acquires an original image. The correlation determination unit determines whether the correlation of an image component of a primary reference band with image components of respective bands other than the primary reference band is either high correlation or low correlation. The reference image generation part interpolates missing pixels in the image component of the primary reference band by switching the interpolation method based on the correlation determination result obtained by the correlation determination part. The interpolation image generation part interpolates, using the correlation determination result and the primary reference image, missing pixels in at least some of the image component of the primary reference band.
    Type: Grant
    Filed: April 5, 2017
    Date of Patent: April 2, 2019
    Assignees: TOKYO INSTITUTE OF TECHNOLOGY, OLYMPUS CORPORATION
    Inventors: Sunao Kikuchi, Yusuke Monno, Daisuke Kiku, Masayuki Tanaka, Masatoshi Okutomi
  • Publication number: 20180322672
    Abstract: An image processing system in which, in order to easily analyze input images acquired by sensors, output image quality is improved so that is suitable for a user. It includes: a gradient calculation unit that calculates a desired gradient based on input images; an indication function calculation unit that calculates an indication function for the input images, the indication function defining a range that can be taken by an output image and pixel values of a reference image; a pixel value renewal unit that renews pixel values of one of the input images so as to approximate the desired gradient to produce a renewed image; and a pixel value constraint unit that updates pixel values of the renewed image so as to fall within the range that can be taken by the output image and to approximate the pixel values of the reference image, to thereby obtain the output image.
    Type: Application
    Filed: September 14, 2016
    Publication date: November 8, 2018
    Applicants: NEC CORPORATION, TOKYO INSTITUTE OF TECHNOLOGY
    Inventors: Takashi SHIBATA, Masayuki TANAKA, Masatoshi OKUTOMI
  • Publication number: 20180262748
    Abstract: A camera calibration board, which is arranged three-dimensionally above a board, includes the board, a plurality of flat plates, and a plurality of support columns having the same length. The plurality of flat plates are spatially arranged in a plane different from a plane in which the board is arranged. The board and each of the plurality of flat plates have different reflectances with respect to visible light. With this configuration, it is possible to accurately measure extrinsic parameters between cameras, which are required for calibrating cameras that use different types of image sensors, in order to easily analyze a group of images acquired from a plurality of sensors.
    Type: Application
    Filed: September 26, 2016
    Publication date: September 13, 2018
    Applicants: NEC Corporation, TOKYO INSTITUTE OF TECHNOLOGY
    Inventors: Takashi SHIBATA, Masayuki TANAKA, Masatoshi OKUTOMI
  • Publication number: 20180174282
    Abstract: An image processing system includes: a weight determination circuitry configured to determine a band containing important information from among a group of images, which are acquired by a plurality of sensors, and to express a degree of importance of the band as a weight; a calculation circuitry configured to calculate, using the weight, an amount calculated based on a gradient of an image based on a gradient of each image, that is calculated based on the group of images, in order to restrict a gradient of an output image; and an image optimization circuitry configured to compose the output image using the amount calculated based on the gradient of the image.
    Type: Application
    Filed: June 10, 2016
    Publication date: June 21, 2018
    Inventors: Takashi SHIBATA, Masayuki TANAKA, MASATOSHI OKUTOMI
  • Patent number: 9747675
    Abstract: Provided is an information processing system configured to: receive a plurality of images; select a standard image; search, in extracting partial images for complementing a too bright region/too dark region in the standard image from a reference images, using correction images obtained by subjecting each of the images to multivalued processing for each division of luminance components, for regions having matching shapes of respective regions included in the correction image of the standard image and the correction images of the other images; and complement image portions corresponding to the too bright region and/or too dark region in the correction image of the standard image using image portions, which are matching regions and correspond to appropriately bright regions, to thereby generate a synthetic image.
    Type: Grant
    Filed: October 17, 2014
    Date of Patent: August 29, 2017
    Assignees: NEC Corporation, Tokyo Institute of Technology
    Inventors: Takashi Shibata, Shuji Senda, Masayuki Tanaka, Masatoshi Okutomi, Takehito Hayami
  • Patent number: 9741143
    Abstract: A basis image is converted into a more functional image by image synthesis technology using a number of imaging devices arranged independently of each other. A multocular imaging system is provided with a plurality of imaging parts that can be arranged independently of each other, a similar component search part operable to acquire a basis image outputted from at least one imaging part of the plurality of imaging parts and a reference image outputted from another imaging part of the plurality of imaging parts and to search a similar component included in the reference image for each of components included in the basis image, and an image synthesis part operable to perform a synthesis process on at least one component included in the basis image into a desired image with reference to the similar component extracted by the similar component search part and to output the desired image as a synthesis image.
    Type: Grant
    Filed: April 22, 2014
    Date of Patent: August 22, 2017
    Assignees: NEC Corporation, Tokyo Institute of Technology
    Inventors: Shuji Senda, Akihiko Iketani, Takashi Shibata, Masatoshi Okutomi, Masayuki Tanaka
  • Publication number: 20170206631
    Abstract: An image processing unit has an image acquisition part, a correlation determination part, a reference image generation part, and an interpolation image generation part. The image acquisition part acquires an original image. The correlation determination unit determines whether the correlation of an image component of a primary reference band with image components of respective bands other than the primary reference band is either high correlation or low correlation. The reference image generation part interpolates missing pixels in the image component of the primary reference band by switching the interpolation method based on the correlation determination result obtained by the correlation determination part. The interpolation image generation part interpolates, using the correlation determination result and the primary reference image, missing pixels in at least some of the image component of the primary reference band.
    Type: Application
    Filed: April 5, 2017
    Publication date: July 20, 2017
    Applicants: TOKYO INSTITUTE OF TECHNOLOGY, OLYMPUS CORPORATION
    Inventors: Sunao KIKUCHI, Yusuke MONNO, Daisuke KIKU, Masayuki TANAKA, Masatoshi OKUTOMI
  • Publication number: 20160292835
    Abstract: Provided is an information processing system configured to: receive a plurality of images; select a standard image; search, in extracting partial images for complementing a too bright region/too dark region in the standard image from a reference images, using correction images obtained by subjecting each of the images to multivalued processing for each division of luminance components, for regions having matching shapes of respective regions included in the correction image of the standard image and the correction images of the other images; and complement image portions corresponding to the too bright region and/or too dark region in the correction image of the standard image using image portions, which are matching regions and correspond to appropriately bright regions, to thereby generate a synthetic image.
    Type: Application
    Filed: October 17, 2014
    Publication date: October 6, 2016
    Applicants: NEC Corporation, Tokyo Institute of Technology
    Inventors: Takashi SHIBATA, Shuji SENDA, Masayuki TANAKA, Masatoshi OKUTOMI, Takehito HAYAMI
  • Publication number: 20160098852
    Abstract: A basis image is converted into a more functional image by image synthesis technology using a number of imaging devices arranged independently of each other. A multocular imaging system is provided with a plurality of imaging parts that can be arranged independently of each other, a similar component search part operable to acquire a basis image outputted from at least one imaging part of the plurality of imaging parts and a reference image outputted from another imaging part of the plurality of imaging parts and to search a similar component included in the reference image for each of components included in the basis image, and an image synthesis part operable to perform a synthesis process on at least one component included in the basis image into a desired image with reference to the similar component extracted by the similar component search part and to output the desired image as a synthesis image.
    Type: Application
    Filed: April 22, 2014
    Publication date: April 7, 2016
    Applicants: NEC Corporation, Tokyo Institute of Technology
    Inventors: Shuji SENDA, Akihiko IKETANI, Takashi SHIBATA, Masatoshi OKUTOMI, Masayuki TANAKA
  • Patent number: 9294654
    Abstract: The present invention provides a high-resolution image generation method which is capable of generating a high-resolution image from multiple low-resolution images having displacements without using an iterative computation. A high-resolution image generation method for generating a high-resolution image from multiple low-resolution images having displacements, comprises a first step of performing a registration processing of multiple low-resolution images; a second step of generating an average image having the undefined pixels and a weighted image based on the displacement information obtained by the registration processing and multiple low-resolution images; and a third step of generating the high-resolution image by estimating pixel values of the undefined pixels included in the average image.
    Type: Grant
    Filed: September 26, 2007
    Date of Patent: March 22, 2016
    Assignee: TOKYO INSTITUTE OF TECHNOLOGY
    Inventors: Masayuki Tanaka, Masatoshi Okutomi