Patents by Inventor Masatoshi Okutomi
Masatoshi Okutomi has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11758110Abstract: A camera calibration information acquisition device acquires captured images of a camera calibration target from two or more cameras, detects, from each image, a coordinate of a feature point in the image, calculates—an internal parameter for each camera by using the feature point, calculates, for each camera, a magnitude of error in the coordinate of the feature point, calculates a value for an external parameter of the cameras by using the magnitude of the error, the coordinate of the feature point, and an error function set so that a penalty for error in calculating the external parameter decreases as the magnitude of the error in the coordinate of the feature point in the image increases.Type: GrantFiled: February 27, 2020Date of Patent: September 12, 2023Assignees: NEC CORPORATION, TOKYO INSTITUTE OF TECHNOLOGYInventors: Takashi Shibata, Masatoshi Okutomi, Masayuki Tanaka, Thapanapong Rukkanchanunt
-
Patent number: 11669997Abstract: An image processing system, which estimates a position and a pose of a camera and performs three-dimensional reconstruction processing of an object having a cylindrical shape by using a photographed image acquired by photographing an inside of the object with the camera, includes a processor. The processor estimates a first center axis of the cylindrical shape by using a group of three-dimensional points obtained by reconstructing, in a three-dimensional space, a group of feature points extracted from the photographed image. In addition, the processor performs bundle adjustment for correcting the position and the pose of the camera and the coordinates of the group of three-dimensional points by using a condition for minimizing a total sum of differences between a radius of the cylindrical shape and respective distances from the first center axis to individual three-dimensional points that constitute the group of three-dimensional points.Type: GrantFiled: May 26, 2021Date of Patent: June 6, 2023Assignees: Tokyo Institute of TechnologyInventors: Naoyuki Miyashita, Masatoshi Okutomi, Sho Kagami
-
Publication number: 20220132092Abstract: A camera calibration information acquisition device acquires captured images of a camera calibration target from two or more cameras, detects, from each image, a coordinate of a feature point in the image, calculates—an internal parameter for each camera by using the feature point, calculates, for each camera, a magnitude of error in the coordinate of the feature point, calculates a value for an external parameter of the cameras by using the magnitude of the error, the coordinate of the feature point, and an error function set so that a penalty for error in calculating the external parameter decreases as the magnitude of the error in the coordinate of the feature point in the image increases.Type: ApplicationFiled: February 27, 2020Publication date: April 28, 2022Applicants: NEC CORPORATION, TOKYO INSTITUTE OF TECHNOLOGYInventors: Takashi SHIBATA, Masatoshi OKUTOMI, Masayuki TANAKA, Thapanapong RUKKANCHANUNT
-
Publication number: 20210374990Abstract: An image processing system, which estimates a position and a pose of a camera and performs three-dimensional reconstruction processing of an object having a cylindrical shape by using a photographed image acquired by photographing an inside of the object with the camera, includes a processor. The processor estimates a first center axis of the cylindrical shape by using a group of three-dimensional points obtained by reconstructing, in a three-dimensional space, a group of feature points extracted from the photographed image. In addition, the processor performs bundle adjustment for correcting the position and the pose of the camera and the coordinates of the group of three-dimensional points by using a condition for minimizing a total sum of differences between a radius of the cylindrical shape and respective distances from the first center axis to individual three-dimensional points that constitute the group of three-dimensional points.Type: ApplicationFiled: May 26, 2021Publication date: December 2, 2021Applicants: OLYMPUS CORPORATION, TOKYO INSTITUTE OF TECHNOLOGYInventors: Naoyuki Miyashita, Masatoshi Okutomi, Sho Kagami
-
Patent number: 11010876Abstract: An image processing system includes: a weight determination circuitry configured to determine a band containing important information from among a group of images, which are acquired by a plurality of sensors, and to express a degree of importance of the band as a weight; a calculation circuitry configured to calculate, using the weight, an amount calculated based on a gradient of an image based on a gradient of each image, that is calculated based on the group of images, in order to restrict a gradient of an output image; and an image optimization circuitry configured to compose the output image using the amount calculated based on the gradient of the image.Type: GrantFiled: June 10, 2016Date of Patent: May 18, 2021Assignees: NEC Corporation, TOKYO INSTITUTE OF TECHNOLOGYInventors: Takashi Shibata, Masayuki Tanaka, Masatoshi Okutomi
-
Patent number: 10943561Abstract: The image data display system according to the present invention makes it possible to comprehend a global distribution of measurement values and a change in details of the measurement values simultaneously. In the present invention, a color information conversion unit converts the measurement values to color information for representing the global distribution of the measurement values. A detail extraction unit extracts detail information of the measurement values from the measurement values. A detail adjustment unit adjusts the strength of detail information and generates adjusted detail information. A color information adding unit adds color information on the basis of the adjusted detail information.Type: GrantFiled: September 7, 2017Date of Patent: March 9, 2021Assignees: NEC Corporation, TOKYO INSTITUTE OF TECHNOLOGYInventors: Takashi Shibata, Masayuki Tanaka, Masatoshi Okutomi
-
Patent number: 10943339Abstract: The present invention enables a high-quality filtered image to be generated even from multimodal and multispectral images containing positional deviations. An image perturbation part generates a perturbed guide image group comprising first to K-th perturbed guide images obtained by deforming a guide image. A filtering part generates a filtered image group comprising first to K-th filtered images by applying first to K-th filtering processing to a target image by using the perturbed guide image group. A reliability calculation part calculates a reliability group comprising first to K-th reliabilities for the first to K-th filtered images of the filtered image group on the basis of first to K-th correlation values between the first to K-th perturbed guide images and the target image. A weight optimization part generates, on the basis of the first to K-th reliabilities, a weight group comprising first to K-th weights to be respectively used when compositing the first to K-th filtered images.Type: GrantFiled: October 26, 2017Date of Patent: March 9, 2021Assignees: NEC CORPORATION, TOKYO INSTITUTE OF TECHNOLOGYInventors: Takashi Shibata, Masatoshi Okutomi, Masayuki Tanaka
-
Patent number: 10699455Abstract: An image processing system in which, in order to easily analyze input images acquired by sensors, output image quality is improved so that is suitable for a user. It includes: a gradient calculation unit that calculates a desired gradient based on input images; an indication function calculation unit that calculates an indication function for the input images, the indication function defining a range that can be taken by an output image and pixel values of a reference image; a pixel value renewal unit that renews pixel values of one of the input images so as to approximate the desired gradient to produce a renewed image; and a pixel value constraint unit that updates pixel values of the renewed image so as to fall within the range that can be taken by the output image and to approximate the pixel values of the reference image, to thereby obtain the output image.Type: GrantFiled: September 14, 2016Date of Patent: June 30, 2020Assignees: NEC CORPORATION, TOKYO INSTITUTE OF TECHNOLOGYInventors: Takashi Shibata, Masayuki Tanaka, Masatoshi Okutomi
-
Publication number: 20200074604Abstract: The present invention enables a high-quality filtered image to be generated even from multi modal and multispectral images containing positional deviations. An image perturbation part generates a perturbed guide image group comprising first to K-th perturbed guide images obtained by deforming a guide image. A filtering part generates a filtered image group comprising first to K-th filtered images by applying first to K-th filtering processing to a target image by using the perturbed guide image group. A reliability calculation part calculates a reliability group comprising first to K-th reliabilities for the first to K-th filtered images of the filtered image group on the basis of first to K-th correlation values between the first to K-th perturbed guide images and the target image. A weight optimization part generates, on the basis of the first to K-th reliabilities, a weight group comprising first to K-th weights to be respectively used when compositing the first to K-th filtered images.Type: ApplicationFiled: October 26, 2017Publication date: March 5, 2020Applicants: NEC Corporation, TOKYO INSTITUTE OF TECHNOLOGYInventors: Takashi SHIBATA, Masatoshi OKUTOMI, Masayuki TANAKA
-
Publication number: 20190206361Abstract: The image data display system according to the present invention makes it possible to comprehend a global distribution of measurement values and a change in details of the measurement values simultaneously. In the present invention, a color information conversion unit converts the measurement values to color information for representing the global distribution of the measurement values. A detail extraction unit extracts detail information of the measurement values from the measurement values. A detail adjustment unit adjusts the strength of detail information and generates adjusted detail information. A color information adding unit adds color information on the basis of the adjusted detail information.Type: ApplicationFiled: September 17, 2017Publication date: July 4, 2019Applicants: NEC Corporation, TOKYO INSTITUTE OF TECHNOLOGYInventors: Takashi SHIBATA, Masayuki TANAKA, Masatoshi OKUTOMI
-
Patent number: 10249020Abstract: An image processing unit has an image acquisition part, a correlation determination part, a reference image generation part, and an interpolation image generation part. The image acquisition part acquires an original image. The correlation determination unit determines whether the correlation of an image component of a primary reference band with image components of respective bands other than the primary reference band is either high correlation or low correlation. The reference image generation part interpolates missing pixels in the image component of the primary reference band by switching the interpolation method based on the correlation determination result obtained by the correlation determination part. The interpolation image generation part interpolates, using the correlation determination result and the primary reference image, missing pixels in at least some of the image component of the primary reference band.Type: GrantFiled: April 5, 2017Date of Patent: April 2, 2019Assignees: TOKYO INSTITUTE OF TECHNOLOGY, OLYMPUS CORPORATIONInventors: Sunao Kikuchi, Yusuke Monno, Daisuke Kiku, Masayuki Tanaka, Masatoshi Okutomi
-
Publication number: 20180322672Abstract: An image processing system in which, in order to easily analyze input images acquired by sensors, output image quality is improved so that is suitable for a user. It includes: a gradient calculation unit that calculates a desired gradient based on input images; an indication function calculation unit that calculates an indication function for the input images, the indication function defining a range that can be taken by an output image and pixel values of a reference image; a pixel value renewal unit that renews pixel values of one of the input images so as to approximate the desired gradient to produce a renewed image; and a pixel value constraint unit that updates pixel values of the renewed image so as to fall within the range that can be taken by the output image and to approximate the pixel values of the reference image, to thereby obtain the output image.Type: ApplicationFiled: September 14, 2016Publication date: November 8, 2018Applicants: NEC CORPORATION, TOKYO INSTITUTE OF TECHNOLOGYInventors: Takashi SHIBATA, Masayuki TANAKA, Masatoshi OKUTOMI
-
Publication number: 20180262748Abstract: A camera calibration board, which is arranged three-dimensionally above a board, includes the board, a plurality of flat plates, and a plurality of support columns having the same length. The plurality of flat plates are spatially arranged in a plane different from a plane in which the board is arranged. The board and each of the plurality of flat plates have different reflectances with respect to visible light. With this configuration, it is possible to accurately measure extrinsic parameters between cameras, which are required for calibrating cameras that use different types of image sensors, in order to easily analyze a group of images acquired from a plurality of sensors.Type: ApplicationFiled: September 26, 2016Publication date: September 13, 2018Applicants: NEC Corporation, TOKYO INSTITUTE OF TECHNOLOGYInventors: Takashi SHIBATA, Masayuki TANAKA, Masatoshi OKUTOMI
-
Publication number: 20180174282Abstract: An image processing system includes: a weight determination circuitry configured to determine a band containing important information from among a group of images, which are acquired by a plurality of sensors, and to express a degree of importance of the band as a weight; a calculation circuitry configured to calculate, using the weight, an amount calculated based on a gradient of an image based on a gradient of each image, that is calculated based on the group of images, in order to restrict a gradient of an output image; and an image optimization circuitry configured to compose the output image using the amount calculated based on the gradient of the image.Type: ApplicationFiled: June 10, 2016Publication date: June 21, 2018Inventors: Takashi SHIBATA, Masayuki TANAKA, MASATOSHI OKUTOMI
-
Patent number: 9747675Abstract: Provided is an information processing system configured to: receive a plurality of images; select a standard image; search, in extracting partial images for complementing a too bright region/too dark region in the standard image from a reference images, using correction images obtained by subjecting each of the images to multivalued processing for each division of luminance components, for regions having matching shapes of respective regions included in the correction image of the standard image and the correction images of the other images; and complement image portions corresponding to the too bright region and/or too dark region in the correction image of the standard image using image portions, which are matching regions and correspond to appropriately bright regions, to thereby generate a synthetic image.Type: GrantFiled: October 17, 2014Date of Patent: August 29, 2017Assignees: NEC Corporation, Tokyo Institute of TechnologyInventors: Takashi Shibata, Shuji Senda, Masayuki Tanaka, Masatoshi Okutomi, Takehito Hayami
-
Patent number: 9741143Abstract: A basis image is converted into a more functional image by image synthesis technology using a number of imaging devices arranged independently of each other. A multocular imaging system is provided with a plurality of imaging parts that can be arranged independently of each other, a similar component search part operable to acquire a basis image outputted from at least one imaging part of the plurality of imaging parts and a reference image outputted from another imaging part of the plurality of imaging parts and to search a similar component included in the reference image for each of components included in the basis image, and an image synthesis part operable to perform a synthesis process on at least one component included in the basis image into a desired image with reference to the similar component extracted by the similar component search part and to output the desired image as a synthesis image.Type: GrantFiled: April 22, 2014Date of Patent: August 22, 2017Assignees: NEC Corporation, Tokyo Institute of TechnologyInventors: Shuji Senda, Akihiko Iketani, Takashi Shibata, Masatoshi Okutomi, Masayuki Tanaka
-
Publication number: 20170206631Abstract: An image processing unit has an image acquisition part, a correlation determination part, a reference image generation part, and an interpolation image generation part. The image acquisition part acquires an original image. The correlation determination unit determines whether the correlation of an image component of a primary reference band with image components of respective bands other than the primary reference band is either high correlation or low correlation. The reference image generation part interpolates missing pixels in the image component of the primary reference band by switching the interpolation method based on the correlation determination result obtained by the correlation determination part. The interpolation image generation part interpolates, using the correlation determination result and the primary reference image, missing pixels in at least some of the image component of the primary reference band.Type: ApplicationFiled: April 5, 2017Publication date: July 20, 2017Applicants: TOKYO INSTITUTE OF TECHNOLOGY, OLYMPUS CORPORATIONInventors: Sunao KIKUCHI, Yusuke MONNO, Daisuke KIKU, Masayuki TANAKA, Masatoshi OKUTOMI
-
Publication number: 20160292835Abstract: Provided is an information processing system configured to: receive a plurality of images; select a standard image; search, in extracting partial images for complementing a too bright region/too dark region in the standard image from a reference images, using correction images obtained by subjecting each of the images to multivalued processing for each division of luminance components, for regions having matching shapes of respective regions included in the correction image of the standard image and the correction images of the other images; and complement image portions corresponding to the too bright region and/or too dark region in the correction image of the standard image using image portions, which are matching regions and correspond to appropriately bright regions, to thereby generate a synthetic image.Type: ApplicationFiled: October 17, 2014Publication date: October 6, 2016Applicants: NEC Corporation, Tokyo Institute of TechnologyInventors: Takashi SHIBATA, Shuji SENDA, Masayuki TANAKA, Masatoshi OKUTOMI, Takehito HAYAMI
-
Publication number: 20160098852Abstract: A basis image is converted into a more functional image by image synthesis technology using a number of imaging devices arranged independently of each other. A multocular imaging system is provided with a plurality of imaging parts that can be arranged independently of each other, a similar component search part operable to acquire a basis image outputted from at least one imaging part of the plurality of imaging parts and a reference image outputted from another imaging part of the plurality of imaging parts and to search a similar component included in the reference image for each of components included in the basis image, and an image synthesis part operable to perform a synthesis process on at least one component included in the basis image into a desired image with reference to the similar component extracted by the similar component search part and to output the desired image as a synthesis image.Type: ApplicationFiled: April 22, 2014Publication date: April 7, 2016Applicants: NEC Corporation, Tokyo Institute of TechnologyInventors: Shuji SENDA, Akihiko IKETANI, Takashi SHIBATA, Masatoshi OKUTOMI, Masayuki TANAKA
-
Patent number: 9294654Abstract: The present invention provides a high-resolution image generation method which is capable of generating a high-resolution image from multiple low-resolution images having displacements without using an iterative computation. A high-resolution image generation method for generating a high-resolution image from multiple low-resolution images having displacements, comprises a first step of performing a registration processing of multiple low-resolution images; a second step of generating an average image having the undefined pixels and a weighted image based on the displacement information obtained by the registration processing and multiple low-resolution images; and a third step of generating the high-resolution image by estimating pixel values of the undefined pixels included in the average image.Type: GrantFiled: September 26, 2007Date of Patent: March 22, 2016Assignee: TOKYO INSTITUTE OF TECHNOLOGYInventors: Masayuki Tanaka, Masatoshi Okutomi