Patents by Inventor Makoto Tomioka

Makoto Tomioka has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11961182
    Abstract: An information processing apparatus generates a map element that is based on a position and orientation of an image capturing apparatus and three-dimensional position information about a feature point included in an image, generates three-dimensional map information based on a plurality of map elements at a plurality of different positions and orientations, corrects, in such a way as to make smaller a reprojection error of a common feature point in a first map element group, at least one of a position and orientation of the image capturing apparatus and the three-dimensional position included in the first map element group, and corrects, in such a way as to make smaller a reprojection error of the common feature point with use of a second map element group, at least one of a position and orientation of the image capturing apparatus and the three-dimensional position information included in the second map element group.
    Type: Grant
    Filed: March 4, 2022
    Date of Patent: April 16, 2024
    Assignee: Canon Kabushiki Kaisha
    Inventors: Takatoshi Sato, Makoto Tomioka
  • Patent number: 11830216
    Abstract: There is provided with an information processing apparatus. From an image capturing apparatus which can move, a captured image of an object is obtained. The position of the image capturing apparatus is derived using the captured image and a three-dimensional map. The three-dimensional map is corrected using information indicating a reliability of: information indicating the three-dimensional position of the feature included in a predefined area in the three-dimensional map held by the holding unit; and information indicating a three-dimensional position of another feature of the object, the information obtained based on the captured image from an expanded area of the predefined area in the three-dimensional map held by the holding unit.
    Type: Grant
    Filed: April 13, 2021
    Date of Patent: November 28, 2023
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Daisuke Kotake, Akihiro Katayama, Makoto Tomioka, Nozomu Kasuya, Takayuki Yamada, Masahiro Suzuki, Masakazu Fujiki
  • Publication number: 20230342956
    Abstract: An information processing device that improves accuracy of a map used to measure a position and an orientation of a movable apparatus includes: a map acquisition unit configured to acquire a map for measuring a position and an orientation of a movable apparatus; a detection unit configured to detect a visual index from a drawing information which corresponds to a real space that the movable apparatus moves or an object in the real space; a registration unit configured to perform registration of a coordinate system between the map and the drawing information; an association unit configured to perform association between the visual index included in the drawing information after the registration and a constituent element included in the map; and a correction unit configured to correct the map based on a result of the association.
    Type: Application
    Filed: April 3, 2023
    Publication date: October 26, 2023
    Inventors: SHINJI OHIRA, MASAKAZU FUJIKI, MAKOTO TOMIOKA
  • Publication number: 20230326131
    Abstract: An information processing apparatus generates a map element that is based on a position and orientation of an image capturing apparatus and three-dimensional position information about a feature point included in an image, generates three-dimensional map information based on a plurality of map elements at a plurality of different positions and orientations, corrects, in such a way as to make smaller a reprojection error of a common feature point in a first map element group, at least one of a position and orientation of the image capturing apparatus and the three-dimensional position included in the first map element group, and corrects, in such a way as to make smaller a reprojection error of the common feature point with use of a second map element group, at least one of a position and orientation of the image capturing apparatus and the three-dimensional position information included in the second map element group.
    Type: Application
    Filed: March 4, 2022
    Publication date: October 12, 2023
    Inventors: Takatoshi Sato, Makoto Tomioka
  • Publication number: 20230243667
    Abstract: An information processing apparatus comprising a memory storing instructions; and a processor executing the instructions causing the information processing apparatus to acquire sensor information from a sensor mounted on a moving body, generate map data based on the sensor information, calculate a use appropriateness degree of the map data based on at least one of the sensor information and the map data, and determine whether or not to use the map data in a position and/or orientation measurement of the moving body that is based on the use appropriateness degree.
    Type: Application
    Filed: January 5, 2023
    Publication date: August 3, 2023
    Inventors: Takumi Miyakawa, Masakazu Fujiki, Takatomo Kawai, Makoto Tomioka
  • Patent number: 11715218
    Abstract: An information processing obtains a first image which is obtained by using a first camera to capture a three-dimensional space; obtains map information that is generated based on a second transformed image obtained by using second transformation information to geometrically transform a second image which has been captured by using a second camera to capture the three-dimensional space; generates a first transformed image by using first transformation information to geometrically transform the first image; and collates the map information and the first transformed image. The first transformation information and the second transformation information are set so that a geometric correspondence relationship between the three-dimensional space and the first transformed image and a geometric correspondence relationship between the three-dimensional space and the second transformed image will have a common geometric correspondence relationship.
    Type: Grant
    Filed: June 28, 2021
    Date of Patent: August 1, 2023
    Assignee: Canon Kabushiki Kaisha
    Inventor: Makoto Tomioka
  • Patent number: 11713977
    Abstract: An information processing apparatus includes an update unit and an obtaining unit. The obtaining unit obtains a second position of a map feature point included in map information based on the map information and information obtained from a vehicle sensor. The map information includes a map feature point first position measured in an environment including a closed route along which the vehicle travels. The sensor-obtained information includes a sensor feature point measured by the sensor mounted on the vehicle while the vehicle travels along the closed route. Where a distance between an estimated vehicle first position and an estimated vehicle second position is greater than a threshold, map information updating is restrained. Where the vehicle traveling near the vehicle first position continues traveling along the closed route, the update unit updates the map information between when the vehicle leaves the vehicle first position and nears the vehicle second position.
    Type: Grant
    Filed: December 10, 2020
    Date of Patent: August 1, 2023
    Assignee: Canon Kabushiki Kaisha
    Inventors: Makoto Tomioka, Masakazu Fujiki
  • Publication number: 20230168686
    Abstract: An information processing apparatus for determining control values for controlling a position of a vehicle for conveying a cargo includes an acquisition unit configured to acquire first information for identifying a three-dimensional shape of the cargo based on a captured first image of the cargo, and second information for identifying, based on a captured second image of an environment where the vehicle moves, a distance between an object in the environment and the vehicle, and a determination unit configured to, based on the first information and the second information, determine the control values for preventing the cargo and the object from coming closer than a predetermined distance.
    Type: Application
    Filed: January 12, 2023
    Publication date: June 1, 2023
    Inventors: Keisuke Tateno, Makoto Tomioka
  • Publication number: 20230110992
    Abstract: The information processing apparatus is provided with a measurement unit configured to perform position and orientation measurement of at least one of a position and an orientation of a moving body based on a first sensor data and a second sensor data stored in a moving body, a control content determination unit configured to determine control content of the moving body based on at least one of the position and orientation measured by the measurement unit, a dependency degree acquisition unit configured to acquire a dependency degree of the second sensor data with respect to the first sensor data, and a reliability degree calculation unit configured to calculate a reliability degree that represents a smallness of an accumulation value of the dependency degree, wherein the control content determination unit is configured to determine a control content of the moving body based on the reliability degree.
    Type: Application
    Filed: October 5, 2022
    Publication date: April 13, 2023
    Inventors: Yukio Numakami, Makoto Tomioka, Masakazu Fujiki
  • Publication number: 20230072508
    Abstract: The information processing apparatus comprises an inertial sensor provided in a vehicle; a position and orientation estimation unit for performing estimation processing for a position and orientation of the vehicle by using an output from the inertial sensor; a movement state acquisition unit for acquiring a movement state of the vehicle; and a first weighting determining unit for determining a first weighting in relation to output information from the inertial sensor in the estimation processing of the position and orientation estimation unit based on the movement state that has been acquired by the movement state acquisition unit.
    Type: Application
    Filed: September 2, 2022
    Publication date: March 9, 2023
    Inventors: Keiichi Yamamoto, Makoto Tomioka
  • Patent number: 11573574
    Abstract: An information processing apparatus for determining control values for controlling a position of a vehicle for conveying a cargo includes an acquisition unit configured to acquire first information for identifying a three-dimensional shape of the cargo based on a captured first image of the cargo, and second information for identifying, based on a captured second image of an environment where the vehicle moves, a distance between an object in the environment and the vehicle, and a determination unit configured to, based on the first information and the second information, determine the control values for preventing the cargo and the object from coming closer than a predetermined distance.
    Type: Grant
    Filed: August 23, 2019
    Date of Patent: February 7, 2023
    Assignee: Canon Kabushiki Kaisha
    Inventors: Keisuke Tateno, Makoto Tomioka
  • Publication number: 20220379903
    Abstract: An information processing device measures a position of the moving object, acquires success or failure information relating to success or failure of the position measurement, acquires at least one of histories, determines to interrupt driving control of the moving object, and decides, if the driving control of the moving object is determined to be interrupted, a restart method. The histories include a history of the position of the moving object, a driving history of the moving object, a history of illuminance around the moving object, and a history of a direction of an imaging element mounted in the moving object. The driving control of the moving object is interrupted on the basis of the success or failure information. The restart method restarts the driving control of the moving object on the basis of at least one of the histories.
    Type: Application
    Filed: May 24, 2022
    Publication date: December 1, 2022
    Inventors: Shoko Miura, Makoto Tomioka, Daisuke Kotake, Ayato Imai
  • Publication number: 20220292713
    Abstract: An information processing apparatus includes a first selection unit configured to select at least one map element from first three-dimensional map information including map elements each including a position and orientation of an image capturing apparatus mounted on a mobile object and three-dimensional positional information in an environment about a feature point included in an image of the environment captured by the image capturing apparatus, a second selection unit configured to select a map element including a feature point with three-dimensional positional information within a predetermined distance from a position indicated by the three-dimensional positional information about a feature point included in the map element selected by the first selection unit from map elements in second three-dimensional map information preliminarily created for the environment, and an association unit configured to associate the map element selected by the first selection unit with the map element selected by the second
    Type: Application
    Filed: March 4, 2022
    Publication date: September 15, 2022
    Inventors: Shoko Miura, Makoto Tomioka
  • Patent number: 11400598
    Abstract: An information processing apparatus that obtains, with high accuracy, the gripping position for gripping the target object by a gripping apparatus is provided. The information processing apparatus includes an image acquisition unit that acquires a captured image obtained by capturing an image of the target object, an image feature detection unit that detects a plurality of image features in the captured image, and a unit detection unit that detects a unit of a pattern in which a plurality of image features repeatedly appear. In addition, the information processing apparatus further includes a snipping position determining unit that determines a gripping position using the unit detected by the unit detection unit.
    Type: Grant
    Filed: October 1, 2018
    Date of Patent: August 2, 2022
    Assignee: Canon Kabushiki Kaisha
    Inventors: Makoto Tomioka, Kazuhiko Kobayashi, Tomoaki Higo, Masahiro Suzuki
  • Patent number: 11393123
    Abstract: An information processing device finds a position/orientation of an image capturing unit including first and second cameras whose image capturing fields are partially overlapped, the information processing device comprises an input unit that inputs first and second images from the first and second cameras a holding unit holding a learning model; a first estimating unit that estimates first provisional geometric information from the first and second images; a second estimating unit that estimates second provisional geometric information on the basis of the first image and the learning model; a third estimating unit that estimates third provisional geometric information on the basis of the second image and the learning model; and a generating unit that, on the basis of the first, second, and third provisional geometric information, generates the position/orientation information of the image capturing unit.
    Type: Grant
    Filed: July 6, 2020
    Date of Patent: July 19, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Tomoaki Higo, Daisuke Kotake, Masahiro Suzuki, Nozomu Kasuya, Makoto Tomioka
  • Patent number: 11348323
    Abstract: Based on a three-dimensional map in which three-dimensional information of a scene captured by an image capturing apparatus and a position and orientation of the apparatus are associated with each other and an image captured by the apparatus, a first position and orientation of the apparatus at the time of capturing the image is derived. The map is updated based on the captured image and the first position and orientation. A relative position and orientation between the first position and orientation and a second position and orientation of the apparatus derived by a method different from a method of deriving the first position and orientation or at a point of time different from a point of time of deriving the first position and orientation is derived. The map is corrected based on the relative position and orientation.
    Type: Grant
    Filed: January 8, 2020
    Date of Patent: May 31, 2022
    Assignee: Canon Kabushiki Kaisha
    Inventors: Daisuke Kotake, Makoto Tomioka, Nozomu Kasuya
  • Publication number: 20220137626
    Abstract: Difference information between a first element of a vehicle estimated in accordance with measurement information acquired by a first sensor and a second element of the vehicle acquired simultaneously with the first element is acquired. The difference information is according to the same coordinate system as the first element and the second element. An element for controlling movement of the vehicle is selected from the first element and the second element. When the element for controlling movement of the vehicle is switched to another element of the first element and the second element, the other element selected is corrected by using the difference information.
    Type: Application
    Filed: October 27, 2021
    Publication date: May 5, 2022
    Inventors: Shinji Ohira, Makoto Tomioka, Daisuke Kotake, Masakazu Fujiki
  • Patent number: 11295142
    Abstract: Of a plurality of learning models learned to output geometric information corresponding to a captured image, a learning model corresponding to a setting region is acquired.
    Type: Grant
    Filed: December 28, 2018
    Date of Patent: April 5, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Sonoko Miyatani, Masakazu Fujiki, Kazuhiko Kobayashi, Masahiro Suzuki, Makoto Tomioka
  • Publication number: 20210407113
    Abstract: An information processing obtains a first image which is obtained by using a first camera to capture a three-dimensional space; obtains map information that is generated based on a second transformed image obtained by using second transformation information to geometrically transform a second image which has been captured by using a second camera to capture the three-dimensional space; generates a first transformed image by using first transformation information to geometrically transform the first image; and collates the map information and the first transformed image. The first transformation information and the second transformation information are set so that a geometric correspondence relationship between the three-dimensional space and the first transformed image and a geometric correspondence relationship between the three-dimensional space and the second transformed image will have a common geometric correspondence relationship.
    Type: Application
    Filed: June 28, 2021
    Publication date: December 30, 2021
    Inventor: Makoto Tomioka
  • Patent number: 11144786
    Abstract: An information processing apparatus comprising: a holding unit configured to hold a plurality of learning models for estimating geometric information based on an input image captured by an image capturing apparatus; a selection unit configured to calculate, for each of the learning models, an evaluation value that indicates suitability of the learning model to a scene of the input image, and select a learning model from the plurality of learning models based on the evaluation values; and an estimation unit configured to estimate first geometric information using the input image and the selected learning model.
    Type: Grant
    Filed: October 30, 2018
    Date of Patent: October 12, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Makoto Tomioka, Daisuke Kotake, Nozomu Kasuya, Masahiro Suzuki