Patents by Inventor Nozomu Kasuya

Nozomu Kasuya has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11836879
    Abstract: An information processing apparatus for correcting a shift between a first three-dimensional position in an image capturing region that is identified based on a position of a first feature point on a first image and a second three-dimensional position in an image capturing region that is identified based on a position of a second feature point corresponding to the first feature point on a second image.
    Type: Grant
    Filed: February 3, 2021
    Date of Patent: December 5, 2023
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Nozomu Kasuya
  • Patent number: 11830216
    Abstract: There is provided with an information processing apparatus. From an image capturing apparatus which can move, a captured image of an object is obtained. The position of the image capturing apparatus is derived using the captured image and a three-dimensional map. The three-dimensional map is corrected using information indicating a reliability of: information indicating the three-dimensional position of the feature included in a predefined area in the three-dimensional map held by the holding unit; and information indicating a three-dimensional position of another feature of the object, the information obtained based on the captured image from an expanded area of the predefined area in the three-dimensional map held by the holding unit.
    Type: Grant
    Filed: April 13, 2021
    Date of Patent: November 28, 2023
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Daisuke Kotake, Akihiro Katayama, Makoto Tomioka, Nozomu Kasuya, Takayuki Yamada, Masahiro Suzuki, Masakazu Fujiki
  • Publication number: 20230245411
    Abstract: An information processing apparatus is provided. A determination method for determining a color of an object in a virtual viewpoint video, which includes the object and is generated based on a captured image obtained by capturing an image of the object, is selected based on a movement of a virtual viewpoint corresponding to the virtual viewpoint video or a movement of the object. The virtual viewpoint video, which includes the object, is generated through determining the color of the object in the virtual viewpoint video with the selected determination method.
    Type: Application
    Filed: January 24, 2023
    Publication date: August 3, 2023
    Inventors: Nozomu KASUYA, Atsushi DATE
  • Patent number: 11393123
    Abstract: An information processing device finds a position/orientation of an image capturing unit including first and second cameras whose image capturing fields are partially overlapped, the information processing device comprises an input unit that inputs first and second images from the first and second cameras a holding unit holding a learning model; a first estimating unit that estimates first provisional geometric information from the first and second images; a second estimating unit that estimates second provisional geometric information on the basis of the first image and the learning model; a third estimating unit that estimates third provisional geometric information on the basis of the second image and the learning model; and a generating unit that, on the basis of the first, second, and third provisional geometric information, generates the position/orientation information of the image capturing unit.
    Type: Grant
    Filed: July 6, 2020
    Date of Patent: July 19, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Tomoaki Higo, Daisuke Kotake, Masahiro Suzuki, Nozomu Kasuya, Makoto Tomioka
  • Patent number: 11348323
    Abstract: Based on a three-dimensional map in which three-dimensional information of a scene captured by an image capturing apparatus and a position and orientation of the apparatus are associated with each other and an image captured by the apparatus, a first position and orientation of the apparatus at the time of capturing the image is derived. The map is updated based on the captured image and the first position and orientation. A relative position and orientation between the first position and orientation and a second position and orientation of the apparatus derived by a method different from a method of deriving the first position and orientation or at a point of time different from a point of time of deriving the first position and orientation is derived. The map is corrected based on the relative position and orientation.
    Type: Grant
    Filed: January 8, 2020
    Date of Patent: May 31, 2022
    Assignee: Canon Kabushiki Kaisha
    Inventors: Daisuke Kotake, Makoto Tomioka, Nozomu Kasuya
  • Publication number: 20220060664
    Abstract: An information processing apparatus 10 determines the positions and orientations of a plurality of image capturing apparatuses 11, which capture an imaging region from respective different directions. The information processing apparatus 10 outputs, based on the determination, information that enables recognition of a satisfying state of a predetermined condition regarding image capturing of the imaging region from a plurality of directions, the satisfying state being a state that changes at least in accordance with a relationship between the plurality of directions.
    Type: Application
    Filed: November 3, 2021
    Publication date: February 24, 2022
    Inventor: Nozomu Kasuya
  • Patent number: 11144786
    Abstract: An information processing apparatus comprising: a holding unit configured to hold a plurality of learning models for estimating geometric information based on an input image captured by an image capturing apparatus; a selection unit configured to calculate, for each of the learning models, an evaluation value that indicates suitability of the learning model to a scene of the input image, and select a learning model from the plurality of learning models based on the evaluation values; and an estimation unit configured to estimate first geometric information using the input image and the selected learning model.
    Type: Grant
    Filed: October 30, 2018
    Date of Patent: October 12, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Makoto Tomioka, Daisuke Kotake, Nozomu Kasuya, Masahiro Suzuki
  • Patent number: 11108964
    Abstract: An information processing apparatus presenting information to an operator operating an image pickup device includes an image-pickup range setting portion setting an image pickup range over which an image can be taken by the image pickup device, a position and orientation calculation portion calculating a position and orientation of the image pickup device by using the image taken by the image pickup device, an evaluation portion evaluating an image pickup situation in the image pickup range, set by the image-pickup range setting portion, on the basis of the position and orientation calculated by the position and orientation calculation portion, and a guide information presentation portion presenting, in accordance with evaluation by the evaluation portion, guide information for guiding an operation of the image pickup device on a display device.
    Type: Grant
    Filed: January 6, 2020
    Date of Patent: August 31, 2021
    Assignee: Canon Kabushiki Kaisha
    Inventors: Nozomu Kasuya, Makoto Tomioka, Daisuke Kotake, Masahiro Suzuki, Takayuki Yamada, Masakazu Fujiki, Akihiro Katayama
  • Publication number: 20210241541
    Abstract: An information processing apparatus comprising: a correction unit configured to correct a shift between a first three-dimensional position in an image capturing region that is identified based on a position of a first feature point on a first image among a plurality of images acquired by a first acquisition unit and image capturing information about an image capturing apparatus that corresponds to the first image and a second three-dimensional position in an image capturing region that is identified based on a position of a second feature point corresponding to the first feature point on a second image among the plurality of images acquired by the first acquisition unit and the image capturing information about the image capturing apparatus that corresponds to the second image.
    Type: Application
    Filed: February 3, 2021
    Publication date: August 5, 2021
    Inventor: Nozomu Kasuya
  • Publication number: 20210232845
    Abstract: There is provided with an information processing apparatus. From an image capturing apparatus which can move, a captured image of an object is obtained. The position of the image capturing apparatus is derived using the captured image and a three-dimensional map. The three-dimensional map is corrected using information indicating a reliability of: information indicating the three-dimensional position of the feature included in a predefined area in the three-dimensional map held by the holding unit; and information indicating a three-dimensional position of another feature of the object, the information obtained based on the captured image from an expanded area of the predefined area in the three-dimensional map held by the holding unit.
    Type: Application
    Filed: April 13, 2021
    Publication date: July 29, 2021
    Inventors: Daisuke Kotake, Akihiro Katayama, Makoto Tomioka, Nozomu Kasuya, Takayuki Yamada, Masahiro Suzuki, Masakazu Fujiki
  • Patent number: 11037325
    Abstract: An information processing apparatus has a hold unit for holding a plurality of features of a physical space as a plurality of held features, each of the plurality of held features being related with a position in a first image captured by an image capturing apparatus at a first time, and information of an availability for a position/orientation calculation of the image capturing apparatus. The information processing apparatus associates a plurality of detected features, which are detected in a second image captured by the image capturing apparatus at a second time after the first time, with the plurality of held features, and, based on the availabilities related with the associated held features, adjusts a detected feature, among the plurality of detected features, to be used in the calculation of the position/orientation of the image capturing apparatus.
    Type: Grant
    Filed: February 3, 2020
    Date of Patent: June 15, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Makoto Tomioka, Daisuke Kotake, Nozomu Kasuya
  • Patent number: 11003939
    Abstract: There is provided with an information processing apparatus. From an image capturing apparatus which can move, a captured image of an object is obtained. The position of the image capturing apparatus is derived using the captured image and a three-dimensional map. The three-dimensional map is corrected using information indicating a reliability of: information indicating the three-dimensional position of the feature included in a predefined area in the three-dimensional map held by the holding unit; and information indicating a three-dimensional position of another feature of the object, the information obtained based on the captured image from an expanded area of the predefined area in the three-dimensional map held by the holding unit.
    Type: Grant
    Filed: June 25, 2019
    Date of Patent: May 11, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Daisuke Kotake, Akihiro Katayama, Makoto Tomioka, Nozomu Kasuya, Takayuki Yamada, Masahiro Suzuki, Masakazu Fujiki
  • Patent number: 10957068
    Abstract: An information processing apparatus has a hold unit for holding a plurality of features of a physical space as a plurality of held features, each of the plurality of held features being related with a position in a first image captured by an image capturing apparatus at a first time, and information of an availability for a position/orientation calculation of the image capturing apparatus. The information processing apparatus associates a plurality of detected features, which are detected in a second image captured by the image capturing apparatus at a second time after the first time, with the plurality of held features, and, based on the availabilities related with the associated held features, adjusts a detected feature, among the plurality of detected features, to be used in the calculation of the position/orientation of the image capturing apparatus.
    Type: Grant
    Filed: January 4, 2018
    Date of Patent: March 23, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Makoto Tomioka, Daisuke Kotake, Nozomu Kasuya
  • Patent number: 10939081
    Abstract: An image processing apparatus for processing an image of a projection content to be projected onto a projection target object including a pattern or a figure in a part thereof, including: a positioning unit configured to perform positioning of the image of the projection content and the projection target object with respect to each other; a transformation unit configured to transform the image of the projection content on the basis of the result of the positioning by the positioning unit; and an output unit configured to output the image transformed by the transformation unit to a projection device.
    Type: Grant
    Filed: May 21, 2019
    Date of Patent: March 2, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Sonoko Miyatani, Nozomu Kasuya
  • Patent number: 10861185
    Abstract: An information processing apparatus inputs a plurality of detected features that are detected from an image or three-dimensional data, holds a plurality of features of a physical space as a plurality of held features in association with availabilities in a calculation of a position/orientation of an apparatus that obtained the image or the three-dimensional data, decides spatial locations of the held features in the image or the three-dimensional data, and decides, based on the availabilities of the held features existing in a vicinity of one detected feature out of the plurality of detected features at the locations, a state of usage of the one detected feature in the position/orientation calculation.
    Type: Grant
    Filed: January 4, 2018
    Date of Patent: December 8, 2020
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Nozomu Kasuya, Makoto Tomioka, Masakazu Fujiki
  • Publication number: 20200334843
    Abstract: This invention provides an information processing apparatus comprising a first acquiring unit configured to acquire first distance information from a distance sensor, a second acquiring unit configured to acquire an image from an image capturing device, a holding unit configured to hold a learning model for estimating distance information from images, an estimating unit configured to estimate second distance information corresponding to the image acquired by the second acquiring unit using the learning model, and a generating unit configured to generate third distance information based on the first distance information and the second distance information.
    Type: Application
    Filed: July 7, 2020
    Publication date: October 22, 2020
    Inventors: Nozomu Kasuya, Kazuhiko Kobayashi, Masahiro Suzuki, Daisuke Kotake, Makoto Tomioka
  • Publication number: 20200334855
    Abstract: An information processing device finds a position/orientation of an image capturing unit including first and second cameras whose image capturing fields are partially overlapped, the information processing device comprises an input unit that inputs first and second images from the first and second cameras a holding unit holding a learning model; a first estimating unit that estimates first provisional geometric information from the first and second images; a second estimating unit that estimates second provisional geometric information on the basis of the first image and the learning model; a third estimating unit that estimates third provisional geometric information on the basis of the second image and the learning model; and a generating unit that, on the basis of the first, second, and third provisional geometric information, generates the position/orientation information of the image capturing unit.
    Type: Application
    Filed: July 6, 2020
    Publication date: October 22, 2020
    Inventors: Tomoaki Higo, Daisuke Kotake, Masahiro Suzuki, Nozomu Kasuya, Makoto Tomioka
  • Publication number: 20200175717
    Abstract: An information processing apparatus has a hold unit for holding a plurality of features of a physical space as a plurality of held features, each of the plurality of held features being related with a position in a first image captured by an image capturing apparatus at a first time, and information of an availability for a position/orientation calculation of the image capturing apparatus. The information processing apparatus associates a plurality of detected features, which are detected in a second image captured by the image capturing apparatus at a second time after the first time, with the plurality of held features, and, based on the availabilities related with the associated held features, adjusts a detected feature, among the plurality of detected features, to be used in the calculation of the position/orientation of the image capturing apparatus.
    Type: Application
    Filed: February 3, 2020
    Publication date: June 4, 2020
    Inventors: Makoto Tomioka, Daisuke Kotake, Nozomu Kasuya
  • Publication number: 20200143603
    Abstract: Based on a three-dimensional map in which three-dimensional information of a scene captured by an image capturing apparatus and a position and orientation of the apparatus are associated with each other and an image captured by the apparatus, a first position and orientation of the apparatus at the time of capturing the image is derived. The map is updated based on the captured image and the first position and orientation. A relative position and orientation between the first position and orientation and a second position and orientation of the apparatus derived by a method different from a method of deriving the first position and orientation or at a point of time different from a point of time of deriving the first position and orientation is derived. The map is corrected based on the relative position and orientation.
    Type: Application
    Filed: January 8, 2020
    Publication date: May 7, 2020
    Inventors: Daisuke Kotake, Makoto Tomioka, Nozomu Kasuya
  • Publication number: 20200145588
    Abstract: An information processing apparatus presenting information to an operator operating an image pickup device includes an image-pickup range setting portion setting an image pickup range over which an image can be taken by the image pickup device, a position and orientation calculation portion calculating a position and orientation of the image pickup device by using the image taken by the image pickup device, an evaluation portion evaluating an image pickup situation in the image pickup range, set by the image-pickup range setting portion, on the basis of the position and orientation calculated by the position and orientation calculation portion, and a guide information presentation portion presenting, in accordance with evaluation by the evaluation portion, guide information for guiding an operation of the image pickup device on a display device.
    Type: Application
    Filed: January 6, 2020
    Publication date: May 7, 2020
    Inventors: Nozomu Kasuya, Makoto Tomioka, Daisuke Kotake, Masahiro Suzuki, Takayuki Yamada, Masakazu Fujiki, Akihiro Katayama