Patents by Inventor Kazuki Takemoto

Kazuki Takemoto has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11967107
    Abstract: An apparatus includes a generation unit configured to generate map information including a position of a feature point and identification information on an index in an image of a real space captured by a capturing apparatus, a collation unit configured to collate the identification information on the index in the generated map information with the identification information on the index in one or more pieces of registered map information, and to extract map information from the one or more pieces of registered map information based on a result of the collation, and an estimation unit configured to estimate a position and orientation of the capturing apparatus based on the position of the feature point in the extracted map information and the position of the feature point in the generated map information.
    Type: Grant
    Filed: March 19, 2021
    Date of Patent: April 23, 2024
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Kazuki Takemoto
  • Patent number: 11842519
    Abstract: An image processing apparatus includes an acquisition unit configured to acquire color information about an object and color information about a background in a first image captured by an image capturing apparatus, a storage unit configured to store the acquired color information about the object and the acquired color information about the background, an expansion unit configured to expand, in a three-dimensional color space, the color information about the object and the color information about the background stored in the storage unit, and an extraction unit configured to extract an area of the object from a second image captured by the image capturing apparatus, based on the respective pieces of the color information expanded by the expansion unit.
    Type: Grant
    Filed: January 13, 2022
    Date of Patent: December 12, 2023
    Assignee: Canon Kabushiki Kaisha
    Inventor: Kazuki Takemoto
  • Publication number: 20230188692
    Abstract: An information processing apparatus includes a processor and a memory coupled to the processor and storing instructions that, when executed by the processor, cause the processor to function as an image acquisition unit, an index detection unit, a correction unit, and a determination unit. The image acquisition unit is configured to acquire images captured by an image capturing unit configured to perform image capturing from a plurality of directions. The index detection unit configured to detect information about an index appearing on the acquired images. The correction unit is configured to determine a correction to: (1) correct a depth value calculated from parallax in the acquired images, or (2) correct the parallax, based on the detected information. The determination unit is configured to determine whether to execute the correction based on a state of the index appearing on one of the acquired images.
    Type: Application
    Filed: December 12, 2022
    Publication date: June 15, 2023
    Inventor: KAZUKI TAKEMOTO
  • Patent number: 11490062
    Abstract: An information processing apparatus includes an acquisition unit configured to acquire an image from an image capturing apparatus that captures an image of a real space, an estimation unit configured to estimate a position or orientation of the image capturing apparatus in the real space, based on the image, a creation unit configured to create a map including at least one keyframe, a setting unit configured to set an observation space of a user, a generation unit configured to analyze a relationship between the observation space set by the setting unit and the map created by the creation unit, and generate a model representing the keyframe included in the map, and a control unit configured to cause a display unit to display a combined image of an image based on the generated model and the image.
    Type: Grant
    Filed: September 17, 2019
    Date of Patent: November 1, 2022
    Assignee: Canon Kabushiki Kaisha
    Inventors: Masayuki Hayashi, Kazuki Takemoto
  • Patent number: 11486894
    Abstract: A calibration apparatus of an inertial sensor, obtains an angular velocity value from the inertial sensor, derives a distribution of a difference between temporally adjacent angular velocity values concerning a plurality of angular velocity values obtained during a given period, and determines, based on the distribution, whether the inertial sensor is in a motionless state during the given period. Then, if it is determined that the inertial sensor is in the motionless state, the calibration apparatus decides a bias value of the inertial sensor based on the plurality of angular velocity values and corrects the obtained angular velocity value based on the bias value.
    Type: Grant
    Filed: February 5, 2021
    Date of Patent: November 1, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Yu Okano, Kazuki Takemoto
  • Patent number: 11423622
    Abstract: Based on an image captured by an image capturing unit, a three-dimensional position in a real space corresponding to each of one or more features included in the image is estimated, a candidate region that is a region on a plane of an object existing in the real space is determined as a candidate for a region to which features are to be added based on the estimated three-dimensional position, and a recommended region to which the features are to be added is determined in the candidate region based on the number of features included in a partial region set in the determined candidate region.
    Type: Grant
    Filed: June 4, 2020
    Date of Patent: August 23, 2022
    Assignee: Canon Kabushiki Kaisha
    Inventors: Yu Okano, Kazuki Takemoto
  • Publication number: 20220230358
    Abstract: An image processing apparatus includes an acquisition unit configured to acquire color information about an object and color information about a background in a first image captured by an image capturing apparatus, a storage unit configured to store the acquired color information about the object and the acquired color information about the background, an expansion unit configured to expand, in a three-dimensional color space, the color information about the object and the color information about the background stored in the storage unit, and an extraction unit configured to extract an area of the object from a second image captured by the image capturing apparatus, based on the respective pieces of the color information expanded by the expansion unit.
    Type: Application
    Filed: January 13, 2022
    Publication date: July 21, 2022
    Inventor: Kazuki Takemoto
  • Patent number: 11275434
    Abstract: An information processing apparatus supplies, an image display apparatus including an image capturing unit configured to capture an image of a real space, and a display unit configured to display an image generated using the image captured by the image capturing unit, an image generated using the image captured by the image capturing unit. The information processing apparatus includes a generation unit configured to generate an image depicting a specific object at a position at which the specific object is estimated to be present after a predetermined time from a time when the image display apparatus starts to move in the captured image of the real space including the specific object, and a control unit configured to shift a position at which the image generated by the generation unit is displayed on the display unit based on a change in a position and/or an orientation of the image display apparatus.
    Type: Grant
    Filed: October 28, 2019
    Date of Patent: March 15, 2022
    Assignee: Canon Kabushiki Kaisha
    Inventor: Kazuki Takemoto
  • Patent number: 11200706
    Abstract: There is provided with an image processing apparatus for extracting an object region from an image. An image acquisition unit acquires an image. A designation acquisition unit acquires designation of one or more extraction colors that belong to the object region of the image and designation of one or more non-extraction colors that do not belong to the object region of the image. A derivation unit derives a color conversion parameter, based on the extraction color and the non-extraction color. A conversion unit converts a color of the image based on the color conversion parameter. An extraction unit extracts the object region from the image, based on the image and the extraction color after the conversion.
    Type: Grant
    Filed: September 16, 2019
    Date of Patent: December 14, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Kazuki Takemoto
  • Publication number: 20210304436
    Abstract: An apparatus includes a generation unit configured to generate map information including a position of a feature point and identification information on an index in an image of a real space captured by a capturing apparatus, a collation unit configured to collate the identification information on the index in the generated map information with the identification information on the index in one or more pieces of registered map information, and to extract map information from the one or more pieces of registered map information based on a result of the collation, and an estimation unit configured to estimate a position and orientation of the capturing apparatus based on the position of the feature point in the extracted map information and the position of the feature point in the generated map information.
    Type: Application
    Filed: March 19, 2021
    Publication date: September 30, 2021
    Inventor: Kazuki Takemoto
  • Publication number: 20210247420
    Abstract: A calibration apparatus of an inertial sensor, obtains an angular velocity value from the inertial sensor, derives a distribution of a difference between temporally adjacent angular velocity values concerning a plurality of angular velocity values obtained during a given period, and determines, based on the distribution, whether the inertial sensor is in a motionless state during the given period. Then, if it is determined that the inertial sensor is in the motionless state, the calibration apparatus decides a bias value of the inertial sensor based on the plurality of angular velocity values and corrects the obtained angular velocity value based on the bias value.
    Type: Application
    Filed: February 5, 2021
    Publication date: August 12, 2021
    Inventors: Yu Okano, Kazuki Takemoto
  • Publication number: 20200388078
    Abstract: Based on an image captured by an image capturing unit, a three-dimensional position in a real space corresponding to each of one or more features included in the image is estimated, a candidate region that is a region on a plane of an object existing in the real space is determined as a candidate for a region to which features are to be added based on the estimated three-dimensional position, and a recommended region to which the features are to be added is determined in the candidate region based on the number of features included in a partial region set in the determined candidate region.
    Type: Application
    Filed: June 4, 2020
    Publication date: December 10, 2020
    Inventors: Yu Okano, Kazuki Takemoto
  • Patent number: 10706625
    Abstract: The apparatus draws virtual objects as an image from a predetermined point of view, determines whether the virtual objects interfere with each other, calculates the region of interference of the virtual objects determined as interfering with each other, and outputs an image in which the region of interference located behind of the virtual objects as seen from the point of view is drawn.
    Type: Grant
    Filed: July 1, 2016
    Date of Patent: July 7, 2020
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Masayuki Hayashi, Kazuki Takemoto
  • Publication number: 20200133388
    Abstract: An information processing apparatus supplies, an image display apparatus including an image capturing unit configured to capture an image of a real space, and a display unit configured to display an image generated using the image captured by the image capturing unit, an image generated using the image captured by the image capturing unit. The information processing apparatus includes a generation unit configured to generate an image depicting a specific object at a position at which the specific object is estimated to be present after a predetermined time from a time when the image display apparatus starts to move in the captured image of the real space including the specific object, and a control unit configured to shift a position at which the image generated by the generation unit is displayed on the display unit based on a change in a position and/or an orientation of the image display apparatus.
    Type: Application
    Filed: October 28, 2019
    Publication date: April 30, 2020
    Inventor: Kazuki Takemoto
  • Publication number: 20200107004
    Abstract: An information processing apparatus includes an acquisition unit configured to acquire an image from an image capturing apparatus that captures an image of a real space, an estimation unit configured to estimate a position or orientation of the image capturing apparatus in the real space, based on the image, a creation unit configured to create a map including at least one keyframe, a setting unit configured to set an observation space of a user, a generation unit configured to analyze a relationship between the observation space set by the setting unit and the map created by the creation unit, and generate a model representing the keyframe included in the map, and a control unit configured to cause a display unit to display a combined image of an image based on the generated model and the image.
    Type: Application
    Filed: September 17, 2019
    Publication date: April 2, 2020
    Inventors: Masayuki Hayashi, Kazuki Takemoto
  • Publication number: 20200098149
    Abstract: There is provided with an image processing apparatus for extracting an object region from an image. An image acquisition unit acquires an image. A designation acquisition unit acquires designation of one or more extraction colors that belong to the object region of the image and designation of one or more non-extraction colors that do not belong to the object region of the image. A derivation unit derives a color conversion parameter, based on the extraction color and the non-extraction color. A conversion unit converts a color of the image based on the color conversion parameter. An extraction unit extracts the object region from the image, based on the image and the extraction color after the conversion.
    Type: Application
    Filed: September 16, 2019
    Publication date: March 26, 2020
    Inventor: Kazuki Takemoto
  • Patent number: 10410420
    Abstract: An apparatus includes an image acquisition unit configured to acquire a captured image of a real space, a position and orientation acquisition unit configured to acquire a position and orientation of each of a plurality of virtual objects, an interference determination unit configured to determine whether interference is present between the virtual objects based on the position and orientation of each of the plurality of virtual objects and model data of the plurality of virtual objects, an interference information recording unit configured to record an outline of an interference part where the virtual objects interfere with each other as interference information, based on a result of the interference determination unit, a generation unit configured to generate a composite image including the captured image, an image of the plurality of virtual objects, and an image representing the outline of the interference part.
    Type: Grant
    Filed: June 28, 2016
    Date of Patent: September 10, 2019
    Assignee: Canon Kabushiki Kaisha
    Inventor: Kazuki Takemoto
  • Patent number: 10373382
    Abstract: An apparatus includes an image acquisition unit configured to acquire a captured image of a real space, a position and orientation acquisition unit configured to acquire a position and orientation of each of a plurality of virtual objects, an interference determination unit configured to determine whether interference is present between the virtual objects based on the position and orientation of each of the plurality of virtual objects and model data of the plurality of virtual objects, an interference information recording unit configured to record an outline of an interference part where the virtual objects interfere with each other as interference information, based on a result of the interference determination unit, a generation unit configured to generate a composite image including the captured image, an image of the plurality of virtual objects, and an image representing the outline of the interference part.
    Type: Grant
    Filed: June 28, 2016
    Date of Patent: August 6, 2019
    Assignee: Canon Kabushiki Kaisha
    Inventor: Kazuki Takemoto
  • Patent number: 10339712
    Abstract: An object region detection unit (130) decides the region of a physical object of interest in a physical space image. An image manipulation unit (140) performs shading processing of an inclusion region including the decided region. A rendering unit (155) arranges a virtual object in virtual space at the position and orientation of the physical object of interest and generates a virtual space image based on the position and orientation of the user's viewpoint. A composition unit (160) generates a composite image by superimposing the virtual space image on the physical space image that has undergone the shading processing and outputs the generated composite image to an HMD (190).
    Type: Grant
    Filed: March 19, 2015
    Date of Patent: July 2, 2019
    Assignee: Canon Kabushiki Kaisha
    Inventors: Kazuki Takemoto, Takashi Aso
  • Patent number: 10236971
    Abstract: To provide a technique capable of reducing the transmission delay of an image, a communication apparatus wirelessly communicable with another communication apparatus, receives a compressed captured image from the other communication apparatus; decompresses the compressed captured image to obtain a decompressed captured image; generates, based on the decompressed captured image, a CG image to be superimposed and displayed on the captured image; and compresses the CG image to generate a compressed CG image; transmits the compressed CG image to the other communication apparatus. Then, the communication apparatus derives a delay time based on a transmission time of the compressed captured image in the other communication apparatus and a generation completion time of the CG image; and changes a compression ratio of the CG image based on whether the delay time is longer than a predetermined threshold.
    Type: Grant
    Filed: June 3, 2016
    Date of Patent: March 19, 2019
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Yutaka Ui, Hiroichi Yamaguchi, Kazuki Takemoto