Patents by Inventor Keigo Yoneda

Keigo Yoneda has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11941729
    Abstract: An image processing apparatus obtains one or plurality of images based on capturing by one or plurality of image capturing apparatuses, obtains information related to a virtual object, and generates a two-dimensional image including the virtual object, based on the one or plurality of obtained images and the obtained information related to the virtual object. The image processing apparatus generates the two-dimensional image by determining color information of the virtual object based on color information of a real object included in the one or plurality of images.
    Type: Grant
    Filed: November 12, 2021
    Date of Patent: March 26, 2024
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Keigo Yoneda
  • Publication number: 20240092337
    Abstract: A vehicle control apparatus includes front-wheel and rear-wheel driving systems, and a control system. The front-wheel driving system includes a first travel motor mechanically coupled to a front wheel of a vehicle and a first accumulator electrically coupled to the first travel motor. The rear-wheel driving system includes a second travel motor mechanically coupled to a rear wheel of the vehicle and a second accumulator electrically coupled to the second travel motor. The control system includes one or more processors and one or more memories communicably coupled to the one or more processors, and controls the first and second travel motors. When a difference between an SOC of the first accumulator and an SOC of the second accumulator is greater than a threshold value, the one or more processors change a torque distribution ratio between the first and second travel motors from a reference distribution ratio.
    Type: Application
    Filed: September 13, 2023
    Publication date: March 21, 2024
    Inventors: Hiroshi KUSANO, Yoshinobu YAMAZAKI, Masami OGURI, Akihiro NABESHIMA, Yoshiyuki JIN, Takeshi YONEDA, Fumiya SATO, Keigo YAMADA, Takumi ARAKI, Shuntaro MIURA
  • Publication number: 20240040106
    Abstract: A second image processing apparatus 40 generates a virtual viewpoint image including an object for which a color is determined based on a method selected between a virtual viewpoint-dependent rendering method for determining a color based on virtual viewpoint information for identifying a position of a virtual viewpoint and a line-of-sight direction from the virtual viewpoint, shape information for identifying a three-dimensional shape of the object, and images acquired by a plurality of imaging apparatuses, and a virtual viewpoint-independent rendering method for determining a color based on the shape information for identifying the three-dimensional shape of the object, and color information that identifies a color corresponding to a component element of the shape information.
    Type: Application
    Filed: August 15, 2023
    Publication date: February 1, 2024
    Inventor: KEIGO YONEDA
  • Patent number: 11670043
    Abstract: A virtual viewpoint foreground image generating unit generates a virtual viewpoint foreground image, which is an image of a foreground object seen from a virtual viewpoint without a shadow, based on received multi-viewpoint images and a received virtual viewpoint parameter. A virtual viewpoint background image generating unit generates a virtual viewpoint background image, which is an image of a background object seen from the virtual viewpoint, based on the received multi-viewpoint images and virtual viewpoint parameter. A shadow mask image generating unit generates shadow mask images from the received multi-viewpoint images. A shadow-added virtual viewpoint background image generating unit renders a shadow in the virtual viewpoint background image based on the received virtual viewpoint background image, shadow mask images, and virtual viewpoint parameter.
    Type: Grant
    Filed: May 7, 2021
    Date of Patent: June 6, 2023
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Keigo Yoneda
  • Patent number: 11521346
    Abstract: An image processing apparatus obtains virtual viewpoint information indicating at least a position of a virtual viewpoint and a view direction from the virtual viewpoint and generates a virtual viewpoint image based on the virtual viewpoint information and a plurality of images captured from a plurality of viewpoints by hiding processing a specific region of the virtual viewpoint image, the specific region being determined based on that the obtained virtual viewpoint information satisfies a condition.
    Type: Grant
    Filed: July 22, 2021
    Date of Patent: December 6, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Keigo Yoneda
  • Publication number: 20220383589
    Abstract: An image generation apparatus obtains a virtual viewpoint image generated based on captured images obtained by image capture of an object by a plurality of image capture devices from a plurality of viewpoints and three-dimensional shape data on the object, and removes noise in the virtual viewpoint image obtained, the noise being generated due to accuracy of the three-dimensional shape data.
    Type: Application
    Filed: August 11, 2022
    Publication date: December 1, 2022
    Inventors: Shu Fujita, Keigo Yoneda, Shuntaro Aratani, Atsushi Date, Toshiaki Fujii, Keita Takahashi, Takashi Sugie
  • Patent number: 11368666
    Abstract: A control is performed such that a speed of change of the virtual viewpoint which is changed in accordance with acceptance of an input according to a specific user operation during playback of the virtual viewpoint image at a first playback speed becomes lower than a speed of change of the virtual viewpoint which is changed in accordance with acceptance of an input according to the specific user operation during playback of the virtual viewpoint image at a second playback speed higher than the first playback speed.
    Type: Grant
    Filed: December 24, 2020
    Date of Patent: June 21, 2022
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Keigo Yoneda
  • Publication number: 20220189078
    Abstract: An image processing apparatus obtains one or plurality of images based on capturing by one or plurality of image capturing apparatuses, obtains information related to a virtual object, and generates a two-dimensional image including the virtual object, based on the one or plurality of obtained images and the obtained information related to the virtual object. The image processing apparatus generates the two-dimensional image by determining color information of the virtual object based on color information of a real object included in the one or plurality of images.
    Type: Application
    Filed: November 12, 2021
    Publication date: June 16, 2022
    Inventor: Keigo Yoneda
  • Publication number: 20220051469
    Abstract: An image processing apparatus obtains virtual viewpoint information indicating at least a position of a virtual viewpoint and a view direction from the virtual viewpoint and generates a virtual viewpoint image based on the virtual viewpoint information and a plurality of images captured from a plurality of viewpoints by hiding processing a specific region of the virtual viewpoint image, the specific region being determined based on that the obtained virtual viewpoint information satisfies a condition.
    Type: Application
    Filed: July 22, 2021
    Publication date: February 17, 2022
    Inventor: Keigo Yoneda
  • Publication number: 20210358204
    Abstract: A virtual viewpoint foreground image generating unit generates a virtual viewpoint foreground image, which is an image of a foreground object seen from a virtual viewpoint without a shadow, based on received multi-viewpoint images and a received virtual viewpoint parameter. A virtual viewpoint background image generating unit generates a virtual viewpoint background image, which is an image of a background object seen from the virtual viewpoint, based on the received multi-viewpoint images and virtual viewpoint parameter. A shadow mask image generating unit generates shadow mask images from the received multi-viewpoint images. A shadow-added virtual viewpoint background image generating unit renders a shadow in the virtual viewpoint background image based on the received virtual viewpoint background image, shadow mask images, and virtual viewpoint parameter.
    Type: Application
    Filed: May 7, 2021
    Publication date: November 18, 2021
    Inventor: Keigo Yoneda
  • Patent number: 11057609
    Abstract: An information processing apparatus sets a plurality of key frames that each indicate a position of a virtual viewpoint that corresponds to a virtual viewpoint image, the plurality of key frames corresponding to different times, the virtual viewpoint image being generated based on images of an image capture region captured by a plurality of image capturing apparatuses from different directions. The information processing apparatus determines, based on a position of a virtual viewpoint indicated by a set first key frame and a position of a virtual viewpoint indicated by a set second key frame, a moving path of the virtual viewpoints during a time period between time that corresponds to the first key frame and time that corresponds to the second key frame, and outputs viewpoint information that indicates the determined moving path of the virtual viewpoints.
    Type: Grant
    Filed: February 7, 2020
    Date of Patent: July 6, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Keigo Yoneda, Michio Aizawa
  • Publication number: 20210120224
    Abstract: A control is performed such that a speed of change of the virtual viewpoint which is changed in accordance with acceptance of an input according to a specific user operation during playback of the virtual viewpoint image at a first playback speed becomes lower than a speed of change of the virtual viewpoint which is changed in accordance with acceptance of an input according to the specific user operation during playback of the virtual viewpoint image at a second playback speed higher than the first playback speed.
    Type: Application
    Filed: December 24, 2020
    Publication date: April 22, 2021
    Inventor: Keigo Yoneda
  • Patent number: 10916048
    Abstract: An image processing apparatus that generates a virtual viewpoint image based on images obtained by a plurality of cameras that capture an image capturing area from a plurality of directions and on viewpoint information indicating a position and direction of a virtual viewpoint, the image processing apparatus including: a determining unit configured to determine a priority of an object in the image capturing area; a control unit configured to control a display manner of the object in the virtual viewpoint image, based on the priority of the object determined by the determining unit, so that processing time related to generation of the virtual viewpoint image does not exceed a predetermined amount of time; and a generating unit configured to generate the virtual viewpoint image according to control by the control unit.
    Type: Grant
    Filed: January 10, 2019
    Date of Patent: February 9, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Keigo Yoneda
  • Publication number: 20200275083
    Abstract: An information processing apparatus sets a plurality of key frames that each indicate a position of a virtual viewpoint that corresponds to a virtual viewpoint image, the plurality of key frames corresponding to different times, the virtual viewpoint image being generated based on images of an image capture region captured by a plurality of image capturing apparatuses from different directions. The information processing apparatus determines, based on a position of a virtual viewpoint indicated by a set first key frame and a position of a virtual viewpoint indicated by a set second key frame, a moving path of the virtual viewpoints during a time period between time that corresponds to the first key frame and time that corresponds to the second key frame, and outputs viewpoint information that indicates the determined moving path of the virtual viewpoints.
    Type: Application
    Filed: February 7, 2020
    Publication date: August 27, 2020
    Inventors: Keigo Yoneda, Michio Aizawa
  • Publication number: 20200145635
    Abstract: An information processing apparatus including: a reception unit configured to receive an input in accordance with a specific user operation for changing a position of a virtual viewpoint for a virtual viewpoint image; a changing unit configured to change a position of the virtual viewpoint in accordance with an input received by the reception unit; and a control unit configured to move, in response to a specific condition being satisfied, a position of the virtual viewpoint to a position on a path determined in advance irrespective of the specific user operation.
    Type: Application
    Filed: October 23, 2019
    Publication date: May 7, 2020
    Inventor: Keigo Yoneda
  • Publication number: 20190221029
    Abstract: An image processing apparatus that generates a virtual viewpoint image based on images obtained by a plurality of cameras that capture an image capturing area from a plurality of directions and on viewpoint information indicating a position and direction of a virtual viewpoint, the image processing apparatus including: a determining unit configured to determine a priority of an object in the image capturing area; a control unit configured to control a display manner of the object in the virtual viewpoint image, based on the priority of the object determined by the determining unit, so that processing time related to generation of the virtual viewpoint image does not exceed a predetermined amount of time; and a generating unit configured to generate the virtual viewpoint image according to control by the control unit.
    Type: Application
    Filed: January 10, 2019
    Publication date: July 18, 2019
    Inventor: Keigo Yoneda