Patents by Inventor Michio Aizawa

Michio Aizawa has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11825063
    Abstract: An image processing apparatus comprising: an identifying unit that identifies, from multiple image capture apparatuses that capture images of an image capture space from multiple directions, two or more image capture apparatuses that capture images of a predetermined position in the image capture space; a camera path setting unit that sets multiple viewpoints that are based on the two or more image capture apparatuses identified by the identifying unit; a virtual viewpoint image generating unit that generates multiple viewpoint images corresponding to the multiple viewpoints based on three-dimensional shape data generated using multiple images captured by the multiple image capture apparatuses; and an image capture apparatus selecting unit that selects, from the two or more image capture apparatuses identified by the identifying unit, an image capture apparatus close to the position of the viewpoint corresponding to a viewpoint image designated by a user from the multiple viewpoint images.
    Type: Grant
    Filed: March 25, 2022
    Date of Patent: November 21, 2023
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Michio Aizawa
  • Publication number: 20230283757
    Abstract: A method for generating a virtual viewpoint image includes generating, by a first image processing apparatus, first information for generating the virtual viewpoint image based on a first image captured by a first camera, generating, by a second image processing apparatus, second information for generating the virtual viewpoint image based on a second image captured by a second camera; specifying a viewpoint in the virtual viewpoint image; and generating, by a third image processing apparatus, a virtual viewpoint image corresponding to the specified viewpoint using the first information and the second information.
    Type: Application
    Filed: May 12, 2023
    Publication date: September 7, 2023
    Inventors: Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
  • Patent number: 11750792
    Abstract: An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes an obtaining unit configured to obtain a foreground image based on an object region including a predetermined object in a captured image for generating a virtual viewpoint image and a background image based on a region different from the object region in the captured image, wherein the obtained foreground image and the obtained background image having different frame rates, and an output unit configured to output the foreground image and the background image which are obtained by the obtaining unit and which are associated with each other.
    Type: Grant
    Filed: October 6, 2021
    Date of Patent: September 5, 2023
    Assignee: Canon Kabushiki Kaisha
    Inventors: Tomohiro Yano, Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Mai Komiyama, Kenichi Fujii, Atsushi Date
  • Patent number: 11689706
    Abstract: A method for generating a virtual viewpoint image includes generating, by a first image processing apparatus, first information for generating the virtual viewpoint image based on a first image captured by a first camera, generating, by a second image processing apparatus, second information for generating the virtual viewpoint image based on a second image captured by a second camera; specifying a viewpoint in the virtual viewpoint image; and generating, by a third image processing apparatus, a virtual viewpoint image corresponding to the specified viewpoint using the first information and the second information.
    Type: Grant
    Filed: October 7, 2020
    Date of Patent: June 27, 2023
    Assignee: Canon Kabushiki Kaisha
    Inventors: Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
  • Publication number: 20220321855
    Abstract: An image processing apparatus comprising: an identifying unit that identifies, from multiple image capture apparatuses that capture images of an image capture space from multiple directions, two or more image capture apparatuses that capture images of a predetermined position in the image capture space; a camera path setting unit that sets multiple viewpoints that are based on the two or more image capture apparatuses identified by the identifying unit; a virtual viewpoint image generating unit that generates multiple viewpoint images corresponding to the multiple viewpoints based on three-dimensional shape data generated using multiple images captured by the multiple image capture apparatuses; and an image capture apparatus selecting unit that selects, from the two or more image capture apparatuses identified by the identifying unit, an image capture apparatus close to the position of the viewpoint corresponding to a viewpoint image designated by a user from the multiple viewpoint images.
    Type: Application
    Filed: March 25, 2022
    Publication date: October 6, 2022
    Inventor: Michio Aizawa
  • Patent number: 11323688
    Abstract: An information processing apparatus is configured to perform at least based on a first parameter set according to an operation on a first operation unit, and also based on an operation on a second operation unit, changing at least either of a position and a direction of a virtual viewpoint corresponding to a virtual viewpoint image, receiving a switching input for switching a parameter set according to an operation on the first operation unit from the first parameter to a second parameter, and based on the second parameter set according to an operation on the first operation unit performed after the switching input is received, and also based on an operation on the second operation unit, changing at least either of the position and the direction of the virtual viewpoint.
    Type: Grant
    Filed: July 15, 2019
    Date of Patent: May 3, 2022
    Assignee: Canon Kabushiki Kaisha
    Inventor: Michio Aizawa
  • Publication number: 20220060638
    Abstract: An arrangement determination apparatus for determining an arrangement of a plurality of cameras that is used for generation of a virtual viewpoint image acquires information indicating an imaging target region, and determines an arrangement of the plurality of cameras based on the information in such a manner that images of the entire region of the imaging target region are captured by two or more cameras of the plurality of cameras and images of the entire region of the imaging target region are captured by different two or more cameras of the plurality of cameras that are different from the two or more cameras.
    Type: Application
    Filed: November 3, 2021
    Publication date: February 24, 2022
    Inventors: Michio Aizawa, Yasushi Shikata, Shinichiro Uno, Atsushi Date
  • Publication number: 20220030215
    Abstract: An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes an obtaining unit configured to obtain a foreground image based on an object region including a predetermined object in a captured image for generating a virtual viewpoint image and a background image based on a region different from the object region in the captured image, wherein the obtained foreground image and the obtained background image having different frame rates, and an output unit configured to output the foreground image and the background image which are obtained by the obtaining unit and which are associated with each other.
    Type: Application
    Filed: October 6, 2021
    Publication date: January 27, 2022
    Inventors: Tomohiro Yano, Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Mai Komiyama, Kenichi Fujii, Atsushi Date
  • Patent number: 11190673
    Abstract: A control device for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The control device includes an obtaining unit configured to obtain game information specifying a type of game which is a target of imaging performed by the plurality of cameras, a storage unit configured to store information for associating the game information obtained by the obtaining unit with setting information of the system, and a setting unit configured to perform a setting process of the system based on the game information obtained by the obtaining unit and the information stored in the storage unit.
    Type: Grant
    Filed: May 22, 2017
    Date of Patent: November 30, 2021
    Assignee: Canon Kabushiki Kaisha
    Inventors: Katsumasa Tanaka, Masahiro Handa, Michio Aizawa, Shogo Mizuno, Akihiro Matsushita, Keisuke Morisawa, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
  • Patent number: 11172187
    Abstract: An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes an obtaining unit configured to obtain a foreground image based on an object region including a predetermined object in a captured image for generating a virtual viewpoint image and a background image based on a region different from the object region in the captured image, wherein the obtained foreground image and the obtained background image having different frame rates, and an output unit configured to output the foreground image and the background image which are obtained by the obtaining unit and which are associated with each other.
    Type: Grant
    Filed: May 22, 2017
    Date of Patent: November 9, 2021
    Assignee: Canon Kabushiki Kaisha
    Inventors: Tomohiro Yano, Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Mai Komiyama, Kenichi Fujii, Atsushi Date
  • Patent number: 11057609
    Abstract: An information processing apparatus sets a plurality of key frames that each indicate a position of a virtual viewpoint that corresponds to a virtual viewpoint image, the plurality of key frames corresponding to different times, the virtual viewpoint image being generated based on images of an image capture region captured by a plurality of image capturing apparatuses from different directions. The information processing apparatus determines, based on a position of a virtual viewpoint indicated by a set first key frame and a position of a virtual viewpoint indicated by a set second key frame, a moving path of the virtual viewpoints during a time period between time that corresponds to the first key frame and time that corresponds to the second key frame, and outputs viewpoint information that indicates the determined moving path of the virtual viewpoints.
    Type: Grant
    Filed: February 7, 2020
    Date of Patent: July 6, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Keigo Yoneda, Michio Aizawa
  • Patent number: 11012674
    Abstract: An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes a determination unit configured to determine a generation method for generating a virtual viewpoint image using the image data from among a plurality of generation methods depending on a situation of imaging using the plurality of cameras, and an output unit configured to output data in accordance with a result of the determination performed by the determination unit.
    Type: Grant
    Filed: May 22, 2017
    Date of Patent: May 18, 2021
    Assignee: Canon Kabushiki Kaisha
    Inventors: Keisuke Morisawa, Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
  • Publication number: 20210021803
    Abstract: A method for generating a virtual viewpoint image includes generating, by a first image processing apparatus, first information for generating the virtual viewpoint image based on a first image captured by a first camera, generating, by a second image processing apparatus, second information for generating the virtual viewpoint image based on a second image captured by a second camera; specifying a viewpoint in the virtual viewpoint image; and generating, by a third image processing apparatus, a virtual viewpoint image corresponding to the specified viewpoint using the first information and the second information.
    Type: Application
    Filed: October 7, 2020
    Publication date: January 21, 2021
    Inventors: Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
  • Patent number: 10855967
    Abstract: An image processing apparatus includes an obtaining unit configured to obtain identification information for identifying a restriction area which is set in a three-dimensional coordinate system, the restriction area being an area in which display of a virtual object inserted in a virtual viewpoint image based on captured images obtained by a plurality of cameras that capture images in different angles and viewpoint information corresponding to a specification of a virtual viewpoint is restricted, wherein the virtual object is not included in the captured images obtained by the plurality of cameras, and a control unit configured to restrict the display of the virtual object in the virtual viewpoint image so that the display of the virtual object being in the restriction area, which is identified by the identification information obtained by the obtaining unit, is restricted.
    Type: Grant
    Filed: March 30, 2018
    Date of Patent: December 1, 2020
    Assignee: Canon Kabushiki Kaisha
    Inventor: Michio Aizawa
  • Patent number: 10848748
    Abstract: A method for generating a virtual viewpoint image includes generating, by a first image processing apparatus, first information for generating the virtual viewpoint image based on a first image captured by a first camera, generating, by a second image processing apparatus, second information for generating the virtual viewpoint image based on a second image captured by a second camera; specifying a viewpoint in the virtual viewpoint image; and generating, by a third image processing apparatus, a virtual viewpoint image corresponding to the specified viewpoint using the first information and the second information.
    Type: Grant
    Filed: May 22, 2017
    Date of Patent: November 24, 2020
    Assignee: Canon Kabushiki Kaisha
    Inventors: Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
  • Publication number: 20200336719
    Abstract: An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes a determination unit configured to determine a generation method for generating a virtual viewpoint image using the image data from among a plurality of generation methods depending on a situation of imaging using the plurality of cameras, and an output unit configured to output data in accordance with a result of the determination performed by the determination unit.
    Type: Application
    Filed: May 22, 2017
    Publication date: October 22, 2020
    Inventors: Keisuke Morisawa, Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
  • Publication number: 20200329189
    Abstract: A control device for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The control device includes an obtaining unit configured to obtain game information specifying a type of game which is a target of imaging performed by the plurality of cameras, a storage unit configured to store information for associating the game information obtained by the obtaining unit with setting information of the system, and a setting unit configured to perform a setting process of the system based on the game information obtained by the obtaining unit and the information stored in the storage unit.
    Type: Application
    Filed: May 22, 2017
    Publication date: October 15, 2020
    Inventors: Katsumasa Tanaka, Masahiro Handa, Michio Aizawa, Shogo Mizuno, Akihiro Matsushita, Keisuke Morisawa, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
  • Publication number: 20200322584
    Abstract: A control device for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The control device includes a reception unit configured to receive an instruction issued by a user for specifying a virtual viewpoint associated with generation of a virtual viewpoint image, an obtaining unit configured to obtain restriction information for specifying a restriction region where designation of a virtual viewpoint based on the instruction received by the reception unit is restricted, wherein the restriction region is changed in accordance with a parameter associated with the image data, and a notification unit configured to perform a notification based on the restriction information obtained by the obtaining unit.
    Type: Application
    Filed: May 22, 2017
    Publication date: October 8, 2020
    Inventors: Michio Aizawa, Masahiro Handa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
  • Publication number: 20200322591
    Abstract: An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes an obtaining unit configured to obtain a foreground image based on an object region including a predetermined object in a captured image for generating a virtual viewpoint image and a background image based on a region different from the object region in the captured image, wherein the obtained foreground image and the obtained background image having different frame rates, and an output unit configured to output the foreground image and the background image which are obtained by the obtaining unit and which are associated with each other.
    Type: Application
    Filed: May 22, 2017
    Publication date: October 8, 2020
    Applicant: Canon Kabushiki Kaisha
    Inventors: Tomohiro YANO, Masahiro HANDA, Michio AIZAWA, Shogo MIZUNO, Katsumasa TANAKA, Akihiro MATSUSHITA, Keisuke MORISAWA, Mai KOMIYAMA, Kenichi FUJII, Atsushi DATE
  • Publication number: 20200275084
    Abstract: A parameter set specification unit of an information processing apparatus specifies a virtual viewpoint parameter set included in virtual viewpoint information obtained by a camera path obtaining unit. A camera path modification unit modifies a virtual viewpoint parameter included in the specified virtual viewpoint parameter set based on at least either a size of an object region included in a virtual viewpoint image corresponding to the specified virtual viewpoint parameter set or information for determining the size.
    Type: Application
    Filed: February 19, 2020
    Publication date: August 27, 2020
    Inventor: Michio Aizawa