Patents by Inventor Michio Aizawa

Michio Aizawa has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240338892
    Abstract: An information processing apparatus is provided. The apparatus obtains information on a 3D model of an object. The apparatus generates metadata on the 3D model of the object on a basis of the information in accordance with a metadata generation request including a metadata type designation. The apparatus transmits the metadata on the 3D model of the object generated in accordance with the generation request.
    Type: Application
    Filed: March 28, 2024
    Publication date: October 10, 2024
    Inventors: Michio AIZAWA, Keisuke MORISAWA
  • Publication number: 20240292117
    Abstract: An arrangement determination apparatus for determining an arrangement of a plurality of cameras that is used for generation of a virtual viewpoint image acquires information indicating an imaging target region, and determines an arrangement of the plurality of cameras based on the information in such a manner that images of the entire region of the imaging target region are captured by two or more cameras of the plurality of cameras and images of the entire region of the imaging target region are captured by different two or more cameras of the plurality of cameras that are different from the two or more cameras.
    Type: Application
    Filed: May 6, 2024
    Publication date: August 29, 2024
    Inventors: Michio Aizawa, Yasushi Shikata, Shinichiro Uno, Atsushi Date
  • Publication number: 20240244174
    Abstract: An image processing apparatus: obtain information on a virtual viewpoint to generate a virtual viewpoint image, the virtual viewpoint image being an image of an object viewed from the virtual viewpoint, the object included in an image capturing region of an image capturing apparatus; obtain enlarged three-dimensional shape data representing the object in which at least a part of regions is greater than that of normal three-dimensional shape data generated based on images obtained by image capturing by the image capturing apparatus; and generate the virtual viewpoint image based on the enlarged three-dimensional shape data in a case where a visual field represented by the information is a panoramic visual field.
    Type: Application
    Filed: December 19, 2023
    Publication date: July 18, 2024
    Inventor: Michio AIZAWA
  • Patent number: 12010437
    Abstract: An arrangement determination apparatus for determining an arrangement of a plurality of cameras that is used for generation of a virtual viewpoint image acquires information indicating an imaging target region, and determines an arrangement of the plurality of cameras based on the information in such a manner that images of the entire region of the imaging target region are captured by two or more cameras of the plurality of cameras and images of the entire region of the imaging target region are captured by different two or more cameras of the plurality of cameras that are different from the two or more cameras.
    Type: Grant
    Filed: November 3, 2021
    Date of Patent: June 11, 2024
    Assignee: Canon Kabushiki Kaisha
    Inventors: Michio Aizawa, Yasushi Shikata, Shinichiro Uno, Atsushi Date
  • Patent number: 11825063
    Abstract: An image processing apparatus comprising: an identifying unit that identifies, from multiple image capture apparatuses that capture images of an image capture space from multiple directions, two or more image capture apparatuses that capture images of a predetermined position in the image capture space; a camera path setting unit that sets multiple viewpoints that are based on the two or more image capture apparatuses identified by the identifying unit; a virtual viewpoint image generating unit that generates multiple viewpoint images corresponding to the multiple viewpoints based on three-dimensional shape data generated using multiple images captured by the multiple image capture apparatuses; and an image capture apparatus selecting unit that selects, from the two or more image capture apparatuses identified by the identifying unit, an image capture apparatus close to the position of the viewpoint corresponding to a viewpoint image designated by a user from the multiple viewpoint images.
    Type: Grant
    Filed: March 25, 2022
    Date of Patent: November 21, 2023
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Michio Aizawa
  • Publication number: 20230283757
    Abstract: A method for generating a virtual viewpoint image includes generating, by a first image processing apparatus, first information for generating the virtual viewpoint image based on a first image captured by a first camera, generating, by a second image processing apparatus, second information for generating the virtual viewpoint image based on a second image captured by a second camera; specifying a viewpoint in the virtual viewpoint image; and generating, by a third image processing apparatus, a virtual viewpoint image corresponding to the specified viewpoint using the first information and the second information.
    Type: Application
    Filed: May 12, 2023
    Publication date: September 7, 2023
    Inventors: Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
  • Patent number: 11750792
    Abstract: An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes an obtaining unit configured to obtain a foreground image based on an object region including a predetermined object in a captured image for generating a virtual viewpoint image and a background image based on a region different from the object region in the captured image, wherein the obtained foreground image and the obtained background image having different frame rates, and an output unit configured to output the foreground image and the background image which are obtained by the obtaining unit and which are associated with each other.
    Type: Grant
    Filed: October 6, 2021
    Date of Patent: September 5, 2023
    Assignee: Canon Kabushiki Kaisha
    Inventors: Tomohiro Yano, Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Mai Komiyama, Kenichi Fujii, Atsushi Date
  • Patent number: 11689706
    Abstract: A method for generating a virtual viewpoint image includes generating, by a first image processing apparatus, first information for generating the virtual viewpoint image based on a first image captured by a first camera, generating, by a second image processing apparatus, second information for generating the virtual viewpoint image based on a second image captured by a second camera; specifying a viewpoint in the virtual viewpoint image; and generating, by a third image processing apparatus, a virtual viewpoint image corresponding to the specified viewpoint using the first information and the second information.
    Type: Grant
    Filed: October 7, 2020
    Date of Patent: June 27, 2023
    Assignee: Canon Kabushiki Kaisha
    Inventors: Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
  • Publication number: 20220321855
    Abstract: An image processing apparatus comprising: an identifying unit that identifies, from multiple image capture apparatuses that capture images of an image capture space from multiple directions, two or more image capture apparatuses that capture images of a predetermined position in the image capture space; a camera path setting unit that sets multiple viewpoints that are based on the two or more image capture apparatuses identified by the identifying unit; a virtual viewpoint image generating unit that generates multiple viewpoint images corresponding to the multiple viewpoints based on three-dimensional shape data generated using multiple images captured by the multiple image capture apparatuses; and an image capture apparatus selecting unit that selects, from the two or more image capture apparatuses identified by the identifying unit, an image capture apparatus close to the position of the viewpoint corresponding to a viewpoint image designated by a user from the multiple viewpoint images.
    Type: Application
    Filed: March 25, 2022
    Publication date: October 6, 2022
    Inventor: Michio Aizawa
  • Patent number: 11323688
    Abstract: An information processing apparatus is configured to perform at least based on a first parameter set according to an operation on a first operation unit, and also based on an operation on a second operation unit, changing at least either of a position and a direction of a virtual viewpoint corresponding to a virtual viewpoint image, receiving a switching input for switching a parameter set according to an operation on the first operation unit from the first parameter to a second parameter, and based on the second parameter set according to an operation on the first operation unit performed after the switching input is received, and also based on an operation on the second operation unit, changing at least either of the position and the direction of the virtual viewpoint.
    Type: Grant
    Filed: July 15, 2019
    Date of Patent: May 3, 2022
    Assignee: Canon Kabushiki Kaisha
    Inventor: Michio Aizawa
  • Publication number: 20220060638
    Abstract: An arrangement determination apparatus for determining an arrangement of a plurality of cameras that is used for generation of a virtual viewpoint image acquires information indicating an imaging target region, and determines an arrangement of the plurality of cameras based on the information in such a manner that images of the entire region of the imaging target region are captured by two or more cameras of the plurality of cameras and images of the entire region of the imaging target region are captured by different two or more cameras of the plurality of cameras that are different from the two or more cameras.
    Type: Application
    Filed: November 3, 2021
    Publication date: February 24, 2022
    Inventors: Michio Aizawa, Yasushi Shikata, Shinichiro Uno, Atsushi Date
  • Publication number: 20220030215
    Abstract: An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes an obtaining unit configured to obtain a foreground image based on an object region including a predetermined object in a captured image for generating a virtual viewpoint image and a background image based on a region different from the object region in the captured image, wherein the obtained foreground image and the obtained background image having different frame rates, and an output unit configured to output the foreground image and the background image which are obtained by the obtaining unit and which are associated with each other.
    Type: Application
    Filed: October 6, 2021
    Publication date: January 27, 2022
    Inventors: Tomohiro Yano, Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Mai Komiyama, Kenichi Fujii, Atsushi Date
  • Patent number: 11190673
    Abstract: A control device for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The control device includes an obtaining unit configured to obtain game information specifying a type of game which is a target of imaging performed by the plurality of cameras, a storage unit configured to store information for associating the game information obtained by the obtaining unit with setting information of the system, and a setting unit configured to perform a setting process of the system based on the game information obtained by the obtaining unit and the information stored in the storage unit.
    Type: Grant
    Filed: May 22, 2017
    Date of Patent: November 30, 2021
    Assignee: Canon Kabushiki Kaisha
    Inventors: Katsumasa Tanaka, Masahiro Handa, Michio Aizawa, Shogo Mizuno, Akihiro Matsushita, Keisuke Morisawa, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
  • Patent number: 11172187
    Abstract: An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes an obtaining unit configured to obtain a foreground image based on an object region including a predetermined object in a captured image for generating a virtual viewpoint image and a background image based on a region different from the object region in the captured image, wherein the obtained foreground image and the obtained background image having different frame rates, and an output unit configured to output the foreground image and the background image which are obtained by the obtaining unit and which are associated with each other.
    Type: Grant
    Filed: May 22, 2017
    Date of Patent: November 9, 2021
    Assignee: Canon Kabushiki Kaisha
    Inventors: Tomohiro Yano, Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Mai Komiyama, Kenichi Fujii, Atsushi Date
  • Patent number: 11057609
    Abstract: An information processing apparatus sets a plurality of key frames that each indicate a position of a virtual viewpoint that corresponds to a virtual viewpoint image, the plurality of key frames corresponding to different times, the virtual viewpoint image being generated based on images of an image capture region captured by a plurality of image capturing apparatuses from different directions. The information processing apparatus determines, based on a position of a virtual viewpoint indicated by a set first key frame and a position of a virtual viewpoint indicated by a set second key frame, a moving path of the virtual viewpoints during a time period between time that corresponds to the first key frame and time that corresponds to the second key frame, and outputs viewpoint information that indicates the determined moving path of the virtual viewpoints.
    Type: Grant
    Filed: February 7, 2020
    Date of Patent: July 6, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventors: Keigo Yoneda, Michio Aizawa
  • Patent number: 11012674
    Abstract: An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes a determination unit configured to determine a generation method for generating a virtual viewpoint image using the image data from among a plurality of generation methods depending on a situation of imaging using the plurality of cameras, and an output unit configured to output data in accordance with a result of the determination performed by the determination unit.
    Type: Grant
    Filed: May 22, 2017
    Date of Patent: May 18, 2021
    Assignee: Canon Kabushiki Kaisha
    Inventors: Keisuke Morisawa, Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
  • Publication number: 20210021803
    Abstract: A method for generating a virtual viewpoint image includes generating, by a first image processing apparatus, first information for generating the virtual viewpoint image based on a first image captured by a first camera, generating, by a second image processing apparatus, second information for generating the virtual viewpoint image based on a second image captured by a second camera; specifying a viewpoint in the virtual viewpoint image; and generating, by a third image processing apparatus, a virtual viewpoint image corresponding to the specified viewpoint using the first information and the second information.
    Type: Application
    Filed: October 7, 2020
    Publication date: January 21, 2021
    Inventors: Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
  • Patent number: 10855967
    Abstract: An image processing apparatus includes an obtaining unit configured to obtain identification information for identifying a restriction area which is set in a three-dimensional coordinate system, the restriction area being an area in which display of a virtual object inserted in a virtual viewpoint image based on captured images obtained by a plurality of cameras that capture images in different angles and viewpoint information corresponding to a specification of a virtual viewpoint is restricted, wherein the virtual object is not included in the captured images obtained by the plurality of cameras, and a control unit configured to restrict the display of the virtual object in the virtual viewpoint image so that the display of the virtual object being in the restriction area, which is identified by the identification information obtained by the obtaining unit, is restricted.
    Type: Grant
    Filed: March 30, 2018
    Date of Patent: December 1, 2020
    Assignee: Canon Kabushiki Kaisha
    Inventor: Michio Aizawa
  • Patent number: 10848748
    Abstract: A method for generating a virtual viewpoint image includes generating, by a first image processing apparatus, first information for generating the virtual viewpoint image based on a first image captured by a first camera, generating, by a second image processing apparatus, second information for generating the virtual viewpoint image based on a second image captured by a second camera; specifying a viewpoint in the virtual viewpoint image; and generating, by a third image processing apparatus, a virtual viewpoint image corresponding to the specified viewpoint using the first information and the second information.
    Type: Grant
    Filed: May 22, 2017
    Date of Patent: November 24, 2020
    Assignee: Canon Kabushiki Kaisha
    Inventors: Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
  • Publication number: 20200336719
    Abstract: An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes a determination unit configured to determine a generation method for generating a virtual viewpoint image using the image data from among a plurality of generation methods depending on a situation of imaging using the plurality of cameras, and an output unit configured to output data in accordance with a result of the determination performed by the determination unit.
    Type: Application
    Filed: May 22, 2017
    Publication date: October 22, 2020
    Inventors: Keisuke Morisawa, Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date