Patents by Inventor Keisuke Morisawa

Keisuke Morisawa has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11798233
    Abstract: A generation device of a three-dimensional model including: an acquisition unit configured to acquire a first mask image indicating a structure area, which is an object still within each image captured from a plurality of viewpoints, and a second mask image indicating a foreground area, which is a moving object within each image captured from the plurality of viewpoints; a combination unit configured to generate a third mask image that integrates the structure area and the foreground area within the image captured from the plurality of viewpoints by combining the first mask image and the second mask image both acquired; and a generation unit configured to generate a three-dimensional model including the structure and the foreground by a visual volume intersection method using the third mask image.
    Type: Grant
    Filed: September 16, 2021
    Date of Patent: October 24, 2023
    Assignee: Canon Kabushiki Kaisha
    Inventors: Keisuke Morisawa, Kiwamu Kobayashi
  • Publication number: 20230283757
    Abstract: A method for generating a virtual viewpoint image includes generating, by a first image processing apparatus, first information for generating the virtual viewpoint image based on a first image captured by a first camera, generating, by a second image processing apparatus, second information for generating the virtual viewpoint image based on a second image captured by a second camera; specifying a viewpoint in the virtual viewpoint image; and generating, by a third image processing apparatus, a virtual viewpoint image corresponding to the specified viewpoint using the first information and the second information.
    Type: Application
    Filed: May 12, 2023
    Publication date: September 7, 2023
    Inventors: Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
  • Patent number: 11750792
    Abstract: An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes an obtaining unit configured to obtain a foreground image based on an object region including a predetermined object in a captured image for generating a virtual viewpoint image and a background image based on a region different from the object region in the captured image, wherein the obtained foreground image and the obtained background image having different frame rates, and an output unit configured to output the foreground image and the background image which are obtained by the obtaining unit and which are associated with each other.
    Type: Grant
    Filed: October 6, 2021
    Date of Patent: September 5, 2023
    Assignee: Canon Kabushiki Kaisha
    Inventors: Tomohiro Yano, Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Mai Komiyama, Kenichi Fujii, Atsushi Date
  • Patent number: 11689706
    Abstract: A method for generating a virtual viewpoint image includes generating, by a first image processing apparatus, first information for generating the virtual viewpoint image based on a first image captured by a first camera, generating, by a second image processing apparatus, second information for generating the virtual viewpoint image based on a second image captured by a second camera; specifying a viewpoint in the virtual viewpoint image; and generating, by a third image processing apparatus, a virtual viewpoint image corresponding to the specified viewpoint using the first information and the second information.
    Type: Grant
    Filed: October 7, 2020
    Date of Patent: June 27, 2023
    Assignee: Canon Kabushiki Kaisha
    Inventors: Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
  • Patent number: 11574432
    Abstract: The image processing apparatus obtains an image representing an object, performs specific processing for an object included in an area whose object extraction accuracy is lower than a threshold value in the captured image, and generates three-dimensional shape data of the object based on the image representing the object for which the specific processing has been performed.
    Type: Grant
    Filed: June 15, 2021
    Date of Patent: February 7, 2023
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Keisuke Morisawa
  • Publication number: 20220030215
    Abstract: An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes an obtaining unit configured to obtain a foreground image based on an object region including a predetermined object in a captured image for generating a virtual viewpoint image and a background image based on a region different from the object region in the captured image, wherein the obtained foreground image and the obtained background image having different frame rates, and an output unit configured to output the foreground image and the background image which are obtained by the obtaining unit and which are associated with each other.
    Type: Application
    Filed: October 6, 2021
    Publication date: January 27, 2022
    Inventors: Tomohiro Yano, Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Mai Komiyama, Kenichi Fujii, Atsushi Date
  • Publication number: 20220012932
    Abstract: The image processing apparatus obtains an image representing an object, performs specific processing for an object included in an area whose object extraction accuracy is lower than a threshold value in the captured image, and generates three-dimensional shape data of the object based on the image representing the object for which the specific processing has been performed.
    Type: Application
    Filed: June 15, 2021
    Publication date: January 13, 2022
    Inventor: Keisuke Morisawa
  • Publication number: 20220005276
    Abstract: A generation device of a three-dimensional model including: an acquisition unit configured to acquire a first mask image indicating a structure area, which is an object still within each image captured from a plurality of viewpoints, and a second mask image indicating a foreground area, which is a moving object within each image captured from the plurality of viewpoints; a combination unit configured to generate a third mask image that integrates the structure area and the foreground area within the image captured from the plurality of viewpoints by combining the first mask image and the second mask image both acquired; and a generation unit configured to generate a three-dimensional model including the structure and the foreground by a visual volume intersection method using the third mask image.
    Type: Application
    Filed: September 16, 2021
    Publication date: January 6, 2022
    Inventors: Keisuke Morisawa, Kiwamu Kobayashi
  • Patent number: 11200690
    Abstract: A generation apparatus acquires a plurality of images obtained based on image capturing by a plurality of image capturing devices, the image indicating an object area of an object and being used for generating three-dimensional shape data of the object. The generation apparatus detects an abnormal image from among the acquired plurality of images. The generation apparatus performs processing on the detected abnormal image, in a case where the abnormal image is detected. The generation apparatus generates three-dimensional shape data of the object, by use of an image obtained as a result of performing the processing on the detected abnormal image, instead of the detected abnormal image, in a case where the abnormal image is detected.
    Type: Grant
    Filed: November 12, 2019
    Date of Patent: December 14, 2021
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Keisuke Morisawa
  • Patent number: 11190673
    Abstract: A control device for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The control device includes an obtaining unit configured to obtain game information specifying a type of game which is a target of imaging performed by the plurality of cameras, a storage unit configured to store information for associating the game information obtained by the obtaining unit with setting information of the system, and a setting unit configured to perform a setting process of the system based on the game information obtained by the obtaining unit and the information stored in the storage unit.
    Type: Grant
    Filed: May 22, 2017
    Date of Patent: November 30, 2021
    Assignee: Canon Kabushiki Kaisha
    Inventors: Katsumasa Tanaka, Masahiro Handa, Michio Aizawa, Shogo Mizuno, Akihiro Matsushita, Keisuke Morisawa, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
  • Patent number: 11172187
    Abstract: An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes an obtaining unit configured to obtain a foreground image based on an object region including a predetermined object in a captured image for generating a virtual viewpoint image and a background image based on a region different from the object region in the captured image, wherein the obtained foreground image and the obtained background image having different frame rates, and an output unit configured to output the foreground image and the background image which are obtained by the obtaining unit and which are associated with each other.
    Type: Grant
    Filed: May 22, 2017
    Date of Patent: November 9, 2021
    Assignee: Canon Kabushiki Kaisha
    Inventors: Tomohiro Yano, Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Mai Komiyama, Kenichi Fujii, Atsushi Date
  • Patent number: 11151787
    Abstract: A generation device of a three-dimensional model including: an acquisition unit configured to acquire a first mask image indicating a structure area, which is an object still within each image captured from a plurality of viewpoints, and a second mask image indicating a foreground area, which is a moving object within each image captured from the plurality of viewpoints; a combination unit configured to generate a third mask image that integrates the structure area and the foreground area within the image captured from the plurality of viewpoints by combining the first mask image and the second mask image both acquired; and a generation unit configured to generate a three-dimensional model including the structure and the foreground by a visual volume intersection method using the third mask image.
    Type: Grant
    Filed: October 24, 2019
    Date of Patent: October 19, 2021
    Assignee: Canon Kabushiki Kaisha
    Inventors: Keisuke Morisawa, Kiwamu Kobayashi
  • Patent number: 11012674
    Abstract: An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes a determination unit configured to determine a generation method for generating a virtual viewpoint image using the image data from among a plurality of generation methods depending on a situation of imaging using the plurality of cameras, and an output unit configured to output data in accordance with a result of the determination performed by the determination unit.
    Type: Grant
    Filed: May 22, 2017
    Date of Patent: May 18, 2021
    Assignee: Canon Kabushiki Kaisha
    Inventors: Keisuke Morisawa, Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
  • Publication number: 20210021803
    Abstract: A method for generating a virtual viewpoint image includes generating, by a first image processing apparatus, first information for generating the virtual viewpoint image based on a first image captured by a first camera, generating, by a second image processing apparatus, second information for generating the virtual viewpoint image based on a second image captured by a second camera; specifying a viewpoint in the virtual viewpoint image; and generating, by a third image processing apparatus, a virtual viewpoint image corresponding to the specified viewpoint using the first information and the second information.
    Type: Application
    Filed: October 7, 2020
    Publication date: January 21, 2021
    Inventors: Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
  • Patent number: 10848748
    Abstract: A method for generating a virtual viewpoint image includes generating, by a first image processing apparatus, first information for generating the virtual viewpoint image based on a first image captured by a first camera, generating, by a second image processing apparatus, second information for generating the virtual viewpoint image based on a second image captured by a second camera; specifying a viewpoint in the virtual viewpoint image; and generating, by a third image processing apparatus, a virtual viewpoint image corresponding to the specified viewpoint using the first information and the second information.
    Type: Grant
    Filed: May 22, 2017
    Date of Patent: November 24, 2020
    Assignee: Canon Kabushiki Kaisha
    Inventors: Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
  • Patent number: 10834371
    Abstract: A generation apparatus that generates a virtual viewpoint image based on a plurality of captured images obtained by a plurality of cameras and virtual viewpoint information, and includes: a generation unit configured to generate a virtual viewpoint image by a generation method determined from a plurality of generation methods for generating a virtual viewpoint image: a changing unit configured to change the generation method for generating a virtual viewpoint image from a first generation method to a second generation method; and a control unit configured to perform control to restrain a change of the generation method by the changing unit.
    Type: Grant
    Filed: June 4, 2018
    Date of Patent: November 10, 2020
    Assignee: CANON KABUSHIKI KAISHA
    Inventor: Keisuke Morisawa
  • Publication number: 20200336719
    Abstract: An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes a determination unit configured to determine a generation method for generating a virtual viewpoint image using the image data from among a plurality of generation methods depending on a situation of imaging using the plurality of cameras, and an output unit configured to output data in accordance with a result of the determination performed by the determination unit.
    Type: Application
    Filed: May 22, 2017
    Publication date: October 22, 2020
    Inventors: Keisuke Morisawa, Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
  • Publication number: 20200329189
    Abstract: A control device for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The control device includes an obtaining unit configured to obtain game information specifying a type of game which is a target of imaging performed by the plurality of cameras, a storage unit configured to store information for associating the game information obtained by the obtaining unit with setting information of the system, and a setting unit configured to perform a setting process of the system based on the game information obtained by the obtaining unit and the information stored in the storage unit.
    Type: Application
    Filed: May 22, 2017
    Publication date: October 15, 2020
    Inventors: Katsumasa Tanaka, Masahiro Handa, Michio Aizawa, Shogo Mizuno, Akihiro Matsushita, Keisuke Morisawa, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
  • Publication number: 20200322584
    Abstract: A control device for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The control device includes a reception unit configured to receive an instruction issued by a user for specifying a virtual viewpoint associated with generation of a virtual viewpoint image, an obtaining unit configured to obtain restriction information for specifying a restriction region where designation of a virtual viewpoint based on the instruction received by the reception unit is restricted, wherein the restriction region is changed in accordance with a parameter associated with the image data, and a notification unit configured to perform a notification based on the restriction information obtained by the obtaining unit.
    Type: Application
    Filed: May 22, 2017
    Publication date: October 8, 2020
    Inventors: Michio Aizawa, Masahiro Handa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
  • Publication number: 20200322591
    Abstract: An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes an obtaining unit configured to obtain a foreground image based on an object region including a predetermined object in a captured image for generating a virtual viewpoint image and a background image based on a region different from the object region in the captured image, wherein the obtained foreground image and the obtained background image having different frame rates, and an output unit configured to output the foreground image and the background image which are obtained by the obtaining unit and which are associated with each other.
    Type: Application
    Filed: May 22, 2017
    Publication date: October 8, 2020
    Applicant: Canon Kabushiki Kaisha
    Inventors: Tomohiro YANO, Masahiro HANDA, Michio AIZAWA, Shogo MIZUNO, Katsumasa TANAKA, Akihiro MATSUSHITA, Keisuke MORISAWA, Mai KOMIYAMA, Kenichi FUJII, Atsushi DATE