Patents by Inventor Keisuke Morisawa
Keisuke Morisawa has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11798233Abstract: A generation device of a three-dimensional model including: an acquisition unit configured to acquire a first mask image indicating a structure area, which is an object still within each image captured from a plurality of viewpoints, and a second mask image indicating a foreground area, which is a moving object within each image captured from the plurality of viewpoints; a combination unit configured to generate a third mask image that integrates the structure area and the foreground area within the image captured from the plurality of viewpoints by combining the first mask image and the second mask image both acquired; and a generation unit configured to generate a three-dimensional model including the structure and the foreground by a visual volume intersection method using the third mask image.Type: GrantFiled: September 16, 2021Date of Patent: October 24, 2023Assignee: Canon Kabushiki KaishaInventors: Keisuke Morisawa, Kiwamu Kobayashi
-
Publication number: 20230283757Abstract: A method for generating a virtual viewpoint image includes generating, by a first image processing apparatus, first information for generating the virtual viewpoint image based on a first image captured by a first camera, generating, by a second image processing apparatus, second information for generating the virtual viewpoint image based on a second image captured by a second camera; specifying a viewpoint in the virtual viewpoint image; and generating, by a third image processing apparatus, a virtual viewpoint image corresponding to the specified viewpoint using the first information and the second information.Type: ApplicationFiled: May 12, 2023Publication date: September 7, 2023Inventors: Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
-
Patent number: 11750792Abstract: An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes an obtaining unit configured to obtain a foreground image based on an object region including a predetermined object in a captured image for generating a virtual viewpoint image and a background image based on a region different from the object region in the captured image, wherein the obtained foreground image and the obtained background image having different frame rates, and an output unit configured to output the foreground image and the background image which are obtained by the obtaining unit and which are associated with each other.Type: GrantFiled: October 6, 2021Date of Patent: September 5, 2023Assignee: Canon Kabushiki KaishaInventors: Tomohiro Yano, Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Mai Komiyama, Kenichi Fujii, Atsushi Date
-
Patent number: 11689706Abstract: A method for generating a virtual viewpoint image includes generating, by a first image processing apparatus, first information for generating the virtual viewpoint image based on a first image captured by a first camera, generating, by a second image processing apparatus, second information for generating the virtual viewpoint image based on a second image captured by a second camera; specifying a viewpoint in the virtual viewpoint image; and generating, by a third image processing apparatus, a virtual viewpoint image corresponding to the specified viewpoint using the first information and the second information.Type: GrantFiled: October 7, 2020Date of Patent: June 27, 2023Assignee: Canon Kabushiki KaishaInventors: Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
-
Patent number: 11574432Abstract: The image processing apparatus obtains an image representing an object, performs specific processing for an object included in an area whose object extraction accuracy is lower than a threshold value in the captured image, and generates three-dimensional shape data of the object based on the image representing the object for which the specific processing has been performed.Type: GrantFiled: June 15, 2021Date of Patent: February 7, 2023Assignee: CANON KABUSHIKI KAISHAInventor: Keisuke Morisawa
-
Publication number: 20220030215Abstract: An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes an obtaining unit configured to obtain a foreground image based on an object region including a predetermined object in a captured image for generating a virtual viewpoint image and a background image based on a region different from the object region in the captured image, wherein the obtained foreground image and the obtained background image having different frame rates, and an output unit configured to output the foreground image and the background image which are obtained by the obtaining unit and which are associated with each other.Type: ApplicationFiled: October 6, 2021Publication date: January 27, 2022Inventors: Tomohiro Yano, Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Mai Komiyama, Kenichi Fujii, Atsushi Date
-
Publication number: 20220012932Abstract: The image processing apparatus obtains an image representing an object, performs specific processing for an object included in an area whose object extraction accuracy is lower than a threshold value in the captured image, and generates three-dimensional shape data of the object based on the image representing the object for which the specific processing has been performed.Type: ApplicationFiled: June 15, 2021Publication date: January 13, 2022Inventor: Keisuke Morisawa
-
Publication number: 20220005276Abstract: A generation device of a three-dimensional model including: an acquisition unit configured to acquire a first mask image indicating a structure area, which is an object still within each image captured from a plurality of viewpoints, and a second mask image indicating a foreground area, which is a moving object within each image captured from the plurality of viewpoints; a combination unit configured to generate a third mask image that integrates the structure area and the foreground area within the image captured from the plurality of viewpoints by combining the first mask image and the second mask image both acquired; and a generation unit configured to generate a three-dimensional model including the structure and the foreground by a visual volume intersection method using the third mask image.Type: ApplicationFiled: September 16, 2021Publication date: January 6, 2022Inventors: Keisuke Morisawa, Kiwamu Kobayashi
-
Patent number: 11200690Abstract: A generation apparatus acquires a plurality of images obtained based on image capturing by a plurality of image capturing devices, the image indicating an object area of an object and being used for generating three-dimensional shape data of the object. The generation apparatus detects an abnormal image from among the acquired plurality of images. The generation apparatus performs processing on the detected abnormal image, in a case where the abnormal image is detected. The generation apparatus generates three-dimensional shape data of the object, by use of an image obtained as a result of performing the processing on the detected abnormal image, instead of the detected abnormal image, in a case where the abnormal image is detected.Type: GrantFiled: November 12, 2019Date of Patent: December 14, 2021Assignee: CANON KABUSHIKI KAISHAInventor: Keisuke Morisawa
-
Patent number: 11190673Abstract: A control device for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The control device includes an obtaining unit configured to obtain game information specifying a type of game which is a target of imaging performed by the plurality of cameras, a storage unit configured to store information for associating the game information obtained by the obtaining unit with setting information of the system, and a setting unit configured to perform a setting process of the system based on the game information obtained by the obtaining unit and the information stored in the storage unit.Type: GrantFiled: May 22, 2017Date of Patent: November 30, 2021Assignee: Canon Kabushiki KaishaInventors: Katsumasa Tanaka, Masahiro Handa, Michio Aizawa, Shogo Mizuno, Akihiro Matsushita, Keisuke Morisawa, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
-
Patent number: 11172187Abstract: An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes an obtaining unit configured to obtain a foreground image based on an object region including a predetermined object in a captured image for generating a virtual viewpoint image and a background image based on a region different from the object region in the captured image, wherein the obtained foreground image and the obtained background image having different frame rates, and an output unit configured to output the foreground image and the background image which are obtained by the obtaining unit and which are associated with each other.Type: GrantFiled: May 22, 2017Date of Patent: November 9, 2021Assignee: Canon Kabushiki KaishaInventors: Tomohiro Yano, Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Mai Komiyama, Kenichi Fujii, Atsushi Date
-
Patent number: 11151787Abstract: A generation device of a three-dimensional model including: an acquisition unit configured to acquire a first mask image indicating a structure area, which is an object still within each image captured from a plurality of viewpoints, and a second mask image indicating a foreground area, which is a moving object within each image captured from the plurality of viewpoints; a combination unit configured to generate a third mask image that integrates the structure area and the foreground area within the image captured from the plurality of viewpoints by combining the first mask image and the second mask image both acquired; and a generation unit configured to generate a three-dimensional model including the structure and the foreground by a visual volume intersection method using the third mask image.Type: GrantFiled: October 24, 2019Date of Patent: October 19, 2021Assignee: Canon Kabushiki KaishaInventors: Keisuke Morisawa, Kiwamu Kobayashi
-
Patent number: 11012674Abstract: An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes a determination unit configured to determine a generation method for generating a virtual viewpoint image using the image data from among a plurality of generation methods depending on a situation of imaging using the plurality of cameras, and an output unit configured to output data in accordance with a result of the determination performed by the determination unit.Type: GrantFiled: May 22, 2017Date of Patent: May 18, 2021Assignee: Canon Kabushiki KaishaInventors: Keisuke Morisawa, Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
-
Publication number: 20210021803Abstract: A method for generating a virtual viewpoint image includes generating, by a first image processing apparatus, first information for generating the virtual viewpoint image based on a first image captured by a first camera, generating, by a second image processing apparatus, second information for generating the virtual viewpoint image based on a second image captured by a second camera; specifying a viewpoint in the virtual viewpoint image; and generating, by a third image processing apparatus, a virtual viewpoint image corresponding to the specified viewpoint using the first information and the second information.Type: ApplicationFiled: October 7, 2020Publication date: January 21, 2021Inventors: Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
-
Patent number: 10848748Abstract: A method for generating a virtual viewpoint image includes generating, by a first image processing apparatus, first information for generating the virtual viewpoint image based on a first image captured by a first camera, generating, by a second image processing apparatus, second information for generating the virtual viewpoint image based on a second image captured by a second camera; specifying a viewpoint in the virtual viewpoint image; and generating, by a third image processing apparatus, a virtual viewpoint image corresponding to the specified viewpoint using the first information and the second information.Type: GrantFiled: May 22, 2017Date of Patent: November 24, 2020Assignee: Canon Kabushiki KaishaInventors: Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
-
Patent number: 10834371Abstract: A generation apparatus that generates a virtual viewpoint image based on a plurality of captured images obtained by a plurality of cameras and virtual viewpoint information, and includes: a generation unit configured to generate a virtual viewpoint image by a generation method determined from a plurality of generation methods for generating a virtual viewpoint image: a changing unit configured to change the generation method for generating a virtual viewpoint image from a first generation method to a second generation method; and a control unit configured to perform control to restrain a change of the generation method by the changing unit.Type: GrantFiled: June 4, 2018Date of Patent: November 10, 2020Assignee: CANON KABUSHIKI KAISHAInventor: Keisuke Morisawa
-
Publication number: 20200336719Abstract: An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes a determination unit configured to determine a generation method for generating a virtual viewpoint image using the image data from among a plurality of generation methods depending on a situation of imaging using the plurality of cameras, and an output unit configured to output data in accordance with a result of the determination performed by the determination unit.Type: ApplicationFiled: May 22, 2017Publication date: October 22, 2020Inventors: Keisuke Morisawa, Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
-
Publication number: 20200329189Abstract: A control device for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The control device includes an obtaining unit configured to obtain game information specifying a type of game which is a target of imaging performed by the plurality of cameras, a storage unit configured to store information for associating the game information obtained by the obtaining unit with setting information of the system, and a setting unit configured to perform a setting process of the system based on the game information obtained by the obtaining unit and the information stored in the storage unit.Type: ApplicationFiled: May 22, 2017Publication date: October 15, 2020Inventors: Katsumasa Tanaka, Masahiro Handa, Michio Aizawa, Shogo Mizuno, Akihiro Matsushita, Keisuke Morisawa, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
-
Publication number: 20200322584Abstract: A control device for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The control device includes a reception unit configured to receive an instruction issued by a user for specifying a virtual viewpoint associated with generation of a virtual viewpoint image, an obtaining unit configured to obtain restriction information for specifying a restriction region where designation of a virtual viewpoint based on the instruction received by the reception unit is restricted, wherein the restriction region is changed in accordance with a parameter associated with the image data, and a notification unit configured to perform a notification based on the restriction information obtained by the obtaining unit.Type: ApplicationFiled: May 22, 2017Publication date: October 8, 2020Inventors: Michio Aizawa, Masahiro Handa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
-
Publication number: 20200322591Abstract: An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes an obtaining unit configured to obtain a foreground image based on an object region including a predetermined object in a captured image for generating a virtual viewpoint image and a background image based on a region different from the object region in the captured image, wherein the obtained foreground image and the obtained background image having different frame rates, and an output unit configured to output the foreground image and the background image which are obtained by the obtaining unit and which are associated with each other.Type: ApplicationFiled: May 22, 2017Publication date: October 8, 2020Applicant: Canon Kabushiki KaishaInventors: Tomohiro YANO, Masahiro HANDA, Michio AIZAWA, Shogo MIZUNO, Katsumasa TANAKA, Akihiro MATSUSHITA, Keisuke MORISAWA, Mai KOMIYAMA, Kenichi FUJII, Atsushi DATE