Patents by Inventor Shogo Mizuno
Shogo Mizuno has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11911891Abstract: An actuator system that picks up workpieces aims to shorten tact time and to reduce damages to workpieces. The actuator system includes an actuator that picks up a workpiece, an external force detection sensor that detects a physical quantity that is correlated with an external force that is applied to the workpiece, a head unit that is connected to the actuator and the external force detection sensor without a communication network, the head unit being configured to control the actuator based on a sensing result from the external force detection sensor when a pickup request signal that is a signal requesting pickup of the workpiece is received, and a control device that is connected to the head unit over the communication network, the control device being configured to transmit the pickup request signal to the head unit.Type: GrantFiled: October 17, 2019Date of Patent: February 27, 2024Assignee: THK CO., LTD.Inventors: Katsuya Fukushima, Masashi Ishii, Hiroki Niwa, Akira Suzuki, Kazuto Oga, Shogo Wakuta, Satoshi Hara, Tomofumi Mizuno, Shigeki Hayashi
-
Publication number: 20230410416Abstract: An image processing system includes one or more memories storing instructions, and one or more processors that execute the instructions to acquire a visual field of a virtual camera that changes in position relative to a region where a first virtual object and a second virtual object are displayed interchangeably, acquire, during a time in which the region is in the visual field of the virtual camera, a first display time indicating a time during which the first virtual object is displayed in the region and a second display time indicating a time during which the second virtual object is displayed in the region, and generate, based on the first display time and the second display time, a virtual viewpoint image corresponding to the virtual camera, wherein the virtual viewpoint image includes one of the first virtual object and the second virtual object.Type: ApplicationFiled: June 12, 2023Publication date: December 21, 2023Inventor: SHOGO MIZUNO
-
Publication number: 20230370575Abstract: An image processing apparatus predicts a virtual viewpoint in a second frame subsequent to a first frame in a virtual viewpoint image and a position of a three-dimensional subject model in the second frame. The image processing apparatus determines an image capturing apparatus from which a captured image to be used for generating the second frame is obtained from among the plurality of image capturing apparatuses based on the predicted virtual viewpoint, the predicted position of the three-dimensional subject model, and image capturing parameters of the image capturing apparatuses, and generates the virtual viewpoint image based on the captured image for the second frame obtained from the determined image capturing apparatus, the three-dimensional subject model corresponding to the second frame, and the virtual viewpoint information corresponding to the second frame.Type: ApplicationFiled: May 3, 2023Publication date: November 16, 2023Inventor: SHOGO MIZUNO
-
Publication number: 20230283757Abstract: A method for generating a virtual viewpoint image includes generating, by a first image processing apparatus, first information for generating the virtual viewpoint image based on a first image captured by a first camera, generating, by a second image processing apparatus, second information for generating the virtual viewpoint image based on a second image captured by a second camera; specifying a viewpoint in the virtual viewpoint image; and generating, by a third image processing apparatus, a virtual viewpoint image corresponding to the specified viewpoint using the first information and the second information.Type: ApplicationFiled: May 12, 2023Publication date: September 7, 2023Inventors: Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
-
Patent number: 11750792Abstract: An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes an obtaining unit configured to obtain a foreground image based on an object region including a predetermined object in a captured image for generating a virtual viewpoint image and a background image based on a region different from the object region in the captured image, wherein the obtained foreground image and the obtained background image having different frame rates, and an output unit configured to output the foreground image and the background image which are obtained by the obtaining unit and which are associated with each other.Type: GrantFiled: October 6, 2021Date of Patent: September 5, 2023Assignee: Canon Kabushiki KaishaInventors: Tomohiro Yano, Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Mai Komiyama, Kenichi Fujii, Atsushi Date
-
Patent number: 11689706Abstract: A method for generating a virtual viewpoint image includes generating, by a first image processing apparatus, first information for generating the virtual viewpoint image based on a first image captured by a first camera, generating, by a second image processing apparatus, second information for generating the virtual viewpoint image based on a second image captured by a second camera; specifying a viewpoint in the virtual viewpoint image; and generating, by a third image processing apparatus, a virtual viewpoint image corresponding to the specified viewpoint using the first information and the second information.Type: GrantFiled: October 7, 2020Date of Patent: June 27, 2023Assignee: Canon Kabushiki KaishaInventors: Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
-
Publication number: 20220189103Abstract: A generation apparatus includes an acquisition unit configured to acquire shape data representing a shape of a subject based on a plurality of captured images obtained by a plurality of imaging apparatuses capturing the subject in an imaging region, a first determination unit configured to determine a subject position which is a position of the subject in the imaging region, a second determination unit configured to determine a reference position serving as a reference of the position of the subject, and a generation unit configured to generate, based on the shape data acquired by the acquisition unit, a virtual viewpoint image in accordance with a deviation between the subject position determined by the first determination unit and the reference position determined by the second determination unit.Type: ApplicationFiled: December 7, 2021Publication date: June 16, 2022Inventor: Shogo Mizuno
-
Publication number: 20220030215Abstract: An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes an obtaining unit configured to obtain a foreground image based on an object region including a predetermined object in a captured image for generating a virtual viewpoint image and a background image based on a region different from the object region in the captured image, wherein the obtained foreground image and the obtained background image having different frame rates, and an output unit configured to output the foreground image and the background image which are obtained by the obtaining unit and which are associated with each other.Type: ApplicationFiled: October 6, 2021Publication date: January 27, 2022Inventors: Tomohiro Yano, Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Mai Komiyama, Kenichi Fujii, Atsushi Date
-
Patent number: 11190673Abstract: A control device for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The control device includes an obtaining unit configured to obtain game information specifying a type of game which is a target of imaging performed by the plurality of cameras, a storage unit configured to store information for associating the game information obtained by the obtaining unit with setting information of the system, and a setting unit configured to perform a setting process of the system based on the game information obtained by the obtaining unit and the information stored in the storage unit.Type: GrantFiled: May 22, 2017Date of Patent: November 30, 2021Assignee: Canon Kabushiki KaishaInventors: Katsumasa Tanaka, Masahiro Handa, Michio Aizawa, Shogo Mizuno, Akihiro Matsushita, Keisuke Morisawa, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
-
Patent number: 11172187Abstract: An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes an obtaining unit configured to obtain a foreground image based on an object region including a predetermined object in a captured image for generating a virtual viewpoint image and a background image based on a region different from the object region in the captured image, wherein the obtained foreground image and the obtained background image having different frame rates, and an output unit configured to output the foreground image and the background image which are obtained by the obtaining unit and which are associated with each other.Type: GrantFiled: May 22, 2017Date of Patent: November 9, 2021Assignee: Canon Kabushiki KaishaInventors: Tomohiro Yano, Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Mai Komiyama, Kenichi Fujii, Atsushi Date
-
Publication number: 20210337177Abstract: It is an object of the present invention to reduce a possibility that a subject (specific object) of a virtual viewpoint image and a virtual object area overlap. To achieve the object, the present invention comprises a first identifying unit for identifying a three-dimensional position of the specific object captured respectively from different directions by a plurality of cameras; a second identifying unit for identifying a three-dimensional position of a virtual viewpoint related to generation of the virtual viewpoint image based on captured images obtained by the plurality of cameras; and a determining unit for determining a position of the virtual object area to which a virtual object to be displayed in the virtual viewpoint image is disposed, based on the three-dimensional position of the specific object identified by the first identifying unit and the three-dimensional position of the virtual viewpoint identified by the second identifying unit.Type: ApplicationFiled: July 6, 2021Publication date: October 28, 2021Inventors: Shogo Mizuno, Atsushi Date
-
Patent number: 11089284Abstract: It is an object of the present invention to reduce a possibility that a subject (specific object) of a virtual viewpoint image and a virtual object area overlap. To achieve the object, the present invention comprises a first identifying unit for identifying a three-dimensional position of the specific object captured respectively from different directions by a plurality of cameras; a second identifying unit for identifying a three-dimensional position of a virtual viewpoint related to generation of the virtual viewpoint image based on captured images obtained by the plurality of cameras; and a determining unit for determining a position of the virtual object area to which a virtual object to be displayed in the virtual viewpoint image is disposed, based on the three-dimensional position of the specific object identified by the first identifying unit and the three-dimensional position of the virtual viewpoint identified by the second identifying unit.Type: GrantFiled: March 5, 2019Date of Patent: August 10, 2021Assignee: Canon Kabushiki KaishaInventors: Shogo Mizuno, Atsushi Date
-
Patent number: 11012674Abstract: An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes a determination unit configured to determine a generation method for generating a virtual viewpoint image using the image data from among a plurality of generation methods depending on a situation of imaging using the plurality of cameras, and an output unit configured to output data in accordance with a result of the determination performed by the determination unit.Type: GrantFiled: May 22, 2017Date of Patent: May 18, 2021Assignee: Canon Kabushiki KaishaInventors: Keisuke Morisawa, Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
-
Publication number: 20210021803Abstract: A method for generating a virtual viewpoint image includes generating, by a first image processing apparatus, first information for generating the virtual viewpoint image based on a first image captured by a first camera, generating, by a second image processing apparatus, second information for generating the virtual viewpoint image based on a second image captured by a second camera; specifying a viewpoint in the virtual viewpoint image; and generating, by a third image processing apparatus, a virtual viewpoint image corresponding to the specified viewpoint using the first information and the second information.Type: ApplicationFiled: October 7, 2020Publication date: January 21, 2021Inventors: Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
-
Patent number: 10848748Abstract: A method for generating a virtual viewpoint image includes generating, by a first image processing apparatus, first information for generating the virtual viewpoint image based on a first image captured by a first camera, generating, by a second image processing apparatus, second information for generating the virtual viewpoint image based on a second image captured by a second camera; specifying a viewpoint in the virtual viewpoint image; and generating, by a third image processing apparatus, a virtual viewpoint image corresponding to the specified viewpoint using the first information and the second information.Type: GrantFiled: May 22, 2017Date of Patent: November 24, 2020Assignee: Canon Kabushiki KaishaInventors: Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
-
Publication number: 20200336719Abstract: An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes a determination unit configured to determine a generation method for generating a virtual viewpoint image using the image data from among a plurality of generation methods depending on a situation of imaging using the plurality of cameras, and an output unit configured to output data in accordance with a result of the determination performed by the determination unit.Type: ApplicationFiled: May 22, 2017Publication date: October 22, 2020Inventors: Keisuke Morisawa, Masahiro Handa, Michio Aizawa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
-
Publication number: 20200329189Abstract: A control device for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The control device includes an obtaining unit configured to obtain game information specifying a type of game which is a target of imaging performed by the plurality of cameras, a storage unit configured to store information for associating the game information obtained by the obtaining unit with setting information of the system, and a setting unit configured to perform a setting process of the system based on the game information obtained by the obtaining unit and the information stored in the storage unit.Type: ApplicationFiled: May 22, 2017Publication date: October 15, 2020Inventors: Katsumasa Tanaka, Masahiro Handa, Michio Aizawa, Shogo Mizuno, Akihiro Matsushita, Keisuke Morisawa, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
-
Publication number: 20200322584Abstract: A control device for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The control device includes a reception unit configured to receive an instruction issued by a user for specifying a virtual viewpoint associated with generation of a virtual viewpoint image, an obtaining unit configured to obtain restriction information for specifying a restriction region where designation of a virtual viewpoint based on the instruction received by the reception unit is restricted, wherein the restriction region is changed in accordance with a parameter associated with the image data, and a notification unit configured to perform a notification based on the restriction information obtained by the obtaining unit.Type: ApplicationFiled: May 22, 2017Publication date: October 8, 2020Inventors: Michio Aizawa, Masahiro Handa, Shogo Mizuno, Katsumasa Tanaka, Akihiro Matsushita, Keisuke Morisawa, Tomohiro Yano, Mai Komiyama, Kenichi Fujii, Atsushi Date
-
Publication number: 20200322591Abstract: An information processing apparatus for a system generates a virtual viewpoint image based on image data obtained by performing imaging from a plurality of directions using a plurality of cameras. The information processing apparatus includes an obtaining unit configured to obtain a foreground image based on an object region including a predetermined object in a captured image for generating a virtual viewpoint image and a background image based on a region different from the object region in the captured image, wherein the obtained foreground image and the obtained background image having different frame rates, and an output unit configured to output the foreground image and the background image which are obtained by the obtaining unit and which are associated with each other.Type: ApplicationFiled: May 22, 2017Publication date: October 8, 2020Applicant: Canon Kabushiki KaishaInventors: Tomohiro YANO, Masahiro HANDA, Michio AIZAWA, Shogo MIZUNO, Katsumasa TANAKA, Akihiro MATSUSHITA, Keisuke MORISAWA, Mai KOMIYAMA, Kenichi FUJII, Atsushi DATE
-
Patent number: 10771761Abstract: An information processing apparatus includes one or more memories storing instructions, and one or more processors executing the instructions to determine, among a plurality of captured images obtained by a plurality of image capturing apparatuses, a display target image related to a virtual viewpoint image, based on a position of a virtual viewpoint and a view direction from the virtual viewpoint, the virtual viewpoint image being generated based on the display target image and the position of the virtual viewpoint and the view direction from the virtual viewpoint, and to cause a displaying unit to display the determined display target image in a displaying mode according to a degree of contribution of the determined display target image to generation of the virtual viewpoint image.Type: GrantFiled: December 10, 2018Date of Patent: September 8, 2020Assignee: Canon Kabushiki KaishaInventor: Shogo Mizuno