Patents by Inventor Yusuke TOMOTO
Yusuke TOMOTO has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11887256Abstract: Novel images may be generated using an image generator implemented on a processor. The image generator may receive as input neural features selected from a neural texture atlas. The image generator may also receive as input one or more position guides identifying position information for a plurality of input image pixels. The novel images may be evaluated using an image discriminator to determine a plurality of optimization values by comparing each of the plurality of novel images with a respective one of a corresponding plurality of input images. Each of the novel images may be generated from a respective camera pose relative to an object identical to that of the respective one of the corresponding plurality of input images. The image generator and the neural features may be updated based on the optimization values and stored on a storage device.Type: GrantFiled: November 1, 2021Date of Patent: January 30, 2024Assignee: Fyusion, Inc.Inventors: Tobias Bertel, Yusuke Tomoto, Srinivas Rao, Krunal Ketan Chande, Rodrigo Ortiz-Cayon, Stefan Johannes Josef Holzer, Christian Richardt
-
Publication number: 20220139036Abstract: Novel images may be generated using an image generator implemented on a processor. The image generator may receive as input neural features selected from a neural texture atlas. The image generator may also receive as input one or more position guides identifying position information for a plurality of input image pixels. The novel images may be evaluated using an image discriminator to determine a plurality of optimization values by comparing each of the plurality of novel images with a respective one of a corresponding plurality of input images. Each of the novel images may be generated from a respective camera pose relative to an object identical to that of the respective one of the corresponding plurality of input images. The image generator and the neural features may be updated based on the optimization values and stored on a storage device.Type: ApplicationFiled: November 1, 2021Publication date: May 5, 2022Applicant: Fyusion, Inc.Inventors: Tobias Bertel, Yusuke Tomoto, Srinivas Rao, Krunal Ketan Chande, Rodrigo Ortiz-Cayon, Stefan Johannes Josef Holzer, Christian Richardt
-
Patent number: 10855936Abstract: Various embodiments of the present invention relate generally to systems and methods for analyzing and manipulating images and video. In particular, a multi-view interactive digital media representation (MVIDMR) of a person can be generated from live images of a person captured from a hand-held camera. Using the image data from the live images, a skeleton of the person and a boundary between the person and a background can be determined from different viewing angles and across multiple images. Using the skeleton and the boundary data, effects can be added to the person, such as wings. The effects can change from image to image to account for the different viewing angles of the person captured in each image.Type: GrantFiled: September 23, 2019Date of Patent: December 1, 2020Assignee: Fyusion, Inc.Inventors: Stefan Johannes Josef Holzer, Radu Bogdan Rusu, Stephen David Miller, Pantelis Kalogiros, Matteo Munaro, Alexander Jay Bruen Trevor, Nico Gregor Sebastian Blodow, Luo Yi Tan, Mike Penz, Martin Markus Hubert Wawro, Matthias Reso, Chris Beall, Yusuke Tomoto, Krunal Ketan Chande
-
Publication number: 20200021752Abstract: Various embodiments of the present invention relate generally to systems and methods for analyzing and manipulating images and video. In particular, a multi-view interactive digital media representation (MVIDMR) of a person can be generated from live images of a person captured from a hand-held camera. Using the image data from the live images, a skeleton of the person and a boundary between the person and a background can be determined from different viewing angles and across multiple images. Using the skeleton and the boundary data, effects can be added to the person, such as wings. The effects can change from image to image to account for the different viewing angles of the person captured in each image.Type: ApplicationFiled: September 23, 2019Publication date: January 16, 2020Applicant: Fyusion, Inc.Inventors: Stefan Johannes Josef Holzer, Radu Bogdan Rusu, Stephen David Miller, Pantelis Kalogiros, Matteo Munaro, Alexander Jay Bruen Trevor, Nico Gregor Sebastian Blodow, Luo Yi Tan, Mike Penz, Martin Markus Hubert Wawro, Matthias Reso, Chris Beall, Yusuke Tomoto, Krunal Ketan Chande
-
Patent number: 10469768Abstract: Various embodiments of the present invention relate generally to systems and methods for analyzing and manipulating images and video. In particular, a multi-view interactive digital media representation (MVIDMR) of a person can be generated from live images of a person captured from a hand-held camera. Using the image data from the live images, a skeleton of the person and a boundary between the person and a background can be determined from different viewing angles and across multiple images. Using the skeleton and the boundary data, effects can be added to the person, such as wings. The effects can change from image to image to account for the different viewing angles of the person captured in each image.Type: GrantFiled: March 26, 2018Date of Patent: November 5, 2019Assignee: Fyusion, Inc.Inventors: Stefan Johannes Josef Holzer, Radu Bogdan Rusu, Stephen David Miller, Pantelis Kalogiros, Matteo Munaro, Alexander Jay Bruen Trevor, Nico Gregor Sebastian Blodow, Luo Yi Tan, Mike Penz, Martin Markus Hubert Wawro, Matthias Reso, Chris Beall, Yusuke Tomoto, Krunal Ketan Chande
-
Patent number: 10356341Abstract: Various embodiments of the present invention relate generally to systems and methods for analyzing and manipulating images and video. In particular, a multi-view interactive digital media representation (MVIDMR) of a person can be generated from live images of a person captured from a hand-held camera. Using the image data from the live images, a skeleton of the person and a boundary between the person and a background can be determined from different viewing angles and across multiple images. Using the skeleton and the boundary data, effects can be added to the person, such as wings. The effects can change from image to image to account for the different viewing angles of the person captured in each image.Type: GrantFiled: March 26, 2018Date of Patent: July 16, 2019Assignee: Fyusion, Inc.Inventors: Stefan Johannes Josef Holzer, Radu Bogdan Rusu, Stephen David Miller, Pantelis Kalogiros, Matteo Munaro, Alexander Jay Bruen Trevor, Nico Gregor Sebastian Blodow, Luo Yi Tan, Mike Penz, Martin Markus Hubert Wawro, Matthias Reso, Chris Beall, Yusuke Tomoto, Krunal Ketan Chande
-
Publication number: 20190114836Abstract: Various embodiments of the present invention relate generally to systems and methods for analyzing and manipulating images and video. In particular, a multi-view interactive digital media representation (MVIDMR) of a person can be generated from live images of a person captured from a hand-held camera. Using the image data from the live images, a skeleton of the person and a boundary between the person and a background can be determined from different viewing angles and across multiple images. Using the skeleton and the boundary data, effects can be added to the person, such as wings. The effects can change from image to image to account for the different viewing angles of the person captured in each image.Type: ApplicationFiled: March 26, 2018Publication date: April 18, 2019Applicant: Fyusion, Inc.Inventors: Stefan Johannes Josef Holzer, Radu Bogdan Rusu, Stephen David Miller, Pantelis Kalogiros, Matteo Munaro, Alexander Jay Bruen Trevor, Nico Gregor Sebastian Blodow, Luo Yi Tan, Mike Penz, Martin Markus Hubert Wawro, Matthias Reso, Chris Beall, Yusuke Tomoto, Krunal Ketan Chande
-
Publication number: 20190116322Abstract: Various embodiments of the present invention relate generally to systems and methods for analyzing and manipulating images and video. In particular, a multi-view interactive digital media representation (MVIDMR) of a person can be generated from live images of a person captured from a hand-held camera. Using the image data from the live images, a skeleton of the person and a boundary between the person and a background can be determined from different viewing angles and across multiple images. Using the skeleton and the boundary data, effects can be added to the person, such as wings. The effects can change from image to image to account for the different viewing angles of the person captured in each image.Type: ApplicationFiled: March 26, 2018Publication date: April 18, 2019Applicant: Fyusion, Inc.Inventors: Stefan Johannes Josef Holzer, Radu Bogdan Rusu, Stephen David Miller, Pantelis Kalogiros, Matteo Munaro, Alexander Jay Bruen Trevor, Nico Gregor Sebastian Blodow, Luo Yi Tan, Mike Penz, Martin Markus Hubert Wawro, Matthias Reso, Chris Beall, Yusuke Tomoto, Krunal Ketan Chande
-
Patent number: 9262687Abstract: An image processing apparatus includes a feature value calculating section that calculates a feature value from an image picked up of a living mucous membrane, an extraction section that extracts a structure corresponding to the feature value, and a region division section that divides the structure into partial regions according to a predetermined condition.Type: GrantFiled: July 21, 2014Date of Patent: February 16, 2016Assignee: OLYMPUS CORPORATIONInventors: Yusuke Tomoto, Hirokazu Nishimura, Kenichi Tanaka, Sawako Shibata
-
Patent number: 9129384Abstract: A medical image processing device includes an input section to which a biological mucous membrane image obtained by picking up an image of a biological mucous membrane is inputted, a region extracting section that extracts a mucous membrane microstructure region corresponding to a mucous membrane microstructure from the inputted biological mucous membrane image, a closed region identifying section that identifies at least one closed region regarded as being surrounded by the mucous membrane microstructure region, and a unit region setting section that sets a biologically histological unit region on the basis of the mucous membrane microstructure region and the closed region.Type: GrantFiled: June 10, 2014Date of Patent: September 8, 2015Assignee: OLYMPUS MEDICAL SYSTEMS CORP.Inventors: Kenichi Tanaka, Sawako Shibata, Yusuke Tomoto, Hirokazu Nishimura
-
Publication number: 20150003715Abstract: An image processing apparatus includes a feature value calculating section that calculates a feature value from an image picked up of a living mucous membrane, an extraction section that extracts a structure corresponding to the feature value, and a region division section that divides the structure into partial regions according to a predetermined condition.Type: ApplicationFiled: July 21, 2014Publication date: January 1, 2015Inventors: Yusuke TOMOTO, Hirokazu NISHIMURA, Kenichi TANAKA, Sawako SHIBATA
-
Publication number: 20140334698Abstract: A medical image processing device includes an input section to which a biological mucous membrane image obtained by picking up an image of a biological mucous membrane is inputted, a region extracting section that extracts a mucous membrane microstructure region corresponding to a mucous membrane microstructure from the inputted biological mucous membrane image, a closed region identifying section that identifies at least one closed region regarded as being surrounded by the mucous membrane microstructure region, and a unit region setting section that sets a biologically histological unit region on the basis of the mucous membrane microstructure region and the closed region.Type: ApplicationFiled: June 10, 2014Publication date: November 13, 2014Applicant: OLYMPUS MEDICAL SYSTEMS CORP.Inventors: Kenichi TANAKA, Sawako SHIBATA, Yusuke TOMOTO, Hirokazu NISHIMURA
-
Patent number: 8792697Abstract: An image processing apparatus includes: a basic shape matching section that extracts, as a structure region, a predetermined structural object included in an image obtained by picking up an image of a mucosal surface of a living body, and matches each of regions resulting from the structure region being divided, the regions each including at least one pixel, with a first region having a first basic shape or a second region having a second basic shape; a feature value calculating section that sequentially sets regions of interest from among the regions matched by the basic shape matching section, and calculates counts of the first regions and the second regions adjacent to each of the regions of interest; and a classification section that classifies the structure region based on a result of the calculation by the feature value calculating section.Type: GrantFiled: November 7, 2013Date of Patent: July 29, 2014Assignee: Olympus Medical Systems Corp.Inventor: Yusuke Tomoto
-
Publication number: 20140093155Abstract: An image processing apparatus includes: a basic shape matching section that extracts, as a structure region, a predetermined structural object included in an image obtained by picking up an image of a mucosal surface of a living body, and matches each of regions resulting from the structure region being divided, the regions each including at least one pixel, with a first region having a first basic shape or a second region having a second basic shape; a feature value calculating section that sequentially sets regions of interest from among the regions matched by the basic shape matching section, and calculates counts of the first regions and the second regions adjacent to each of the regions of interest; and a classification section that classifies the structure region based on a result of the calculation by the feature value calculating section.Type: ApplicationFiled: November 7, 2013Publication date: April 3, 2014Applicant: OLYMPUS MEDICAL SYSTEMS CORP.Inventor: Yusuke TOMOTO
-
Patent number: 8666135Abstract: An image processing apparatus includes: an image input section via which a medical image picked up of a mucous surface of a living body is inputted; a setting section that sets a region of interest as a first region and a second region including a unit region in the medical image; a feature value calculating section that calculates a first feature value relating to a shape of the region of interest based on pixel values of the region of interest and a region in a periphery thereof and a second feature value relating to a shape of the unit region based on pixel values of the unit region and a region in a periphery thereof; and an matching section that matches the region of interest with a predetermined shape based on distributions of the first feature value and the second feature value calculated by the feature value calculating section.Type: GrantFiled: January 24, 2013Date of Patent: March 4, 2014Assignee: Olympus Medical Systems Corp.Inventor: Yusuke Tomoto
-
Patent number: 8509509Abstract: An image processing apparatus of the invention includes a first feature value calculation unit adapted to calculate a first feature value for each pixel in an image picked up of living tissue, where the first feature value represents a value of an index which indicates what shape a local region; a second feature value calculation unit adapted to calculate a degree of concentration of a gradient vector as a second feature value based on the gradient vector for each pixel in the image; an evaluation value calculation unit adapted to calculate a geometric evaluation value for each pixel, based on calculation results of the first feature value and the second feature value; and a region extraction unit of separately extracting a candidate region of the linear structure and a candidate region of the massive structure based on a calculation result of the geometric evaluation value.Type: GrantFiled: August 9, 2011Date of Patent: August 13, 2013Assignee: Olympus Medical Systems Corp.Inventor: Yusuke Tomoto
-
Publication number: 20120076373Abstract: An image processing apparatus of the invention includes a first feature value calculation unit adapted to calculate a first feature value for each pixel in an image picked up of living tissue, where the first feature value represents a value of an index which indicates what shape a local region; a second feature value calculation unit adapted to calculate a degree of concentration of a gradient vector as a second feature value based on the gradient vector for each pixel in the image; an evaluation value calculation unit adapted to calculate a geometric evaluation value for each pixel, based on calculation results of the first feature value and the second feature value; and a region extraction unit of separately extracting a candidate region of the linear structure and a candidate region of the massive structure based on a calculation result of the geometric evaluation value.Type: ApplicationFiled: August 9, 2011Publication date: March 29, 2012Applicant: OLYMPUS MEDICAL SYSTEMS CORP.Inventor: Yusuke TOMOTO
-
Publication number: 20120076372Abstract: A medical image processing apparatus is a medical image processing apparatus performing image segmentation processing for a medical image including: a feature value calculating unit that calculates at least one feature value from the medical image; a category setting unit that sets, on the basis of the feature value calculated by the feature value calculating unit, plural categories in the medical image; a parameter setting unit that sets, on the basis of the feature value calculated by the feature value calculating unit, a parameter for each of areas of the medical image respectively classified into the categories set by the category setting unit; and an image segmenting unit that performs the image segmentation processing for the medical image according to an arithmetic operation of employing a dynamic contour model specified according to the number of categories set by the category setting unit and parameters set by the parameter setting unit.Type: ApplicationFiled: August 3, 2011Publication date: March 29, 2012Applicant: OLYMPUS MEDICAL SYSTEMS CORP.Inventors: Hirokazu NISHIMURA, Kenichi TANAKA, Yusuke TOMOTO
-
Publication number: 20120076374Abstract: An image processing apparatus according to the present invention includes a pixel selection unit adapted to select a pixel of interest from an image; a contrast feature value calculation unit adapted to calculate, as a contrast feature value, a value which represents an amount of change in contrast in a local region including the pixel of interest; a geometric feature value calculation unit adapted to calculate, as a geometric feature value, a value of an index which indicates whether or not a linear or massive structure is contained in the local region; an evaluation value calculation unit adapted to calculate an evaluation value by weighting each of the contrast feature value and the geometric feature value; and a region extraction unit adapted to extract a candidate region estimated to contain the linear or massive structure from the image based on a calculation result of the evaluation value.Type: ApplicationFiled: August 9, 2011Publication date: March 29, 2012Applicant: OLYMPUS MEDICAL SYSTEMS CORP.Inventors: Kenichi TANAKA, Yusuke TOMOTO, Hirokazu NISHIMURA