Patents Assigned to Eidgenoessische Technische Hochschule Zurich
  • Publication number: 20180096463
    Abstract: Enhanced removing of noise and outliers from one or more point sets generated by image-based 3D reconstruction techniques is provided. In accordance with the disclosure, input images and corresponding depth maps can be used to remove pixels that are geometrically and/or photometrically inconsistent with the colored surface implied by the input images. This allows standard surface reconstruction methods (such as Poisson surface reconstruction) to perform less smoothing and thus achieve higher quality surfaces with more features. In some implementations, the enhanced point-cloud noise removal in accordance with the disclosure can include computing per-view depth maps, and detecting and removing noisy points and outliers from each per-view point cloud by checking if points are consistent with the surface implied by the other input views.
    Type: Application
    Filed: September 30, 2016
    Publication date: April 5, 2018
    Applicants: Disney Enterprises, Inc., ETH Zürich (Eidgenössische Technische Hochschule Zürich)
    Inventors: Changil Kim, Olga Sorkine-Hornung, Christopher Schroers, Henning Zimmer, Katja Wolff, Mario Botsch, Alexander Sorkine-Hornung
  • Publication number: 20180085201
    Abstract: A system and method for non-invasive reconstruction of an entire object-specific or person-specific teeth row from just a set of photographs of the mouth region of an object (e.g., an animal) or a person (e.g., an actor or a patient) are provided. A teeth statistic model defining individual teeth in a teeth row can be developed. The teeth statistical model can jointly describe shape and pose variations per tooth, and as well as placement of the individual teeth in the teeth row. In some embodiments, the teeth statistic model can be trained using teeth information from 3D scan data of different sample subjects. The 3D scan data can be used to establish a database of teeth of various shapes and poses. Geometry information regarding the individual teeth can be extracted from the 3D scan data. The teeth statistic model can be trained using the geometry information regarding the individual teeth.
    Type: Application
    Filed: September 29, 2016
    Publication date: March 29, 2018
    Applicants: Disney Enterprises, Inc., ETH Zürich (Eidgenössische Technische Hochschule Zürich)
    Inventors: Chenglei Wu, Derek Bradley, Thabo Beeler, Markus Gross
  • Publication number: 20180089905
    Abstract: A method of rendering content items on a display via an electronic device involves mapping linked content items to a three-dimensional object defined by layout data. The layout data is then transmitted to an electronic device for display.
    Type: Application
    Filed: September 26, 2016
    Publication date: March 29, 2018
    Applicants: Disney Enterprises, Inc., ETH Zürich (Eidgenössische Technische Hochschule Zürich)
    Inventors: Barbara Solenthaler, Sohyeon Jeong, Max Grosse, Sasha Schriber, David Sinclair, Maria Cabral, Markus Gross, Kenneth J. Mitchell
  • Publication number: 20180089330
    Abstract: There is provided a system for linking transmedia content subsets. A memory stores a plurality of transmedia content data items and associated linking data which define time-ordered content links between the plurality of transmedia content data items. The plurality of transmedia content data items are arranged into linked transmedia content subsets comprising different groups of the transmedia content data items and different content links therebetween; a transmedia content model that represents the transmedia content data items as nodes and the content links between the transmedia content data items as edges in one or more time-varying graphs. A processor is configured to associate the transmedia content data items with the time-ordered content links and store the linking data in the memory. It assigns the transmedia content data items to nodes of a graph structure, assign the time-ordered content links to edges of the graph structure and store them in the transmedia content model.
    Type: Application
    Filed: September 26, 2016
    Publication date: March 29, 2018
    Applicants: DISNEY ENTERPRISES, INC., ETH Zürich (Eidgenössische Technische Hochschule Zürich)
    Inventors: Aljosa Smolic, Miquel Angel Farre Guiu, Nikolce Stefanoski, Markus Gross, Adriano Galati
  • Publication number: 20180089201
    Abstract: A method is provided for rendering a representation of and interacting with transmedia content on an electronic device. Transmedia content data is received at the electronic device. The transmedia content data comprises: a plurality of transmedia content data items; linking data which define time-ordered content links between the plurality of transmedia content data items, whereby the plurality of transmedia content data items are arranged into linked transmedia content subsets comprising different groups of the transmedia content data items and different content links therebetween; a visualisation model of the transmedia content data; and a hierarchical structure of the linked transmedia content subsets and clusters of linked transmedia content subsets.
    Type: Application
    Filed: September 26, 2016
    Publication date: March 29, 2018
    Applicants: DISNEY ENTERPRISES, INC., ETH Zürich (Eidgenössische Technische Hochschule Zürich)
    Inventors: Rebekkah Laeuchli, Max Grosse, Maria Cabral, Markus Gross, Sasha Schriber, Isa Simo
  • Patent number: 9881380
    Abstract: Techniques and systems are described for performing video segmentation using fully connected object proposals. For example, a number of object proposals for a video sequence are generated. A pruning step can be performed to retain high quality proposals that have sufficient discriminative power. A classifier can be used to provide a rough classification and subsampling of the data to reduce the size of the proposal space, while preserving a large pool of candidate proposals. A final labeling of the candidate proposals can then be determined, such as a foreground or background designation for each object proposal, by solving for a posteriori probability of a fully connected conditional random field, over which an energy function can be defined and minimized.
    Type: Grant
    Filed: February 16, 2016
    Date of Patent: January 30, 2018
    Assignees: DISNEY ENTERPRISES, INC., ETH ZÜRICH (EIDGENÖSSISCHE TECHNISCHE HOCHSCHULE ZÜRICH
    Inventors: Alexander Sorkine Hornung, Federico Perazzi, Oliver Wang
  • Publication number: 20180012401
    Abstract: Systems and techniques for generating a parametric eye model of one or more eyes are provided. The systems and techniques may include obtaining eye data from an eye model database. The eye data includes eyeball data and iris data corresponding to a plurality of eyes. The systems and techniques may further include generating an eyeball model using the eyeball data. Generating the eyeball model includes establishing correspondences among the plurality of eyes. The systems and techniques may further include generating an iris model using the iris data. Generating the iris model includes sampling one or more patches of one or more of the plurality of eyes using an iris control map and merging the one or more patches into a synthesized texture. The systems and techniques may further include generating the parametric eye model that includes the eyeball model and the iris model.
    Type: Application
    Filed: July 7, 2016
    Publication date: January 11, 2018
    Applicants: Disney Enterprises, Inc., ETH Zürich (Eidgenössische Technische Hochschule Zürich)
    Inventors: Pascal Bérard, Thabo Beeler, Derek Bradley, Markus Gross
  • Publication number: 20180012418
    Abstract: Systems and techniques for reconstructing one or more eyes using a parametric eye model are provided. The systems and techniques may include obtaining one or more input images that include at least one eye. The systems and techniques may further include obtaining a parametric eye model including an eyeball model and an iris model. The systems and techniques may further include determining parameters of the parametric eye model from the one or more input images. The parameters can be determined to fit the parametric eye model to the at least one eye in the one or more input images. The parameters include a control map used by the iris model to synthesize an iris of the at least one eye. The systems and techniques may further include reconstructing the at least one eye using the parametric eye model with the determined parameters.
    Type: Application
    Filed: July 7, 2016
    Publication date: January 11, 2018
    Applicants: Disney Enterprises, Inc., ETH Zürich (Eidgenössische Technische Hochschule Zürich)
    Inventors: Pascal Bêrard, Thabo Beeler, Derek Bradley, Markus Gross
  • Patent number: 9786062
    Abstract: The disclosure provides an approach for estimating depth in a scene. According to one aspect, regions where the depth estimation is expected to perform well may first be identified in full-resolution epipolar-plane images (EPIs) generated from a plurality of images of the scene. Depth estimates for EPI-pixels with high edge confidence are determined by testing a number of discrete depth hypotheses and picking depths that lead to highest color density of sampled EPI-pixels. The depth estimate may also be propagated throughout the EPIs. This process of depth estimation and propagation may be iterated until all EPI-pixels with high edge confidence have been processed, and all EPIs may also be processed in this manner. The EPIs are then iteratively downsampled to coarser resolutions, at which edge confidence for EPI-pixels not yet processed are determined, depth estimates of EPI-pixels with high edge confidence made, and depth estimates propagated throughout the EPIs.
    Type: Grant
    Filed: July 17, 2013
    Date of Patent: October 10, 2017
    Assignees: Disney Enterprises, Inc., ETH Zurich (Eidgenoessische Technische Hochschule Zurich)
    Inventors: Alexander Sorkine-Hornung, Changil Kim, Henning Zimmer, Yael Pritch, Markus Gross
  • Patent number: 9783843
    Abstract: The invention provides a chemical compound comprising a chemical moiety (p) capable of performing a binding interaction with a target molecule, and an oligonucleotide (b) or functional analogue thereof. The oligonucleotide (b) or functional analogue comprises at least one self-assembly sequence (b1) capable of performing a combination reaction with at least one self-assembly sequence (b1?) of a complementary oligonucleotide or functional analogue bound to another chemical compound comprising a chemical moiety (q). In some embodiments, the chemical compound comprises a coding sequence (b1) coding for the identification of the chemical moiety (p) and further comprises at least one self-assembly moiety (m) capable of performing a combination reaction with at least one self-assembly moiety (m?) of a similar chemical compound comprising a chemical moiety (q).
    Type: Grant
    Filed: January 14, 2014
    Date of Patent: October 10, 2017
    Assignee: Eidgenoessische Technische Hochschule Zurich
    Inventors: Dario Neri, Samu Melkko
  • Publication number: 20170287456
    Abstract: Systems and methods for re-arranging a musical composition using augmented reality are disclosed. A user can be provided with one or more physical image markers representative of at least one of a musical entity and a musical style in which a musical track has been pre-recorded. Upon capturing a visual scene in which one or more of these physical image markers are included, an augmented reality version of the visual scene is displayed along with audio corresponding to the musical style(s) and/or entities represented by the one or more physical image markers.
    Type: Application
    Filed: May 9, 2017
    Publication date: October 5, 2017
    Applicants: DISNEY ENTERPRISES, INC., EIDGENOESSISCHE TECHNISCHE HOCHSCHULE ZURICH
    Inventors: FABIO ZUND, ALESSIA MARRA, MAURIZIO NITTI, MATTIA RYFFEL, ROBERT SUMNER
  • Patent number: 9764021
    Abstract: The present invention relates to Salmonella enterica comprising at least pgl operon of Campylobacter jejuni or a functional derivative thereof and presenting at least one N-glycan of Campylobacter jejuni or N-glycan derivative thereof on its cell surface and, in particular, to medical uses and pharmaceutical compositions thereof as well as methods for treating and/or preventing Campylobacter and optionally Salmonella infections and methods for producing these Salmonella strains.
    Type: Grant
    Filed: April 8, 2016
    Date of Patent: September 19, 2017
    Assignee: EIDGENOESSISCHE TECHNISCHE HOCHSCHULE ZURICH
    Inventors: Karin Ilg, Markus Aebi, Umesh Ahuja, Saba Amber, Flavio Schwartz
  • Patent number: 9747668
    Abstract: Systems and method for the reconstruction of an articulated object are disclosed herein, The articulated object can be reconstructed from image data collected by a moving camera over a period of time. A plurality of 2D feature points can be identified within the image data. These 2D feature points can be converted into three-dimensional space, which converted points are identified as 3D feature points. These 3D feature points can be used to identify one or several rigidity constrains and/or kinematic constraints. These rigidity and/or kinematic constraints can be applied to a model of the reconstructed articulated object.
    Type: Grant
    Filed: January 21, 2016
    Date of Patent: August 29, 2017
    Assignees: DISNEY ENTERPRISES, INC., ETH ZÜRICH (EIDGENÖESSISCHE TECHNISCHE HOCHSCHULE ZÜRICH)
    Inventors: Kaan Yücer, Alexander Sorkine Hornung, Oliver Wang, Olga Sorkine Hornung
  • Publication number: 20170236290
    Abstract: Techniques and systems are described for performing video segmentation using fully connected object proposals. For example, a number of object proposals for a video sequence are generated. A pruning step can be performed to retain high quality proposals that have sufficient discriminative power. A classifier can be used to provide a rough classification and subsampling of the data to reduce the size of the proposal space, while preserving a large pool of candidate proposals. A final labeling of the candidate proposals can then be determined, such as a foreground or background designation for each object proposal, by solving for a posteriori probability of a fully connected conditional random field, over which an energy function can be defined and minimized.
    Type: Application
    Filed: February 16, 2016
    Publication date: August 17, 2017
    Applicants: Disney Enterprises, Inc., ETH Zürich (Eidgenössische Technische Hochschule Zürich)
    Inventors: Alexander Sorkine Hornung, Federico Perazzi, Oliver Wang
  • Patent number: 9734628
    Abstract: Techniques are disclosed for creating digital assets that can be used to personalize themed products. For example, a workflow and pipeline used to generate a 3D model from digital images of a person's face and to manufacture a personalized, physical figurine customized with the 3D model are disclosed. The 3D model of the person's face may be simplified to match a topology of a desired figurine. While the topology is deformed to match that of the figurine, the 3D model retains the geometry of the child's face. Simplifying the topology of the 3D model in this manner allows the mesh to be integrated with or attached to a mesh representing desired figurine.
    Type: Grant
    Filed: November 20, 2015
    Date of Patent: August 15, 2017
    Assignees: Disney Enterprises, Inc., ETH Zürich (Eidgenössische Technische Hochschule Zürich)
    Inventors: Jose Rafael Tena, Moshe Mahler, Iain Matthews, Hengchin Yeh, Thabo Dominik Beeler, Robert Sumner, Cydni Tetro, John-Thomas C. Ngo
  • Publication number: 20170213320
    Abstract: Systems and method for the reconstruction of an articulated object are disclosed herein, The articulated object can be reconstructed from image data collected by a moving camera over a period of time. A plurality of 2D feature points can be identified within the image data. These 2D feature points can be converted into three-dimensional space, which converted points are identified as 3D feature points. These 3D feature points can be used to identify one or several rigidity constrains and/or kinematic constraints. These rigidity and/or kinematic constraints can be applied to a model of the reconstructed articulated object.
    Type: Application
    Filed: January 21, 2016
    Publication date: July 27, 2017
    Applicants: Disney Enterprises, Inc., ETH Zürich (Eidgenössische Technische Hochschule Zürich)
    Inventors: Kaan YÜCER, Alexander SORKINE HORNUNG, Oliver WANG, Olga SORKINE HORNUNG
  • Patent number: 9689879
    Abstract: The present invention relates to a method for the production of a library comprising recombinant derivatives of the SH3 domain of the Fyn kinase of SEQ ID NO: 1 as well as a method for selecting from a library comprising recombinant derivatives of the SH3 domain of the Fyn kinase of SEQ ID NO: 1 one or more of said derivatives having a specific binding affinity to a protein or peptide.
    Type: Grant
    Filed: August 31, 2016
    Date of Patent: June 27, 2017
    Assignee: EIDGENOESSISCHE TECHNISCHE HOCHSCHULE ZURICH
    Inventors: Dragan Grabulovski, Dario Neri
  • Publication number: 20170166534
    Abstract: The present invention relates to a compound of formula (I) wherein R1 is defined as in the description and in the claims. The compound of formula (I) can be used as radiolabeled ligand.
    Type: Application
    Filed: February 27, 2017
    Publication date: June 15, 2017
    Applicants: Hoffmann-La Roche Inc., EIDGENÖSSISCHE TECHNISCHE HOCHSCHULE ZÜRICH, UNIVERSITÄT ZÜRICH
    Inventors: Simon M. Ametamey, Juergen Fingerle, Luca Gobbi, Uwe Grether, Ahmed Haider, Thomas Hartung, Linjing Mu, Leo Nicholls, Mark Rogers-Evans, Christoph Ullmer
  • Patent number: 9652890
    Abstract: Techniques and systems are described for generating an anatomically-constrained local model and for performing performance capture using the model. The local model includes a local shape subspace and an anatomical subspace. In one example, the local shape subspace constrains local deformation of various patches that represent the geometry of a subject's face. In the same example, the anatomical subspace includes an anatomical bone structure, and can be used to constrain movement and deformation of the patches globally on the subject's face. The anatomically-constrained local face model and performance capture technique can be used to track three-dimensional faces or other parts of a subject from motion data in a high-quality manner. Local model parameters that best describe the observed motion of the subject's physical deformations (e.g., facial expressions) under the given constraints are estimated through optimization.
    Type: Grant
    Filed: September 29, 2015
    Date of Patent: May 16, 2017
    Assignees: DISNEY ENTERPRISES, INC., ETH ZÜRICH (EIDGENÖESSISCHE TECHNISCHE HOCHSCHULE ZÜRICH
    Inventors: Thabo Beeler, Derek Bradley, Chenglei Wu
  • Patent number: 9649026
    Abstract: Systems and techniques for reconstructing one or more surfaces of an object including one or more opaque surfaces behind one or more refractive surfaces are provided. The systems and techniques may include obtaining one or more images of the object including an opaque surface located behind a refractive surface and determining one or more refractive surface constraints using the one or more images. The one or more refractive surface constraints constrain one or more characteristics of the refractive surface. The systems and techniques may further include reconstructing an opaque surface representation or a refractive surface representation using the one or more refractive surface constraints, the opaque surface representation representing the opaque surface of the object, and the refractive surface representation representing the refractive surface of the object.
    Type: Grant
    Filed: November 21, 2014
    Date of Patent: May 16, 2017
    Assignees: Disney Enterprises, Inc., ETH Zürich (Eidgenössische Technische Hochschule Zürich)
    Inventors: Pascal Bérard, Thabo Beeler, Derek Bradley