Patents Assigned to ETH Zürich
  • Publication number: 20250106353
    Abstract: In some embodiments, a method receives a video including interlaced frames. Second fields for a second frame and the second fields for a third frame are analyzed to determine estimated second fields for the first frame in an image space. The method converts the first fields and the estimated second fields for the first frame into first features and second features, respectively, in a feature space. The estimated second features are determined for the estimated second fields for the first frame based on the first features for the first frame. Backward features from the second frame and forward features from the third frame are used to determine the estimated second features for the first frame. The method outputs a prediction for the estimated second fields for the first frame based on the estimated second features and generates a first frame with the first fields and estimated second fields.
    Type: Application
    Filed: September 19, 2024
    Publication date: March 27, 2025
    Applicants: Disney Enterprises, Inc., ETH Zürich (Eidgenössische Technische Hochschule Zürich)
    Inventors: Yang Zhang, Zhaowei Gao, Mingyang Song, Christopher Richard Schroers
  • Publication number: 20250095115
    Abstract: In some embodiments, a grain analysis system is configured for analyzing a first video frame and outputting respective first film grain information for film grain that is included in the first video frame or configured for analyzing a second video frame and outputting second film grain information. At least one of a grain removal system and a grain synthesis system is included. The grain removal system is configured for removing the film grain from the first video frame using the first film grain information to generate a third video frame corresponding to the first video frame with film grain removed. The grain analysis system is separate from the grain removal system. The grain synthesis system is configured for synthesizing film grain for the third video frame using the first film grain information or the second film grain information. The grain analysis system is separate from the grain synthesis system.
    Type: Application
    Filed: September 20, 2023
    Publication date: March 20, 2025
    Applicants: Disney Enterprises, Inc., Beijing YoJaJa Software Technology Development Co., Ltd., ETH Zürich (Eidgenössische Technische Hochschule Zürich)
    Inventors: Abdelaziz Djelouah, Yang Zhang, Roberto Gerson De Albuquerque Azevedo, Elham Amin Mansour, Mingyang Song, Christopher Richard Schroers, Yuanyi Xue, Scott Labrozzi, Wenhao Zhang, Xuewei Meng, Jeroen Schulte
  • Patent number: 12243140
    Abstract: A technique for rendering an input geometry includes generating a first segmentation mask for a first input geometry and a first set of texture maps associated with one or more portions of the first input geometry. The technique also includes generating, via one or more neural networks, a first set of neural textures for the one or more portions of the first input geometry. The technique further includes rendering a first image corresponding to the first input geometry based on the first segmentation mask, the first set of texture maps, and the first set of neural textures.
    Type: Grant
    Filed: November 15, 2021
    Date of Patent: March 4, 2025
    Assignees: Disney Enterprises, INC., ETH Zürich (Eidgenössische Technische Hochschule Zürich)
    Inventors: Derek Edward Bradley, Prashanth Chandran, Paulo Fabiano Urnau Gotardo, Gaspard Zoss
  • Patent number: 12243349
    Abstract: Embodiment of the present invention sets forth techniques for performing face reconstruction. The techniques include generating an identity mesh based on an identity encoding that represents an identity associated with a face in one or more images. The techniques also include generating an expression mesh based on an expression encoding that represents an expression associated with the face in the one or more images. The techniques also include generating, by a machine learning model, an output mesh of the face based on the identity mesh and the expression mesh.
    Type: Grant
    Filed: March 17, 2022
    Date of Patent: March 4, 2025
    Assignees: Disney Enterprises, INC., ETH Zürich (Eidgenössische Technische Hochschule Zürich)
    Inventors: Derek Edward Bradley, Prashanth Chandran, Simone Foti, Paulo Fabiano Urnau Gotardo, Gaspard Zoss
  • Patent number: 12236517
    Abstract: Techniques are disclosed for generating photorealistic images of objects, such as heads, from multiple viewpoints. In some embodiments, a morphable radiance field (MoRF) model that generates images of heads includes an identity model that maps an identifier (ID) code associated with a head into two codes: a deformation ID code encoding a geometric deformation from a canonical head geometry, and a canonical ID code encoding a canonical appearance within a shape-normalized space. The MoRF model also includes a deformation field model that maps a world space position to a shape-normalized space position based on the deformation ID code. Further, the MoRF model includes a canonical neural radiance field (NeRF) model that includes a density multi-layer perceptron (MLP) branch, a diffuse MLP branch, and a specular MLP branch that output densities, diffuse colors, and specular colors, respectively. The MoRF model can be used to render images of heads from various viewpoints.
    Type: Grant
    Filed: November 8, 2022
    Date of Patent: February 25, 2025
    Assignees: Disney Enterprises, INC., ETH Zürich (Eidgenössische Technische Hochschule Zürich)
    Inventors: Derek Edward Bradley, Prashanth Chandran, Paulo Fabiano Urnau Gotardo, Daoye Wang, Gaspard Zoss
  • Publication number: 20250058014
    Abstract: A composition including a temperature sensitive biocompatible solder and at least one type of nanoparticles, characterized in that a first type of nanoparticles is a fluorescent nanothermometer, wherein the fluorescent nanothermometer exhibits an excitation maximum and temperature dependent emission spectrum each in the range of between 650 and 1350 nm. The composition can be used for laser tissue soldering.
    Type: Application
    Filed: December 15, 2022
    Publication date: February 20, 2025
    Applicants: ETH ZÜRICH, EMPA EIDGENÖSSISCHE MATERIALPRÜFUNGS- UND FORSCHUNGSANSTALT
    Inventors: Inge HERRMANN, Oscar CIPOLATO
  • Patent number: 12223577
    Abstract: One embodiment of the present invention sets forth a technique for generating actuation values based on a target shape such that the actuation values cause a simulator to output a simulated soft body that matches the target shape. The technique includes inputting a latent code that represents a target shape and a point on a geometric mesh into a first machine learning model. The technique further includes generating, via execution of the first machine learning model, one or more simulator control values that specify a deformation of the geometric mesh, where each of the simulator control values is based on the latent code and corresponds to the input point, and generating, via execution of the simulator, a simulated soft body based on the one or more simulator control values and the geometric mesh. The technique further includes causing the simulated soft body to be outputted to a computing device.
    Type: Grant
    Filed: January 25, 2023
    Date of Patent: February 11, 2025
    Assignees: Disney Enterprises, INC., ETH Zürich (Eidgenössische Technische Hochschule Zürich)
    Inventors: Gaspard Zoss, Baran Gözcü, Barbara Solenthaler, Lingchen Yang, Byungsoo Kim
  • Patent number: 12215050
    Abstract: The present invention provides additive manufacturing compositions, also referred as “inks” in the field of additive manufacturing, which can be fine-tuned with respect to porosity by varying the intensity of the photopolymerisation light source and which can further be used to obtain objects out of glasses, ceramics or glass-ceramics and their respective alloys.
    Type: Grant
    Filed: August 28, 2019
    Date of Patent: February 4, 2025
    Assignee: ETH Zürich
    Inventors: David Moore, Lorenzo Barbera, Kunal Masania, André R. Studart
  • Patent number: 12205213
    Abstract: A technique for rendering an input geometry includes generating a first segmentation mask for a first input geometry and a first set of texture maps associated with one or more portions of the first input geometry. The technique also includes generating, via one or more neural networks, a first set of neural textures for the one or more portions of the first input geometry. The technique further includes rendering a first image corresponding to the first input geometry based on the first segmentation mask, the first set of texture maps, and the first set of neural textures.
    Type: Grant
    Filed: November 15, 2021
    Date of Patent: January 21, 2025
    Assignees: Disney Enterprises, INC., ETH Zürich (Eidgenössische Technische Hochschule Zürich)
    Inventors: Derek Edward Bradley, Prashanth Chandran, Paulo Fabiano Urnau Gotardo, Gaspard Zoss
  • Patent number: 12198225
    Abstract: A technique for synthesizing a shape includes generating a first plurality of offset tokens based on a first shape code and a first plurality of position tokens, wherein the first shape code represents a variation of a canonical shape, and wherein the first plurality of position tokens represent a first plurality of positions on the canonical shape. The technique also includes generating a first plurality of offsets associated with the first plurality of positions on the canonical shape based on the first plurality of offset tokens. The technique further includes generating the shape based on the first plurality of offsets and the first plurality of positions.
    Type: Grant
    Filed: February 18, 2022
    Date of Patent: January 14, 2025
    Assignees: Disney Enterprises, INC., ETH Zürich (Eidgenössische Technische Hochschule Zürich)
    Inventors: Derek Edward Bradley, Prashanth Chandran, Paulo Fabiano Urnau Gotardo, Gaspard Zoss
  • Publication number: 20240430440
    Abstract: In some embodiments, a method trains a first parameter of a differentiable proxy codec to encode source content based on a first loss between first compressed source content and second compressed source content that is output by a target codec. A pre-processor pre-processes a source image to output a pre-processed source image, the pre-processing being based on a second parameter. The differentiable proxy codec encodes the pre-processed source image into a compressed pre-processed source image based on the first parameter. The method determines a second loss between the source image and the compressed pre-processed source image and determines an adjustment to the first parameter based on the second loss. The adjustment is used to adjust the second parameter of the pre-processor based on the second loss.
    Type: Application
    Filed: October 19, 2023
    Publication date: December 26, 2024
    Applicants: Disney Enterprises, Inc., ETH Zürich (Eidgenössische Technische Hochschule Zürich)
    Inventors: Yang Zhang, Mingyang Song, Christopher Richard Schroers, Tunc Ozan Aydin, Yuanyi Xue, Scott Labrozzi
  • Patent number: 12169778
    Abstract: A system includes a computing platform having a hardware processor and a memory storing a software code and a neural network (NN) having multiple layers including a last activation layer and a loss layer. The hardware processor executes the software code to identify different combinations of layers for testing the NN, each combination including candidate function(s) for the last activation layer and candidate function(s) for the loss layer. For each different combination, the software code configures the NN based on the combination, inputs, into the configured NN, a training dataset including multiple data objects, receives, from the configured NN, a classification of the data objects, and generates a performance assessment for the combination based on the classification. The software code determines a preferred combination of layers for the NN including selected candidate functions for the last activation layer and the loss layer, based on a comparison of the performance assessments.
    Type: Grant
    Filed: May 4, 2023
    Date of Patent: December 17, 2024
    Assignees: Disney Enterprises, Inc., ETH Zürich (EIDGENÖSSISCHE TECHNISCHE HOCHSCHULE ZÜRICH)
    Inventors: Hayko Jochen Wilhelm Riemenschneider, Leonhard Markus Helminger, Christopher Richard Schroers, Abdelaziz Djelouah
  • Patent number: 12141945
    Abstract: Techniques are disclosed for training and applying a denoising model. The denoising model includes multiple specialized denoisers and a generalizer, each of which is a machine learning model. The specialized denoisers are trained to denoise images associated with specific ranges of noise parameters. The generalizer is trained to generate per-pixel denoising kernels for denoising images associated with arbitrary noise parameters using outputs of the specialized denoisers. Subsequent to training, a noisy image, such as a live-action image or a rendered image, can be denoised by inputting the noisy image into the specialized denoisers to obtain intermediate denoised images that are then input, along with the noisy image, into the generalizer to obtain per-pixel denoising kernels, which can be normalized and applied to denoise the noisy image.
    Type: Grant
    Filed: February 19, 2020
    Date of Patent: November 12, 2024
    Assignees: Disney Enterprises, INC., ETH Zürich (Eidgenössische Technische Hochschule Zürich)
    Inventors: Zhilin Cai, Tunc Ozan Aydin, Marco Manzi, Ahmet Cengiz Oztireli
  • Patent number: 12118734
    Abstract: Some implementations of the disclosure are directed to capturing facial training data for one or more subjects, the captured facial training data including each of the one or more subject's facial skin geometry tracked over a plurality of times and the subject's corresponding jaw poses for each of those plurality of times; and using the captured facial training data to create a model that provides a mapping from skin motion to jaw motion. Additional implementations of the disclosure are directed to determining a facial skin geometry of a subject; using a model that provides a mapping from skin motion to jaw motion to predict a motion of the subject's jaw from a rest pose given the facial skin geometry; and determining a jaw pose of the subject using the predicted motion of the subject's jaw.
    Type: Grant
    Filed: June 28, 2022
    Date of Patent: October 15, 2024
    Assignees: Disney Enterprises, Inc., ETH Zürich (Eidgenössische Technische Hochschule Zürich)
    Inventors: Dominik Thabo Beeler, Derek Edward Bradley, Gaspard Zoss
  • Patent number: 12120359
    Abstract: A system processing hardware executes a machine learning (ML) model-based video compression encoder to receive uncompressed video content and corresponding motion compensated video content, compare the uncompressed and motion compensated video content to identify an image space residual, transform the image space residual to a latent space representation of the uncompressed video content, and transform, using a trained image compression ML model, the motion compensated video content to a latent space representation of the motion compensated video content.
    Type: Grant
    Filed: March 25, 2022
    Date of Patent: October 15, 2024
    Assignees: Disney Enterprises, Inc., ETH Zürich (EIDGENÖSSISCHE TECHNISCHE HOCHSCHULE ZÜRICH)
    Inventors: Abdelaziz Djelouah, Leonhard Markus Helminger, Roberto Gerson De Albuquerque Azevedo, Scott Labrozzi, Christopher Richard Schroers, Yuanyi Xue
  • Publication number: 20240305801
    Abstract: In some embodiments, a system includes a first component to extract temporal features from a current frame being coded and a previous frame of a video. A second component uses a first transformer to fuse spatial features from the current frame with the temporal features to generate spatio-temporal features as first output. A third component uses a second transformer to perform entropy coding using the first output and at least a portion of the temporal features to generate a second output. A fourth component uses a third transformer to reconstruct the current frame based on the first output that is processed using the second output and the temporal features.
    Type: Application
    Filed: July 7, 2023
    Publication date: September 12, 2024
    Applicants: Disney Enterprises, Inc., ETH Zürich (Eidgenössische Technische Hochschule Zürich)
    Inventors: Zhenghao Chen, Roberto Gerson De Albuquerque Azevedo, Christopher Richard Schroers, Yang Zhang, Lucas Relic
  • Patent number: 12080929
    Abstract: The present invention relates to energy storage systems and reactors useful in such systems. Inventive reactors comprise a reaction vessel defining an inner volume and a compensation element, whereby said inner volume is filled with a fixed bed that is free of cavities and that comprises particles of formula (I), FeOx (I), where 0?x?1.5; said compensation element is adapted to adjust said inner volume. The reactors are inherently explosion proof and thus suited for domestic use. The systems are useful for compensating long-term fluctuations observed in production of renewable energy.
    Type: Grant
    Filed: February 25, 2020
    Date of Patent: September 3, 2024
    Assignee: ETH Zürich
    Inventors: Wendelin Jan Stark, Urs Benjamin Lustenberger
  • Publication number: 20240286917
    Abstract: The present disclosure relates to a method for producing calcium carbonate solids from alkaline minerals including the following method steps: Supplying alkaline minerals and an extraction agent into a reactor tank. Stirring the alkaline minerals and the extraction agent in the reactor tank such that a first suspension is formed. Draining of the first suspension from the reactor tank and separating a liquid phase comprising calcium from the first suspension and transferring the liquid phase into a carbonation tank. Supplying a gas comprising CO2 into the carbonation tank, wherein the consumption of CO2 results in the precipitation of calcium carbonate solids thereby generating a second suspension and nucleating and growing of the calcium carbonate solids. Furthermore, a measure of the consumed CO2 is determined by at least one sensor.
    Type: Application
    Filed: June 29, 2022
    Publication date: August 29, 2024
    Applicant: ETH Zürich
    Inventors: Johannes Tiefenthaler, Marco Mazzotti, Mattheus Meijssen
  • Patent number: 12071420
    Abstract: The invention relates to a compound of formula (I) wherein A1, A2, X and R1-R3 are as defined in the description and in the claims. The compound of formula (I) can be used as a medicament.
    Type: Grant
    Filed: December 17, 2020
    Date of Patent: August 27, 2024
    Assignees: HOFFMANN-LA ROCHE INC., ETH ZUERICH
    Inventors: Luca Gobbi, Uwe Grether, Julian Kretz, Simon M. Ametamey
  • Publication number: 20240281647
    Abstract: The present invention relates to a time-continuous neural network circuit implemented on analog hardware with device mismatch, the circuit including a control unit (40) which is individually connected to each respective neuron of the circuit, the neurons in the hidden and output layers comprising a forward compartment for processing signals coming from preceding layers, a feedback compartment for processing feedback signals coming from the control unit and a central compartment for generating and sending a signal to the next layer or to the control unit. The control unit generates and sends to the feedback compartment of each respective neuron a feedback signal (Sf) based on the comparison between a network output signal (Sout) and a target signal (Star).
    Type: Application
    Filed: June 13, 2022
    Publication date: August 22, 2024
    Applicant: ETH Zürich
    Inventors: Alexander Marc E. Meulemans, Benjamin Friedrich Grewe, Matilde Tristany Farinha, Javier Garcia Ordonez, Joao Rodrigues Sacramento, Pau Aceituno