Patents by Inventor Joan Puigcerver i Perez

Joan Puigcerver i Perez has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • ENSEMBLING MIXTURE-OF-EXPERTS NEURAL NETWORKS
    Publication number: 20230107409
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for performing a machine learning task on a network input to generate a network output. In one aspect, one of the systems includes a neural network configured to perform the machine learning task, the neural network including one or more expert neural network blocks that each include multiple routers and multiple expert neural networks.
    Type: Application
    Filed: October 5, 2022
    Publication date: April 6, 2023
    Inventors: Rodolphe Jenatton, Carlos Riquelme Ruiz, Dustin Tran, James Urquhart Allingham, Florian Wenzel, Zelda Elaine Mariet, Basil Mustafa, Joan Puigcerver i Perez, Neil Matthew Tinmouth Houlsby, Ghassen Jerfel
  • TRANSFER LEARNING BETWEEN DIFFERENT COMPUTER VISION TASKS
    Publication number: 20220189612
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a neural network to perform a downstream computer vision task. One of the methods includes pre-training an initial neural network that shares layers with the neural network to perform an initial computer vision task and then training the neural network on the downstream computer vision task.
    Type: Application
    Filed: December 14, 2021
    Publication date: June 16, 2022
    Inventors: Xiaohua Zhai, Sylvain Gelly, Alexander Kolesnikov, Yin Ching Jessica Yung, Joan Puigcerver i Perez, Lucas Klaus Beyer, Neil Matthew Tinmouth Houlsby, Wen Yau Aaron Loh, Alan Prasana Karthikesalingam, Basil Mustafa, Jan Freyberg, Patricia Leigh MacWilliams, Vivek Natarajan
  • TRAINING NEURAL NETWORKS USING TRANSFER LEARNING
    Publication number: 20220108171
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training neural networks using transfer learning.
    Type: Application
    Filed: September 28, 2021
    Publication date: April 7, 2022
    Inventors: Joan Puigcerver i Perez, Basil Mustafa, André Susano Pinto, Carlos Riquelme Ruiz, Neil Matthew Tinmouth Houlsby, Daniel M. Keysers