Patents by Inventor Pascal Fua

Pascal Fua has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11768983
    Abstract: The present invention generally relates to a method, a system and a computer program for shape optimisation of a technical device adapted to be exposed to a fluid flowing around a contour of said device with respect to its fluid dynamic parameters. In order to provide an improved method for shape optimisation of a technical device with respect to its fluid dynamic parameters which is faster, a method is provided comprising discretizing the shape of the technical device into a plurality of points along the contour of the technical device or into a surface mesh, and inputting the plurality of points or the surface mesh into a Convolutional Neural Network (CNN) for computing a prediction of the at least one fluid dynamic parameter.
    Type: Grant
    Filed: February 5, 2018
    Date of Patent: September 26, 2023
    Assignee: ECOLE POLYTECHNIQUE FEDERALE DE LAUSANNE EPFL-TTO
    Inventors: Pierre Bruno Baqué, Pascal Fua, Francois Fleuret
  • Publication number: 20230298210
    Abstract: Data processing systems are disclosed for determining semantic and person keypoints for an environment and an image and matching the keypoints for the image to the keypoints for the environment. A homography is generated based on the keypoint matching and decomposed into a matrix. Camera parameters are then determined from the matrix. A plurality of random camera poses can be generated and used to project keypoints for an environment using image keypoints. The projected keypoints can be compared to the actual keypoints for the environment to determine an error and weighting for each of the random camera poses.
    Type: Application
    Filed: May 22, 2023
    Publication date: September 21, 2023
    Inventors: Leonardo Citraro, Pablo Márquez Neila, Stefano Savarè, Vivek Jayaram, Charles Xavier Quentin Dubout, Felix Constant Marc Renaut, Andres Michael Levering Hasfura, Horesh Beny Ben Shitrit, Pascal Fua
  • Patent number: 11694362
    Abstract: Data processing systems are disclosed for determining semantic and person keypoints for an environment and an image and matching the keypoints for the image to the keypoints for the environment. A homography is generated based on the keypoint matching and decomposed into a matrix. Camera parameters are then determined from the matrix. A plurality of random camera poses can be generated and used to project keypoints for an environment using image keypoints. The projected keypoints can be compared to the actual keypoints for the environment to determine an error and weighting for each of the random camera poses.
    Type: Grant
    Filed: April 7, 2021
    Date of Patent: July 4, 2023
    Assignee: Genius Sports SS, LLC
    Inventors: Leonardo Citraro, Pablo Márquez Neila, Stefano Savarè, Vivek Jayaram, Charles Xavier Quentin Dubout, Felix Constant Marc Renaut, Andres Michael Levering Hasfura, Horesh Beny Ben Shitrit, Pascal Fua
  • Publication number: 20230169732
    Abstract: A method for enforcing smoothness constraints on surface meshes produced by a Graph Convolutional Neural Network (GCNN) including the steps of reading image data from a memory, the image data including two-dimensional image data representing a three-dimensional object or a three-dimensional image stack of the three-dimensional object, performing a GCNN mesh deformation step on the image data to obtain an approximation of a surface of the three-dimensional object, the surface represented by triangulated surface meshes, at least some vertices of the triangulated surface meshes having a different number of neighboring vertices compared to other vertices in a same triangulated surface mesh, and performing a deep active surface model (DASM) transformation step on the triangulated surface meshes to obtain a corrected representation of the surface of three-dimensional object to improve smoothness of the surface.
    Type: Application
    Filed: November 16, 2021
    Publication date: June 1, 2023
    Inventors: Udaranga Pamuditha Wickramasinghe, Pascal Fua
  • Publication number: 20220346878
    Abstract: System for training an interventionalist to perform an invasive percutaneous or endoscopic intervention on an organ includes a pipe having a size and/or shape similar to a body vessel or tubular body cavity connected to the organ. An exit of the pipe simulates or represents an exit of the vessel or cavity at the organ. A tool is inserted at an entrance of the pipe and pushed through the pipe. A stereoscopic camera acquires images of an end portion of the tool as it exits from the pipe. A model generating unit generates a real-time 3D model of this end portion from the images. A merging unit merges in real time the real-time model and a pre-computed 3D model of the organ into a common environment displayed so that the interventionalist can see in real-time where the real-time model of the tool is located with respect to the pre-computed model.
    Type: Application
    Filed: April 28, 2022
    Publication date: November 3, 2022
    Inventors: Hussein Ballan, Pascal Fua, Georges Caron, Jürg Schwitter, Luigi Bagnato
  • Publication number: 20210225034
    Abstract: Data processing systems are disclosed for determining semantic and person keypoints for an environment and an image and matching the keypoints for the image to the keypoints for the environment. A homography is generated based on the keypoint matching and decomposed into a matrix. Camera parameters are then determined from the matrix. A plurality of random camera poses can be generated and used to project keypoints for an environment using image keypoints. The projected keypoints can be compared to the actual keypoints for the environment to determine an error and weighting for each of the random camera poses.
    Type: Application
    Filed: April 7, 2021
    Publication date: July 22, 2021
    Inventors: Leonardo Citraro, Pablo Márquez Neila, Stefano Savarè, Vivek Jayaram, Charles Xavier Quentin Dubout, Felix Constant Marc Renaut, Andres Michael Levering Hasfura, Horesh Beny Ben Shitrit, Pascal Fua
  • Publication number: 20210157962
    Abstract: The present invention generally relates to a method, a system and a computer program for shape optimisation of a technical device adapted to be exposed to a fluid flowing around a contour of said device with respect to its fluid dynamic parameters. In order to provide an improved method for shape optimisation of a technical device with respect to its fluid dynamic parameters which is faster, a method is provided comprising discretizing the shape of the technical device into a plurality of points along the contour of the technical device or into a surface mesh, and inputting the plurality of points or the surface mesh into a Convolutional Neural Network (CNN) for computing a prediction of the at least one fluid dynamic parameter.
    Type: Application
    Filed: February 5, 2018
    Publication date: May 27, 2021
    Inventors: Pierre Bruno BAQUÉ, Pascal FUA, Francois FLEURET
  • Patent number: 10991125
    Abstract: Data processing systems are disclosed for determining semantic and person keypoints for an environment and an image and matching the keypoints for the image to the keypoints for the environment. A homography is generated based on the keypoint matching and decomposed into a matrix. Camera parameters are then determined from the matrix. A plurality of random camera poses can be generated and used to project keypoints for an environment using image keypoints. The projected keypoints can be compared to the actual keypoints for the environment to determine an error and weighting for each of the random camera poses.
    Type: Grant
    Filed: February 24, 2020
    Date of Patent: April 27, 2021
    Assignee: Second Spectrum, Inc.
    Inventors: Leonardo Citraro, Pablo Márquez Neila, Stefano Savarè, Vivek Jayaram, Charles Xavier Quentin Dubout, Felix Constant Marc Renaut, Andres Michael Levering Hasfura, Horesh Beny Ben Shitrit, Pascal Fua
  • Publication number: 20210027493
    Abstract: Data processing systems are disclosed for determining semantic and person keypoints for an environment and an image and matching the keypoints for the image to the keypoints for the environment. A homography is generated based on the keypoint matching and decomposed into a matrix. Camera parameters are then determined from the matrix. A plurality of random camera poses can be generated and used to project keypoints for an environment using image keypoints. The projected keypoints can be compared to the actual keypoints for the environment to determine an error and weighting for each of the random camera poses.
    Type: Application
    Filed: February 24, 2020
    Publication date: January 28, 2021
    Inventors: Leonardo Citraro, Pablo Márquez Neila, Stefano Savarè, Vivek Jayaram, Charles Xavier Quentin Dubout, Felix Constant Marc Renaut, Andres Michael Levering Hasfura, Horesh Beny Ben Shitrit, Pascal Fua
  • Patent number: 10600210
    Abstract: Data processing systems are disclosed for determining semantic and person keypoints for an environment and an image and matching the keypoints for the image to the keypoints for the environment. A homography is generated based on the keypoint matching and decomposed into a matrix. Camera parameters are then determined from the matrix. A plurality of random camera poses can be generated and used to project keypoints for an environment using image keypoints. The projected keypoints can be compared to the actual keypoints for the environment to determine an error and weighting for each of the random camera poses.
    Type: Grant
    Filed: July 25, 2019
    Date of Patent: March 24, 2020
    Assignee: Second Spectrum, Inc.
    Inventors: Leonardo Citraro, Pablo Márquez Neila, Stefano Savaré, Vivek Jayaram, Charles Xavier Quentin Dubout, Felix Constant Marc Renaut, Andres Michael Levering Hasfura, Horesh Beny Ben Shitrit, Pascal Fua
  • Patent number: 10552709
    Abstract: A method for training a feature detector of an image processing device, including the steps of detecting features in the image to generate a score map, computing a center of mass on the score map to generate a location, extracting a patch from the image at the location by a first spatial transformer, estimating an orientation of the patch, rotating the patch in accordance with the patch orientation with a second spatial transformer, and describing the rotated patch to create a description vector.
    Type: Grant
    Filed: June 29, 2017
    Date of Patent: February 4, 2020
    Assignee: ECOLE POLYTECHNIQUE FEDERALE DE LAUSANNE (EPFL)
    Inventors: Pascal Fua, Vincent Lepetit, Eduard Fortuny Trulls, Kwang Moo Yi
  • Publication number: 20180096224
    Abstract: A method for training a feature detector of an image processing device, including the steps of detecting features in the image to generate a score map, computing a center of mass on the score map to generate a location, extracting a patch from the image at the location by a first spatial transformer, estimating an orientation of the patch, rotating the patch in accordance with the patch orientation with a second spatial transformer, and describing the rotated patch to create a description vector.
    Type: Application
    Filed: June 29, 2017
    Publication date: April 5, 2018
    Inventors: Pascal Fua, Vincent Lepetit, Eduard Fortuny Trulls, Kwang Moo Yi
  • Publication number: 20170316578
    Abstract: A method for predicting three-dimensional body poses from image sequences of an object, the method performed on a processor of a computer having memory, the method including the steps of accessing the image sequences from the memory, finding bounding boxes around the object in consecutive frames of the image sequence, compensating motion of the object to form spatio-temporal volumes, and learning a mapping from the spatio-temporal volumes to a three-dimensional body pose in a central frame based on a mapping function.
    Type: Application
    Filed: April 27, 2017
    Publication date: November 2, 2017
    Inventors: Pascal Fua, Vincent Lepetit, Artem Rozantsev, Bugra Tekin
  • Patent number: 9794525
    Abstract: Systems and methods for tracking interacting objects may acquire, with a sensor, and two or more images associated with two or more time instances. A processor may generate image data from the two or more images. The processor may apply an extended Probability Occupancy Map (POM) algorithm to the image data to obtain probability of occupancy for a container class of potentially interacting objects, probability of occupancy for a containee class of the potentially interacting objects, and a size relationship of the potentially interacting objects, over a set of discrete locations on a ground plane for each time instance. The processor may estimate trajectories of an object belonging to each of the two classes by determining a solution of a tracking model on the basis of the occupancy probabilities and a set of rules describing the interaction between objects of different or the same classes.
    Type: Grant
    Filed: March 24, 2015
    Date of Patent: October 17, 2017
    Assignee: ECOLE POLYTECHNIQUE FEDERALE DE LAUSANNE (EPFL)
    Inventors: Engin Turetken, Pascal Fua, Francois Fleuret, Xinchao Wang
  • Publication number: 20150281655
    Abstract: Systems and methods for tracking interacting objects may acquire, with a sensor, and two or more images associated with two or more time instances. A processor may generate image data from the two or more images. The processor may apply an extended Probability Occupancy Map (POM) algorithm to the image data to obtain probability of occupancy for a container class of potentially interacting objects, probability of occupancy for a containee class of the potentially interacting objects, and a size relationship of the potentially interacting objects, over a set of discrete locations on a ground plane for each time instance. The processor may estimate trajectories of an object belonging to each of the two classes by determining a solution of a tracking model on the basis of the occupancy probabilities and a set of rules describing the interaction between objects of different or the same classes.
    Type: Application
    Filed: March 24, 2015
    Publication date: October 1, 2015
    Inventors: ENGIN TURETKEN, Pascal FUA, Francois FLEURET, Xinchao WANG
  • Patent number: 8615107
    Abstract: Trajectories of objects are estimated by determining the optimal solution(s) of a tracking model on the basis of an occupancy probability distribution. The occupancy probability distribution is the probability of presence of objects over a set of discrete points in the spatio-temporal space at a number of time steps. The tracking model is defined by the set of discrete points, a virtual source location and a virtual sink location, wherein objects in the tracking model are creatable in the virtual source location and are removable in the virtual sink location.
    Type: Grant
    Filed: January 11, 2012
    Date of Patent: December 24, 2013
    Assignee: Ecole Polytechnique Federale de Lausanne (EPFL)
    Inventors: François Fleuret, Jérôme Berclaz, Engin Türetken, Pascal Fua
  • Patent number: 8588509
    Abstract: We presented an approach for speeding-up image acquisition when tasked with localizing specific structures in FIB-SEM imagery. It exploits the fact that low-quality images can be acquired faster than higher-quality ones and yet be sufficient for inference purposes. We have demonstrated greater than five-fold speed-ups at very little loss in accuracy in the context of mitochondria and synapse detection. Furthermore, the algorithm we propose is generic and applicable to many imaging modalities that allow trading quality for speed.
    Type: Grant
    Filed: June 28, 2012
    Date of Patent: November 19, 2013
    Assignee: Ecole Polytechnique Federale de Lausanne (EPFL)
    Inventors: Pascal Fua, Graham Knott, Raphael Sznitman, Aurelien Lucchi
  • Publication number: 20130177200
    Abstract: Trajectories of objects are estimated by determining the optimal solution(s) of a tracking model on the basis of an occupancy probability distribution. The occupancy probability distribution is the probability of presence of objects over a set of discrete points in the spatio-temporal space at a number of time steps. The tracking model is defined by the set of discrete points, a virtual source location and a virtual sink location, wherein objects in the tracking model are creatable in the virtual source location and are removable in the virtual sink location.
    Type: Application
    Filed: January 11, 2012
    Publication date: July 11, 2013
    Inventors: Françoi FLEURET, Jérôme Berclaz, Engin Türetken, Pascal Fua
  • Patent number: 6834120
    Abstract: The present invention provides a method for measuring the self-consistency of inference algorithms. The present invention provides a method for measuring the accuracy of an inference algorithm that does not require comparison to ground truth. Rather, the present invention pertains to a method for measuring the accuracy of an inference algorithm by comparing the outputs of the inference algorithm against each other. Essentially, the present invention looks at how well the algorithm applied to many of the different observations gives the same answer. In particular, the present invention provides a method that is not time and labor intensive and is cost effective.
    Type: Grant
    Filed: November 15, 2000
    Date of Patent: December 21, 2004
    Assignee: SRI International
    Inventors: Yvan G. LeClerc, Quang-Tuan Luong, Pascal Fua
  • Patent number: RE42999
    Abstract: The present invention provides a method for measuring the self-consistency of inference algorithms. The present invention provides a method for measuring the accuracy of an inference algorithm that does not require comparison to ground truth. Rather, the present invention pertains to a method for measuring the accuracy of an inference algorithm by comparing the outputs of the inference algorithm against each other. Essentially, the present invention looks at how well the algorithm applied to many of the different observations gives the same answer. In particular, the present invention provides a method that is not time and labor intensive and is cost effective.
    Type: Grant
    Filed: December 21, 2006
    Date of Patent: December 6, 2011
    Assignee: Transpacific Kodex, LLC
    Inventors: Yvan G. LeClerc, Margaret Frances Davies, legal representative, Quang-Tuan Luong, Pascal Fua