Patents by Inventor Pascal Fua
Pascal Fua has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 12190452Abstract: A method for enforcing smoothness constraints on surface meshes produced by a Graph Convolutional Neural Network (GCNN) including the steps of reading image data from a memory, the image data including two-dimensional image data representing a three-dimensional object or a three-dimensional image stack of the three-dimensional object, performing a GCNN mesh deformation step on the image data to obtain an approximation of a surface of the three-dimensional object, the surface represented by triangulated surface meshes, at least some vertices of the triangulated surface meshes having a different number of neighboring vertices compared to other vertices in a same triangulated surface mesh, and performing a deep active surface model (DASM) transformation step on the triangulated surface meshes to obtain a corrected representation of the surface of three-dimensional object to improve smoothness of the surface.Type: GrantFiled: November 16, 2021Date of Patent: January 7, 2025Assignee: ECOLE POLYTECHNIQUE FEDERALE DE LAUSANNE (EPFL)Inventors: Udaranga Pamuditha Wickramasinghe, Pascal Fua
-
Publication number: 20240412416Abstract: Data processing systems are disclosed for determining semantic and person keypoints for an environment and an image and matching the keypoints for the image to the keypoints for the environment. A homography is generated based on the keypoint matching and decomposed into a matrix. Camera parameters are then determined from the matrix. A plurality of random camera poses can be generated and used to project keypoints for an environment using image keypoints. The projected keypoints can be compared to the actual keypoints for the environment to determine an error and weighting for each of the random camera poses.Type: ApplicationFiled: August 15, 2024Publication date: December 12, 2024Inventors: Leonardo Citraro, Pablo Márquez Neila, Stefano Savarè, Vivek Jayaram, Charles Xavier Quentin Dubout, Felix Constant Marc Renaut, Andres Michael Levering Hasfura, Horesh Beny Ben Shitrit, Pascal Fua
-
Patent number: 12094174Abstract: Data processing systems are disclosed for determining semantic and person keypoints for an environment and an image and matching the keypoints for the image to the keypoints for the environment. A homography is generated based on the keypoint matching and decomposed into a matrix. Camera parameters are then determined from the matrix. A plurality of random camera poses can be generated and used to project keypoints for an environment using image keypoints. The projected keypoints can be compared to the actual keypoints for the environment to determine an error and weighting for each of the random camera poses.Type: GrantFiled: May 22, 2023Date of Patent: September 17, 2024Assignee: Genius Sports SS, LLCInventors: Leonardo Citraro, Pablo Márquez Neila, Stefano Savarè, Vivek Jayaram, Charles Xavier Quentin Dubout, Felix Constant Marc Renaut, Andres Michael Levering Hasfura, Horesh Beny Ben Shitrit, Pascal Fua
-
Patent number: 11768983Abstract: The present invention generally relates to a method, a system and a computer program for shape optimisation of a technical device adapted to be exposed to a fluid flowing around a contour of said device with respect to its fluid dynamic parameters. In order to provide an improved method for shape optimisation of a technical device with respect to its fluid dynamic parameters which is faster, a method is provided comprising discretizing the shape of the technical device into a plurality of points along the contour of the technical device or into a surface mesh, and inputting the plurality of points or the surface mesh into a Convolutional Neural Network (CNN) for computing a prediction of the at least one fluid dynamic parameter.Type: GrantFiled: February 5, 2018Date of Patent: September 26, 2023Assignee: ECOLE POLYTECHNIQUE FEDERALE DE LAUSANNE EPFL-TTOInventors: Pierre Bruno Baqué, Pascal Fua, Francois Fleuret
-
Publication number: 20230298210Abstract: Data processing systems are disclosed for determining semantic and person keypoints for an environment and an image and matching the keypoints for the image to the keypoints for the environment. A homography is generated based on the keypoint matching and decomposed into a matrix. Camera parameters are then determined from the matrix. A plurality of random camera poses can be generated and used to project keypoints for an environment using image keypoints. The projected keypoints can be compared to the actual keypoints for the environment to determine an error and weighting for each of the random camera poses.Type: ApplicationFiled: May 22, 2023Publication date: September 21, 2023Inventors: Leonardo Citraro, Pablo Márquez Neila, Stefano Savarè, Vivek Jayaram, Charles Xavier Quentin Dubout, Felix Constant Marc Renaut, Andres Michael Levering Hasfura, Horesh Beny Ben Shitrit, Pascal Fua
-
Patent number: 11694362Abstract: Data processing systems are disclosed for determining semantic and person keypoints for an environment and an image and matching the keypoints for the image to the keypoints for the environment. A homography is generated based on the keypoint matching and decomposed into a matrix. Camera parameters are then determined from the matrix. A plurality of random camera poses can be generated and used to project keypoints for an environment using image keypoints. The projected keypoints can be compared to the actual keypoints for the environment to determine an error and weighting for each of the random camera poses.Type: GrantFiled: April 7, 2021Date of Patent: July 4, 2023Assignee: Genius Sports SS, LLCInventors: Leonardo Citraro, Pablo Márquez Neila, Stefano Savarè, Vivek Jayaram, Charles Xavier Quentin Dubout, Felix Constant Marc Renaut, Andres Michael Levering Hasfura, Horesh Beny Ben Shitrit, Pascal Fua
-
Publication number: 20230169732Abstract: A method for enforcing smoothness constraints on surface meshes produced by a Graph Convolutional Neural Network (GCNN) including the steps of reading image data from a memory, the image data including two-dimensional image data representing a three-dimensional object or a three-dimensional image stack of the three-dimensional object, performing a GCNN mesh deformation step on the image data to obtain an approximation of a surface of the three-dimensional object, the surface represented by triangulated surface meshes, at least some vertices of the triangulated surface meshes having a different number of neighboring vertices compared to other vertices in a same triangulated surface mesh, and performing a deep active surface model (DASM) transformation step on the triangulated surface meshes to obtain a corrected representation of the surface of three-dimensional object to improve smoothness of the surface.Type: ApplicationFiled: November 16, 2021Publication date: June 1, 2023Inventors: Udaranga Pamuditha Wickramasinghe, Pascal Fua
-
Publication number: 20220346878Abstract: System for training an interventionalist to perform an invasive percutaneous or endoscopic intervention on an organ includes a pipe having a size and/or shape similar to a body vessel or tubular body cavity connected to the organ. An exit of the pipe simulates or represents an exit of the vessel or cavity at the organ. A tool is inserted at an entrance of the pipe and pushed through the pipe. A stereoscopic camera acquires images of an end portion of the tool as it exits from the pipe. A model generating unit generates a real-time 3D model of this end portion from the images. A merging unit merges in real time the real-time model and a pre-computed 3D model of the organ into a common environment displayed so that the interventionalist can see in real-time where the real-time model of the tool is located with respect to the pre-computed model.Type: ApplicationFiled: April 28, 2022Publication date: November 3, 2022Inventors: Hussein Ballan, Pascal Fua, Georges Caron, Jürg Schwitter, Luigi Bagnato
-
Publication number: 20210225034Abstract: Data processing systems are disclosed for determining semantic and person keypoints for an environment and an image and matching the keypoints for the image to the keypoints for the environment. A homography is generated based on the keypoint matching and decomposed into a matrix. Camera parameters are then determined from the matrix. A plurality of random camera poses can be generated and used to project keypoints for an environment using image keypoints. The projected keypoints can be compared to the actual keypoints for the environment to determine an error and weighting for each of the random camera poses.Type: ApplicationFiled: April 7, 2021Publication date: July 22, 2021Inventors: Leonardo Citraro, Pablo Márquez Neila, Stefano Savarè, Vivek Jayaram, Charles Xavier Quentin Dubout, Felix Constant Marc Renaut, Andres Michael Levering Hasfura, Horesh Beny Ben Shitrit, Pascal Fua
-
Publication number: 20210157962Abstract: The present invention generally relates to a method, a system and a computer program for shape optimisation of a technical device adapted to be exposed to a fluid flowing around a contour of said device with respect to its fluid dynamic parameters. In order to provide an improved method for shape optimisation of a technical device with respect to its fluid dynamic parameters which is faster, a method is provided comprising discretizing the shape of the technical device into a plurality of points along the contour of the technical device or into a surface mesh, and inputting the plurality of points or the surface mesh into a Convolutional Neural Network (CNN) for computing a prediction of the at least one fluid dynamic parameter.Type: ApplicationFiled: February 5, 2018Publication date: May 27, 2021Inventors: Pierre Bruno BAQUÉ, Pascal FUA, Francois FLEURET
-
Patent number: 10991125Abstract: Data processing systems are disclosed for determining semantic and person keypoints for an environment and an image and matching the keypoints for the image to the keypoints for the environment. A homography is generated based on the keypoint matching and decomposed into a matrix. Camera parameters are then determined from the matrix. A plurality of random camera poses can be generated and used to project keypoints for an environment using image keypoints. The projected keypoints can be compared to the actual keypoints for the environment to determine an error and weighting for each of the random camera poses.Type: GrantFiled: February 24, 2020Date of Patent: April 27, 2021Assignee: Second Spectrum, Inc.Inventors: Leonardo Citraro, Pablo Márquez Neila, Stefano Savarè, Vivek Jayaram, Charles Xavier Quentin Dubout, Felix Constant Marc Renaut, Andres Michael Levering Hasfura, Horesh Beny Ben Shitrit, Pascal Fua
-
Publication number: 20210027493Abstract: Data processing systems are disclosed for determining semantic and person keypoints for an environment and an image and matching the keypoints for the image to the keypoints for the environment. A homography is generated based on the keypoint matching and decomposed into a matrix. Camera parameters are then determined from the matrix. A plurality of random camera poses can be generated and used to project keypoints for an environment using image keypoints. The projected keypoints can be compared to the actual keypoints for the environment to determine an error and weighting for each of the random camera poses.Type: ApplicationFiled: February 24, 2020Publication date: January 28, 2021Inventors: Leonardo Citraro, Pablo Márquez Neila, Stefano Savarè, Vivek Jayaram, Charles Xavier Quentin Dubout, Felix Constant Marc Renaut, Andres Michael Levering Hasfura, Horesh Beny Ben Shitrit, Pascal Fua
-
Patent number: 10600210Abstract: Data processing systems are disclosed for determining semantic and person keypoints for an environment and an image and matching the keypoints for the image to the keypoints for the environment. A homography is generated based on the keypoint matching and decomposed into a matrix. Camera parameters are then determined from the matrix. A plurality of random camera poses can be generated and used to project keypoints for an environment using image keypoints. The projected keypoints can be compared to the actual keypoints for the environment to determine an error and weighting for each of the random camera poses.Type: GrantFiled: July 25, 2019Date of Patent: March 24, 2020Assignee: Second Spectrum, Inc.Inventors: Leonardo Citraro, Pablo Márquez Neila, Stefano Savaré, Vivek Jayaram, Charles Xavier Quentin Dubout, Felix Constant Marc Renaut, Andres Michael Levering Hasfura, Horesh Beny Ben Shitrit, Pascal Fua
-
Patent number: 10552709Abstract: A method for training a feature detector of an image processing device, including the steps of detecting features in the image to generate a score map, computing a center of mass on the score map to generate a location, extracting a patch from the image at the location by a first spatial transformer, estimating an orientation of the patch, rotating the patch in accordance with the patch orientation with a second spatial transformer, and describing the rotated patch to create a description vector.Type: GrantFiled: June 29, 2017Date of Patent: February 4, 2020Assignee: ECOLE POLYTECHNIQUE FEDERALE DE LAUSANNE (EPFL)Inventors: Pascal Fua, Vincent Lepetit, Eduard Fortuny Trulls, Kwang Moo Yi
-
Publication number: 20180096224Abstract: A method for training a feature detector of an image processing device, including the steps of detecting features in the image to generate a score map, computing a center of mass on the score map to generate a location, extracting a patch from the image at the location by a first spatial transformer, estimating an orientation of the patch, rotating the patch in accordance with the patch orientation with a second spatial transformer, and describing the rotated patch to create a description vector.Type: ApplicationFiled: June 29, 2017Publication date: April 5, 2018Inventors: Pascal Fua, Vincent Lepetit, Eduard Fortuny Trulls, Kwang Moo Yi
-
Publication number: 20170316578Abstract: A method for predicting three-dimensional body poses from image sequences of an object, the method performed on a processor of a computer having memory, the method including the steps of accessing the image sequences from the memory, finding bounding boxes around the object in consecutive frames of the image sequence, compensating motion of the object to form spatio-temporal volumes, and learning a mapping from the spatio-temporal volumes to a three-dimensional body pose in a central frame based on a mapping function.Type: ApplicationFiled: April 27, 2017Publication date: November 2, 2017Inventors: Pascal Fua, Vincent Lepetit, Artem Rozantsev, Bugra Tekin
-
Patent number: 9794525Abstract: Systems and methods for tracking interacting objects may acquire, with a sensor, and two or more images associated with two or more time instances. A processor may generate image data from the two or more images. The processor may apply an extended Probability Occupancy Map (POM) algorithm to the image data to obtain probability of occupancy for a container class of potentially interacting objects, probability of occupancy for a containee class of the potentially interacting objects, and a size relationship of the potentially interacting objects, over a set of discrete locations on a ground plane for each time instance. The processor may estimate trajectories of an object belonging to each of the two classes by determining a solution of a tracking model on the basis of the occupancy probabilities and a set of rules describing the interaction between objects of different or the same classes.Type: GrantFiled: March 24, 2015Date of Patent: October 17, 2017Assignee: ECOLE POLYTECHNIQUE FEDERALE DE LAUSANNE (EPFL)Inventors: Engin Turetken, Pascal Fua, Francois Fleuret, Xinchao Wang
-
Publication number: 20150281655Abstract: Systems and methods for tracking interacting objects may acquire, with a sensor, and two or more images associated with two or more time instances. A processor may generate image data from the two or more images. The processor may apply an extended Probability Occupancy Map (POM) algorithm to the image data to obtain probability of occupancy for a container class of potentially interacting objects, probability of occupancy for a containee class of the potentially interacting objects, and a size relationship of the potentially interacting objects, over a set of discrete locations on a ground plane for each time instance. The processor may estimate trajectories of an object belonging to each of the two classes by determining a solution of a tracking model on the basis of the occupancy probabilities and a set of rules describing the interaction between objects of different or the same classes.Type: ApplicationFiled: March 24, 2015Publication date: October 1, 2015Inventors: ENGIN TURETKEN, Pascal FUA, Francois FLEURET, Xinchao WANG
-
Patent number: 8615107Abstract: Trajectories of objects are estimated by determining the optimal solution(s) of a tracking model on the basis of an occupancy probability distribution. The occupancy probability distribution is the probability of presence of objects over a set of discrete points in the spatio-temporal space at a number of time steps. The tracking model is defined by the set of discrete points, a virtual source location and a virtual sink location, wherein objects in the tracking model are creatable in the virtual source location and are removable in the virtual sink location.Type: GrantFiled: January 11, 2012Date of Patent: December 24, 2013Assignee: Ecole Polytechnique Federale de Lausanne (EPFL)Inventors: François Fleuret, Jérôme Berclaz, Engin Türetken, Pascal Fua
-
Patent number: 8588509Abstract: We presented an approach for speeding-up image acquisition when tasked with localizing specific structures in FIB-SEM imagery. It exploits the fact that low-quality images can be acquired faster than higher-quality ones and yet be sufficient for inference purposes. We have demonstrated greater than five-fold speed-ups at very little loss in accuracy in the context of mitochondria and synapse detection. Furthermore, the algorithm we propose is generic and applicable to many imaging modalities that allow trading quality for speed.Type: GrantFiled: June 28, 2012Date of Patent: November 19, 2013Assignee: Ecole Polytechnique Federale de Lausanne (EPFL)Inventors: Pascal Fua, Graham Knott, Raphael Sznitman, Aurelien Lucchi