Patents by Inventor Marc PROESMANS
Marc PROESMANS has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 12225319Abstract: A system for producing a virtual image view for a vehicle is provided. The system includes one or more image capture means configured to capture image data in proximity to the vehicle, the image data being defined at least in part by first viewpoint parameters, and to provide an identifier identifying the respective one or more image capture means, storage means configured to store a plurality of virtualization records containing conversion information related to a virtualized viewpoint and a plurality of image capture means, and processing means.Type: GrantFiled: February 15, 2019Date of Patent: February 11, 2025Assignees: TOYOTA JIDOSHA KABUSHIKI KAISHA, KATHOLIEKE UNIVERSITEIT LEUVENInventors: Kazuki Tamura, Hiroaki Shimizu, Marc Proesmans, Frank Verbiest, Luc Van Gool
-
Patent number: 12142023Abstract: A system for generating a mask for object instances in an image is provided. The system includes a first module comprising a trained neural network and configured to input the image to the neural network, wherein the neural network is configured to generate: pixel offset vectors for the pixels of the object instance configured to point towards a unique center of an object instance, the pixel offset vectors thereby forming a cluster with a cluster distribution, and for each object instance an estimate of said cluster distribution defining a margin for determining which pixels belong to the object instance. A method for training a neural network map to be used for generating a mask for object instances in an image is also provided.Type: GrantFiled: January 17, 2019Date of Patent: November 12, 2024Assignees: TOYOTA MOTOR EUROPE, KATHOLIEKE UNIVERSITEIT LEUVEN, K.U. LEUVEN R&DInventors: Wim Abbeloos, Davy Neven, Bert De Brabandere, Marc Proesmans, Luc Van Gool
-
Patent number: 12073322Abstract: A computer-implemented method for training a classifier (??), including: training a pretext model (??) to learn a pretext task, so as to minimize a distance between an output of a source sample via the pretext model (??) and an output of a corresponding transformed sample via the pretext model (??), the transformed sample being a sample obtained by applying a transformation (T) to the source sample; S20) determining a neighborhood (NXi) of samples (Xi) of a dataset (SD) in the embedding space; S30) training the classifier (??) to predict respective estimated probabilities ??j(Xi), j=1 . . . C, for a sample (Xi) to belong to respective clusters (Cj), by using a second training criterion which tends to: maximize a likelihood for a sample and its neighbors (Xj) of its neighborhood (Nxi) to belong to the same cluster; and force the samples to be distributed over several clusters.Type: GrantFiled: May 21, 2021Date of Patent: August 27, 2024Assignees: TOYOTA JIDOSHA KABUSHIKI KAISHA, KATHOLIEKE UNIVERSITEIT LEUVENInventors: Wim Abbeloos, Gabriel Othmezouri, Wouter Van Gansbeke, Simon Vandenhende, Marc Proesmans, Stamatios Georgoulis, Luc Van Gool
-
Publication number: 20240144638Abstract: A method for adjusting an information system of a mobile machine, the information system being configured to calculate 3D information relative to a scene in which the mobile machine is moving, the method including: acquiring at least a first image of the scene at a first time and a second image of the scene at a second time; detecting one or more scene features in the first image and the second image; matching the one or more scene features across the first image and the second image based upon detection of the one or more scene features; estimating an egomotion of the mobile machine based upon the matching of the one or more scene features across the first image and the second image; and adjusting the information system by taking into account the estimation of the egomotion of the mobile machine.Type: ApplicationFiled: August 17, 2023Publication date: May 2, 2024Applicants: TOYOTA JIDOSHA KABUSHIKI KAISHA, KATHOLIEKE UNIVERSITEIT LEUVENInventors: Wim ABBELOOS, Frank VERBIEST, Bruno DAWAGNE, Wim LEMKENS, Marc PROESMANS, Luc VAN GOOL
-
Publication number: 20240144487Abstract: A method for tracking a position of an object in a scene surrounding a mobile machine based upon information acquired from monocular images, includes: acquiring at least a first image at a first time and a second image at a second time, the first image and the second image each including image data corresponding to the object and a scene feature present in the scene surrounding the mobile machine; detecting the object in the first image and the second image; matching the scene feature across the first image and the second image; performing an estimation of an egomotion of the mobile machine based upon the scene feature matched across the first image and the second image; and predicting a position of the object taking into account the estimation of the egomotion of the mobile machine.Type: ApplicationFiled: September 25, 2023Publication date: May 2, 2024Inventors: Wim ABBELOOS, Gabriel OTHMEZOURI, Frank VERBIEST, Bruno DAWAGNE, Wim LEMKENS, Marc PROESMANS, Luc VAN GOOL
-
Patent number: 11900696Abstract: A system and a method for processing a plurality of images, each image of the plurality of images being acquired by a respective image acquisition module of a vehicle and each image acquisition module being oriented outwardly with respect to the vehicle, the method comprising: elaborating a bird's eye view image of surroundings of the vehicle using pixel values of pixels of at least one portion of each image of the plurality of images as pixel values of the bird's eye view image, and performing, on the bird's eye view image, a detection of at least one lane marked on a surface on which the vehicle is and visible on the bird's eye view image.Type: GrantFiled: August 28, 2019Date of Patent: February 13, 2024Assignees: TOYOTA MOTOR EUROPE, KATHOLIEKE UNIVERSITEIT LEUVENInventors: Kazuki Tamura, Hiroaki Shimizu, Marc Proesmans, Frank Verbiest, Jonas Heylen, Bruno Dawagne, Davy Neven, Bert Debrabandere, Luc Van Gool
-
Method and system for processing an image and performing instance segmentation using affinity graphs
Patent number: 11881016Abstract: A system and a method for processing an image so as to perform instance segmentation. The system/method includes: a—inputting (S1) the image (IMG) to a first neural network configured to output an affinity graph (AF), and b—inputting (S2), to a second neural network, the affinity graph and a predefined seed-map (SM), so as to determine whether other pixels belong to a same instance, and set at a first value the value of the other pixels determined as belonging to the same instance.Type: GrantFiled: September 21, 2018Date of Patent: January 23, 2024Assignees: TOYOTA MOTOR EUROPE, KATHOLIEKE UNIVERSITEIT LEUVEN, K.U. LEUVEN R&DInventors: Hiroaki Shimizu, Bert De Brabandere, Davy Neven, Marc Proesmans, Luc Van Gool -
Publication number: 20230289983Abstract: A computer-implemented method for calculating information relative to a relative speed between an objectand a camera, based on two images of the object acquired by the camera. The method comprises:determining a value of an optical flowbetween the two images and, altogether with or after the determination of the value the optical flow, determining at least one parameter of the transformation, using the optical flow; andcalculating information relative to a relative speed between the object and the camera, based on said at least one parameter of the transformation.Type: ApplicationFiled: August 4, 2020Publication date: September 14, 2023Inventors: Nikolay Chumerin, Marc Proesmans
-
Publication number: 20220292846Abstract: A system and a method for processing a plurality of images, each image of the plurality of images being acquired by a respective image acquisition module of a vehicle and each image acquisition module being oriented outwardly with respect to the vehicle, the method comprising: elaborating a bird's eye view image of surroundings of the vehicle using pixel values of pixels of at least one portion of each image of the plurality of images as pixel values of the bird's eye view image, and performing, on the bird's eye view image, a detection of at least one lane marked on a surface on which the vehicle is and visible on the bird's eye view image.Type: ApplicationFiled: August 28, 2019Publication date: September 15, 2022Applicants: TOYOTA MOTOR EUROPE, KATHOLIEKE UNIVERSITEIT LEUVENInventors: Kazuki TAMURA, Hiroaki SHIMIZU, Marc PROESMANS, Frank VERBIEST, Jonas HEYLEN, Bruno DAWAGNE, Davy NEVEN, Bert DEBRABANDERE, Luc VAN GOOL
-
Publication number: 20220132049Abstract: A system for producing a virtual image view for a vehicle is provided. The system includes one or more image capture means configured to capture image data in proximity to the vehicle, the image data being defined at least in part by first viewpoint parameters, and to provide an identifier identifying the respective one or more image capture means, storage means configured to store a plurality of virtualization records containing conversion information related to a virtualized viewpoint and a plurality of image capture means, and processing means.Type: ApplicationFiled: February 15, 2019Publication date: April 28, 2022Inventors: Kazuki TAMURA, Hiroaki SHIMIZU, Marc PROESMANS, Frank VERBIEST, Luc VAN GOOL
-
Publication number: 20220092869Abstract: A system for generating a mask for object instances in an image is provided. The system includes a first module comprising a trained neural network and configured to input the image to the neural network, wherein the neural network is configured to generate: pixel offset vectors for the pixels of the object instance configured to point towards a unique center of an object instance, the pixel offset vectors thereby forming a cluster with a cluster distribution, and for each object instance an estimate of said cluster distribution defining a margin for determining which pixels belong to the object instance. A method for training a neural network map to be used for generating a mask for object instances in an image is also provided.Type: ApplicationFiled: January 17, 2019Publication date: March 24, 2022Applicants: Toyota Motor Europe, Katholieke Universiteit Leuven, K.U. Leuven R&DInventors: Wim ABBELOOS, Davy NEVEN, Bert DE BRABANDERE, Marc PROESMANS, Luc VAN GOOL
-
Publication number: 20210365735Abstract: A computer-implemented method for training a classifier (??), including: training a pretext model (??) to learn a pretext task, so as to minimize a distance between an output of a source sample via the pretext model (??) and an output of a corresponding transformed sample via the pretext model (??), the transformed sample being a sample obtained by applying a transformation (T) to the source sample; S20) determining a neighborhood (NXi) of samples (Xi) of a dataset (SD) in the embedding space; S30) training the classifier (??) to predict respective estimated probabilities ??j(Xi), j=1 . . . C, for a sample (Xi) to belong to respective clusters (Cj), by using a second training criterion which tends to: maximize a likelihood for a sample and its neighbors (Xj) of its neighborhood (Nxi) to belong to the same cluster; and force the samples to be distributed over several clusters.Type: ApplicationFiled: May 21, 2021Publication date: November 25, 2021Applicants: Toyota Jidosha Kabushiki Kaisha, Katholieke Universiteit LeuvenInventors: Wim Abbeloos, Gabriel Othmezouri, Wouter Van Gansbeke, Simon Vandenhende, Marc Proesmans, Stamatios Georgoulis, Luc Van Gool
-
METHOD AND SYSTEM FOR PROCESSING AN IMAGE AND PERFORMING INSTANCE SEGMENTATION USING AFFINITY GRAPHS
Publication number: 20210287049Abstract: A system and a method for processing an image so as to perform instance segmentation. The system/method includes: a—inputting (S1) the image (IMG) to a first neural network configured to output an affinity graph (AF), and b—inputting (S2), to a second neural network, the affinity graph and a predefined seed-map (SM), so as to determine whether other pixels belong to a same instance, and set at a first value the value of the other pixels determined as belonging to the same instance.Type: ApplicationFiled: September 21, 2018Publication date: September 16, 2021Applicants: TOYOTA MOTOR EUROPE, KATHOLIEKE UNIVERSITEIT LEUVENInventors: Hiroaki SHIMIZU, Bert DE BRABANDERE, Davy NEVEN, Marc PROESMANS, Luc VAN GOOL -
Publication number: 20210264196Abstract: The present disclosure provides a method for processing at least one image comprising inputting the image to at least one neural network, the at least one network being configured to deliver, for each pixel of a group of pixels belonging to an object of a given type visible on the image, an estimation of object parameters that are parameters of the object. The method further comprising processing the estimations of the object parameters using an instance segmentation mask identifying instances of objects having the given type.Type: ApplicationFiled: February 17, 2021Publication date: August 26, 2021Applicants: TOYOTA JIDOSHA KABUSHIKI KAISHA, KATHOLIEKE UNIVERSITEIT LEUVENInventors: Wim ABBELOOS, Daniel OLMEDA REINO, Hazem ABDELKAWY, Jonas HEYLEN, Mark DE WOLF, Bruno DAWAGNE, Michael BARNES, Wim LEMKENS, Marc PROESMANS, Luc VAN GOOL