Patents by Inventor Jonah Philion
Jonah Philion has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Publication number: 20250111109Abstract: In various examples, systems and methods are disclosed relating to generating tokens for traffic modeling. One or more circuits can identify trajectories in a dataset, and generate actions from the identified trajectories. The one or more circuits can generate, based at least on the plurality of actions and at least one trajectory of the plurality of trajectories, a set of tokens representing actions to generate trajectories of one or more agents in a simulation. The one or more circuits may update a transformer model to generate simulated actions for simulated agents based at least on tokens generated from the trajectories in the dataset.Type: ApplicationFiled: May 15, 2024Publication date: April 3, 2025Applicant: NVIDIA CorporationInventors: Jonah PHILION, Sanja FIDLER, Jason PENG
-
Patent number: 12214809Abstract: A method of instance segmentation in an image and a system for instance segmentation of images. The method includes identifying, with a processor, a starting pixel associated with an object in an image, the image having a plurality of rows of pixels, the starting pixel located in a row of the plurality of rows; identifying, with the processor, at least one pixel located in an adjacent row to the row in which the starting pixel is located, the at least one pixel being part of the same object as the starting pixel; iterating the previous two identification steps using the at least one identified adjacent row pixel as a start pixel for the next iteration; and connecting, with the processor, the at least one identified adjacent row pixels to form polylines representing the object.Type: GrantFiled: June 26, 2023Date of Patent: February 4, 2025Assignee: iSee, Inc.Inventors: Jonah Philion, Yibiao Zhao
-
Publication number: 20250020481Abstract: Apparatuses, systems, and techniques are presented to determination about objects in an environment. In at least one embodiment, a neural network can be used to determine one or more positions of one or more objects within a three-dimensional (3D) environment and to generate a segmented map of the 3D environment based, at least in part, on one or more two dimensional (2D) images of the one or more objects.Type: ApplicationFiled: April 7, 2022Publication date: January 16, 2025Inventors: Enze Xie, Zhiding Yu, Jonah Philion, Anima Anandkumar, Sanja Fidler, Jose Manuel Alvarez Lopez
-
Publication number: 20240362897Abstract: In various examples, systems and methods are disclosed relating to synthetic data generation using viewpoint augmentation for autonomous and semi-autonomous systems and applications. One or more circuits can identify a set of sequential images corresponding to a first viewpoint and generate a first transformed image corresponding to a second viewpoint using a first image of the set of sequential images as input to a machine-learning model. The one or more circuits can update the machine-learning model based at least on a loss determined according to the first transformed image and a second image of the set of sequential images.Type: ApplicationFiled: April 12, 2024Publication date: October 31, 2024Applicant: NVIDIA CorporationInventors: Tzofi Klinghoffer, Jonah Philion, Zan Gojcic, Sanja Fidler, Or Litany, Wenzheng Chen, Jose Manuel Alvarez Lopez
-
Publication number: 20240160888Abstract: In various examples, systems and methods are disclosed relating to neural networks for realistic and controllable agent simulation using guided trajectories. The neural networks can be configured using training data including trajectories and other state data associated with subjects or agents and remote or neighboring subjects or agents, as well as context data representative of an environment in which the subjects are present. The trajectories can be determining using the neural networks and using various forms of guidance for controllability, such as for waypoint navigation, obstacle avoidance, and group movement.Type: ApplicationFiled: March 31, 2023Publication date: May 16, 2024Applicant: NVIDIA CorporationInventors: Davis Winston Rempe, Karsten Julian Kreis, Sanja Fidler, Or Litany, Jonah Philion
-
Publication number: 20240092390Abstract: In various examples, systems and methods are presented for model-based trajectory simulation of agents in a simulated environment. Traffic simulators mimic reality so that autonomous or semi-autonomous vehicle design teams can validate driving models in environments that have diversity and complexity. In some embodiments, for a model-controlled agent of a simulation environment, a plurality of navigation probability distributions are generated, each of the plurality of navigation probability distributions defining a candidate trajectory for the agent to follow. A trajectory is selected for the agent based at least on at least one of the plurality of navigation probability distributions, and the agent is moved within the simulation environment based at least on the selected trajectory. In some embodiments, a search algorithm may be applied across multiple time-steps of a simulation, for example, to identify the occurrence of collision-free sequences of navigation probability distributions.Type: ApplicationFiled: September 21, 2022Publication date: March 21, 2024Inventors: Jonah PHILION, Jeevan DEVARANJAN, Xue Bin PENG, Sanja FIDLER
-
Publication number: 20230385687Abstract: Approaches for training data set size estimation for machine learning model systems and applications are described. Examples include a machine learning model training system that estimates target data requirements for training a machine learning model, given an approximate relationship between training data set size and model performance using one or more validation score estimation functions. To derive a validation score estimation function, a regression data set is generated from training data, and subsets of the regression data set are used to train the machine learning model. A validation score is computed for the subsets and used to compute regression function parameters to curve fit the selected regression function to the training data set. The validation score estimation function is then solved for and provides an output of an estimate of the number additional training samples needed for the validation score estimation function to meet or exceed a target validation score.Type: ApplicationFiled: May 31, 2022Publication date: November 30, 2023Inventors: Rafid Reza Mahmood, James Robert Lucas, David Jesus Acuna Marrero, Daiqing Li, Jonah Philion, Jose Manuel Alvarez Lopez, Zhiding Yu, Sanja Fidler, Marc Law
-
Publication number: 20230358533Abstract: A method of instance segmentation in an image and a system for instance segmentation of images. The method includes identifying, with a processor, a starting pixel associated with an object in an image, the image having a plurality of rows of pixels, the starting pixel located in a row of the plurality of rows; identifying, with the processor, at least one pixel located in an adjacent row to the row in which the starting pixel is located, the at least one pixel being part of the same object as the starting pixel; iterating the previous two identification steps using the at least one identified adjacent row pixel as a start pixel for the next iteration; and connecting, with the processor, the at least one identified adjacent row pixels to form polylines representing the object.Type: ApplicationFiled: June 26, 2023Publication date: November 9, 2023Inventors: Jonah Philion, Yibiao Zhao
-
Patent number: 11718324Abstract: A method of instance segmentation in an image and a system for instance segmentation of images. The method includes identifying, with a processor, a starting pixel associated with an object in an image, the image having a plurality of rows of pixels, the starting pixel located in a row of the plurality of rows; identifying, with the processor, at least one pixel located in an adjacent row to the row in which the starting pixel is located, the at least one pixel being part of the same object as the starting pixel; iterating the previous two identification steps using the at least one identified adjacent row pixel as a start pixel for the next iteration; and connecting, with the processor, the at least one identified adjacent row pixels to form polylines representing the object.Type: GrantFiled: April 13, 2020Date of Patent: August 8, 2023Assignee: iSee, Inc.Inventors: Jonah Philion, Yibiao Zhao
-
Publication number: 20220391766Abstract: In various examples, systems and methods are disclosed that use a domain-adaptation theory to minimize the reality gap between simulated and real-world domains for training machine learning models. For example, sampling of spatial priors may be used to generate synthetic data that that more closely matches the diversity of data from the real-world. To train models using this synthetic data that still perform well in the real-world, the systems and methods of the present disclosure may use a discriminator that allows a model to learn domain-invariant representations to minimize the divergence between the virtual world and the real-world in a latent space. As such, the techniques described herein allow for a principled approach to learn neural-invariant representations and a theoretically inspired approach on how to sample data from a simulator that, in combination, allow for training of machine learning models using synthetic data.Type: ApplicationFiled: May 27, 2022Publication date: December 8, 2022Inventors: David Jesus Acuna Marrero, Sanja Fidler, Jonah Philion
-
Publication number: 20220269937Abstract: Apparatuses, systems, and techniques to use one or more neural networks to generate one or more images based, at least in part, on one or more spatially-independent features within the one or more images. In at least one embodiment, the one or more neural networks determine spatially-independent information and spatially-dependent information of the one or more images and process the spatially-independent information and the spatially-dependent information to generate the one or more spatially-independent features and one or more spatially-dependent features within the one or more images.Type: ApplicationFiled: February 24, 2021Publication date: August 25, 2022Inventors: Seung Wook Kim, Jonah Philion, Sanja Fidler, Antonio Torralba Barriuso
-
Publication number: 20210398338Abstract: Apparatuses, systems, and techniques are presented to generate view-specific representations of an object or environment. In at least one embodiment, one or more neural networks are used to generate one or more images based, at least in part, on two or more two-dimensional (2D) images having different frames of reference.Type: ApplicationFiled: June 22, 2020Publication date: December 23, 2021Inventors: Jonah Philion, Sanja Fidler
-
Publication number: 20210390778Abstract: Apparatuses, systems, and techniques are presented to generate a simulated environment. In at least one embodiment, one or more neural networks are used to generate a simulated environment based, at least in part, on stored information associated with objects within the simulated environment.Type: ApplicationFiled: June 10, 2020Publication date: December 16, 2021Inventors: Seung Wook Kim, Sanja Fidler, Jonah Philion, Antonio Torralba Barriuso
-
Publication number: 20200327338Abstract: A method of instance segmentation in an image and a system for instance segmentation of images. The method includes identifying, with a processor, a starting pixel associated with an object in an image, the image having a plurality of rows of pixels, the starting pixel located in a row of the plurality of rows; identifying, with the processor, at least one pixel located in an adjacent row to the row in which the starting pixel is located, the at least one pixel being part of the same object as the starting pixel; iterating the previous two identification steps using the at least one identified adjacent row pixel as a start pixel for the next iteration; and connecting, with the processor, the at least one identified adjacent row pixels to form polylines representing the object.Type: ApplicationFiled: April 13, 2020Publication date: October 15, 2020Inventors: Jonah Philion, Yibiao Zhao