Patents by Inventor Animesh GARG

Animesh GARG has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240095077
    Abstract: Apparatuses, systems, and techniques to generate a prompt for one or more machine learning processes. In at least one embodiment, the machine learning process(es) generate(s) a plan to perform a task (identified in the prompt) that is to be performed by an agent (real world or virtual).
    Type: Application
    Filed: March 16, 2023
    Publication date: March 21, 2024
    Inventors: Ishika Singh, Arsalan Mousavian, Ankit Goyal, Danfei Xu, Jonathan Tremblay, Dieter Fox, Animesh Garg, Valts Blukis
  • Patent number: 11902705
    Abstract: Apparatuses, systems, and techniques to enhance video are disclosed. In at least one embodiment, one or more neural networks are used to create, from a first video, a second video having one or more additional video frames.
    Type: Grant
    Filed: September 3, 2019
    Date of Patent: February 13, 2024
    Assignee: NVIDIA CORPORATION
    Inventors: Kevin Shih, Aysegul Dundar, Animesh Garg, Robert Pottorff, Andrew Tao, Bryan Catanzaro
  • Patent number: 11893468
    Abstract: Apparatuses, systems, and techniques to identify a goal of a demonstration. In at least one embodiment, video data of a demonstration is analyzed to identify a goal. Object trajectories identified in the video data are analyzed with respect to a task predicate satisfied by a respective object trajectory, and with respect to motion predicate. Analysis of the trajectory with respect to the motion predicate is used to assess intentionality of a trajectory with respect to the goal.
    Type: Grant
    Filed: July 16, 2020
    Date of Patent: February 6, 2024
    Assignee: NVIDIA Corporation
    Inventors: Yu-Wei Chao, De-An Huang, Christopher Jason Paxton, Animesh Garg, Dieter Fox
  • Publication number: 20230398686
    Abstract: Apparatuses, systems, and techniques to update a machine learning model associated with an object. In at least one embodiment, the machine learning model is updated based at least in part on, for example, one or more distributions associated with the machine learning model.
    Type: Application
    Filed: February 24, 2023
    Publication date: December 14, 2023
    Inventors: Fabio Tozeto Ramos, Animesh Garg, Krishna Murthy Jatavallabhula, Miles Macklin
  • Publication number: 20230256595
    Abstract: One embodiment of a method for controlling a robot includes receiving sensor data associated with an environment that includes an object; applying a machine learning model to a portion of the sensor data associated with the object and one or more trajectories of motion of the robot to determine one or more path lengths of the one or more trajectories; generating a new trajectory of motion of the robot based on the one or more trajectories and the one or more path lengths; and causing the robot to perform one or more movements based on the new trajectory.
    Type: Application
    Filed: July 1, 2022
    Publication date: August 17, 2023
    Inventors: Adithyavairavan MURALI, Balakumar SUNDARALINGAM, Yun-Chun CHEN, Dieter FOX, Animesh GARG
  • Publication number: 20230226696
    Abstract: Methods and systems to remotely operate robotic devices are provided. A number of embodiments allow users to remotely operate robotic devices using generalized consumer devices (e.g., cell phones). Additional embodiments provide for a platform to allow communication between consumer devices and the robotic devices. Further embodiments allow for training robotic devices to operate autonomously by training the robotic device with machine learning algorithms using data collected from scalable methods of controlling robotic devices.
    Type: Application
    Filed: November 2, 2020
    Publication date: July 20, 2023
    Applicant: The Board of Trustees of the Leland Stanford Junior University
    Inventors: Ajay U. Mandlekar, Yuke Zhu, Animesh Garg, Silvio Savarese, Fei-Fei Li
  • Patent number: 11529205
    Abstract: According to some embodiments of the invention, a surgical robot includes a robot arm having an end effector, the end effector comprising a needle assembly. The surgical robot further includes a robot control system operatively connected to the robot arm, and an end effector control system operatively connected to the end effector. The robot control system provides control signals for operation of the robot arm to move the end effector to selected positions relative to a subject. The end effector control system is configured to provide signals for operation of the end effector to at least one of inject material through the needle assembly to a selected location within the subject's body or extract material through the needle assembly from the selected location within the subject's body.
    Type: Grant
    Filed: June 23, 2016
    Date of Patent: December 20, 2022
    Assignee: The Regents of the University of California
    Inventors: Stephen McKinley, Animesh Garg, Sachin Patil, Susan M. L. Lim, Ken Goldberg
  • Publication number: 20220382246
    Abstract: A differentiable simulator for simulating the cutting of soft materials by a cutting instrument is provided. In accordance with one aspect of the disclosure, a method for simulating a cutting operation includes: receiving a mesh for an object, modifying the mesh to add virtual nodes associated with a predefined cutting plane, optimizing a set of parameters associated with a simulator based on ground-truth data, and running a simulation via the simulator to generate outputs that include trajectories associated with a cutting instrument. Optimizing the set of parameters can include performing inference based on a set of ground-truth trajectories captured using sensors to measure real-world cutting operations. The inference techniques can employ stochastic gradient descent, stochastic gradient Langevin dynamics, or a Bayesian approach. In an embodiment, the simulator can be utilized to generate control signals for a robot based on the simulated trajectories.
    Type: Application
    Filed: April 28, 2022
    Publication date: December 1, 2022
    Inventors: Eric Heiden, Fabio Tozeto Ramos, Yashraj Narang, Miles Macklin, Dieter Fox, Animesh Garg, Mike Skolones
  • Publication number: 20220374723
    Abstract: Apparatuses, systems, and techniques to perform a language-guided distributional tree search based at least in part on a natural language task. In at least one embodiment, a tree search is performed using one or more neural networks to determine an action to be performed by an autonomous agent.
    Type: Application
    Filed: May 10, 2021
    Publication date: November 24, 2022
    Inventors: Valts Blukis, Christopher Jason Paxton, Animesh Garg, Dieter Fox
  • Publication number: 20220180528
    Abstract: Apparatuses, systems, and techniques to perform unsupervised keypoint or landmark learning using one or more neural networks. In at least one embodiment, one or more neural networks use pose and appearance information to construct a foreground and a background, which are then used to reconstruct an input image and determine loss values to train the one or more neural networks.
    Type: Application
    Filed: February 23, 2022
    Publication date: June 9, 2022
    Inventors: Aysegul Dundar, Kevin Jonathan Shih, Animesh Garg, Robert Thomas Pottorff, Andrew Tao, Bryan Christopher Catanzaro
  • Publication number: 20220055689
    Abstract: A framework for offline learning from a set of diverse and suboptimal demonstrations operates by selectively imitating local sequences from the dataset. At least one embodiment recovers performant policies from large manipulation datasets by decomposing the problem into a goal-conditioned imitation and a high-level goal selection mechanism.
    Type: Application
    Filed: August 20, 2020
    Publication date: February 24, 2022
    Inventors: Ajay Uday Mandlekar, Fabio Tozeto Ramos, Byron Boots, Animesh Garg, Dieter Fox
  • Publication number: 20220036179
    Abstract: One embodiment of a method for performing a task includes generating a first posterior distribution of a global latent context variable for the task based on a pool of contexts sampled from one or more previous episodes of the task. The method also includes generating a second posterior distribution of a local latent context variable for a current time step in a current episode of the task based on one or more recent contexts sampled at one or more previous time steps of the current episode. The method further includes causing an agent to perform an action related to carrying out the task based on the first posterior distribution, the second posterior distribution, and a current state associated with the current time step.
    Type: Application
    Filed: July 31, 2020
    Publication date: February 3, 2022
    Inventors: Animesh GARG, Hongyu REN, Yuke ZHU, Anima ANANDKUMAR
  • Publication number: 20220012596
    Abstract: Apparatuses, systems, and techniques used to train one or more neural networks to generate images comprising one or more features. In at least one embodiment, one or more neural networks are trained to determine one or more styles for an input image and then generate features associated with said one or more styles in an output image.
    Type: Application
    Filed: July 9, 2020
    Publication date: January 13, 2022
    Inventors: Weili Nie, Tero Tapani Karras, Animesh Garg, Shoubhik Debnath, Anjul Patney, Anima Anandkumar
  • Publication number: 20210146531
    Abstract: A robot is controlled using a combination of model-based and model-free control methods. In some examples, the model-based method uses a physical model of the environment around the robot to guide the robot. The physical model is oriented using a perception system such as a camera. Characteristics of the perception system may be are used to determine an uncertainty for the model. Based at least in part on this uncertainty, the system transitions from the model-based method to a model-free method where, in some embodiments, information provided directly from the perception system is used to direct the robot without reliance on the physical model.
    Type: Application
    Filed: February 3, 2020
    Publication date: May 20, 2021
    Inventors: Jonathan Tremblay, Dieter Fox, Michelle Lee, Carlos Florensa, Nathan Donald Ratliff, Animesh Garg, Fabio Tozeto Ramos
  • Publication number: 20210081752
    Abstract: Apparatuses, systems, and techniques to identify a goal of a demonstration. In at least one embodiment, video data of a demonstration is analyzed to identify a goal. Object trajectories identified in the video data are analyzed with respect to a task predicate satisfied by a respective object trajectory, and with respect to motion predicate. Analysis of the trajectory with respect to the motion predicate is used to assess intentionality of a trajectory with respect to the goal.
    Type: Application
    Filed: July 16, 2020
    Publication date: March 18, 2021
    Inventors: Yu-Wei Chao, De-An Huang, Christopher Jason Paxton, Animesh Garg, Dieter Fox
  • Publication number: 20210065052
    Abstract: One embodiment of a method includes determining, by a Bayesian optimizer, a first sparsity ratio associated with a limit on an accuracy loss caused by compressing the machine learning model. The method further includes selecting, by the Bayesian optimizer, a second sparsity ratio that optimizes a predefined objective function for the machine learning model within a search space bounded by the first sparsity ratio. The method further includes generating a compressed version of the machine learning model having the second sparsity ratio.
    Type: Application
    Filed: February 7, 2020
    Publication date: March 4, 2021
    Inventors: Saurav MURALIDHARAN, Vinu JOSEPH, Animesh GARG, Michael GARLAND
  • Publication number: 20210064925
    Abstract: Apparatuses, systems, and techniques to enhance video are disclosed. In at least one embodiment, one or more neural networks are used to create, from a first video, a second video having one or more additional video frames.
    Type: Application
    Filed: September 3, 2019
    Publication date: March 4, 2021
    Inventors: Kevin Shih, Aysegul Dundar, Animesh Garg, Robert Pottorff, Andrew Tao, Bryan Catanzaro
  • Patent number: 10286197
    Abstract: The present invention offers an alternative for cancer treatment where radiation, thermotherapy, or another therapeutic modality must be delivered to an internal cavity of a subject, for example to treat mouth, anal, cervical, and vaginal cancers. The invention is a new approach that builds on recent results in 3D printing and steerable needle motion planning to create customized implants containing customized curvature-constrained internal channels that fit securely, minimize air gaps, and precisely guide treatment sources through internal printed channels to accurately reach tumors and minimize damage to healthy tissue.
    Type: Grant
    Filed: July 28, 2014
    Date of Patent: May 14, 2019
    Assignee: THE REGENTS OF THE UNIVERSITY OF CALIFORNIA
    Inventors: Jean Pouliot, Ken Goldberg, I-Chow Hsu, J. Adam M. Cunha, Animesh Garg, Sachin Patil, Pieter Abbeel, Timmy Siauw
  • Publication number: 20180177558
    Abstract: According to some embodiments of the invention, a surgical robot includes a robot arm having an end effector, the end effector comprising a needle assembly. The surgical robot further includes a robot control system operatively connected to the robot arm, and an end effector control system operatively connected to the end effector. The robot control system provides control signals for operation of the robot arm to move the end effector to selected positions relative to a subject. The end effector control system is configured to provide signals for operation of the end effector to at least one of inject material through the needle assembly to a selected location within the subject's body or extract material through the needle assembly from the selected location within the subject's body.
    Type: Application
    Filed: June 23, 2016
    Publication date: June 28, 2018
    Applicant: The Regents of the University of California
    Inventors: Stephen McKinley, Animesh Garg, Sachin Patil, Susan M. L. Lim, Ken Goldberg
  • Publication number: 20160271379
    Abstract: The present invention offers an alternative for cancer treatment where radiation, thermotherapy, or another therapeutic modality must be delivered to an internal cavity of a subject, for example to treat mouth, anal, cervical, and vaginal cancers. The invention is a new approach that builds on recent results in 3D printing and steerable needle motion planning to create customized implants containing customized curvature-constrained internal channels that fit securely, minimize air gaps, and precisely guide treatment sources through internal printed channels to accurately reach tumors and minimize damage to healthy tissue.
    Type: Application
    Filed: July 28, 2014
    Publication date: September 22, 2016
    Inventors: Jean POULIOT, Ken GOLDBERG, I-Chow HSU, J. Adam M. CHNHA, Animesh GARG, Sachin PATEL, Pieter ABBEEL, Timmy SIAUW