Patents by Inventor Milind Tambe

Milind Tambe has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 9931573
    Abstract: The following information may be read from a memory system: an identification of each of multiple moving targets that are each expected to move in accordance with a schedule of when and where the target will move; the schedule; an identification of each of multiple mobile defense resources that each have a maximum movement speed and a maximum protection radius; and the maximum movement speed and the maximum protection radius of each mobile defense resource. A computer system may determine where each mobile defense resource should be at each of a sequential set of different times so as to optimize the ability of the mobile defense resources to protect each of the mobile targets from a single attack by an attacker against one of the targets at an unknown time based on the information read from the memory system. The determining may take into consideration that the attacker may observe and analyze movements of the mobile defense resources prior to the attack in formulating the attack.
    Type: Grant
    Filed: February 10, 2014
    Date of Patent: April 3, 2018
    Assignee: UNIVERSITY OF SOUTHERN CALIFORNIA
    Inventors: Fei Fang, Albert Jiang, Milind Tambe
  • Publication number: 20160321563
    Abstract: An optimized artificial intelligence machine may: receive information indicative of the times, locations, and types of crimes that were committed over a period of time in a geographic area; receive information indicative of the number and locations of patrol agents that were patrolling during the period of time; build a learning model based on the received information that learns the relationships between the locations of the patrol agents and the crimes that were committed; and determine whether and where criminals would commit new crimes based on the learning model and a different number of patrol agents or locations of patrol agents.
    Type: Application
    Filed: May 2, 2016
    Publication date: November 3, 2016
    Applicant: UNIVERSITY OF SOUTHERN CALIFORNIA
    Inventors: Arunesh Sinha, Milind Tambe, Chao Zhang
  • Publication number: 20150273341
    Abstract: The following information may be read from a memory system: an identification of each of multiple moving targets that are each expected to move in accordance with a schedule of when and where the target will move; the schedule; an identification of each of multiple mobile defense resources that each have a maximum movement speed and a maximum protection radius; and the maximum movement speed and the maximum protection radius of each mobile defense resource. A computer system may determine where each mobile defense resource should be at each of a sequential set of different times so as to optimize the ability of the mobile defense resources to protect each of the mobile targets from a single attack by an attacker against one of the targets at an unknown time based on the information read from the memory system. The determining may take into consideration that the attacker may observe and analyze movements of the mobile defense resources prior to the attack in formulating the attack.
    Type: Application
    Filed: February 10, 2014
    Publication date: October 1, 2015
    Applicant: UNIVERSITY OF SOUTHERN CALIFORNIA
    Inventors: Fei Fang, Albert Jiang, Milind Tambe
  • Publication number: 20140279818
    Abstract: Game theory models may be used for producing a strategy and schedule for patrolling an area like a rail transportation system. In some instances, the model may account for events that cause a patrol unit to deviate from a patrol schedule and route. For example, a patrol schedule may be generated for one or more patrol units using a Bayesian Stackelberg game theory model based on a map of the public transportation system, a schedule of the transports, a list of the one or more patrolling units, a probability distribution for the occurrence of the passenger not paying to ride the transports, a list of the one or more possible events that would delay the patrol units, and a probability distribution for the occurrence of the one or more possible events that would delay the patrolling units represented by a Markov-decision process.
    Type: Application
    Filed: March 17, 2014
    Publication date: September 18, 2014
    Applicant: UNIVERSITY OF SOUTHERN CALIFORNIA
    Inventors: Albert Xin Jiang, Zhengyu Yin, Chao Zhang, Milind Tambe, Sarit Kraus
  • Publication number: 20140274246
    Abstract: A method and a system for resolving a two-player influencer blocking conflict are disclosed. The method and system may include to form a set of defender actions to increase a defender set of nodes; form a set of attacker actions; determine a defender strategy based the set of attacker actions, the defender strategy comprising a new defender action; to determine an attacker strategy that is based the set of defender actions; modify the set of defender actions to include the new defender action; update the set of attacker actions according to the attacker strategy; form a new set of attacker actions when the set of defender nodes increases more than a threshold; and form a display to show the defender set of nodes and the attacker set of nodes in a graph.
    Type: Application
    Filed: March 14, 2014
    Publication date: September 18, 2014
    Applicant: UNIVERSITY OF SOUTHERN CALIFORNIA
    Inventors: Jason Tsai, Thanh H. Nguyen, Milind Tambe
  • Publication number: 20130273514
    Abstract: Different solution methodologies for addressing problems or issues when directing security domain patrolling strategies according to attacker-defender Stackelberg security games. One type of solution provides for computing optimal strategy against quantal response in security games, and includes two algorithms, the GOSAQ and PASAQ algorithms. Another type of solution provides for a unified method for handling discrete and continuous uncertainty in Bayesian Stackelberg games, and introduces the HUNTER algorithm. Another solution type addresses multi-objective security games (MOSG), combining security games and multi-objective optimization. MOSGs have a set of Pareto optimal (non-dominated) solutions referred to herein as the Pareto frontier. The Pareto frontier can be generated by solving a sequence of constrained single-objective optimization problems (CSOP), where one objective is selected to be maximized while lower bounds are specified for the other objectives.
    Type: Application
    Filed: March 15, 2013
    Publication date: October 17, 2013
    Applicant: University of Southern California
    Inventors: Milind Tambe, Fernando Ordóñez, Rong Yang, Zhengyu Yin, Matthew Brown, Bo An, Christopher Kiekintveld
  • Patent number: 8364511
    Abstract: Efficient heuristic methods are described for approximating the optimal leader strategy for security domains where threats come from unknown adversaries. These problems can be modeled as Bayes-Stackelberg games. An embodiment of the heuristic method can include defining a patrolling or security domain problem as a mixed-integer quadratic program. The mixed-integer quadratic program can be converted to a mixed-integer linear program. For a single follower (e.g., robber or terrorist) scenario, the mixed-integer linear program can be solved, subject to appropriate constraints. For embodiments applicable to multiple follower situations, the relevant mixed-integer quadratic program and related mixed-integer linear program can be decomposed, e.g., by changing the response function for the follower from a pure strategy to a weighted combination over various pure follower strategies where the weights are probabilities of occurrence of each of the follower types.
    Type: Grant
    Filed: May 24, 2012
    Date of Patent: January 29, 2013
    Assignee: University of Southern California
    Inventors: Milind Tambe, Praveen Paruchuri, Fernando Ordóñez, Sarit Kraus, Jonathan Pearce, Janusz Marecki
  • Publication number: 20120330727
    Abstract: Efficient heuristic methods are described for approximating the optimal leader strategy for security domains where threats come from unknown adversaries. These problems can be modeled as Bayes-Stackelberg games. An embodiment of the heuristic method can include defining a patrolling or security domain problem as a mixed-integer quadratic program. The mixed-integer quadratic program can be converted to a mixed-integer linear program. For a single follower (e.g., robber or terrorist) scenario, the mixed-integer linear program can be solved, subject to appropriate constraints. For embodiments applicable to multiple follower situations, the relevant mixed-integer quadratic program and related mixed-integer linear program can be decomposed, e.g., by changing the response function for the follower from a pure strategy to a weighted combination over various pure follower strategies where the weights are probabilities of occurrence of each of the follower types.
    Type: Application
    Filed: May 24, 2012
    Publication date: December 27, 2012
    Applicant: UNIVERSITY OF SOUTHERN CALIFORNIA
    Inventors: Milind Tambe, Praveen Paruchuri, Fernando Ordóñez, Sarit Kraus, Jonathan Pearce, Janusz Marecki
  • Patent number: 8224681
    Abstract: Techniques are described for Stackelberg games, in which one agent (the leader) must commit to a strategy that can be observed by other agents (the followers or adversaries) before they choose their own strategies, in which the leader is uncertain about the types of adversaries it may face. Such games are important in security domains, where, for example, a security agent (leader) must commit to a strategy of patrolling certain areas, and robbers (followers) have a chance to observe this strategy over time before choosing their own strategies of where to attack. An efficient exact algorithm is described for finding the optimal strategy for the leader to commit to in these games. This algorithm, Decomposed Optimal Bayesian Stackelberg Solver or “DOBSS,” is based on a novel and compact mixed-integer linear programming formulation. The algorithm can be implemented in a method, software, and/or system including computer or processor functionality.
    Type: Grant
    Filed: October 17, 2008
    Date of Patent: July 17, 2012
    Assignee: University of Southern California
    Inventors: Milind Tambe, Praveen Paruchuri, Fernando Ordóñez, Sarit Kraus, Jonathan Pearce, Janusz Marecki
  • Patent number: 8195490
    Abstract: Efficient heuristic methods are described for approximating the optimal leader strategy for security domains where threats come from unknown adversaries. These problems can be modeled as Bayes-Stackelberg games. An embodiment of the heuristic method can include defining a patrolling or security domain problem as a mixed-integer quadratic program. The mixed-integer quadratic program can be converted to a mixed-integer linear program. For a single follower (e.g., robber or terrorist) scenario, the mixed-integer linear program can be solved, subject to appropriate constraints. For embodiments applicable to multiple follower situations, the relevant mixed-integer quadratic program and related mixed-integer linear program can be decomposed, e.g., by changing the response function for the follower from a pure strategy to a weighted combination over various pure follower strategies where the weights are probabilities of occurrence of each of the follower types.
    Type: Grant
    Filed: October 15, 2008
    Date of Patent: June 5, 2012
    Assignee: University of Southern California
    Inventors: Milind Tambe, Praveen Paruchuri, Fernando Ordóñez, Sarit Kraus, Jonathan Pearce, Janusz Marecki
  • Publication number: 20090119239
    Abstract: Efficient heuristic methods are described for approximating the optimal leader strategy for security domains where threats come from unknown adversaries. These problems can be modeled as Bayes-Stackelberg games. An embodiment of the heuristic method can include defining a patrolling or security domain problem as a mixed-integer quadratic program. The mixed-integer quadratic program can be converted to a mixed-integer linear program. For a single follower (e.g., robber or terrorist) scenario, the mixed-integer linear program can be solved, subject to appropriate constraints. For embodiments applicable to multiple follower situations, the relevant mixed-integer quadratic program and related mixed-integer linear program can be decomposed, e.g., by changing the response function for the follower from a pure strategy to a weighted combination over various pure follower strategies where the weights are probabilities of occurrence of each of the follower types.
    Type: Application
    Filed: October 15, 2008
    Publication date: May 7, 2009
    Applicant: UNIVERSITY OF SOUTHERN CALIFORNIA
    Inventors: Milind Tambe, Praveen Paruchuri, Fernando Ordonez, Sarit Kraus, Jonathan Pearce, Janusz Marecki
  • Publication number: 20090099987
    Abstract: Techniques are described for Stackelberg games, in which one agent (the leader) must commit to a strategy that can be observed by other agents (the followers or adversaries) before they choose their own strategies, in which the leader is uncertain about the types of adversaries it may face. Such games are important in security domains, where, for example, a security agent (leader) must commit to a strategy of patrolling certain areas, and robbers (followers) have a chance to observe this strategy over time before choosing their own strategies of where to attack. An efficient exact algorithm is described for finding the optimal strategy for the leader to commit to in these games. This algorithm, Decomposed Optimal Bayesian Stackelberg Solver or “DOBSS,” is based on a novel and compact mixed-integer linear programming formulation. The algorithm can be implemented in a method, software, and/or system including computer or processor functionality.
    Type: Application
    Filed: October 17, 2008
    Publication date: April 16, 2009
    Applicant: UNIVERSITY OF SOUTHERN CALIFORNIA
    Inventors: Milind Tambe, Praveen Paruchuri, Fernando Ordonez, Sarit Kraus, Jonathan Pearce, Janusz Marecki
  • Publication number: 20070156460
    Abstract: A system for coming up with policies of behavior for various agents engaged in a task. These policies consider costs and benefits of actions and outcomes, and uncertainties. The system utilizes limited neighborhoods of agents for expedited computing in large arrangements. Also sought are local and global optimums in terms of selecting policies.
    Type: Application
    Filed: December 29, 2005
    Publication date: July 5, 2007
    Inventors: Ranjit Nair, Milind Tambe, Pradeep Varakantham, Makoto Yokoo