Abstract: Systems and methods for path planning with latent state inference and spatial-temporal relationships are provided. A system includes an inference module, a policy module, a graphical representation module, and a planning module. The inference module receives sensor data associated with a plurality of agents. The inference module also maps the sensor data to a latent state distribution to identify latent states of the plurality of agents. The latent states identify agents of the plurality of agents as cooperative or aggressive. The policy module predicts future trajectories of the plurality of agents at a given time based on sensor data and the latent states of the plurality of agents. The graphical representation module generates a graphical representation based on the sensor data and a graphical representation neural network. The planning module generates a motion plan for the ego agent based on the predicted future trajectories and the graphical representation.

Abstract: A method for generating operable driving areas for an autonomous driving vehicle based on a path trajectory of the autonomous driving vehicle is provided. The method may form a space time (ST) graph indicating a distance of travel along the path trajectory with respect to time of the autonomous driving vehicle and path trajectories of devices intersecting with the path trajectory of the autonomous driving vehicle. The method may segment the ST graph into cells, wherein viable cells represent discretized viable unoccupied spaces in the ST graph. The method may find passage ways for the autonomous driving vehicle based on the viable cells. The method may select a desired passage way using quadratic programming (QP) optimization when multiple passage ways are found.

Abstract: A vehicle includes a ranged sensor that generates time-series data indicating positions of objects in an environment surrounding the vehicle, a user interface configured to warn the driver of a predicted collision between the vehicle and one of the objects in the environment, and at least one processor including an ECU operatively connected to the ranged sensor and the user interface. The processor records control inputs by the driver driving the vehicle, and develops a driver behavior model associated with the driver driving the vehicle based on the control inputs. The processor also predicts trajectories of the objects and the vehicle based on the time-series data and the driver behavior model, and predicts a collision between the vehicle and one of the objects based on the predicted trajectories. The processor also generates a warning indicating the predicted collision to the driver.

Abstract: A vehicle access control system for predicting a user's intent to enter a vehicle is achieved through an analysis of video data captured by a plurality of external cameras mounted on the vehicle. The plurality of cameras capture the video data as the user approaches the vehicle. The system includes a processor with an intent prediction module. A memory stores instructions which, when executed by the processor, enable the processor to analyze visual cues of the user from the video data, including body posture, gaze direction, and proximity to the vehicle. Furthermore, the processor extracts user data including a trajectory, head orientation, and body orientation of the user from the video data. The intent prediction module, using the user data, predicts the intent of the user to enter the vehicle and triggers a corresponding vehicle entry action.

Abstract: A vehicle access control system for predicting a user's intent to enter a vehicle is achieved through an analysis of video data captured by a plurality of external cameras mounted on the vehicle. The plurality of cameras capture the video data as the user approaches the vehicle. The system includes a processor with an intent prediction module. A memory stores instructions which, when executed by the processor, enable the processor to analyze visual cues of the user from the video data, including body posture, gaze direction, and proximity to the vehicle. Furthermore, the processor extracts user data including a trajectory, head orientation, and body orientation of the user from the video data. The intent prediction module, using the user data, predicts the intent of the user to enter the vehicle and triggers a corresponding vehicle entry action.

Abstract: A method for generating operable driving areas for an autonomous driving vehicle based on a path trajectory of the autonomous driving vehicle is provided. The method may form a space time (ST) graph indicating a distance of travel along the path trajectory with respect to time of the autonomous driving vehicle and path trajectories of devices intersecting with the path trajectory of the autonomous driving vehicle. The method may segment the ST graph into cells, wherein viable cells represent discretized viable unoccupied spaces in the ST graph. The method may find passage ways for the autonomous driving vehicle based on the viable cells. The method may select a desired passage way using quadratic programming (QP) optimization when multiple passage ways are found.

Abstract: A method for generating operable driving areas for an autonomous driving vehicle based on a path trajectory of the autonomous driving vehicle is provided. The method may form a space time (ST) graph indicating a distance of travel along the path trajectory with respect to time of the autonomous driving vehicle and path trajectories of devices intersecting with the path trajectory of the autonomous driving vehicle, wherein the path trajectory of each device is based on current and historical data for each device. The method may segment the ST graph into cells, wherein viable cells represent discretized viable unoccupied spaces in the ST graph. The method may find passage ways for the autonomous driving vehicle based on the viable cells. The method may select a desired passage way using quadratic programming (QP) optimization when multiple passage ways are found.

Abstract: A method for generating operable driving areas for an autonomous driving vehicle based on a path trajectory of the autonomous driving vehicle is provided. The method may form a space time (ST) graph indicating a distance of travel along the path trajectory with respect to time of the autonomous driving vehicle and path trajectories of devices intersecting with the path trajectory of the autonomous driving vehicle. The method may segment the ST graph into cells, wherein viable cells represent discretized viable unoccupied spaces in the ST graph. The method may find passage ways for the autonomous driving vehicle based on the viable cells. The method may select a desired passage way using quadratic programming (QP) optimization when multiple passage ways are found.

Abstract: A method for generating operable driving areas for an autonomous driving vehicle based on a path trajectory of the autonomous driving vehicle is provided. The method may form a space time (ST) graph indicating a distance of travel along the path trajectory with respect to time of the autonomous driving vehicle and path trajectories of devices intersecting with the path trajectory of the autonomous driving vehicle. The method may segment the ST graph into cells, wherein viable cells represent discretized viable unoccupied spaces in the ST graph. The method may find passage ways for the autonomous driving vehicle based on the viable cells. The method may select a desired passage way using quadratic programming (QP) optimization when multiple passage ways are found. The QP optimization may use hard and soft constraints to select the desired passage way to minimize time travel and undesirable movement of the autonomous driving vehicle.

Abstract: A method for generating operable driving areas for an autonomous driving vehicle based on a path trajectory of the autonomous driving vehicle is provided. The method may form a space time (ST) graph indicating a distance of travel along the path trajectory with respect to time of the autonomous driving vehicle and path trajectories of devices intersecting with the path trajectory of the autonomous driving vehicle. The method may segment the ST graph into cells, wherein viable cells represent discretized viable unoccupied spaces in the ST graph, and wherein each cell is defined at each time segment on the ST graph by minimum smin and maximum smax bounds in distance. The method may find passage ways for the autonomous driving vehicle based on the viable cells. The method may generate a lower bound and an upper bound for each passage way. The method may select a desired passage way using quadratic programming (QP) optimization when multiple passage ways are found.

Abstract: A method for generating operable driving areas for an autonomous driving vehicle based on a path trajectory of the autonomous driving vehicle is provided. The method may form a space time (ST) graph indicating a distance of travel along the path trajectory with respect to time of the autonomous driving vehicle and path trajectories of devices intersecting with the path trajectory of the autonomous driving vehicle, wherein the path trajectory of each device is based on current and historical data for each device. The method may segment the ST graph into cells, wherein viable cells represent discretized viable unoccupied spaces in the ST graph. The method may find passage ways for the autonomous driving vehicle based on the viable cells. The method may select a desired passage way using quadratic programming (QP) optimization when multiple passage ways are found.

Abstract: A vehicle includes a ranged sensor that generates time-series data indicating positions of objects in an environment surrounding the vehicle, a user interface configured to warn the driver of a predicted collision between the vehicle and one of the objects in the environment, and at least one processor including an ECU operatively connected to the ranged sensor and the user interface. The processor records control inputs by the driver driving the vehicle, and develops a driver behavior model associated with the driver driving the vehicle based on the control inputs. The processor also predicts trajectories of the objects and the vehicle based on the time-series data and the driver behavior model, and predicts a collision between the vehicle and one of the objects based on the predicted trajectories. The processor also generates a warning indicating the predicted collision to the driver.

Abstract: According to one aspect, causal graph chain reasoning predictions may be implemented by generating a causal graph of one or more participants within an operating environment including an ego-vehicle, one or more agents, and one or more potential obstacles, generating a prediction for each participant within the operating environment based on the causal graph, and generating an action for the ego-vehicle based on the prediction for each participant within the operating environment. Nodes of the causal graph may represent the ego-vehicle or one or more of the agents. Edges of the causal graph may represent a causal relationship between two nodes of the causal graph. The causal relationship may be a leader-follower relationship, a trajectory-dependency relationship, or a collision relationship.

Abstract: Navigation based on internal state inference and interactivity estimation may include training a policy for autonomous navigation by extracting spatio-temporal features from one or more historical observations of one or more agents within a simulation environment including an ego-agent, analyzing the spatio-temporal features to infer one or more internal states of one or more of the agents, predicting one or more future behaviors for one or more of the one or more of the agents in a first scenario including an existence of the ego-agent within the simulation environment and in a second scenario excluding the existence of the ego-agent within the simulation environment, and calculating one or more interactivity scores for one or more of the agents based on a difference between the first scenario and the second scenario. The trained policy may be implemented to control an autonomous vehicle.

Abstract: Systems and methods for path planning with latent state inference and spatial-temporal relationships are provided. A system includes an inference module, a policy module, a graphical representation module, and a planning module. The inference module receives sensor data associated with a plurality of agents. The inference module also maps the sensor data to a latent state distribution to identify latent states of the plurality of agents. The latent states identify agents of the plurality of agents as cooperative or aggressive. The policy module predicts future trajectories of the plurality of agents at a given time based on sensor data and the latent states of the plurality of agents. The graphical representation module generates a graphical representation based on the sensor data and a graphical representation neural network. The planning module generates a motion plan for the ego agent based on the predicted future trajectories and the graphical representation.

Abstract: Systems and methods for path planning with latent state inference and spatial-temporal relationships are provided. In one embodiment, a system includes an inference module, a policy module, a graphical representation module, and a planning module. The inference module receives sensor data associated with a plurality of agents. The inference module maps the sensor data to a latent state distribution to identify latent states of the plurality of agents. The latent states identify agents as cooperative or aggressive. The policy module predicts future trajectories of the plurality of agents at a given time based on sensor data and the latent states of the plurality of agents. The graphical representation module generates a graphical representation based on the sensor data and a graphical representation neural network. The planning module generates a motion plan for the ego agent based on the predicted future trajectories and the graphical representation.

Abstract: According to one aspect, systems and techniques for lane selection may include receiving a current state of an ego vehicle and a traffic participant vehicle, and a goal position, projecting the ego vehicle and the traffic participant vehicle onto a graph network, where nodes of the graph network may be indicative of discretized space within an operating environment, determining a current node for the ego vehicle within the graph network, and determining a subsequent node for the ego vehicle based on identifying adjacent nodes which may be adjacent to the current node, calculating travel times associated with each of the adjacent nodes, calculating step costs associated with each of the adjacent nodes, calculating heuristic costs associated with each of the adjacent nodes, and predicting a position of the traffic participant vehicle.

Abstract: A system and method for multi-agent reinforcement learning in a multi-agent environment that include receiving data associated with the multi-agent environment in which an ego agent and a target agent are traveling. The system and method also include learning single agent policies that are respectively associated with the ego agent and the target agent based on the data associated with the multi-agent environment. The system and method additionally include learning a multi-agent policy as an interactive policy that enables the ego agent and the target agent to account for one another while traveling to respective goals within the multi-agent environment based on the single agent policies. The system and method further include implementing the multi-agent policy to control at least one of: the ego agent and the target agent to operate within the multi-agent environment.

Abstract: According to one aspect, systems and techniques for lane selection may include receiving a current state of an ego vehicle and a traffic participant vehicle, and a goal position, projecting the ego vehicle and the traffic participant vehicle onto a graph network, where nodes of the graph network may be indicative of discretized space within an operating environment, determining a current node for the ego vehicle within the graph network, and determining a subsequent node for the ego vehicle based on identifying adjacent nodes which may be adjacent to the current node, calculating travel times associated with each of the adjacent nodes, calculating step costs associated with each of the adjacent nodes, calculating heuristic costs associated with each of the adjacent nodes, and predicting a position of the traffic participant vehicle.

Abstract: A system and method for multi-agent reinforcement learning with periodic parameter sharing that include inputting at least one occupancy grid to a convolutional neural network (CNN) and at least one vehicle dynamic parameter into a first fully connected layer and concatenating outputs of the CNN and the first fully connected layer. The system and method also include providing Q value estimates for agent actions based on processing of the concatenated outputs and choosing at least one autonomous action to be executed by at least one of: an ego agent and a target agent. The system and method further include processing a multi-agent policy that accounts for operation of the ego agent and the target agent with respect to one another within a multi-agent environment based on the at least one autonomous action to be executed by at least one of: the ego agent and the target agent.