Abstract: A method for automated root cause analysis via one or more structured data sources and one or more unstructured data sources includes identifying an error in a process or an environment. The method also includes searching the one or more unstructured data sources via a retrieval-augmented generation (RAG) component based on an error description corresponding to the identified error. The method further includes generating, via the RAG component, a hypothesis for the error in accordance with searching the one or more unstructured data sources. The method also includes searching the one or more structured data sources based on one or more queries generated via a text-to-SQL component in accordance with the hypothesis. The method still further includes autonomously adjusting one or more parameters of one or more devices associated with the process or the environment in accordance with searching the one or more structured data sources.

Abstract: A computer-implemented method is disclosed for determining optimal operational parameters for a model predictive controller (MPC) for vehicle control. The method includes training a machine learning model by simulating vehicle operations across a range of operational parameters using an MPC framework. The simulation identifies ranges of parameters that recover the vehicle from unstable states, with the bounds corresponding to the vehicle's performance envelope. The method comprises determining an optimum value for a vehicle parameter based on the simulation output, updating training data accordingly, and revising the vehicle's control system using the optimum value to control the operation of an actuator for a particular maneuver. The system may update the parameter set in response to changing vehicle or environmental conditions and supports both autonomous and human-in-the-loop operation.

Abstract: A computer implemented method for determining optimal values for operational parameters for a model predictive controller for controlling a vehicle can receive from a data store or a graphical user interface, ranges for one or more operational parameters. The computer implemented method can determine optimum values for vehicle parameters of the vehicle of one or more other parameters by simulating a vehicle operation across the ranges of the one or more operational parameters by solving a vehicle control problem and determining an output of the vehicle control problem based on a result for the simulated vehicle operation. A vehicle can include a processing component configured to adjust a control input for an actuator of the vehicle according to a control algorithm and based on the optimum values of a parameter as determined by the computer implemented method.

Abstract: A method for collaborative knowledge management pruning is described. The method includes feeding, in response to a user search request, retrieved articles from an enterprise knowledge database to a large language model (LLM). The method also includes performing, by the LLM, a hierarchical search-based comparison of the retrieved articles to provide an LLM-based identification of out-of-date articles. The method further includes flagging out-of-date articles for user review. The method also includes removing, in response to the user, identified out-of-date articles from the enterprise knowledge database.

Abstract: A computer implemented method for determining optimal values for controls parameters for a model predictive controller for controlling a vehicle can receive from a data store or a graphical user interface, ranges for one or more operational parameters. The computer implemented method can determine optimum values for controls parameters by simulating a vehicle operation across the ranges of the one or more operational parameters by solving a vehicle control problem and determining an output of the vehicle control problem based on a result for the simulated vehicle operation. A vehicle can include a processing component configured to adjust a control input for an actuator of the vehicle according to a control algorithm and based on the optimum values of the controls parameter as determined by the computer implemented method.

Abstract: A method for semantic keypoint detection is described. The method includes linking, using a keypoint graph neural network (KGNN), semantic keypoints of an object within a first image of a video stream into a 2D graph structure corresponding to a category of the object. The method also includes embedding descriptors within the semantic keypoints of the 2D graph structure corresponding to the category of the object. The method further includes tracking the object within subsequent images of the video stream using the embedded descriptors within the semantic keypoints of the 2D graph structure corresponding to the category of the object.

Abstract: A computer implemented method for determining optimal values for operational parameters for a model predictive controller for controlling a vehicle, can receive from a data store or a graphical user interface, ranges for one or more external parameters. The computer implemented method can determine optimum values for external parameters of the vehicle by simulating a vehicle operation across the ranges of the one or more operational parameters by solving a vehicle control problem and determining an output of the vehicle control problem based on a result for the simulated vehicle operation. A vehicle can include a processing component configured to adjust a control input for an actuator of the vehicle according to a control algorithm and based on the optimum values of the vehicle parameter as determined by the computer implemented method.

Abstract: A computer implemented method for determining optimal values for controls parameters for a model predictive controller for controlling a vehicle can receive from a data store or a graphical user interface, ranges for one or more operational parameters. The computer implemented method can determine optimum values for controls parameters by simulating a vehicle operation across the ranges of the one or more operational parameters by solving a vehicle control problem and determining an output of the vehicle control problem based on a result for the simulated vehicle operation. A vehicle can include a processing component configured to adjust a control input for an actuator of the vehicle according to a control algorithm and based on the optimum values of the controls parameter as determined by the computer implemented method.

Abstract: Systems, methods, computer-readable media, techniques, and methodologies are disclosed for performing end-to-end, learning-based keypoint detection and association. A scene graph of a signalized intersection is constructed from an input image of the intersection. The scene graph includes detected keypoints and linkages identified between the keypoints. The scene graph can be used along with a vehicle's localization information to identify which keypoint that represents a traffic signal is associated with the vehicle's current travel lane. An appropriate vehicle action may then be determined based on a transition state of the traffic signal keypoint and trajectory information for the vehicle. A control signal indicative of this vehicle action may then be output to cause an autonomous vehicle, for example, to implement the appropriate vehicle action.

Abstract: A method for vehicle prediction, planning, and control is described. The method includes separately encoding traffic state information at an intersection into corresponding traffic state latent spaces. The method also includes aggregating the corresponding traffic state latent spaces to form a generalized traffic geometry latent space. The method further includes interpreting the generalized traffic geometry latent space to form a traffic flow map including current and future vehicle trajectories. The method also includes decoding the generalized traffic geometry latent space to predict a vehicle behavior according to the traffic flow map based on the current and future vehicle trajectories.

Abstract: A computer implemented method for determining optimal values for operational parameters for a model predictive controller for controlling a vehicle, can receive from a data store or a graphical user interface, ranges for one or more external parameters. The computer implemented method can determine optimum values for external parameters of the vehicle by simulating a vehicle operation across the ranges of the one or more operational parameters by solving a vehicle control problem and determining an output of the vehicle control problem based on a result for the simulated vehicle operation. A vehicle can include a processing component configured to adjust a control input for an actuator of the vehicle according to a control algorithm and based on the optimum values of the vehicle parameter as determined by the computer implemented method.

Abstract: Systems, methods, and other embodiments described herein relate to a multi-task model that integrates recurrent models to improve handling of multi-sweep inputs. In one embodiment, a method includes acquiring sensor data from multiple modalities. The method includes separately encoding respective segments of the sensor data according to an associated one of the different modalities to form encoded features using separate encoders of a network. The method includes accumulating, in a detector, sparse features associated with sparse sensor inputs of the multiple modalities to densify the sparse features into dense features. The method includes providing observations according to the encoded features and the sparse features using the network.

Abstract: A method for 2D semantic keypoint detection and tracking is described. The method includes learning embedded descriptors of salient object keypoints detected in previous images according to a descriptor embedding space model. The method also includes predicting, using a shared image encoder backbone, salient object keypoints within a current image of a video stream. The method further includes inferring an object represented by the predicted, salient object keypoints within the current image of the video stream. The method also includes tracking the inferred object by matching embedded descriptors of the predicted, salient object keypoints representing the inferred object within the previous images of the video stream based on the descriptor embedding space model.

Abstract: A method for controlling an ego vehicle in an environment includes detecting one or more changes in a position of an agent vehicle over time in accordance with capturing at least a first representation of the environment and a second representation of the environment via one or more sensors associated with the ego vehicle. The method also includes determining a velocity of the object based on detecting the one or more changes. The method further includes classifying the agent vehicle as parked based on the velocity and contextual data associated with the agent vehicle and/or the environment. The method still further includes planning a trajectory for the ego vehicle based on classifying the agent vehicle as parked. The method also includes controlling the ego vehicle to navigate along the trajectory.

Abstract: A method for controlling an ego vehicle in an environment includes associating, by a velocity model, one or more objects within the environment with a respective velocity instance label. The method also includes selectively, by a recurrent network of the taillight recognition system, focusing on a selected region of the sequence of images according to a spatial attention model for a vehicle taillight recognition task. The method further includes concatenating the selected region with the respective velocity instance label of each object of the one or more objects within the environment to generate a concatenated region label. The method still further planning a trajectory of the ego vehicle based on inferring, at a classifier of the taillight recognition system, an intent of each object of the one or more objects according to a respective taillight state of each object, as determined based on the concatenated region label.

Abstract: A method for 2D semantic keypoint detection and tracking is described. The method includes learning embedded descriptors of salient object keypoints detected in previous images according to a descriptor embedding space model. The method also includes predicting, using a shared image encoder backbone, salient object keypoints within a current image of a video stream. The method further includes inferring an object represented by the predicted, salient object keypoints within the current image of the video stream. The method also includes tracking the inferred object by matching embedded descriptors of the predicted, salient object keypoints representing the inferred object within the previous images of the video stream based on the descriptor embedding space model.

Abstract: A method controlling an ego vehicle in an environment includes determining, via a flow model of a parked vehicle recognition system, a flow between a first representation of the environment and a second representation of the environment. The method also includes determining, via a velocity model of the parked vehicle recognition system, a velocity of a vehicle in the environment based on the flow. The method further includes determining, via a parked vehicle classification model of the parked vehicle recognition system, the vehicle is parked based on the velocity of the vehicle and one or more of features associated with the vehicle and/or the environment. The method still further includes planning a trajectory of the ego vehicle based on determining the vehicle is parked.

Abstract: A method for generating a dense light detection and ranging (LiDAR) representation by a vision system of a vehicle includes generating, at a depth estimation network, a depth estimate of an environment depicted in an image captured by an image capturing sensor integrated with the vehicle. The method also includes generating, via a sparse depth network, one or more sparse depth estimates of the environment, each sparse depth estimate associated with a respective sparse representation of one or more sparse representations. The method further includes generating the dense LiDAR representation based on a dense depth estimate that is generated based on the depth estimate and the one or more sparse depth estimates. The method still further includes controlling an action of the vehicle based on the dense LiDAR representation.

Abstract: A method for generating a dense light detection and ranging (LiDAR) representation by a vision system includes receiving, at a sparse depth network, one or more sparse representations of an environment. The method also includes generating a depth estimate of the environment depicted in an image captured by an image capturing sensor. The method further includes generating, via the sparse depth network, one or more sparse depth estimates based on receiving the one or more sparse representations. The method also includes fusing the depth estimate and the one or more sparse depth estimates to generate a dense depth estimate. The method further includes generating the dense LiDAR representation based on the dense depth estimate and controlling an action of the vehicle based on identifying a three-dimensional object in the dense LiDAR representation.

Abstract: Datasets for autonomous driving systems and multi-modal scenes may be automatically labeled using previously trained models as priors to mitigate the limitations of conventional manual data labeling. Properly versioned models, including model weights and knowledge of the dataset on which the model was previously trained, may be used to run an inference operation on unlabeled data, thus automatically labeling the dataset. The newly labeled dataset may then be used to train new models, including sparse data sets, in a semi-supervised or weakly-supervised fashion.