Abstract: Human-in-the-loop automation training using artificial intelligence (AI) for agentic automation is disclosed. This may be accomplished by a listener watching interactions of a user or an AI agent with a computing system. Based on the interactions by the user or the AI agent with the computing system, the automation may be improved and/or personalized for the user or a group of users.

Abstract: Use of generative artificial intelligence (AI)/machine learning (ML) models is disclosed to determine sequences of user interactions with computing systems, extract common processes, and generate robotic process automation (RPA) robots. The generative AI/ML model may be trained to recognize matching n-grams of user interactions and/or a beneficial end state. Recorded real user interactions may be analyzed, and matching sequences may be implemented as corresponding activities in an RPA workflow.

Abstract: Use of generative artificial intelligence (AI)/machine learning (ML) models is disclosed to determine sequences of user interactions with computing systems, extract common processes, and generate robotic process automation (RPA) robots. The generative AI/ML model may be trained to recognize matching n-grams of user interactions and/or a beneficial end state. Recorded real user interactions may be analyzed, and matching sequences may be implemented as corresponding activities in an RPA workflow.

Abstract: Probabilistic models may be used in a deterministic workflow for an automation. Artificial intelligence (AI) introduces a probabilistic framework where the outcome is not deterministic, and therefore, the steps are not deterministic. Deterministic workflows may be mixed with probabilistic workflows, or probabilistic activities may be inserted into deterministic workflows, in order to create more dynamic workflows. A supervisor system may be used to monitor an AI model and raise an alarm, disable an automation, bypass the automation, or roll back to a previous version of the AI model when an error is detected by a data drift detector, a concept drift detector, or both.

Abstract: Techniques for recognizing applications, screens, and UI elements and for recognizing user interactions and/or AI agent interactions with the applications, screens, and UI elements using agentic artificial intelligence (AI) are disclosed. An AI model may facilitate such recognition without other system inputs, such as system-level information (e.g., key presses, mouse clicks, locations, operating system operations, etc.) or application-level information (e.g., information from an application programming interface (API) from a software application executing on a computing system).

Abstract: Automatic activation and configuration of robotic process automation (RPA) workflows using machine learning (ML) is disclosed. One or more parts of an RPA workflow may be turned on or off based on one or more probabilistic ML models. RPA robots may be configured to modify parameters, determine how much of a certain resource to provide, determine more optimal thresholds, etc. Such RPA workflows implementing ML may thus be hybrids of both deterministic and probabilistic logic, and may learn and improve over time by retraining the ML models, adjusting the confidence thresholds, using local/global confidence thresholds, providing or adjusting modifiers for the local confidence thresholds, implement a supervisor system that monitors ML model performance, etc.

Abstract: Techniques for training a generative artificial intelligence (AI)/machine learning (ML) model to recognize applications, screens, and UI elements using computer vision (CV) and to recognize user interactions with the applications, screens, and UI elements are disclosed. Optical character recognition (OCR) may also be used to assist in training the generative AI/ML model. Training of the generative AI/ML model may be performed without other system inputs such as system-level information (e.g., key presses, mouse clicks, locations, operating system operations, etc.) or application-level information (e.g., information from an application programming interface (API) from a software application executing on a computing system), or the training of the generative AI/ML model may be supplemented by other information, such as browser history, heat maps, file information, currently running applications and locations, system level and/or application-level information, etc.

Abstract: Automatic activation and configuration of robotic process automation (RPA) workflows using machine learning (ML) is disclosed. One or more parts of an RPA workflow may be turned on or off based on one or more probabilistic ML models. RPA robots may be configured to modify parameters, determine how much of a certain resource to provide, determine more optimal thresholds, etc. Such RPA workflows implementing ML may thus be hybrids of both deterministic and probabilistic logic, and may learn and improve over time by retraining the ML models, adjusting the confidence thresholds, using local/global confidence thresholds, providing or adjusting modifiers for the local confidence thresholds, implement a supervisor system that monitors ML model performance, etc.

Abstract: Probabilistic models may be used in a deterministic workflow for robotic process automation (RPA). Machine learning (ML) introduces a probabilistic framework where the outcome is not deterministic, and therefore, the steps are not deterministic. Deterministic workflows may be mixed with probabilistic workflows, or probabilistic activities may be inserted into deterministic workflows, in order to create more dynamic workflows. A supervisor system may be used to monitor an ML model and raise an alarm, disable an RPA robot, bypass an RPA robot, or roll back to a previous version of the ML model when an error is detected by a data drift detector, a concept drift detector, or both.

Abstract: Artificial intelligence (AI)-based process identification, extraction, and automation for robotic process automation (RPA) is disclosed. Listeners may be deployed to user computing systems to collect data pertaining to user actions. The data collected by the listeners may then be sent to one or more servers and be stored in a database. This data may be analyzed by AI layers to recognize patterns of user behavioral processes therein. These recognized processes may then be distilled into respective RPA workflows and deployed to automate the processes.

Abstract: Human-in-the-loop robot training using artificial intelligence (AI) for robotic process automation (RPA) is disclosed. This may be accomplished by a listener robot watching interactions of a user or another robot with a computing system. Based on the interactions by the user or robot with the computing system, the robot may be improved and/or personalized for the user or a group of users.

Abstract: Artificial intelligence (AI)/machine learning (ML) model drift detection and correction for robotic process automation (RPA) is disclosed. Information is analyzed pertaining to input data for an AI/ML model to determine whether data drift has occurred, analyze information pertaining to results from execution of the AI/ML model to determine whether model drift has occurred, or both. When, based on the analysis of the information, a change condition is found, a change threshold is met or exceeded, or both, the AI/ML model is retrained. The retrained AI/ML model may then be deployed to provide better predictions on real world data.

Abstract: A machine learning (ML) model retraining pipeline for robotic process automation (RPA) is disclosed. When an ML model is deployed in a production or development environment, RPA robots send requests to the ML model when executing their workflows. When a confidence level of the ML model falls below a certain confidence, training data is collected, potentially from a large number of computing systems. The ML model is then trained using at least in part the collected training data, and a new version of the ML model is deployed.

Abstract: Process evolution for robotic process automation (RPA) and RPA workflow micro-optimization are disclosed. Initially, an RPA implementation may be scientifically planned, potentially using artificial intelligence (AI). Embedded analytics may be used to measure, report, and align RPA operations with strategic business outcomes. RPA may then be implemented by deploying AI skills (e.g., in the form of machine learning (ML) models) through an AI fabric that seamlessly applies, scales, manages AI for RPA workflows of robots. This cycle of planning, measuring, and reporting may be repeated, potentially guided by more and more AI, to iteratively improve the effectiveness of RPA for a business. RPA implementations may also be identified and implemented based on their estimated return on investment (ROI).

Abstract: Human-in-the-loop robot training using artificial intelligence (AI) for robotic process automation (RPA) is disclosed. This may be accomplished by a listener robot watching interactions of a user or another robot with a computing system. Based on the interactions by the user or robot with the computing system, the robot may be improved and/or personalized for the user or a group of users.

Abstract: Artificial intelligence (AI) layer-based process extraction for robotic process automation (RPA) is disclosed. Data collected by RPA robots and/or other sources may be analyzed to identify patterns that can be used to suggest or automatically generate RPA workflows. These AI layers may be used to recognize patterns of user or business system processes contained therein. Each AI layer may “sense” different characteristics in the data and be used individually or in concert with other AI layers to suggest RPA workflows.

Abstract: Process evolution for robotic process automation (RPA) and RPA workflow micro-optimization are disclosed. Initially, an RPA implementation may be scientifically planned, potentially using artificial intelligence (AI). Embedded analytics may be used to measure, report, and align RPA operations with strategic business outcomes. RPA may then be implemented by deploying AI skills (e.g., in the form of machine learning (ML) models) through an AI fabric that seamlessly applies, scales, manages AI for RPA workflows of robots. This cycle of planning, measuring, and reporting may be repeated, potentially guided by more and more AI, to iteratively improve the effectiveness of RPA for a business. RPA implementations may also be identified and implemented based on their estimated return on investment (ROI).

Abstract: Human-in-the-loop robot training using artificial intelligence (AI) for robotic process automation (RPA) is disclosed. This may be accomplished by a listener robot watching interactions of a user or another robot with a computing system. Based on the interactions by the user or robot with the computing system, the robot may be improved and/or personalized for the user or a group of users.

Abstract: Artificial intelligence (AI) layer-based process extraction for robotic process automation (RPA) is disclosed. Data collected by RPA robots and/or other sources may be analyzed to identify patterns that can be used to suggest or automatically generate RPA workflows. These AI layers may be used to recognize patterns of user or business system processes contained therein. Each AI layer may “sense” different characteristics in the data and be used individually or in concert with other AI layers to suggest RPA workflows.

Abstract: Process evolution for robotic process automation (RPA) and RPA workflow micro-optimization are disclosed. Initially, an RPA implementation may be scientifically planned, potentially using artificial intelligence (AI). Embedded analytics may be used to measure, report, and align RPA operations with strategic business outcomes. RPA may then be implemented by deploying AI skills (e.g., in the form of machine learning (ML) models) through an AI fabric that seamlessly applies, scales, manages AI for RPA workflows of robots. This cycle of planning, measuring, and reporting may be repeated, potentially guided by more and more AI, to iteratively improve the effectiveness of RPA for a business. RPA implementations may also be identified and implemented based on their estimated return on investment (ROI).