Abstract: Techniques for training an artificial intelligence (AI)/machine learning (ML) model to recognize applications, screens, and UI elements using computer vision (CV) and to recognize user interactions with the applications, screens, and UI elements. Optical character recognition (OCR) may also be used to assist in training the AI/ML model. Training of the AI/ML model may be performed without other system inputs such as system-level information (e.g., key presses, mouse clicks, locations, operating system operations, etc.) or application-level information (e.g., information from an application programming interface (API) from a software application executing on a computing system), or the training of the AI/ML model may be supplemented by other information, such as browser history, heat maps, file information, currently running applications and locations, system level and/or application-level information, etc.

Abstract: Use of artificial intelligence (AI)/machine learning (ML) models is disclosed to determine sequences of user interactions with computing systems, extract common processes, and generate robotic process automation (RPA) robots. The AI/ML model may be trained to recognize matching n-grams of user interactions and/or a beneficial end state. Recorded real user interactions may be analyzed, and matching sequences may be implemented as corresponding activities in an RPA workflow.

Abstract: Human-in-the-loop robot training using artificial intelligence (AI) for robotic process automation (RPA) is disclosed. This may be accomplished by a listener robot watching interactions of a user or another robot with a computing system. Based on the interactions by the user or robot with the computing system, the robot may be improved and/or personalized for the user or a group of users.

Abstract: Artificial intelligence (AI)-based process identification, extraction, and automation for robotic process automation (RPA) is disclosed. Listeners may be deployed to user computing systems to collect data pertaining to user actions. The data collected by the listeners may then be sent to one or more servers and be stored in a database. This data may be analyzed by AI layers to recognize patterns of user behavioral processes therein. These recognized processes may then be distilled into respective RPA workflows and deployed to automate the processes.

Abstract: Artificial intelligence (AI)/machine learning (ML) model drift detection and correction for robotic process automation (RPA) is disclosed. Information is analyzed pertaining to input data for an AI/ML model to determine whether data drift has occurred, analyze information pertaining to results from execution of the AI/ML model to determine whether model drift has occurred, or both. When, based on the analysis of the information, a change condition is found, a change threshold is met or exceeded, or both, the AI/ML model is retrained. The retrained AI/ML model may then be deployed to provide better predictions on real world data.

Abstract: A processing unit can operate a first recurrent computational model (RCM) to provide first state information and a predicted result value. The processing unit can operating a first network computational model (NCM) to provide respective expectation values of a plurality of actions based at least in part on the first state information. The processing unit can provide an indication of at least one of the plurality of actions, and receive a reference result value, e.g., via a communications interface. The processing unit can train the first RCM based at least in part on the predicted result value and the reference result value to provide a second RCM, and can train the first NCM based at least in part on the first state information and the at least one of the plurality of actions to provide a second NCM.

Abstract: A machine learning (ML) model retraining pipeline for robotic process automation (RPA) is disclosed. When an ML model is deployed in a production or development environment, RPA robots send requests to the ML model when executing their workflows. When a confidence level of the ML model falls below a certain confidence, training data is collected, potentially from a large number of computing systems. The ML model is then trained using at least in part the collected training data, and a new version of the ML model is deployed.

Abstract: A document information extraction system determines a structure of an electronic document based on characteristics of the document's constituent elements. The system segments the document to generate elements with each element having similar characteristics. Elements may be clustered to assist in determining the document structure. The system determines directional relationships between elements (e.g., above, below, etc.). The system then employs a master comparator to determine familial relationships between adjacent elements. The master comparator includes a set of unit comparators and each unit comparator compares a specific characteristic between two elements. The master comparator sequentially applies the unit comparators to determine the familial relationship based on the comparisons. The system outputs a document hierarchy tree reflecting the determined familial relationships. The hierarchy tree represents the structure of the document.

Abstract: Using artificial intelligence (AI) to select and/or chain robotic process automation (RPA) models a given problem is disclosed. A model of models (e.g., an RPA robot or an ML model) may serve as an additional layer on an existing system that makes the existing models more effective. This model of models may incorporate AI that learns an improved or best set of rules or an order from existing models, potentially taking certain activities from a model, feeding input from one model into another, and/or chaining models in some embodiments.

Abstract: Probabilistic models may be used in a deterministic workflow for robotic process automation (RPA). Machine learning (ML) introduces a probabilistic framework where the outcome is not deterministic, and therefore, the steps are not deterministic. Deterministic workflows may be mixed with probabilistic workflows, or probabilistic activities may be inserted into deterministic workflows, in order to create more dynamic workflows. A supervisor system may be used to monitor an ML model and raise an alarm, disable an RPA robot, bypass an RPA robot, or roll back to a previous version of the ML model when an error is detected by a data drift detector, a concept drift detector, or both.

Abstract: Artificial intelligence (AI) layer-based process extraction for robotic process automation (RPA) is disclosed. Data collected by RPA robots and/or other sources may be analyzed to identify patterns that can be used to suggest or automatically generate RPA workflows. These AI layers may be used to recognize patterns of user or business system processes contained therein. Each AI layer may “sense” different characteristics in the data and be used individually or in concert with other AI layers to suggest RPA workflows.

Abstract: Automatic activation and configuration of robotic process automation (RPA) workflows using machine learning (ML) is disclosed. One or more parts of an RPA workflow may be turned on or off based on one or more probabilistic ML models. RPA robots may be configured to modify parameters, determine how much of a certain resource to provide, determine more optimal thresholds, etc. Such RPA workflows implementing ML may thus be hybrids of both deterministic and probabilistic logic, and may learn and improve over time by retraining the ML models, adjusting the confidence thresholds, using local/global confidence thresholds, providing or adjusting modifiers for the local confidence thresholds, implement a supervisor system that monitors ML model performance, etc.

Abstract: Process evolution for robotic process automation (RPA) and RPA workflow micro-optimization are disclosed. Initially, an RPA implementation may be scientifically planned, potentially using artificial intelligence (AI). Embedded analytics may be used to measure, report, and align RPA operations with strategic business outcomes. RPA may then be implemented by deploying AI skills (e.g., in the form of machine learning (ML) models) through an AI fabric that seamlessly applies, scales, manages AI for RPA workflows of robots. This cycle of planning, measuring, and reporting may be repeated, potentially guided by more and more AI, to iteratively improve the effectiveness of RPA for a business. RPA implementations may also be identified and implemented based on their estimated return on investment (ROI).

Abstract: Using artificial intelligence (AI) to select and/or chain robotic process automation (RPA) models a given problem is disclosed. A model of models (e.g., an RPA robot or an ML model) may serve as an additional layer on an existing system that makes the existing models more effective. This model of models may incorporate AI that learns an improved or best set of rules or an order from existing models, potentially taking certain activities from a model, feeding input from one model into another, and/or chaining models in some embodiments.

Abstract: A reconfigurable workbench pipeline for robotic process automation (RPA) workflows is disclosed. Different workbench pipelines may be built for different users. For instance, a global workflow (e.g., a receipt extractor) may be built and used initially, but this workflow may not work optimally or at all for a certain user or a certain task. A machine learning (ML) model may be employed, potentially with a human-in-the-loop, to specialize the global workflow for a given task.

Abstract: Artificial intelligence (AI)-based process identification, extraction, and automation for robotic process automation (RPA) is disclosed. Listeners may be deployed to user computing systems to collect data pertaining to user actions. The data collected by the listeners may then be sent to one or more servers and be stored in a database. This data may be analyzed by AI layers to recognize patterns of user behavioral processes therein. These recognized processes may then be distilled into respective RPA workflows and deployed to automate the processes.

Abstract: Systems and methods for analyzing, prioritizing, and potentially automatically generating robots implementing processes and/or process flows for robotic process automation (RPA) are disclosed. Artificial intelligence (AI) may be used to analyze business processes and/or process flows and look for possible candidates for automation or improvement of existing automations. Listeners (e.g., robots, separate software applications, operating system extensions, etc.) may be employed to listen in the background on user computing systems to mine data pertaining to workflow effectiveness and/or to identify new processes and/or process flows that may improve return on investment (ROI) for RPA.

Abstract: Reinforcement learning may be used to train machine learning (ML) models for robotic process automation (RPA) that are implemented by robots. A policy network may be employed, which learns to achieve a definite output by providing a particular input. In other words, the policy network informs the system whether it is getting closer to the winning state. The policy network may be refined by the robots automatically or with the periodic assistance of a human in order to reach the winning state, or to achieve a more optimal winning state. Robots may also create other robots that utilize reinforcement learning.

Abstract: Human-in-the-loop robot training using artificial intelligence (AI) for robotic process automation (RPA) is disclosed. This may be accomplished by a listener robot watching interactions of a user or another robot with a computing system. Based on the interactions by the user or robot with the computing system, the robot may be improved and/or personalized for the user or a group of users.

Abstract: Using artificial intelligence (AI) to select and/or chain robotic process automation (RPA) models a given problem is disclosed. A model of models (e.g., an RPA robot or an ML model) may serve as an additional layer on an existing system that makes the existing models more effective. This model of models may incorporate AI that learns an improved or best set of rules or an order from existing models, potentially taking certain activities from a model, feeding input from one model into another, and/or chaining models in some embodiments.