Abstract: In some embodiments, a method may include determining hierarchical agents including a first agent and a second agent based on a document defining a UI, the hierarchical agents having access to initial context data. The method may include delegating a task related to a UI element to the first agent based on information associated with the UI element and restricting portions of the initial context data available to the first agent to a propagated subset based on input data types mapped to the first agent and portions of the initial context data available to the second agent. The method may include generating interaction data by providing a machine learning model with the propagated subset and updating the document (e.g., by populating or interacting with the UI element based on the interaction data).

Abstract: In some embodiments, a method and related system for dynamically responding to evolving UIs includes using hierarchical agents in a same runtime as the UI. In some embodiments, the method includes determining hierarchical agents within a runtime environment based on UI elements of a document in the runtime environment, and delegating a task related to a target UI element to an agent based on UI element information in the first runtime environment. The method may include generating, via the agent, interaction data for the target UI element based on the information related to the target UI element and user information and may further include updating the document based on the interaction data.

Abstract: In some embodiments, a method may include determining hierarchical agents including a first agent and a second agent based on a document defining a UI, the hierarchical agents having access to initial context data. The method may include delegating a task related to a UI element to the first agent based on information associated with the UI element and restricting portions of the initial context data available to the first agent to a propagated subset based on input data types mapped to the first agent and portions of the initial context data available to the second agent. The method may include generating interaction data by providing a machine learning model with the propagated subset and updating the document (e.g., by populating or interacting with the UI element based on the interaction data).