Abstract: Systems and methods provide user interface (UI) automation for multiple types of devices and applications. A computing device stores an objective for automated manipulation of a UI of a user device and conducts an iterative sequence to achieve the objective. The iterative sequence includes capturing current state information of the UI, wherein the current state information includes text and an image of the UI; sending multimodal input to a generative artificial intelligence (AI) system, wherein the multimodal input includes the image of the UI, a text prompt, and the objective; receiving, from the AI system, a predicted next action for the UI based on the multimodal input; initiating a programmatic action to implement the predicted next action on the UI; and recording the programmatic action. The computing device generates, based on the iterative sequence, a UI automation model associated with achieving the objective on the UI.

Abstract: In the various embodiments, systems and methods are disclosed for determining user engagement with an application based on network traffic data corresponding to network traffic on a network. An aspect of the present disclosure is a method comprising obtaining network traffic data for a period of time, the network traffic data including a plurality of host calls; determining a host call sequence from the plurality of host calls, the host call sequence including one or more of the plurality of host calls; identifying an application corresponding to the host call sequence based on an augmented dataset; and determining a number of users of the application for the period of time based on a number of times the host call sequence repeats in the network traffic data.

Abstract: The present teaching relates to method, system, medium, and implementations for augmenting data via data crowd sourcing. Local data are acquired by one or more sensors deployed on a first device. Augmented data are obtained where such augmented data are generated based on the local data and remote data from at least one second device and are rendered on the first device.

Abstract: The present teaching relates to method, system, medium, and implementations for text processing. When a plurality of unstructured text strings are received, an input from a user for at least some of the plurality of unstructured text strings is received that identifies one or more structural elements. Training data are generated to include the plurality of unstructured text strings and the identified one or more structural elements associated with the at least some of the plurality of unstructured text strings. A conversion model is trained, via machine learning, based on the training data and one or more previously trained language models. The conversion model is for converting an input unstructured text string into a structured data record by identifying at least one structural data element from the raw unstructured text string.

Abstract: The present teaching relates to method, system, medium, and implementations for augmenting data via data crowd sourcing. Local data are acquired by one or more sensors deployed on a first device. Augmented data are obtained where such augmented data are generated based on the local data and remote data from at least one second device and are rendered on the first device.

Abstract: A system and method permit a user to browse and compare products of a merchant using information about a competitor. In one embodiment of the system and method, a page server serves a competitor electronic page to a customer browser which permits the user to select a competitor. The competitor electronic page includes a hyperlink having a manufacturer ID parameter, which hyperlink, when selected, issues a request to the page server for competitor product information. The request includes the manufacturer ID. Responsive to that request, the page server uses the manufacturer ID to form a query to present to a product database having competitive product information, manufacturer information, product information and associations between that information. A database engine processes the query and returns records satisfying the query. The records are used to construct a competitor product electronic page permitting a user to select a competitor product.

Abstract: A system and method permit a user to browse and compare products of a merchant using information about a competitor. In one embodiment of the system and method, a page server serves a competitor electronic page to a customer browser which permits the user to select a competitor. The competitor electronic page includes a hyperlink having a manufacturer ID parameter, which hyperlink, when selected, issues a request to the page server for competitor product information. The request includes the manufacturer ID. Responsive to that request, the page server uses the manufacturer ID to form a query to present to a product database having competitive product information, manufacturer information, product information and associations between that information. A database engine processes the query and returns records satisfying the query. The records are used to construct a competitor product electronic page permitting a user to select a competitor product.

Abstract: A system and method permit a user to browse and compare products of a merchant using information about a competitor. In one embodiment of the system and method, a page server serves a competitor electronic page to a customer browser which permits the user to select a competitor. The competitor electronic page includes a hyperlink having a manufacturer ID parameter, which hyperlink, when selected, issues a request to the page server for competitor product information. The request includes the manufacturer ID. Responsive to that request, the page server uses the manufacturer ID to form a query to present to a product database having competitive product information, manufacturer information, product information and associations between that information. A database engine processes the query and returns records satisfying the query. The records are used to construct a competitor product electronic page permitting a user to select a competitor product.