Abstract: A digital adoption platform includes a page change identification technique. The page change identification technique is platform and application agnostic. Changes in screenshots of a UI of an application are compared. Differences between screenshots are compared using a cross-correlation technique. Trigger conditions are defined to reduce the computational resources required. Additional optimizations to reduce processing resources and optimize accuracy may also be included.

Abstract: A digital adoption platform includes a page change identification technique. The page change identification technique is platform and application agnostic. Changes in screenshots of a UI of an application are compared. Differences between screenshots are compared using a cross-correlation technique. Trigger conditions are defined to reduce the computational resources required. Additional optimizations to reduce processing resources and optimize accuracy may also be included.

Abstract: A technique to support a walkthrough across different applications is disclosed. Walkthroughs between desktop applications is supported. Walkthroughs between a desktop application and a web application may also be supported. A central flow route processor may be provided to support routing walkthroughs between applications. The central flow route processor may include an application identity table to identify application identifiers, process names, and class names.

Abstract: A method for detecting potential elements of interest present in digital user interfaces comprises receiving a grayscale image of a user interface comprising multiple elements. The grayscale image may be formed of pixels. Multiple threshold values corresponding to the pixels may be identified and selected by processing the grayscale image. Multiple binary images may be thereafter generated. Each of the binary images may correspond to a respective one of the threshold values. Thereafter, multiple sets of one or more bounding boxes may be obtained. Each of the sets may correspond to a respective one of the binary images. Each of the bounding boxes may encapsulate a respective one or more of the elements. Subsequently, one or more bounding boxes may be obtained, each one encapsulating a respective one of the potential elements of interest among the elements present in the user interface, by processing the multiple sets of bounding boxes.

Abstract: A system (100) and a method (400) for detecting a target element in a Java application is disclosed. The system (100) comprises one or more user devices (110) in communication with a server (40). The user device comprises a processor configured to receive a selection of a target element via a user interface of the Java application. The processor is configured to traverse from the target element to a root element along a traversal path. The traversal path comprises elements. The processor is configured to determine one or more neighboring elements of the target element. The processor is configured to capture and store the elements and attributes of each of the elements on the traversal path and the one or more neighboring elements on the server (40), thereby creating reference data for enabling detection of the target element.

Abstract: A system and method are disclosed for creating a shadow representation of a user interface. The shadow representation which may take the form of a shadow UI cache is updated in response to detected structure change events. An exemplary application of the shadow representation is to improve the UI element retrieval for a digital adoption platform.

Abstract: A page identification technique is configurable to select regions of a screen for optical character recognition. The size of the regions may be selected to reduce the CPU resources needed to identify a page. Pre-processing and post-processing may be performed to improve the accuracy of the optical character recognition. A word mapping algorithm may include logical condition to determine a page name.

Abstract: Provided herein are systems and methods for performing optimized template matching within a digital adoption platform used in conjunction with an underlying computer application. In some embodiments, a method includes capturing an image and template from a user interface of the underlying application, converting the image and template to grayscale, detecting a background type of the image and template and inverting one of the background types if there is a mismatch, applying a Gaussian filter to the image and template, dividing the scale of the image by the scale of the template to determine a starting scale, reducing a resolution of at least the image, applying a template matching algorithm to the image and template using the starting scale to locate the template in the image, and remapping the coordinates of the template to reflect its original location on the image.

Abstract: A technique for screen mirroring of a mobile device with a laptop or desktop computer via an encoded room ID in a machine-readable optical image code displayed on the laptop or desktop computer. The mobile device scans the optical image code and discovers the room ID. The room ID is used to establish secure screen mirroring.

Abstract: A method for providing digital guidance corresponding to software applications comprises acquiring an image of a current UI of a software application. A template image of an element of interest may be obtained from a previously processed template UI image corresponding to the current user interface. The obtaining of the template image may comprise obtaining bounding boxes using binary images of the template UI. Each bounding box may encapsulate a potential element of interest. Further the method may include receiving a selection of a bounding box corresponding to the element of interest among the potential element of interest. The element of interest may be identified in the current UI by using the template image of the element of interest and the image of the current UI. Subsequently, the digital guidance associated with the element of interest may be displayed in the current UI.

Abstract: A technique for inspecting screen elements of a mobile device with a laptop or desktop computer displays a screen-shot of the mobile device. Visible screen elements are identified as the user moves a user interface pointer over the screen-shot. Individual screen elements are highlighted and a user may select individual screen elements. Additional information regarding screen element identification and attributes may be displayed. The screen element attributes may be captured for use in generating DAP content for a mobile device.

Abstract: A system and method to create at least one step for providing digital guidance to an underlying application is disclosed. The system comprising one or more user devices in communication with a server, the user device comprising a processor configured to: scan the underlying application for identifying one or more elements; select at least one target element; determine neighbouring element in proximity of the target element; analyse elements to determine attributes including unique attributes; classify as a pillar element depending upon presence of unique attributes; determine an intersection element between the target element and the pillar element; and determine path of the intersection element, store path of the intersection element, the path of the intersection element enables identification of the intersection element and based on the intersection element, the pillar element and the target element associated with the intersection element can be identified.

Abstract: Provided herein are systems and methods for creating, testing and providing digital guidance for use in an underlying computer application. In one exemplary implementation, a method includes using a browser extension to record steps of digital guidance content as the steps are created by a content author, automatically testing the content with the same browser and making the tested content available for playback. The testing may include receiving an execute testing command, fetching test case data from a server, executing a test case in the browser using the test case data, running tests on the test case in a background tab of the browser, recording passes and or failures of the tests, sending reports of the passes and failures to the server, sending a notification to the content author that the testing results are ready to view, and displaying the testing results in the dashboard.

Abstract: Provided herein are systems and methods for personalizing digital guidance for improved user adoption of an underlying computer application. In one exemplary implementation, a method includes identifying an underlying application, identifying different pages of the application, gathering usage data at a user level for n days, creating a user behavior matrix from the gathered data, performing a user similarity calculation for each pair of the users, tabulating a consumption count for each of the users, performing a series of score calculations for a recommendation user, calculating an intermediate score for each piece of content, counting a number of users who clicked on each piece of content, obtaining a final score for each piece of content, deciding on a ranking order of the content based on the final scores, and recommending content to the recommendation user from the ranking step.

Abstract: Provided herein are systems and methods for personalizing digital guidance for improved user adoption of an underlying computer application. In one exemplary implementation, a method includes identifying an underlying application, identifying different pages of the application, gathering usage data at a user level for n days, creating a user behavior matrix from the gathered data, performing a user similarity calculation for each pair of the users, tabulating a consumption count for each of the users, performing a series of score calculations for a recommendation user, calculating an intermediate score for each piece of content, counting a number of users who clicked on each piece of content, obtaining a final score for each piece of content, deciding on a ranking order of the content based on the final scores, and recommending content to the recommendation user from the ranking step.

Abstract: Provided herein are systems and methods for providing digital guidance in an underlying computer application. In one exemplary implementation, a method includes setting a rule or rules, in a computing device, in advance of digital guidance content creation, for detecting, upon later playback of the content, page elements of the underlying computer application that are associated with the content. The exemplary method further includes recording, in the computing device, steps of the digital guidance content as the steps are created by a content author, and automatically applying, in the computing device, the previously set rule or rules for detecting page elements, and thereby assigning strong attributes to the page elements. The method further includes saving, in the computing device, the content steps along with the strong attributes of the page elements associated with the content steps.

Abstract: Provided herein are systems and methods for providing digital guidance in an underlying computer application. In one exemplary implementation, a method includes recording, in a computing device, steps of digital guidance content as the steps are created by a content author. The exemplary method also includes automatically segmenting, in the computing device, the digital guidance content as it is being created such that the digital guidance content is only associated with segments of the underlying computer application where the content is relevant. The exemplary method further includes making the digital guidance content available for playback to an end user on a computing device only when the end user is in a segment of the underlying computer application that is relevant to the digital guidance content.