Abstract: A user interface change event is detected. An app identifier of an associated third party app is determined. A dynamic rule data structure associated with the app identifier of the associated third party app is determined. A user interface match state specified by the dynamic rule data structure is determined based on absolute screen positioning or relative screen positioning. A current user interface state of the associated third party app is determined by querying an accessibility API. Upon determining that the user interface match state matches the current user interface state, at least one user interface report field specified by the dynamic rule data structure is determined and at least one report field property of the at least one user interface report field is extracted by querying the accessibility API. An active session data structure associated with the dynamic rule data structure is updated to store the extracted property value.

Abstract: A method and system for simultaneous recording of the pixels of a screen in the form of a video and at least one of: events received via an accessibility API and snapshots of the UI obtained via an accessibility API. All captured elements are associated with timestamps such that the video, events and UI snapshots can retrospectively be replayed and retain their synchronisation. The recording is performed via an app that runs on the same device being recorded and the recorded session may be uploaded to server via a network. A second app, running on a second device may be used to download the recorded sessions and be used to play, pause, and scrub, such that the pixels, accessibility events and the UI can be inspected at any time from the recorded session.

Abstract: A method and system for simultaneous recording of the pixels of a screen in the form of a video and at least one of: events received via an accessibility API and snapshots of the UI obtained via an accessibility API. All captured elements are associated with timestamps such that the video, events and UI snapshots can retrospectively be replayed and retain their synchronisation. The recording is performed via an app that runs on the same device being recorded and the recorded session may be uploaded to server via a network. A second app, running on a second device may be used to download the recorded sessions and be used to play, pause, and scrub, such that the pixels, accessibility events and the UI can be inspected at any time from the recorded session.

Abstract: A user interface change event is detected. An app identifier of an associated third party app is determined. A dynamic rule data structure associated with the app identifier of the associated third party app is determined. A user interface match state specified by the dynamic rule data structure is determined based on absolute screen positioning or relative screen positioning. A current user interface state of the associated third party app is determined by querying an accessibility API. Upon determining that the user interface match state matches the current user interface state, at least one user interface report field specified by the dynamic rule data structure is determined and at least one report field property of the at least one user interface report field is extracted by querying the accessibility API. An active session data structure associated with the dynamic rule data structure is updated to store the extracted property value.