Abstract: A system is described that obtains first performance data collected during execution of a first application at a first group of computing devices, determines, based on the first performance data, at least one metric for quantifying performance of the first application, and compares the at least one metric to a corresponding benchmark derived from second performance data collected during execution of one or more second applications at a second group of computing devices. Each of the one or more second applications being different than the first application. The system determines whether the at least one metric is within a threshold amount of the corresponding benchmark, and further determines, determines, based at least in part on the at least one metric is not within the threshold amount of the corresponding benchmark, a fix to the first application and outputs, for presentation at a developer device, an indication of the fix.

Abstract: A system is described that obtains first performance data collected during execution of a first application at a first group of computing devices, determines, based on the first performance data, at least one metric for quantifying performance of the first application, and compares the at least one metric to a corresponding benchmark derived from second performance data collected during execution of one or more second applications at a second group of computing devices. Each of the one or more second applications being different than the first application. The system determines whether the at least one metric is within a threshold amount of the corresponding benchmark, and further determines, determines, based at least in part on the at least one metric is not within the threshold amount of the corresponding benchmark, a fix to the first application and outputs, for presentation at a developer device, an indication of the fix.

Abstract: A system generates screenshots of a graphical user interface (GUI) of an application that is displayed by target devices testing the application. Each screenshot includes an image of the GUI and metadata indicative of elements of the GUI present in the image or a state of the application or target device when the image is generated. The system determines, based on the metadata of a screenshot from a first set of the screenshots and the metadata of a screenshot from a second set of the screenshots, whether the screenshots are similar and if so, the system assigns the screenshot from the second set of screenshots to a cluster that includes the screenshot from the first set of screenshots. The system outputs an indication of the cluster (e.g., a notification or graphical indication) indicative of the similarity or discrepancy between the screenshots.

Abstract: A system generates screenshots of a graphical user interface (GUI) of an application that is displayed by target devices testing the application. Each screenshot includes an image of the GUI and metadata indicative of elements of the GUI present in the image or a state of the application or target device when the image is generated. The system determines, based on the metadata of a screenshot from a first set of the screenshots and the metadata of a screenshot from a second set of the screenshots, whether the screenshots are similar and if so, the system assigns the screenshot from the second set of screenshots to a cluster that includes the screenshot from the first set of screenshots. The system outputs an indication of the cluster (e.g., a notification or graphical indication) indicative of the similarity or discrepancy between the screenshots.

Abstract: A system generates screenshots of a graphical user interface (GUI) of an application that is displayed by target devices testing the application. Each screenshot includes an image of the GUI and metadata indicative of elements of the GUI present in the image or a state of the application or target device when the image is generated. The system determines, based on the metadata of a screenshot from a first set of the screenshots and the metadata of a screenshot from a second set of the screenshots, whether the screenshots are similar and if so, the system assigns the screenshot from the second set of screenshots to a cluster that includes the screenshot from the first set of screenshots. The system outputs an indication of the cluster (e.g., a notification or graphical indication) indicative of the similarity or discrepancy between the screenshots.