Abstract: A computer-implemented method for improving comparative performance test results of mobile applications may include (1) determining an optimum testing configuration for a mobile computing device, (2) directing the mobile computing device to (a) execute a comparative performance test, (b) operate in accordance with the determined optimum testing configuration during the execution of the comparative performance test, and (c) write data generated during the execution of the comparative performance test to a random-access memory (RAM) drive of the mobile computing device, (3) recording a network response directed to the mobile computing device, (4) detecting a subsequent network request sent by the mobile computing device, (5) sending the recorded network response to the mobile computing device in response to detecting the subsequent network request, and (6) tracking a control performance value and a modified performance value during the comparative performance test.

Abstract: A system and method that automatically detects that a regression incident has occurred, and identifies the particular revision(s) of source code that introduced the regression incident is disclosed herein. The system and method execute one or more simulations of each revision in a window of revisions of the source code to compute values for one or more metrics. The metric values are then used to compute regression confidence values as well as a regression confidence interval—to then detect a regression incident and identify the revision that caused the regression incident. The system and method can also identify subsequent revision(s) that sufficiently fix regression incident(s) caused by a revision such that a software developer can be informed of these fixing revisions.

Abstract: A system and method that automatically detects that a regression incident has occurred, and identifies the particular revision(s) of source code that introduced the regression incident is disclosed herein. The system and method execute one or more simulations of each revision in a window of revisions of the source code to compute values for one or more metrics. The metric values are then used to compute regression confidence values as well as a regression confidence interval—to then detect a regression incident and identify the revision that caused the regression incident. The system and method can also identify subsequent revision(s) that sufficiently fix regression incident(s) caused by a revision such that a software developer can be informed of these fixing revisions.

Abstract: A computer-implemented method for improving comparative performance test results of mobile applications may include (1) determining an optimum testing configuration for a mobile computing device, (2) directing the mobile computing device to (a) execute a comparative performance test, (b) operate in accordance with the determined optimum testing configuration during the execution of the comparative performance test, and (c) write data generated during the execution of the comparative performance test to a random-access memory (RAM) drive of the mobile computing device, (3) recording a network response directed to the mobile computing device, (4) detecting a subsequent network request sent by the mobile computing device, (5) sending the recorded network response to the mobile computing device in response to detecting the subsequent network request, and (6) tracking a control performance value and a modified performance value during the comparative performance test.

Abstract: The disclosure is directed to a benchmarking system for measuring performance of a client-side application, e.g., a web browser, in processing an application, e.g., rendering a web page of a social networking application. The benchmarking process is executed in multiple modes, e.g., a record mode and a replay mode. In the record mode, the benchmarking system warms up a proxy server by storing request-response pairs between a client device and an app server in a cache of the proxy server. In the replay mode, the benchmarking system replays the requests to obtain the responses from the cache of the proxy server and records various metrics that indicate a performance of the client-side application in processing the responses, e.g., rendering the web page.

Abstract: The disclosure is directed to a benchmarking system for measuring performance of a client-side application, e.g., a web browser, in processing an application, e.g., rendering a web page of a social networking application. The benchmarking process is executed in multiple modes, e.g., a record mode and a replay mode. In the record mode, the benchmarking system warms up a proxy server by storing request-response pairs between a client device and an app server in a cache of the proxy server. In the replay mode, the benchmarking system replays the requests to obtain the responses from the cache of the proxy server and records various metrics that indicate a performance of the client-side application in processing the responses, e.g., rendering the web page.