Abstract: A method for real-time analysis of results from a load test performed on a target website includes calculating first-level aggregated test results within each of a plurality of load server instances that generate a load on the target website. The first-level aggregated test results are calculated from data points received by each of the load server instances from the target website. The first-level aggregated test results include a sum of the data points, a count of the number of the data points, a sum of squares of the data points, and an average of the data points. A standard deviation result (STDEV) is calculated and chart is generated on a display via a graphical user interface. The chart provides a visual representation of a performance metric for the load test based on the standard deviation result.

Abstract: A method for real-time analysis of results from a load test performed on a target website includes calculating first-level aggregated test results within each of a plurality of load server instances that generate a load on the target website. The first-level aggregated test results are calculated from data points received by each of the load server instances from the target website. The first-level aggregated test results include a sum of the data points, a count of the number of the data points, a sum of squares of the data points, and an average of the data points. A standard deviation result (STDEV) is calculated and chart is generated on a display via a graphical user interface. The chart provides a visual representation of a performance metric for the load test based on the standard deviation result.

Abstract: A method for cloud-based functional testing of a mobile application includes running a functional test program on a server. The functional test program provides a graphical user interface (GUI) that allows a user to select a mobile application and a mobile computing device having a touch-sensitive display screen for receiving user input. The mobile computing device is located remote to the server. The functional test program launches the mobile application on the mobile computing device via a wireless network connection. The server receives precision elements of each gesture-based input on the touch-sensitive display screen, the precision elements being captured and transmitted from the mobile computing device to the server during execution of the mobile application. The precision elements of each gesture-based input are then recorded in a test clip.

Abstract: A processor-implemented method includes providing an analytic dashboard with a graphical user interface (GUI) that outputs aggregated results streaming in real-time of a load test performed on a target website. The load test consists of a plurality of virtual users simulated by one or more load servers that execute a test composition on one or more webpages of the website. A waterfall chart is produced on the analytic dashboard that includes a plurality of timeline bars. Each of the timeline bars represents an aggregated result for a resource of the one or more webpages across all of the virtual users. The timeline bars change in real-time as the load test progresses.

Abstract: A method for cloud-based functional testing of a mobile application includes running a functional test program on a server. The functional test program provides a graphical user interface (GUI) that allows a user to select a mobile application and a mobile computing device having a touch-sensitive display screen for receiving user input. The mobile computing device is located remote to the server. The functional test program launches the mobile application on the mobile computing device via a wireless network connection. The server receives precision elements of each gesture-based input on the touch-sensitive display screen, the precision elements being captured and transmitted from the mobile computing device to the server during execution of the mobile application. The precision elements of each gesture-based input are then recorded in a test clip.

Abstract: A method for real-time capture of actual user experiences on a website, web application or mobile app includes receiving, in first servers, one or more beacons, each containing data items. Each beacon is generated in real-time from a user session. The data items are aggregated in one or more first sets of N data buckets associated with each of the first servers. Each of the first servers transmits the data items of each of the N data buckets to a second server over a network, which further aggregates the data items received in one or more sets of N data buckets corresponding to and identically configured as the data buckets of the first servers. The corresponding data contents of the one or more second sets of N data buckets is aggregated into one or more final sets of N data buckets used in generating a real-time analytic dashboard.

Abstract: A method includes providing a graphical user interface (GUI) that allows a user to dynamically change virtual user (VU) distributions of a load test performed on a target website or web application during test run-time. The GUI allowing the user to make a change to a current ramp profile of one or more VU distributions responsive to application of first user input. The first input including dragging an icon to a position in a first graph, the position denoting a future number of VUs at a future time. Following application of the first input, the change to the current ramp profile is visually displayed on a second graph in real-time as the load test progresses.

Abstract: Optimizing a set of graphical display elements on a client device. A first set of graphical display elements may be transmitted from a first server to a client device. A second set of graphical display elements may be generated on a second server. The second set of graphical display elements may be transmitted from the second server to the client device. A third set of graphical display elements may be created in a first window including the first set of graphical display elements and the second set of graphical display elements.

Abstract: A method for real-time capture of actual user experiences on a website, web application or mobile app includes receiving, in first servers, one or more beacons, each containing data items. Each beacon is generated in real-time from a user session. The data items are aggregated in one or more first sets of N data buckets associated with each of the first servers. Each of the first servers transmits the data items of each of the N data buckets to a second server over a network, which further aggregates the data items received in one or more sets of N data buckets corresponding to and identically configured as the data buckets of the first servers. The corresponding data contents of the one or more second sets of N data buckets is aggregated into one or more final sets of N data buckets used in generating a real-time analytic dashboard.

Abstract: A method for real-time capture of analytics from real users of a native mobile application (app) includes storing a custom metric/timer definition for a native mobile application (app) in a configuration file on a server. The custom metric/timer definition includes one or more identifiers of an element or object of the native mobile app selected by touch gesture input via a user interface on a mobile device running the native mobile app in a special mode. The configuration file is downloaded from the server to real users running the native mobile app on associated mobile devices. Immediately thereafter, one or more collector servers receive data beaconed in real-time from the associated mobile devices of the real users. The beaconed data includes custom metric/timer data obtained from the custom metric/timer definition.

Abstract: A method includes providing a graphical user interface (GUI) that displays a view of the globe as from outer space. The view including a geographic distribution of beacons having one or more visual attributes. Each beacon corresponds to one or more real users who are accessing a website, web application or mobile app from a geographic location. The visual attributes include an indicator of a performance metric representative of an experience of the one or more real users of the website, web application, or mobile app. Each beacon is generated in real-time from aggregated data obtained in real-time from one or more corresponding real user sessions on the website, web application or mobile app. The beacons are periodically refreshed with the visual attributes changing in response to measured changes in the geographic distribution, a total number of real users at the location, or the performance indicator at the location.

Abstract: A method of optimizing the delivery of a set of data elements from a first device to a second device. The method includes retrieving from a data source the set of data elements, including a first subset of the set of data elements, a second subset of the set of data elements, and a third subset of the set of data elements. The method also includes transferring the first subset of the set of data elements to the second device. The method further includes selecting a fourth subset of the set of data elements, wherein the fourth subset can be comprised of data elements from the first subset and the second subset, or wherein the fourth subset can be comprised of data elements from the second subset and the third subset. The method also includes transferring a fourth subset of the set of data elements to the second device.

Abstract: An automated method for provisioning a grid used to run a load test on a target website includes sending one or more requests in a multi-threaded manner to at least one cloud provider, the one or more requests for an allocation of N load server instances and M result server instances which comprise the grid. Requests received back from the cloud provider are also handled in a multi-threaded manner; any errors occurring during the allocation being corrected automatically. The N load server instances and the M result server instances are then verified to be operational and correctly running software deployed to provide defined test services. Errors identified during the verification are automatically corrected either by attempting to restart a failed instance or allocating a different instance.

Abstract: Optimizing a set of graphical display elements on a client device. A first set of graphical display elements may be transmitted from a first server to a client device. A second set of graphical display elements may be generated on a second server. The second set of graphical display elements may be transmitted from the second server to the client device. A third set of graphical display elements may be created in a first window including the first set of graphical display elements and the second set of graphical display elements.

Abstract: A computer-implemented method includes scanning a clip of messages that includes message requests and message responses arranged in a sequence. The scanning is performed based on one or more search parameters and produces a list of one or more name/value pairs. The clip is utilized to perform a load test on a target website. Each name/value pair has a corresponding value. For each name/value pair in the list a message request in the clip is identified where the corresponding value is first used. Then, looking backwards in the sequence from the message request where the corresponding value is first used, prior message responses are located where the corresponding value is found. An extraction point is specified in the clip for the corresponding value as a latest message response in the sequence where the corresponding value was returned from the target website. The corresponding value is then stored as a property.

Abstract: An automated method for provisioning a grid used to run a load test on a target website includes sending one or more requests in a multi-threaded manner to at least one cloud provider, the one or more requests for an allocation of N load server instances and M result server instances which comprise the grid. Requests received back from the cloud provider are also handled in a multi-threaded manner; any errors occurring during the allocation being corrected automatically. The N load server instances and the M result server instances are then verified to be operational and correctly running software deployed to provide defined test services. Errors identified during the verification are automatically corrected either by attempting to restart a failed instance or allocating a different instance.

Abstract: A processor-implemented method includes providing an analytic dashboard with a graphical user interface (GUI) that outputs aggregated results streaming in real-time of a load test performed on a target website. The load test consists of a plurality of virtual users simulated by one or more load servers that execute a test composition on one or more webpages of the website. A waterfall chart is produced on the analytic dashboard that includes a plurality of timeline bars. Each of the timeline bars represents an aggregated result for a resource of the one or more webpages across all of the virtual users. The timeline bars change in real-time as the load test progresses.

Abstract: A method of optimizing a first set of graphical display elements on a client device. The method also includes coupling a first server to the client device by a first connection; coupling a second server to the client device by a second connection; and generating the first set of graphical display elements on a first server, wherein the first set of graphical display elements further comprises a first graphical display element and a second graphical display element. The method further includes generating a second set of graphical display elements on a second server; transmitting the first set of graphical display elements from the first server to the client device; and transmitting the second set of graphical display elements from the second server to the client device, wherein a third set of graphical display elements is created in a first window comprising the first set of graphical display elements and the second set of graphical display elements.

Abstract: A business intelligence system includes a business activity monitor with a data cache to receive and store enterprise data integrated from a plurality of enterprise applications, the data cache being updated in real-time as the enterprise data changes. A computer coupled with the data cache runs a program that produces a graphical user interface on a display. The graphical user interface provides a user with a real-time report of the enterprise data and a page that allows the user to specify at least one action affecting operation of the enterprise. The page also including a button selection of which causes the computer to send a first message designating one or more selected actions to the BAM. In response, the BAM sends a second message to one or more of the enterprise applications to execute the one or more selected actions in real-time.

Abstract: A method for real-time analysis of results from a load test performed on a target website includes periodically computing first-level aggregated test results within each of a plurality of load server instances that generate a load on the target website. The first-level aggregated test results are computed from data received by each of the load server instances from the target website every first time interval. The first-level aggregated test results are then periodically sent from each of the load server instances to an associated one of a plurality of analytic server instances every second time interval. The first-level aggregated test results are aggregated by each of the analytic server instances to produce second-level aggregated test results, which test results may then further aggregated to produce third-level aggregated test results at a data storage instance in real-time.