Abstract: A computer-implemented method includes providing a graphical user interface (GUI) that allows a user working in a notebook computing system environment to generate a source notebook that includes a plurality of cells, each containing code, for the one or more visualizations each including a chart. The GUI allows the user to run the cells before creating the marketing analytic dashboard. The code used to generate the one or more visualizations into a custom dataframe is strung together into a custom dataframe, which is then paired with chart properties. Processing the pairs in an engine creates a preview of each visualization of the dashboard using campaign data of the customer. The marketing analytic dashboard is made available to the customer through a customer-facing marketing analytics application which performs the same processing as the engine to create visualizations on the dashboard using updated campaign data of the customer.

Abstract: A computer-implemented method for creation of a test plan for load testing a website includes receiving a set of input parameters, which includes a specified time period range. Beacon data of real user sessions on the website that fall within the specified time period range is retrieved from a data storage repository. A set of peak traffic time periods, which includes a peak day, a peak hour, a peak minute, and a peak second, is identified. User session statistics are calculated for the peak day, the user session statistics including median session duration, session length, and think times. A page group distribution table is generated that includes a list of all page groups and page group hit percentages, relative to all other page groups, for the real user sessions during the peak hour. A set of test scenario paths representative of the page group distribution table is then generated.

Abstract: A method includes providing a graphical user interface (GUI) that allows a user to dynamically change virtual user (VU) distributions of a load test performed on a target website or web application during test run-time. The GUI allowing the user to make a change to a current ramp profile of one or more VU distributions responsive to application of first user input. The first input including dragging an icon to a position in a first graph, the position denoting a future number of VUs at a future time. Following application of the first input, the change to the current ramp profile is visually displayed on a second graph in real-time as the load test progresses.

Abstract: A system for worldwide cloud-based testing of mobile applications includes a plurality of mobile computing devices associated with an enterprise. The mobile computing devices are geographically distributed across a plurality of different countries. The system further includes one or more servers connected with the mobile computing devices over one or more Internet Protocol (IP) networks. The one or more servers run a program for playback of a test composition which includes a timed sequence of clips on the mobile computing devices. The timed sequence of clips including one or more messages each of which instructs a precise gesture-based action applied to at least one object displayed on the touch-sensitive display screen.

Abstract: A system for worldwide cloud-based testing of mobile applications includes a plurality of mobile computing devices geographically distributed across a plurality of different countries. One or more servers are connected with the mobile computing devices over one or more networks. The one or more servers run a program for playback of a test composition which includes a timed sequence of clips on the mobile computing devices. The timed sequence of clips include one or more messages each of which instructs a precise gesture-based action applied to at least one object displayed on the touch-sensitive display screen. The precise gesture-based action corresponds to a functional aspect of the mobile application and consists of a plurality of data elements previously captured from inside the mobile application while the mobile application was subject to the gesture-based user input entered via the touch-sensitive display screen.

Abstract: A method includes providing a graphical user interface (GUI) that displays a view of the globe as from outer space. The view including a geographic distribution of beacons having one or more visual attributes. Each beacon corresponds to one or more real users who are accessing a website, web application or mobile app from a geographic location. The visual attributes include an indicator of a performance metric representative of an experience of the one or more real users of the website, web application, or mobile app. Each beacon is generated in real-time from aggregated data obtained in real-time from one or more corresponding real user sessions on the website, web application or mobile app. The beacons are periodically refreshed with the visual attributes changing in response to measured changes in the geographic distribution, a total number of real users at the location, or the performance indicator at the location.

Abstract: A method for real-time capture of analytics from real users of a native mobile application (app) includes storing a custom metric/timer definition for a native mobile application (app) in a configuration file on a server. The custom metric/timer definition includes one or more identifiers of an element or object of the native mobile app selected by touch gesture input via a user interface on a mobile device running the native mobile app in a special mode. The configuration file is downloaded from the server to real users running the native mobile app on associated mobile devices. Immediately thereafter, one or more collector servers receive data beaconed in real-time from the associated mobile devices of the real users. The beaconed data includes custom metric/timer data obtained from the custom metric/timer definition.

Abstract: A method for real-time capture of analytics from real users of a native mobile application (app) includes storing a custom metric/timer definition for a native mobile application (app) in a configuration file on a server. The custom metric/timer definition includes one or more identifiers of an element or object of the native mobile app selected by touch gesture input via a user interface on a mobile device running the native mobile app in a special mode. The configuration file is downloaded from the server to real users running the native mobile app on associated mobile devices. Immediately thereafter, one or more collector servers receive data beaconed in real-time from the associated mobile devices of the real users. The beaconed data includes custom metric/timer data obtained from the custom metric/timer definition.

Abstract: A method includes providing a graphical user interface (GUI) that displays a view of the globe as from outer space. The view including a geographic distribution of beacons having one or more visual attributes. Each beacon corresponds to one or more real users who are accessing a website, web application or mobile app from a geographic location. The visual attributes include an indicator of a performance metric representative of an experience of the one or more real users of the website, web application, or mobile app. Each beacon is generated in real-time from aggregated data obtained in real-time from one or more corresponding real user sessions on the website, web application or mobile app. The beacons are periodically refreshed with the visual attributes changing in response to measured changes in the geographic distribution, a total number of real users at the location, or the performance indicator at the location.

Abstract: A processor-implemented method includes providing an analytic dashboard with a graphical user interface (GUI) that outputs aggregated results streaming in real-time of a load test performed on a target website. Responsive to input of a user on the GUI, the input comprising selection of a source chart and a target chart, a single chart is automatically generated that represents either a combination or a statistical correlation of the source and target charts. The single chart has a left y-axis and an x-axis. The combination or the statistical correlation of the single chart changing in real-time as the load test progresses. A visual representation of the single chart is then produced on the analytic dashboard.

Abstract: A method includes providing a graphical user interface (GUI) that displays a view of the globe as from outer space. The view including a geographic distribution of beacons having one or more visual attributes. Each beacon corresponds to one or more real users who are accessing a website, web application or mobile app from a geographic location. The visual attributes include an indicator of a performance metric representative of an experience of the one or more real users of the website, web application, or mobile app. Each beacon is generated in real-time from aggregated data obtained in real-time from one or more corresponding real user sessions on the website, web application or mobile app. The beacons are periodically refreshed with the visual attributes changing in response to measured changes in the geographic distribution, a total number of real users at the location, or the performance indicator at the location.

Abstract: A method for cloud-based functional testing of a mobile application includes running a functional test program on a server. The functional test program provides a graphical user interface (GUI) that allows a user to select a mobile application and a mobile computing device having a touch-sensitive display screen for receiving user input. The mobile computing device is located remote to the server. The functional test program launches the mobile application on the mobile computing device via a wireless network connection. The server receives precision elements of each gesture-based input on the touch-sensitive display screen, the precision elements being captured and transmitted from the mobile computing device to the server during execution of the mobile application. The precision elements of each gesture-based input are then recorded in a test clip.

Abstract: A method for cloud-based functional testing of a mobile application includes running a functional test program on a server. The functional test program provides a graphical user interface (GUI) that allows a user to select a mobile application and a mobile computing device having a touch-sensitive display screen for receiving user input. The mobile computing device is located remote to the server. The functional test program launches the mobile application on the mobile computing device via a wireless network connection. The server receives precision elements of each gesture-based input on the touch-sensitive display screen, the precision elements being captured and transmitted from the mobile computing device to the server during execution of the mobile application. The precision elements of each gesture-based input are then recorded in a test clip.

Abstract: A method for cloud-based functional testing of a mobile application includes running a functional test program on a server. The functional test program provides a graphical user interface (GUI) that allows a user to select a mobile application and a mobile computing device having a touch-sensitive display screen for receiving user input. The mobile computing device is located remote to the server. The functional test program launches the mobile application on the mobile computing device via a wireless network connection. The server receives precision elements of each gesture-based input on the touch-sensitive display screen, the precision elements being captured and transmitted from the mobile computing device to the server during execution of the mobile application. The precision elements of each gesture-based input are then recorded in a test clip.

Abstract: A method includes providing a graphical user interface (GUI) that allows a user to dynamically change virtual user (VU) distributions of a load test performed on a target website or web application during test run-time. The GUI allowing the user to make a change to a current ramp profile of one or more VU distributions responsive to application of first user input. The first input including dragging an icon to a position in a first graph, the position denoting a future number of VUs at a future time. Following application of the first input, the change to the current ramp profile is visually displayed on a second graph in real-time as the load test progresses.

Abstract: A method for real-time capture of analytics from real users of a native mobile application (app) includes storing a custom metric/timer definition for a native mobile application (app) in a configuration file on a server. The custom metric/timer definition includes one or more identifiers of an element or object of the native mobile app selected by touch gesture input via a user interface on a mobile device running the native mobile app in a special mode. The configuration file is downloaded from the server to real users running the native mobile app on associated mobile devices. Immediately thereafter, one or more collector servers receive data beaconed in real-time from the associated mobile devices of the real users. The beaconed data includes custom metric/timer data obtained from the custom metric/timer definition.

Abstract: A method includes providing a graphical user interface (GUI) that displays a view of the globe as from outer space. The view including a geographic distribution of beacons having one or more visual attributes. Each beacon corresponds to one or more real users who are accessing a website, web application or mobile app from a geographic location. The visual attributes include an indicator of a performance metric representative of an experience of the one or more real users of the website, web application, or mobile app. Each beacon is generated in real-time from aggregated data obtained in real-time from one or more corresponding real user sessions on the website, web application or mobile app. The beacons are periodically refreshed with the visual attributes changing in response to measured changes in the geographic distribution, a total number of real users at the location, or the performance indicator at the location.

Abstract: An automated method for provisioning a grid used to run a load test on a target website includes sending one or more requests in a multi-threaded manner to at least one cloud provider, the one or more requests for an allocation of N load server instances and M result server instances which comprise the grid. Requests received back from the cloud provider are also handled in a multi-threaded manner; any errors occurring during the allocation being corrected automatically. The N load server instances and the M result server instances are then verified to be operational and correctly running software deployed to provide defined test services. Errors identified during the verification are automatically corrected either by attempting to restart a failed instance or allocating a different instance.