Abstract: A system comprises data processing hardware and memory hardware. The memory hardware is in communication with the data processing hardware, and stores instructions that, when executed on the data processing hardware, cause the data processing hardware to perform a plurality of operations. In some examples, one of the operations may include receiving instance management configuration data for a single-tenant software-as-a-service (SaaS) application. Another operation may include further include receiving an image of the single-tenant SaaS application. Yet another operation can include generating, by the control plane manager, a control plane based on the instance management configuration data. The control plane is configured to create multiple instances of the single-tenant SaaS application based on the received image, and to manage the instances of the single-tenant SaaS application based on the received instance management configuration data.

Abstract: Software code is tested to determine relative performance of the software code. Successfully executing a test may be used to flag problems in a code repository to be corrected or criteria for accepting code for acceptance to the repository. To further evaluate test results, the test may be run several times on the same code version to determine a test result stability score describing how the test results may vary in different executions, such as a frequency that the code passes the test. Based on the score, additional tests may be run to further refine test result stability score. To evaluate time-variance of testing, when a code version fails a test, a previous version of the code may be run with the same test and the results compared to determine if a new regression was introduced.

Abstract: A system and method for prepopulating a container image repository for continuous integration (CI/CD) environments using volumes and/or layered images. The method includes executing, by the processing device, a container image that is configured as an image repository mirror for a remote server. The method includes executing, by the processing device, an application to cause the application to provide a request for one or more images to the container image. The method includes determining, by the container image, an absence of the one or more images in the container image. The method includes retrieving, by the container image responsive to determining the absence of the one or more images, the one or more images from the remote storage. The method includes providing, by the container image, the one or more images retrieved from the remote storage to the application.

Abstract: Systems, computer program products, and methods are described herein for implementing an intelligent validation protocol within a cloud infrastructure. The present invention is configured to receive a request to invoke the intelligent validation protocol on one or more cloud service component clusters; determine one or more operating systems associated with the one or more cloud service component clusters; determine one or more validation requirements for the one or more operating systems; dynamically invoke, using the intelligent validation protocol, a multi-checkpoint validation subroutine on the one or more operating systems; determine whether the one or more operating systems meet the one or more validation requirements; initiate a dashboard script configured to generate an analysis interface indicating whether the one or more operating systems meet the one or more validation requirements; and transmit control signals configured to cause the computing device of the user to display the analysis interface.

Abstract: A method and apparatus for event attribution during software experimentation is described. The method may include receiving, by a server computer system, a plurality of event tracking messages associated with an end user system, each event tracking message including at least a customer identifier, an end user identifier, and a timestamp. The method may also include storing each event tracking messages with the received customer identifier, end user identifier, and timestamp in a customer data store. Furthermore, the method may include applying, by the server computer system, a feature treatment to a configurable application executing on the end user system, the feature treatment specified by a customer system associated with the customer identifier, and the feature treatment configures one or more features of the configurable application associated with the end user identifier.

Abstract: Provided is a technique for analyzing connection compatibility between software applications such as OSS.

Abstract: Methods, computer-readable media, software, and apparatuses may determine source code keywords via analysis of a source code file, map the source code keywords to test keywords, based on a similarity between the source code keywords and the test keywords, wherein the test keywords are associated with test cases, and cause execution of one or more of the test cases. Artificial intelligence driven testing utilizes artificial intelligence in analysis of source code and may automatically select and perform tests on the source code based on results of the analysis.

Abstract: A program development assistance system includes an automatic execution process server that accepts a commit completion notification indicating that a source code has been registered, commit information that includes source code information and ticket information is acquired, a ticket identifier is extracted from the commit information, attribute information pertaining to a ticket is acquired on the basis of the extracted ticket identifier, information to be executed that corresponds to the source code to be processed by automatic execution is stored in an automatic execution queue, the sequence of to-be-executed information in the automatic execution queue is altered on the basis of the acquired attribute information pertaining to the ticket, the source code and a test case that are to be processed by automatic execution are acquired, and an automatic execution process is performed using the source code and the test case on the basis of the sequence of to-be-executed information.

Abstract: Systems and methods for implementing a build-time, automatic, exporter configuration rule generator that removes the need for manual definition of exporter configurations are described. A processing device may perform a scan of source code of an application to identify one or more classes of the application, each of the one or more classes enabling an exporter to access metrics generated by the class. For each of the one or more classes, the processing device may analyze source code of the class with a set of templates and heuristics to generate a set of configuration rules for the class. The processing device may then generate an exporter configuration for the exporter based on the set of configuration rules for each of the one or more classes.

Abstract: For each continuous integration and continuous delivery/deployment (CI/CD) pipeline of a plurality of CI/CD pipelines created for a project, a data structure reflecting an execution configuration of the respective CI/CD pipeline is created. A request to submit a code change to the project is received. Among the plurality of CI/CD pipelines, at least one CI/CD pipeline having the data structure that matches the code change to the project is identified. The code change to the project on the at least one identified CI/CD pipelines is executed.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for container-based server environments. In some implementations, a server environment is provided using a plurality of containers that provide instances of different software modules. The plurality of containers includes a first container running a first software image of a particular software module. Various operations can be performed in response to determining that an updated software image is available for the particular software module. For example, execution is started for a second container that provides an instance of the updated software image. Incoming requests are to the second container while continuing to process, using the first container, one or more requests that were received before starting execution of the second container. In response to determining that a level of activity of the first container is below a threshold, the execution of the first container is stopped.

Abstract: A system for scheduling remediation includes a memory, a processor in communication with the memory, a container scheduled on a first node, a scheduler executing on the processor, and a node-local-unscheduler (“NLU”). The scheduler has a watch module. The NLU executes on the processor to determine a status of the container as failing validation. The NLU has access to scheduling policies corresponding to the container and the first node. Responsive to determining the status of the container as failing validation, the NLU annotates the container and stops execution of the container. The watch module executes on the processor to detect the annotation associated with the container. Responsive to detecting the annotation, the container is rescheduled to a second node.

Abstract: A service testing system is disclosed to enable consistent replay of stateful requests on a service whose output depends on the service's execution state prior to the requests. In embodiments, the service implements a compute engine that executes service requests and a storage subsystem that maintains execution states during the execution of stateful requests. When a stateful request is received during testing, the storage subsystem creates an in-memory test copy of the execution state to support execution of the request, and provides the test copy to the compute engine. In embodiments, the storage subsystem will create a separate instance of execution state for each individual test run. The disclosed techniques enable mock execution states to be easily created for testing of stateful requests, in a manner that is transparent to the compute engine and does not impact production execution data maintained by the service.

Abstract: A method includes collecting code development data associated with development of code files on a per user basis. A predicted code execution performance score is determined based on weighting one or more developer attributes captured in the code development data on the per user basis, the predicted code execution performance score indicative of a predicted likelihood of a code quality issue, where the one or more developer attributes are based at least in part on personnel data including a level of developer experience and a history of observed development activities of an associated developer from review data. One or more resources of one or more code execution servers associated with execution of selected files are predictively allocated based on the predicted code execution performance score. One or more code execution metrics are captured associated with executing selected files on the one or more code execution servers.

Abstract: Systems, methods, and non-transitory computer readable media are provided for facilitating improved defect resolution. Defect information and defect criteria information may be obtained. The defect information may identify defects of software and/or hardware in development. The defect criteria information may define one or more criteria for measuring the defects. The defects may be measured based on the one or more criteria. A defect analysis interface may be provided. The defect analysis interface may list a limited number of the defects based on the measurements of the defects. The defect analysis interface may provide costs (e.g., computing resources, time, personnel) of solving the defects.

Abstract: An embodiment features a method of generating test data. An application-level schema corresponding to a source relational database is received. The schema defines constraints comprising one or more of inter-field, inter-record, and inter-object constraints between related data in the source relational database. A random walk is performed on a graph of nodes representing data in the source relational database. At respective ones of the nodes, corresponding ones of the data in the source relational database are selected along a path ordered in accordance with the constraints defined in the schema. Synthetic test data is generated based on one or more statistical models of the data selected from the source relational database. Data values are generated for respective fields of an object defined in the schema, and data values are generated for records related to the object based on one or more of the constraints defined in the schema.

Abstract: Systems and methods for binary translation of executable code.

Abstract: Systems and methods for learning differentially private machine-learned models are provided. A computing system can include one or more server computing devices comprising one or more processors and one or more non-transitory computer-readable media that collectively store instructions that, when executed by the one or more processors cause the one or more server computing devices to perform operations. The operations can include selecting a subset of client computing devices from a pool of available client computing devices; providing a machine-learned model to the selected client computing devices; receiving, from each selected client computing device, a local update for the machine-learned model; determining a differentially private aggregate of the local updates; and determining an updated machine-learned model based at least in part on the data-weighted average of the local updates.

Abstract: In certain embodiments, a software pipeline (“pipeline”) is configured by the use of gates for progressing an application from one stage to another (e.g., from a development stage to a production stage). A configuration file having a set of attribute values that is descriptive of an application, and a gate mapping file having information associated with the gates to be invoked for different combinations of attribute values are obtained. The configuration file is processed using the gate mapping file to determine a set of gates to be invoked for progressing the application in the pipeline based on the attribute values of the application. The set of gates are invoked to cause a corresponding set of software routines to be executed for progressing the application.

Abstract: In some examples, a system processes event data and video frames produced by a program during execution of the program, the event data representing user actions with respect to a graphical user interface (GUI) of the program. The system identifies an area of the GUI that corresponds to a respective user action of the user actions, wherein identifying the area of the GUI uses a first video frame before an event corresponding to the respective user action, and a second video frame after the event corresponding to the respective user action. The system identifies, based on the identified area, a test object representing a user interface (UI) element, and generates a test script for testing the program, the test script including the test object.