Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for allocating a number of first containers to implement one primary segment instance each and a number of second containers to implement one mirror segment instance each. In one example system, the second containers are configured to have less computing resources than the first containers. The containers are distributed among a number of physical computers. The system receives an indication of a failure of a physical computer hosting a particular first container implementing a first primary segment instance. In response to receiving the indication, the system promotes a second mirror segment instance that is a mirror of the first primary segment instance to be a new primary segment instance. The system allocates additional resources to the particular second container implementing the promoted mirror segment instance.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for instrumentation and control of workloads in a massively parallel processing database. Deployment is in a cluster which mirrors the cluster of the database to be controlled. The system includes data publishing modules, action agents, rules processing modules, deployment managers, rule compilation and management tools. Together these provide a distributed, fault tolerant system for the automated rules-based control of work in a database cluster. A first calculation master, upon receiving a request, performs local calculation on a first node, and directs a second calculation master to perform local calculation on a second node. The first calculation master then performs global calculation using intermediate results from the first node and the second node.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for implementing an independent services platform. One of the methods includes maintaining a first software platform system configured to host user-provided computing tasks in a cloud computing environment of a distributed computing system. A services platform system configured to host services in the cloud computing environment of the distributed computing system is also maintained, wherein the second services platform system is configured to provision independent service resources in the underlying cloud computing infrastructure, and launch one or more service instances of the service using the provisioned independent service resources in the underlying cloud computing infrastructure. The second services platform system is configured to receive a bind request from a user and to provide binding information to one or more computing tasks hosted by the first software platform system upon receiving the bind request.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media for creating and configuring computing clusters on a cloud computing platform. One of the methods includes receiving, by a service broker, a user input requesting creation of a computing cluster. The service broker generates, based at least in part on one or more release templates and the user input, a deployment manifest that specifies components and properties of a deployment of one or more clusters of a container orchestrator. The service broker provides the deployment manifest to a deployment manager. The deployment manager creates, according to the deployment manifest, one or more computing clusters in which one or more containerized applications are managed by the container orchestrator. Each computing cluster is configured to execute, in a user space, a containerized application specified by the container orchestrator. References to the computing cluster(s) are provided to a user device.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for code testing. In one aspect, a method includes receiving, by a code editor of an IDE, updated source code for a first service and an associated set of tests; deploying, by the IDE, an updated first service based on the updated source code to a cloud environment and the test case to a test agent; running an instance of the updated first service in the cloud environment; performing, by the test agent, the set of tests on the running instance of the updated first service; receiving, by the IDE, data representing the test results; and displaying, by the IDE, the data representing the test results on a user interface.

Abstract: Methods, systems, and computer program products for accelerate database through runtime code generation are described. A system provides a library of transformation functions that each transform an original function in an intermediate representation into a transformed function in the intermediate representation. The system receives a query. The system obtains an original database function used to execute the query, the original database function being in the intermediate representation. The system generates a new function that is a query specialized version of the original database function. The system generates a result for the query, including executing the new function instead of the original database function.

Abstract: Systems, methods, and computer program products for trace management in a distributed computing environment are described. A trace manager receives a request to analyze a trace of a series of calls between applications serving requests in a microservice architecture. The trace manager determines metrics including, for example, latency information and start time for the series of calls. The trace manager presents the metrics in association with log entries correlated to the series of calls. A call stack, or one or more latency indicators, provides a user interface of selecting one or more calls. A user selection of a particular call in the call stack or a latency indicator causes one or more corresponding log entries to be emphasized or filtered. The call stack and the one or more latency indicators can have various display configurations.

Abstract: A cloud computing environment provides the ability to deploy a web application that has been developed using one of a plurality of application frameworks and is configured to execute within one of a plurality of runtime environments. The cloud computing environment receives the web application in a package compatible with the runtime environment and dynamically binds available services by appropriately inserting service provisioning data into the package. The cloud computing environment then packages an instance of the runtime environment, a start script and the package into a web application deployment package, which is then transmitted to an application. The application container unpacks the web application deployment package, installs the runtime environment, loads the web application package into the runtime environment and starts the start script, thereby deploying the web application in the application container.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating configuration files using executable template language statements. One of the methods includes receiving a configuration template file for a structured configuration language that defines nodes, relationships between nodes, and, for each of one or more nodes, associates metadata with the node. A reserved character pattern is identified in the configuration template file attached to text that defines a node in the structured configuration language, wherein the reserved character pattern has one or more associated statements in an executable template language. A graph representation is generated that includes the node corresponding to the text. Statements in the executable template language associated with the reserved character pattern are executed to generate associated metadata for the node.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for receiving a request to generate a backup of a distributed computing system; generating, by each of the plurality of components of the distributed computing system, one or more backup artifacts; generating, by each of the plurality of components of the distributed computing system, verification data, the verification data being metadata about the contents of the generated backup artifacts; obtaining a second request to validate the backup; provisioning a restore environment; processing the plurality of backup artifacts to restore the plurality of components in the provisioned restore environment; performing a verification process using respective verification data for the restored component, wherein each verification process determines whether contents of the restored component matches the respective verification data for the restored component; and outputting a result of the verification process.

Abstract: Systems, methods, and computer program products of distributing sorted sets to multiple nodes of a distributed in-memory database system are described. The distributed in-memory database system is a database system based on key-value pairs. The system receives data records including user data and scores for sorting. The system maps the user data to keys in the key-value pairs. The system maps the scores to the values in the key-value pairs. The system then distributes the mapped key-value pairs to the nodes. The distributed in-memory database system is indexed on the values.

Abstract: A policy engine is situated within the communications path of a cloud computing environment and a user of the cloud computing environment to comply with an organization's policies for deploying web applications in the cloud computing environment. The policy engine intercepts communications packets to the cloud computing environment from a user, such as a web application developer, for example, in preparation for deploying a web application in the cloud computing environment. The policy engine identifies commands corresponding to the communications packets and directs the communications packets to appropriate rules engines corresponding to such commands in order to execute rules to comply with an organization's policies. Upon completion of execution of the rules, the communications packets are forwarded to the cloud computing environment if they comply with the policies.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for stream processing. One method includes receiving an event stream of events by a first plurality of local modelers of a stream processing system. Each local modeler processes a portion of received events of the event stream according to a first set of operations, the operations including aggregating information associated with each event to generate aggregated information. One or more local modelers provide, to a first central modeler executing on the system, the respective aggregated information generated by one or more of the local modelers. A set of parameters of a respective machine learning model is determined using the received aggregated information.

Abstract: Logs emitted in a cloud application platform can be cached. Log events emitted by one or more log emitters in the cloud application platform are received. Cache-allocation data that specifies, for each log emitter, a quota for storing log-event data for the log emitter is maintained. For each log emitter of a plurality of log emitters in the cloud application platform, a respective local cache of log events in computer memory is maintained. A global cache for all of the plurality of log emitters in the system is maintained. Each node in the global cache represents a different respective local cache.

Abstract: Methods, systems, and computer-readable media for managing license compliance in software development. A license analyzer receives a triggering event for analyzing license obligations associated with a software package. In response, the license analyzer performs a first scan on dependencies in the software package to determine libraries included in the software package and declared licenses in the included libraries. The license analyzer performs a second scan on source files in the software package to detect, based on license indicators present in the source files, licenses implicitly used in the software package. The license analyzer generates a compliance document specifying the license obligations based on results of the scans.

Abstract: Systems, methods, and computer program products for an application to securely record and propagate an invocation context for invoking other applications are described. The applications being invoked not only receive a user's authentication token, but also authentication tokens of an entire invocation chain. Accordingly, the applications being invoked can verify a chain of custody through verification of nested, cryptographically signed payloads of a chain of authentication tokens. An application can thus verify identities of each application in the chain of custody, as well as the invocation contexts (e. g. the HTTP request method and path) in which each application in the chain invoked the next application.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for computing availability metrics for an integrated service. One of the methods includes generating, for a service installed on a software platform, a plurality of availability logs, each availability log representing an occurrence of the service becoming unavailable. The plurality of availability logs are aggregated according to one or more aggregation criteria. The aggregated availability logs are processed to compute one or more availability metrics for the service, wherein each availability metric quantifies the availability of the service to process requests from the plurality of workloads in the presence of system failures and interruptions. An availability rating for the service is computed from the one or more availability metrics.

Abstract: Methods, systems, and computer programs encoded on computer storage media, for binding service credentials to an application. One example system receives a service bind request for an application in a cloud application platform. The service bind request includes a request to bind a service provided by a service host in the cloud application platform. The service bind request specifies (i) an identifier for the service and (ii) a unique identifier for the application. The system receives, from the service host, credentials for the application to access the service. The system provides the credentials to a secure credential hub installed on the cloud application platform. The secure credential hub stores the credentials in association with a credential location identifier. The system grants, to the unique identifier for the application, read access to the credential location identifier. The system stores the credential location identifier as application metadata for the application.

Abstract: Systems, methods, and computer program products for credential management. An application deployment system receives a deployment manifest for deploying an application in a cloud computing environment. A deployment director of the application deployment system determines a resource to be used by the application. The deployment director determines, from the deployment manifest, an identifier, e.g., a name, of credentials for accessing the resource. The deployment director requests the credentials from a credential manager of the application deployment system. Upon receiving the credentials, the deployment director modifies the deployment manifest by replacing the identifier with the received credentials. The application deployment system deploys the application using the modified deployment manifest and then deletes the modified deployment manifest.

Abstract: This specification describes methods, systems, and computer readable media for representing progresses of multiple projects in an integrated progress view. In an integrated progress view, visual indicators can represent a respective degree of completion of each project, as well as additional information on the project. The additional information indicates velocity of the progresses and resources used to achieve the velocity. Measurements of completion, including milestones achieved in and resources consumed by each project, are individually configurable in a distributed manner. For example, a user interface can allow a first project manager to configure how to measure progress of a first project, and a second project manager to configure how to measure progress of a second project. The integrated progress view can provide a summary view of progresses of the projects, even when measurements of the progresses are configured differently.