Abstract: Systems and methods provide a system that gathers information about data as it progresses through data processing pipelines of data analysis projects. The data analytics system derives value indicators and implicit metadata from the data processing pipelines. For example, the data analytics system may derive value indicators and implicit metadata from data-related products themselves, semantic analysis of the code/processing steps used to process the data-related products, the structure of data processing pipelines, and human behavior related to production and usage of data-related products. Once a new data analysis project is initiated, the data analytics system gathers parameters and characteristics about the new data analysis project and references the value indicators and implicit metadata to recommend useful processing steps, datasets, and/or other data-related products for the new data analysis project.

Abstract: In an example, a container cluster management system includes a first node, a second node and redistribution manager. The first node has an allocated external IP address, and comprises a utilization monitor to provide data relating to a utilization of the first node. The redistribution manager may receive the data relating to the utilization of the first node from the first node and determine whether the utilization of the first node has exceeded a predetermined threshold. Responsive to the utilization exceeding the predetermined threshold, the redistribution manager may reallocate the external IP address from the first node to the second node.

Abstract: Systems and methods provide a system that gathers information about data as it progresses through data processing pipelines of data analysis projects. The data analytics system derives value indicators and implicit metadata from the data processing pipelines. For example, the data analytics system may derive value indicators and implicit metadata from data-related products themselves, semantic analysis of the code/processing steps used to process the data-related products, the structure of data processing pipelines, and human behavior related to production and usage of data-related products. Once a new data analysis project is initiated, the data analytics system gathers parameters and characteristics about the new data analysis project and references the value indicators and implicit metadata to recommend useful processing steps, datasets, and/or other data-related products for the new data analysis project.

Abstract: Systems and methods provide a system that gathers information about data as it progresses through data processing pipelines of data analysis projects. The data analytics system derives value indicators and implicit metadata from the data processing pipelines. For example, the data analytics system may derive value indicators and implicit metadata from data-related products themselves, semantic analysis of the code/processing steps used to process the data-related products, the structure of data processing pipelines, and human behavior related to production and usage of data-related products. Once a new data analysis project is initiated, the data analytics system gathers parameters and characteristics about the new data analysis project and references the value indicators and implicit metadata to recommend useful processing steps, datasets, and/or other data-related products for the new data analysis project.

Abstract: Systems and methods provide a system that gathers information about data as it progresses through data processing pipelines of data analysis projects. The data analytics system derives value indicators and implicit metadata from the data processing pipelines. For example, the data analytics system may derive value indicators and implicit metadata from data-related products themselves, semantic analysis of the code/processing steps used to process the data-related products, the structure of data processing pipelines, and human behavior related to production and usage of data-related products. Once a new data analysis project is initiated, the data analytics system gathers parameters and characteristics about the new data analysis project and references the value indicators and implicit metadata to recommend useful processing steps, datasets, and/or other data-related products for the new data analysis project.

Abstract: Embodiments described herein are generally directed to integration of multiple services across multiple clouds within a unified IAM control plane. According to an example, an MSP provides (i) a user interface through which users of multiple tenants are able to configure permissions for and access multiple resources of a set of services associated with a hybrid cloud; and (i) a unified IAM control plane across the set of services, each of which potentially uses a different IAM protocol or scheme. A centralized IAM service is maintained by the MSP containing information regarding the permissions for the resources. Multiple service integrations for the set of services are supported by the MSP, including providing a first set of APIs that facilitate a direct integration with the unified IAM control plane in which the centralized IAM service maintains access control information for resources associated with a first service of the set of services.

Abstract: Embodiments described herein are generally directed to integration of multiple services across multiple clouds within a unified IAM control plane. According to an example, an MSP provides (i) a user interface through which users of multiple tenants are able to configure permissions for and access multiple resources of a set of services associated with a hybrid cloud; and (i) a unified IAM control plane across the set of services, each of which potentially uses a different IAM protocol or scheme. A centralized IAM service is maintained by the MSP containing information regarding the permissions for the resources. Multiple service integrations for the set of services are supported by the MSP, including providing a first set of APIs that facilitate a direct integration with the unified IAM control plane in which the centralized IAM service maintains access control information for resources associated with a first service of the set of services.

Abstract: Examples described herein relate to a system and method for deploying and managing services in tenant clusters using a management cluster. The management cluster includes an integration service in communication with a service controller. The integration service communicates with a service endpoint using privileged credentials for receiving tenant cluster-specific configuration information. The integration service generates access credentials for the new tenant cluster to communicate with the service provider. The integration service provides tenant cluster-specific configuration information and access credentials to the service controller for the deployment of the service in the new tenant cluster. The service controller deploys the service at the new tenant cluster and manages the lifecycle of the service at the new tenant cluster.

Abstract: Examples described herein relate to a system and method for deploying and managing services in tenant clusters using a management cluster. The management cluster includes an integration service in communication with a service controller. The integration service communicates with a service endpoint using privileged credentials for receiving tenant cluster-specific configuration information. The integration service generates access credentials for the new tenant cluster to communicate with the service provider. The integration service provides tenant cluster-specific configuration information and access credentials to the service controller for the deployment of the service in the new tenant cluster. The service controller deploys the service at the new tenant cluster and manages the lifecycle of the service at the new tenant cluster.

Abstract: Examples described herein relate to policy-based logging using workload profiles. A workload profile of a first workload is identified. Based on the workload profile, a logging policy, which includes a predefined log pattern and a predefined log depth, is compiled. Workload log messages of a predetermined log level that are associated with the first workload are stored in a cache memory. On detecting the predefined log pattern in the workload log messages stored in the cache memory, the workload log messages are logged to a log file based on the predefined log depth.

Abstract: Examples described herein relate to policy-based logging using workload profiles. A workload profile of a first workload is identified. Based on the workload profile, a logging policy, which includes a predefined log pattern and a predefined log depth, is compiled. Workload log messages of a predetermined log level that are associated with the first workload are stored in a cache memory. On detecting the predefined log pattern in the workload log messages stored in the cache memory, the workload log messages are logged to a log file based on the predefined log depth.

Abstract: Examples described relate to configuration management systems and updates to packages hosted on an on-premise gateway. In an example, availability of an updated version of a package for each tenant among a plurality of tenants subscribing to the package is determined. The updated version corresponds to a change to at least one of a plurality of service components included in the package. The determination is based on a latest version information of the package, an installed version information of the package for the tenant, and an environment information stored in a plurality of repositories. Each of the plurality of repositories is identified by a repository name indicative of the package and the environment information. The updated version of the package is published for the tenant to be installed on the on-premise gateway and a notification indicative of availability of the updated version is sent to the on-premise gateway.

Abstract: Example implementations relate to data synchronization. According to an example, a system includes a processing system to execute a workload container, the workload container including a user workload application, the user workload application including a sync client; a data storage system, coupled to the processing system, to store user data; and a sync controller to control synchronization of the user data between the sync client and a sync server executing on a customer computing system and pull a selected portion of the user data from the customer computing system to the sync client. The sync client incrementally updates the user data stored on the data storage system with the selected portion of the user data to synchronize the user data between the customer computing system and the cloud computing system.

Abstract: Examples described herein relate to policy management in target environments. A workload attestation request including a workload specification of a workload is received. A workload profile is determined based on the workload specification. A policy stored in a policy database is identified based on the workload profile. An attestation identifier indicating the workload profile is provided in response to the workload attestation request. On receiving a policy request including the attestation identifier from a controller node at a target environment, policies are compiled from the policy database using the attestation identifier, and provided to the controller node, which applies the policy in the target environment.

Abstract: Example techniques for permitting access to cloud computing resources based on tags are described. In an example, a user is permitted to access a resource provided by a cloud computing platform based on a comparison of identifier of the user with an identifier specified in an access tag associated with the resource.

Abstract: Examples described herein relate to an authentication management system and a method for managing authentication of a user between an enterprise-level authentication protocol and a cloud-native authentication protocol. The authentication management system may receive an authentication request from an application hosted on a private on-premise network to authenticate a user using the enterprise-level authentication protocol. The authentication request is generated by the application upon receiving an access request from the user via a software as-a-service (SaaS) cloud platform in a cloud-native authentication protocol. Further, the authentication management system may generate an authentication response compliant with the enterprise-level authentication protocol based on an authentication reply that is formatted in compliance to the cloud-native authentication protocol and received from a cloud-native identity and authentication management system based on the authentication request.

Abstract: Example implementations relate hybrid cloud compliance and remediation service. A hybrid cloud management system may comprise a first service to evaluate a compliance check for a hybrid cloud environment utilizing a framework that corresponds to different cloud services of the hybrid cloud environment, a second service to publish a compliance event based on the compliance check of the first service, and a third service to route the compliance event based on a remediation action determined by the third service, where the first, second, and third services are deployed as services in a cluster.

Abstract: Embodiments described herein are generally directed to integration of multiple services across multiple clouds within a unified IAM control plane. According to an example, an MSP provides (i) a user interface through which users of multiple tenants are able to configure permissions for and access multiple resources of a set of services associated with a hybrid cloud; and (i) a unified IAM control plane across the set of services, each of which potentially uses a different IAM protocol or scheme. A centralized IAM service is maintained by the MSP containing information regarding the permissions for the resources. Multiple service integrations for the set of services are supported by the MSP, including providing a first set of APIs that facilitate a direct integration with the unified IAM control plane in which the centralized IAM service maintains access control information for resources associated with a first service of the set of services.

Abstract: In an example, a container cluster management system includes a first node, a second node and redistribution manager. The first node has an allocated external IP address, and comprises a utilization monitor to provide data relating to a utilization of the first node. The redistribution manager may receive the data relating to the utilization of the first node from the first node and determine whether the utilization of the first node has exceeded a predetermined threshold. Responsive to the utilization exceeding the predetermined threshold, the redistribution manager may reallocate the external IP address from the first node to the second node.

Abstract: In an example, a container cluster management system includes a first node, a second node and redistribution manager. The first node has an allocated external IP address, and comprises a utilization monitor to provide data relating to a utilization of the first node. The redistribution manager may receive the data relating to the utilization of the first node from the first node and determine whether the utilization of the first node has exceeded a predetermined threshold. Responsive to the utilization exceeding the predetermined threshold, the redistribution manager may reallocate the external IP address from the first node to the second node.