Abstract: A distributed object store can expose object metadata, in addition to object data, to distributed processing systems, such as Hadoop and Apache Spark. The distributed object store may acts as a Hadoop Compatible File System (HCFS), exposing object metadata as a collection of records that can be efficiently processed by MapReduce (MR) and other distributed processing frameworks. Various metadata records formats are supported. Related methods are also described.

Abstract: In one aspect, a method includes determining an allocation of nodes in a cluster to application containers using a node capacity and a policy, publishing the allocation to a coordinator, the coordinator configured to manage the nodes comprising a first node, reading the allocation from the coordinator and instructing a container manager in the first node to generate an application container in the first node conforming to the allocation.

Abstract: A distributed object store can expose object metadata, in addition to object data, to distributed processing systems, such as Hadoop and Apache Spark. The distributed object store may acts as a Hadoop Compatible File System (HCFS), exposing object metadata as a collection of records that can be efficiently processed by MapReduce (MR) and other distributed processing frameworks. A distributed processing job can specify a metadata query to narrow the set of objects returned. Related methods are also described.

Abstract: In an environment that includes a host computing system that executes virtual machines, and a secure cloud computing channel that communicatively couples the host to a client computing system that is assigned to a particular one of the virtual machines, the particular virtual machine generates a certificate, install the certificate on the itself, and returns a certificate representation to the client. This may occur when the virtual machine is provisioned. During a subsequent connection request from the client to the virtual machine, the virtual machine returns the certificate to the client. The client compares the certificate representation that was returned during provisioning with the certificate returned during the subsequent connection, and if there is a match, then the virtual machine is authenticated to the client. Thus, in this case, the virtual machine authenticates without the client having to generate, install, and manage security for a certificate.

Abstract: In one aspect, a method includes associating disk devices with containers based on a policy, allocating a disk device to a container based on the policy and allowing access to the disk device from the container. In another aspect, an apparatus includes electronic hardware circuitry configured to associate disk devices with containers based on a policy, allocate a disk device to a container based on the policy and allow access to the disk device from the container. In a further aspect, an article includes a non-transitory computer-readable medium that stores computer-executable instructions. The instructions cause a machine to associate disk devices with containers based on a policy, allocate a disk device to a container based on the policy and allow access to the disk device from the container.

Abstract: Uploading storage data. A method includes determining a file protocol for a local file including determining sparseness for the local file. Based on the sparseness for the local file, the local file is uploaded to a remote service, while preserving sparseness by not uploading data that the remote service can imply based on the sparseness.

Abstract: Updating a remote storage data set. A method includes, from a local service providing a hint of a remote storage data set that may exist at a remote service. An indication is received from the remote service that the remote storage data set exists at the remote service. The method includes requesting that the remote storage data set be copied at the remote service to a copy of the remote storage data set. A change to be applied to the copy of the remote storage data set is sent to the remote service.

Abstract: The provisioning of a virtual machine when booted from virtual storage. During virtual machine boot from an image, the virtual machine detects storage media. The virtual machine acquires a provisioning agent and provisioning data from the detected storage media. The virtual machine uses the provisioning data to provision itself, and executes the provisioning agent. The provisioning agent may monitor the progress of the provisioning and/or report a status of the provisioning. The virtual machine may operate in a cloud computing environment, the status of the provisioning agent being returned to the user through the cloud environment. The user need not generate the provisioning data in a format readable by the virtual machine. Instead, perhaps some naturally entered user input is used to automatically generate the properly formatted provisioning data using perhaps a service in the cloud.

Abstract: The replication of an asset from a source cluster in a source data center to multiple target clusters in multiple destination data centers. The replication occurs by first estimating or determining a cost parameter associated with copying of the asset from the source cluster to each of at least some of the target clusters. As an example, the cost parameter might be a geographical parameter, but might also be any cost parameter such as a channel bandwidth, channel cost, utilization ratio or the like. Based on the cost parameters, an order of replication priority is determined. Then, the replication is initiated in accordance with the prioritization. The replication may occur in multiple phases, and replication prioritization may occur on a per phase basis.

Abstract: In an environment that includes a host computing system that executes virtual machines, and a secure cloud computing channel that communicatively couples the host to a client computing system that is assigned to a particular one of the virtual machines, the particular virtual machine generates a certificate, install the certificate on the itself, and returns a certificate representation to the client. This may occur when the virtual machine is provisioned. During a subsequent connection request from the client to the virtual machine, the virtual machine returns the certificate to the client. The client compares the certificate representation that was returned during provisioning with the certificate returned during the subsequent connection, and if there is a match, then the virtual machine is authenticated to the client. Thus, in this case, the virtual machine authenticates without the client having to generate, install, and manage security for a certificate.

Abstract: In an environment that includes a host computing system that executes virtual machines, and a secure cloud computing channel that communicatively couples the host to a client computing system that is assigned to a particular one of the virtual machines, the particular virtual machine generates a certificate, install the certificate on the itself, and returns a certificate representation to the client. This may occur when the virtual machine is provisioned. During a subsequent connection request from the client to the virtual machine, the virtual machine returns the certificate to the client. The client compares the certificate representation that was returned during provisioning with the certificate returned during the subsequent connection, and if there is a match, then the virtual machine is authenticated to the client. Thus, in this case, the virtual machine authenticates without the client having to generate, install, and manage security for a certificate.

Abstract: The replication of an asset from a source cluster in a source data center to multiple target clusters in multiple destination data centers. The replication occurs by first estimating or determining a cost parameter associated with copying of the asset from the source cluster to each of at least some of the target clusters. As an example, the cost parameter might be a geographical parameter, but might also be any cost parameter such as a channel bandwidth, channel cost, utilization ratio or the like. Based on the cost parameters, an order of replication priority is determined. Then, the replication is initiated in accordance with the prioritization. The replication may occur in multiple phases, and replication prioritization may occur on a per phase basis.

Abstract: Uploading storage data. A method includes determining a file protocol for a local file including determining sparseness for the local file. Based on the sparseness for the local file, the local file is uploaded to a remote service, while preserving sparseness by not uploading data that the remote service can imply based on the sparseness.

Abstract: The provisioning of a virtual machine when booted from virtual storage. During virtual machine boot from an image, the virtual machine detects storage media. The virtual machine acquires a provisioning agent and provisioning data from the detected storage media. The virtual machine uses the provisioning data to provision itself, and executes the provisioning agent. The provisioning agent may monitor the progress of the provisioning and/or report a status of the provisioning. The virtual machine may operate in a cloud computing environment, the status of the provisioning agent being returned to the user through the cloud environment. The user need not generate the provisioning data in a format readable by the virtual machine. Instead, perhaps some naturally entered user input is used to automatically generate the properly formatted provisioning data using perhaps a service in the cloud.

Abstract: In an environment that includes a host computing system that executes virtual machines, and a secure cloud computing channel that communicatively couples the host to a client computing system that is assigned to a particular one of the virtual machines, the particular virtual machine generates a certificate, install the certificate on the itself, and returns a certificate representation to the client. This may occur when the virtual machine is provisioned. During a subsequent connection request from the client to the virtual machine, the virtual machine returns the certificate to the client. The client compares the certificate representation that was returned during provisioning with the certificate returned during the subsequent connection, and if there is a match, then the virtual machine is authenticated to the client. Thus, in this case, the virtual machine authenticates without the client having to generate, install, and manage security for a certificate.

Abstract: Updating a remote storage data set. A method includes, from a local service providing a hint of a remote storage data set that may exist at a remote service. An indication is received from the remote service that the remote storage data set exists at the remote service. The method includes requesting that the remote storage data set be copied at the remote service to a copy of the remote storage data set. A change to be applied to the copy of the remote storage data set is sent to the remote service.