Abstract: Secured data access in virtual data processing is described. An example includes instructions to receive a request from an application in a compute node of a compute cluster in a virtual data processing environment to access a secured data source for a user, the virtual data processing environment including a multiple secured data sources that are accessible by compute nodes of the virtual compute cluster; fetch a credential in a current application context and forward the credential for validation; validate the credential with a credential authority; and, upon successfully validating the credential, authenticate the user at the secured data source and establish a connection with the secured data source.

Abstract: The present disclosure describes aspects for providing Quality of Service (QoS) over a virtual interface for solid-state storage. In some aspects, a storage media switch receives, from a host device, an input/output (I/O) command for data access including an identifier for a virtual interface associated with a namespace through which solid-state storage is accessible. The switch determines an amount of the data that the I/O command will access through the namespace. A determination is made whether the amount of data that the I/O command will access through the namespace exceeds a predefined threshold for data access through that namespace. In response to determining that the amount of data does not exceed the predefined threshold, the I/O command is released to the solid-state storage to enable the data access. By so doing, the switch may provide QoS for the virtually accessed solid-state storage based on an access parameter of the namespace.

Abstract: Described herein are systems, methods, and software to enhance the allocation of cache resources to virtual nodes. In one implementation, a configuration system in large-scale processing environment is configured to identify a request to initiate a large-scale processing framework (LSPF) cluster, wherein the LSPF cluster comprises a plurality of virtual nodes, and identify host computing resources of a host computing system allocated to each virtual node of the LSPF cluster. The configuration system further allocates cache memory of a cache service to each of the virtual nodes based on the host computing resources, and initiate the LSPF cluster in the computing environment.

Abstract: The present disclosure describes aspects for providing Quality of Service (QoS) over a virtual interface for solid-state storage. In some aspects, a storage media switch receives, from a host device, an input/output (I/O) command for data access including an identifier for a virtual interface associated with a namespace through which solid-state storage is accessible. The switch determines an amount of the data that the I/O command will access through the namespace. A determination is made whether the amount of data that the I/O command will access through the namespace exceeds a predefined threshold for data access through that namespace. In response to determining that the amount of data does not exceed the predefined threshold, the I/O command is released to the solid-state storage to enable the data access. By so doing, the switch may provide QoS for the virtually accessed solid-state storage based on an access parameter of the namespace.

Abstract: Systems, methods, and software described herein facilitate an enhanced service architecture for large-scale data processing. In one implementation, a method of providing data to a large-scale data processing architecture includes identifying a data request from a container in a plurality of containers executing on a host system, wherein the plurality of containers each run an instance of a large-scale processing framework. The method further provides identifying a storage repository for the data request, and accessing data associated with the data request from the storage repository. The method also includes caching the data in a portion of a cache memory on the host system allocated to the container, wherein the cache memory comprises a plurality of portions each allocated to one of the plurality of containers.

Abstract: Described herein are systems, methods, and software to enhance the allocation of cache resources to virtual nodes. In one implementation, a configuration system in large-scale processing environment is configured to identify a request to initiate a large-scale processing framework (LSPF) cluster, wherein the LSPF cluster comprises a plurality of virtual nodes, and identify host computing resources of a host computing system allocated to each virtual node of the LSPF cluster. The configuration system further allocates cache memory of a cache service to each of the virtual nodes based on the host computing resources, and initiate the LSPF cluster in the computing environment.

Abstract: Systems, methods, and software described herein facilitate an enhanced service architecture for large-scale data processing. In one implementation, a method of providing data to a large-scale data processing architecture includes identifying a data request from a container in a plurality of containers executing on a host system, wherein the plurality of containers each run an instance of a large-scale processing framework. The method further provides identifying a storage repository for the data request, and accessing data associated with the data request from the storage repository. The method also includes caching the data in a portion of a cache memory on the host system allocated to the container, wherein the cache memory comprises a plurality of portions each allocated to one of the plurality of containers.

Abstract: Systems, methods, and software described herein facilitate a cache service that allocates shared memory in a data processing cluster based on quality of service. In one example, a method for operating a cache service includes identifying one or more jobs to be processed in a cluster environment. The method further provides determining a quality of service for the one or more jobs and allocating shared memory for the one or more jobs based on the quality of service.