Abstract: A method, system and program is described for providing virtual storage domains for content addressable system. At least one tenant data storage policy is configured for at least one tenant in a storage system. A virtual storage domain is created based on the tenant data storage policy, each virtual storage domain having a unique identifier (ID). The corresponding virtual storage domain ID is tagged to a data request based on a data set policy when data belonging to a data set gets written to the storage system. A hash signature is calculated for the data taking the data content and the storage domain ID as inputs to calculate the hash signature.

Abstract: Embodiments of the present disclosure provide methods, devices, and computer program products for processing a task. A method of processing a task comprises: receiving, at a network device and from a set of computing devices, a set of processing results derived from processing the task by the set of computing devices; in response to receiving the set of processing results, executing a reduction operation on the set of processing results; and transmitting a result of the reduction operation to the set of computing devices. In this way, embodiments of the present disclosure can significantly reduce an amount of data exchanged among a plurality of devices processing a task in parallel, and thus reduce network latency caused by data exchange.

Abstract: A method comprises: determining whether an event triggering processing of data at a storage device occurs, the data being predetermined to be processed at a computing device associated with the storage device; in response to determining that the event occurs, determining available resources of the storage device; and in response to an amount of the available resources exceeding a first predetermined threshold, causing the storage device to process the data and provide the processed data to the computing device. As such, operations to be performed to data may be adaptively allocated, deployed and adjusted on the storage device and the computing device, so that computing capabilities of both the storage device and the computing device may be fully leveraged, and further the computing efficiency of the entire data processing system may be improved.

Abstract: A method of managing a distributed system comprises: in response to receiving data that changes in a first memory region of a client, updating data in a second memory region with the received data based on a mapping between the first memory region and the second memory region; in response to receiving a calling request for a computing node in a server from the client, causing the computing node to perform a processing step based on the updated data in the second memory region; determining data that changes after the processing step in the second memory region; and transmitting, to the client, the data that changes after the processing step, such that the client updates the data in the first memory region based on the mapping.

Abstract: Embodiments of the present disclosure relate to a method and device for migrating data. The method comprises identifying cold data in a primary storage system. The method further comprises, in response to determining that the cold data is in a non-compression state, obtaining the cold data from the primary storage system via a first interface, the first interface being configured for a user to access the primary storage system. The method further comprises obtaining, in response to determining the cold data is in a compression state, the cold data in the compression state from the primary storage system via a second interface that is different from the first interface. The method further comprises migrating the obtained cold data from the primary storage system to a secondary storage system.

Abstract: Embodiments of the present disclosure relate to a method, device and computer program product for protocol selection. According to embodiments of the present disclosure, a client may determine supported transmission protocols based on its own hardware information and transmit a connection request to a server using a protocol with a higher priority. The server may determine supported protocols based on its own hardware information and respond to the connection request according to the supported protocols. In this way, the establishment of the connection between the client and the server is transparent to users.

Abstract: Embodiments of the present disclosure relate to a method, apparatus and computer program product for scheduling dedicated processing resources. The method comprises: in response to receiving a scheduling request for a plurality of dedicated processing resources, obtaining a topology of the plurality of dedicated processing resources, the topology being determined based on connection attributes related to connections among the plurality of dedicated processing resources; and determining, based on the topology, a target dedicated processing resource satisfying the scheduling request from the plurality of dedicated processing resources. In this manner, the performance and the resource utilization rate of scheduling the dedicated processing resources are improved.

Abstract: Embodiments of the present disclosure relate to a method, a device and a computer program product for managing a distributed system. The method comprises sending heartbeat messages from a master node to a plurality of slave nodes, the master node and the plurality of slave nodes being included in a plurality of nodes in the distributed system, and the plurality of nodes being divided into one or more partitions. The method further comprises, in response to receiving a response to the heartbeat messages from a portion of slave nodes in the plurality of slave nodes, determining respective states of the one or more partitions. In addition, the method further comprises a state of a first slave node in the plurality of slave nodes at least based on the respective states of the one or more partitions, the master node failing to receive a response to the heartbeat messages from the first slave node.

Abstract: A technique versions a configuration of data storage equipment. The technique involves receiving, while the data storage equipment operates in accordance with a first version of the configuration of the data storage equipment, a configuration change command to change the configuration of the data storage equipment. The technique further involves changing the first version of the configuration of the data storage equipment to a second version of the configuration of the data storage equipment in response to the configuration change command. The technique further involves, while the data storage equipment operates in accordance with the second version of the configuration of the data storage equipment, concurrently maintaining access to the first version of the configuration of the data storage equipment and the second version of the configuration of the data storage equipment.

Abstract: An apparatus in one embodiment comprises a host device that includes at least one processor and an associated memory. The host device is configured to implement a plurality of processes each configured to access a shared region of the memory. The host device is further configured to establish a multi-process control group for the shared region, to maintain state information for the multi-process control group, and to track usage of the shared region by the processes based at least in part on the state information. At least a subset of the processes may comprise respective containers implemented utilizing operating system level virtualization of the processor of the host device. The multi-process control group established for the shared region illustratively comprises a coarse-grained control group having a granularity greater than a single page of the shared region.

Abstract: A method is disclosed comprising: generating a plurality of snapshots, each of the snapshots representing a state of one or more storage objects in a storage system; generating a plurality of access pattern records (APRs) for the storage objects, each APR being associated with a different respective one of the plurality of snapshots, each APR indicating a characteristic of workload of the storage system in a period preceding the generation of the APR's associated snapshot; detecting a workload trend for the storage objects, the workload trend being detected by using a workload prediction model that is trained based on the plurality of APRs; and configuring the storage system based on the workload trend, the configuring including allocating additional resources for servicing access requests to the storage objects when the workload trend is a rising workload trend.

Abstract: A client side method for processing a GPU task comprises: receiving a request for the GPU task from an application; determining whether the request relates to a query about an execution state of the GPU task; and in response to the request relating to the query, providing a positive acknowledgement for the query to the application, without forwarding the request to a machine that executes the GPU task. A server side method for processing a GPU task comprises: receiving a request for the GPU task from a machine, the request being irrelevant to a query about an execution state of the GPU task; determining whether processing of the request depends on a processing of a previous request; and in response to the processing of the request depending on the processing of the previous request, suspending the processing of the request until the processing of the previous request is completed.

Abstract: Embodiments of the present disclosure relate to a method, a device and a computer readable medium for generating an image tag. According to the embodiments of the present disclosure, an index value of an image is determined based on contents of the image, similarities between a plurality of images is determined based on index values of the plurality of images, and thereby tags are generated for images. According to the embodiments of the present disclosure, images is further grouped depending on similarities between them.

Abstract: Implementations of the present disclosure relate to a method, apparatus and computer program product for processing a computing task. According to one example implementation of the present disclosure, there is provided a method for processing a computing task, comprising: in response to usage of multiple computing resources indicating that at least one part of computing resources among the multiple computing resources are used, determining a direction of a communication ring between the at least one part of computing resources; in response to receiving a request for processing the computing task, determining the number of computing resources associated with the request; and based on the usage and the direction of the communication ring, selecting from the multiple computing resources a sequence of computing resources which satisfy the number to process the computing task. Other example implementations include an apparatus for processing a computing task and a computer program product thereof.

Abstract: Embodiments of the present disclosure provide a method, a server system and a computer program product of managing resources. The method may comprise receiving a request for a first amount of resources of the dedicated processing unit from an application with an assigned priority. The method may further comprise determining a total amount of resources of the dedicated processing unit to be occupied by the application based on the request. The method may also comprise in response to the total amount approximating or exceeding a predetermined quota associated with the priority, allocating the first amount of resources of the general-purpose processing unit to the application.

Abstract: A target data processing method comprises: in response to receiving, from a client, a request for processing target data, obtaining, at a server and from a storage device, the target data, the target data being predetermined to be obtained by the client from the storage device and a first set of operations being predetermined to be performed on the target data; and processing, at the server, the target data by performing the first set of operations on the target data such that at least one dedicated processing resource of the server performs, on the processed target data, a second set of operations associated with the first set of operations. As such, the data moving path may be shortened significantly, the network traffic pressure may be reduced significantly, the efficiency of the target data processing system may be improved, and moreover, the number of dedicated processing resources in the server may be easily scaled.

Abstract: Systems and methods are provided to implement intelligent data coordination for accelerated computing in a distributed computing environment. For example, a method includes executing a task on a computing node, monitoring requests issued by the executing task, intercepting requests issued by the executing task which correspond to data flow operations to be performed as part of the task execution, and asynchronously executing the intercepted requests at scheduled times to coordinate data flow between resources on the computing node.

Abstract: Embodiments of the present disclosure provide a method, apparatus and computer-readable medium for application scheduling. In accordance with embodiments of the present disclosure, influence factors related to scheduling of a plurality of applications between a plurality of processing units of a computing system are obtained, the plurality of applications being run by at least one of the plurality of processing units. Based on the obtained influence factors, a target application to be scheduled is selected from the plurality of applications and a first processing unit is selected from the plurality of processing units, the first processing unit being different from a second processing unit of the at least one processing unit running the target application. The target application is scheduled from the second processing unit to the first processing unit to continue running of the target application by the first processing unit.

Abstract: Techniques are provided for implementing asynchronous checkpointing of in-memory data in a distributed computing system. For example, a method includes processing a stream of data records by an operator executing on a computing node, maintaining in a system memory, an operator state which is generated in response to the operator processing the stream of data records, and performing an asynchronous checkpointing process. The asynchronous checkpointing process includes enqueuing a checkpoint of the operator state in a first queue, wherein the first queue is maintained in the system memory, and executing a background worker thread to dequeue the checkpoint of the operator state from the first queue and store the checkpoint of the operator state in a data store. The operator continues with processing the stream of data records during the asynchronous checkpointing process.

Abstract: Embodiments of the present disclosure provide a computer-implemented method and an apparatus for a storage system. The method comprises: in response to receiving a read request of a first container for data in a storage device, obtaining an identifier associated with the read request; searching for metadata of the read request in a metadata set based on the identifier, the metadata recording addressing information of the read request, the metadata set including metadata of access requests for the storage device during a past period; and in response to finding the metadata of the read request in the metadata set, determining, based on the metadata, a cached page of a second container storing the data; and providing the cached page from the second container to the first container to avoid reading the data from the storage device.