Abstract: A storage system monitors the first access frequency of occurrence which is the access frequency of occurrence from a host device during a first period, and the second access frequency of occurrence which is the access frequency of occurrence from a host device during a second period shorter than the first period. Along with performing data relocation among the tiers (levels) in the first period cycle based on the first access frequency of occurrence, the storage system performs a decision whether or not to perform a second relocation based on the first access frequency of occurrence and the second access frequency of occurrence, synchronously with access from a host device. Here the threshold value utilized in a decision on whether or not to perform the first relocation is different from the threshold value utilized in a decision on whether or not to perform the second relocation.

Abstract: A storage device for providing data storage services to a source host and a destination host includes persistent storage and a controller. The controller obtains a handoff initiation request for a handoff of storage resources of the persistent storage allocated to the source host, the handoff initiation request specifies that the storage resource is to be handed off to the destination host; in response to obtaining the handoff initiation request: quiesces the storage resource; terminates use of the storage resource by the source host after quiescing the storage resource; after terminating the use of the storage resource by the source host, connects the destination host to the storage resource; and after connecting the destination host to the storage resource, enables use of the storage resource by the destination host.

Abstract: A system divides non-volatile memory of a plurality of storage devices into physical extents which comprises chunks. The system allocates slabs associated with the storage devices, wherein a respective slab comprises extents from different storage devices and further comprises stripes. A stripe comprises a chunk from each extent of the respective slab. The system updates, in a first data structure, an entry which indicates: a slab number for the respective allocated slab; and a storage device identifier and an extent number for each extent in the respective allocated slab. Responsive to receiving a write request, the system obtains a first stripe from a pre-allocated list which includes the allocated slabs. The system searches, based on stripe information associated with the first stripe, the first data structure to obtain a physical location in a storage device to which to issue the write request.

Abstract: A host-managed storage device includes an offload capability that enables the host to offload all or a portion of a defrag operation to the storage device. Rather than issuing read, write or copy operations and commands to relocate data to the host's DRAM, the host assembles a defrag operation command descriptor for the storage device controller. The command descriptor includes a defrag bitmap that can be directly accessed by the storage device controller to conduct the defrag operation entirely on the storage device at band granularity, without consuming host CPU cycles or host memory. The reduction in host operations/commands achieved by offloading defragmentation to the storage device is on the order of at least a thousand-fold reduction.

Abstract: An intelligent data partitioning engine processes instructions to monitor an input queue of a cluster computing framework processing on a distributed computing system. The intelligent data partitioning engine calculates data requirements for processing of one or more program files in the input queue and determines, based on a block size and available processing resources of a plurality of nodes of the distributed computing system, a number of data partitions. Based on the data partitions, the intelligent data partitioning engine triggers execution of the one or more program files by the cluster computing framework, where the cluster computing framework is configured based on the block size and the number of data partitions and updates the data requirements for processing of the one or more program files based on feedback from the cluster computing framework corresponding to one or more previous processing runs of the one or more program files.

Abstract: Methods, apparatus, and processor-readable storage media for determining migrations between geographically distributed data centers are provided herein. An example computer-implemented method includes obtaining information associated with data centers that are geographically distributed relative to one another, wherein the information includes: information related to migration factors specific to the respective geographic location of each of the data centers and information related to a respective set of processes of each of the data centers; automatically generating a migration schedule based at least in part on the obtained information, wherein the migration schedule comprises one or more times for migrating at least one of the processes of a first one of the data centers to a second one of the data centers; and automatically triggering at least one migration of the at least one process between the data centers based at least in part on the migration schedule.

Abstract: A storage control device, includes a memory; and a processor coupled to the memory and the processor configured to: when receiving a first response that includes first information from a control device, generate a second response that includes second information by converting the first response, transmit, to a host device, the second response, and when detecting that a first recording device is removed from a slot and a second recording device is mounted in the slot, update, by using the first information of the first recording device associated with the second information, the first information of the second recording device.

Abstract: A geographically distributed erasure coding system includes multiple computer readable, non-transitory storage memories capable of storing a digital dataset including multiple object blocks, where each storage memory is configured to store one or more of the object blocks of the dataset according to an erasure coding policy. The system includes one or more processors configured to implement the erasure coding policy by distributing the multiple object blocks of the dataset to the multiple storage memories according to distribution criteria of the erasure coding policy, and the distribution criteria include at least one status parameter associated with each storage memory. The multiple storage memories are geographically distributed at different locations from one another.

Abstract: A file management method, a distributed storage system, and a management node are disclosed. In the distributed storage system, after receiving a file creation request sent by a host for requesting to create a file in a distributed storage system, a management node allocates, to the file, first virtual space from global virtual address space of the distributed storage system, where local virtual address space of each storage node in the distributed storage system is corresponding to a part of the global virtual address space. Then, the management node records metadata of the file, where the metadata of the file includes information about the first virtual space, and the information about the first virtual space is used to point to local virtual address space of a storage node that is used to store the file. Further, the management node sends, the information about the first virtual space to the host.

Abstract: Embodiments of the present disclosure relate to a memory system and an operating method thereof. According to the embodiments of the present disclosure, the memory system may include a plurality of cores, a control core, and a shared memory. When processing the event, the control core may select a first core executing a target job requiring distributed execution among the plurality of cores, and the first core may run a first firmware among the plurality of firmwares to execute the target job. The control core may select a second core to execute the target job together with the first core, and may control the second core to run the first firmware. The control core may control the first core and the second core to perform distributed execution of the target job.

Abstract: Reading data stored at a free block of a storage device is read prior to allocating the free block for storage of data. A determination as to whether a number of bit flips of the data stored at the free block is below a threshold is made. The free block is added to a pool of active free blocks to be allocated for the storage of data upon determining that the number of bit flips of the data stored at the free block is below the threshold.

Abstract: Allocation of parity data storage extents for a virtual RAID is disclosed. A virtual RAID can be enabled by a virtual storage device pool (VSDP) mapped to a physical storage device pool (PSDP) that can comprise physical extents of physical disks. In an aspect, the physical disks can be co-located, remotely located, or combinations thereof. Mapping of the VSDP can enable allocation of virtual extents in a virtual RAID that can, for example, emulate a RAID4 while still providing parity data storage diversity that can, for example, emulate RAID5, RAID6, etc. Moreover, the disclosed subject matter can support proactive wear leveling, for example, based on historical storage of parity data via an extent, e.g., extents previously used to store parity data. Furthermore, the disclosed subject matter can support active wear leveling.

Abstract: A computer-implemented method for providing tenant aware, variable length, deduplication of data stored on a non-transitory computer readable storage medium is described here. The method is performed at least in part by circuitry and the data comprises a plurality of data items. Each of the plurality of data items is associated with a particular tenant of a group of tenants that store data on the storage medium. In addition, a data deduplication data storage medium made up of one or more tenant storage areas and a deduplicated block database stored on the data deduplication data storage medium is described. The tenant storage areas comprise a plurality of data items, where each data item comprises a plurality of item blocks and each item block comprises a pointer to a storage location in a deduplicated block database.

Abstract: Systems and methods for providing any point in time functionality. With a storage system such as a VSAN, any point in time protection is achieved by combining a metadata stream with snapshots of the storage system. This allows snapshots to be generated in hindsight such that any point in time functionality is provided.

Abstract: Techniques for provisioning storage may include: initially provisioning storage for a storage group of logical devices; tagging the storage group to enable autonomous storage provisioning; receiving a plurality of parameters used in connection with performing autonomous storage provisioning for the storage group, wherein the plurality of parameters includes a first parameter denoting a threshold amount of consumed storage of the storage group, a second parameter denoting a storage capacity expansion amount by which to expand the storage capacity of the storage group, and a third parameter denoting a system-wide threshold of consumed backend non-volatile storage; determining, in accordance with the plurality of parameters, whether to expand a current storage capacity of the storage group; and responsive to determining to expand the current storage capacity of the storage group, performing first processing to automatically expand the current storage capacity of the storage group in accordance with the second pa

Abstract: One aspect facilitates a global map in a distributed system. The system generates a first data structure which comprises key-value pairs, wherein, in a respective key-value pair, the respective key is an integer and the respective value comprises a pointer to a sparse array which includes a bitmap (such as an ordered two-bit bitmap). The system stores the first data structure as a first partition of the global map. The system searches, based on a pattern, the first data structure to obtain a first value. If the first value comprises a two-bit bitmap, the system converts, based on the pattern, the first value to a two-dimensional bitmap, and performs a function on the first value to obtain a first result. The system uses the first value or the first result as metadata to execute a read or write operation in a filesystem associated with the distributed system.

Abstract: An information processing apparatus and method capable of minimizing influences affecting business activities and dynamically changing the configuration of a storage apparatus in response to scale-out of hosts are proposed.

Abstract: Disclosed is a computing system which includes a storage device and a host. The storage device may include a nonvolatile memory, and the host may control the storage device based on a physical address of the nonvolatile memory and may send an asynchronous event request command to the storage device. The storage device may monitor the nonvolatile memory and may send an asynchronous event request corresponding to the asynchronous event request command to the host based on the monitoring result. The asynchronous event request may include requesting another command from the host based on the monitoring result. In some aspects, the host may send an erase command for erasing to erase a selected memory block of the nonvolatile memory to the storage device. In response, the storage device may send an erase pass response or an erase delay violation response to the host in response to the erase command.

Abstract: A storage system performing an overwrite, a host system controlling the storage system, and an operating method of the storage system, wherein the storage system includes a memory device; and a controller that receives new data and an overwrite request from the host system, wherein the overwrite request includes a first logical address for old data and a second logical address for the new data, and performs an overwrite operation by writing the new data corresponding to the second logical address to the memory device and invalidating the old data corresponding to the first logical address according to the overwrite request.

Abstract: Method and system are provided for storage allocation enhancement of microservices. A method carried out at a microservice orchestrator, includes: identifying distinct phases of a run of a microservice container; categorizing the phases of a run of a microservice container, wherein the categorization defines a predicted storage behavior of the microservice container input/output operations in the phase of the microservice container; and providing the categorization in association with the microservice container input/output operations in the phase to a storage system for use in storage allocation of the input/output operations.