Abstract: Disclosed is a storage management system comprising: sending, by a user device manager running at a user space of an operating system, a first request for partition table data to a block device; receiving, by the user device manager, first partition data of the block device; sending, by the user device manager, a second request for partition data of the block device to a kernel of the operating system; receiving, by the user device manager, second partition data from the kernel, wherein the second partition data is associated with the block device and cached by the kernel; determining whether the first partition data and the second partition data are identical; and in response to determining that the first partition data is different from the second partition data, performing a device discovery operation on the block device.

Abstract: A method of adding a disk in a redundant array of independent disks (RAID) system with a protection pool of storage units includes receiving a request to add a new physical disk to a storage cluster and partitioning the new physical disk into a set of physical extents. The method further includes allocating one or more physical extents of the set of physical extents of the new physical disk to at least one array of physical extents, wherein the array of physical extents is distributed across physical disks of the storage cluster.

Abstract: A method of performing a reconstruction of data in a redundant array of independent disks (RAID) system with a protection pool of storage units includes receiving a request to perform a reconstruction of a first set of physical extents stored on a first physical disk of a set of physical disks. Each physical extent of the first set of physical extents is associated with an array of a second set of physical extents. The second set of physical extents is distributed across the set of physical disks. The method further includes allocating a third set of physical extents on one or more physical disks of the set of physical disks other than the first physical disk, and distributing data from each of the first set of physical extents of the first physical disk to a corresponding physical extent of the third set of physical extents.

Abstract: A first node of a plurality of nodes is determined based on a node UID that is included in a physical extent (PE) universally unique identifier (UUID). Each of the plurality of nodes includes one or more groups of arrays. A local disk manager (LDM) that is associated with the first node is identified based on an LDM UID that is included in the PE UUID. The LDM manages a physical disk that includes a plurality of physical extents. A disk object is obtained based on a disk UID that is included in the PE UUID. The disk object is used to access a physical extent (PE) of the physical disk, using a PE offset that is included in the PE UUID. Other embodiments are described and claimed.

Abstract: A method, apparatus, and system for processing Redundant Array of Independent Disks (RAID) Input/Output (I/O) requests for a plurality of nodes in a cluster is disclosed. A file system request including a byte offset is received. Then, a Physical Extent (PE) row that matches the file system request and a RAID stripe within the identified PE row based on the byte offset is identified. Next, a plurality of RAID I/O requests to be routed to a physical disk is generated. Each of the plurality of the RAID I/O requests includes information associated with the PE and a type of operation. Thereafter, each of the RAID I/O requests is processed based on the information associated with the PE and the type of operation.

Abstract: A method of reassembling a local disk manager (LDM) and array group (AGRP) includes starting a physical extent manager (PEM) configured to run on a number of nodes. The PEM on each node is configured to manage an AGRP running on the same node. A number of LDMs are reassembled, and each LDM is configured to manage virtual disks on each of the nodes. Once enough LDMs are reassembled, an AGRP can be reassembled.

Abstract: A method of performing a migration of a physical extent in a redundant array of independent disks (RAID) storage system with a protection pool of storage units includes identifying a first physical extent of a first physical disk to be migrated to a second physical disk, wherein the first physical extent is associated with an array of physical extents distributed across physical disks of a storage cluster. The method further includes assigning a second physical extent from the second physical disk to the array to replace the first physical extent and migrating data from the first physical extent of the first physical disk to the second physical extent of the second physical disk.

Abstract: A method of managing extents of a file system having a protection pool includes collecting and initializing physical extent manager (PEM) metadata, using a PEM daemon thread. The PEM is configured to run on each of a number of nodes. The method also includes creating a request queue, using the PEM daemon thread, for all requests submitted to the PEM. The method also includes scanning the request queue, using a PEM worker thread, to handle incoming requests submitted to the PEM. The method also includes listening for multicast messages, using a PEM multicast listener thread, to be handled by the PEM worker thread.

Abstract: A first node of a plurality of nodes is determined based on a node UID that is included in a physical extent (PE) universally unique identifier (UUID). Each of the plurality of nodes includes one or more groups of arrays. A local disk manager (LDM) that is associated with the first node is identified based on an LDM UID that is included in the PE UUID. The LDM manages a physical disk that includes a plurality of physical extents. A disk object is obtained based on a disk UID that is included in the PE UUID. The disk object is used to access a physical extent (PE) of the physical disk, using a PE offset that is included in the PE UUID. Other embodiments are described and claimed.

Abstract: A method of performing a full data reconstruction in a redundant array of independent disks (RAID) system with a protection pool of storage units includes determining that a physical disk of a storage cluster has been removed from service. The physical disk includes a set of physical extents and at least one physical extent of the set of physical extents is associated with an array of physical extents distributed across physical disks of the storage cluster. The method further includes transmitting a message to of the physical disks, to allocate replacement physical extents and assign the replacement physical extents to the array of physical extents and initiating reconstruction of data from the set of physical extents of the physical disk to the replacement physical extents.

Abstract: A storage node can include one or more processors and one or more storage disks, where the one or more storage disks include one or more local physical extents (PEs) that are local to the storage node. The storage node can include a protection pool driver executed by the one or more processors to run in a kernel space of the storage node, where the protection pool driver includes a local disk manager (LDM) and an array group module (AGRP). The LDM can be configured to manage the one or more local PEs at the one or more storage disks. The AGRP can include a number of storage arrays, where each of the storage arrays includes one or more virtual disks, where each of the one or more virtual disks is associated to at least a local PE or an external PE external to the storage node.

Abstract: A method of performing a reconstruction of data in a redundant array of independent disks (RAID) system with a protection pool of storage units includes receiving a request to perform a reconstruction of a first set of physical extents stored on a first physical disk of a set of physical disks. Each physical extent of the first set of physical extents is associated with an array of a second set of physical extents. The second set of physical extents is distributed across the set of physical disks. The method further includes allocating a third set of physical extents on one or more physical disks of the set of physical disks other than the first physical disk, and distributing data from each of the first set of physical extents of the first physical disk to a corresponding physical extent of the third set of physical extents.

Abstract: A method of managing extents of a file system having a protection pool includes collecting and initializing physical extent manager (PEM) metadata, using a PEM daemon thread. The PEM is configured to run on each of a number of nodes. The method also includes creating a request queue, using the PEM daemon thread, for all requests submitted to the PEM. The method also includes scanning the request queue, using a PEM worker thread, to handle incoming requests submitted to the PEM. The method also includes listening for multicast messages, using a PEM multicast listener thread, to be handled by the PEM worker thread.

Abstract: A method of adding a disk in a redundant array of independent disks (RAID) system with a protection pool of storage units includes receiving a request to add a new physical disk to a storage cluster and partitioning the new physical disk into a set of physical extents. The method further includes allocating one or more physical extents of the set of physical extents of the new physical disk to at least one array of physical extents, wherein the array of physical extents is distributed across physical disks of the storage cluster.

Abstract: A method of performing a migration of a physical extent in a redundant array of independent disks (RAID) storage system with a protection pool of storage units includes identifying a first physical extent of a first physical disk to be migrated to a second physical disk, wherein the first physical extent is associated with an array of physical extents distributed across physical disks of a storage cluster. The method further includes assigning a second physical extent from the second physical disk to the array to replace the first physical extent and migrating data from the first physical extent of the first physical disk to the second physical extent of the second physical disk.

Abstract: A method of reassembling a local disk manager (LDM) and array group (AGRP) includes starting a physical extent manager (PEM) configured to run on a number of nodes. The PEM on each node is configured to manage an AGRP running on the same node. A number of LDMs are reassembled, and each LDM is configured to manage virtual disks on each of the nodes. Once enough LDMs are reassembled, an AGRP can be reassembled.

Abstract: A redundant array of independent disks (raid) array can include one or more virtual disks representing a raid configuration of the raid array. Each of the one or more virtual disks includes a number of physical extents (PEs), where a first PE and a second PE of the PEs have a same size. The first PE is located at a first storage disk of a first storage node of a cluster and the second PE is located at a second storage disk of a second storage node of the cluster.

Abstract: A method, apparatus, and system for processing Redundant Array of Independent Disks (RAID) Input/Output (I/O) requests for a plurality of nodes in a cluster is disclosed. A file system request including a byte offset is received. Then, a Physical Extent (PE) row that matches the file system request and a RAID stripe within the identified PE row based on the byte offset is identified. Next, a plurality of RAID I/O requests to be routed to a physical disk is generated. Each of the plurality of the RAID I/O requests includes information associated with the PE and a type of operation. Thereafter, each of the RAID I/O requests is processed based on the information associated with the PE and the type of operation.

Abstract: A system, method and computer program for allocating physical memory from a group of N memory devices to logical volumes. A group of N memory devices are partitioned into a plurality of bands, each of the group of N memory devices sharing a portion of each of the plurality of bands. A cluster map for each of the plurality of bands is generated. The cluster maps indicate the physical address for each of a plurality of clusters. Each of the plurality of clusters are distributed equally over two or more of the N memory devices to ensure a specified level of redundancy for each of the plurality of bands. Each of the N memory devices share an approximately equal number of clusters. Available bands are determined and are allocated to a logical volume.

Abstract: A system, method and computer program for allocating physical memory from a group of N memory devices to logical volumes. A group of N memory devices are partitioned into a plurality of bands, each of the group of N memory devices sharing a portion of each of the plurality of bands. A cluster map for each of the plurality of bands is generated. The cluster maps indicate the physical address for each of a plurality of clusters. Each of the plurality of clusters are distributed equally over two or more of the N memory devices to ensure a specified level of redundancy for each of the plurality of bands. Each of the N memory devices share an approximately equal number of clusters. Available bands are determined and are allocated to a logical volume.