Abstract: A system and method for dynamic redistribution of parity groups is described. The system and method for dynamic redistribution of parity groups operates on a computer storage system that includes a plurality of disk drives for storing parity groups. Each parity group includes storage blocks. The storage blocks include one or more data blocks and a parity block that is associated with the data blocks. Each of the storage blocks is stored on a separate disk drive such that no two storage blocks from a given parity set reside on the same disk drive. The computer system further includes a redistribution module to dynamically redistribute parity groups by combining some parity groups to improve storage efficiency.

Abstract: A system and method for dynamic redistribution of parity groups is described. The system and method for dynamic redistribution of parity groups operates on a computer storage system that includes a plurality of disk drives for storing parity groups. Each parity group includes storage blocks. The storage blocks include one or more data blocks and a parity block that is associated with the data blocks. Each of the storage blocks is stored on a separate disk drive such that no two storage blocks from a given parity set reside on the same disk drive. The computer system further includes a redistribution module to dynamically redistribute parity groups by combining some parity groups to improve storage efficiency.

Abstract: A system and method for dynamic redistribution of parity groups is described. The system and method for dynamic redistribution of parity groups operates on a computer storage system that includes a plurality of disk drives for storing parity groups. Each parity group includes storage blocks. The storage blocks include one or more data blocks and a parity block that is associated with the data blocks. Each of the storage blocks is stored on a separate disk drive such that no two storage blocks from a given parity set reside on the same disk drive. The computer system further includes a redistribution module to dynamically redistribute parity groups by combining some parity groups to improve storage efficiency.

Abstract: A system and method for dynamic redistribution of parity groups is described. The system and method for dynamic redistribution of parity groups operates on a computer storage system that includes a plurality of disk drives for storing parity groups. Each parity group includes storage blocks. The storage blocks include one or more data blocks and a parity block that is associated with the data blocks. Each of the storage blocks is stored on a separate disk drive such that no two storage blocks from a given parity set reside on the same disk drive. The computer system further includes a redistribution module to dynamically redistribute parity groups by combining some parity groups to improve storage efficiency.

Abstract: A system and method for dynamic redistribution of parity groups is described. The system and method for dynamic redistribution of parity groups operates on a computer storage system that includes a plurality of disk drives for storing parity groups. Each parity group includes storage blocks. The storage blocks include one or more data blocks and a parity block that is associated with the data blocks. Each of the storage blocks is stored on a separate disk drive such that no two storage blocks from a given parity set reside on the same disk drive. The computer system further includes a redistribution module to dynamically redistribute parity groups by combining some parity groups to improve storage efficiency.

Abstract: A system and method for replacing file system processors, also known as hot swapping, is described. The system and method operate on a fault-tolerant network file system that includes a first file server that is operably connected to a network fabric and a second file server that is operably connected to the network fabric. The fault-tolerant network file system includes a first disk array that is operably coupled to the first file server and to the second file server and a second disk array that is operably coupled to the first file server and to the second file server. First file system information is loaded on the first file server. The first file system information includes a first intent log of proposed changes to first metadata. Second file system information is loaded on the second file server. The second file system information includes a second intent log of proposed changes to second metadata.

Abstract: A dynamically scalable storage system is described. The system includes a first plurality of disk drives for storing distributed parity groups. Each distributed parity group includes storage blocks arranged as one or more data blocks and a parity block. Each storage block is stored on a separate disk drive such that no two storage blocks from a given distributed parity group reside on the same disk drive. File system metadata is used to describe a location of each of said storage blocks by specifying a disk identifier and a logical block identifier of a first logical block of each storage block. A processor manages the file system metadata. The processor recognizes when a new disk drive is added to the plurality of disk drives and causes one or more existing storage blocks to be moved to the new disk drive to balance usage of all drives. The processor also updates the file system metadata.

Abstract: An integrated distributed file system with variable parity groups is described. The integrated distributed file system includes a first file server that is operably connected to a network fabric and a second file server that is operably connected to the network fabric. The integrated distributed file system further includes file system metadata that includes a first portion of the file system metadata that is loaded on the first file server and a second portion of the file system metadata that is loaded on the second file server. The file system metadata specifies at least a portion of a directory structure that aggregates files stored by the first file server and by the second file server to allow a client computer that is operably connected to the network fabric to locate files stored by the first file server and files stored by the second file server without prior knowledge as to which file server stores a desired file. The file system metadata further organizes file data into distributed parity groups.

Abstract: An enhanced file system with failure tolerance is described. The enhanced file system includes a plurality of disk drives for storing parity groups, each parity group comprising storage blocks. The storage blocks include one or more data blocks and a parity block associated with the data blocks. Each of the storage blocks is stored on a separate disk drive such that no two storage blocks from a given parity group reside on the same disk drive. A recovery module dynamically recovers data lost when a disk drive becomes unavailable. The recovery module produces a reconstructed block by using information in the remaining storage blocks of a parity group corresponding to an unavailable storage block, and stores the reconstructed block on a functioning drive. The file system metadata is updated to indicate where the reconstructed block is stored.

Abstract: A system and method for enhanced disk replacement via hot swapping with variable parity is described. The system and method operate on a computer storage system that includes a plurality of disk drives for storing distributed parity groups. Each distributed parity group includes storage blocks. The storage blocks include one or more data blocks and a parity block that is associated with the one or more data blocks. Each of the storage blocks is stored on a separate disk drive such that no two storage blocks from a given parity set reside on the same disk drive. The computer storage system further includes file system metadata to describe a location of each of the storage blocks. The computer storage system further includes a resource-allocation module to recognize a new disk drive that is hot-swapped into the plurality of disk drives during file system operation and to use the new disk drive to store one or more storage blocks.

Abstract: A data path accelerator with variable parity, variable length, and variable extent groups is described. The data path accelerator includes a network interface for communicating with one or more clients and a storage interface for communicating with one or more disk drives. A metafile processor is configured to queue network transaction requests to the network interface and to queue storage transaction requests to the storage interface. The metafile processor is further configured to manage file system metafile information. The file system metafile information includes disk locations of one or more distributed parity groups on the one or more disk drives. Each distributed parity group includes one or more data blocks and a parity block. The file system metafile information further includes information regarding a length of each distributed parity group.

Abstract: A system and method for data blocking mapping on a computer storage system that includes a plurality of disk drives for storing parity groups. Each parity group includes storage blocks. The storage blocks include one or more data blocks and a parity block that is associated with the one or more data blocks. Each of the storage blocks is stored on a separate disk drive such that no two storage blocks from a given parity set reside on the same disk drive. File system metadata includes information to describe the data blocks in one or more parity groups.

Abstract: A system and method for dynamic data recovery is described. The system and method for dynamic data recovery operates on a computer storage system that includes a plurality of disk drives for storing parity groups. Each parity group includes storage blocks. Each of the storage blocks is stored on a separate disk drive such that no two storage blocks from a given parity set reside on the same disk drive. The computer storage system further includes a recovery module to dynamically recover data that is lost when at least a portion of one disk drive in the plurality of disk drives becomes unavailable. The recovery module is configured to produce a reconstructed block by using information in the remaining storage blocks of a parity set that corresponds to an unavailable storage block.

Abstract: A data path controller architecture is disclosed. The architecture includes a network interface for communicating with one or more clients, a storage interface for communicating with one or more disk drives. A data engine configured to communicate with the storage interface to receive file data from the one or more disk drives. The data engine communicates with the network interface to send file data to the one or more clients. A CPU is configured to queue transaction requests for the data engine in response to file requests from the clients. The data engine receives file data in response to at least a portion of the transaction requests. The data engine sends file data to the one or more clients in response to the transaction requests.

Abstract: A redundant dynamically distributed file system is described. The redundant dynamically distributed file system operates on a computer network and includes a first file server that is operably connected to a network fabric and a second file server that is operably connected to the network fabric. The redundant dynamically distributed file system further includes first file system information loaded on the first file server and second file system information loaded on the second file server. The first file system information and the second file system information are configured to allow a client computer that is operably connected to the network fabric to locate files owned by the first file server and files owned by the second file server without prior knowledge as to which file server owns the files.

Abstract: An enhanced disk array is described. The enhanced disk includes a plurality of disk drives for storing distributed parity groups. Each distributed parity group has a number of storage blocks including one or more data blocks and a parity block. Each of the storage blocks is stored on a separate disk drive such that no two storage blocks from a given parity group reside on the same disk drive. File system metadata describes a location of each storage block by specifying a disk identifier and a logical block identifier of a first logical block of each storage block. An allocation module allocates space for a new distributed parity group on two or more disk drives by allocating space for each storage block of the new distributed parity group from free space on each of the disk drives.

Abstract: A computer network file system is described. The computer network file system includes first metadata, which is managed primarily by a first file server that is operably connected to a network fabric. The first metadata includes first file location information, and the first file location information includes at least one server id. The computer network file system also includes second metadata, which is managed primarily by a second file server that is operably connected to a network fabric. The second metadata includes second file location information, and the second file location information includes at least one server id. The first metadata and the second metadata are configured to allow a requester to locate files that are stored by the first file server and files that are stored by the second file server in a directory structure that spans the first file server and the second file server.

Abstract: A dynamically distributed file system is described. The dynamically distributed file system operates on a computer network and includes a first file server that is operably connected to a network fabric and a second file server that is operably connected to the network fabric. The dynamically distributed file system further includes first file system information loaded on the first file server and second file system information loaded on the second file server. The first file system information and the second file system information are configured to allow a client computer that is operably connected to the network fabric to locate files stored by the first file server and files stored by the second file server without prior knowledge as to which file server stores the files.