Abstract: In accordance with one or more embodiments, an inode implemented file system may be utilized to support both offline and inline deduplication. When the first content is stored in the storage medium, one inode is used to associate a filename with the data blocks where the first content is stored. When a second content that is a duplicate of the first content is to be stored, then a parent inode is created to point to the data blocks in which a copy of the first content is stored. Further, two inodes are created, one representing the first content and the other representing the second content. Both inodes point to the same parent inode that points to the data blocks where the first content is stored.

Abstract: Systems and methods for optimizing deduplication in a data storage system are provided. The method comprises associating a first name with first data blocks including first content stored in a data storage system, wherein the first name is associated with the first data blocks by way of a reference to a first meta file that points to a data file which points to the first data blocks; storing a first signature derived from the first content in an indexing data structure, wherein the first signature is used to associate the first name with the first data blocks and as means to verify whether a second content is a duplicate of the first content, based on value of a second signature derived from the second content.

Abstract: An exemplary embodiment includes partitioning a data message to be communicated from a first data site to a second data site into data chunks; generating a data chunk identifier for each data chunk; determining whether the data chunks are stored at the second data site; when at least one data chunk is not stored at the second data site, adding the data chunk identifier for each data chunk not stored at the second data site to a data structure at the first data site; sending a transformed data message from the first date site to the second data site; wherein, when at least one data chunk is already stored at the second data site, rather than including that data chunk, the transformed data message instead includes at least one tuple to enable the data message to be reconstructed at the second data site without sending the previously stored data chunk, the transformed data message also includes each data chunk not stored at the second data site.

Abstract: Systems and methods for optimizing deduplication in a data storage system are provided. The method comprises associating a first name with first data blocks including first content stored in a data storage system, wherein the first name is associated with the first data blocks by way of a reference to a first meta file that points to a data file which points to the first data blocks; storing a first signature derived from the first content in an indexing data structure, wherein the first signature is used to associate the first name with the first data blocks and as means to verify whether a second content is a duplicate of the first content, based on value of a second signature derived from the second content.

Abstract: In accordance with one or more embodiments, an inode implemented file system may be utilized to support both offline and inline deduplication. When the first content is stored in the storage medium, one inode is used to associate a filename with the data blocks where the first content is stored. When a second content that is a duplicate of the first content is to be stored, then a parent inode is created to point to the data blocks in which a copy of the first content is stored. Further, two inodes are created, one representing the first content and the other representing the second content. Both inodes point to the same parent inode that points to the data blocks where the first content is stored.

Abstract: A system and method for solving the weak membership problem in a system of nodes that might include redundancies. Each node is given the same random seed. Each node uses a link state protocol to determine the current system topography, and then an optimization such as simulated annealing is run on the topography at each node, independently of the other nodes, to determine the optimum weak membership for use thereof in subsequent system operations. Since each node starts with the same random seed, the nodes all arrive at the same solution without having to communicate a common solution between nodes.

Abstract: An exemplary embodiment includes partitioning a data message to be communicated from a first data site to a second data site into data chunks; generating a data chunk identifier for each data chunk; determining whether the data chunks are stored at the second data site; when at least one data chunk is not stored at the second data site, adding the data chunk identifier for each data chunk not stored at the second data site to a data structure at the first data site; sending a transformed data message from the first date site to the second data site; wherein, when at least one data chunk is already stored at the second data site, rather than including that data chunk, the transformed data message instead includes at least one tuple to enable the data message to be reconstructed at the second data site without sending the previously stored data chunk, the transformed data message also includes each data chunk not stored at the second data site.

Abstract: A system and method for solving the weak membership problem in a system of nodes that might include redundancies. Each node is given the same random seed. Each node uses a link state protocol to determine the current system topography, and then an optimization such as simulated annealing is run on the topography at each node, independently of the other nodes, to determine the optimum weak membership for use thereof in subsequent system operations. Since each node starts with the same random seed, the nodes all arrive at the same solution without having to communicate a common solution between nodes.

Abstract: Providing high availability cache coherency in a distributed cache environment for a storage cluster. An extent owner node in a cluster controls extent disk requests and the locking and demotion of extent data. An extent client node may access the data but does not control destaging or locking. The extent client waits for a lock state grant prior to completing any I/O request. An extent client is allowed to receive data from a host for a write request and later let the extent owner sort out the proper cache coherency order. An extent client is not required to request a lock state change from the extent owner when a read cache hit occurs in the extent client. When a read miss occurs in an extent client, the extent client can initiate a stage request from disk and request the owner for a lock state change at a later time.

Abstract: Providing high availability cache coherency in a distributed cache environment for a storage cluster. An extent owner node in a cluster controls extent disk requests and the locking and demotion of extent data. An extent client node may access the data but does not control destaging or locking. The extent client waits for a lock state grant prior to completing any I/O request. An extent client is allowed to receive data from a host for a write request and later let the extent owner sort out the proper cache coherency order. An extent client is not required to request a lock state change from the extent owner when a read cache hit occurs in the extent client. When a read miss occurs in an extent client, the extent client can initiate a stage request from disk and request the owner for a lock state change at a later time.