Abstract: System and methods for storage object distribution using a universal distributed storage (UDS) system. An embodiment UDS includes server nodes and a header server in communication with the server nodes. The header server is configured to divide an object received from a client into chunks, to assign a key to each of the chunks, to calculate a hash value for each of the keys to identify which of the server nodes will store each of the chunks, and to instruct one of the server nodes to store each of the chunks in accordance with the hash value calculated. In an embodiment, the server nodes include a single central processing unit, a single storage device, a primary network interface, and a redundant network interface.

Abstract: An embodiment computing device operating in a data storage system includes an object storage controller operable to divide an object into blocks and to create an object hash from hash values, and a network interface in communication with the object storage controller, the network interface operable to transmit the blocks to a storage subsystem that generates one of the hash values from each of the blocks, to receive the hash values from the storage subsystem, and to provide the hash values to the object storage controller for creation of the object hash from the hash values. In an embodiment, the object storage controller is operably coupled to a processor and a memory or stored on a computer readable medium.

Abstract: System and methods for storage object distribution using dynamic policy controls are provided. An embodiment method deleting an object in a distributed storage system includes receiving, from a client, a delete request for an object, retrieving, by a primary datacenter, an object metadata list corresponding to the object to be deleted, and inserting, by the primary datacenter, a delete marker on a top of a stack data structure in an object metadata list.

Abstract: An embodiment for object integrity service in a storage system includes generating a list of objects stored in a storage system, wherein the list of objects may list an unchecked object, and wherein the unchecked object is an object that has not been checked within a set time period, walking through the list of objects to identify the unchecked object, adding a task to a queue to check the unchecked object, and clearing the task from the queue by checking the unchecked object.

Abstract: System and methods for storage object distribution using dynamic policy controls are provided. An embodiment method deleting an object in a distributed storage system includes receiving, from a client, a delete request for an object, retrieving, by a primary datacenter, an object metadata list corresponding to the object to be deleted, and inserting, by the primary datacenter, a delete marker on a top of a stack data structure in an object metadata list.

Abstract: System and methods for storage object distribution using a universal distributed storage (UDS) system. An embodiment UDS includes server nodes and a header server in communication with the server nodes. The header server is configured to divide an object received from a client into chunks, to assign a key to each of the chunks, to calculate a hash value for each of the keys to identify which of the server nodes will store each of the chunks, and to instruct one of the server nodes to store each of the chunks in accordance with the hash value calculated. In an embodiment, the server nodes include a single central processing unit, a single storage device, a primary network interface, and a redundant network interface.

Abstract: System and method embodiments are provided for improving the performance of data compression for storage systems. The embodiments enable selectively compressing data for storage on a block by block basis to save resources and computation time and cost. The system and method also handle the compression of different types of data blocks using different targeted algorithms. In an embodiment, a method for compressing data in a storage system includes receiving one or more data blocks for storage, determining whether to compress one or more data blocks according to attributes of the one or more data blocks, upon determining to compress a data block from the one or more data blocks, compressing the data block, and storing the compressed data block. The attributes include at least one of a name of the data block, a file type of the data block, and information in the data block.

Abstract: System and methods for storage object distribution using dynamic policy controls are provided. An embodiment method deleting an object in a distributed storage system includes receiving, from a client, a delete request for an object, retrieving, by a primary datacenter, an object metadata list corresponding to the object to be deleted, and inserting, by the primary datacenter, a delete marker on a top of a stack data structure in an object metadata list.

Abstract: An embodiment for object integrity service in a storage system includes generating a list of objects stored in a storage system, wherein the list of objects may list an unchecked object, and wherein the unchecked object is an object that has not been checked within a set time period, walking through the list of objects to identify the unchecked object, adding a task to a queue to check the unchecked object, and clearing the task from the queue by checking the unchecked object.

Abstract: An embodiment computing device operating in a data storage system includes an object storage controller operable to divide an object into blocks and to create an object hash from hash values, and a network interface in communication with the object storage controller, the network interface operable to transmit the blocks to a storage subsystem that generates one of the hash values from each of the blocks, to receive the hash values from the storage subsystem, and to provide the hash values to the object storage controller for creation of the object hash from the hash values. In an embodiment, the object storage controller is operably coupled to a processor and a memory or stored on a computer readable medium.