Abstract: A method and system is used in managing deduplication of data in storage systems. A first digest for a deduplication candidate is received. At least one neighboring digest segment of a first loaded digest segment is loaded. Whether the digest is located in the at least one neighboring digest segment is determined. If the digest is not located in the at least one neighboring digest segment, the digest is processed.

Abstract: A method and system is used in managing deduplication of data in storage systems. A first digest for a deduplication candidate is received. At least one stream associated with the deduplication candidate is detected. At least one neighboring digest segment of a first loaded digest segment associated with the at least one stream is loaded. Whether the digest is located in the at least one neighboring digest segment is determined. If the digest is not located in the at least one neighboring digest segment, the digest is processed.

Abstract: An object management system (10) comprises a storage device (12); a first computer system (12) configured to store a first object, and a copy of the first object on the storage device; and a second computer system. The first computer system is configured to create a first data object including information about the stored copy of the first object, and the second computer system is configured to read the information about the stored copy of the first object from the first data object, and retrieve the stored copy of the first object from the storage device. The first object may be partitioned by the first computer system and stored as partitions on the storage device, and the first data object would contain information about the partitions. The second computer system would be configured to read information about the partitions from the first data object, select partitions from the storage device.

Abstract: A computer system configured to store a plurality of files, and a data file, which includes inode and migration or purge information associated with the files. The computer system searches the data file to identify files that are candidates for migration or purge. A plurality of pathnames associated with the files is stored in the data file or a separate data file, and the computer system obtains the pathnames of candidate files from the data file (or separate data file). When candidate files are identified, their inodes are used to look up their pathnames in the plurality of pathnames. The data file may include information about whether a file has been modified and its time of last access. To determine whether a file is a candidate for migration, its entry in the data file is checked to determine whether it has been modified. If it has, it is identified as a migration candidate.

Abstract: A method, article of manufacture, and apparatus for managing data commonality in a Merkle tree is disclosed. Reference counts are associated with a node in the Merkle tree. Data commonality is detected and the root of the detected data commonality is determined. If a node is the root node of the detected data commonality, the nodes reference count is incremented. When an object is deleted, the root node of the object is determined. The reference count of the node is decremented. If the count reaches zero, the node is removed from the Merkle tree, and its child nodes are decremented.

Abstract: An object management system comprises a computer system configured to store an object (72), which may be a file. The computer system is configured to divide the object (72) into partitions (70), select partitions, and provide the selected partitions to a storage device (14) for storage. The partitions are selected by determining which partitions need to be migrated device, based on whether the partitions have been modified. The system determines this by examining a data object associated with the object. The computer system may be configured to retrieve a selected partition from the storage device.

Abstract: An object management system (10) comprises a storage device (12); a first computer system (12) configured to store a first object, and a copy of the first object on the storage device; and a second computer system. The first computer system is configured to create a first data object including information about the stored copy of the first object, and the second computer system is configured to read the information about the stored copy of the first object from the first data object, and retrieve the stored copy of the first object from the storage device. The first object may be partitioned by the first computer system and stored as partitions on the storage device, and the first data object would contain information about the partitions. The second computer system would be configured to read information about the partitions from the first data object, select partitions from the storage device.

Abstract: An object management system (10) comprises a storage device (12); a first computer system (12) configured to store a first object, and a copy of the first object on the storage device; and a second computer system. The first computer system is configured to create a first data object including information about the stored copy of the first object, and the second computer system is configured to read the information about the stored copy of the first object from the first data object, and retrieve the stored copy of the first object from the storage device. The first object may be partitioned by the first computer system and stored as partitions on the storage device, and the first data object would contain information about the partitions. The second computer system would be configured to read information about the partitions from the first data object, select partitions from the storage device.

Abstract: An object management system (10) comprises a storage device (12); a first computer system (12) configured to store a first object, and a copy of the first object on the storage device; and a second computer system. The first computer system is configured to create a first data object including information about the stored copy of the first object, and the second computer system is configured to read the information about the stored copy of the first object from the first data object, and retrieve the stored copy of the first object from the storage device. The first object may be partitioned by the first computer system and stored as partitions on the storage device, and the first data object would contain information about the partitions. The second computer system would be configured to read information about the partitions from the first data object, select partitions from the storage device.

Abstract: A computer system configured to store a plurality of files, and a data file, which includes inode and migration or purge information associated with the files. The computer system searches the data file to identify files that are candidates for migration or purge. A plurality of pathnames associated with the files is stored in the data file or a separate data file, and the computer system obtains the pathnames of candidate files from the data file (or separate data file). When candidate files are identified, their inodes are used to look up their pathnames in the plurality of pathnames. The data file may include information about whether a file has been modified and its time of last access. To determine whether a file is a candidate for migration, its entry in the data file is checked to determine whether it has been modified. If it has, it is identified as a migration candidate.

Abstract: An object management system comprises a computer system configured to store an object (72), which may be file. The computer system is configured to divide the object (72) into partitions (70), select partitions, and provide the selected partitions to a storage device (14) for storage. The partitions are selected by determining which partitions need to be migrated device, based on whether the partitions have been modified. The system determines this by examining a data object associated with the object. The computer system may be configured to retrieve a selected partition from the storage device.