Abstract: In some examples, one or more computing devices may perform deduplication of data. For instance, a first device may receive, from a second device, a first data-portion identifier corresponding to a first deduplication data portion. The first device may include a first index portion of a deduplication index and the second device may include a second index portion of the deduplication index. Further, the first data-portion identifier may be received based on a first data-portion identifier portion being in a range of values assigned to the first index portion. The first device may locate, in the first index portion of the deduplication index, a second data-portion identifier that matches the first data-portion identifier. The first device may associate the first reference information for the first deduplication data portion with a second deduplication data portion referenced by reference information associated with the second data-portion identifier.

Abstract: In some examples, one or more computing devices may perform deduplication of data. For instance, a first device may receive, from a second device, a first data-portion identifier corresponding to a first deduplication data portion. The first device may include a first index portion of a deduplication index and the second device may include a second index portion of the deduplication index. Further, the first data-portion identifier may be received based on a first data-portion identifier portion being in a range of values assigned to the first index portion. The first device may locate, in the first index portion of the deduplication index, a second data-portion identifier that matches the first data-portion identifier. The first device may associate the first reference information for the first deduplication data portion with a second deduplication data portion referenced by reference information associated with the second data-portion identifier.

Abstract: According to at least one embodiment, a data storage system is provided. The data storage system includes memory, at least one processor in data communication with the memory, and a deduplication director component executable by the at least one processor. The deduplication director component is configured to receive data for storage on the data storage system, analyze the data to determine whether the data is suitable for at least one of summary-based deduplication, content-based deduplication, and no deduplication, and store, in a common object store, at least one of the data and a reference to duplicate data stored in the common object store.

Abstract: According to at least one embodiment, a data storage system is provided. The data storage system includes memory, at least one processor in data communication with the memory, and a deduplication director component executable by the at least one processor. The deduplication director component is configured to receive data for storage on the data storage system, analyze the data to determine whether the data is suitable for at least one of summary-based deduplication, content-based deduplication, and no deduplication, and store, in a common object store, at least one of the data and a reference to duplicate data stored in the common object store.