Abstract: Example apparatus and methods combine erasure coding with data deduplication to simultaneously reduce the overall redundancy in data while increasing the redundancy of unique data. In one embodiment, an efficient representation of a data set is produced by deduplication. The efficient representation reduces duplicate data in the data set. Redundancy is then added back into the data set using erasure coding. The redundancy that is added back in adds protection to the unique data associated with the efficient representation. How much redundancy is added back in and what type of redundancy is added back in may be controlled based on an attribute (e.g., value, reference count, symbol size, number of symbols) of the unique data. Decisions concerning how much and what type of redundancy to add back in may be adapted over time based, for example, on observations of the efficiency of the overall system.

Abstract: Example apparatus and methods combine erasure coding with data deduplication to simultaneously reduce the overall redundancy in data while increasing the redundancy of unique data. In one embodiment, an efficient representation of a data set is produced by deduplication. The efficient representation reduces duplicate data in the data set. Redundancy is then added back into the data set using erasure coding. The redundancy that is added back in adds protection to the unique data associated with the efficient representation. How much redundancy is added back in and what type of redundancy is added back in may be controlled based on an attribute (e.g., value, reference count, symbol size, number of symbols) of the unique data. Decisions concerning how much and what type of redundancy to add back in may be adapted over time based, for example, on observations of the efficiency of the overall system.

Abstract: A method for monitoring changes in an inventory of media cartridges in a media library includes the steps of determining with a controller that the inventory of media cartridges in the media library has changed, and asynchronously reporting with the controller the specific change in inventory of media cartridges that has occurred in the media library. The method can also include the step of determining whether the change in inventory included an increase or a decrease in the quantity of media cartridges within the media library, or whether the change in inventory did not include an increase or decrease in the quantity of media cartridges within the media library. Further, the method can also include the step of determining whether the change in inventory of media cartridges is required to be reported. A media library system includes a media library having a plurality of media cartridges, and a controller that determines a change in an inventory of media cartridges in the media library.

Abstract: An open systems based media storage library system (10) for use by one or more hosts (5) includes a first hosted partition (12A) and a pool partition (14). The first hosted partition (12A) can be accessed by one of the hosts (5). Additionally, the first hosted partition (12A) includes a plurality of first hosted resources (16, 18). The plurality of first hosted resources (16, 18) can include a plurality of first hosted storage slots (16) and a plurality of first hosted storage media (18). The plurality of first hosted storage slots (16) includes one or more first physical storage slots (16P) and one or more first logical storage slots (16L). The plurality of first hosted storage media (18) are positioned within the first physical storage slots (16P). The pool partition (14) is inaccessible by any of the hosts (5). The pool partition (14) includes a plurality of pool resources (20, 22). One of the plurality of pool resources (20, 22) is selectively assigning to the first hosted partition (12A).

Abstract: Example apparatus and methods combine erasure coding with data deduplication to simultaneously reduce the overall redundancy in data while increasing the redundancy of unique data. In one embodiment, an efficient representation of a data set is produced by deduplication. The efficient representation reduces duplicate data in the data set. Redundancy is then added back into the data set using erasure coding. The redundancy that is added back in adds protection to the unique data associated with the efficient representation. How much redundancy is added back in and what type of redundancy is added back in may be controlled based on an attribute (e.g., value, reference count, symbol size, number of symbols) of the unique data. Decisions concerning how much and what type of redundancy to add back in may be adapted over time based, for example, on observations of the efficiency of the overall system.

Abstract: In a method of classifying data for deduplication, data to be classified is accessed. The data is classified into a deduplication classification in accordance with a data content aware data classification policy such that classified data is created. The data classification policy includes a plurality of deduplication classifications.

Abstract: Example methods and apparatus associated with a messaging policy controlled email deduplication are provided. In one example a messaging policy is accessed. It is determined whether a received message complies with the policy based on rules of the messaging policy. If a message complies with the messaging policy, the message is displayed. If the message does not comply with the messaging policy, it is determined whether the message is duplicative. If the message is deemed duplicative it is not displayed. Conversely, if the message is not deemed duplicative it is displayed.

Abstract: Example methods and apparatus associated with a messaging policy controlled email deduplication are provided. In one example a messaging policy is accessed. It is determined whether a received message complies with the policy based on rules of the messaging policy. If a message complies with the messaging policy, the message is displayed. If the message does not comply with the messaging policy, it is determined whether the message is duplicative. If the message is deemed duplicative it is not displayed. Conversely, if the message is not deemed duplicative it is displayed.

Abstract: A request for a physical import/export (I/E) slot is satisfied using a tape library slot that is not a physical I/E slot. According to one embodiment, the request for the physical I/E slot, that is associated with the tape library, is received. A different slot, which is not any of the physical I/E slots associated with the tape library, is used to satisfy the request.

Abstract: Example apparatus and methods concern a file system based interface between a disk-based network attached storage device and a linear tape open (LTO) linear tape file system tape. One example method may include controlling a device (e.g., backup server) to read a file from the NAS device using a shared file system (e.g., NFS, CIFS) and controlling the device to write the file to the LTO tape device using the LTFS. Since the NAS device and the LTO device may have different information or metadata requirements, and since the shared file system and the LTFS may have different information or metadata requirements, the method may include controlling the device to remove from the file information specific to the NAS and the shared file system. Additionally, the method may include controlling the device to add to the file information specific to the LTFS or the LTO device.

Abstract: Example articles of manufacture, methods, and systems facilitate having encryption policy follow an article of manufacture like a tape cartridge. One example article of manufacture includes a media portion (e.g., tape) and a non-media portion (e.g., housing). The media portion is configured to store machine readable information. The article of manufacture could be a tape, a disk, a memory, and other computer readable media. The article of manufacture also includes an encryption policy information indicator. The encryption policy information indicator can be configured to store information that controls an encryption policy associated with the article of manufacture. Therefore, encryption policy can, for example, follow a tape cartridge rather than be resident solely in a controlling application (e.g., tape library).

Abstract: In accordance with some embodiments, of the systems and methods described here a data storage system that may include data de-duplication may receive a stream of data and parse the stream of data into a block at a local client node. Additionally, in some embodiments, a code that represents the block of data might be determined at the local client node. This code, representing the block of data, may be sent to a server. In accordance with various embodiments, the server may determine if a block is unique, for example, based on the code received at the server. In various embodiments, the server might write a unique block to a file at the local client node; and update metadata.

Abstract: Example apparatus and methods concern a tape library that can initiate an action. One example method may include controlling a tape library to perform a media scanning operation associated with an extended data life management policy. The extended data life management operation may be associated with an application representation of tape drives, slots, and tapes on the tape library. The method may include determining a result of the media scanning operation and selectively controlling the tape library to either provide status or to issue a command based on the result. In one example, conventional status may be returned when a media scan operation result (e.g., tape scan) indicates the tape is fine while a command may be issued when the result indicates the tape may need to be fixed, copied, or replaced.

Abstract: The present invention is directed toward methods and systems for data de-duplication. More particularly, in various embodiments, the present invention provides systems and methods for data de-duplication that may utilize storage reclamation. In various embodiments, data de-duplication may be performed using data storage reclamation by reconciling a list of all active tags against a list of all tags present within the object store itself. Any tags found to be in the object store that have no corresponding active usage may then be deleted. In some embodiments additional steps may be taken to avoid race conditions in deleting tags that are needed by incoming data. In some embodiments the object store may request the lists. In other embodiments, a runtime list, in which each new tag is entered as they are returned from the object store. In another embodiment the object store may maintain this list directly.

Abstract: Example apparatus, methods, and other embodiments concern a tape library controller (TLC) configured to examine import and export commands to provide more intelligent active vault support. One example method may include receiving a command in a TLC associated with a tape library that is configured with an active archive and an active vault. The example method may include determining that the command can be satisfied by one of, an operation involving the active vault, and an operation involving an external vault. The example method may then control the TLC to provide a request that seeks the vault destination to be used to satisfy the command. The example method may also include receiving an identifier of the vault destination in the TLC and controlling the tape library to move a tape to or from the active vault or the external vault based on the vault destination identifier.

Abstract: A system and method for use in an automated data storage cartridge library defines cartridges for use with an external host computer (“open” cartridges), and cartridges for use only internal to the library (“closed” cartridges). Cartridges may be “virtualized” by storing data from them on disk or closed cartridges, and then “realized” by writing data to physical cartridges. Virtual cartridges may be logically exported from one library to another. When new cartridges are introduced to the library, they may be designated with one of multiple designations or uses.

Abstract: Various embodiments provide for creating a self-contained portable output file that includes a de-duplicated version of data. According to one embodiment, data, which includes a selected group of files, is partitioned into subblocks. A de-duplicated version of the data is created by eliminating a second subblock from the data and using a first subblock to represent the second subblock, if the second subblock is a duplicate of the first subblock. A self-contained portable output file, which includes the de-duplicated version of the data, is created.

Abstract: Example apparatus and methods concern a file system based interface between a disk-based network attached storage device and a linear tape open (LTO) linear tape file system tape. One example method may include controlling a device (e.g., backup server) to read a file from the NAS device using a shared file system (e.g., NFS, CIFS) and controlling the device to write the file to the LTO tape device using the LTFS. Since the NAS device and the LTO device may have different information or metadata requirements, and since the shared file system and the LTFS may have different information or metadata requirements, the method may include controlling the device to remove from the file information specific to the NAS and the shared file system. Additionally, the method may include controlling the device to add to the file information specific to the LTFS or the LTO device.

Abstract: Example apparatus and methods concern de-duplication reference tag reconciliation associated with garbage collection and/or reference health checking. One example method may include accessing data associated with members of a set of references to blocks of data stored by a data de-duplication system. The method may process the first data to manipulate a Bloom filter into a state from which membership in the set of references can be assessed. The method may also include accessing a block identifier identified with a member of the set of blocks of data stored by the data de-duplication system and assessing membership in the set of references for the block identifier by querying the Bloom filter with the block identifier. If the block is not referenced, as determined by querying the Bloom filter, then the method may include performing a block reclamation action on the unreferenced block.

Abstract: Example apparatus and methods concern de-duplication reference tag reconciliation associated with garbage collection and/or reference health checking. One example method may include accessing data associated with members of a set of references to blocks of data stored by a data de-duplication system. The method may process the first data to manipulate a Bloom filter into a state from which membership in the set of references can be assessed. The method may also include accessing a block identifier identified with a member of the set of blocks of data stored by the data de-duplication system and assessing membership in the set of references for the block identifier by querying the Bloom filter with the block identifier. If the block is not referenced, as determined by querying the Bloom filter, then the method may include performing a block reclamation action on the unreferenced block.