Abstract: A processing method for duplicated data includes the following steps. A query request is received from a client, in which the query request includes a requested fingerprint value. A hash tank corresponding to the requested fingerprint value in a memory is searched for the requested fingerprint value. When the requested fingerprint value does not exist in the hash tank corresponding to the requested fingerprint value, the following steps are executed. An addition table in the memory is searched for the requested fingerprint value; and when the requested fingerprint value exists in the addition table, an invalid duplicate message is sent to the client.

Abstract: A distributed de-duplication system and a processing method thereof are described. A client runs a de-duplication procedure on an input file to generate a partitioned data block and a corresponding fingerprint eigenvalue. The client sends an inquiry request having the fingerprint eigenvalue to a dispatch server. The dispatch server records a storage location of the partitioned data block. The dispatch server forwards the inquiry request to the corresponding dedup. engine according to the fingerprint eigenvalue. The dedup. engine judges whether the fingerprint eigenvalue already exists. If the fingerprint eigenvalue does not exist, the dedup. engine stores a new partitioned data block to a storage server according to a new fingerprint eigenvalue.

Abstract: A processing method for duplicated data includes the following steps. A stored file is partitioned into a plurality of raw tanks and a plurality of meta tanks, in which the raw tanks correspond to the meta tanks in a one to one manner, and each meta tank has a stored fingerprint value of the corresponding raw tank. A duplicated data determination request is received, in which the duplicated data determination request includes a requested fingerprint value. At least one of the meta tanks is read, and the requested fingerprint value is compared with the stored fingerprint value of the read meta tank. A referred counter value of the read meta tank is modified, and the modified meta tank is stored back, when the requested fingerprint value is the same as the stored fingerprint value of the read meta tank.

Abstract: A method of a transaction-based system is applicable to a data deduplication system. In the system, pointers of same data point to a same position, so that when one piece of data is changed, all associated pointers need to be changed. In this method, a server first sets a flag to a false value, and after the server receives a request for backing up a data element from a client, the server reads a fingerprinting of the data element and determines whether the fingerprinting is the same as a temporary fingerprinting in a meta cache of the client, writes the data element and the fingerprinting into a corresponding temporary storage data block when the fingerprinting is not the same as the temporary fingerprinting, and writes the data element and the fingerprinting into a main meta cache and resets the flag when the flag is a true value.

Abstract: A processing method for duplicated data includes the following steps. A query request is received from a client, in which the query request includes a requested fingerprint value. A hash tank corresponding to the requested fingerprint value in a memory is searched for the requested fingerprint value. When the requested fingerprint value does not exist in the hash tank corresponding to the requested fingerprint value, the following steps are executed. An addition table in the memory is searched for the requested fingerprint value; and when the requested fingerprint value exists in the addition table, an invalid duplicate message is sent to the client.

Abstract: An method for creating a index of the data blocks is applicable in data de-duplication procedure, includes loading an index file, the index file includes a plurality of location blocks, each location block includes a plurality of storage fields, and each storage field records a primary Hash value corresponding to the data block; performing a first Hash procedure on a primary Hash value of the data block and calculating a block number; performing a second Hash procedure on the primary Hash value in the same data block and calculating a field number; loading a location conflict list; comparing the field number with the field number in the location conflict list to search whether the same field number is stored in the location conflict list; writing the primary Hash value into the corresponding block number and the field number if the field number does not exist in the location conflict list.

Abstract: A processing system of data de-duplication includes a client and a server. A characteristic value of each data block is compared with characteristic values stored in the client. If the same characteristic value exists in the client, the data block corresponding to the compared characteristic value is deleted. A server data management module is connected to a client data management module through a network. If the characteristic value does not exist in the server, a corresponding data block is obtained from the client, and the new data block and the characteristic value are stored in the server. A file management module records a storage address of the data blocks in the server into an index file. In this way, the server is not required to perform all data de-duplication processes of the clients, thus reducing the occupation of bandwidth and improving the processing efficiency of the server.

Abstract: An method for creating a index of the data blocks is applicable in data de-duplication procedure, includes loading an index file, the index file includes a plurality of location blocks, each location block includes a plurality of storage fields, and each storage field records a primary Hash value corresponding to the data block; performing a first Hash procedure on a primary Hash value of the data block and calculating a block number; performing a second Hash procedure on the primary Hash value in the same data block and calculating a field number; loading a location conflict list; comparing the field number with the field number in the location conflict list to search whether the same field number is stored in the location conflict list; writing the primary Hash value into the corresponding block number and the field number if the field number does not exist in the location conflict list.

Abstract: A partitioning method of data blocks is applied to a data de-duplication process. The method includes the following steps. A file structural tank partitioning program and a data block partitioning process are performed on an input file. A fingerprint feature value of a generated data block is compared with fingerprint feature values recorded in completed file structural tanks. If a duplicate fingerprint feature value exists in another file structural tank, it is determined whether the duplicate data block is a first data block of the existing file structural tank. If the data block is the same as the first data block of the existing file structural tank, it is further determined whether the structural tank feature values of the file structural tanks of the two data blocks are the same; and if yes, the data block to be compared is deleted.

Abstract: A method for analyzing a Protocol Data Unit (PDU) of an internet Small Computer Systems Interface (iSCSI) is used for processing a data write request of the iSCSI. The method includes sending the data write request to a target; the target generating a Ready to Transfer (R2T) PDU according to the data write request, and transferring the R2T PDU to an initiator; the initiator generating multiple groups of Data Out PDUs, and writing a scatter/gather block in a target transfer tag of each Data Out PDU; the target finding the corresponding scatter/gather block according to the target transfer tag, and obtaining a host buffer from the scatter/gather block; the target executing a Direct Memory Access command, so as to directly write a payload content received by the target in the host buffer; and after the target completes the write request, the target sending out an RSP PDU to the initiator.

Abstract: A communication method for accelerating Internet small computer system interface data and a processing system thereof are used for sending a plurality of data packets to a plurality of storage devices by a target of the Internet small computer system interface. The communication method includes the following steps. An access request for accessing the storage devices is received by the target. A plurality of small computer interface commands is generated according to the access request. The small computer interface commands are read by an egress packet generator in the target. An address resolving procedure is performed by the egress packet generator for converting the small computer interface commands to a plurality of network packets. A first check code is generated according to a storage content in each network packet. The first check codes are added to the network packets.

Abstract: A method of identifying and dynamically updating storage device status at a target is applied for a storage area network (SAN) built by Linux system, for determining operating status of storage devices at a target through logic device identification numbers. First, a session is established between an initiator and the target, and allocated storage devices and corresponding logic unit numbers (LUNs) are obtained. Then, the initiator sends a CMD request packet with report LUN command to the target. Afterward, according to the LUNs in a received CMD response packet, operating status corresponding to the storage devices is determined. Thereby, timeout may be reduced by avoiding sending queries to those storage devices. When the device allocation is modified, the target may send an asynchronous message PDU to update a storage device status record at the target, so as to maintain the usability of the record.

Abstract: A method of multi-path accessing a remote logic device under a Linux system is used to realize a multi-path access between an initiator and a target in a storage area network (SAN). Firstly, a communication is established between the initiator and the target. Next, the initiator requests to establish at least one link session with the target. Then, the initiator obtains an iSCSI-connected host assigned by the target, and also obtains a message about connected devices corresponding to the iSCSI-connected host through transmitting a report logic unit number (LUN) command. Then, the initiator configures a device mapper, and the device mapper generates information about redundant devices according to the connected devices and the corresponding LUNs, and the redundant connected devices are mapped into a unique mapping device.