Abstract: The apparatus includes: a hardware-side processing section including one or more programmable hardware-implemented chips configured to process request packets, which are received from host computers and relate to access requests to one or more file systems managed by the apparatus, and to generate response packets for the processed request packets; and a software-side processing section including one or more CPUs configured to execute decoding of requests packets sent from a host computer based on one or more computer programs stored in a memory of the software-side; wherein at least one programmable hardware-implemented chip of the hardware-side processing section is configured to process a credit request included in a received request packet, in particular without involvement of the software-side processing section.

Abstract: The data storage system includes one or more storage apparatuses and a file system server connected to the one or more storage apparatuses and to one or more host computers. Write operations are controlled by providing a free space object which stores a plurality of indicators, each indicator being associated with one of a plurality of storage units for storing data units in the one or more storage apparatuses and each indicator indicating whether the associated storage unit is free or used, executing a read-ahead examination which comprises examining a set of indicators of the free space object for identifying one or more used storage units associated with indicators of the set, in particular for observing a fragmentation status of the storage units associated with the indicators of the set, and executing an allocation examination which comprises examining one or more indicators.

Abstract: A deduplication system and method involves interaction between a software-based system that manages the overall background deduplication process and a hardware-based system that includes a hardware-based filesystem manager and a hash generator. A filesystem checkpoint mechanism is leveraged to manage the background deduplication process and also to reduce processing complexity with respect to identifying chunks that are candidates for deduplication and processing such chunks.

Abstract: A deduplication system and method involves interaction between a software-based system that manages the overall background deduplication process and a hardware-based system that includes a hardware-based filesystem manager and a hash generator. A filesystem checkpoint mechanism is leveraged to manage the background deduplication process and also to reduce processing complexity with respect to identifying chunks that are candidates for deduplication and processing such chunks.

Abstract: Available storage locations are identified by searching through a free blocks object non-sequentially. The free blocks object may be logically divided into sections, and the sections may be searched non-sequentially. Each section may be logically divided into a number of sub-sections, and the sub-sections of the various sections may be searched non-sequentially. A new section may be added to the free blocks object, and the added section may be searched until a predetermined threshold or condition is reached, at which point non-sequential searching may begin or resume.

Abstract: Embodiments of the present invention allow multiple checkpoints to be taken so that multiple versions of the filesystem, including a working version and at least two checkpoint versions, can be maintained over time. Specifically, at least three “superblock” root structures are used to manage multiple instantiations of the filesystem. The superblocks are preferably stored in fixed locations within the storage system for easy access, although they may alternatively be stored in other ways. The number of superblocks may be fixed or variable.

Abstract: A file cloning mechanism allows for quickly creating copies (clones) of files within a filesystem, such as when a user makes a copy of a file. In exemplary embodiments, a clone of a source object is at least initially represented by a structure containing references to various elements of the source object (e.g., indirect onodes, direct onodes, and data blocks). Both read-only and mutable clones can be created. The source file and the clone initially share such elements and continue to share unmodified elements as changes are made to the source file or mutable clone. None of the user data blocks or the metadata blocks describing the data stream (i.e., the indirect/direct onodes) associated with the source file need to be copied at the time the clone is created. At appropriate times, cloned files may be “de-cloned.

Abstract: Apparatus for managing a plurality of root nodes may include a file server coupled to a storage device, wherein a first root node is operable to identify a previous version of an object of a file system and to relate to a plurality of data blocks forming a portion of the object, a second root node is operable to identify a current version of the object and to relate to a data block of the plurality of data blocks and a new data block of the object, and the storage device is operable to store the plurality of data blocks and the new data block.

Abstract: A file cloning process allows for quickly cloning files within a filesystem, such as when a user makes a copy of a directory containing files and subdirectories of files. A priority based main queue is filled by a depth first traversal of the directory to be copied with work items corresponding to files and subdirectories. Worker threads refer to the main queue for file cloning, subdirectory copying and directory traversal. Files that have not been modified since a most recent checkpoint are cloned without issuing a checkpoint request. Files that have been modified since the most recent checkpoint are moved to a delay queue. Once a checkpoint of the file system completes, the files in the delay queue are then moved to the main queue to retry cloning thereof. A secondary queue is also provided to prevent worker threads from becoming deadlocked in the main queue.

Abstract: Apparatus includes a file server node having (i) a first interface operable to communicate with a network and receiving a network request via network, (ii) a non-volatile memory operable to temporarily store a request related to the network request received by the first interface, (iii) a second interface operable to be coupled to the storage device for storing the request, and (iv) a non-volatile memory processing module, coupled to the first interface, the non-volatile memory and the second interface, and operable to be coupled to another file server node, so that the request can be sent to the non-volatile memory, the second interface and the another file server node after the non-volatile memory processing module receives the file system request.

Abstract: The method performed by the apparatus includes interconnecting a first file system managing unit 310 between the plurality of client computers 100 and the second file system managing unit 410, creating a first directory /root in a first file system managed by the first file system managing unit 310, associating a first directory /root of the second file system with the first directory /root of the first file system, enabling on-demand virtualization of the second file system by the first file system managing unit 310 based on client requests received from the client computers 100 at the first file system managing unit 310 and based on the association between the first directory of the first file system and the first directory of the second file system, and enabling indirect client access to the second file system through the first file system.

Abstract: The present invention relates to a method and an apparatus for data migration of a first file system in a data storage system comprising a plurality of client computers 100, a first file system managing unit 310 for managing the first file system and being connected to the plurality of client computers 100, and a second file system managing unit 410 for managing a second file system and being connected to the first file system managing unit 310, the second file system comprising a plurality of data files and the first file system comprising a plurality of external link objects, each external link object of the first file system being associated with a respective data file of the second file system for enabling client access to the respective data file of the second file system.

Abstract: The method and an apparatus provides a virtualized file system enabling indirect access to a second file system in a data storage system comprising a plurality of client computers 100 and a second file system managing unit 410 for managing the second file system and enabling client access to the second file system, the method comprising interconnecting a first file system managing unit 310 between the plurality of client computers 100 and the second file system managing unit 410, creating a directory /root in a first file system managed by the first file system managing unit 310, a directory /root of the second file system with the directory /root of the first file system, enabling on-demand virtualization of the second file system by the first file system managing unit 310 based on client requests received from the client computers 100 at the first file system managing unit 310.

Abstract: The present invention relates to a method and an apparatus for data migration of a first file system in a data storage system comprising a plurality of client computers 100, a first file system managing unit 310 for managing the first file system and being connected to the plurality of client computers 100, and a second file system managing unit 410 for managing a second file system and being connected to the first file system managing unit 310, the second file system comprising a plurality of data files and the first file system comprising a plurality of external link objects, each external link object of the first file system being associated with a respective data file of the second file system for enabling client access to the respective data file of the second file system.

Abstract: A multi-tiered filesystem integrates multiple types of storage devices into a contiguous filesystem storage space having regions associated with two or more tiers of storage.

Abstract: A file cloning mechanism allows for quickly creating copies (clones) of files within a filesystem, such as when a user makes a copy of a file. In exemplary embodiments, a clone of a source object is at least initially represented by a structure containing references to various elements of the source object (e.g., indirect onodes, direct onodes, and data blocks). Both read-only and mutable clones can be created. The source file and the clone initially share such elements and continue to share unmodified elements as changes are made to the source file or mutable clone. None of the user data blocks or the metadata blocks describing the data stream (i.e., the indirect/direct onodes) associated with the source file need to be copied at the time the clone is created. At appropriate times, cloned files may be “de-cloned.

Abstract: A high tier storage area stores a stub file and a lower tier cloud storage area stores the file corresponding to the stub file. When a client apparatus requests segments of the file from the high tier storage area, reference is made to the stub file to determine a predicted non-sequential pattern of requests to the segments by the client apparatus. The high tier storage area follows the predicted non-sequential pattern of requests to retrieve the segments of the file from the cloud prior to the client apparatus actually requesting the segments. As such, the file may be efficiently provided to the client apparatus while also efficiently storing the file on the lower tier cloud storage area.

Abstract: In some examples, a distributed system may include a plurality of nodes with a file stored in a file system across the plurality of nodes. One of the nodes may receive a request for location data corresponding to a part of the file. For instance, the location data may be included in a mapping file, and the request may specify an offset of the mapping file. The mapping file may include locations of nodes storing parts of the file in the file system across the plurality of nodes, and the mapping file may have a plurality of parts corresponding to the parts of the file. In response to the request, the node may access the mapping file and send location data corresponding to the offset of the mapping file. The location data may indicate at least one of the nodes storing the part of the file.

Abstract: A cluster system includes a plurality of computing nodes connected to a network. Each node is configured to access its own storage device, and to send and receive input/output (I/O) operations associated with its own storage device. Further, each node of the plurality of nodes may be configured to have a function of acting as a first node, which sends a first message to other nodes of the plurality of nodes. The first message may include configuration information indicative of a data placement of data on the plurality of nodes in the cluster system according to an event. Following receipt of the first message from the first node, each of the other nodes may be configured to determine, based at least in part on the configuration information, whether data stored on its own storage device is affected by the event.

Abstract: The method and an apparatus provides a virtualized file system enabling indirect access to a second file system in a data storage system comprising a plurality of client computers 100 and a second file system managing unit 410 for managing the second file system and enabling client access to the second file system, the method comprising interconnecting a first file system managing unit 310 between the plurality of client computers 100 and the second file system managing unit 410, creating a directory /root in a first file system managed by the first file system managing unit 310, a directory /root of the second file system with the directory /root of the first file system, enabling on-demand virtualization of the second file system by the first file system managing unit 310 based on client requests received from the client computers 100 at the first file system managing unit 310.