Abstract: Disclosed is a system that will update the metadata index at the consistency point. Accordingly, the metadata index will be updated at the same time that the data blocks and metadata updates are written to disk. Furthermore, the metadata index will be written in the same location as the file system data, and accordingly, when a snapshot is taken of the file system, the metadata index will also be copied and saved with the snapshot. Accordingly, the metadata index will travel with the snapshots of the filesystem, and will be up to date with the latest changes to the file data blocks.

Abstract: A system and method for implementing a quota system in a distributed file system is provided. Each node manages a quota database tracking available quota for the node. Should additional quota be required, a node queries a remote node to obtain a lock over the remote quota database. The additional quota is shifted and remaining free quota is reallocated between the local and remote nodes.

Abstract: Disclosed is a system that will update the metadata index at the consistency point. Accordingly, the metadata index will be updated at the same time that the data blocks and metadata updates are written to disk. Furthermore, the metadata index will be written in the same location as the file system data, and accordingly, when a snapshot is taken of the file system, the metadata index will also be copied and saved with the snapshot. Accordingly, the metadata index will travel with the snapshots of the filesystem, and will be up to date with the latest changes to the file data blocks.

Abstract: Examples described herein include a data migration system for migrating data between different data storage environments. The data migration system creates a first volume on a first storage system, and creates a logical unit within the first volume. The data migration system then creates a virtual volume on a virtual storage system associated with a second storage system, wherein data stored in the virtual volume is backed by the logical unit on the first storage system. The data migration system then replicates, on the virtual volume, a set of data stored on the second storage system. Upon replicating the set of data onto the virtual volume the virtual storage system may automatically create a copy of the corresponding data in the logical unit of the first volume.

Abstract: A system and method for implementing a quota system in a distributed file system is provided. Each node manages a quota database tracking available quota for the node. Should additional quota be required, a node queries a remote node to obtain a lock over the remote quota database. The additional quota is shifted and remaining free quota is reallocated between the local and remote nodes.

Abstract: Examples described herein include a data migration system for migrating data between different data storage environments. The data migration system creates a first volume on a first storage system, and creates a logical unit within the first volume. The data migration system then creates a virtual volume on a virtual storage system associated with a second storage system, wherein data stored in the virtual volume is backed by the logical unit on the first storage system. The data migration system then replicates, on the virtual volume, a set of data stored on the second storage system. Upon replicating the set of data onto the virtual volume the virtual storage system may automatically create a copy of the corresponding data in the logical unit of the first volume.

Abstract: A system, computer-readable storage medium storing at least one program, and a computer-implemented method for online workflow implementation is provided. An input identifier identifying a digital content to be processed is received. A workflow identifier is also received, the work flow identifier identifying a workflow comprised of a plurality of ordered applications. The digital content is then processed in accordance with the workflow to generate a final output.

Abstract: A system and method addresses data containers in a clustered storage system. Each instantiation of a volume, or other container set, is associated with a data set identifier (DSID). All instantiations of data that represent a single point in time are associated with a master data set identifier (MSID). A volume location database (VLDB), utilizing a replicated database among the nodes of the cluster, stores a data set data structure containing appropriate mapping information between the MSIDs and DSIDs. Clients of the clustered storage system utilize MSIDs to reference data that is desired to be accessed. When a storage system receives a data access request containing a MSID, the storage system accesses the VLDB to identify an appropriate DSID to which to forward the request. The data access request is then forwarded to the appropriate storage system for processing.

Abstract: A technique provides an administrative path for accessing a writeable master storage volume in a mirrored storage environment. Illustratively, a writeable master storage volume stores a master set of data addressable by a corresponding pathname, and zero or more read-only (e.g., load-balancing) mirrored storage volumes are configured to store a mirrored set of the master set of data, the mirrored set also addressable by the corresponding pathname. Clients may read data from either the master storage volume or one of the mirrored storage volumes (e.g., according to a configured access location, such as a local mirrored volume if one exists) by issuing read requests having the corresponding pathnames. Also, each client may specifically access the master set of data from the master storage volume by issuing an access (e.g., read/write) request having a specified master storage volume pathname prefix prepended to the corresponding pathname.

Abstract: A system and method to allow a volume to appear in multiple locations in a super-namespace. A super-namespace is a hierarchy of namespaces within a storage system environment, such as a storage system cluster. The volume can appear in multiple locations in the super-namespace and/or in multiple namespaces within the super-namespace.

Abstract: Provided is a method and system for redirecting data access requests in a clustered computing environment. A clustered namespace applied to the clustered computing environment includes multiple modules for storing and manipulating data. The clustered namespace is enabled by using a replicated storage location repository listing storage locations distributed throughout the clustered computing environment. When searching for data, pathnames to storage locations are examined and compared with values listed in the storage location repository to identify a storage location to visit. A module associated with an identified storage location is visited to satisfy a data access request. If a redirection identifier is encountered when examining the metadata of the identified storage location, then the storage location repository is examined to find the next storage location to visit to satisfy the data access request.

Abstract: A system and method for authenticating an unauthenticated file level protocol using a sidecar authentication mechanism. A client transmits an authentication ticket, UID and list of network addresses to an authentication daemon of a storage system. The authentication daemon verifies the user identity and generates a file system credential that is stored in a cache indexed by an authentication tuple. Received data access operations from a client are compared to authentication tuples by UID and network address and the file system utilizes the stored credential for processing the data access operation.

Abstract: A technique provides an administrative path for accessing a writeable master storage volume in a mirrored storage environment. Illustratively, a writeable master storage volume stores a master set of data addressable by a corresponding pathname, and zero or more read-only (e.g., load-balancing) mirrored storage volumes are configured to store a mirrored set of the master set of data, the mirrored set also addressable by the corresponding pathname. Clients may read data from either the master storage volume or one of the mirrored storage volumes (e.g., according to a configured access location, such as a local mirrored volume if one exists) by issuing read requests having the corresponding pathnames. Also, each client may specifically access the master set of data from the master storage volume by issuing an access (e.g., read/write) request having a specified master storage volume pathname prefix prepended to the corresponding pathname.