Abstract: A technique performs a write operation. The technique involves receiving, after a snapshot of a file system is taken, a write instruction to write new data to a particular portion of the file system. The technique further involves includes reading, in response to the write instruction, metadata to determine whether the new data is a first update of the particular portion since the snapshot was taken. The metadata identifies portions of the file system which have changed since the snapshot was taken. The technique further involves, when the new data is a first update of the particular portion since the snapshot was taken, copying the original data from cache memory (i.e., from the file system buffer cache) to snapshot storage (i.e., to a dedicated save area) and, after the original data is copied, updating the original data in the cache memory with the new data.

Abstract: An on-disk structure of a file system has the capability to maintain snapshot and file system metadata on a storage system. The on-disk structure arranges file system data sequentially on disk within regions, wherein each region comprises a predetermined amount of disk space represented by blocks. The snapshot and file system metadata is maintained within level 1 (L1) indirect blocks of the on-disk structure. Each L1 indirect block describes (i.e., represents) a corresponding region of the on-disk structure of the file system; in the case of an active region, e.g., an L1 indirect block represents an active file data portion of a large file. The L1 indirect block that references an active region also performs file block number-to-disk block number mapping for the region.

Abstract: Disclosed is a data replication method in a Database Management System (DBMS). The data replication method includes generating a replication log through a transaction log of a master database to thereby transmit the generated replication log to a distributor, determining a slave host distributing the replication log to thereby distribute the replication log to the corresponding slave host, and reflecting the replication log in a slave database.

Abstract: In accordance with embodiments of the present disclosure, an information handling system for deploying a target image to a particular target system may include a storage medium and a processor communicatively coupled to the storage medium. The process may be configured to receive one or more target images and store the one or more target images to the storage medium, receive unique system identifiers for each of one or more target systems and store the unique system identifiers to the storage medium, generate one or more entitlements binding each of the one or more target systems to a respective target image of the one or more target images based on the one or more target images and the unique system identifiers, and deploy a target image having an entitlement for the particular target system.

Abstract: A method for increasing the efficiency of a “copy-on-write” operation performed on an SSD to extend the life of the SSD is disclosed herein. In one embodiment, such a method includes receiving a first logical address specifying a logical location where new data should be written to an SSD. The first logical address maps to a first physical location, storing original data, on the SSD. The method further receives a second logical address specifying a logical location where the original data should be available on the SSD. The second logical address maps to a second physical location on the SSD. To efficiently perform the copy-on-write operation, the method writes the new data to a new physical location on the SSD, maps the first logical address to the new physical location, and maps the second logical address to the first physical location. A corresponding apparatus is also disclosed.

Abstract: Method and system for using a clone of a replicated copy of a data structure as an independent data object is provided. The replicated copy and the clone share data blocks, when the clone is generated. The clone is assigned new data blocks to replace the shared data blocks. A profile for the clone is generated where the clone does not share any data blocks with the replicated copy. The profile includes an option to delete the clone profile and any associated data blocks thereof.

Abstract: Methods, apparatus and computer program products implement embodiments of the present invention that include defining, in a storage system including receiving, by a storage system, a storage request, and identifying, based on the storage request, one or more storage management units. For each of the storage management units, a master partition table having multiple master entries and one or more backup partition tables is identified, each of the backup partition tables having backup entries in a one-to-one-correspondence with the master entries. The storage request is performed, and upon the storage request being performed, any changes to essential metadata in the one or more master partition tables are identified, and the identified changes are stored to the essential metadata in the one or more backup partition tables.

Abstract: Systemic, adaptive procedural template comprised of common building blocks forming template frameworks i.e.

Abstract: Methods and systems are described that involve replica placement strategy for distributed systems. At the time of index creation, initial index replica placement is decided. The first index replica is placed locally on the current processing server node. This server node operates as a master host for the first replica. The other index replicas are placed on different hosts depending on the index type, split index or non-split index, and a set of criteria. For non-split indexes, the set of criteria includes: a number of recently created replicas per host, resource usage per host, and a total number of replicas per host. For split indexes, the set of criteria includes: a number of replicas of any split index part per host and a number of local first replicas of split index parts. If all criteria re equal, the first host in alphanumeric ordering receives a next replica.

Abstract: A method, system, and program product for data replication comprising, building a virtual image of a point in time in a Data Protection Appliance (DPA), taking a storage array based snapshot of a current image, creating a hot pull session and exposing a LUN containing the point in time image at the DPA.

Abstract: In accordance with one or more aspects of the application-managed file versioning, a request to store a new version of a file is received from an application, the request having been generated by the application. A filename for the new version of the file is generated, derived from a standardized naming convention. The filename includes a first portion having at least a portion of a name of the file, and a second portion having data indicating that the new version of the file is a version of the file. A set of application programming interfaces (APIs) can be exposed that allow the application to manage file versions, such as creating a new version of a file, identifying one or more versions of the file, listing one or more versions of the file, and deleting one or more versions of the file.

Abstract: Methods and apparatus for an account cloning service for cloud computing environments are disclosed. A system includes a plurality of resources, a plurality of service managers coordinating respective distributed network-accessible services, and a metadata manager. The metadata manager receives an account cloning request specifying a source client account. The metadata manager identifies a representation of an administrative state of the source client account with respect to a plurality of services, including configuration settings of an original set of resources of the plurality of resources providing functionality of the set of services. The metadata manager stores a record of an association of a clone client account of the particular source client account with the representation of the administrative state.

Abstract: In a local storage system having a local volume with a plurality of local regions, respective local signatures are computed over the local regions. In a remote storage system having a remote volume with remote regions in a one-to-one correspondence with the local regions, respective remote signatures are computed over the remote regions. A given remote region is identified, the given remote region having a given remote signature and a corresponding local region with a given local signature that does not match the given remote signature. The data in the given remote region is then replaced with data from the corresponding local region.

Abstract: A method, article of manufacture, and apparatus for protecting data. In some embodiments, this includes taking a snapshot of a virtual machine, parsing the virtual machine to determine a header section and a file system, indexing the virtual machine based on the parsing, storing the index in a storage device, and storing the snapshot in a deduplicated data storage device.

Abstract: A system and a method are disclosed for generating a repository to be used on a client device. The repository is generated based on a repository format supported by the client device, which is identified by analyzing an empty repository created by the client device. The generated repository is configured with metadata that allows an operating system executing on the client device to communicate with the repository. Once generated, the repository is populated with data associated with a user of the client device. The populated repository is transmitted to the client device, where the repository is used by applications for retrieving and storing data.

Abstract: Methods and apparatus for token-based admission control for replicated writes are disclosed. Data objects are divided into partitions, and corresponding to each partition, at least a master replica and a slave replica are stored. A determination as to whether to accept a write request directed to the partition is made based at least in part on one or more of (a) available throughput capacity at the master replica, and (b) an indication, obtained using a token-based protocol, of available throughput capacity at the slave replica. If the write request is accepted, one or more data modification operations are initiated.

Abstract: The present invention is directed to a system for understanding social media. The system may provide automated machine understanding of social media communications based on: social media assertions, social media statements and conversations, social connections, user profile info, crowd-sourced databases, Internet pages, and semantic networks.

Abstract: A method for creating a deployable zone template of a source zone, involving receiving, from the user an instruction to create the deployable zone template of a source zone including a zonepath dataset (ZPDS) and an application image (AI), where the ZPDS is a hierarchy of file systems in which an operating system image of the source zone is installed, creating a zonepath image file of the ZPDS, creating an application image file of the AI, collecting auxiliary zone data describing a dependency of the source zone and configuration a parameter of the source zone, creating an archive file including the zonepath image file, the application image file, and the auxiliary zone data, and combining the archive file and an executable wrapper script to obtain the deployable zone template.

Abstract: Performing data synchronization is disclosed, including: receiving an indication to synchronize a container to a snapshot, wherein the container has a first data state and an identity, wherein the snapshot corresponds to a second data state; causing the container to have the second data state corresponding to the snapshot; and maintaining the identity of the container.

Abstract: According to one embodiment of the present invention, a system reduces re-reading of database logs by persisting long running transaction data. The system processes the database log records of the database transaction log; generates a snapshot of the database log records at periodic intervals, wherein each snapshot includes database log records for pending transactions; and in response to an interruption in processing of the database log records, utilizes a snapshot to restore database log records for the pending transactions and resume processing of the database transaction log from a position succeeding the database log records of the selected snapshot.

Abstract: A snapshot agent executing on a virtual desktop allows a user to both create snapshots of the VM image hosting the virtual desktop and to revert that VM instance to such snapshots. In addition to a snapshot agent that executes within a given VM instance, another embodiment provides a user with network access to a portal snapshot management interface, e.g., via a web application. The web application can present the list of VM instances, and snapshots for each such VM instance, owned by an authenticated user. The user can then interact with the web application to create a new snapshot for (or revert to) an existing snapshot for the owned VM instances.

Abstract: The disclosed techniques include generation of a single index table when backing up data in a first backup format to a backup storage system that uses a second backup format. Using the single index table, a query for a data item can be answered by searching the single index table. The single index table avoids having to search through multiple index tables, each corresponding to a different backup format that may be used for backing up the searched data item.

Abstract: An on-disk structure of a file system has the capability to efficiently manage and organize data containers, such as snapshots, stored on a storage system. A multi-bit, monotonically increasing, snapshot identifier (“snapid”) is provided that represents a snapshot and that increases every time a snapshot is generated for a volume of the storage system. The snapid facilitates organization of snapshot metadata within, e.g., a data structure used to organize metadata associated with snapshot data. In the illustrative embodiment, the data structure is a balanced tree structure configured to index the copy-out snapshot data blocks. The snapid is also used to determine which blocks belong to which snapshots. To that end, every block that is used in a snapshot has an associated “valid-to” snapid denoting the newest snapshot for which the block is valid. The oldest snapshot for which the block is valid is one greater than the valid-to field of the next older block at the same file block number.

Abstract: A system and method for parallel file system traversal using multiple job executors is disclosed. The system includes a pool of job executors, a job queue, and a trigger tracker. An object, representative of a node in the filesystem, is added (i.e., pushed) to the job queue for processing by an job executor. The job queue assigns (i.e., pops) objects to job executors in accordance to a LIFO (Last In First Out) ordering. Then the job executor performs an action such as copy. In one embodiment, the trigger tracker follows the processing of a child nodes to a particular child node. Thus, the filesystem is being traversed by several job executors at the same time.

Abstract: Change tracking between snapshots of a source storage. In one example embodiment, a method includes various steps. For example, the method includes, at time t(1), starting tracking, in a change log, locations in a source storage of all blocks that are changed after time t(1). The method also includes, between time t(1) and time t(3), changing a block in the source storage. The method further includes, at time t(3), creating a first snapshot of the source storage. The method also includes, after time t(3), creating a first image backup using the first snapshot. The method further includes, at time t(8), creating a second snapshot of the source storage. The method also includes, at time t(11), creating an incremental image backup that includes all blocks in the second snapshot that are tracked as having been changed in the change log after time t(1).

Abstract: A non-transitory computer readable medium that may store instructions for receiving, by a local storage system, a file system command that is sent from a host computer, the file system command is related to a remote snapshot of a local file system entity; wherein the remote snapshot of the local file system entity is generated by a process that may include sending a snapshot of the local file system entity from the local storage system to a remote storage system; wherein the local file system entity belongs to a local file system stored at the local storage system; and responding to the file system command, wherein the responding may include utilizing or generating remote snapshot file system information that is representative of the remote snapshot of the local file system entity.

Abstract: A system and method for performing an image level restore of data is described. In some examples, the system receives a request to restore a file and transmits the request to an intermediate component. The intermediate component may then retrieve a directory file from an image of a secondary copy of a data set, identify a location of the file from the directory file, and provide the location to the requestor.

Abstract: A computer-based system creates a data object by preparing a data structure for the data object in a database and processes the data object at different processing stages each associating a different workflow state with the data object. The system can take and store automatically a snapshot of the data object, prior to a workflow transition of the data object from a first workflow state to a second workflow state, respectively associated with the snapshot and with the data object. The system also creates a unique locating reference for the snapshot based on a unique locating reference created previously for the data object. When the unique locating reference for the data object is received, controlled access to the data object and the snapshot is provided. Based on one unique locating reference, multiple states of the data object can be easily and efficiently made available concurrently to a user.

Abstract: A database service may provide multi-tenant and single-tenant environments in which tables may be maintained on behalf of clients. The service (or underlying system) may create database instances and tables in either or both types of environments (e.g., by default or according to various parameter values specified in requests to create the instances or tables). When receiving and servicing requests directed to a table hosted in a single-tenant environment, the system may elide at least some of the authentication or metering operations that would be performed when servicing requests directed to tables hosted in a multi-tenant environment. Tables may be moved from a single-tenant environment to a multi-tenant environment, or vice versa, automatically by the system (e.g., dependent on an observed, expected, or desired throughput) or in response to an explicit request from a client to do so (e.g., to increase throughput or reduce cost).

Abstract: Systems and methods for intelligent data replication are provided, which may include the identification and use of consistency points in application data, such that one or more replication volumes may be created using an “application aware” replication process that allows the system to intelligently replicate data or other information (e.g., metadata) relating to a particular process, application or specified set of data.

Abstract: A local imager (202) copies each allocation unit (302) occupied by a file (305) of a file system (102) to a locally-stored image file (204) within the same partition (104) as the file system (102). The allocation units (302) may be compressed as they are copied, resulting in a locally-stored image file (204) that occupies fewer allocation units (302) than the original file system (102). In addition, the local imager (202) adds a directory map (312) to the locally-stored image file (204) that associates copied allocation units (302) in the locally-stored image file (204) with names of corresponding files (305) from the file system (102).

Abstract: Described are techniques for creating a snapshot of a distributed file system or a file thereof. The distributed file system includes metadata file systems storing metadata about files in the distributed file system and includes data file systems storing file content data. Quiescing is performed for requests affecting the distributed file system, or a file thereof, for which a snapshot is being created. A snapshot of metadata is obtained. For the distributed file system, this includes a snapshot of each metadata file system. For a file, this includes a snapshot of the file's metadata. A snapshot of file data is obtained. For distributed file systems, this includes a snapshot of each data file system. For a file, this includes a snapshot of the file's data. Unquiescing is performed for requests affecting the distributed file system, or the file thereof, upon successful completion of obtaining snapshots of metadata and file data.

Abstract: Systems and methods for providing automated computer support are described herein. One described method comprises receiving a plurality of snapshots from a plurality of computers, storing the plurality of snapshots in a data store, and creating an adaptive reference model based at least in part on the plurality of snapshots. The described method further comprises comparing at least one of the plurality of snapshots to the adaptive reference model, and identifying at least one anomaly based on the comparison.

Abstract: Embodiments of the present invention disclose a method, computer program product, and system for snapshot management in a storage infrastructure. A computer identifies one or more snapshots within layers of the storage infrastructure. The computer determines one or more relationships of the one or more identified snapshots of the storage infrastructure. The determined relationships include, at least in part, relations of one or more entities included in the one or more snapshots to additional one or more entities in the one or more snapshots of the storage infrastructure. The computer identifies the one or more duplicate snapshots by utilizing the one or more determined relationships of the one or more identified snapshots. The computer consolidates the one or more identified duplicate snapshots in the storage infrastructure. In another embodiment, the computer identifies one or more inconsistent snapshots, and consolidates the one or more inconsistent snapshots in the storage infrastructure.

Abstract: A method for facilitating discovery of electronic data stored in a data storage system. The method includes generating a snapshot of the electronic data, wherein the snapshot permits read access to the data, and a copy-on-write technique is used to perform modifications to the data, such that the snapshot is immutable but ongoing user operations with respect to the data can be performed substantially without interruption. The method also includes transmitting data of the snapshot over a network to a data cache server to which an analysis computer system is communicatively coupled. In some embodiments, the data cache server may store a local copy of the transmitted data of the snapshot. In this regard, the data cache server may determine whether data requested by the analysis computer system is stored locally, and if so, the data cache server may transmit the data requested directly to the analysis computer system.

Abstract: A system and method are provided for performing storage operations relating to a first secondary copy of electronic data. A storage policy or storage preferences may dictate that a replication copy should be used in storage operations performed to a particular client, sub-client, data, media or other item. Based on the storage policy, when a new client, sub-client, data, media or other item is received, a media agent determines whether there is a replication copy of the item. In the absence of a replication copy, one may be created. The replication copy may be provided by a third party application, or created by the client or a storage management system component. Information regarding the replication copy and its corresponding first secondary copy may be stored in a database. To optimize use of system resources, storage operations relating to the first secondary copy may be performed using the replication copy instead of the first secondary copy.

Abstract: A method that may executed by a main storage system and may include compressing the vast genetic information database to provide a compressed genetic information database; storing the compressed genetic information database, receiving updates to the vast genetic information database; updating the compressed genetic information database; generating different point in time snapshots of the compressed genetic information database; calculating differences between the different point in time snapshots of the compressed genetic information database; and transmitting the differences to at least one secondary storage system that is accessible to a user.

Abstract: Disclosed is system for monitoring data changes during a data replication process. The system includes a modeling module configured to select tables and fields to be monitored during execution of the data replication process, a trigger module configured to track changes of data being generated during execution of a program by inserting triggers into a destination system at the start of a program execution and then dropping the trigger at the end of program execution, a snapshot module configured to track changes of data being generated during execution of a program by generating a snapshot of data at the beginning and the end of program execution, and a report module configured to generate a report indicating changes in data based on the changes in data indicated by the triggers and based on the changes in data indicated by the snapshots of data.

Abstract: A file cloning mechanism allows for quickly creating copies (clones) of files within a filesystem, such as when a user makes a copy of a file. In exemplary embodiments, a clone of a source object is at least initially represented by a structure containing references to various elements of the source object (e.g., indirect onodes, direct onodes, and data blocks). Both read-only and mutable clones can be created. The source file and the clone initially share such elements and continue to share unmodified elements as changes are made to the source file or mutable clone. None of the user data blocks or the metadata blocks describing the data stream (i.e., the indirect/direct onodes) associated with the source file need to be copied at the time the clone is created. At appropriate times, cloned files may be “de-cloned.

Abstract: A system and method for maintaining a mapping table in a data storage subsystem. A data storage subsystem supports multiple mapping tables. Records within a mapping table are arranged in multiple levels which may be logically ordered by time. Each level stores pairs of a key value and a pointer value. New records are inserted in a created new (youngest) level. All levels other than the youngest may be read only. In response to detecting a flattening condition, a data storage controller is configured to identify a group of two or more adjacent levels of the plurality of levels for flattening which are logically adjacent in time. A new level is created and one or more records stored within the group are stored in the new level, in response to detecting each of the one or more records stores a unique key among keys stored within the group.

Abstract: Example embodiments of the present invention provide methods for replicating a production site snapshot to a replication site. A first example embodiment creates a snapshot of the production volume at the production site and creates a bookmark in a do metadata stream. The bookmark may be sent to the replication site and, when processed from the do metadata stream at the replication site, cause the replication site to create a snapshot of the replication volume according to the bookmark. A second example embodiment replicates to a replication site snapshot by generating a list of differences between the production site snapshot and the replication site snapshot and performs replication according to the differences. The differences may include differences between the production site volume and the production site snapshot, differences between the production site volume and the replication site volume and differences between the replication site volume and the replication site snapshot.

Abstract: A method and system for utilizing snapshots to provide copies of a database or other application or large data structure to computing devices receives a request for access to a copy of a database, and performs a snapshot of a storage volume containing the requested database. The system then clones the snapshot and mounts the snapshot to a computing device, thus enabling the computing device to access a copy of the database. In some examples, the system automatically updates copies of a database on a scheduled basis (e.g., daily or weekly basis) to refresh a database regularly.

Abstract: A data processing system includes a host and a plurality of locations. A difference recording operation between a first location of the plurality of locations and a second location of the plurality of locations is started. A first operational relationship between a third location of the plurality of locations and the first location is started. A signal is sent in response to the first operational relationship starting after the difference recording operation. A first dataset is updated in response to the host writing data to at least one of the first location or the second location. The first dataset is updated with changes to the first location in response to the signal.

Abstract: A host-based replication snapshot method. The method includes synchronizing a set of data objects stored at both a replication source node and a secondary node. The method further includes identifying changed data objects out of the set of data objects from the replication source node that have been modified during a time period between a first time and a subsequent second time. Metadata indicating the changed data objects from the replication source node is transmitted to the secondary node. A snapshot is then generated at the second time on the secondary node by using the metadata.

Abstract: An information processing apparatus includes a volatile main storage; a nonvolatile first-auxiliary storage; a nonvolatile second-auxiliary storage for storing second data; a processing unit for loading the second data from the second-auxiliary storage into the main storage; a storing unit for storing first data stored in the main storage into the first-auxiliary storage at a predetermined timing, wherein the first data includes the second data that was loaded into the main storage from the second-auxiliary storage; and a loading unit for loading the first data stored in the first-auxiliary storage into the main storage. After the loading unit loads the first data into the main storage, the processing unit loads, from the second-auxiliary storage into the main storage, the second data that was changed after the storing unit stored the first data into the first-auxiliary storage from the main storage section.

Abstract: A request to generate a snapshot of the master file system for replication is received. The master file system is frozen and a freeze callback function is invoked to generate a consistent point in time. The freeze callback function initiates generation of a bookmark event based on a current time. The bookmark event indicates the consistent point in time for generation of the snapshot. The freeze callback function also initiates capturing I/O events intended for the master file system in order and suspending journal flushing to data storage so as to avoid deadlock of the master file system. The freeze callback function is forwarded and used to generate the snapshot by indicating the consistent point in time to start generation of the snapshot.

Abstract: A data storage system according to certain aspects can share a single snapshot for multiple applications and/or agents. For example, the data storage system can receive snapshot commands from multiple applications and/or agents, and can group them for a single snapshot (e.g., based on time of receipt of the snapshot commands). Data associated with the multiple applications and/or agents may reside on a single LUN or volume. The data storage system can take a single snapshot of the LUN or volume, and generate metadata regarding which portion of the snapshot is related to which application. The single snapshot can be stored in one or more secondary storage devices. The single snapshot may be partitioned into portions relating to different applications and stored separately.

Abstract: A method and apparatus for replicating a data container of a source storage server at the logical level in an unordered stream of individual data units are described. In certain embodiments, the replication operations can be performed without regard to the differences in geometry of physical persistent storage of the source and destination storage servers and without regard to the differences in data container format of the source and destination storage servers. An initial replication operation of the source data container is performed by transferring the data objects within the source data container to a replica data container in the destination storage server as an unordered stream of individual data units while preserving data object identifiers of the source data objects. Afterwards, incremental replication operations can be performed to capture modifications to the source data container over time after the initial replication operation.

Abstract: Systems and methods are disclosed for state consistent replication of client data set on a client computer by generating a snapshot of the client data set on a local volume; synchronizing with a remote server volume corresponding to the local volume to create a copy of the client data set on the remote server; performing a master to slave replication of the data set; and taking a snapshot of the server data set to create a mirror of the snapshot of the client data set on the server.

Abstract: The present invention relates to a method for performing an image level copy of an information store. The present invention comprises performing a snapshot of an information store that indexes the contents of the information store, retrieving data associated with the contents of the information store from a file allocation table, copying the contents of the information store to a storage device based on the snapshot, and associating the retrieved data with the copied contents to provide file system information for the copied contents.