Abstract: Embodiments for storing log snapshots in an automated data storage library by a processor. A log snapshot is saved on a node associated with the automated data storage library for subsequent retrieval such that each of a plurality of saved log snapshots saved from a plurality of nodes associated with the automated data storage library are aggregated for exporting to a user.

Abstract: Embodiments include systems and computer program products to perform an operation for managing different virtual machine images as a single virtual machine image. The operation generally includes generating a representation of a virtual machine (VM) image, and generating a first VM instance from the VM image. The representation of the VM image includes a set of artifacts associated with the VM image. The operation also includes receiving an indication of an available software update. Upon determining that the software update is applicable to the representation of the VM image, the operation further includes applying the software update to the first VM instance image.

Abstract: Embodiments include methods to perform an operation for managing different virtual machine images as a single virtual machine image. The operation generally includes generating a representation of a virtual machine (VM) image, and generating a first VM instance from the VM image. The representation of the VM image includes a set of artifacts associated with the VM image. The operation also includes receiving an indication of an available software update. Upon determining that the software update is applicable to the representation of the VM image, the operation further includes applying the software update to the first VM instance image.

Abstract: The present invention discloses a system, method and computer readable media storage program therein for allocating cloud resources, which is adapted to obtain and allocate work demand to a proper cloud resource for the processing thereof. The method, system and the computer readable media comprise the steps and corresponding device needed to classify and arrange the order of the cloud data, obtaining work demand and matching the work demand with the cloud resource so as to process thereto.

Abstract: A system, a method, and a computer program product for replication of data changes are disclosed. Based on a received data query, at least one attribute of stored data is identified for replication. The attribute corresponds to at least one parameter of the received query. Data stored at a first time and data stored at a second time are retrieved. The second time is subsequent to the first time. Data stored at the first time is compared to the data stored at the second time to determine a delta difference between the data stored at the first and second times. The computed delta difference is selected for the identified attribute. The selected computed delta difference is replicated in response to the received query.

Abstract: A snapshot analysis system analyzes a plurality of data snapshots taken in connection with data stored on a block device allocated by a data storage system. The snapshot analysis system may include an ingestor capable of initially detecting new snapshots and adding a root node for the snapshots. The system may include a block device analyzer that analyzes each snapshot to determine its contents, the relationship within data structures extant within the snapshot, and the snapshot's relationship to other snapshots and/or that of other block devices. The system may also include a clustering analyzer capable of determining whether snapshots are associated with multipart block devices, such as LVM or MD RAID devices. The system may further include a block device emulator that exposes data associated with a given snapshot as an addressable block device without necessitating retrieval or exposure of the full block device to which the snapshot is associated.

Abstract: Systems and methods of enabling a service level agreement to specify interactions between an application and a remotely located object store that manages data as objects. A computing device receives data associated with a request to write application data to an object store according to a schedule, wherein the data is file system data. The computing device creates a snapshot associated with the requested application at a snapshot pool, and transmits instructions to a cloud formatting engine to create a virtual disk at a storage pool associated with an object store. The computing device copies the snapshot from the snapshot pool to the virtual disk, the snapshot comprising file system data and transmits instructions to the cloud formatting engine to convert the data associated with the first snapshot into an object, and move the object from the virtual disk to the object store.

Abstract: Provided are a computer program product, system, and method for serializing access to data objects in a logical entity group in a network storage. Data objects associated with a logical entity at a client storage are generated. A determination is made of a prefix for a container in the network storage associated with the logical entity. The prefix is included in names of the data objects in the logical entity. The prefix is added to a lock queue shared by the client systems having access to the data objects in the container at the network storage. The data objects having the names including the prefix are transmitted to the network storage to store in the container in the network storage.

Abstract: A method of generating time-coordinated snapshots across virtual machines (VMs) managed by at least one hypervisor executing in at least one host computer is described. The method includes: controlling at least one hypervisor to activate write caches for caching write traffic, generated by the VMs, targeting virtual disks; receiving, from the at least one hypervisor, messages that indicate idle periods in the write traffic; determining a quiescent window in the write traffic across the VMs from the idle periods; controlling the at least one hypervisor to flush the write caches up to a start time of the quiescent window; and controlling the at least one hypervisor to generate snapshots of the VMs.

Abstract: Example embodiments of the present invention relate to a method, a system, and a computer program product for managing metadata. The method includes determining a common characteristic of metadata entries for a plurality of files in a directory of a file system and computing a representative metadata entry for the plurality of metadata entries according to the common characteristic of the metadata entries. The plurality of metadata entries in the file system then may be represented according to the computed representative metadata entry.

Abstract: Systems and methods for performing a recovery operation for a host. A user interface is provided than enables user interface interactions that are common to or independent of the host and user interface interactions that are specific to a client backup module selected for the recovery operation. The user interface retrieves a plug-in to enable the user interface interactions that are specific to the client backup module.

Abstract: In an embodiment, a computer-implemented method comprises receiving, at multiple broker computing devices, device control data from a plurality of directory services in a federation; posting, by the broker computing devices, the device control data to a distributed datastore including distributed ledger and blockchain; receiving, at a computing hardware device, the device control data from the distributed datastore; in response to receiving the device control data from the distributed datastore, remotely managing, by the computing hardware device, user accounts and access control and security policies on at least one networked device.

Abstract: A system is provided that permits events to be propagated between systems in near real time for the purpose of ensuring consistency in a transaction-based environment. In one implementation, transactions are streamed between systems using a lightweight protocol shortly after they are processed, rather than being communicated in a one-way batch mode as is typically done in conventional retail store systems.

Abstract: Apparatuses, systems, methods, and computer program products are disclosed for hybrid checkpointed memory. An extended memory module uses volatile memory of a host and a non-volatile memory medium as virtual memory for the host. A clone module clones data of a range of virtual memory in response to a checkpoint event for the range of virtual memory. A range of virtual memory may include data stored in a volatile memory and data stored in a non-volatile memory medium. A checkpoint module flushes dirty data of a range of virtual memory to a non-volatile memory medium in response to a checkpoint event. A hybrid checkpointed memory interface provides access to data of a range of virtual memory while dirty data is being flushed using data of a range of virtual memory, or using a clone of the data.

Abstract: A system and method for reading file blocks includes reading an inode associated with the file from the file system, the inode including one or more first block pointers, determining a height of a file tree associated with the file, and determining whether a value of a second block pointer selected from the one or more first block pointers is consistent with the file having been stored using a block allocation pattern. When the value of the second block pointer is consistent with the file having been stored using the block allocation pattern the method further includes pre-fetching a plurality of file blocks based on the block allocation pattern, verifying that the pre-fetched file blocks are consistent with the file tree, and retrieving one or more data blocks of the file. In some examples, the block allocation pattern corresponds to the file being stored in streaming order to consecutively and contiguously located blocks.

Abstract: A method is described that includes providing a snapshot counter for a storage system implemented with multiple distributed consistent database instances. The method further includes recognizing the taking of a snapshot of the storage system by incrementing the snapshot counter from a first snapshot counter value to a second snapshot counter value. The method further includes, in response to a first change for one of the distributed consistent databases subsequent to the taking of the snapshot, performing the following: saving state information of the distributed consistent database as the state information existed prior to the change and associating the first snapshot counter value to the state information. Associating the second snapshot counter's value with the distributed consistent database having the first change. Another method for the taking of a snapshot of a distributed consistent database is also described.

Abstract: The present disclosure relates to maintaining file system consistency on a mounted storage device in a computing system during system runtime. In one embodiment, a method generally includes locking access to a file stored in a file system on the mounted storage volume and metadata associated with the file. A computing system determines one or more properties associated with the file and examines the metadata for inconsistencies between the metadata and the determined properties. Upon determining that the metadata and the determined properties are consistent, the computing system generates a backup copy of the file, commits the backup copy to a backup data repository, and unlocks access to the file.

Abstract: Described are techniques for processing data. Hash values for the data portions of a logical device are determined. Each data portion has a corresponding one of the hash values. It is determined whether a first of the hash values associated with a first of the data portions is equal to a hash value of an implied data value. If the first hash value is equal to the hash value of the implied data value, first processing is performed including determining whether the first data portion has a current data value equal to the implied data value, and responsive to determining that the first data portion has a current data value equal to the implied data value, performing second processing including updating first metadata for the first data portion to denote that the first data portion has the implied data value. The first data portion is not associated with allocated storage.

Abstract: Embodiments relate to a pool of persistent storage volumes. Capacity of the volumes is managed to ensure continued operation and function of the volumes with respect to their corresponding storage pool capacity threshold(s). A background process groups the volumes within each pool into one or more clusters based on a similarity or commonality characteristic. The background process selectively performs one or more space savings techniques of a copy of a selected volume, measures impact data associated with the techniques, and maintains the data. At such time as the threshold level is approached for a storage pool, one or more space reduction actions take place on constituent volumes in view of the background process and the associated groups. The reduction action includes implementation of a space saving technique, such as compression and/or thinning, of one or more volumes in one or more clusters in an associated storage pool.

Abstract: Systems and techniques are described for transferring data. A described technique includes receiving a request to transmit a data block from a first data storage device to a second data storage device. An attempt to read the data block from the first data storage device is made. A media error resulting from the attempt to read the data block from the first data storage device is detected. In response to detecting the media error, a new data block is generated and includes mismatched checksum data that causes a checksum mismatched error when the new data block is accessed. The new data block is transmitted for storage at the second data storage device in place of the data block.

Abstract: Methods and systems for recovering data containers is provided. One method includes creating a first set of one or more incremental backups for a data container; associating by a processor the first set of one or more incremental backups with the first full backup of the data container; presenting the association of the first set of one or more incremental backups with the first full backup; and restoring the data container within a recovery time period associated with the data container.

Abstract: Described embodiments provide systems and methods for operating a storage system. A plurality of storage segments of a production volume of the storage system are identified. Write requests to be written to the production volume are received during an operating time window. An alignment of the received write requests to one or more of the plurality of segments of the production volume is determined. For write requests that are not aligned to the one or more of the plurality of segments of the production volume, snapshot replication is performed. For write requests that are aligned to the one or more of the plurality of segments of the production volume, continuous replication is performed.

Abstract: A method may include establishing, by a MPIO driver of a host information handling system, an I/O path between the host information handling system and the source storage array as an active I/O path and a path between the host and the target storage array as a passive I/O path. The method may also include performing a snapshot-based iterative replication between the source storage array and the target storage array, wherein successive iterations of the snapshot-based iterative replication comprise I/O to the source storage array occurring during an immediately previous iteration of the snapshot-based iterative replication. The method may further include, upon completion of the snapshot-based iterative replication, establishing, by the MPIO, the I/O path between the host and the source storage array as a passive I/O path and the path between the host and the target storage array as the active I/O path.

Abstract: For improving data placement optimization in a computing storage environment, an application layer and/or a user are allowed to attach anticipated usage metadata and directive metadata to a file.

Abstract: During checkpointing of a virtual computing instance running in a first host computer, memory pages that have been modified during a checkpoint time interval are lazily transmitted from the first host computer to a second, backup, host computer. The lazy transmission technique includes the steps of stunning the virtual computing instance at the end of the time interval, and after said stunning, (i) detecting at the first host computer the memory pages that have been modified during the time interval, and (ii) copying one or more of the modified memory pages to a memory region in the first host computer. Then, after the virtual computing instance resumes execution, i.e., while the virtual computing instance is running in the first host computer, the copied memory pages are transmitted from the memory region in the first host computer to the second host computer.

Abstract: Correlating two storage rings based on an access rate for an object. A correlative dual hash ring includes a first ring of storage drives and a second ring of storage drives. Objects and replicas are allocated to either a first ring or a second ring.

Abstract: Systems and methods for intelligent replication of a snapshot tree are described. In one embodiment, a first storage system may include a storage controller. In some embodiments, the storage controller may be operable to replicate a first storage volume of a first storage system and a first user snapshot of the first storage volume to a second storage volume of a second storage system and capture a first tree structure block (TSB) of the first storage system. In some cases, the first user snapshot may include a point in time capture of data on the first storage volume at a first time. In some embodiments, the first TSB captures a hierarchy of each snapshot of the first storage system.

Abstract: Techniques are shown for enabling a network system to index data stored on a third-party server without having to access the raw data on the third-party server. Metadata consisting of one or more of indexable text or indexable html or some combination of indexable text and indexable html is associated with the data stored on a third-party server. An indexing utility processes the metadata at the network system from the third-party server and arranges the metadata on the network system in a manner that is searchable by searching functionality of the network system.

Abstract: Described embodiments provide systems and methods for operating a storage system. One or more production volumes of the storage system are selected for continuous replication. A number, N, is selected that is associated with a number of damaged volumes the storage system can sustain and maintain data consistency. Write transactions from a host to an associated one of the selected one or more production volumes are intercepted. The intercepted write transactions are sent to the associated production volume and to a plurality of copy volumes. When acknowledgments of the write transaction have been received from N copy volumes, the write transaction is acknowledged to the host.

Abstract: Embodiments described herein relate to an improved technique for maintaining a consistent state during data migration operations in an active database system. Data can be copied from database table(s) of the active database system into a corresponding database table(s) in the shadow system. Snapshots of the active system can be taken at a specified point in time and used to establish a point of consistency. Later, the snapshot data can be compared with the data in the shadow database system. If the data matches, then the active and shadow database systems are at a consistent state and the data migration process completes. If the data does not match, embodiments are configured to restore the consistent state at the specified point in time by copying the snapshot data into the shadow database table(s).

Abstract: A method, system, and program product is provided for splitting a clone object from a parent object when the clone object includes at least one snapshot. A mapping is created of a source data block from the parent object to a destination data block in the clone object. A creation generation in the mapped source data block is compared to an isolate generation in the destination data block in the clone object. Inherited data blocks in the clone object are isolated from the parent object, based on the creation generation differing from the isolate generation. The destination block is updated with the mapping information.

Abstract: A technique for providing access to a data object serving as a target of snapshot-shipping replication includes taking a system snap of the data object after completion of each of multiple snapshot-shipping updates. In response to receiving a request to take a user snap of the data object, a data storage system redirects the request to a previously generated system snap, so that the data storage system takes the user snap of the system snap rather than taking the user snap of the data object itself.

Abstract: The disclosed embodiments disclose techniques for facilitating access to a remote cloud service via a cloud controller for a distributed filesystem. Two or more cloud controllers collectively manage distributed filesystem data that is stored in the cloud storage systems; the cloud controllers ensure data consistency for the stored data, and each cloud controller caches portions of the distributed filesystem. During operation, a cloud controller detects a request from a co-located client to access a network address that is in the same subnet of their local network. The cloud controller determines that the network address is associated with the remote cloud service (which executes in a cloud storage environment) and forwards the request to the remote cloud service.

Abstract: Systems and methods for providing automated computer support are described herein. One described method comprises receiving a plurality of snapshots from a plurality of computers, storing the plurality of snapshots in a data store, and creating an adaptive reference model based at least in part on the plurality of snapshots. The described method further comprises comparing at least one of the plurality of snapshots to the adaptive reference model, and identifying at least one anomaly based on the comparison.

Abstract: A method of data replication from a first data storage device to a second data storage device. The method may include generating, at the first data storage device, at spaced time intervals, a plurality of snapshots for a logical data volume of the first data storage device, the logical data volume being an abstraction of data blocks from one or more physical storage devices, each snapshot identifying changes of data for at least a portion of the logical data volume since a most previous snapshot. Also at the first data storage device, the method includes generating a delta volume, the delta volume indicating changes in the data of at least a portion of the logical data volume between two non-consecutive snapshots. The method further involves replicating the delta volume to the second data storage device, and replicating the changes to the data indicated therein at the second data storage device.

Abstract: A system, method, and computer program product for managing storage volumes. A processor creates a first point-in-time copy cascade, where the first point-in-time copy cascade comprises a source volume, a first snapshot point-in-time copy volume, and a second snapshot point-in-time copy volume; the first volume is a snapshot copy of the source volume and the second volume is a snapshot copy of the first volume; and the source volume, the first volume, and the second volume include a host portion. A processor creates a third snapshot point-in-time copy volume from the first volume. A processor maps the third volume to create a second cascade, wherein the second cascade comprises the source volume, the first volume, and the third volume but not the second volume. A processor directs an I/O operation for the first copy volume to the third volume.

Abstract: A technique manages file system metadata and is performed in a data storage system that maintains a file system on behalf of a set of host computers. The technique involves modifying a first metadata block of the file system in response to a file system change, the first metadata block containing file system metadata. The technique further involves performing a compression operation to generate a compressed metadata block in volatile storage from the first metadata block, the compressed metadata block having a size that is smaller than a size of the first metadata block. The technique further involves writing the compressed metadata block from the volatile storage (volatile cache memory) to non-volatile storage (e.g., flash memory).

Abstract: Disclosed herein are system, method, and computer program product embodiments for virtual machine (VM) backup from a storage snapshot. An embodiment operates by receiving selective backup parameters including a VM to backup and then creating a VM snapshot associated with the VM. Next, an offset table associated with a virtual disk of the VM stored on a storage is retrieved. The embodiment further includes generating a storage snapshot and deleting the VM snapshot and then promoting the storage snapshot to a new logical unit number. The promoted storage snapshot is then mounted to the backups server. The virtual disk data is backed up to a backup storage using the offset table from the storage snapshot. The storage snapshot is dismounted from the backup server and deleted from the storage.

Abstract: A method and system of implementing continuous deployment of scripts in languages that only support single deployment. The method and system may develop incremental scripts based on differences between a pending script and an implemented script.

Abstract: Provided are a computer program product, system, and method for pre-allocating storage space for an application operation in a space efficient volume where a host system transmits writes to the space efficient volume. Physical storage space is allocated to the space efficient volume when the host system submits a write request. An amount of space needed by the write request is allocated to the volume in response to receiving the write request. A space allocation request is received from the host system for an application operation indicating a requested amount of space to allocate in the space efficient volume for the application operation. The requested amount of space is pre-allocated in the space efficient volume for the application operation in advance of the application operation needing the requested amount of space for a series of write operations that will be generated during the execution of the application operation.

Abstract: Provided are a computer program product, system, and method for pre-allocating storage space for an application operation in a space efficient volume. To transmit application requests to a storage controller managing a space efficient volume, a determination is made of an amount of space required for an application operation requiring a series of write operations over a period of time to the space efficient volume. A space pre-allocation request for the application operation is transmitted to the storage controller. The space pre-allocation request indicates a requested amount of physical space to pre-allocate to the application operation to cause the storage controller to pre-allocate the requested amount of space in advance of the application operation needing the requested amount of space in the volume for the series of write operations.

Abstract: Various systems and methods for migrating data between deduplication systems. For example, one method involves receiving a fingerprint, where the fingerprint is received from a source computing device at a destination computing device, and the fingerprint is associated with a data segment stored at the source computing device. The method also involves identifying a fingerprint type associated with the fingerprint. The method also involves performing a migration operation from the source computing device to the destination computing device. The migration operation involves determining whether the fingerprint is stored in a fingerprint sub-index. The migration operation also involves determining whether a second fingerprint that corresponds to the data segment is stored in a second sub-index, where the second fingerprint is of a second fingerprint type.

Abstract: The present invention relates to a data block based backup method for a data management system. The data management system comprises a file system that controls access by a database application to at least one database container file stored the data management system. The data management system further comprises a backup client that is connected to a remote backup server, whereby a first version of the database container file is saved in the backup server and a first inode containing information on data blocks of the first version of the database container file. The method may include creating a change tracking table for at least the database container file and adding an entry in the change tracking table, whereby the entry has an indication of the respective data block in association with an information indicating the type of the access.

Abstract: Dynamically allocates a new Flashcopy backup target volume within the single repository for executing a new Flashcopy backup to avoid a collision with one of a mount operation, a restore operation, and a clone operation when dynamically allocating the new Flashcopy target volume for the new Flashcopy backup.

Abstract: Systems and methods are provided herein for efficient local caching of data tiered to cloud storage to help reduce the bandwidth cost of repeated reads and writes to the same region of a stubbed file, increase the performance of write operations, and increase performance of read operations to portions of a stubbed file accessed repeatedly. When operations are directed toward data tiered to the cloud, the data can be read from cloud storage and stored within a local cache. A cache tracking tree can be generated and used to track file regions of a stub file, cached states associated with regions of the stub file, a set of cache flags, and other file and mapping data. For example, the cache state of regions of a stub file can be tracked including a cached data state, a non-cached state, a modified state, or a truncated state.

Abstract: A system and method for efficiently maintaining metadata stored among a plurality of solid-state storage devices. A data storage subsystem supports multiple mapping tables. Records within a mapping table are arranged in multiple levels. Each level stores at least pairs of a key value and a physical pointer value. The levels are sorted by time. New records are inserted in a created new highest (youngest) level. No edits are performed in-place. A data storage controller determines both a cost of searching a given table exceeds a threshold and an amount of memory used to flatten levels exceeds a threshold. In response, the controller incrementally flattens selected levels within the table based on key ranges. After flattening the records in the selected levels within the key range, the records may be removed from the selected levels. The process repeats with another different key range.

Abstract: An embodiment may simulate a block storage system on an object storage system. An embodiment may define one or more logical parts of the block storage system and may store data included in the logical parts in a respective plurality of objects in the object storage system. In order to modify a simulation when data in the block storage system is modified, an embodiment may create a new object in the object storage system and may store the modified data in the new object. An embodiment may update a range-map to include at least one of: a reference to the new object, a logical address of the modified data, a size of the modified data and a counter.

Abstract: A storage control apparatus controls storage units in a storage apparatus and includes a memory unit that stores group information identifying a copy-source volume group belonging to a consistency group; and a control unit that creates based on the group information, snapshots of respective volumes of the volume group for a given time point; creates respective difference storage areas to store, as difference data, update data for the respective volumes after the given time point; and transfers to a copy-destination storage apparatus, data of the snapshots of the respective volumes. The control unit further creates snapshots of the respective volumes at an arbitrary time point after the given time point; creates respective difference storage areas to store, as difference data, update data for the respective volumes after the arbitrary time point; and transfers to the copy-destination storage apparatus, the difference data of the respective volumes for the arbitrary time point.

Abstract: Virtual databases are provisioned using point-in-time copies of a source database. Transaction logs received from the source database are applied to a point-in-time copy of the source database to create recovery milestones comprising database blocks that can be used to provision virtual databases. The recovery milestones are created in advance of receiving a request to provision a virtual database. Each recovery milestone is validated to determine that a consistent database snapshot can be created using the recovery milestone. If a problem is identified that prevents creation of a consistent database snapshot, the problem is fixed before creating the next recovery milestone. In response to receiving a request to provision a virtual database corresponding to a point in time, a recovery milestone is identified and transaction logs applied to the recovery milestone to create a database snapshot corresponding to the requested point in time.

Abstract: A method and system for storage copy with chain cloning are provided, including providing a volume with one or more snapshots in the form of a dependency chain, where the volume and one or more snapshots are volume nodes in the dependency chain and providing associated metadata required to maintain the one or more snapshots; cloning the dependency chain to create at least one a sparse copy chain including sparse copies of the volume and the one or more snapshots resulting in sparse volume nodes, resulting in a lattice structure of the dependency chain of volume nodes and one or more sparse copy chains of cloned volume nodes.