Abstract: A method begins by a processing module of a dispersed storage network (DSN) sending a set of write commands to storage units of the DSN regarding storage of a set of current revision level encoded data slices and receiving a write acknowledgement in response to a write command. The method continues with the processing module determining whether a write threshold number of write acknowledgements have been received. When the write threshold number of write acknowledgements have been received, the method continues with the processing module issuing a set of commit commands to the storage units. The method continues with the processing module determining whether to issue a set of finalize commands, where a finalize command instructs a storage unit regarding storage of a corresponding current revision level encoded data slice and storage of a previous revision level encoded data.

Abstract: A system and methods are disclosed for performing virtual machine (VM) backups. In accordance with one embodiment, a hypervisor executed by a processing device suspends execution of a VM and initiates a backup procedure to save a current state of the VM. The hypervisor reads a value of a flag that is written to by the VM and is stored in a portion of memory accessible by the VM and the hypervisor. In response to determining that the value read by the hypervisor equals a first value, the hypervisor resumes execution of the VM prior to receiving a status message regarding the backup procedure. In response to determining that the value read by the hypervisor equals a second value, the hypervisor waits to resume execution of the VM until the hypervisor has received a status message indicating that the backup procedure was successful.

Abstract: Systems and methods are disclosed for rapidly restoring client data set for a computer by storing the client data and one or more pat sets required to revert to one or more version of the client data on a remote server; storing a local copy of the replicated client data on a local data storage device coupled to the computer; receiving a request to revert to a predetermined version of the client data; using the local copy as a seed, receiving a patch set corresponding to a predetermined version; and updating the local copy using the patch set to generated the predetermined version.

Abstract: A storage system and a method for realizing a storage system is disclosed, the storage system comprising: a disk array comprising at least one solid state disk and at least one non-solid state disk; and a storage control means configured to: in response to entering a scrubbing mode, scan and move data blocks in the at least one non-solid state disk in the disk array to form more continuous free blocks. The storage system of the present invention has good read and write performances, higher data reliability and availability, and lower cost.

Abstract: A storage apparatus performs, in place of a copy process which involves physical resource allocation to a copy destination logical volume, a copy process which allows the copy destination logical volume to refer to an allocation destination managed by a management unit area of a copy source logical volume. A storage unit stores management information relating to the reference destination of the management unit area of the logical volume. A control unit releases the physical resource which has been allocated to the management unit area by exchanging the reference destination of the management unit area specified by a release command from a host computer with the reference destination of the management unit area of the other logical volume corresponding to the specified management unit area.

Abstract: A mechanism is provided in a data processing system for replicating writing of a file with striping. The mechanism writes a file at an owner node within a plurality of nodes in a data processing system. The mechanism divides the file into a plurality of file chunks. The mechanism identifies at least one replication node within the plurality of nodes having a duplicate copy of a respective file chunk within the plurality of file chunks. The mechanism selects a plurality of replication nodes for the plurality of file chunks based on identification at least one replication node within the plurality of nodes having a duplicate copy of a respective file chunk and replicates the file at the plurality of replication nodes based on the selection of the plurality of replication nodes.

Abstract: Example apparatus and methods treat some erasure codes differently than other erasure codes. For example, erasure codes that are only involved in error-recovery may never be read and thus may be stored using a different approach than erasure codes that are involved in more regular data reading. If different types of data stores are available, then the erasure codes that are more likely to be read may be stored in data stores having a first (e.g., higher, faster) type of read performance while the erasure codes that are less likely to be read may be stored in data stores having a second (e.g., lower, slower, less expensive) type of read performance. Different data stores may be located on different data storage devices. Different data stores may even be located on a single data storage device.

Abstract: Self-describing data blocks of a minimum atomic write size may be stored for a data store. Data may be received for storage in a data block of a plurality of data blocks at a persistent storage device that are equivalent to a minimum atomic write size for the persistent storage device. Metadata may be generated for the data that includes an error detection code which is generated for the data and the metadata together. The data and the metadata are sent to the persistent storage device to store together in the data block. An individual atomic write operation may write together the data and the metadata in the data block. When accessed, the error detection code is applicable to detect errors. The metadata may also be applicable to determine whether the data is stored for a currently assigned purpose or a previously assigned purpose of the data block.

Abstract: Restoration devices in a cloud storage system are paired with source containers associated with a mainframe computer, and series of commands are generated based on the pairings to cause copies of data at the source containers to be stored to the restoration devices. A point-in-time copy of the copy of the data at the source containers may be stored to some restoration devices, and a second copy of the data may be stored to other restoration devices. The restoration devices may be reallocated from inactive source containers. Execution of the commands is monitored, and the commands are modified if the execution of the commands does not satisfy one or more desired conditions. For example, a cycle time associated with copying data to a restoration device may be measured, and if the cycle time exceeds a threshold, the command may be modified.

Abstract: In some embodiments, a method of maintaining a reference list for data deduplication is provided. The method includes discarding a newly arriving data segment in response to finding a fingerprint of the newly arriving data segment matches an existing fingerprint in a plurality of fingerprints on a fingerprint-to-file reference list. The method includes adding, in the fingerprint-to-file reference list, to a list for the existing fingerprint, a source for the newly arriving data segment, in response to the fingerprint-to-file reference list indicating the existing fingerprint does not correspond to a hot data segment and setting an indication in the fingerprint-to-file reference list that the existing fingerprint corresponds to the hot data segment in response to the list for the existing fingerprint meeting or exceeding a predetermined number of entries. Other embodiments are included.

Abstract: Structured block transfer module, system architecture, and method for transferring content or data. Circuit allowing content in one memory to be shifted, moved, or copied to another memory with no direction from a host., the circuit comprising: a connection manager, at least one copy engine, and a connection between the connection manager and the copy engine. Method for transferring the contents of one of a number of blocks of source memory to one of a number of possible destination memories comprising: selecting source memory; selecting available destination memory; marking the selected destination as no longer available; copying contents of selected source memory into selected destination memory; and marking selected source as available.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for maintaining virtual machine metadata. One of the methods includes initializing a first virtual machine (VM) on a first host machine using one or more elements of user-specified initialization metadata. Upon receiving a notification that the first VM has published one or more elements of VM-generated metadata, one or more elements of VM-generated metadata are obtained. A request is received for the one or more elements of VM-generated metadata, and the one or more elements of VM-generated metadata are provided in response to the request.

Abstract: A computer-implemented method for creating optimized synthetic backup images may include (1) transferring a backup image that represents a virtual machine at a specific point in time to a server that stores the backup image, (2) identifying a subsequent backup image that represents at least a portion of the virtual machine at a subsequent point in time, (3) creating a data stream that includes (i) at least one changed data block captured in the subsequent backup image and (ii) at least one reference that identifies where at least one unchanged data block is located within the backup image stored on the server, and then (4) transferring the data stream to the server to enable the server to create an optimized synthetic backup image of the virtual machine. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: A secondary storage controller receives metadata that uniquely identifies a source volume of a primary storage controller. Data stored in the source volume of the primary storage controller is synchronously copied to a target volume of the secondary storage controller. The secondary storage controller receives a command from a primary host to write selected data to the source volume. In response to receiving the command at the secondary storage controller, the selected data is written to the target volume of the secondary storage controller.

Abstract: A storage control device configured to control a storage device includes a first disk which is in active state and a second disk which is in standby state. The storage control device includes a communication unit and a control unit. The communication unit transmits a read-out request or a write request to the storage device and receives a response to the read-out request or the write request from the storage device. The control unit controls the communication unit so that the communication unit transmits a rotation start command which instructs a start of rotation of the second disk to the storage device, when a time to the point when receiving the response to the read-out request or the write request transmitted to the first disk which is in active state is longer than a predetermined threshold.

Abstract: An apparatus is operable with a host and a data storage component for controlling expansion of storage, and comprises: an allocating component responsive to a user input for allocating an expanded target storage space to a file system element to thereby make an expanded file system element; a file system metadata component for maintaining file system metadata including metadata for said expanded file system element; a file system I/O component responsive to said file system metadata component for controlling file system I/O between said host and said storage component; and a synchronizing component responsive to said file system metadata component for synchronizing data between a source storage space and said expanded target storage space; wherein said file system I/O component is operable to use said file system metadata component to access said expanded file system element prior to completion of action of said synchronizing component.

Abstract: Disclosed herein is an enhanced volume manager (VM) for a storage system that accelerates input/output (I/O) performance for random write operations to a striped disk array using parity. More specifically, various implementations are directed to accelerating “random writes” (writes comprising less than a complete stripe of data) by consolidating several random writes together to create a “sequential write” (a full-stripe write) to eliminate one or more read operations and/or increase the volume of new/updated data stored for each write operation. Several such implementations comprise functionality in the VM (volume manager) for identifying random write I/O requests, queuing them locally in a journal, and then periodically flushing the journal to the disk array as a sequential write request.

Abstract: A storage controller receives a write command with respect to a track, from a host. A first process determines that the track is a source track and also determines that at least one corresponding target track is in an incremental copy relation to the source track. A second process is generated to modify a target change recording structure, where the second process executes in parallel with the first process.

Abstract: A memory control apparatus, a memory control method, and a program are provided which allow reduction of the number of times of writing to a nonvolatile memory. According to the present invention, both of data to be written to one block of a plurality of blocks dividing a storage region of a nonvolatile memory and information for identifying the number of times of writing to the nonvolatile memory are written to the one block.

Abstract: Capturing post-snapshot quiescence writes in a branching image backup chain.

Abstract: A computer-implemented method for increasing restore speeds of backups stored in deduplicated storage systems may include (1) identifying a backup that includes data stored in at least one data container within a deduplicated storage system, (2) detecting a subsequent backup that includes additional data, (3) calculating an amount of duplication between the additional data included in the subsequent backup and the data stored in the data container, (4) determining that the amount of duplication between the additional data and the data stored in the data container is below a predetermined threshold, (5) identifying at least one additional data container to store the additional data instead of deduplicating the additional data with respect to the data container, and then (6) storing the additional data in the additional data container to facilitate increasing a restore speed of the subsequent backup. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: Expired files in the deduplicating virtual media are selectively erased using a backup application for notifying a backup repository of which expired files are no longer required. The space of the expired files is reclaimed for reuse. Virtual space of the expired files is reserved for allowing the backup application to seek past the reclaimed space to subsequent data in the deduplicating virtual media.

Abstract: A method of performing data management in a computing system comprises performing a checkpointing operation comprising storing checkpoint of the computing system, writing a plurality of nodes in a plurality of node blocks in a sequential write method after the checkpointing operation, each of the plurality of nodes comprising position information of a next node block, and during a subsequent recovery operation, selecting a node for recovery by scanning of the plurality of node blocks using the position information.

Abstract: A method, system, and computer program product for use in replication comprising intercepting an IO for a file at an application layer at the production site, determining if the file is being replicated, and based on a determination the file is being replicated, sending the IO to a first data recovery appliance and recording the IO in a journal.

Abstract: The storage system according to the present invention has a function to encrypt write data from the host and store the same in a storage media. Further, validation information of write data is added to the write data during storage thereof, and the data having the validation information added thereto is encrypted and stored in the storage media. When starting the storage system or restoring the encryption key information, the encrypted data stored in the storage media is read from the disk and decrypted prior to receiving a data access request from the host, and validation of data is performed using the validation information added to the decrypted data, so as to determine whether the encryption key stored in a storage controller is valid or not.

Abstract: A virtualization based system comprises a host and a plurality of virtual machines that may each comprises a guest memory. A virtual machine monitor has access to underlying platform hardware in the system and may control physical resources in the platform. The platform hardware comprises a processor and a memory coupled to the processor. Further, the VMM may manage guest software including guest operating systems running on the virtual machines. A binary translation logic may replace guest memory writing instructions corresponding to a hot spot in guest application with translated codes to generate a mirrored content for the guest memory. The binary translation logic may combine one or more of the guest memory writing instructions in a region and keep the region atomic. The processor may execute the translated codes in an atomic region together to write a content in the guest memory and a mirrored content in a mirroring memory. The VMM may allocate a memory region in the host memory for the mirroring memory.

Abstract: Systems, methods and computer program products for multicast database replication are described herein. An embodiment includes creating a replication group for replication of data. One or more replicate (or target) databases are subscribed to the replication group and the replication group may include one or more subscribed replicate databases. The replication group is associated with a replication group address. Embodiments send (or publish) data that is to be replicated to the replication group multicast address causing automatic replication of the data to the subscribed replicate databases. In this way, by sending data to be replicated once to a replication group address, the data is automatically replicated to several subscribed replicate databases and a replication server need not establish distinct point-to-point connections with each replicate database.

Abstract: Method and system for migrating information from a source storage to a destination storage is provided. The method includes (a) receiving a migration request to migrate information from the source storage to the destination storage; wherein a router receives the migration request; (b) placing a reservation on the source storage such that no other system can write to the source storage, once the migration of information from the source storage to the destination storage is initiated; wherein the router sends a reservation request to a system that manages the source storage and the system grants the reservation request to the router; (c) migrating information from the source storage to the destination storage, while the reservation is placed on the source storage; and (d) releasing the reservation after migration is completed in step (c).

Abstract: According to one embodiment, a memory system includes a first memory, a second memory, a third memory, and a memory controller. The first memory includes a plurality of blocks. The second memory stores a first table having a plurality of first correspondences between a logical address and a physical address. The third memory has a higher processing speed than the second memory and stores a second table having second correspondences which are parts of the first correspondences. The memory controller determines whether data in a written block is first data to be copied, using the first table, not the second table. The memory controller copies the first data from the written block to a writable block to copy all data in a first state in the second block to the writable block. The memory controller sets all data in the written block to a second state.

Abstract: A computing device executing a virtualization manager detects that a virtual machine running on a host has been paused. While the virtual machine is paused, no processor cycles are assigned to the virtual machine. The computing device determines whether a condition that caused the virtual machine to be paused has been resolved. If the condition has been resolved, the computing device causes the virtual machine to be resumed. Resuming the virtual machine includes assigning processor cycles to the virtual machine and performing a last input/output operation that was attempted prior to the virtual machine being paused.

Abstract: A centralized content addressed storage (CAS) application and a method for providing data protection are implemented by running a CAS application on a virtualization layer of a computer platform. The virtualization layer presents to the CAS application a normalized representation of a hardware subsystem of the computer platform, shielding the CAS application from actual hardware devices of the computer platform. A storage device of the computer platform is used to store a raw data set and the CAS application generates a backup data set of the raw data set. The CAS application stores the backup data set to an archive mechanism of the computer platform and can also restore and recover the raw data set in the event it is lost, corrupted or otherwise destroyed. Multiple CAS applications can be operated separately or together and they may be the same or differ.

Abstract: A system for migrating data items from a source cluster to a destination cluster in a database system. During operation, while the database continues to process live database traffic, the system records a current position in an operation log for the database, wherein the operation log comprises a sequential record of operations applied to the database. Next, the system retrieves data items from the source cluster, and inserts the copies of the retrieved data items into the destination cluster. The system also applies a sequence of updates, starting from the recorded position in the operation log, to the copies of the data items in the destination cluster. Finally, after the sequence of updates is applied, the system performs a cut-over operation that diverts the live database traffic from the data items on the source cluster to the copies of the data items on the destination cluster.

Abstract: Systems and methods are disclosed for command sets and functions for communication between and operation of devices, especially data storage devices. In an embodiment, an apparatus may comprise a data storage device configured to store data as objects, each object including a tracking indicator to identify the object, and a data field with a variable size to store user data. The data storage device may further be configured to receive a command including an operation directed to an object and an indicator that specifies a variation of the operation to be performed. In another embodiment, a memory device may store instructions that cause a processor to perform a method comprising storing data as objects to a nonvolatile media, and receiving a command including an operation directed to an object and an indicator that specifies a variation of the operation to be performed.

Abstract: A computer-implemented method and system for safe storing data is disclosed. A sending queue manager associated with a client computer transmits an asynchronous write of a transaction message containing data to a receiving queue manager associated with a transaction processing computer not collocated with the client computer. The receiving queue manager transmits a synchronous write of the transaction message to a remote queue manager associated with a remote disaster recovery computer to safe store the transaction message before it can be operated upon by the transaction processing computer.

Abstract: A method and apparatus for managing persistent change operations on user data is disclosed. For each change, a record of the change is saved. An index tracks the current state of the user data. Changes can be undone or redone in a sequential manner if certain criteria are met. Variables pertaining to the changes are saved in a persistent storage, enabling an undo/redo history to be preserved if a program is exited and restarted.

Abstract: In one embodiment, a method performed by one or more computing devices includes receiving at a host cache a first request for data comprising at least one snapshot of a cached logical unit number (LUN), sending, by the host cache, the data comprising at least one snapshot of the cached LUN in response to the first request, and in response to the completing sending the data comprising at least one snapshot of the cached LUN, sending, by the host cache, a first response indicating that sending the data is complete.

Abstract: A data control system facilitates transfer of a virtual disk from a primary storage system to a secondary storage system. The data control system, responsive to an instruction to transfer the virtual disk, wherein the virtual disk comprises a plurality of data blocks, determines whether each of the plurality of data blocks is allocated or unallocated; for each data block of the plurality of data blocks determined to be allocated, the data control system reads the data block from memory in the primary storage system and transfers the data block for storage in the secondary storage system; and for each data block of the plurality of data blocks determined to be unallocated, the data control system refrains from reading the data block from memory in the primary storage system.

Abstract: A data storage system comprises a controller, a first lower performance storage medium and a second higher performance storage medium. The controller is connected to the storage mediums and is arranged to control Input/Output (IO) access to the storage mediums. In operation, the controller is arranged to store an image on the first storage medium, initiate a copy function from the first storage medium to the second storage medium, direct all IO access for the image to the second storage medium, and periodically age data from the second storage medium to the first storage medium.

Abstract: A data storage system comprises a controller, a first lower performance storage medium and a second higher performance storage medium. The controller is connected to the storage mediums and is arranged to control Input/Output (IO) access to the storage mediums. In operation, the controller is arranged to store an image on the first storage medium, initiate a copy function from the first storage medium to the second storage medium, direct all IO access for the image to the second storage medium, and periodically age data from the second storage medium to the first storage medium.

Abstract: A method for supplementing structured information within a data system for entities based on unstructured data analyzes a document with unstructured data and extracts attribute values from the unstructured data for one or more entities of the data system. Entity records with structured information are retrieved from the data system based on the extracted attribute values. Entity references for corresponding entities of the data system are constructed based on a comparison of the retrieved entity records and the extracted attribute values. The entity references are linked to the corresponding entities within the data system, with the entity references including extracted attributes from the unstructured data for corresponding linked entities.

Abstract: A memory system including parent data and clone data is disclosed, where the clone data represents a clone of the parent data. The system determines whether clone data to be accessed is different from corresponding data in the parent. The system also determines a physical location of the data to be accessed based on whether the data to be accessed is different from the corresponding parent data. The system also accesses the data based on the physical location.

Abstract: A disk-error detection system may include a storage array having a plurality of storage disks configured to store data. The disk-error detection system may include a processor in communication with the storage disks. The processor may detect presence of a media error in a storage disk from the plurality of storage disks during a read operation of the data stored on the storage disk. The processor may perform a media-error detection scan of a predetermined portion of the storage disk in response to the detection of the media error. The location on the storage disk of the predetermined portion of the storage disk may be based on location of the media error on the storage disk. A method and computer-readable medium may also implement disk-error detection.

Abstract: A backup copy from a first data volume to a second data volume is executed according to either a synchronous mode, in which write data is copied from the first data volume to the second data volume in synchronous with a write request, or an asynchronous mode, in which journal data of a first storage apparatus is reflected on the second data volume in asynchronous with the write request. A second storage apparatus acquires secondary load information representing its own load status, and transmits the information to the first storage apparatus. The first storage apparatus acquires primary load information representing its own load status, determines switching between the modes based on the secondary load information, the primary load information and mode information, and transmits determination information representing determination results to the second storage apparatus.

Abstract: A method and system for acquiring a quiesceing set of information associated with a virtual machine. A virtual machine is cloned. The cloned virtual machine has an associated persistent storage device. The state of the persistent storage device is transformed into a quiesced state of the cloned virtual machine by utilizing a shut-down process. The shut-down process is executed on the cloned virtual machine to quiesce the cloned virtual machine and the quiesceing set of information of the cloned virtual machine is automatically reduced to information stored on the persistent storage device.

Abstract: Techniques for virtual archiving are disclosed. In one particular exemplary embodiment, the techniques may be realized as a method for performing virtual archiving comprising applying archiving rules to a backup catalog, generating a virtual archive catalog based at least in part on a result of applying archiving rules to the backup catalog, determining a backup image associated with the virtual archive catalog becoming expired and converting the backup image into an archive image.

Abstract: A storage system which includes a cache memory needless of replacement of a power storage device, a cache memory with low power consumption, or a cache memory having no limitation on the number of writing operations is provided. An array controller for storing data externally input in any of a plurality of storage devices or a storage system including the array controller includes a processor which specifies at least one of the plurality of storage devices where the data is to be stored and a cache memory which stores the data and outputs the data to the at least one of the plurality of storage devices. The cache memory includes a storage circuit in which a transistor including an oxide semiconductor layer is used.

Abstract: A method of managing memory includes installing a first cacheline at a first location in a cache memory and receiving a write request. In response to the write request, the first cacheline is modified in accordance with the write request and marked as dirty. Also in response to the write request, a second cacheline is installed that duplicates the first cacheline, as modified in accordance with the write request, at a second location in the cache memory.

Abstract: A file encrypting method and apparatus, and a file decrypting method and apparatus is provided. The method includes following steps: creating a virtual disk; the virtual disk receiving a writing request from a file system, encrypting data in the writing request; and notifying the file system to write the encrypted data into a corresponding physical disk, so that the file system writes the encrypted data into the corresponding physical disk after receiving a notification from the virtual disk. The methods and apparatuses can employ the virtual disk to encrypt data in the writing request and decrypt the data required by the reading request, and this manner achieves highly-reliable, secure and effective file encrypting.

Abstract: A mechanism for express storage of sensor data in response to an indication of a power fluctuation, power brownout or blackout that can affect operation of a microcontroller is provided. Embodiments provide a flash memory having memory space allocated to express storage of the sensor data, and a protocol machine configured to provide the desired information to reserved registers associated with express program/erase operations accessing the allocated memory space.

Abstract: A method, non-transitory computer readable medium and device for seamless storage import includes importing file system structure entries stored in one or more storage devices. A request for an operation on one of the entries in the one or more storage devices is obtained during the importing. An import status of the requested one of the entries is determined. The obtained request is processed based on the determined import status of the requested one of the entries without interrupting the importing. The requested one of the entries is updated with the storage management computing device based on the processing. An aggregation of the imported entries with the updating of the requested one of the entries is stored.