Abstract: A data storage system includes a head node and mass storage devices. The head node is configured to flush data stored in a storage of the head node to a set of the mass storage devices of the data storage system. A head node may flush both current version data and point-in-time version data to the set of mass storage devices. Also, the data storage system maintains an index that indicates storage locations of data for particular portions of a volume before and after the data is flushed to the set of mass storage devices. In some embodiments an index includes a current version reference for a volume or portion of a volume and one or more point-in-time snapshot references.

Abstract: Host data to be written at a memory sub-system is received. A write operation is performed to write the host data at the memory sub-system. Based on the performance of the write operation, one or more usage parameter values are determined. The one or more parameter values correspond to one or more operations performed at the memory sub-system. Based on the one or more usage parameter values, a first expected time period is determined during which a first set of subsequent host data will be received from the host system and a second expected time period is determined during which a second set of subsequent host data will be received from the host system. A media management operation is scheduled to be performed between the first expected time period and the second expected time period.

Abstract: Methods and systems for improving the performance of a write-once read-many (WORM) compliant data storage cluster in which a set of data (e.g., one or more electronic files) stored within the data storage cluster may be made immutable for a data retention time period are described. The data storage cluster may determine whether to lock the set of data to satisfy WORM compliance using a combination of software-based and hardware-based techniques depending on the required data retention time, the size of the set of data to be locked, the cost to move the set of data to WORM compliant hardware storage, and the amount of available disk space corresponding with WORM compliant hardware storage located within data storage nodes of the data storage cluster. Over time, the data storage cluster may repurpose data storage resources within the data storage cluster in order to satisfy WORM compliance.

Abstract: A storage system in one embodiment comprises a plurality of storage devices and an associated storage controller. The storage controller is configured to identify a dataset to be scanned to generate a capacity release estimate for prospective deletion of that dataset, to designate a content-based signature prefix to be utilized in the scan, and to scan logical address mapping information for the dataset to identify one or more pages of the dataset that have the designated content-based signature prefix. The scanning further comprises, for each such identified page, determining a reference count of the page, and responsive to the reference count of the page having a particular value, determining a compressibility measure for the page. The storage controller generates the capacity release estimate for prospective deletion of the dataset based at least in part on the one or more page compressibility measures determined as part of the scan.

Abstract: An apparatus in one embodiment comprises at least one processing device comprising a processor coupled to a memory, with the processing device being configured to obtain content-based signatures for respective data pages of at least one write operation, to send the content-based signatures to a content addressable storage (CAS) system, and to receive from the CAS system information indicating for each of the content-based signatures whether or not the corresponding data page is present in the CAS system. Responsive to the information received from the CAS system indicating that one or more of the corresponding data pages are not present in the CAS system, the processing device sends the one or more corresponding data pages to the CAS system. The processing device illustratively comprises a host device coupled to the CAS system over a network.

Abstract: A system on chip includes an interconnect circuit including at least p input interfaces and at least k output interfaces, p source devices respectively coupled to the p input interfaces and k access ports respectively coupled to the k output interfaces and belonging to a target that includes one or more target devices. Each source device is configured to deliver transactions to the target via one of the access ports. An associated memory of each access port is configured to temporarily store the transactions received by the access port. The target is configured to deliver, for each access port, a fill signal representative of a current fill level of its associated memory. A control circuit is configured to receive the fill signals from the access ports and select the access ports eligible to receive a transaction depending on the current fill levels.

Abstract: Techniques are disclosed which allow a secondary storage system to provide data to non-production workloads in conjunction with performing data backup and protection tasks. As disclosed, a secondary storage system exposes backup data stored by the secondary storage system to other workloads, such as test and development applications, data analytics, etc. These non-production workloads can run at the same time the secondary storage system provides backup services to a primary storage system. This consolidation eliminates the need for an enterprise to deploy separate storage clusters for analytics, test and development applications, etc. and eliminates unnecessary copies of data.

Abstract: Disclosed are systems and methods restoring a computing system. The described method includes receiving a delta disk that was generated based on a backup of a computing device executing a protected application. The delta disk comprises one or more configurations for executing the protected application on a different device than the computing device. In response to a request to perform recovery of the computing device, a recovery virtual machine (VM) is created having a base virtual disk emulated from the backup. The recovery VM is modified by attaching the delta disk having the one or more configurations for executing the protected application. Execution of the protected application on the recovery VM is resumed.

Abstract: A virtual storage system and a method of sharing electronic documents within a virtual storage system that includes at least one processor that processes a plurality of electronic documents received from an external system, receives from the user computing device, a request for sharing an electronic document of the plurality of electronic documents, and input information including download information and expiration information corresponding to the electronic document, and authentication information, as input by a user, and creates at least one share link corresponding to the electronic document based on the input information, for sharing the electronic document with a recipient, and encrypt the at least one share link using the authentication information. The virtual storage system further includes a plurality of redundant physical storage devices in data communication with the at least one processor each storing the electronic documents and the at least one share link created.

Abstract: Data replication techniques may include receiving, at a first data storage system, a write operation that writes first data to a source logical device, wherein the source logical device is configured for remote replication using a first replication technology and also configured for remote replication using a second replication technology different from the first replication technology. The first technology may be a first vendor and the second replication may be from a second vendor different from the first vendor. Responsive to receiving the write operation on the first data storage system, processing may be performed comprising: replicating the write operation and writing the first data to a first target logical device on a second data storage system using the first replication technology; and replicating the write operation and writing the first data to a second target logical device on a third data storage system using the second replication technology.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for data retention and modification. One of the methods includes dividing partitions into a set of generations according to a retention policy; accumulating modification and deletion events that define changes to be applied to data of the distributed dataset; and when a triggering event occurs for a triggered generation in the set of generations, rolling an oldest partition out of the triggered generation, the rolling comprising: if the oldest partition has reached the end of a retention period for the dataset, marking the oldest partition for deletion in the triggered generation; otherwise: creating a new partition corresponding to the data of the oldest partition, wherein the data is cleaned using a scrubbing process; adding the new partition to a next generation in the set of generations; and marking the oldest partition for deletion in the triggered generation.

Abstract: A computer-implemented method according to one embodiment includes identifying data stored within a first virtual storage tier of a storage system, analyzing one or more characteristics of the data, and conditionally transferring the data from the first virtual storage tier of the storage system to a second virtual storage tier of the storage system, based on the analyzing.

Abstract: A memory system includes a memory device comprising a plurality of memory cells storing data, and configured to perform one or more of a write operation, read operation and erase operation on the plurality of memory cells; and a controller configured to control an operation of the memory device, wherein the controller is configured to: cache a logical block addressing (LBA) mapping table from the memory device when the memory system is powered on by driving power applied thereto; and transfer a direct memory access (DMA) setup to a host when the LBA mapping table is cached.

Abstract: A storage for storing backups of virtual machines includes a persistent storage and a garbage collector. The persistent storage stores the backups. The garbage collector identifies an end of a backup generation session; in response to identifying the end of the backup generation session, the garbage collector performs a date analysis to identify a set of potentially stale backups of the backups; performs a continuity chain analysis of each backup of the set of potentially stale backups to identify a set of stale backups; and deletes each backup of the set of stale backups.

Abstract: A journal-based process to achieve atomicity in a device driver write operation includes committing a transaction associated with the operation to a journal that include a status indicating the target block is corrupted. Subsequent to committing the transaction, the data is written to the target block. If the write operation is successfully committed, the transaction can be deleted from the journal. If a system crash occurs (e.g., power failure) before the write operation is successfully committed, the transaction remains in the journal and can be used to update block metadata associated with the target block when the system reboots to indicate that it is corrupted; e.g., the target block is a torn write.

Abstract: Described herein are systems, methods, and software to enhance the management of virtual nodes in a computing environment. In one example, a method includes identifying a transition event for a first version of a virtual node executing on a first host, identifying a second host to support a second version of the virtual node, and initiating execution of the second version of the virtual node on the second host. In some implementations, the virtual node comprises a non-persistent portion on the executing host and a persistent portion on a second storage element.

Abstract: Systems and methods for a blockchain-based system for efficient storage and retrieval of disparate supply-side transaction information. An example embodiment includes features to receive a transaction from a provider system; aggregate the received transaction with a plurality of other transactions, wherein each transaction is encrypted; generate one or more hashes associated with the aggregated transactions, and broadcast the generated hashes onto a blockchain of a blockchain network; store the encrypted transactions and generated hashes, wherein the computer system is configured to respond to a search request received from a user, and wherein the computer system is further configured to validate stored transactions which are responsive to the search request via comparison to the generated hashes on the blockchain.

Abstract: According to one embodiment, a storage system includes a representative node and a plurality of general nodes including a plurality of resources. Each of the general nodes stores resource status information indicating respective statuses of the plurality of resources in a first storage unit thereof. The representative node stores resource status information collected from the plurality of general nodes in a second storage unit thereof, decides whether to acquire the resource status information from the first storage unit of the general node or to acquire the resource status information from the second storage unit based on a received request, and transmits the resource status information acquired from a decided acquisition destination to an issuing source of the request.

Abstract: A log unit provides a shared log for recording updates on data objects. Garbage collection is performed locally and in-place by the log unit. In a marking portion of the garbage collection process, the log unit identifies and marks log entries that record mergeable updates. In a deallocation portion of the process, the log unit merges one or more mergeable log entries and deallocates at least portions of the merged log entries.

Abstract: Systems, apparatus, and methods for any point in time replication to the cloud. Data is replicated by replicating data to a remote storage or a data bucket in the cloud. At the same time, a metadata stream is generated and stored. The metadata stream establishes a relationship between the data and offsets of the data in the production volume. This allows continuous replication without having to maintain a replica volume. The replica volume can be generated during a rehydration operation that uses the metadata stream to construct the production volume from the cloud data.

Abstract: Techniques for providing snapshots of logical devices may include: receiving a first request to create a first snapshot of a logical device; responsive to the first request, performing first processing including storing first information in a cache slot, the first information identifying the first snapshot and the logical device used as a source of the first snapshot; receiving a second request to activate one or more snapshots, including the first snapshot, identified by information stored in the cache slot; and responsive to receiving the second request, performing second processing including initiating execution of an asynchronous process that performs snapshot activation processing for the one or more snapshots identified by the cache slot.

Abstract: Migrating data from a first storage device to a second storage device includes causing all data of the first storage device to be copied from the first storage device to the second storage device and causing the host computer to transition from performing I/O operations with the first storage device to performing I/O operations with the second storage device by modifying metadata used for I/O operations to change a mapping of logical devices to physical devices only after causing all data of the first storage device to be copied from the first storage device to the second storage device. Migrating data from the first storage device to the second storage device is independent of any I/O operations by the host. A data write operation from the host is acknowledged only after the data has been successfully written to both the first storage device and the second storage device.

Abstract: A method to exchange medical data between a cloud repository on a cloud server and a plurality of local repositories on a plurality of local servers connected to the cloud server. The plurality of local servers comprises a first local server and the plurality of local repositories comprises a first local repository on the first local server. The method includes, causing the first local server to: transmit an image retrieval request to the cloud server, receive the medical image generated by the cloud server or an instruction from the cloud server to generate the medical image locally, and display the generated medical image on a display. The image retrieval request causes the cloud server to determine whether raw image data associated with the image retrieval request is stored in the cloud repository or locally in the first local repository.

Abstract: A technique for managing cache in a storage system that supports data deduplication renders each of a set of data blocks as multiple sub-blocks and loads a cache-resident digest database on a per-block basis, selectively creating new digest entries in the database for all sub-blocks in a block, but only for blocks that contain no duplicate sub-blocks. Sub-blocks of blocks containing duplicates are excluded. By limiting digest entries to sub-blocks of blocks that contain no duplicates, the storage system limits the size of the digest database, and thus of the cache, while also biasing the contents of the digest database toward entries that are likely to produce deduplication matches in the future.

Abstract: Systems and methods for providing data protection services are provided. In one example, data protection services are provided in a high availability system. Server side copies of the data stored in or by nodes or servers of the high availability system are generated. The server side copies are independent of the operating systems and storage hierarchies associated with the actual data. The resulting backup copies can be generated by storing metadata that includes references to the original data. The backup copies can also be restored without being hindered by the operating systems and storage hierarchies of the highly available system.

Abstract: A distributed storage system including memory hosts and at least one curator in communication with the memory hosts. Each memory host has memory, and the curator manages striping of data across the memory hosts. In response to a memory access request by a client in communication with the memory hosts and the curator, the curator provides the client a file descriptor mapping data stripes and data stripe replications of a file on the memory hosts for remote direct memory access of the file on the memory hosts.

Abstract: Techniques and solutions are described for facilitating data archival, including for improving compliance with retention policies and legal requirements. Data objects can be assigned an expiration date based on properties of the data objects and rules associated with such properties. The data objects can be stored in an archive. In some cases, the data objects can be automatically deleted when the expiration date passes. In other cases, the data objects can be manually deleted when the expiration date passes, with deletion not occurring, and an error being generated, if the expiration date has not passed. Unstructured data objects can be associated with structured data objects through association lists, where an association list can be used to delete such unstructured data objects with or without deletion of an associated structured data object, and where the unstructured data objects can be linked with retention policy information of the structured data object.

Abstract: Provided are a computer program product, system, and method for forming a consistency group comprised of volumes maintained by one or more storage controllers. At least one storage controller is caused to perform reservation operations for point-in-time copies of storage units to allocate storage resources and a data structure for a point-in-time copy. Upon successfully completing the reservation operations for all the point-in-time copies, Input/Output (I/O) operations to the storage units of the point-in-time copies are suspended. If I/O operations were successfully suspended at the storage units for all of the point-in-time copies, then suspension of I/O operations is ended I/O operations are allowed to continue at the storage units of the point-in-time copies. The point-in-time copies at the storage units are formed at which the suspension of I/O operations was ended after being successfully suspended. The point-in-time copies are consistent as of a same point-in-time.

Abstract: An image forming apparatus and method for verifying forgery or falsification of an execution file by using a trusted platform module configured to generate an encryption key are provided. The method includes generating the encryption key by using a hash value for an operating system (OS) kernel image, the generating being performed by the trusted platform module, and verifying forgery or falsification of the execution file based on the generated encryption key.

Abstract: A method for backing up data is disclosed. In one embodiment, such a method includes identifying a volume of data to back up, and determining a number of backup tasks that can operate in parallel to back up data in the volume. The number of backup tasks may be based on an amount of memory available, a fragmentation level of a target storage area, a number of tape mounts that are available, or the like. The method then divides the volume into a number of sections corresponding to the number of backup tasks. Each section is associated with a particular backup task. The method then initiates the backup tasks to back up their corresponding sections in parallel. In certain embodiments, each backup task generates a data set storing backup data from its corresponding section. A corresponding system and computer program product are also disclosed.

Abstract: A data storage device that includes a data storage medium and a controller communicatively coupled to the data storage medium. The controller is configured to receive commands from a host and to detect a hung state in the data storage device. The controller is also configured to determine an execution status of a command, of the commands from the host, associated with the hung state. The controller is further configured to dynamically carry out a self-recovery operation in the data storage device to clear the hung state. The self-recovery operation includes steps that depend upon the execution status of the command associated with the hung state.

Abstract: Provided are a computer program product, system, and method for replication of versions of an object from a source storage to a target storage. A source retention policy indicates at least one source retention requirement to determine when to expire versions of an object at the source storage and a target retention policy indicates at least one target retention requirement to determine when to expire versions of the object at the target storage. The source and target retention requirements for versions of the object are different. The source retention policy is used to expire at least one version of the object at the source storage to satisfy the at least one source retention requirement. A number of the versions of the object maintained at the source storage and target storage differ due to the different source and target retention requirements.

Abstract: Placement decisions can be made for data storage volumes based at least in part upon the requirements of the storage volumes and the capabilities of the types of hardware available to host those volumes. There may be multiple types of hardware capable of supporting a volume, and the placement can be biased to hardware capable of supporting fewer types of storage volumes in order to ensure sufficient capacity for the various types of storage volumes. A consistent level of performance can also be provided independent of the type of hardware utilized. Hardware can be selected to host a volume that is able to satisfy various volume requirements, and the operation can be adjusted to ensure that the volume requirements are satisfied over time.

Abstract: Methods and systems for recovering databases and other applications with reduced downtime using recoverable chains are described. When protecting or backing up a database, an integrated data management and storage system may capture snapshots of the database at a snapshot frequency (e.g., at 15 minute intervals) and acquire database transaction logs that include data changes of the database at a frequency that is greater than the snapshot frequency. The integrated data management and storage system may generate a particular point in time version of the database by identifying a recoverable chain that comprises a combination of one or more database snapshots including the snapshot closest to the recovery point and one or more database transaction logs.

Abstract: Embodiments of the present disclosure relate to a method, a device and a computer program product for managing a storage system. According to embodiments of the present disclosure, the method comprises, in response to a certain disk of a disk array of the storage system returning from a failed state to a normal state, determining information of a spare disk for recovering data on the storage disk, the first data being stored on the first disk. The method further comprises determining based at least in part on information of the spare disk, a disk from the spare disk and a first disk for reconstructing the disk array. According to embodiments of the present disclosure, in the case that the first disk is recovered from the failed state, the method comprises based on a data amount in the spare disk having not been recovered yet and a data amount associated with the first disk, selecting the spare disk or the first disk for data reconstruction.

Abstract: A storage system in one embodiment comprises a plurality of storage devices and a storage controller. The storage controller is configured to monitor a differential between a storage volume of the storage system and a previous snapshot generated for that storage volume, and responsive to the monitored differential satisfying one or more specified conditions, to generate a subsequent snapshot for the storage volume. For example, monitoring the differential between the storage volume of the storage system and the previous snapshot generated for that storage volume illustratively comprises maintaining a counter indicative of an amount of data in the storage volume that has been written since generation of the previous snapshot. In such an arrangement, generating the subsequent snapshot for the storage volume responsive to the monitored differential satisfying one or more specified conditions illustratively comprises generating the subsequent snapshot responsive to the counter exceeding a specified threshold.

Abstract: A method is used in managing data accesses in storage systems. An access path to a storage object is evaluated. The storage object is associated with a first storage processor of a storage system for providing access to the storage object. The storage object is accessed using a second storage processor of the storage system. The storage system includes source and destination storage pools configured such that performance characteristics associated with the source storage pool is different from performance characteristics associated with the destination storage pool. The storage object resides in the source storage pool associated with the first storage processor. Based on the evaluation, the access path of the storage object is changed to the second storage processor based on a policy. The policy determines available storage space in the destination storage pool associated with the second storage processor for migrating the storage object to the destination storage pool.

Abstract: A storage controller configures a plurality of storage tiers. A sub-unit of a storage unit is maintained in a selected storage tier of the plurality of storage tiers, for at least a predetermined duration of time subsequent to an input/output (I/O) request for the sub-unit.

Abstract: A storage system comprises: a controller; a memory; one or more objects, each object having content data and metadata which includes system metadata; and a policy which governs writing of the content data and metadata of the one or more objects from the storage system to an external storage. The policy includes a configurable criterion for decoupling of the content data and the metadata of a given object and a rule for determining storage locations for the content data and the metadata between the storage system and the external storage in a decoupled manner if the content data and the metadata of the object are decoupled. The configurable criterion is based on an attribute of the metadata of the object. The controller is operable to execute the policy against the objects and to apply the rule to determine storage locations for the content data and metadata of a decoupled object.

Abstract: Embodiments are directed to a method of backing up virtual machines coupled to a backup server in a large-scale data storage system, by installing a single instance of a backup management program on the backup server; pushing, by the backup management program, a backup agent to each virtual machine; detecting, through the backup agent, all applications running on a respective virtual machine; taking a snapshot of each application after freezing the applications and prior to thawing the applications, by the backup agent; and saving the snapshot of the each applications on a storage medium. The pushing step comprises creating a shared folder and exposing the shared folder to all the virtual machines for remote invocation by the backup program.

Abstract: Provided are a system and a method for managing a container image. The container image managing system includes a remote storage configured to store and manage a container image, a container engine configured to mount a storage area of the container image stored in the remote storage and read the container image from the mounted storage area to generate a container, and a local storage configured to store a read-write layer of the generated container.

Abstract: In an approach for purging an address range from a cache, a processor quiesces a computing system. Cache logic issues a command to purge a section of a cache to higher level memory, wherein the command comprises a starting storage address and a range of storage addresses to be purged. Responsive to each cache of the computing system activating the command, cache logic ends the quiesce of the computing system. Subsequent to ending the quiesce of the computing system, Cache logic purges storage addresses from the cache, based on the command, to the higher level memory.

Abstract: An artificial intelligence and machine learning infrastructure system, including: one or more storage systems comprising, respectively, one or more storage devices; and one or more graphical processing units, wherein the graphical processing units are configured to communicate with the one or more storage systems over a communication fabric; where the one or more storage systems, the one or more graphical processing units, and the communication fabric are implemented within a single chassis.

Abstract: Methods and systems for releasing space on a secondary storage device for resynchronization are provided. A system for releasing space on a secondary storage device for resynchronization includes a suspension detection module that determines that the relationship between a primary computing device and a secondary computing device is suspended. The system also includes a relationship resumption module that determines that the relationship between the primary computing device and a secondary computing device is resumed. The system further includes an extent release module that directs the secondary computing device to release extents in a secondary storage device of the secondary computing device that correspond to free extents in a primary storage device of the primary computing device. Additionally, the system includes a synchronization module that synchronizes data stored on the secondary storage device and the primary storage device.

Abstract: An information processing apparatus includes a first storage unit that has a power restricted state and an activated state, and a second storage that has a higher access speed than the first storage. A determination unit determines whether or not the first storage unit needs to be used based on a remaining storage capacity in which data can be stored in the second storage unit. A control unit causes, in a state where data can be stored in the second storage unit, the first storage unit to be in the power restricted state, and makes the first storage unit switch from the power restricted state to the activated state in a case where it is determined, while the first storage unit is in the power restricted state, that the first storage unit needs to be used.

Abstract: In one example, a method for generating a host affinity policy includes selecting one or more criterion for a host affinity policy, and scanning a computing environment and establishing a baseline configuration of the computing environment based upon the scan. The selected criteria are then applied to baseline configuration information, and a host affinity policy is generated based upon the application of the selected criteria to the baseline configuration information. In this example, the host affinity policy identifies a cluster that includes set of hosts, a backup proxy, and a set of datastores that are accessible by one or more of the hosts and the backup proxy.

Abstract: A data journaling method in a solid state storage device, the method including: receiving a read request; determining whether updated data mapping for the read request is located in at least one of a volatile journal and a nonvolatile journal using a Bloom filter; searching the volatile journal if the updated data mapping for the request is located in the Bloom filter, and then, searching the nonvolatile journal if the updated data mapping for the request is not found in the volatile journal; and stopping the search when the updated data mapping is found.

Abstract: Systems and methods for remediating errors in distributed computing are provided. A system may include a remediation node. The remediation node may forecast receipt of a service request by a service authority. The service request may be configured to cause the service authority to modify a service assigned to an account. The service authority may be in communication with a plurality of source systems. The remediation node may acquire, from at least one of the source systems, a service parameter in which the service authority is configured to access to process the service request. The remediation node may determine an error condition corresponding to the service parameter. The remediation node may communicate, in response to determination of error condition, a remediation instruction to the at least one of the source systems, the remediation instruction configured to cause the at least one of the source systems to modify the service parameter.

Abstract: A distributed storage device includes a control unit and a plurality of storage units. The control unit has a network interface, to receive a work instruction sent by at least one user end via a network. Each storage unit supports a non-volatile memory host controller interface (NVMHCI) specification and includes at least one non-volatile memory and a storage controller. The storage controller is capable of performing an operation on the at least one non-volatile memory according to the work instruction, to share operation resources of the control unit. The operation may be thin provisioning that establishes a physical volume and a logical volume for the storage unit.

Abstract: Method and apparatus for managing data buffers in a data storage device. In some embodiments, a write manager circuit stores user data blocks in a write cache pending transfer to a non-volatile memory (NVM). The write manager circuit sets a write cache bit value in a forward map describing the NVM to a first value upon storage of the user data blocks in the write cache, and subsequently sets the write cache bit value to a second value upon transfer of the user data blocks to the NVM. A read manager circuit accesses the write cache bit value in response to a read command for the user data blocks. The read manager circuit searches the write cache for the user data blocks responsive to the first value, and retrieves the requested user data blocks from the NVM without searching the write cache responsive to the second value.