Abstract: A technique for performing deduplication extends a match found in a digest database by looking forward and/or backward to adjacent data elements. The technique performs data comparisons between data blocks adjacent to a candidate block and corresponding data blocks adjacent to an identified target block. If the data comparisons indicate that an adjacent candidate block matches an adjacent target block, then the adjacent candidate block may be deduplicated to the adjacent target block without having to compute a hash value of the adjacent candidate block or to perform a separate lookup into the digest database.

Abstract: A data backup system is provided with: a plurality of devices for main site storage, one device for relay site storage, and one or more devices for backup site storage. While the main site is operating normally, the relay site storage implements synchronized replication of data held by the main site storage and data held by the relay site storage. After the main site has stopped operating normally, the data held by the relay site storage and the data held by the backup site storage are subjected to consistency ensuring replication.

Abstract: A method of data loss prevention during transitions from a replication source, the method including: initiating a transition from using a first data repository as a source for data replication to using a second data repository as the source for data replication; prior to completing the transition and responsive to determining that one or more storage operations directed to the first data repository have not been replicated to the second data repository, delaying transition of the second data repository as the source for data replication; and responsive to completing the transition, promoting the second data repository as the source for data replication such that all storage operations received after completing the transition are directed to the second data repository.

Abstract: Techniques of partition abstraction in a wide area network are disclosed herein. In one example, a method includes receiving, at a partition of the wide area network, a request to perform a computing task with a computing resource in the wide area network, the computing resource having a resource identifier. In response to receiving the request, the method also includes determining whether the resource identifier of the computing resource includes a partition embedded globally unique identifier (PEGUID) and in response to determining that the resource identifier includes a PEGUID, extracting the PEGUID from the resource identifier and decoding the PEGUID to identify a partition corresponding to the computing resource.

Abstract: Disclosed is an improved approach for implementing and maintaining writable snapshots. An efficient approach is provided for implementing snapshots that can be used to immediately create snapshots without incurring any detectable delays in providing access to the new snapshots. Also described are improved metadata structures that can be used to implement and maintain the writable snapshots.

Abstract: Techniques involve: in accordance with a detection that an initiator port of a host is connected to a target port of a storage system, obtaining setup information from the host, the setup information at least comprising device identification information of the host and port identification information of the initiator port; determining a device object corresponding to the host and a port object corresponding to the initiator port, the device object being identified by the device identification information and the port object being identified by the port identification information; and associating the port object with the device object, the storage system managing access to a logical storage space of the host via the initiator port through the device object and the port object. Such techniques implement faster and more accurate automatic storage management for the host and the initiator port, improve management efficiency, and reduce the possibility of errors.

Abstract: A request to perform a write operation to write data at a memory sub-system is received. Responsive to the request to perform the write operation, the data is stored at a cache portion of cache memory of the memory sub-system. A duplicate copy of the data is stored at a write buffer portion of cache memory. An entry of the write buffer record is recorded that maps a location of the duplicate copy of the data stored at the write buffer portion to a location of the data stored at the cache portion of the cache memory. A memory operation is performed at the memory sub-system based at least in part on the write buffer record.

Abstract: Systems and methods are disclosed for cross-system storage management for transferring data across autonomous information management systems. Data may be transferred from one information management system to another information management system without interfering with or overriding each system's autonomy. For example, a secondary copy of production data (e.g., backed up data) is transferred from a first information management system that originated the data to a component of another “foreign” information management system. A first storage manager that manages the first information management system also manages the cross-system data transfer operation to a “foreign” client computing device, which remains under autonomous management as a component of the foreign information management system.

Abstract: An arithmetic processing device includes an arithmetic circuit and a memory access controller performing access control for a read request on a memory module including a volatile memory and a nonvolatile memory, the volatile memory operating as a cache of the nonvolatile memory. The memory access controller stores an address table on which unit addresses including a request address of the read request are registered, issues a speculative read to the memory module in response to the read request and update the address table when the request address is included in the unit addresses in the address table, and issues a normal read when the request address is not included in any of the unit addresses. When the normal read is issued, read data is received after transmitting a transmission request signal. When the speculative read is issued, read data are acquired when receiving a hit flag.

Abstract: Provided are techniques for using real segments and alternate segments in Non-Volatile Storage (NVS). One or more write requests for a track are executed by alternating between storing data in one or more sectors of real segments and one or more sectors of alternate segments for each of the write requests, while setting indicators in a real sector structure and an alternate sector structure. In response to determining that the one or more write requests for the track have completed, the data stored in the one or more sectors of the real segments and in the one or more sectors of the alternate segments are merged to form newly written data. In response to determining that a hardened, previously written data of a track does exist in Non-Volatile Storage (NVS), the newly written data is merged with the hardened, previously written data in the NVS. The merged data is committed.

Abstract: A method for managing resources of a computer cluster, wherein automated means allocate to a job at least one resource among several resources from the cluster, the automated means selecting the resource based on at least one historical data relative to previous uses of the resources and/or data relative to the arrangement, temperature, power consumption, bandwidth, or maintenance of the cluster or one or more components thereof, the automated mechanism thus determining the wear of the various resources available and choosing the resources with the lowest wear to perform the job, thereby avoiding the over-utilization of resources, one of the main causes of failures in a computer cluster, and increasing the lifetime of the cluster.

Abstract: A method for managing storage devices in a backup storage system includes obtaining, by a backup agent, a backup storage initiation request, identifying, in response to the backup storage initiation request, an initial grouping amount for a plurality of application types, generating a plurality of backup storage deduplication pools based on the initial grouping amount, generating a buffer pool, and generating a plurality of deduplication pool metadata mappings based on the plurality of backup storage deduplication pools, wherein a backup storage deduplication pool of the plurality of backup storage deduplication pools comprises a storage device, and wherein the buffer pool comprises a plurality of storage devices.

Abstract: Example implementations described herein are directed to automated failover and assuring RTO (Recovery Time Objective) assurance, and RPO (Recovery Point Objective) on asynchronous remote copy feature of storage. By using markers that are cyclically stored to the journal volume, the storage device can thereby determine an accurate communication loss period.

Abstract: Example methods, apparatus, systems and articles of manufacture are disclosed to facilitate meter to meter matching for media identification. Example apparatus disclosed herein include an unknown signature comparer, a stack counter, and a reference database updater. The unknown signature comparer is to select a candidate unknown signature segment meeting a threshold length from a set of unknown signature segments collected at a first audience measurement location and to compare individual signatures of the candidate unknown signature segment with a collection of unknown signature segments collected at a second audience measurement location. The stack counter is to count a number of times that the candidate unknown signature segment matches unknown signature segments in the collection and to identify the candidate unknown signature segment as a matched signature segment when the number of times meets a counter threshold.

Abstract: A computer-implemented method, according to one embodiment, includes: sending existing data to a secondary storage volume in a secondary system from a primary storage volume in a primary system. Moreover, in response to receiving a write request at the primary system: a determination is made as to whether existing data corresponding to the write request has already been copied to the secondary storage volume. The write request is performed at the primary system in response to determining that all the existing data corresponding to the write request has already been copied to the secondary storage volume. However, at least a portion of the existing data corresponding to the write request is read from the primary storage volume in response to determining that at least a portion of the existing data corresponding to the write request has not already been sent to the secondary storage volume.

Abstract: According to certain aspects, a method can include receiving, in response to an indication that a data storage database is being restored to a second time before a first time such that the data storage database comprises a plurality of first archive file identifiers associated at the second time, a first instruction from a data storage computer, where the first instruction instructs a media agent to stop scheduled secondary storage operations associated with a deduplication database, and where the deduplication database comprises a plurality of second archive file identifiers; determining at least one second archive file identifier in the plurality of second archive file identifiers that does not correlate with any first archive identifier in the plurality of first archive file identifiers; and, for each of the at least one second archive identifier, instructing the deduplication database to prune an entry associated with the respective second archive file identifier.

Abstract: A data storage system includes multiple head nodes and data storage sleds. A control plane of the data storage system designates, for a volume partition, one of the head nodes to function as a primary head node storing a primary replica of the volume partition and designates two or more other head nodes to function as reserve head nodes storing reserve replicas of the volume partition. Additionally, the primary head node causes volume data for the volume partition to be erasure encoded and stored on multiple mass storage devices in different ones of the data storage sleds.

Abstract: Methods, systems, and devices supporting data archiving are described. A device (e.g., an application server) may identify a set of archiving jobs for a first database (e.g., a relational database), where each archiving job indicates a set of data records for archiving. The device may receive a data record of the set of data records from the first database, where the data record is filtered by an abstraction layer (e.g., removing some information from the data record such that the filtered data record corresponds to a user's view of the data record). For example, the filtered data record may include a subset of the total information for the stored data record. The device may transform this received, filtered data record from a first format to a second format supported by a second database. The device may then send the transformed data record to the second database for storage.

Abstract: The embodiments are directed to methods and systems for determining whether a server should be placed in maintenance mode. The methods and systems can create a user group comprising one or more client devices connected to one or more permanently installed applications or one or more virtual desktops hosted on the server. The methods and systems can create a temporary directory containing duplicates of the one or more applications or one or more virtual desktops that the one or more client devices are connected to. The methods and systems can disconnect the one or more client devices from the one or more permanent applications or virtual desktops, and connect the one or more user devices to the one or more duplicate applications or virtual desktops.

Abstract: Methods, systems, and devices supporting data storage are described. A database system may implement lazy optimistic concurrency control (LOCC). LOCC may support an efficient use of database connections for a data archiving process. The data archiving process may involve a first worker thread at an application server copying data records from a primary database and writing the data records to a secondary database. A second worker thread may operate concurrent to the first worker thread to monitor the primary database for changes (e.g., using a shared database connection), as the primary database may not lock the copied data records during the archiving process. Data records that are altered in the primary database during the archiving process may be logged for error handling by an administrator. The data records that are copied from the primary database and not altered during the archiving process may be deleted from the primary database.

Abstract: The disclosed technology generally describes efficient garbage collection operations based on chunk filters (e.g., Bloom filters) maintained in association with object table partitions (e.g., trees). When an object update impacts a chunk, a corresponding chunk filter is updated, using the chunk's identifier as a chunk filter key by hashing the chunk identifier into chunk filter locations and setting bits at those locations. When garbage collection occurs, a garbage collection candidate chunk's identifier is similarly hashed to read the bit values at those locations in the chunk filters for the partitions. If any bit is zero, the chunk is definitely not in use in a partition; if no chunk filter for any partition indicates the candidate chunk is possibly in use, the chunk is garbage collected without tree scanning. If tree scanning is needed, only the partition(s) with an associated chunk filter that indicates “possibly in use” need to be scanned.

Abstract: A technology is described for operating a multi-tiered data processing service. An example method may include receiving a data rule set used to process data generated by a network addressable device included in a multi-tiered data processing service having computing nodes that are connected using one or more networks, where the computing nodes may have computing capacities to execute a portion of the data rule set using a rules engine. A computing node included in the multi-tiered processing service may be selected to host a portion of the data rule set on the computing node and a portion of the data rule set may be deployed to the computing node, where the data rule set may be registered with the rules engine that executes on the computing node and data generated by the network addressable device may be processed using the rules engine and the data rule set.

Abstract: A system described herein may provide a technique for the remote backup of a User Equipment (“UE”). An initiating device may be registered as being associated with the UE, and may initiate remote backups of the UE, without requiring user interaction at the UE. Different network backup policies may be specified in the request, such as a “Wi-Fi only” network backup request. If the UE is in a “lost” mode, a “damaged” mode, and/or is otherwise unusable or inaccessible, the specified network backup policy may be overridden, to ensure that the UE is backed up and the relevant device data may be recovered.

Abstract: A method for managing data includes selecting a first workload, wherein the first workload is implemented on at least a resource device, obtaining a snapshot of performance metrics for the resource device, storing the snapshot of performance metrics in a performance database, making a first determination that a minimum number of previous snapshots have been obtained after a previous performance analysis, and in response to the first determination: performing a performance analysis on a set of previous snapshots of the first workload to obtain a performance report, making a second determination, based on the performance report, that the resource device does not meet standard performance, and in response to the second determination, performing a resource device remediation on the resource device.

Abstract: An interface between an existing local file system and a data store generates and exports to the data store a versioned file system. The state of the local file system at a given point in time can be determined using the versioned file system. In operation, the interface creates and exports to the data store structured data representations, which correspond to versions of the local file system, as well as actual file system data that these structured data representations represent. A cache associated with the interface stores recently used data and metadata, as well as all write data and metadata waiting to be transferred to the data store. Prior to transfer, one or more data transformations may be applied to the data and metadata. In one embodiment, the data store comprises one or more cloud storage service providers. A content control system is used to configure and manage the interface.

Abstract: A method of configuring an HVAC system uses a Specifier Library that includes specifier options for a plurality of HVAC components. An engineering tool accepts a user selection of an HVAC component that will be part of the HVAC system and displays one or more options for the selected HVAC component. The engineering tool accepts selections of one or more options by the user and creates one or more points for the selected HVAC component based on the user selections, each of the one or more points having one or more point parameter values. The engineering tool creates a configuration package to configure a controller based at least in part on the user selections and the one or more points and downloads the configuration package to at least partially configure the controller. At least part of the HVAC system is controlled using the controller.

Abstract: A computer-implemented data processing system and method writes a first plurality of copies of a data set at a first plurality of hosts and reads a second plurality of copies of the data set at a second plurality of hosts. The first and second pluralities of copies may be overlapping and the first and second pluralities of hosts may be overlapping. A hashing function may be used to select the first and second pluralities of hosts. Version histories for each of the first copies of the data set may also be written at the first plurality of hosts and read at the second plurality of hosts. The version histories for the second copies of the data set may be compared and causal between the second copies of the data set may be evaluated based on the version histories for the second copies of the data set.

Abstract: Extending snapshot retention for a storage system includes creating a plurality of entries, each of the entries corresponding to snapshot data on the storage system and containing data that was written in connection with the snapshot and containing a map indicating which portions of the storage system were modified and includes transferring the entries to an external storage that is separate from the storage system. The map may be an SDDF map that indicates tracks of data that were modified. The external storage may be a cloud storage. Each of the entries may be created prior to deleting data for a corresponding snapshot on the storage system. The entries may be transferred directly from the storage system to the external storage. Extending snapshot retention for a storage system may also include periodically writing a full version of data from the storage device to the external storage.

Abstract: Data loss thresholds are enforced when performing updates to mirrored data sets. When an update is received for a data set that is mirrored to other copies of the data set, an evaluation of the difference between the data set and the other copies of the data set may be performed. If the evaluation determines that the difference fails to satisfy a threshold for acceptable data loss at the other copies upon a failure of the data set, a data loss mitigation action may be applied to performance of the update until the difference satisfies the threshold.

Abstract: A computing server includes a hardware platform with hardware resources, with at least a portion of the hardware resources to be allocated as virtualized resources. A hypervisor platform is provided based on execution of code instructions by the hardware platform. A virtual machine operates as an independent guest computing device, with at least a portion of the virtualized resources being allocated by the hypervisor platform to the virtual machine. The hypervisor platform includes a snapshot function to save the state of the virtual machine, a virtual machine activity monitor to monitor activity of the virtual machine, and an activity-based snapshot policy engine to activate the snapshot function based on the monitored activity of the virtual machine exceeding an activity threshold metric.

Abstract: A method for restoring virtual machines in accordance with one or more embodiments of the invention includes obtaining, by a data protection manager, a restoration request, and in response to the restoration request: identifying a plurality of virtual machines (VMs) to restore based on the restoration request, determining a restoration process based on the plurality of virtual machines, and initiating a deployment of a production agent based on the restoration process, wherein the production agent initiates a restoration on at least a portion of the plurality of VMs.

Abstract: Example implementations disclosed herein can be used to build, maintain, and access databases built database in multi-core computing systems with large VRAM and huge NVRAM. The database with optimistic concurrency control can be built on a transactional key-value data store that includes logically equivalent data pages stored in both VRAM and VRAM. Data records in volatile data pages in the VRAM represent the most recent version of the data. Data records in the NVRAM immutable and are organized in a stratified composite snapshot. A distributed log gleaner process is used to process log entries corresponding to transactions on the volatile data pages and construct the snapshot. The log gleaner sorts the log entries by epoch, key range, and most recent use to partition the snapshot across multiple nodes.

Abstract: A request associated with restoring a previous version of a linked clone virtual machine is received. One or more changes between a base image of a parent virtual machine and the previous version of the linked clone virtual machine are determined. One or more data blocks corresponding to the base image and one or more data blocks corresponding to the determined changes are provided to a remote system.

Abstract: An information processing device includes a master virtual machine and at least one slave virtual machine. The master virtual machine includes a file collector to collect a file in the at least one slave virtual machine, an archive creator to create an archive file of the collected file and store the archive file into the master virtual machine, and a master backup unit to create an image file of the master virtual machine including the archive file of the collected file and back up the image file into an external storage.

Abstract: A method and system of checkpointing in a computing system having a primary node and a secondary node is disclosed. In one embodiment the method includes the steps of determining by the primary node to initiate a checkpoint process; sending a notification to the secondary node, by the primary node, of an impending checkpoint process; blocking, by the primary node, I/O requests from the Operating System (OS) that arrive at the primary node after the determination to initiate the checkpoint process; completing, by the primary node, active I/O requests for data received from the OS prior to the determination to initiate the checkpoint process, by accessing the primary node data storage; and upon receiving, by the primary node, a notice of checkpoint readiness from the secondary node, initiating a checkpoint process to move state and data from the primary node to the secondary node.

Abstract: A method is provided, comprising: receiving, at a first storage array, a first request to perform an atomic write operation at a specified address in a volume; placing a read-write lock on a first instance of the volume, and executing the atomic write operation on the first instance of the volume; transmitting, to a second storage array, a second request to perform the atomic write operation on a second instance of the volume; and detecting whether an error condition is present that is associated with the second request; when the error condition is present, comparing a first data item that is stored at the specified address in the first instance of the volume with a second data item that is stored at the specified address in the second instance of the volume, and, when the first data item matches the second data item, transmitting an acknowledgment.

Abstract: A backup manager for providing backup services includes storage and a backup orchestrator. The storage stores manager associations. The backup orchestrator obtains a request to provide the backup services for a deployment; in response to the request: identifies types of managers of the deployment; makes a determination, based on the types of the managers of the deployment, that the managers of the deployment require a hybrid backup using the manager associations; and schedules a hybrid backup for the deployment based on the determination.

Abstract: Methods for automatically performing a background operation in a memory device might include automatically performing the background operation responsive to automatic performance of the background operation being enabled and receiving a start command.

Abstract: A plurality of generators that each correspond to a respective one of a plurality of cursors associated with the plurality of memory devices are identified. A sequence of logical unit numbers (LUNs) of a plurality of sequences of LUNs are generated for each of the cursors based on a respective generator corresponding to the plurality of cursors. Each of the cursors are directed to perform a memory operation on a set of LUNs in an order provided by the sequence of LUNs that is associated with each of the plurality of cursors.

Abstract: Embodiments of the present disclosure relate to autonomous data protection. One or more input/output (I/O) streams can be received by one or more storage devices. One or more snapshots of each storage device can be obtained. One or more anomalies can be identified based on a change rate corresponding to each storage device's memory allocated to store user data included in the I/O streams.

Abstract: Offloading techniques to assist a hypervisor with VM data migration between storage devices are disclosed. In an embodiment, a method to offload live data migration from hypervisors includes migrating snapshots from a source device to a destination device, where the snapshots are associated with a virtual machine (VM) being migrated from a source device to a destination device. The method includes requesting a hypervisor to take a hypervisor snapshot. The method includes taking a storage array-based snapshot after requesting the hypervisor to take the hypervisor snapshot, and requesting the hypervisor to migrate live data from the source device to the destination device including by using the hypervisor snapshot to offload hypervisor live data migration. Hypervisor offload can be performed for various hypervisors and protocols including vSphere Storage APIs Array Integration (VAAI) and Remote offloaded data transfer (ODX).

Abstract: A method for efficiently supporting deletion in a probabilistic data structure, and related computing or storage system are described. A processor, computing system or storage system constructs a table and a summary table for determining whether there is an entry for a value in the table. The summary table has buckets pointed to by address fields of values. Each bucket has a prefix table, a transit table, signature table and a first indicator. The system tracks deletion and addition of items of the table and summary table through the first indicators.

Abstract: According to one embodiment, a write instructing unit instructs a data access unit to write, in a storage area of a data storage unit indicated by a first physical address, write object data, instructs a management information access unit to update address conversion information, and instructs a first access unit to update the first physical address. A compaction unit extracts a physical address of compaction object data, instructs the data access unit to read the compaction object data stored in a storage area of the data storage unit indicated by the physical address, instructs the data access unit to write the compaction object data in a storage area of the data storage unit indicated by a second physical address, instructs the management information access unit to update the address conversion information, and instructs a second access unit to update the second physical address.

Abstract: A method, a system, and a computer program product for executing synthetic backup processes and deduplication backup storage with landing zone. A synthetic backup of a data file is received. A partial re-synthesis of the synthetic backup of the data file is performed. A total size of the partial re-synthesized backup of the data file and the received synthetic backup is determined. A size of a complete re-synthesis of the synthetic backup of the data file is computed. The complete re-synthesis of the synthetic backup of the data file is performed when the determined total size exceeds the computed size of the complete re-synthesis of the synthetic backup of the data file.

Abstract: A storage system includes a storage controller, plural volumes each configured by the storage controller, and a pool allocating physical storage areas to logical storage areas of the volumes. The storage controller configures a first group including, among the volumes, a first primary volume to which a first target protection period is set, and a first history information volume storing history information about updating to the first primary volume, and a second group including, thereamong, a second primary volume to which a second target protection period is set, and a second history information volume storing history information about updating to the second primary volume. The volumes included in the first and second groups utilize the same physical storage area of the pool. When increasing a free capacity thereof, history information to be purged is determined from the first and second protectable periods such that their protectable periods become the same.

Abstract: A data storage system includes a generic snapshot interface, allowing for integration with a wide variety of snapshot-capable storage devices. The generic interface can be a programming interface (e.g., an application programming interface [API]). Using the snapshot interface, storage device vendors can integrate their particular snapshot technology with the data storage system. For instance, the data storage system can access a shared library of functions (e.g., a dynamically linked library [DLL]) provided by the vendor (or another by appropriate entity) and that complies with the specifications of the common programming interface. And by invoking the appropriate functions in the library, the data storage system implements the snapshot operation on the storage device.

Abstract: A method for managing backup data units stored in a data server is provided. The backup data may include a first backup data unit established by copying a source data unit into the data server in response to a data backup command received at a first time point. The method includes: acquiring a specified storage space in response to a data backup command received at a second time point; copying the first backup data unit to the specified storage space in a lightweight copy manner; writing differential data contents between the source data unit presented at the second time point and the source data unit presented at the first time point into the lightweight-copied first backup data unit in the specified storage space; and defining the resulting data stored in the specified storage space as a second backup data unit, wherein the second time point is later than the first time point.

Abstract: Redo logs are used to facilitate efficient cloning of virtual machines. When a virtual machine with a virtual hard disk is to be cloned, two redo logs are created, both of which are linked to the virtual hard disk. The virtual machine being cloned is then linked to one redo log, and a newly created virtual machine is linked to the other. Each time an additional virtual machine is created, two new redo logs are created and linked to the end of the disk chain. The parent and newly created virtual machine are each linked to one of the new redo logs.

Abstract: Embodiments for dynamically allocating journal space for Do streams across multiple applications. A shared Do stream process has a dynamic block allocation component that provides a certain amount of buffering of a data flush for an application, using space that would normally be allocated for, but unused by, other applications, thus preventing the need for one or more of the applications to move to fast-forward mode when possible. Certain machine learning techniques are used in order to predict the required Do stream for each application according to past experience with the application, and this prediction is used to intelligently allocate Do Streams between the different applications.

Abstract: According to certain aspects, a secondary computing system can be configured to perform a full backup on database data, generate incremental backups comprising log files associated with modifications to the database data, and create a differential full backup copy of the database data using the full backup copy and changed blocks identified using the log files from the incremental backups.