Abstract: A computer-implemented method to validate a block at a node within a network of nodes implementing a blockchain conforming to a blockchain protocol. This may be the Bitcoin protocol or an alternative. The method includes determining, serially, that each unspent transaction output referenced as an input in each of the plurality of transactions is unique and, based on that determination allocating each transaction in the plurality of transactions to one of two or more parallel processors, and verifying, in parallel, by the two or more parallel processors, that the transactions in the plurality of transactions comply with transaction-level validation criteria. The node also determines that the block meets block-level validation criteria. If the transactions comply with transaction-level validation criteria and the block complies with block-level validation criteria, the block is deemed valid and the node forwards the block to one or more peer nodes in the network.

Abstract: In an example embodiment, a first function is performed on the first document received at first middleware management architecture, causing a change in the status of the first document. The change is logged in a record corresponding to the first document in a memory. Then the first document is sent to a second network via a transmission protocol layer. A notification of a change in the status of the first document within the second layer is received in a layer other than the transmission protocol layer, from the second network. The change in the second network is logged in the record corresponding to the first document in the memory. Information corresponding to the change in the status of the first document at the middleware management architecture and the change in the status of the first document in the second network is reported to the first network.

Abstract: A system described herein may provide a technique for the remote backup of a User Equipment (“UE”). An initiating device may be registered as being associated with the UE, and may initiate remote backups of the UE, without requiring user interaction at the UE. Different network backup policies may be specified in the request, such as a “Wi-Fi only” network backup request. If the UE is in a “lost” mode, a “damaged” mode, and/or is otherwise unusable or inaccessible, the specified network backup policy may be overridden, to ensure that the UE is backed up and the relevant device data may be recovered.

Abstract: Methods and apparatus for identifying consistent snapshot points for file systems in a distributed storage service in which a client may access a file system in backend storage via two or more access nodes. A snapshot coordinator initiates a two-phase commit to perform a snapshot epoch transition. The coordinator sends prepare messages to the nodes. In response, a node sends a response to the coordinator, stops issuing writes to the file system, sets a timer, and waits for a commit message. Upon receiving a response from all nodes, the coordinator sends a commit message. Upon receiving the commit or the timer expiring, the nodes increment an epoch counter and begin issuing writes to the file system tagged with the new epoch and indicating that a copy-on-write operation be performed. The transition is successful if all nodes respond to the request message; otherwise, the two-phase commit is retried.

Abstract: A method, computer program product, and computing system for identifying a replication link failure between a first volume of a first storage array and a second volume of a second storage array, wherein a first storage protocol identifier is associated with each of the first volume and the second volume. One of the first volume and the second volume may be defined as inaccessible and the other of the first volume and the second volume as accessible, thus defining an inaccessible volume and an accessible volume. The first storage protocol identifier associated with the inaccessible volume may be replaced with a second storage protocol identifier. Access to the inaccessible volume may be provided via the second storage protocol identifier.

Abstract: Provided is a redundancy determination system extending a system on an on-premise data center to a public cloud by using a computer including a processor and a memory, in which the processor performs first processing of deploying the system in a plurality of of sites included in the public cloud when a recovery time objective of the system is less than a build-out time of the system that is calculated on the basis of an operational status of the system, and second processing of deploying the system in one site of the sites included in the public cloud when the recovery time objective of the system is not less than the build-out time.

Abstract: Processing I/O operations may include: receiving, at a data storage system, an I/O operation from a host, wherein the I/O operation is directed to a logical address and includes an I/O tag used in connection with performing data reduction processing for first data stored at the logical address; and performing processing to back up a data set including the first data stored at the logical address. The processing may include: sending, from the data storage system to a backup application, the data set and hints regarding the first data set, wherein the hints include a first hint determined in accordance with the I/O tag from the host; performing, in accordance with the hints, data reduction processing of the data set to generate a second data set; and storing the second data set on one or more backup storage devices.

Abstract: Presently disclosed are systems and methods for generating customized filtered-and-partitioned market-data feeds. In an embodiment, an output-feed profile is maintained in data storage at a market-data-processing device (MDPD). The output-feed profile specifies a subset of ticker symbols and a ticker-symbol-based feed-partitioning scheme. An input feed of order-book updates to ticker symbols is received at the MDPD from an upstream device. At the MDPD, a customized market-data output feed is generated according to the maintained output-feed profile at least in part by filtering the input feed down to the order-book updates to ticker symbols in the specified subset and partitioning the filtered feed according to the specified ticker-symbol-based feed-partitioning scheme. The customized market-data output feed is transmitted from the MDPD to a downstream device.

Abstract: In an approach to improve asynchronous replication in database clusters embodiments retain committed transactions during database cluster replication. Embodiments build and run asynchronous replication logic using database nodes running as one or more standalone nodes, wherein the asynchronous replication logic is responsible for data replication from a primary database node to one or more secondary database nodes. Embodiments register a replication reader to a sender node to replicate journal logs and replay the journal logs on the one or more secondary database nodes. Further, embodiments monitor replication lag metrics from the sender node and notify a replication source and a replication target of a generated replication plan, wherein the cluster controller instructs the replication source and the replication target to be ready to initiate the replication plan. Additionally, embodiments adjust a replication plan to allow the asynchronous replication logic to catch up and complete uncommitted transactions.

Abstract: Described herein are embodiments of a database system. The database system receives a read command to read at least some stored data. The database system may generate a plurality of snapshots of data stored in a first data storage node of a plurality of data storage nodes. The database system may determine whether data is being written to the first data storage node. Responsive to determining that data is not being written to the first data storage node, the database system may process the read command at least in part by reading at least some data stored on the first data storage node. Responsive to determining that data is being written to the first data storage node, the database system may process the read command at least in part by reading at least some data from a snapshot of the plurality of snapshots.

Abstract: Techniques for managing a storage unit involve: determining space usage indicators of a storage system including disks, each disk is divided into disk slices, and at least part of the disk slices are organized into a storage unit. The techniques further involve: determining a target priority of a data migration task based on the space usage indicators, wherein the data migration task is used to migrate data in a group of disk slices allocated to at least one storage unit to another group of disk slices. The techniques further involve: if the target priority is different from a current priority of the data migration task, adjusting the current priority of the data migration task to the target priority, and determining system resources for the data migration task based on the target priority. Accordingly, a priority of a data migration task can be dynamically adjusted to accommodate different scenarios.

Abstract: The present disclosure relates to improved systems, methods, apparatuses, and techniques providing data backup, restoration, and verification functions. In certain embodiments, a backup storage platform provides backup services for files stored on the client servers. The backup storage platform can execute verification functions that verify the integrities of the backup copies by determining whether the backup copies have become corrupted, determining whether the backup copies are restorable, and determining whether the backup copies include the most current or contemporaneous information.

Abstract: A storage control device includes a memory and a processor. The processor configured to, when a request for writing first data to a first unit region among unit regions included in a first storage region is received, write the first data to the first unit region in a second storage region corresponding to a snapshot, the snapshot being corresponding to the first storage region. The processor is further configured to send a first completion response to the request for writing. The processor is further configured to, when a first read request requesting for reading from the first unit region in the second storage region is received, send second data stored in the first unit region in the first storage region, as read data in accordance with the first read request.

Abstract: A method, computer program product, and computing system for locally processing a plurality of data files stored on a local data storage system to effectuate the storage of one or more archivable files at one or more defined remote addresses on a remote data storage system. One or more identifiers, that locate the one or more archivable files at the one or more defined remote addresses on the remote data storage system, are stored on the local data storage system. A local database, that defines the one or more identifiers, is maintained on the local data storage system.

Abstract: Techniques for query engine virtualization are described. A query engine virtualization layer between clients and multiple query engines acts as a proxy to execute queries on behalf of the clients using ones of the multiple query engines selected for each query that are comparatively the best-suited to execute the query. The selection may be based on the workload pattern the query is issuing on the underlying data.

Abstract: Disclosed are various embodiments for performing a backup a device and/or performing a wipe or removal of data from a device enrolled with a device management service. In various embodiments, a wipe request is generated by a management service and transmitted to a client device. The wipe request includes commands to backup enterprise data for a particular application, verify that the management service has received the enterprise data, and remove the enterprise data from the client device. The management service determines that the enterprise data is received from the client device and transmits a confirmation that the management service has received the enterprise data. The confirmation causes the client device to remove the enterprise data from the client device.

Abstract: A method, computer program product, and computer system for receiving, by a computing device, a selection of a set of records to edit in a multi-record update operation. A selection is received of at least one record of the set of records on which to capture one or more changes. At least one aspect of the at least one record of the set of records is captured. The at least one aspect is played back on one or more remaining records of the set of records.

Abstract: A mechanism is described for facilitating dynamic data management for computing devices according to one embodiment. A method of embodiments, as described herein, includes tracking one or more factors relating to a plurality of data sets, evaluating the plurality of data sets based on the one or more factors. The evaluating may include speculating at least one of relevancy and accessibility of each of the plurality of data sets. The method may further include generating data scores, the data scores being associated with the plurality of data sets based on the evaluation of the plurality of data sets, performing a first comparison of the data scores of the plurality of data sets with a criteria score, and classifying each data set based on the first comparison. The classifying may include setting caching order for each data set of the plurality of data sets.

Abstract: One embodiment provides a method for storage management in an aggregated file system. The method includes tracking inode numbers for sub-file systems of the aggregated file system. A request for a unique range of inode numbers in the aggregated file system is received. The unique range of inode numbers is provided to one or more sub-file systems of the aggregated file system while providing that each sub-file system of the aggregated file system has a required range of inode numbers and that no two sub-file systems have overlapping inode numbers.

Abstract: Various example embodiments are directed to systems and methods for migrating a database from a source database having a source schema to a target database having a target schema. For example the migrating may comprise a pre-migration phase and a migration phase. The pre-migration phase may comprise either executing a pre-migration command to modify at least a portion of the source database or generating a pre-migration object at the source database. The migration phase may comprise selecting at least one column from the source database that was modified during the pre-migration phase and writing the at least one column to the target database.

Abstract: An enterprise system which facilitates synchronization of offline data. Offline data created during an offline session or sessions (collectively an offline session) prior to synchronization is assigned a temporary key. Changes of offline data created during an offline session is assigned the temporary key of the data to which the change is associated. The temporary key is mapped to a new created backend key and stored in a mapping table. Using the mapping table, temporary keys associated with the changes are swapped with backend keys which the temporary keys are mapped. This maintains data persistency of newly created and change data during an offline session.

Abstract: An append-only data storage system is described that stores sets of data blocks in extents that are located in storage devices. During operation of the system, upon receiving a request to copy an extent from a source storage device to a destination storage device, the system creates a scratch extent on the destination storage device, and associates the scratch extent with a private identifier, whereby the scratch extent can only be accessed through the private identifier. The system uses the private identifier to perform a copying operation that copies the extent from the source storage device to the scratch extent on the destination storage device. After the copying operation is complete and the scratch extent is closed, the system associates the scratch extent with a public identifier, whereby the copy of the extent on the destination storage device becomes publically accessible to other entities in the data storage system.

Abstract: A stateful cluster may implement scaling of the stateful cluster while maintaining access to the state of the stateful cluster. A scaling event for a stateful cluster may be detected, and in response the stateful cluster may be adjusted to include a different number of nodes. The state of the cluster may then be logically distributed among the different number of nodes according to a monotone distribution scheme. The adjusted node may then service access requests according to the monotone distribution scheme. Prior to making the adjusted storage cluster available for servicing access requests, the nodes from the original cluster may still service access requests for state.

Abstract: A method, computer program product, computing system, and system for increasing speed of a file restore from an archive storage device are described. The method may include receiving, at a computing device, a list of files to be restored from the archive storage device and file location data associated with one or more files from the list of files to be restored. The method may further include determining, at the computing device, a file restoration sequence for the one or more files from the list of files to be restored based upon, at least in part, the file location data. The method may also include restoring, from the archive storage device, the one or more files from the list of files to be restored based upon, at least in part, the file restoration sequence.

Abstract: Embodiments of the present disclosure provide for a method and system for storing content based on one or more attributes associated with the content. Specifically, the present disclosure provides for determining storage capabilities of one or more storage devices associated with a computing device and also determining a retention policy associated with the content. In certain embodiments, the retention policy is identified by the one or more attributes. When the retention policy and the capabilities of the one or more storage devices have been determined, the content is written to the one or more storage devices based on the retention policy.

Abstract: An illustrative “open archive” architecture relieves the immediate need to add network-attached storage (NAS) devices to a storage management system. The open archive architecture provides streamlined access to live production data, which originally was stored on a NAS device but which is archived to secondary storage to free up NAS space. An open-archive server coordinates with an open-archive layer that operates on the NAS device. The open-archive server identifies data sets on the NAS that meet archiving criteria, which are then automatically moved to an open archive in secondary storage. The open archive layer intercepts data-access calls coming into the NAS device, e.g., open calls, read calls, write calls. The intercepted calls are reported to the open-archive server for analysis.

Abstract: A mechanism is provided for updating data of a file on a tape in a file system using a tape drive. Data of a file which received a write request is read out from a tape drive and stored in a memory. At least a part of the data of the file is edited and the edited data part of the file is stored in the memory. Combination data with a non-edited data part and the edited data part of the file is written on the tape in the tape drive as a continuous data of the file to have an extent. The extent of the written continuous data of the file is then written on the tape.

Abstract: Aspects of the subject matter described herein relate to backups and change journals. In aspects, a change journal is read to determine changes that have occurred to objects of a file system. From these changes a data structure is created to capture path information and collect changes for each object. Where the data structure is insufficient to identify a complete path, the live file system is consulted. After the data structure is complete, a data protection engine uses the data structure to update a catalog at least to provide the capability to view the namespace of the protected objects at one or more times covered by the catalog.

Abstract: Provided are a computer program product, system, and method for allocating additional requested storage space for a data set in a first managed space in a second managed space. A request for additional storage space is received for a requested data set stored in a first managed space in the storage. A revised amount of storage space for the requested data set comprises at least an amount of space currently allocated to the requested data set in the first managed space and the requested additional storage space. If the revised amount of storage space exceeds a value, then allocation is made of the revised amount of storage space in allocated storage space in a second managed space of the storage. The data set is stored in the allocated storage space in the second managed space.

Abstract: Provided are a computer program product, system, and method for allocating additional requested storage space for a data set in a first managed space in a second managed space. A request for additional storage space is received for a requested data set stored in a first managed space in the storage. A revised amount of storage space for the requested data set comprises at least an amount of space currently allocated to the requested data set in the first managed space and the requested additional storage space. If the revised amount of storage space exceeds a value, then allocation is made of the revised amount of storage space in allocated storage space in a second managed space of the storage. The data set is stored in the allocated storage space in the second managed space.

Abstract: Aspects of this disclosure relate to protecting email data. For example, email protection rules can instruct an email server to route an email to an email protection module. The one or more email rules can identify a group of one or more email addresses. The email protection module can receive an email from the email server that has an email address of the group as an intended receipt. The email protection module can route the email to secondary storage and store the email in secondary storage to create a secondary copy of the email. The secondary copy can be stored inline to persistent memory of secondary storage, according to certain embodiments. Access to the backup copy of the email stored to the persistent memory can be controlled, for example, based on whether a user had permission to access to the email when the email was sent.

Abstract: Described herein is a system and method for managing environment metadata of a server system during a backup session between the server system and a storage system. In some embodiments, during the backup session, the server system sends a sequence of blocks or files comprising backup data and environment metadata to the storage system. The backup data may comprise data on the server that is typically sent to the storage system during a backup session, such as client or application data. The environment metadata may include information describing the server system, such as information describing hardware or software components of the server system or server metrics of the server system. In these embodiments, operations for processing environment metadata may be included with the operations for processing backup data during the backup session.

Abstract: Systems and methods which provide for obtaining snapshots of one or more nodes, while having minimal impact on performance and throughput of the storage network are provided. Embodiments may involve a method of obtaining snapshots of individual node data within a clustered storage network having a plurality of nodes without requiring quiescing of every node. The snapshots may be obtained in a rolling fashion, e.g., moving across the individual nodes of a cluster either sequentially or non-sequentially. In other embodiments snapshots may be obtained in an asynchronous manner. The obtained snapshots then collectively define an eventually consistent view of the entire system. Such a view may be utilized to provide for mirroring functionality, e.g. to provide for DR and/or HA capabilities.

Abstract: An end-to-end secure cloud-hosted collaboration service is provided with a hybrid cloud/on-premise index and search capability. This approach includes on-premise indexing and search handling, while relying on the cloud for persistent storage and search of the index. The on-premise indexer receives a copy of an encrypted message from the cloud-hosted collaboration service. The encrypted message has been encrypted with a conversation key. The indexer receives the conversation key from an on-premise key management service, and decrypts the encrypted message with the conversation key. A set of tokens are extracted from the decrypted message, and subsequently encrypted with a secret key, different than the conversation key, to generate a first set of encrypted tokens. The first set of encrypted tokens is transmitted for storage in a search index on the cloud-hosted collaboration service.

Abstract: In one embodiment, the storage system determines if a first format of a first segment tree of the first file system is different from a second format of a second segment tree of the second file system representing a file stored in the first and second file systems, respectively. The storage system identifies, in response to determining that the first and second formats are different, a second level within the first and second segment trees that have different formats. In one embodiment, the storage system further identifies one or more segments of the second level of the first segment tree that have been modified based on a comparison of fingerprints of a third level of the segment trees. For each modified second level segment, the storage system resegments the segment from the first to the second format, and replicates the resegmented segments to the target storage system.

Abstract: Managing different versions of a data record is provided. A mapping is maintained between a version-independent logical record identifier and a version-dependent physical record row identifier that correspond to each data record within a plurality of data records of a data table using a logical record identifier to physical record row identifier indirection mapping table. Entries within leaf pages of an index associated with the data table are updated to point to the version-independent logical record identifier corresponding to a data record instead of pointing to the version-dependent physical record row identifier corresponding to the data record. The logical record identifier to physical record row identifier indirection mapping table is updated in response to performing an operation on the data record instead of updating the entries within the leaf pages of the index associated with the data table.

Abstract: Machines, systems and methods of uploading data files, the method comprising a first client machine dividing a first file into N data chunks to be uploaded to a server, wherein the N data chunks are of size kX, where k is an integer and X is size of a minimal size data chunk, wherein X is known by the server and by at least a second client machine used for uploading a second file to the server in data chunks of size k?X; and uploading the first file to the server, wherein a first unique signature is calculated for the first file based on applying a signature function to a collection of signatures calculated for the minimal size data chunks of size X that make up the data chunks of size kX in the first file, wherein the uploading of the first file is accomplished by uploading the data chunks of size kX to the server in any order.

Abstract: A method and apparatus for backing up a computer system. A backup is provided of a data stored on a first computer by the first computer generating a dump stream. The dump stream is transmitted to a second computer, the second computer uses the dump stream to maintain a file system copy of the data. One or more snapshots of the file system of the second computer are stored on a backup computer, the snapshots providing a backup of the data stored on the first computer.

Abstract: A server configured to form part of a data protection group, wherein the server comprises a memory, a transceiver configured to receive a request to store a data file from another device, and a processor coupled to the memory and the transceiver and configured to acquire the request to store a data file, write the data file to a container in the memory, and encode the container contents when the container becomes full to generate a plurality of encoded blocks, wherein the transceiver is further configured to distribute the plurality of encoded blocks over peer servers in the data protection group.

Abstract: A hash-optimized backup system and method takes data blocks and generates a probabilistically unique digital fingerprint of the content of each data block using a substantially collision-free algorithm. The process compares the generated fingerprint to a database of stored fingerprints and, if the generated fingerprint matches a stored fingerprint, the data block is determined to already have been backed up, and therefore does not need to be backed up again. Only if the generated fingerprint does not match a stored fingerprint is the data block backed up, at which point the generated fingerprint is added to the database of stored fingerprints. Because the algorithm is substantially collision-free, there is no need to compare actual data content if there is a hash-value match. The process can also be used to audit software license compliance, inventory software, and detect computer-file tampering such as viruses and malware.

Abstract: A system and method are provided for verifying data copies and reverifying the copies over the life span of media according to a verification policy. Characteristics of media and use of media are tracked to provide metrics which may be used to dynamically reevaluate and reassign verification policies to optimize media usage. Copies that fail verification operations may be repaired by repeating a storage operation for recent copies or by substituting a close temporal copy of the failed copy.

Abstract: A computerized method for sharing removable storage media in a network, the method comprising associating, in an index entry, a first piece of removable storage media in a first storage device with at least a first storage policy copy and a second storage policy copy; copying, to the first piece of removable storage media, data associated with the first storage policy copy; and copying, to the first piece of removable storage media, data associated with the second storage policy copy.

Abstract: Systems and methods for copy on write storage conservation are presented. In one embodiment a copy on write storage conservation method includes creating and mounting a snapshot; mounting a snapshot; monitoring interest in the snapshot; initiating a copy on write discard process before a backup or replication is complete; and deleting the snapshot when the backup or replication is complete. In one embodiment the method also includes marking a file as do not copy on write. In one embodiment, the copy on write discard process includes discarding copy on write data when a corresponding read on the file in the snapshot is successful. Initiating a copy on write discard process can be done at a variety of levels (e.g., a file level, an extent level, a block-level, etc.).

Abstract: A system for backing up and restoring information, includes at least one computer system including information to be backed up and restored, a storage device for receiving at least part of the information to be backed up and for storing and backing up the information. A controller includes a scheduling system for allowing a user to input into a job queue, a master job indicating one or more portions of the information of the at least one computer system to be backed up or restored, and a job control system that splits the master job into a plurality of smaller jobs and inputs the plurality of smaller jobs into the job queue.

Abstract: A modular data and storage management system. The system includes a time variance interface that provides for storage into a storage media of data that is received over time. The time variance interface of the modular data and storage management system provides for retrieval, from the storage media, of an indication of the data corresponding to a user specified date. The retrieved indication of the data provides a user with an option to access specific information relative to the data, such as content of files that are included in the data.

Abstract: A first storage system stores information relating to the updating of data stored in that system as a journal. More specifically, the journal is composed of a copy of data that was used for updating and update information such as a write command used during updating. Furthermore, the second storage system acquires the journal via a communication line between the first storage system and the second storage system. The second storage system holds a duplicate of the data held by the first storage system and updates the data corresponding to the data of the first storage system in the data update order of the first storage system by using the journal.

Abstract: A modular computer storage system and method is provided for managing and directing data archiving functions, which is scalable and comprehends various storage media as well as diverse operating systems on a plurality of client devices. A client component is associated with one or more client devices for generating archival request. A file processor directs one or more storage devices, through one or more media components, which control the actual physical level backup on various storage devices. Each media component creates a library indexing system for locating stored data. A management component coordinates the archival functions between the various client components and the file processor, including setting scheduling policies, aging policies, index pruning policies, drive cleaning policies, configuration information, and keeping track of running and waiting jobs.

Abstract: A method, article of manufacture, and apparatus for backing up or archiving objects from a first location to a second location, comprising determining the objects to be backed up and a prioritization of the objects according to a first criterion. The objects are transmitted from the first location to the second location substantially in accordance with the prioritization. The transmission may be suspended in accordance with loss of network connectivity, a user action, or throttling to reduce processor or network load. Transmission may be continued, and the objects reprioritized according to the first criterion, wherein relevant changes in the objects are reflected. A backup target may be chosen based on the location of the source, and if the location changes, a new backup target may be chosen in consideration of bandwidth. The backups to the backup targets may be combined to define a backup.

Abstract: A system and method of managing stored data in a storage management system. The storage management system includes a storage manager, a media agent connected to the storage manager, and a primary volume connected to the media agent. Multiple snapshots are taken of the primary volume. The snapshots are indexed by associating respective information with the snapshot. The indexed snapshots are copied to a recovery volume. In this way, browsing features are enabled for the user. The user may view the snapshots in a hierarchical format, and may even view snapshot data in association with the corresponding application. The resultant recovery volume may be used to replace a primary volume.

Abstract: The present invention relates to a method for performing an image level copy of an information store. The present invention comprises performing a snapshot of an information store that indexes the contents of the information store, retrieving data associated with the contents of the information store from a file allocation table, copying the contents of the information store to a storage device based on the snapshot, and associating the retrieved data with the copied contents to provide file system information for the copied contents.