Abstract: Backup data associated with a primary storage system is received. At least a view of the received backup data associated with the primary storage system is generated. The view of the of the received backup data associated with the primary storage system includes a tree data structure comprising a root node, a first plurality of child nodes, and a first plurality of leaf nodes. At least some of the first plurality of leaf nodes include corresponding pointers to a corresponding binary large object. A read request for data exposed by the view of the received backup data associated with the primary storage system is received from an external system. In response to receiving the read request, the view of the received backup data associated with the primary storage system is exposed to a requesting system utilizing a protocol associated with the external system.

Abstract: A tiered data storage management system in which environmental, social, and governance (ESG) factors are used to evaluate and manage storage of physical and corresponding digital assets, particularly (but not limited to) storage of digital assets generated from corresponding physical assets, and particularly (but not limited to) situations in which the cost to store a digital representation of an asset exceeds the cost to store the original physical asset for a given amount of time.

Abstract: Techniques for live migration of cloud resource infrastructure metadata are provided. A method may include receiving a resharding request associated with a database configured to store resource metadata according to a first database configuration. The resource metadata may be identified by a first mapping. The method may include preparing the resource metadata for migration to a second database configuration corresponding with a second mapping. The method may include migrating a subset of the resource metadata within the database in accordance with the second mapping. The method may include while migrating the subset of the resource metadata, serving requests on the resource metadata according to the first database configuration. The method may include after migrating the subset of the resource metadata, installing the second database configuration. The method may also include removing the subset of the resource metadata remaining in the database according to the first database configuration.

Abstract: A system includes one or more source memory devices of a source computing environment that store a database comprising data files, wherein each of a plurality of data tables of the source computing environment includes data from one or more of the data files, one or more target memory devices of a target computing environment and at least one processor configured to receive a command to copy data files from the source memory devices to the target memory devices, detect that the target memory devices have insufficient memory, calculate a value coefficient for each data table, assign a priority index to each data table based on the value coefficient, order the data files in a copy queue based on the priority index of the data tables, and copy the ordered data files to the target memory devices.

Abstract: Example implementations relate to metadata operations in a storage system. An example includes a machine-readable medium storing instructions that upon execution cause a processor to: receive a data stream to be stored in persistent storage of a deduplication storage system; store data units of the data stream in a container entity group object according to arrival time, where the data units of the container entity group object are referenced by a plurality of container indexes; generate a data index to list each container index that references at least one data unit included in the container entity group object; and in response to a determination that the total size of the container entity group object exceeds the threshold size, transfer the container entity group object from memory to the persistent storage.

Abstract: A data ingestion system prevents data duplication during a data ingestion operation by determining whether a current instance of an ingestion pending indicator file associated with a data set is present at initialization of the data ingestion operation. Upon determining that no current instance of the ingestion pending indicator file is present, the system generates and stores a new ingestion pending indicator file and performs the data ingestion operation using current watermark data. Upon determining that the current instance of the ingestion pending indicator file is not present, the system generates corrected watermark data and performs the data ingestion operation with respect to the corrected watermark data. Upon completion of the data ingestion operation, the system deletes the current instance of the ingestion pending indicator file.

Abstract: A technique is configured to provide various data protection schemes, such as replication and erasure coding, for data blocks of volumes served by storage nodes of a cluster configured to perform deduplication of the data blocks. Additionally, the technique is configured to ensure that each deduplicated data block complies with data redundancy guarantees of the data protection schemes, while improving storage space of the storage nodes. In order to satisfy the data integrity guarantees while improving available storage space, the storage nodes perform periodic garbage collection for data blocks to optimize storage in accordance with currently applicable data protection schemes.

Abstract: A data storage device and method for dynamic prediction of random read with low memory consumption are provided. In one embodiment, a data storage device comprises a volatile memory, a non-volatile memory, and a controller. The controller is configured to allocate an amount of space in the volatile memory for a history pattern matcher data structure used to predict next read commands from a host to read data stored in the non-volatile memory; determine an accuracy of the predicted next read commands; and based on the determined accuracy, dynamically allocate a different amount of space in the volatile memory for the history pattern matcher data structure. Other embodiments are possible, and each of the embodiments can be used alone or together in combination.

Abstract: Management applications (hosts) implement management operations on a storage system by passing system calls (syscalls) to a management system. In some embodiments, all management traffic is passed from one or more instances of a management application to a management daemon executing in the context of the storage system operating system. The management daemon sorts syscalls received from the management applications and implements the syscalls using one or more array control devices. The array control devices are special target devices configured on external control hosts for sending management commands to the storage system operating system and receiving information from the storage system. In some embodiments, Non-Volatile Memory express (NVMe) devices to be used as array control devices, and enable TCP connections to be used as logical array control devices.

Abstract: A method, computer program product, and computing system for tracking the utilization of a plurality of PLBs within a storage platform to generate PLB utilization information, wherein each PLB is associated with one or more VLBs; and tracking the utilization of the one or more VLBs associated with each of the plurality of PLBs within the storage platform to generate VLB utilization information.

Abstract: A consistency verification system that verifies data consistency in a content item management system. The system processes a write request. The write request includes a set of preconditions, a key, and data to write in a write operation. Processing the write request includes determining that the set of conditions are met, committing the write request at a commit time, and assigning a timestamp indicating the commit time to the write request. The system verifies data consistency associated with the write request. The verifying data consistency includes sending a replay request corresponding to the write request. The system determines whether results of the replay are consistent with results of the write request. Responsive to determining whether results of the replay are consistent with results of the write request, the system outputs information describing data inconsistency.

Abstract: One example method includes receiving at a dedupe system, from a client, a request that comprises a set of fingerprints, where each fingerprint in the set corresponds to a particular data segment, filtering, at the dedupe system, the set of fingerprints into a set of unique fingerprints and a set of non-unique fingerprints, reading, at the dedupe system, from a container where copies of the non-unique fingerprints are stored, an additional set of non-unique fingerprints, sending, from the dedupe system to the client, a single response that comprises both the set of unique fingerprints and the additional set of non-unique fingerprints, and receiving from the client, at the dedupe system, data segments that respectively correspond to the unique fingerprints in the set of unique fingerprints, but no data segments corresponding to the non-unique fingerprints in the set of non-unique fingerprints are received by the dedupe system from the client.

Abstract: Present-day blockchain architectures suffer from several problems, including poor extensibility and scalability. This may stem from tying two parts of the consensus architecture, namely canonicality and validity, too closely together. The Polkadot architecture, which is a heterogeneous multi-chain, provides better extensibility and scalability by setting canonicality and validity apart. Compartmentalizing canonicality and validity and keeping overall functionality to a minimum of security and transport introduces practical core extensibility in situ. Scalability is addressed through a divide-and-conquer approach to canonicality and validity, scaling out of its bonded core through the incentivization of untrusted public nodes. The heterogeneity of this architecture enables many highly divergent types of consensus systems interoperating in a trustless, fully decentralized “federation,” allowing open and closed networks to have trust-free access to each other.

Abstract: One example method includes receiving, at an IO journal, a new entry that identifies a respective disk location L, and data X written at that disk location L, and determining whether a location specified in an oldest entry of the IO journal is specified in any other entries in the IO journal. When the location specified in the oldest entry is not specified in any other entries in the IO journal, adding the new entry to the IO journal, and augmenting the new entry with undo data. Or, when the location specified in the oldest entry is specified in at least one other entry in the IO journal, setting data specified in the oldest entry as undo data for the next entry that identifies that location, and adding the new entry to the IO journal, and deleting the oldest entry from the IO journal.

Abstract: A data storage device includes a memory device and a controller coupled to the memory device. The controller is configured to add one or more entries to a log file system (LFS) invalidation table and scan the LFS invalidation table during a storage optimization operation. Each entry of the one or more entries maps a new valid logical block address (LBA) to an old invalidated LBA. The new valid LBA is updated version of the old invalidated LBA. The storage optimization operation includes moving data from a first location to a second location.

Abstract: Described herein is a multi-user retail photo kiosk system that includes multiple touch screen and Graphic User Interface (GUI) controlled consumer photo editing, photo print and product selection, and photo order placement terminals and multiple photo printers. The user photo kiosk terminals can receive images. Billing and payment is accomplished using barcoded receipts provided at the user terminal for payments for purchased photo products. A printer array incorporating various printers capable of producing prints or various sizes and formats can be configured as a horizontal counter or as a vertical tower and includes means to alert the user that their photo print order is complete. In addition, the system automatically notifies operators if equipment service, maintenance, media refilling, and/or post printing finishing procedures are required.

Abstract: A system and corresponding method perform large memory transaction (LMT) stores. The system comprises a processor associated with a data-processing width and a processor accelerator. The processor accelerator performs a LMT store of a data set to a coprocessor in response to an instruction from the processor targeting the coprocessor. The data set corresponds to the instruction. The LMT store includes storing data from the data set, atomically, to the coprocessor based on a LMT line (LMTLINE). The LMTLINE is wider than the data-processing width. The processor accelerator sends, to the processor, a response to the instruction. The response is based on completion of the LMT store of the data set in its entirety. The processor accelerator enables the processor to perform useful work in parallel with the LMT store, thereby improving processing performance of the processor.

Abstract: A method for managing a full backup includes: generating a BBB of a file system, in which the BBB is a full backup of the file system and is generated using a snapshot of the file system; obtaining, using a MBB mechanism, modified file system metadata from the snapshot; obtaining second modified file system metadata from a second snapshot of the file system, in which the snapshot is generated at a first point in time and the second snapshot is generated at a second point in time; comparing the modified file system metadata and the second modified file system metadata to obtain a list of changed assets; initiating an incremental backup of the list of changed assets, in which the list of changed assets is backed up using a FBB mechanism; and generating a synthetic full backup by combining the full backup and the incremental backup.

Abstract: Example implementations relate to metadata operations in a storage system. An example includes receiving, by a storage controller of a deduplication storage system, a plurality of data streams to be stored in persistent storage of the deduplication storage system; identifying, by the storage controller, a set of journals in a first journal group that are modified during a first backup process; determining, by the storage controller, a count of the set of journals that are modified during the first backup process; comparing, by the storage controller, the determined count to a migration threshold; and migrating, by the storage controller, at least one journal of the set of journals to a second journal group based at least on a comparison of the determined count to the migration threshold.

Abstract: Conversion that includes multiple targets or sources of a data store migration may be performed. A request that specifies a mapping between multiple sources and one or more targets, one or more sources and multiple targets, or multiple sources and multiple targets may be created for data store migration. Metadata may be obtained for the selected sources and targets for the mapping. Conversion scripts may then be generated for the mapping based on an analysis using the metadata. The conversion scripts may then be stored for later execution.

Abstract: Embodiments described herein provide a compressed container format that enables the container to be decrypted and decompressed in a streaming manner. One embodiment provides a container format for encrypted archives in which data is compressed and encrypted in a segmented manner. A segment of the archive can be decompressed, decrypted, and checked for integrity before the entire archive is received. Metadata for the encrypted archive is also encrypted to secure details of data stored within the archive.

Abstract: A centralized application management computing system is described that is configured to generate digital dog tag files for local storage on each computing device of a plurality of computing devices (e.g., data center servers) within the enterprise network. The computing system is configured to periodically retrieve, from one or more sources within the enterprise network, application information for one or more applications hosted on a given computing device of the plurality of computing devices. The computing system is configured to periodically generate, based on the application information, a digital dog tag file for the given computing device that includes recovery information for the one or more applications hosted on the given computing device. The computing system is further configured to send the digital dog tag file for local storage at a predefined location on the given computing device.

Abstract: Techniques for providing direct access to backup data can include: receiving a selection of a backup of a file system, wherein the backup is stored on a backup system connected to a data storage system; creating, in accordance with said selection of the backup, a remote copy of the backup, wherein the remote copy is stored on the backup system; generating a proxy file system for the remote copy on the backup system, wherein the proxy file system is mapped by the data storage system to the remote copy on the backup system; and providing a host with direct access to the remote copy using the proxy file system.

Abstract: Heterogeneous memory management and services. A memory metadata service obtains memory configuration information that identifies one or more sharable load-store memory segments available on each of a plurality of computing devices. The memory metadata service generates a memory metadata repository that comprises memory metadata that identifies, for each computing device of the plurality of computing devices, the one or more sharable load-store memory segments available on the computing device and, for each sharable load-store memory segment, a memory size of the sharable load-store memory segment and at least one memory attribute. The memory metadata service receives, from a first requesting computing device, a first memory allocation request that requests a first quantity of load-store memory. The memory metadata service sends, to the first requesting computing device, memory allocation information that identifies a first sharable load-store memory segment based on the memory metadata repository.

Abstract: One or more techniques and/or computing devices are provided for managing an arbitrary set of storage items using a granset. For example, a storage controller may host a plurality of storage items and/or logical unit numbers (LUNs). A subset of the storage items are grouped into a consistency group. A granset is created for tracking, managing, and/or providing access to the storage items within the consistency group. For example, the granset comprises application programming interfaces (APIs) and/or properties used to provide certain levels of access to the storage items (e.g., read access, write access, no access), redirect operations to access either data of an active file system or to a snapshot, fence certain operations (e.g., rename and delete operations), and/or other properties that apply to each storage item within the consistency group. Thus, the granset provides a persistent on-disk layout used to manage an arbitrary set of storage items.

Abstract: Various embodiments provide for obtaining snapshots of a displayable form. User specified information is received from a process modeler user interface. The process that includes the displayable form is created based on the user specified information. Snapshot instructions is associated, based on the user specified information, with a point in the process that can occur anytime while displaying the form during the execution of the process. The form is displayed as part of the execution of the process. When the point is encountered during execution of the process, the snapshot of the displayed form is obtained based on execution of the snapshot instructions.

Abstract: A method and a server system for creating consistent snapshots in a distributed storage system are disclosed. The server system stores entities in databases that includes a production portion for storing current versions of entities and a backup portion for storing backup versions of modified entities, receives a request for a snapshot of a portion of the databases at a predefined snapshot time. In response to the request, the server system generates a snapshot of the databases, the snapshot including: a backup version of an entity retrieved from the backup portion and a current version of another entity retrieved from the databases and produces a response to the request based on the snapshot. When there are several backup portions, a backup portion may be used separately or in conjunction with other backup portions to provide required backup versions to generate a snapshot.

Abstract: One or more embodiments of a synchronization system facilitate selectivity synchronizing digital content items from a collection of digital content items to a local storage of a client device. In particular, one or more embodiments described herein collect and analyze recall data for users of a digital content management system with respect to digital content items to determine synchronization scores for the digital content items. One or more embodiments described herein further include selectively identifying a subset of the digital content items based on the synchronization scores to recommend for synchronization to a local storage of a client device.

Abstract: A file system is implemented in a system comprising an anonymous-write storage device. A request for a file system operation that comprises semantics of the file system to receiving the request is received. The file system translates the file system operation to one or more commands that effect the file system operation while maintaining consistency with operation of the anonymous-write storage device. The one or more commands comprise one or more of updating file system metadata, sending a request to the anonymous-write storage device, or receiving a response from the anonymous-write storage device. The anonymous-write storage device is configured to write data in an append-only format and determine locations of data write operations agnostic of input of a write location from the file system. Metadata is updated to indicate results of the file system operation.

Abstract: A system includes one or more source memory devices of a source computing environment that store a database comprising data files grouped in a plurality of file groups, wherein each of a plurality of data tables of the source computing environment includes data from one or more of the data files grouped in to one or more of the file groups, one or more target memory devices of a target computing environment and at least one processor configured to receive a command to copy data files from the source memory devices to the target memory devices, detect that the target memory devices have insufficient memory, calculate a value coefficient for each data table, assign a priority index to each data table based on the value coefficient, re-arrange the file groups based on priority indices of the data tables, and copy the re-arranged file groups to the target memory devices.

Abstract: Copying data from a source storage system to a target storage system includes resetting a write tracker on the source storage system to track writes to the source storage system by one or more host computing systems, copying data from the source storage system to the target storage system after resetting the write tracker, suspending writes to the source storage system after copying the data, and copying data portions of the source storage system to the target storage system that are indicated as being written by the write tracker after suspending writes to the source storage system. Applications that write data to the source storage system may be quiesced in connection with suspending writes to the source storage system. Data portions may be repeatedly copied from the source storage system to the target storage system until an end condition is reached.

Abstract: Methods, apparatus, systems and articles of manufacture are disclosed to facilitate distributed data backup. An example apparatus includes a controller to detect a trigger event for a distributed backup mode; and, in response to detection of the trigger event, trigger the distributed backup mode. When in the distributed backup mode, the controller of the example apparatus is to identify one or more receiving devices within communication range of the apparatus available to receive a data backup from the apparatus. The example apparatus includes a data distributor to distribute data from the apparatus among the one or more receiving devices. The controller of the example apparatus is to confirm receipt of the distributed data by the one or more receiving devices.

Abstract: A method, computer program product, and computing system for receiving a selection of a portion of data from a backup storage appliance communicatively coupled to a storage system. A copy of the selected portion of the data may be generated on the backup storage appliance, thus defining a data backup copy. One or more hosts may be provided with direct access to the data backup copy using the storage system.

Abstract: A method, a computer system, and a computer program product for tiering migration for storage system optimization is provided. Embodiments of the present invention may include determining to move data based on access counters to balance a workload between storage drives and storage tiers. Embodiments of the present invention may include establishing a connection with an interconnect application program interface. Embodiments of the present invention may include collecting and converting physical access counters. Embodiments of the present invention may include collecting heat map data. Embodiments of the present invention may include calculating a tiering migration plan for an internal map change event.

Abstract: Policies can be applied to, and enforced for, specific resources by applying a corresponding tag to those resources. An entity, such as a customer of a resource provider, can generate one or more policies to be applied to a set of resources, where those policies can relate to data retention, backup, lifecycle events, and other such aspects. Each policy can be associated with a particular tag, which may comprise a key-value pair to be applied to various resources. A policy enforcement manager can determine the tagged resources and ensure that the relevant policies are applied. The policies can include logic or intelligence for performing a variety of tasks with respect to resources, groups of resources, or types of resources, as identified using the tags.

Abstract: Embodiments for optimizing data storage instances in a cloud environment in which metadata is stored and accessed separately from content data in multiple different instances of data storage units. A metadata and content data storage instance optimization process determines the status of different instances of virtual storage resources for both metadata and content data. Full instances are powered down when they are not needed, empty instances are deleted, and data of partially full instances is moved to other appropriate instances to create empty instances that can be deleted. The data storage instance optimization process is provided as part of a data protection search process that provides an execution environment and user interface to the optimization process.

Abstract: A command is received from a host regarding accessing an NVMe dispersed namespace in a metro cluster configuration of storage arrays. A namespace group state corresponding to the host and the port is determined and returned to the host. The namespace group state indicates whether the specific communication path between the host and the port is optimized or non-optimized. The namespace group state indicates that the communication path is non-optimized where the host is not located at the same location as the storage array, and that the communication path is optimized where the host is located at the same location as the storage array and the node of the storage array is a preferred node for processing I/O directed to the NVMe dispersed namespace from hosts located in the same location as the storage array.

Abstract: Disclosed herein are systems and method for backing up data in a load-balanced clustered environment. A clustered resource to be backed up is selected, wherein the clustered resource is stored on a common storage system and operated on by a cluster-aware application executing on at least a first node and a second node of a computing cluster. A load-balanced application may migrate the clustered resource from the first node with a high-load consumption to the second node with low-load consumption. A list of changes made by both nodes are received and merged. A backup agent then generates a consistent incremental backup using data retrieved from the common storage system according to the merged list of changes to the clustered resource.

Abstract: A method is used in host-based caching. A host receives a request for data, and identifies a host in a plurality of hosts that owns the data.

Abstract: A system and method for securing execution environments by quarantining software containers. A method includes: determining, based on configuration data for an application stored in the application software container, at least one intended behavior of the application when executed by the application software container; monitoring execution of the application software container in a first execution environment, wherein the monitoring further comprises comparing the execution of the application software container to the at least one intended behavior; detecting an unauthorized action by the application software container when the execution of the application software container is anomalous as compared to the at least one intended behavior; and quarantining the application software container by migrating the application software container from the first execution environment to a second execution environment when the unauthorized action is detected.

Abstract: Techniques are provided for serializing replication operations. A plurality of operations are implemented upon a first storage object and are replicated as a plurality of replication operations. An order with which the plurality of replication operation are to be executed upon a second storage object is determined. Execution of the plurality of replication operations upon the second storage object is serialized according to the order.

Abstract: Techniques for managing a file system involve in response to receiving, at a first backup device of the file system, a request for replicating data of the file system from the first backup device to a second backup device of the file system, determining a synchronization state between the first backup device and the file system, the second backup device being a backup device located downstream of the first backup device; creating, based on the synchronization state, a target snapshot associated with the file system; and causing the data to be replicated from the first backup device to the second backup device based on the target snapshot. Therefore, the data backup flexibility and accuracy of a file system can be significantly improved and therefore the reliability of the whole system may be enhanced.

Abstract: The present specification discloses a digital device for performing a hibernation booting process and a control method therefor. Here, the digital device according to an embodiment of the present invention comprises: a first memory; a second memory storing a snapshot image generated on the basis of pieces of page data of the first memory; and a control unit for generating the snapshot image, wherein the control unit primarily deduplicates duplicated page data in the first memory and selectively secondarily deduplicates duplicated page data by comparing the duplicated page data with the snapshot image prestored in the second memory, wherein data fragmentation is minimized through the secondary deduplication step.

Abstract: Embodiments for a storage classifier that provides recommendations to a backup server for storage targets among a plurality of disparate target storage types. The storage classifier receives metadata (name, type, size), and the Service Level Agreement with information such as: retention time, Recovery Point Objective, and Recovery Time Objective) from the backup software. The backup software itself receives policy recommendations from a data label rules engine based on certain file attributes. The storage classifier receives an initial recommendation for the storage type and location (e.g., on-premises deduplication storage or public-cloud object storage, etc.) from a data classifier. Based on these inputs, the storage classifier provides recommended specific storage targets to the backup software on a file-by-file basis for data stored in a backup operation.

Abstract: Techniques are provided for remote object store error handling. A storage system may store data within one or more tiers of storage, such as a local storage tier (e.g., solid state storage and disks maintained by the storage system), a remote object store (e.g., storage provided by a third party storage provider), and/or other storage tiers. Because the remote object store may not provide the same data consistency and guarantees that the storage system provides for clients such as through the local storage tier, additional validation is provided by the storage system for the remote object store. For example, when data is put into an object of the remote object store, a verification get operation is performed to read and validate information within a header of the object. Other verifications and checks are performed such as using a locally stored metafile to detect corrupt or lost metadata and/or objects.

Abstract: One example method includes discovering an application topology, discovering relationships between microservices that are elements of the application topology, ranking the microservices, identifying one or more of the microservices as a persistency microservice, selecting one or more persistency microservices for backup, and defining a backup policy based on the microservice relationships, the microservice rankings, and the selected persistent microservices. A backup operation is then performed that includes backing up persistent data and/or persistent metadata generated and/or modified by one or more of the persistency microservices.

Abstract: Embodiments for optimizing multiple backup operations for a data protection system, by determining a size of a dataset to be saved in each backup operation and an available bandwidth in each transfer window of a plurality of transfer windows for transfer data between a source and destination; then determining an order of the backup operations based on first ordering the backups based on decreasing dataset size and second ordering the transfer windows in order of decreasing bandwidth, and matching the backups to the transfer windows in accordance with the first ordering and second ordering. The optimum time represents a time to initiate the backup operation that results in a shortest data transfer time over all of the transfer windows from as compared to other possible transfer windows in a defined backup period.

Abstract: An information processing system includes a first storage system for supplying a primary site, and a second storage system for supplying a secondary site. The first storage system is allowed to execute replication by transferring a processing history of a data volume of the first storage system to the second storage system, and to transfer multiple processing histories collectively. The first storage system integrates histories of multiple write accesses included in the multiple processing histories to be collectively transferred, which are duplicatedly addressed on the volume for transfer.

Abstract: A data storage subsystem is disclosed that implements a process for storing and/or reconstructing system data, such as a system mapping table. In certain embodiments, table pages are systematically copied, or flushed, to non-volatile memory in a progressive manner, according to a fixed ratio of flushed table pages per table update trigger, thereby facilitating write and/or load efficiency. Full or partial reconstruction of a table may be performed within a bounded number of operations based on the size of the table, the ratio implemented, and/or other characteristics.

Abstract: A processing device receives a first instruction specifying that first data is to remain on a first memory device of a plurality of memory devices, the first memory device comprising a first media having a first media type. The processing device further receives a second instruction specifying, based on one or more criteria, that second data is to be moved from the first media having the first media type to a second memory device of the plurality of memory devices, the second memory device comprising a second media having a second media type that is different than the first media type. The processing device further controls the first and second data in the plurality of memory devices based on the first instruction and the second instruction.