Abstract: Embodiments disclosed are directed to a computing system that provides for on-demand scanning for changes in cloud-based object storage systems. The changes can include modifications, additions, or deletions of objects stored in a cloud-based object storage system. The computing system scans, at a first runtime, objects stored in a cloud-based object storage system. The computing system retrieves lookup information associated with a second runtime of a previous scan. Based on the lookup information, the computing system identifies a subset of the objects that were changed or added after the second runtime and before the first runtime. Subsequently, the computing system generates an electronic notification including a consolidated list of the subset of the objects.

Abstract: Generation of new snapshots of a storage object are prompted based on changes to the storage object. An absolute storage change condition is satisfied when the aggregate amount of changed data since the most recent snapshot satisfies a threshold that represents a predefined amount of storage capacity, e.g., N GB. A percentage of used storage change condition is satisfied when the aggregate size of the changes expressed as a percentage of the provisioned storage capacity of snapped storage object satisfies a predetermined threshold, e.g., X % of Y TB. A percentage of provisioned storage change condition is satisfied when the aggregate amount of the changes in terms of percentage of utilized storage capacity of storage object satisfies a predetermined threshold expressed as a percentage of the utilized capacity of the storage object, e.g., P % of Z TB.

Abstract: One example method includes refreshing secondary or repurposed copies. A copy data management system issues a single request that allows multiple secondary copies to be refreshed using an API server. The server allows a storage controller to read data from a single source and then write the data read from the source to multiple targets simultaneously, thereby refreshing multiple copies in parallel.

Abstract: A method of consolidating snapshots includes receiving a request to consolidate a first snapshot with a second snapshot into a third snapshot, the first and second snapshots stored in separate backup files, each backup file organized as a directory where data parts of the first and second snapshots can be hard linked to locations outside of the backup file, comparing the data parts of the first and second snapshots to determine if any second snapshot data part fully overlaps with any first snapshot data part, responsive to determining that a second snapshot data part fully overlaps with a first snapshot data part, hard linking the determined second snapshot data part into the third snapshot, and storing the third snapshot in the backup file.

Abstract: In accordance with some aspects of the present disclosure, a non-transitory computer readable medium is disclosed. In some embodiments, the non-transitory computer readable medium includes instructions that, when executed by a processor, cause the processor to receive, from a workload hosted on a host of a cluster, first I/O traffic programmed according to a first I/O traffic protocol supported by a cluster-wide storage fabric exposed to the workload as being hosted on the same host. In some embodiments, the workload is recovered by a hypervisor hosted on the same host. In some embodiments, the non-transitory computer readable medium includes the instructions that, when executed by the processor, cause the processor to adapt the first I/O traffic to generate second I/O traffic programmed according to a second I/O traffic protocol supported by a repository external to the storage fabric and forward the second I/O traffic to the repository.

Abstract: Contents of a virtual machine of a primary storage are received at a first point in time. A full snapshot of the virtual machine is stored on a secondary storage using the received contents of the virtual machine. One or more cloud storage volumes of the virtual machine are caused to be created. Contents of the full snapshot for storage on the one or more cloud storage volumes are provided from the secondary storage. Changed data of the virtual machine of the primary storage is received at a second point in time. An incremental snapshot of the virtual machine is stored using the received changed data. The one or more cloud storage volumes are updated using the incremental snapshot of the virtual machine. An image of at least one of the cloud storage volumes is caused to be created for standby deployment of another instance of the virtual machine.

Abstract: A cloud manager restores a backup of a distributed environment by comparing a stack of a current distributed environment to a backup stack of the backup of the distributed environment. The cloud manager identifies a difference between a first number of nodes in the first set of nodes specified in the first stack and a second number of nodes in the second set of nodes specified in the second stack. The cloud manager restores the backup of the distributed environment by modifying a number of nodes in the current distributed environment based on the identified difference between the first number of nodes and the number of nodes in the second stack.

Abstract: A computer-implemented method according to one embodiment includes receiving, on a first cluster site, a first I/O request to migrate a plurality of filesets from a second cluster site to the first cluster site. The first cluster site includes a plurality of gateway nodes. The method further includes identifying at least two of the gateway nodes having resources available to perform operations of the migration, and hashing information of a plurality of filesets against the identified gateway nodes. The information includes inode numbers of entities that are mounted during fulfillment of the first I/O request. Operations of the first I/O request are distributed to the identified gateway nodes based on the hashing, and the identified gateway nodes are instructed to fulfill the operations.

Abstract: Examples described herein generally relate to maintaining a snapshot of a multitier distributed file system. A snapshot directory volume of a directory volume can be created at least in part by copying, to the snapshot directory volume, metadata of the directory volume. Based on a file access request, it can be determined whether the file has not been snapshotted. If not, a snapshot file record of the file, and associated with the snapshot directory volume.

Abstract: A virtual storage volume that includes storage space on potentially many different physical disks may be implemented as one or more chunks. This allows for dynamic volume storage adjustment. Dynamic volume storage adjustment allows for increasing volume size without moving data unnecessarily. In addition, dynamic volume storage adjustment also allows freeing up storage space in a node with minimum movement of data.

Abstract: Implementations described herein relate to methods, systems, and computer-readable media to selectively synchronize database objects. In some implementations, a method includes receiving a request to synchronize records that include a corresponding root record and one or more connected records from a first database instance to a second database instance, wherein the request includes a specified graph configuration and an object boundary identifier; collecting the one or more records by traversing a corresponding graph configuration associated with each of the one or more root records; generating a snapshot that includes the one or more records into one or more object record sets based on a corresponding object boundary identifier associated with each of the one or more root records and the one or more connected records; publishing the snapshot to the second database instance; and updating the second database instance.

Abstract: Provided are techniques for role reversal of primary and secondary sites with minimal replication delay. During a backup phase, an Input/Output (I/O) operation selected from a group comprising a create operation and a rename operation is received with one or more local attributes of a local file. The I/O operation is processed to generate one or more remote attributes. The one or more local attributes are stored with the one or more remote attributes. During a reversed phase, a write operation for the remote file is processed, and, the write operation is sent to the primary replication system with the one or more local attributes, where the primary replication system uses a local file handle in the one or more local attributes to access the local file for processing the write operation to sync the local file with the remote file.

Abstract: A system receives a request to import data file(s) from a source data store into a target database. The system reserves a first portion of computing resources that host the target database to import the data file(s). The reservation of the first portion of computing resources permits the import throughput rate of the data file(s) through the first portion of computing resources while maintaining a second portion of the computing resources to support client access to the target database at an access throughput rate. The system initiates import of the data file(s) from the source data store to the target database through one or more storage nodes at the import throughput rate according to the first portion of computing resources. The target database is able to receive access requests from one or more clients during the import of the data file(s) to the target database.

Abstract: Presented herein are systems and methods for backing up and restoring related backup data stored in different cloud storage tiers in a cloud storage environment. Backup data generated during a backup job is stored to different cloud storage tiers based on the type of data and a storage policy comprising designations of a first cloud storage tier and a second cloud storage tier. Backup metadata and index data is stored in the designated first cloud storage tier and backup payload data is stored in the designated second cloud storage tier. Designations of the storage tiers are based on the attributes associated with each tier of cloud storage. During restore, the backup payload data is recalled from the second storage tier into the first storage tier where it is used to restore to the destination client or customer.

Abstract: Distributed application orchestration management is provided. A first passive member of a set of passive members sends a notification message to other members indicating that the first passive member is initiating start of a distributed application in response to the first passive member validating that a self-restart by a leader member failed. The first passive member compares timestamps associated with an attempt to start the distributed application by other passive members in the set of passive members. The first passive member stops a particular attempt to start the distributed application in response to the first passive member determining that a timestamp associated with the particular attempt to start the distributed application by the first passive member is newer than another timestamp of another passive member. The first passive member designates the other passive member having an older timestamp as a new leader member to continue starting the distributed application.

Abstract: A system and method for exposing volumes with underlying read-write mediums to user operations. When a medium is in the process of being migrated to a storage array, a volume which relies on the medium can be exposed to user operations (e.g., snapshots, read and write operations) once the portions of the medium which underlie the volume have been migrated. The volume can be exposed to user operations while one or more other portions of the medium are unfilled and while the medium is in an intermediate read-write state.

Abstract: A client computing device receives a behavior model corresponding to a user group associated with a user. The behavior model has been trained with monitored user interactions of one or more files associated with the user group. The client computing device further mounts a snapshot of a file and determines, based on the behavior model, which files of the mounted snapshot to transfer to a locally accessible cache. During use of the client computing device, the client computing device may determine whether the mounted snapshot is accessible. If the mounted snapshot is not accessible, the client computing device may selectively delete, based on the behavior model, one or more of the files stored in the locally accessible cache. If the mounted snapshot is accessible, the client computing device may update the one or more files of the locally accessible cache with monitored user interactions with the mounted snapshot.

Abstract: A method, computer program product, and computer system for triggering, by a computing device, a synchronization activity on a storage object. A request may be executed for a copy operation resulting from the synchronization activity to copy the storage object from a source to a destination when a current number of concurrent copy operations is below a maximum number of copy operations. The request for the copy operation resulting from the synchronization activity to copy the storage object from the source to the destination may be placed in a queue when the current number of concurrent copy operations is at least at the maximum number of copy operations. One or more attributes of the request in the queue may be identified. The request for the copy operation may be executed according to a replication policy based upon, at least in part, the one or more attributes of the request in the queue.

Abstract: An illustrative embodiment disclosed herein is an apparatus including a processor having programmed instructions to detect an operation associated with a first object instance in a first cluster, determine that the first object instance is configured for replication to a second cluster, create an object information (info) metadata entry for the first object instance, create an object replication metadata entry for the first object instance, and simultaneously write the object info metadata entry and the object replication metadata entry to a first data structure and a second data structure, respectively.

Abstract: A lightweight always-on monitoring, collecting, diagnosing, and correcting utility operates in an enhanced storage manager that manages a data storage managements system. The always-on utility provides a comprehensive and pro-active approach, which is intended to reduce, if not altogether eliminate, the need for after-the-fact diagnostics. The always-on utility also enforces so-called best practices and other heuristics, which include pro-actively activating certain database settings that are not enabled by default; manipulating certain aspects of the database to improve performance; and reporting aspects that are outside best-practice parameters to the trouble report system so that system administrators and/or developers may intervene before a catastrophic failure occurs. In some cases, the best-practice parameters represent heuristics designed by the present inventors to improve the performance and general health of the management database.

Abstract: An agent executing on a processor at a data production site detects filesystem events and creates a list of bookmarks describing the filesystem events in user-understandable strings. Each bookmark is associated with metadata about the filesystem event that includes a timestamp and a point-in-time (PiT) snapshot of the filesystem at the time of occurrence of the event. The bookmarks and associated metadata are transferred to a recovery site and the bookmark set is recorded in storage. The storage can be searched for bookmarks in the set that reference the filename of a file of interest, and the file recovered and replicated using an associated PiT.

Abstract: Disclosed herein are methods, systems, and apparatus, including computer programs encoded on computer storage media, for managing transaction requests in ledger systems.

Abstract: Disclosed herein are methods, systems, and apparatus, including computer programs encoded on computer storage media, for avoiding double-spending problem in read-write set-model-based blockchain technology. One of the methods includes receiving instructions to execute two or more blockchain transactions on a piece of data, where all blockchain transactions of the two or more blockchain transactions modify a value of the piece of data, and for each blockchain transaction from the two or more blockchain transactions, pre-executing a smart contract associated with the blockchain transaction to generate a special instruction indicating the blockchain transaction, where the special instruction is used to validate that a current value of the piece of data supports the blockchain transaction when executing the smart contract to write the blockchain transaction to a blockchain.

Abstract: In an embodiment, a computing system may restore data for a protected system using an emulated block device that presents a synthesized filesystem. Initially, a request to restore data for the protected system may be received. The request may include or otherwise indicate a particular file system format, a particular virtual disk format, and a recovery point representing a particular point in time for presentation of the restored data. Responsive and subsequent to receiving the request to restore the data, the computing system generates a first configuration of the emulated block device for presenting the synthesized filesystem, the first configuration being based on: a) an amount of data in the recovery point, b) the particular file system format, and c) the particular virtual disk format. The computing system also generates a configuration for the synthesized filesystem, and provides access to the emulated block device based on the determined configurations.

Abstract: In a method used for maximizing performance of a storage system, saturation points of the storage system for I/O requests of different types and sizes are identified. Normalized tokens are determined based on the saturation points. Unique numbers of normalized tokens are associated with the I/O requests of different types and sizes. A number of normalized tokens for a queue depth limit of a storage device is determined. From the queue depth limit, normalized tokens are allocated to each node in the storage device. I/O requests are processed according to the allocations of normalized tokens.

Abstract: Described herein is a system that restores a database by processing a portion of the database. The system restores the database to a previous state at a particular time by reverting data entries that have changed since the time to their initial values before the change. Data entries that have changed after the restore time are identified. For the data entries that have changed after the restore time, their initial values before the change are determined from various sources. The system determines a database version that is created most recently before the restore time. The system additionally identifies changes to the database between the restore time and when the database version is created. The initial values can be determined from either the database version or the changes made to the database between the restore time and when the database version is created.

Abstract: A system and method determining a Chain Identification Number (CID) of a source snapshot to be replicated from a source site to a target site of a virtual computing system, determining a predetermined number of potential reference snapshots based on the CID of the source snapshot, computing a closeness value between the source snapshot and each of the potential reference snapshots, and creating a list of the potential reference snapshots based on the closeness value of each of the potential reference snapshots. One snapshot from the list is selected as a reference snapshot. The source snapshot is replicated to the target site based on the reference snapshot.

Abstract: System and method for managing snapshots of storage objects in a storage system use a consolidation operation to reduce read amplification for stored snapshots of a storage object that are stored in log segments in the storage system according to a log-structured file system as storage service objects. The consolidation operation involves identifying target log segments among the log segments that include live blocks that are associated with the latest snapshot of the storage object and determining the number of the live blocks included in each of the target log segments. Based on the number of the live blocks in each of the target log segments, candidate consolidation log segments are determined from the target log segments. The live blocks in the candidate consolidation log segments are then consolidated to new log segments, which are uploaded to the storage system as new storage service objects.

Abstract: Methods and systems for protecting virtual machines is provided. One method includes identifying a plurality of volumes of a primary storage system for storing a plurality of data containers of a virtual machine (“VM”); generating a consistency group (“CG”) snapshot of the plurality of volumes; associating a single instance storage clone of each data container of the VM from the CG snapshot to an active file system of the primary storage system; and generating metadata for representing a VM backup as a set having each of the single instance storage clone of each data container.

Abstract: Contents of a virtual machine of a primary storage are received at a first point in time. A full snapshot of the virtual machine is stored on a secondary storage using the received contents of the virtual machine. One or more cloud storage volumes of the virtual machine are caused to be created. Contents of the full snapshot for storage on the one or more cloud storage volumes are provided from the secondary storage. Changed data of the virtual machine of the primary storage is received at a second point in time. An incremental snapshot of the virtual machine is stored using the received changed data. The one or more cloud storage volumes are updated using the incremental snapshot of the virtual machine. An image of at least one of the cloud storage volumes is caused to be created for standby deployment of another instance of the virtual machine.

Abstract: Systems and methods for adding backups to de-duplicated storage and for removing backups from de-duplicated storage are disclosed. Backups can be added to the de-duplicated storage with minimal reference count updates. Backup data sets can be removed without garbage collection processes being performed on the de-duplicated storage.

Abstract: Change list-based snapshots of applications for testing and development are described. A system selects a change list corresponding to at least one change in an application executed by a virtual machine. The system creates a snapshot of the application corresponding to the change list. The system creates at least one additional virtual machine based on the snapshot of the application. The at least one additional virtual machine executes a test of the application which includes the at least one change corresponding to the change list.

Abstract: A method, a device, and a computer apparatus for merging regions of a HBase table are provided. The method includes acquiring attribute information of HDFS files corresponding to each region in a plurality of regions in the HBase table, where the attribute information of the HDFS files corresponding to one region includes storage space occupied by the files corresponding to the one region, and performing merging processing on every two adjacent regions in the plurality of regions at least according to the storage space occupied by the files corresponding to each region in the plurality of regions. Performing the merging based on the storage space occupied by the files corresponding to the regions in the embodiments of the present disclosure may be beneficial for improving the precision of merging two adjacent regions.

Abstract: A multitenant deployment includes a computing cluster that executes multiple containerized instances of a software application. Each containerized instance is associated with one or more datastores that can be assigned to different tenants. A registry store maintains a mapping between tenants and datastores, thereby allowing a registry manager to properly route tenant requests to the correct datastores. A capacity manager tracks tenant usage of datastores in the registry store and then scales computing resources for each tenant in proportion to usage. The capacity manager also migrates tenant resources in response to catastrophic failures or upgrades. In this fashion, the multitenant deployment can adapt a single-tenant software application for multi-tenancy in a manner that is both transparent and secure for the tenant.

Abstract: A method, system, and computer program product for encoded virtual block deferred reference counting comprising receiving an input/output (“IO”) request for data, the data associated with a virtual block, updating a reference count structure to reflect the IO request, and updating, out of line from the IO request, one or more reference counts associated with the virtual block to reflect the result of the IO request based on the updated reference count structure.

Abstract: The present disclosure provides methods, apparatus, and systems for implementing and operating a memory module, for example, in a computing that includes a network interface, which may be coupled to a network to enable communication with a client device, and host processing circuitry, which may be coupled to the network interface via a system bus and programmed to perform first data processing operations based on user inputs received from the client device. The memory module may be coupled to the system bus and include memory devices and a memory controller coupled to the memory devices via an internal bus. The memory controller may include memory processing circuitry programmed to perform a second data processing operation that facilitates performance of the first data processing operations by the host processing circuitry based on context of the data block indicated by the metadata.

Abstract: A data storage erasure system may have a host connected to a plurality of data storage devices via a network controller with each of the plurality of data storage devices and the network controller connected to a pods controller and each of the plurality of the data storage devices having a device controller. A rebuild strategy can be generated with a rebuild module connected to the plurality of data storage devices, the network controller, and the pods controller. The rebuild strategy may be directed to minimize data rebuild times in the event of a failure in the plurality of data storage devices by executing the rebuild strategy in response to a detected or predicted failure in at least one data storage device of the plurality of data storage devices.

Abstract: Methods, systems, and computer-readable media for linking multiple data entities. The method collects a snapshot of data from one or more data sources and converts it into a canonical representation of records expressing relationships between data elements in the records. The method next cleans the records to generate output data of entities by grouping chunks of records using a machine learning model. The method next ingests the output data of entities to generate a versioned data store of the entities and optimizes versioned data store for real-time data lookup. The method then receives a request for data pertaining to a real-world entity and presenting relevant data from the versioned data store of entities.

Abstract: Container images may be generated from a backup system that includes a backup of one or more applications from a computing system of an entity. During a backup process, an application can be identified and its storage location in a secondary storage can be tracked or saved in a backup index. Configuration information and data or files created by user interaction with the application can be backed up and the location of the backed up data or files may be stored in the backup index along with the location of the configuration information. Using the backup index, a container image can be created that includes a selected application, its configuration information, and data, if any, created by the application. The container image can be generated from the backup stored in the secondary storage.

Abstract: Techniques index a file. The techniques involve: determining, based on a first mapping stored in a first inode associated with the file, whether a predetermined conversion condition is satisfied. The first mapping points to a plurality of data blocks of a file system storing the file in a first index structure. The techniques further involve, in response to determining that the predetermined conversion condition is satisfied, creating a second inode associated with the file. The techniques further involve converting the first mapping into a second mapping to be stored in the second inode. The second mapping points to the plurality of data blocks in a second index structure different from the first index structure.

Abstract: A method for use in a storage system disclosed, comprising: transitioning the storage system into a first state, the first state including a state in which a source system performs synchronous replication to a target system; detecting a first event while the source system is in the first state; in response to the first event, transitioning the storage system from the first state into a second state, the second state being a state in which the source system performs asynchronous replication; detecting a second event while the storage system is in the second state, transitioning the source system from the second state into a third state, the third state including a state in which the source system performs both synchronous replication and asynchronous replication.

Abstract: A file system may include an object storage, a merged index, and a distributed database. When a file is stored in the file system, the file may be converted to an object and be stored in the object storage. The deduplication index of the file may be stored in the distributed database. The namespace metadata of the file may be stored in the merged index. The merged index generates namespace entries of the file when the file is created, deleted, and/or modified. A namespace entry may be associated with a specific file and may include a creation version and a deletion version. When a file is deleted or modified, instead of modifying the existing namespace entries, new entries associated with different versions and including different creation or deletion versions are created. The status of a file may be monitored by one or more entries associated with a file.

Abstract: One example method includes monitoring performance of an element of a runtime environment, where the monitoring includes collecting performance information concerning the element, analyzing the collected information, detecting, based on the analysis of the collected information, an anomaly in the performance of the element and, in response to detection of the anomaly, automatically marking a snapshot of the runtime environment element, and the marking of the snapshot overrides a retention policy applicable to the snapshot.

Abstract: Described is a system that efficiently detects ransomware attacks within a storage environment. The system may perform a specialized validation by comparing a sampling of backup data obtained from a storage environment with a sampling of data maintained by a specialized validation database. Accordingly, if there is a discrepancy between the samples, the system may issue an alert indicating the original backup data may be encrypted as part of a ransomware attack. The system may utilize the specialized sampling as a validation technique in addition, or as an alternative, to relying on data fingerprints for validation. For example, malicious code may be configured to cause the storage environment to provide fingerprints prior to an unauthorized encryption as an attempt to deceive certain validation processes. Accordingly, to counteract such attempts, the system may rely on the sampling of data, instead of relying solely on a fingerprint comparison.

Abstract: A system comprises data processing hardware and memory hardware. The memory hardware is in communication with the data processing hardware, and stores instructions that, when executed on the data processing hardware, cause the data processing hardware to perform a plurality of operations. In some examples, one of the operations may include receiving instance management configuration data for a single-tenant software-as-a-service (SaaS) application. Another operation may include further include receiving an image of the single-tenant SaaS application. Yet another operation can include generating, by the control plane manager, a control plane based on the instance management configuration data. The control plane is configured to create multiple instances of the single-tenant SaaS application based on the received image, and to manage the instances of the single-tenant SaaS application based on the received instance management configuration data.

Abstract: A system and method for an index-based smart scan for a cloud-computing provider network is provided. The system includes a memory having computer-readable instructions stored therein and a snapshot repository configured to store a plurality of snapshots of a plurality of block storage volumes. Each of the plurality of block storage volumes is configured to perform volume based block storage operations for the cloud-computing provider network. The system further includes a processor communicatively coupled to the snapshot repository. The processor is configured to access contents of each of the plurality of snapshots. Each of the plurality of snapshots includes a point-in-time capture of the respective block storage volume. In addition, the processor is configured to perform a full scan of each of the plurality of snapshots to identify one or more files of the respective block storage volume. The processor is further configured to generate a folder index table for each of the files based upon the scan.

Abstract: Methods and related systems are disclosed for retrieving personality data for a first unit a climate control system. In an embodiment, the method includes querying a second unit controller that has replaced the first unit controller. In addition, the method includes determining that the second unit controller lacks personality data that is unique to the first unit. Further, the method includes transferring the personality data to the second unit controller from a memory of the climate control system that is separate from the second unit controller.

Abstract: Methods, information handling systems and computer readable media are disclosed for detection and repair of fragmentation in databases. In one embodiment, a method includes obtaining log data reflecting transactions in a database, where the log data is generated during operation of the database. The method continues with applying a machine learning classification model to at least a portion of the log data to obtain a first prediction, where the first prediction indicates whether defragmentation of the database should be scheduled. In this embodiment the method also includes using a machine learning time series forecasting model to obtain a second prediction, where the second prediction identifies a future time interval of low relative database utilization, and scheduling a defragmentation procedure for performance during the future time interval of low relative database utilization.

Abstract: A method, computer program product, and computing system for processing a snapshot tree structure of a storage system, wherein the snapshot tree structure defines a plurality of filter elements including one or more snapshots. A snapshot matrix is generated based, at least in part, upon the snapshot tree structure, wherein the snapshot matrix defines the amount of data storage consumed by one or more eclipsed elements and the corresponding eclipsing elements.

Abstract: Dynamically adjusting an amount of log data generated for a storage system that includes a plurality of storage devices, including: setting, for a component within the storage system, a logging level for the component, the logging level specifying the extent to which log data should be generated for a particular component; determining, in dependence upon one or more measured operating characteristics of the storage system, whether the logging level for the component should be changed; and responsive to determining that the logging level for the component should be changed, changing the logging level associated with the component.