Abstract: Embodiments of this application provide a method and an apparatus for multi-replica data restoration. The method is applied to a distributed database and includes: when a first page in replica data of a first node has a fault, obtain N latest LSNs in data log information of a second node that corresponds to a first page identifier. The first page is any page that is in the replica data of the first node and that has a fault. The first node further determines a node corresponding to a largest LSN in the N latest LSNs in the data log information of the second node that corresponds to the first page identifier is a third node. Then the first node performs data restoration on the first page in the replica data of the first node according to replica data of the third node.

Abstract: Provided are techniques for determining which target is most ahead in a multi-target mirroring environment between data from a consistent synchronous mirror copy operation and data from a consistent asynchronous mirror copy operation. It is determined that data is to be retrieved from one of a sync secondary storage of a sync secondary storage controller and an async secondary storage of an async secondary storage controller. Then, it is determined which one of data of a consistent synchronous mirror copy operation on the sync secondary storage and data of a consistent asynchronous mirror copy operation on the async secondary storage is a most current copy of the data. The most current copy of the data is retrieved and used for further processing.

Abstract: A method of rebuilding data stored as encoded data slices in a dispersed storage network (DSN) includes obtaining, by a rebuilding module implemented in a processing device, an identity of a plurality slices-in-error to be rebuilt, wherein each individual slice-in-error is associated with index information specifying: a particular dispersed storage unit associated with the individual slice-in-error; and a number of slices-in-error associated with the particular dispersed storage unit. A first slice-in-error is selected for rebuilding based, at least in part, on the number of slices-in-error associated with a first dispersed storage unit associated with the first slice-in-error. Read slice requests at least a decode threshold number of data slices are issued to the first dispersed storage unit. At least a decode threshold number of slices are received at the rebuilding module, which rebuilds the first slice-in-error using the received slices.

Abstract: Systems and methods include a method for handling application requests. A request for an application is received at a zero downtime system. The application is accessible through: 1) primary application servers on a primary system coupled to a primary database, and 2) secondary application servers on a secondary system coupled to a secondary database synchronized to the primary database. A primary system status of the primary system is determined. When the primary system status is a healthy status, the request is routed to primary application servers of the primary system. When the primary system status is an unhealthy status, the request is routed to secondary application servers of the secondary system. When the primary system status is a scheduled system maintenance status, the request is routed to secondary application servers of the secondary system. The request is handled by the primary or the secondary application servers.

Abstract: Examples described here include systems and methods for refreshing the operating system (“OS”) of a device enrolled in a management platform. Execution of a first command file ensures that necessary components of the management platform residing on the device are stored in a partitioned portion of the device hard drive to preserve them during the OS refresh. After a new instance of the OS has been installed, execution of a second command file migrates the necessary components from the partitioned portion of the hard drive to the new OS instance. When the user logs back into the refreshed device, a third command file installs all necessary device management components at the new OS instance and re-enrolls the device with the management platform. In this manner, the OS of a managed device can be refreshed and re-enrolled in the management platform without significant input from a user or administrator.

Abstract: A method includes setting a maximum total size of data saved in a snapshot area, creating a snapshot of a file system, including reference to a plurality of logical volumes, saving at least a part of the plurality of logical volumes in the snapshot area on condition that it does not exceed the maximum total size of data saved in the snapshot area, and executing copy-on-write processing in response to a writing request for data in the file system, the data not being saved in the snapshot area.

Abstract: Managing storage volumes in a point-in-time copy cascade. The cascade includes a first source volume, a first target volume and a second target volume. The method detects a corruption of the first source volume and, if a first restoration of the first source volume from the first target volume is in progress, creates a third target volume from the second target volume and directs I/O operations for the first source volume to the third target volume. The first source volume is then restored from the third target volume.

Abstract: Generating data checksum for a data object including multiple data units comprises, for each data unit, obtaining a corresponding address of the data unit, and rotating the data unit based on said corresponding address of the data unit to generate a rotated data unit. A checksum value for the data object is determined based on said rotated data units.

Abstract: Data streaming applications may need to provide high reliability, particularly depending on the nature of the data being streamed. A framework is described that allows a data streaming application to ensure high reliability both during update operations and during ordinary operations. A unique event ID count can be recorded that reflects messages being sent from a source to the streaming application. After an update and service restart, the count can again be collected to see if data is flowing through the streaming application as expected. Unique database record counts can be reviewed (e.g. after a restart or during ordinary operations) to ensure that no records are being unexpectedly dropped. Data content sampling can also be performed to see that any data transformations are functioning properly. Corrective actions (after a restart or during ordinary operations) can also be taken, including replay of database messages that are dropped, or sending an alert.

Abstract: A method and system for efficient resource usage through intelligent reporting. Specifically, the method and system disclosed herein entail implementing resource-efficient messaging between computing systems engaging in centralized restore operations. A centralized restore operation may refer to the initiation and management of the restoration of data on a remote computing system from a local computing system. Further, conventional management of a centralized restore operation necessitates frequent reporting on the state of the restoration process, which may inefficiently expend memory and network resources.

Abstract: A system for accessing data includes and interface and a processor. The interface is configured to receive a request to move stored data to a new location and requestor information. The stored data comprises sensitive data. The processor is configured to determine whether read access, storage access, and deletion access are allowed based at least in part on the requestor information; in the event that read access, storage access, and deletion access are allowed: read the sensitive data at an original location using an original token, store the sensitive data to the new location and receive a new token associated with the new location, and delete the original token and the sensitive data at the original location.

Abstract: One embodiment provides a system for facilitating data placement. The system receives, by a computing device, data to be written to a non-volatile memory, wherein the data is associated with a first logical block address. The system performs, based on the first logical block address, a search in a mapping table for an entry which indicates a first physical block address associated with a first physical unit. A respective physical unit can comprise a plurality of blocks of data across a plurality of channels of the non-volatile memory. The system writes the data to a second physical block address in the first physical unit. The system updates the entry by replacing the first physical block address with the second physical block address.

Abstract: A method for operating an apparatus according to various embodiments may comprise the operations of: detecting whether a first signal transmitted from a control device to a storage device includes a designated address; and transmitting a second signal to the control device if the first signal includes the designated address, wherein the first signal may be a signal for transmitting, by the control device, a request for data to the storage device, and the second signal may be a signal for detecting whether uncommon data is included in a signal generated from the first signal.

Abstract: Techniques for cooperative preemption of resources in a distributed multi-tenant resource pool are described. A query execution service manages the allocation of computing resources in a provider network by identifying computing nodes in the provider network to preempt. The service causes the computing nodes to be removed from further executing tasks as part of processing their queries in a first group of nodes in the provider network while other computing nodes in the first group continue to execute tasks as part of processing the queries. The service then adds the first computing node into a second group of nodes in the provider network to execute tasks as part of processing other queries in the provider network.

Abstract: Examples described here include systems and methods for refreshing the operating system (“OS”) of a device enrolled in a management platform. Execution of a first command file ensures that necessary components of the management platform residing on the device are stored in a partitioned portion of the device hard drive to preserve them during the OS refresh. After a new instance of the OS has been installed, execution of a second command file migrates the necessary components from the partitioned portion of the hard drive to the new OS instance. When the user logs back into the refreshed device, a third command file installs all necessary device management components at the new OS instance and re-enrolls the device with the management platform. In this manner, the OS of a managed device can be refreshed and re-enrolled in the management platform without significant input from a user or administrator.

Abstract: Methods that can migrate storage data are provided. One method includes receiving, by a processor, an input/output (I/O) request and, in response to receiving the I/O request, simultaneously transmitting data associated with the I/O request to a first controller and a second controller as a portion of a data migration process. Systems and computer program products that can perform and/or implement the method are also provided.

Abstract: Examples described here include systems and methods for refreshing the operating system (“OS”) of a device enrolled in a management platform. Execution of a first command file ensures that necessary components of the management platform residing on the device are stored in a partitioned portion of the device hard drive to preserve them during the OS refresh. After a new instance of the OS has been installed, execution of a second command file migrates the necessary components from the partitioned portion of the hard drive to the new OS instance. When the user logs back into the refreshed device, a third command file installs all necessary device management components at the new OS instance and re-enrolls the device with the management platform. In this manner, the OS of a managed device can be refreshed and re-enrolled in the management platform without significant input from a user or administrator.

Abstract: Techniques for migration for composite nodes in software-defined infrastructures (SDI) are described. A SDI system may include a SDI manager component, including one or more processor circuits, configured to access one or more remote resources, the SDI manager component may include a partition manager configured to receive a request to create a composite node from an orchestrator component, the request including at least one preferred compute sled type and at least one alternative compute sled type. The SDI manager may create a composite node using a first compute sled matching the at least one alternative compute sled type. The SDI manager may determine, based upon a migration table stored on a non-transitory computer-readable storage medium that a second compute sled matching the at least one preferred compute sled type is available. The SDI manager may perform an migration from the first compute sled to the second compute sled. Other embodiments are described and claimed.

Abstract: Generating, in a geographically diverse storage system, a degraded convolved chunk that consumes less storage space than a convolved chunk that is not a degraded chunk is disclosed. The degraded convolved chunk can be generated at a third zone of the storage system and be based on a compressed representation of a first chunk from a first zone of the storage system and a second chunk from a second zone of the storage system, wherein the first chunk is a degraded chunk that comprises at least one non-relevant chunk fragment. In an embodiment, the compressed representation can be generated at the first zone. In another embodiment the compressed representation can be generated at the third zone. In an aspect, mapping data corresponding a logical compression of first chunk fragments to physical storage locations of the first chunk fragments can be employed in data operations of the storage system.

Abstract: The invention provides a file transmitting method and system. The file transmitting method is used for a system comprising N network file systems, N file receiving and forwarding servers, N network access servers, N client servers and N backstage servers that are in a one-to-one correspondence with the network file systems, comprising: the backstage server sends a file transmitting request to the file receiving and forwarding server, the file transmitting request comprises information on the file sending party, the file destination party and the file to be transmitted; the file receiving and forwarding server verifies the legitimacy of the file transmitting request; if legitimate, a file is transmitted between the file sending party and the file destination party; otherwise, a response that prohibits the transmitting is generated and returned to the backstage server that initiated the request. With the invention, transmission of files can be realized.

Abstract: A data backup method and a data processing system are provided. The method includes: when a quantity of storage files stored in a storage medium meets a preset threshold, acquiring storage files which are stored in the storage medium after a time point, where the time point is a time of previously backing up storage files in the storage medium; combining the storage files after the time point to obtain at least one new storage file; and backing up the at least one new storage file. Therefore, incremental backup is performed on the storage files after the time point.

Abstract: Preservation of data during scaling of a geographically diverse data storage system is disclosed. In regard to scaling-in, a first zone storage component (ZSC) can be placed in read-only (RO) mode to allow continued access to data stored on the first ZSC, completion of previously queued operations, updating of data chunks, etc. Data chunks can comprise metadata stored in directory table partitions organized in a tree data structure scheme. An updated data chunk of the first ZSC can be replicated at other ZSCs before deleting the first ZSC. A first hash function can be used to distribute portions of the updated data chunk among the other ZSCs. A second hash function can be used to distribute key data values corresponding to the distributed portions of the updated data chunk among the other ZSCs.

Abstract: A computer-implemented method according to one embodiment includes receiving, by a target system from a source system, a description of a set of data updates that are to be written to the target system. For each given portion of data of the target system that is to be rewritten during performance of the set of data updates, forward lookup is performed on the target system for determining a physical storage address of the given portion of data. The method further includes marking each of the determined physical storage addresses of the portions of data of the target system in a copy of a reverse lookup table of the target system. The marked-up reverse lookup table is used for determining an ordering in which the performance of the set of data updates would result in a least amount of garbage collection being performed while performing the set of data updates.

Abstract: Method and apparatus for managing data in a distributed data storage system, such as but not limited to a cloud computing environment. In some embodiments, snapshots of a data set are uploaded from a source storage subsystem to a cloud store, along with intervening difference information volumes (DIVs). The DIVs are data structures that identify a set of updated data blocks that have been changed by the source storage subsystem between each successive pair of the snapshots. A reader subsystem requests and uses the latest DIV to request the latest set of changed data blocks from the cloud store, and uses the latest set of changed data blocks to update a previous snapshot to generate a copy of the most recent snapshot. The source and reader subsystems can comprise Internet of Things (IoT) devices, client devices, edge computing devices, etc. from different vendors and which utilize different protocols.

Abstract: A memory system may include: a memory controller; a plurality of ranks; and a rank shared bus configured to couple the memory controller and the plurality of ranks. Each of the plurality of ranks may include: a plurality of banks; a rank bus coupled to the plurality of banks and configured to selectively transmit data to the rank shared bus or an intermediate buffer and selectively receive data from the rank shared bus or the intermediate buffer; and an intermediate buffer configured to be selectively coupled to the rank bus or the rank shared bus, according to a first signal from the memory controller.

Abstract: With respect to each of one or more entities, a computer sets a sum of an upper-limit NW send quantity and an upper-limit write quantity to a level equal to or lower than an allocation send quantity that is a send quantity allocated for the entity concerned. With respect to each of the one or more entities, the upper-limit NW send quantity is an upper-limit value of the NW send quantity that is the quantity of data to be sent per unit time via an NW I/F of the computer. With respect to each of the one or more entities, an upper-limit write quantity is an upper-limit value of a write quantity that is the quantity of data to be written per unit time to a logical volume recognized by the entity concerned.

Abstract: In various embodiments, a memory pool application implements composite arrays via a memory pool that includes a first slab and a second slab. First, the memory pool application assigns the first slab and the second slab to a composite array. The memory pool application then modifies a final data word included in the first slab to store a first portion of a specified value and a leading data word included in the second slab to store a second portion of the specified value. The memory pool application copies the second data word to a duplicate data word included in the first slab. Subsequently, the memory pool application performs an unaligned read operation on the first slab based on a specified offset to retrieve a first word stored in memory and extracts the specified value from the first word based on the specified offset and a specified number of bits.

Abstract: Migrating an application executing in a source compute sled to a target compute sled. The migration component selects a first sub-set of source pages. A respective source status of each source page of the first sub-set is modified according to a source table. A target table of the target compute sled is set to indicate that a first sub-set of target pages are modified. The migration component migrates the respective content stored in the first sub-set of source pages to target pages and selects a second sub-set of source pages, wherein the respective source status of each source page of the second sub-set is modified according to the source table. The migration component sets the target table to indicate that a second sub-set of target pages is allocated in the memory and then moves the respective content stored in the second sub-set of source pages to the memory.

Abstract: A computer-automated method, computer system and computer program for managing resources in applications. The resources are managed in groups, each group having a unique group name which is dynamically resolvable to an address specific to a particular application. The resources may be application program interfaces object instances or data sources, for example. When a resource placement request is received to place a resource in a particular application with an associated address, the resource is assigned to a group and given a unique resource identifier which combines with the group name to form a unique endpoint for the resource. Subsequently, in response to detection of a resource performance bottleneck, or in response to an external request, a resource is moved to another application by reassigning its group name to the second address, thereby moving all resources in that group to the other application.

Abstract: A method of operating a storage device includes receiving a first logical address from a host, determining whether first metadata stored in a volatile memory of the storage device and associated with the first logical address is corrupted, processing the first metadata as an uncorrectable error when the first metadata is determined to be corrupted, providing an error message to the host indicating that an operation cannot be performed on data associated with the first logical address when the first metadata is processed as the uncorrectable error, after the providing of the error message, receiving a second logical address from the host, determining whether second metadata stored in the volatile memory and associated with the second logical address is corrupted, and performing an operation of accessing the non-volatile memory based on the second metadata, when the second metadata is not determined to be corrupted.

Abstract: A multi-platform data storage system configured to accessing a plurality of storage platforms that use different storage access and/or storage management protocols. The multi-platform data storage system can, for example, include a storage mobility and management layer providing virtual management of data stored in the plurality of storage platforms, and a storage protocol converter operatively coupled between the storage mobility and management layer and the plurality of storage platforms. During access and/or management communication from the storage mobility and management layer to a particular one of the storage platforms, the storage protocol converter can operate to convert the access and/or management communication from a layer protocol used by the storage mobility and management layer to the storage access protocol used by the particular one of the storage platforms.

Abstract: Example embodiments relate generally to systems and methods for continuous data protection (CDP) and more specifically to an input and output (I/O) filtering framework and log management system to seek a near-zero recovery point objective (RPO).

Abstract: Differential restore using block-based backups is disclosed. Block restore information identifying blocks in a volume that have changed since a backup time may be determined. The block restore information may be based at least in part on stored block change information indicating monitored changes to blocks in the volume. The block restore information may be provided to a backup storage node. The block restore information is used to retrieve backup data associated with the identified blocks. The backup data may be used to restore the volume to a state at the backup time by replacing the identified blocks with corresponding backup data.

Abstract: A new snapshot of a storage volume is created by instructing computing nodes to suppress write requests. Once pending write requests from the computing nodes are completed, storage nodes create a new snapshot for the storage volume by allocating a new segment to the new snapshot and finalizes and performs garbage collection with respect to segments allocated to the previous snapshot. Subsequent write requests to the storage volume are then performed on the segments allocated to the new snapshot. An orchestration layer implements a multi-role application that is provisioned with virtualized storage and computation resources. A snapshot of the application may be created and used to rollback or clone the application. Clone snapshots of storage volumes may be gradually populated with data from prior snapshots to reduce loading on a primary snapshot.

Abstract: A system and method for performing copy offload operations. When a copy offload operation from a first volume (pointing to a first medium) to a second volume (pointing to a second medium) is requested, the copy offload operation is performed without accessing the data being copied. A third medium is created, and the first medium is recorded as the underlying medium of the third medium. The first volume is re-pointed to the third medium. Also, a fourth medium is created, the second volume is re-pointed to the fourth medium, and the second medium is recorded as the underlying medium of the targeted range of the fourth medium. All other ranges of the fourth medium have the second medium as their underlying medium.

Abstract: A snapshot analysis system analyzes a plurality of data snapshots taken in connection with data stored on a block device allocated by a data storage system. The snapshot analysis system may include an ingestor capable of initially detecting new snapshots and adding a root node for the snapshots. The system may include a block device analyzer that analyzes each snapshot to determine its contents, the relationship within data structures extant within the snapshot, and the snapshot's relationship to other snapshots and/or that of other block devices. The system may also include a clustering analyzer capable of determining whether snapshots are associated with multipart block devices, such as LVM or MD RAID devices. The system may further include a block device emulator that exposes data associated with a given snapshot as an addressable block device without necessitating retrieval or exposure of the full block device to which the snapshot is associated.

Abstract: An apparatus is configured to initiate a first replication session to replicate data of a first consistency group in a first storage system to a second consistency group in a second storage system, to create an additional consistency group linked to the first consistency group in the first storage system, and to initiate a second replication session to replicate data of the additional consistency group to another consistency group in a third storage system. The additional consistency group linked to the first consistency group in some embodiments is periodically updated against the first consistency group. For example, in one or more embodiments the second consistency group is updated based at least in part on an active snapshot set of the first replication session, and the additional consistency group is updated based at least in part on the first consistency group.

Abstract: Techniques manage a storage system. In such techniques, data types of data in multiple storage devices associated with the storage system are obtained. The multiple storage devices are divided into a first group of storage devices and a second group of storage devices according to the data types. A first processing ability of the first group of storage devices and a second processing ability of the second group of storage devices are determined separately. Data distribution is scheduled among the multiple storage devices on the basis of the first processing ability and the second processing ability. With such techniques, processing abilities of various storage devices in a resource pool may be balanced, so that workloads of various storage devices may be balanced and further overall response speed of the resource pool may be increased.

Abstract: Embodiments of the invention eliminate problems associated with annotation dependency when providing data protection operations. A proxy register is provided such that proxies can register with the data protection servers. The proxies identified in the proxy register, for each server, are uniquely identified in the proxy register and the proxy register ensures that proxies participating in the performance of data protection operations are excluded from being protected while unregistered proxies can be protected by the data protection application.

Abstract: The present disclosure relates to a method for updating a metadata structure to be compatible with an update between the first version of firmware and a second version of firmware, including formation of migration data (e.g., migration arrays) associated with corresponding blocks of metadata for different versions of firmware, and comparing of attributes of the migration data to determine various migration actions to perform in generating an updated metadata structure that is compatible with an update between versions of firmware.

Abstract: Embodiments of the present disclosure relate to a method, device and computer program product for recovering metadata. The method comprises detecting whether first metadata corresponding to a first journal at a first device is corrupted, and obtaining second metadata corresponding to a second journal from a second device in the case that the first metadata is corrupted, wherein the second device is remote from the first device. The method further includes recovering the first metadata based on the second metadata, the first journal and the second journal. Embodiments of the present disclosure utilize remote backup metadata for recovery in the case that local metadata (which for example includes index information) is corrupted without reserving metadata snapshot locally, thereby saving the storage space.

Abstract: A snapshot object or other type of object may be stored in a first storage system and may be accelerated in another storage system, wherein an accelerated snapshot or other type of object can be used to populate volumes in the other storage system with data more rapidly than a non-accelerated snapshot or other type of object. The accelerated snapshot or other object may be implemented using an intermediate volume implemented in the other storage system that is populated with data from the snapshot object or the other object stored in the first storage system.

Abstract: A data replication method to diminish an impact caused by frequently starting a snapshot on performance of a primary storage array and a system host, where the method includes obtaining differential data information corresponding to differential data, where the differential data information includes a storage address of the differential data, and a determining value of the differential data, replicating the differential data from the primary volume to the secondary volume according to the storage address of the differential data that is located in the primary volume when the determining value is not less than a preset threshold, and taking a snapshot for the primary volume when the determining value is less than the preset threshold and replicating the differential data to the secondary volume.

Abstract: A data management device includes a persistent storage and a processor. The persistent storage includes meta-data of data stored in a long term retention (LTR) storage. The processor obtains a file storage request for a file and deduplicates the file against segments stored in the LTR storage while performing garbage collection on the LTR storage. Performing garbage collection includes deleting segments of the data stored in the LTR storage using the meta-data. The meta-data is not stored in the LTR storage.

Abstract: The Source Volume Backup with Predictive and Lookahead Optimizations Apparatuses, Methods and Systems (“SVBAF”) transforms backup request inputs via SVBAF components into backup response outputs. A set of blocks to be copied from a source volume to a target volume is designated based on predictive optimization settings and copied based on lookahead optimization settings while an operating system is configured to write to the source volume. Blocks of the source volume that were written to by the operating system are identified. A determination is made whether to enter a CoW mode. If the CoW mode should not be entered, the designated set of blocks is changed to include at least one of the identified blocks and a pass is repeated. Otherwise, the operating system is instructed to enter the CoW mode and bring the target volume into a state consistent with a state of the source volume.

Abstract: A drive-to-drive data transfer may be performed by means of a host configuring registers in a source device and a sink device and triggering a transfer. Data copy logic of controllers of the source and sink devices may then proceed to perform the endpoint to endpoint transfer, for example, using transaction layer packets (TLPs).

Abstract: Region summaries of database data are stored in persistent memory of a storage cell. Because the region summaries are stored in persistent memory, when a storage cell is powered off and data in volatile memory is not retained, region summaries are nevertheless preserved in persistent memory. When the storage cell comes online, the region summaries already exist and may be used without the delay attendant to regenerating the region summaries stored in volatile memory.

Abstract: Methods and apparatuses may be provided, where data is written to a first region of memory on a first memory appliance in response to a write operation, the first region of memory is external memory to the client device, and the first region of memory is accessible by the client device over a network via client-side memory access in which a first communication interface of the first memory appliance is configured to access the first region of memory on the first memory appliance; and where the data of the write operation is caused to be written to a second region of memory on a second memory appliance, and wherein the data of the write operation is recoverable from a subset of the memory regions, the subset excluding the first region of memory or the second region of memory.

Abstract: Tiering duplicated objects in a cloud-based object store, including: determining, for a particular data object, a number of copies of the data object to be retained; storing, in a first data tier, at least one copy of the data object; storing, in a second data tier, one or more copies of the data object, wherein a number of copies of the data object that are stored in the second data tier is equal to the number of copies of the data object to be retained minus a number of copies of the data object that are stored in the first data tier; and responsive to receiving a request for the data object, servicing the request from the first data tier.

Abstract: Provided are techniques for cloud based store and restore with copy services. A store command to transfer data from one or more tracks of a volume to cloud storage is received. With track services, data for the one or more tracks in the volume is retrieved by emulating a host read. With a cloud data movement engine, the data for the one or more tracks is converted to data for one or more objects. With the cloud data movement engine, the one or more objects are stored in the cloud storage.