Abstract: A method for storing progress data while replicating a snapshot is disclosed. The operations comprise: determining blocks in a storage object that are different between a first and a second snapshots, wherein the first snapshot corresponds to a first tree structure, and the second snapshot corresponds to a second tree structure; and replicating the second snapshot to a remote storage system, comprising replicating all the blocks in the storage object determined to be different between the first and the second snapshots, wherein the replicating further comprises: upon completion of replication of each data slice, determining nodes in the first tree structure that reference only already-replicated blocks; orphaning all such nodes in the first tree structure; and subsequently, updating the first tree structure, comprising merging the first tree structure and the second tree structure, wherein the first tree structure is updated upon completion of replication of each data slice.

Abstract: In an example, an apparatus comprises a plurality of execution units, and a first memory communicatively couple to the plurality of execution units, wherein the first shared memory is shared by the plurality of execution units and a copy engine to copy context state data from at least a first of the plurality of execution units to the first shared memory. Other embodiments are also disclosed and claimed.

Abstract: Techniques are provided for object store mirroring. Data within a storage tier of a node may be determined as being data to tier out to a primary object store based upon a property of the data. A first object is generated to comprise the data. A second object is generated to comprise the data. The first object is transmitted to the primary data store for storage in parallel with the second object being transmitted to a mirror object store for storage. Tiering of the data is designated as successful once acknowledgements are received from both the primary object that the first object was stored and the mirror object store that the second object was stored.

Abstract: System and method for improved transferring of data involving memory device systems. A memory appliance (MA) comprising a plurality of memory modules is configured to store data within the plurality of memory modules and further configured to receive data commands from the first server and a second server coupled to the MA. The data commands may include direction memory access commands such that the MA can service the data commands while bypassing a host controller of the MA.

Abstract: Embodiments of the invention include method, systems and computer program products for servicing indirect storage requests. Method includes decoding a storage request instruction and sending to a first one of a plurality of memory controllers an address represented by a first pointer associated with at least a portion of the storage request instruction. A first memory is used to read information associated with a second pointer contained at the address. The first memory forwards the storage request instruction to a second one of the plurality of memory controllers, wherein the second one of the plurality of memory controllers is associated with and/or manages a memory location represented by the second pointer. The second one of the plurality of memory controllers reads and forwards data associated with the storage request instruction to a processor using the second pointer. The processor writes the forwarded data in a destination register of the processor.

Abstract: In one aspect, a data item is written to a data chunk of a stream segment. The stream segment includes a stream segment header and a plurality of data chunks. A first identifier of the data item is written to the stream segment header of the stream segment. A second identifier of the data item is written to a header of the data chunk of the stream segment. In another aspect, a stream segment header of a stream segment is queried with a query identifier. The querying identifies if any of the data items in the data chunks of the stream segment have the query identifier. If any of the data items in the data chunks of the stream segment have the query identifier, the data chunks of the stream segment are queried with the query identifier to identify which data chunks of the stream segment have the query identifier.

Abstract: In some examples, a method for operating a data management system comprises acquiring a first full image snapshot and a set of incremental files corresponding with different point in time versions of a virtual machine. The method detects that a combined data size for expired snapshots within an archival data source has exceeded a threshold data size in response to detecting that the archival data source does not have access to compute resources. The method determines that a second full image snapshot should be transferred to the archival data source in response to detecting that the combined data size for the expired snapshots within the archival data source has exceeded the threshold data size. A second full image snapshot is generated using the first full image snapshot and one or more of the incremental files and transferred to the archival data source.

Abstract: To select a storage device suitable for storing data necessary for operation of an application in a system accompanying a dynamic configuration change. A computer system includes: a device configured to execute a processing in accordance with an application; a storage device configured to store application data for operating the application; and a control system, in which the control system is configured to specify the storage device which is operating from the present and at the time of changing a configuration of the computer system based on configuration change schedule information for managing a change schedule of the configuration of the computer system, select the storage device to store the application data from the specified storage device, and arrange the application data in the selected storage device before the configuration of the computer system is changed.

Abstract: A method comprises packaging a plurality of mainframe software artifacts into a container image, wherein the plurality of mainframe software artifacts are created via installation of software on a first mainframe system using a mainframe installer configured for a first operating system. The method further comprises running a container, based on the container image, on a container distribution platform that uses a host operating system different from the first operating system; and executing one or more scripts within the container. The one or more scripts are configured to install and configure the packaged plurality of mainframe software artifacts onto a second mainframe system communicatively coupled to the container distribution platform, the second mainframe system running the first operating system.

Abstract: Embodiments of the present disclosure provide a method and device for data duplication cutover. The method includes initiating duplication of initial data from a source device to a destination device, wherein the initial data are data of a file system stored on the source device upon the initiating. The method further includes, in response to completing the duplication of the initial data, updating a session associated with the file system. Furthermore, the method includes, after updating the session, triggering the source device and the destination device into a data unavailable state to perform duplication of delta data from the source device to the destination device, wherein the delta data are data of the file system changed during duplication of the initial data. Utilization of the cutover mechanism proposed in the present disclosure enables effective reduction of data unavailable period of time.

Abstract: One or more techniques and/or computing devices are provided for resilient replication of storage operations. For example, a first storage controller may host first storage having a replication relationship with second storage hosted by a second storage controller. To improve resiliency against transient network issues of a network between the storage controllers, the first storage controller may implement a queue and retry mechanism to retry replication operations not acknowledge back by the second storage controller within a threshold time. The second storage controller may maintain a cumulative sequence number of a latest replication operation performed in order, an operation response map of replication operations performed out of order, and an operation finder map identifying currently implemented replication operations, which may be used to process incoming replication operations. Single write semantics, write order consistency, and reduction of write amplification may be provided.

Abstract: Technology is described for data archiving in a service provider environment. A first archive data package may be received from an archival data store in the service provider environment. The first archive data package may include first data blocks and first key block data. Second data blocks and second key block data may be received from a source data store in the service provider environment. Merged data blocks may be created by combining the first data blocks with the second data blocks. The merged data blocks may be sent to the archival data store while merged key block data is being created. The merged data blocks and the merged key block data may be included in a second archive data package that is stored at the archival data store.

Abstract: Embodiments are described for enabling file level recovery (FLR) process for dynamic disks in a data storage system. A source virtual machine (VM) stores data files after a data backup operation and to be restored to a destination VM using the FLR operations; a copy of the source VM is spawned and has an Instant Recover (IR) execution component performing IR operations. A helper VM is spawned using the IR operation of the source VM copy. A FLR agent installed on each of the source VM copy and the destination VM is configured to identify a disk on the source VM as being a dynamic disk, and to allow the helper VM to act as a file transfer facilitator between the source VM and the destination VM. In this way, dynamic disks on the source VM are distinguished from regular disks even when they has the same UUID.

Abstract: The disclosed technology is generally directed to online chat management services. In one example of the technology, organization information is accessed for tenants. The organization information includes, for each organization, configuration information for the organization. Each organization belongs to a corresponding tenant. Worker service instances are scheduled to perform fills associated with the organizations, such that sufficient fills are performed for each organization according to the configuration information for the organizations in the accessed organization information. Each fill includes: causing artifacts associated with a function to be created, such that the artifacts associated with the function are configured based on the corresponding tenant. Artifact information associated with the created artifacts is received, including at least one unique identifier associated with the created artifacts for the function.

Abstract: A method for resynchronizing data repositories in a high availability storage environment includes maintaining, in a first gateway server, a first journal that records operations that are performed for a first set of objects. The method further maintains, in a second gateway server, a second journal that records operations that are performed for a second set of objects. The method communicates, from the first gateway server to the second gateway server, any operations that are performed by the first gateway server for objects in the second set, so that these operations may be recorded in the second journal. The method further communicates, from the second gateway server to the first gateway server, any operations that are performed by the second gateway server for objects in the first set, so that these operations may be recorded in the first journal. A corresponding system and computer program product are also disclosed.

Abstract: An online system receives impression data from one or more content publishers. The impression data describes impressions provided to users of the online system on behalf of an agent. The online system selects a randomly selected number of impressions in the received impression data. The online system generates an impressions block by encrypting impression data that describes the selected set of impressions using a unique cypher, and adds the impressions block to a blockchain. The online system further generates a cypher block by encrypting the cypher and an identifier of the impressions block to which the cypher applies using a public key provided by the agent to the online system. The online system adds the cypher block to the blockchain. The agent can recover the cypher from the cypher block based on a private key, and the agent can then recover the impression data using the recovered cypher.

Abstract: With a forever incremental snapshot configuration and a typical caching policy (e.g., least recently used), a storage appliance may evict stable data blocks of an older snapshot, perhaps unchanged data blocks of the snapshot baseline. If stable data blocks have been evicted, restore of a recent snapshot will suffer the time penalty of downloading the stable blocks for restoring the recent snapshot. Creating synthetic baseline snapshots and refreshing eviction data of stable data blocks can avoid eviction of stable data blocks and reduce the risk of violating a recovery time objective.

Abstract: Embodiments of the present invention comprise a class sharing orchestrator (CSO) operating as a subsystem of a container orchestrator. The CSO manages sharing of class data among containerized applications to improve startup performance, CPU consumption and memory footprint. The CSO stores application class data in a shared class cache (SCC). The CSO provides a compatible SCC to every deployed application running within the CSO's purview. The CSO collects SCC data from running applications, and processes the data offline to continuously improve the quality of SCCs provided to each deployment, while causing minimum impact to running applications. The CSO combines updates from running applications of a given type to generate an improved quality SCC for use by newly launched applications of the same type. The CSO comprises an SCC update mechanism that optimizes the size, and network traffic, associated with SCC data exchange, and guarantees SCC quality improves over time.

Abstract: A method relates to backing up a VM. The method can include placing an application being hosted by a VM in a backup state and capturing a snapshot of the VM to generate a VM image of the VM. The method can further comprise resuming the application, extracting application blocks corresponding to the application from the mounted VM image, and storing the application blocks and the VM image.

Abstract: Provided are techniques for performing a recovery copy command using a recovery copy data structure for a backup volume lookup. In response to receiving a recovery copy command, a recovery copy data structure is created with indicators for storage locations and a recovery target data structure is created with indicators for storage locations. A read operation is received for a storage location in a cache. Based on a value of an indicator in the recovery copy data structure for the storage location and a value of an indicator in the recovery target data structure for the storage location, the data is staged from one of the production volume, the recovery volume, and a backup volume to the cache.

Abstract: A method includes sending, by a computing device of a dispersed storage network (DSN), an inquiry to storage units of the DSN regarding status of a new vault in the DSN. The new vault is a logical storage container supported by the storage units, and the new vault is defined by vault parameters that include new vault identifier, new vault storage capabilities, access privileges, and authorized users. When a threshold number of storage units provide a status response of active and when a data access request for a set of encoded data slices is received, the computing device sends a set of access requests regarding the data access request to the storage units. When the threshold number of storage units do not provide the status response of active, the computing device facilitates activation of the new vault in at least the threshold number of storage units.

Abstract: Various systems and methods of tracking database partition change log dependencies are described herein. A system is disclosed herein, according to some embodiments. A change log for a database partition of the plurality of database partitions is stored to a log store. An indication that a split of the database partition into two or more child database partitions has occurred is received. Responsive to the split of the database partition, the change log is split into two or more corresponding child change logs. A portion of the change log is deleted responsive to a determination that a respective complete snapshot is stored for each child database partition corresponding to a child change log of the change log and a determination that a retention window for the portion of the change log has passed.

Abstract: Some examples relate generally to a data management platform comprising a storage device configured to store secondary data and one or more processors in communication with the storage device and configured to perform certain operations. The operations may include identifying an aspect of the secondary data stored in the storage device, the secondary data including a backup of respective primary data stored in a primary data source; identifying or receiving an indication of a target to receive data associated with the identified aspect of the secondary data; transmitting the data associated with the aspect of the secondary data to the target as a push transmission; and performing data management operations related to the secondary data subsequent to the push transmission.

Abstract: A method, computer system, and a computer program product for recasting repetitive messages is provided. Embodiments may include receiving, by a processor, a message. Embodiments may include determining, by the processor, whether the received message is repetitive. Embodiments may include rating, by the processor, an importance level of the received message. Embodiments may include determining a preference for recasting the received message.

Abstract: A secondary location is configured as a recovery service for a primary location of the service. The secondary location is maintained in a warm state that is configured to replace the primary location in a case of a failover. During normal operation, the secondary location is automatically updated to reflect a current state of the primary location that is actively servicing user load. Content changes to the primary location are automatically reflected to the secondary location. System changes applied to the primary location are automatically applied to the secondary location. For example, removing/adding machines, updating machine/role assignments, removing adding/database are automatically applied to the secondary location such that the secondary location substantially mirrors the primary location. After a failover to the secondary location, the secondary location becomes the primary location and begins to actively service the user load.

Abstract: In embodiments, the ability to have two separate Db2 Mirror pair environments, each providing HA, which have the capability to switch application spaces between the Db2 Mirror pairs, is presented. At least one IASP is registered to a first node of a first pair of nodes at a first HA mirroring environment at a first location. The at least one IASP is replicated to a second HA mirroring environment, the second HA mirroring environment including a second pair of nodes at a second location, the second location different than the first location. The at least one IASP is registered with one node of the pair of nodes of the second mirroring environment, the at least one IASP is switched offline at the first pair of nodes of the first mirroring environment, and subsequently switched online at the second pair of nodes of the second mirroring environment.

Abstract: A determination is made that a point-in-time copy of a consistency group of a production volume has to be stored in a backup storage that is configured to store a plurality of point-in-time copies generated at a plurality of time instants. An extent of a thin provisioned volume of a highest storage tier of a tiered storage is allocated to store the point-in-time copy of the consistency group. A process is initiated for storing the point-in-time copy of the consistency group to the extent of the highest storage tier of the tiered storage.

Abstract: Generating any point in time backups without native snapshot generation. Production data is split such that a journal stream is sent to a data protection system, which may be local or remote. The journal stream includes a data stream and a metadata stream. Backups are synthesized at the data protection system by rolling at least a portion of the journal. A backup for any point in time represented in the journal can be synthesized.

Abstract: To reduce the time, cost, and computational resources associated with writing to and reading from a non-volatile memory device multiple times, log data is stored in volatile memory of a computing device. The host device includes a file system that receives the log data from an application when the application sends an instruction to write the log data to the file system. Once the log data is stored in volatile memory, device data indicative of the rate at which log data is received by and transmitted from the computing device, and an amount of unused memory or other computational resources of the computing device, may be used to determine which services are permitted to access the log data, and whether to provide access to all of the log data or only a portion of the log data based on a sampling rate.

Abstract: VM data migration between storage devices is disclosed. In an embodiment, a method of VM data migration includes determining snapshot data and live data corresponding to the VM based on a request to migrate a VM from a source device to a destination device. The method migrates the snapshot data from the source device to the destination device including by setting up a migration path and creating a migration configuration in the source device. The method requests a hypervisor to migrate the live data from the source device to the destination device. The method removes the migration path, the migration configuration, and snapshot data from the source device.

Abstract: A method for restricting write cycles to a storage device includes tracking a first count of a first set of writes to memory executed by a first subsystem of a computing device and, further, determining that the first count meets a write threshold of the first subsystem. The method includes determining that blocking criteria are met by the first subsystem based on the first count exceeding the write threshold of the first subsystem and, further, determining that blocking criteria are not met by a second subsystem of the computing device. The method includes blocking the first set of writes from being synchronized to the storage device, based on the blocking criteria being met by the first subsystem, and synchronizing memory contents of the second subsystem to the storage device, based on the blocking criteria not being met by the second subsystem.

Abstract: A method for updating storage resources in a dispersed storage network operates to determine a storage utilization factor for a storage pool that includes a set of storage resources when old storage resources are being reallocated to new storage resources. The method continues by denying write type requests during reallocation when the storage utilization factor is at or above a threshold and processing write type requests when the storage utilization factor is at or below the threshold. When the reallocation is complete the storage utilization factor is recalculated.

Abstract: Data placement and recovery technology for individually controlling a storage device includes a data management method that may achieve a power saving effect by distributing files between a portion of storage devices, for example, between storage devices included in a higher group and by limiting dependence according to a change in a state of the storage devices to be applied to a portion of storage devices to which a file distribution is performed.

Abstract: A dataset's uniqueness level may be calculated by analyzing a dataset to determine a uniqueness level. In cases where the uniqueness level may be too low for a particular purpose, meaning when the dataset may not provide enough anonymity, the dataset may be adjusted by recomputing the dataset with different resolutions of spatial data, temporal data, content data, and relationship data. By adjusting the resolution or accuracy of the data elements, the uniqueness level may thereby be adjusted. An error calculation may be determined by comparing the adjusted dataset to the original data, and the error value may represent the consistency of the data to the original data. The uniqueness level may be used as an assurance level of anonymity, which may be advertised when a dataset is sold or transferred to a third party for analysis.

Abstract: Aspects of the present disclosure involve systems, methods, computer program products, and the like, for providing failover and load clustering features to one or more proxy servers of a content delivery network (CDN). In one embodiment, one or more proxy servers may announce a virtual host internet protocol (IP) and, to provide a failover feature, two or more of the proxy servers may also announce a more generic virtual network IP address that includes a broader range of IP addresses associated with the virtual network IP address. In another embodiment, each of the proxy servers in communication with the router may announce a generic IP network address to the router. In response to receiving a request for content from an end user of the CDN, the router may select a proxy server and load balance the received requests among the proxy servers.

Abstract: Disclosed are a method and an apparatus for accessing tensor data. The method may include determining a first row address in a first memory where one or more first data items to be accessed in a logical structure of the tensor data are stored at the first row address, copying data items at the first row address in the first memory to a first buffer row of a first buffer, moving each first data item in the first buffer row of the first buffer to a corresponding location at least in a first buffer row of a second buffer, and storing data items in the first buffer row of the second buffer into corresponding target locations in the second memory.

Abstract: Adjusting storage capacity in a computing system that includes a computing device configured to send access requests to a storage device characterized by a first storage capacity, including: reducing data; determining, in dependence upon an amount of storage capacity saved by reducing the data, an updated storage capacity for the storage device; and exporting an updated storage capacity to the computing device.

Abstract: Systems and methods which provide for managing multiple mirror resources in a storage distribution network are provided. In some embodiments, a system provides for both high availability and disaster recovery functionality at different mirroring locations. Other embodiments may provide for multiple high availability and/or multiple disaster recovery mirror resources. These mirror resources are operated in a heterogeneous manner in the sense that each have its own transport, protocol, and the like, but are configured function cooperatively or as a single mirror with respect to mirroring a primary node. Embodiments may provide for the mirroring and resynchronization of mirrored resources in the event of a communication loss with a particular resource without ceasing the mirroring operations to other resources.

Abstract: Recovery of an in-memory database is initiated. Thereafter, pages for recovery having a size equal to or below a pre-defined threshold are copied to a superblock. For each copied page, encryption information is added to a superblock control block for the superblock. The copied pages are encrypted within the superblock using the corresponding encryption information added to the super block control block. The superblock is then flushed from memory (e.g., main memory, etc.) of the database to physical persistence.

Abstract: Systems and methods for using snapshots to establish operable portions of computing entities on secondary sites for use on the secondary sites before the computing entity is fully transferred to the secondary site. Embodiments commence upon initiating replication of an entity from an originating site to a secondary site. While replication of the entire entity from the originating site to the secondary site is being carried out, the originating site transfers entity metadata to the secondary site. A non-replication user process queries the metadata to determine completion status and/or other characteristics of subcomponents of the entity. After determining the completion status of subcomponents of the entity, the non-replication user process operates on subcomponent data of the entity even before the data of the entity has been completely copied to the secondary site. The subcomponents may comprise certain tables of a database or certain rows of a table of a database.

Abstract: Embodiments of the present disclosure provide a method, and apparatus and a computer readable medium for controlling a storage system. For example, a method for controlling a storage system is provided. The method comprises: determining a control factor related to a background operation in the storage system, the control factor including a usage state of a storage resource pool in the storage system; setting a priority level for the background operation based on the determined control factor; and controlling execution of the background operation based on the set priority level. Embodiments of the present disclosure may accelerate execution of background operations, improve resource utilization efficiency, and ensure good I/O performance.

Abstract: Provided are a computer program product, system, and method to transfer track format information for tracks in cache at a primary storage system to a secondary storage system to which tracks are mirrored to use after a failover or failback. In response to a failover from the primary storage system to the secondary storage system, the primary storage system adds a track identifier of the track and track format information indicating a layout of data in the track, indicated in track metadata for the track in the primary storage, to a cache transfer list. The primary storage system transfers the cache transfer list to the secondary storage system to use the track format information in the cache transfer list for a track staged into the secondary cache having a track identifier in the cache transfer list.

Abstract: Disclosed is a method, apparatus, and system for dynamically changing a backup policy, the operations comprising: automatically detecting a change in a backup source system; automatically activating a new backup policy, wherein the new backup policy is determined based on the change in the backup source system and an old backup policy; and performing a backup session based on the new backup policy.

Abstract: The present disclosure is directed to a novel system for active and passive management of location-based copy data. The system may intake user data from various data sources into a rules engine, which contains the decision logic to format the incoming data according to location-dependent rules. The system may continuously index the incoming data as well as metadata (e.g., data source, data storage location, rules associated with the data, or the like). Based on the output of the rules engine and/or index engine, an action engine may execute various processing steps to condition the data for storage in a particular system. Furthermore, the system may use passive and continuous rule updates with the process as described herein to automatically update the stored user data to conform to the new rules.

Abstract: Techniques for managing snapshots of a storage object in a data storage system based on the data churn delta between the latest snapshot and the current data of the storage object. The techniques include, having specified minimum and maximum data loss tolerances for a parent object, creating successive snapshots of the parent object, each snapshot being created at a scheduled time interval or a time when the minimum data loss tolerance has been reached/exceeded. The techniques include obtaining the total data churn between the latest snapshot and the parent data, and determining whether the total data churn has reached or exceeded the maximum data loss tolerance. The techniques include, having determined that the total data churn has reached or exceeded the maximum data loss tolerance, retaining only those snapshots that have not exceeded the maximum data loss tolerance, and discarding all snapshots that have exceeded the maximum data loss tolerance.

Abstract: A system includes an environment-aware storage drive comprising one or more storage medium with a location-based service wherein the environment-aware storage drive generates a signal containing information about a location of the storage drive relative to a geo-fenced area and updates a ledger unit of an event happening to the storage drive based on the signal, wherein the event is related to the current environment of the storage drive. The ledger unit keeps track of a number of events and/or data received from the environment-aware storage drive. A policy unit determines an expandable set of security policies for the storage drive triggered by the event and/or data, wherein the security policies specify access restrictions to the environment-aware storage drive based on its current environment. The policy unit transmits and enforces the set of security policies on the environment-aware storage drive to prevent data from being theft from the storage drive.

Abstract: A computer program product, according to one embodiment, is for managing point in time copies of data in object storage. The computer program product includes a computer readable storage medium having program instructions embodied therewith. Moreover, the program instructions executable by a processor to cause the processor to: create, by the processor, point in time copies of data, and send, by the processor, the point in time copies of the data to an object storage system. A directive for manipulating the point in time copies of the data is also sent by the processor to the object storage system.

Abstract: Examples described herein relate to apparatuses and methods for a Content Distribution Network (CDN) node of a CDN to facilitate communication among two or more clients, including but not limited to determining, by the CDN node, that the two or more clients are connected to the CDN node for accessing content data originating from an origin server, receiving, by the CDN node, a message from a first client of the two or more clients, the message is to be routed to at least one second client of the two or more clients, and sending, by the CDN node, the message to the at least one second client without routing the message to the origin server.

Abstract: An embodiment of a semiconductor apparatus may include technology to selectively determine a set of data for background refresh based at least in part on host-provided information, and refresh the determined set of data on a persistent storage media as a background operation. Other embodiments are disclosed and claimed.

Abstract: Data protection using change-based measurements in block-based backup is disclosed. Block change information indicating an extent of change associated with a volume may be determined. The block change information may be based at least in part on stored information indicating monitored changes to blocks in the volume. A backup operation may be initiated based at least in part on the determined block change information.