Abstract: Systems and methods for performing data protection operations including garbage collection operations and copy forward operations. For deduplicated data stored in a cloud-based storage or in a cloud tier that stores containers containing dead and live segments, the dead segments are deleted by copying live segments into new containers and then deleting the old containers. The copy forward is based on a recipe from a data protection system and is performed using a microservices that can be run as needed in the cloud.

Abstract: One example method includes collecting container information concerning a container, analyzing the container information to identify a security tool needed to perform a vulnerability scan of the container, accessing the security tool from a knowledge lake, running the security tool on the container information to identify a security vulnerability of the container, based on the running of the security tool, generating an alert indicating that the container has the security vulnerability, capturing the security vulnerability and, based on the captured security vulnerability, updating a container image that was used to spawn the container.

Abstract: A method of performing a full data reconstruction in a redundant array of independent disks (RAID) system with a protection pool of storage units includes determining that a physical disk of a storage cluster has been removed from service. The physical disk includes a set of physical extents and at least one physical extent of the set of physical extents is associated with an array of physical extents distributed across physical disks of the storage cluster. The method further includes transmitting a message to one or more array groups of the physical disks, to allocate replacement physical extents and assign the replacement physical extents to the array of physical extents and initiating reconstruction of data from the set of physical extents of the physical disk to the replacement physical extents.

Abstract: A method in one embodiment includes receiving, at an edge device, new data for training a model, the edge device having stored distilled data used to represent historical data to train the model, the historical data being stored in a remote device, and the amount of the historical data being greater than the amount of the distilled data. The method further includes training the model based on the new data and the distilled data. With the data processing solution of this embodiment, the model can be trained at the edge device with fewer storage resources based on the distilled data, thereby achieving higher model accuracy.

Abstract: Techniques for rebuilding space accounting counters in mapping layers of storage appliances. The techniques include uniquely associating top levels of a mapping layer of a storage appliance with respective storage objects. The techniques further include determining amounts of logical storage space consumed by the respective storage objects from mappings of LBAs of the respective storage objects to virtual blocks of a virtual layer of the storage appliance. The techniques further include determining amounts of physical storage space consumed by the respective storage objects from logged information pertaining to each leaf pointer of a leaf level of the mapping layer that points to a virtual block in the virtual layer, each virtual block being mapped to a physical block in a physical layer of the storage appliance. The techniques further include using multi-threading to determine amounts of logical storage space consumed by dynamically adjustable ranges of the respective storage objects.

Abstract: Described is a system that provides for granular and customized upgrades of sub-systems deployed within a third-part system. The system generates an upgrade manager service for implementation of a first sub-system upgrade package from within a third-party system that hosts the first sub-system. The system generates the first sub-system upgrade package according to a compatibility with a first sub-system version currently deployed in the third-party system to update the first sub-system with a feature(s) available in an upgraded version of the first sub-system. The system sends the upgrade manager service to the third-party system. The system receives a first request for the first sub-system upgrade package from the upgrade manager service running in the third-party system. The system sends the first sub-system upgrade package for implementation at the first sub-system by the upgrade manager service running in the third-party system.

Abstract: One example method includes maintaining a deduplication data structure including one or more entries that each identify a respective fingerprint, and pointer, and also maintaining a ClientBlockList data structure comprising one or more entries that each identify a respective handle, retention date, and block, receiving a write request that identifies a handle, retention date, and block, computing a fingerprint of the block identified in the write request, determining, by the server, whether the fingerprint is in the deduplication data structure, and when the fingerprint is not in the deduplication data structure, storing the block identified in the write request at location ‘L’ in the deduplication data structure, and adding, to the deduplication data structure, an entry that identifies the fingerprint and the location ‘L,’ and adding, to the ClientBlockList data structure, an entry that identifies the handle, retention date, and fingerprint.

Abstract: A method of generating a hybrid snapshot includes receiving a request to generate a snapshot of a distributed file system and identifying a first storage resource of the distributed file system and a second storage resource of the distributed file system based on the request. The method further includes generating the snapshot of the distributed file system, the snapshot including a data-full snapshot of the first storage resource and a data-less snapshot of the second storage resource.

Abstract: Techniques described herein relate to a method for resource allocation using fingerprint representations of telemetry data. The method may include receiving, at a resource allocation device, a request to execute a workload; obtaining, by the resource allocation device, telemetry data associated with the workload; identifying, by the resource allocation device, a breakpoint based on the telemetry data; identifying, by the resource allocation device, a workload segment using the breakpoint; generating, by the resource allocation device, a fingerprint representation using the workload segment; performing, by the resource allocation device, a search in a fingerprint catalog using the fingerprint representation to identify a similar fingerprint; obtaining, by the resource allocation device, a resource allocation policy associated with the similar fingerprint; and performing, by the resource allocation device, a resource policy application action based on the resource allocation policy.

Abstract: A method includes retrieving, with a masker controller job, an object and an associated object ID from a masking bucket that is defined in storage, making a copy of the object, with a masker worker microservice, masking the copy of the object to create a masked object, transmitting the masked object to an object access microservice, with the object access microservice, transmitting the masked object to a deduplication microservice, with the deduplication microservice, deduplicating the masked object, and storing the masked object in the storage.

Abstract: Embodiments of the present disclosure provide a method, an electronic device, and a computer program product for information processing. In an information processing method, based on multiple weights corresponding to multiple words in text, a computing device determines a target object associated with the text among predetermined multiple objects, and also determines, among the multiple words, a set of key words with respect to the determination of the target object. Next, the computing device determines, among the set of key words, a set of target words related to a text topic of the text. Then, the computing device outputs the set of target words and an identifier of the target object in an associated manner. In this way, the credibility of the target object associated with the text that is determined by the information processing method is improved, thereby improving the user experience of the information processing method.

Abstract: One example method includes receiving, at an IO journal, a new entry that identifies a respective disk location L, and data X written at that disk location L, and determining whether a location specified in an oldest entry of the IO journal is specified in any other entries in the IO journal. When the location specified in the oldest entry is not specified in any other entries in the IO journal, adding the new entry to the IO journal, and augmenting the new entry with undo data. Or, when the location specified in the oldest entry is specified in at least one other entry in the IO journal, setting data specified in the oldest entry as undo data for the next entry that identifies that location, and adding the new entry to the IO journal, and deleting the oldest entry from the IO journal.

Abstract: A system can identify a file comprising computer-executable instructions, wherein the file has been modified since the file was last transformed into a computer-executable program on which a group of tests was performed. The system can, for respective tests, determine respective line coverage ratios, respective function coverage ratios, and respective branch coverage ratios. The system can select an updated group of tests from the group of tests based on the respective line ratios, the respective function ratios, and the respective branch ratios, the updated group of tests comprising a subgroup of the group of tests. The system can create an updated computer-executable program from the file. The system can test the updated computer-executable program with the updated group of tests.

Abstract: A method, computer program product, and computer system for copying, at a new node, reservation metadata volumes of an old node. While a software upgrade is in progress, volume reservation command processing may be enabled on both the new node and the old node when copying is complete. Separate logic may be run to process a volume reservation command of the volume reservation command processing. The old node may be switched to a primary mode, wherein the new node may be switched to a secondary mode to synchronize volume reservation metadata with a primary copy. When the software upgrade is complete, the new node may be switched to a single mode to use only a volume reservation database of the new node.

Abstract: One example method includes receiving, by a backup appliance, a request concerning a dataset, performing, by the backup appliance, an inquiry to determine if end-to-end encryption is enabled for a volume of a target storage array, receiving, by the backup appliance, confirmation from the storage array that end-to-end encryption is enabled for the volume, and based on the confirmation that end-to-end encryption is enabled for the volume, storing the dataset in the volume without performing encryption, compression, or deduplication, of the dataset prior to storage of the dataset in the volume.

Abstract: Embodiments of the present disclosure provide a method, device and computer program product for managing backup data. The method comprising: obtaining historical information of a plurality of historical operations on target data in a backup storage device during a first time period, the historical information indicating at least types and time of occurrences of the plurality of historical operations; determining, based on the historical information, whether the target data is to be rewritten to the backup storage device within a second time period after the first time period; and in response to determining that the target data is to be written to the backup storage device within the second time period, adjusting an expiration time of the target data in the backup storage device. Based on such a manner, efficiency of the backup system can be increased.

Abstract: Techniques are provided for implementing storage block balancing using volume part migration. One method comprises obtaining a capacity utilization of storage blocks each storing a portion of one or more storage volumes; and when the capacity utilization of a given storage block is above an upper target threshold, migrating a volume part of the given storage block to a different storage block having a capacity utilization below a lower target threshold, wherein the different storage block is within a same storage pool as the given storage block, and wherein the volume part comprises a subset of a storage volume.

Abstract: Techniques are provided for multi-tenant data protection using tenant-based token validation and data encryption. One method comprises obtaining, from a user, a data record to be stored in a multi-tenant storage environment and a token associated with the user. Each data record identifies a tenant associated with the respective data record and the user is authorized to access tenant data of at least one tenant identified in the token. An encryption key of the tenant associated with the data record is obtained and the data record is encrypted using the obtained encryption key and stored. A given data record may be read by obtaining a decryption key of the tenant associated with the given data record and decrypting the given data record using the decryption key. The token may be used to evaluate whether the user is authorized to access the tenant data of the tenant associated with the given data record.

Abstract: Disclosed are techniques for compressing data in a data storage system comprising searching a cluster of nearest neighbors, wherein the cluster has been created using a locality sensitive hashing algorithm, to determine if a data block can be compressed. In alternate embodiments, nearest neighbor clusters can be formed using unsupervised learning. Additionally, nearest neighbors can also be formed in alternate embodiments using one or more of the following algorithms: a k-means clustering algorithm, a k-medoids clustering algorithm, a mean shift algorithm, a generalized method of moment (GMM) algorithm, or a density based spatial clustering of applications with noise (DBSCAN) algorithm.

Abstract: Source file copying is described. An access object service receives a request to copy a file to a destination and identifies a similarity group identifier for a group of fingerprints corresponding to sequential segments in the file. The access object service communicates a request for the group of fingerprints to a deduplication service associated with a range of similarity group identifiers that include the similarity group identifier. The deduplication service communicates the group of fingerprints, retrieved from fingerprint storage, to the access object service, which communicates the group of fingerprints and the similarity group identifier to the destination.