Abstract: A processing device obtains a write operation which comprises first data and second data to be stored in first and second strips of a given stripe. The processing device stores the first data in the first strip and determines that the second strip is unavailable. The processing device determines a parity based on the first data and the second data and stores the parity in a parity strip. The processing device updates metadata to indicate that the second data was not stored in the second strip. In some embodiments, the updated metadata is non-persistent and the processing device may be further configured to rebuild the given stripe, update persistent metadata corresponding to a sector of stripes including the given stripe and clear the non-persistent metadata based at least in part on a completion of the rebuild.

Abstract: A storage control system is configured to obtain measurement information comprising an indication of an amount of utilization of a hardware resource of a first server node by a plurality of processing groups and to determine that the amount of utilization of the hardware resource is above a threshold amount of utilization. The at least one processor is further configured to select a given processing group for redistribution based at least in part on the determination that the amount of utilization of the hardware resource is above the threshold amount and on an amount of utilization of the hardware resource by the given processing group. The at least one processor is further configured to determine that a second server node comprises enough available capacity of the hardware resource and to redistribute the given processing group to the second server node based at least in part on the determination.

Abstract: Techniques are provided for managing host connectivity to a data storage system. A host connectivity management system receives a request from a host system to connect to a data storage system. The data storage system includes storage nodes which include storage volumes, and each storage node includes multiple ports to enable connection to the storage node. The host connectivity management system determines a subset of ports, among all available ports of the storage nodes, to assign to the host system for use by the host system for connecting to the storage nodes of the data storage system to access the storage volumes. The host connectivity management system sends connection information to the host system to enable the host system to connect to the data storage system, wherein the connection information includes port identifiers associated with the subset of ports assigned to the host system.

Abstract: An apparatus comprises a processing device configured to receive a request to create a given storage volume in a storage system, the storage system providing a plurality of storage features. The processing device is also configured to select, for the given storage volume, one of a set of one or more volume tiers, each of the volume tiers specifying whether respective ones of the plurality of storage features provided by the storage system are enabled or disabled for storage volumes associated with that volume tier. The processing device is further configured to create the given storage volume in the storage system, and to associate the selected volume tier with the given storage volume, wherein associating the selected volume tier with the given storage volume comprises enabling or disabling respective ones of the plurality of storage features provided by the storage system as specified by the selected volume tier.

Abstract: Techniques are provided for processing user input/output (I/O) write requests in a fault-tolerant data storage system (e.g., a RAID storage system) by selecting between performing a degraded write operation or a write operation to spare capacity, when the fault-tolerant data storage system is operating in a degraded mode. A method includes receiving a user I/O write request comprising data to be written to a RAID array operating in a degraded mode, and determining whether spare capacity has been allocated for rebuilding missing data of an inaccessible storage device of the RAID array and whether a missing data block, which is associated with I/O write request, has been rebuilt to the spare capacity. A degraded write operation is performed without using the spare capacity, when the missing data block, which is associated with the data of the I/O write request, has not been rebuilt to the allocated spare capacity.

Abstract: Techniques are provided for managing the utilization of shared memory resources among a plurality of asynchronous replication workloads. A data replication system maintains a respective replication journal for each replication workload in an allocated portion of system memory of a source server node. Each replication journal is divided into journal barrier intervals by respective individual barriers for transmission to a destination server node. The data replication system waits for a triggering event to occur for generating a common barrier, wherein the triggering event is configured to prevent exhaustion of the allocated portion of system memory for storing the replication journals. The common barrier is generated to close the replication journals of some or all of the replication workloads in advance of the respective individual barriers associated, and the replication journals closed by the common barrier are transmitted to the destination server node.

Abstract: Techniques are provided for managing the utilization of shared memory resources among a plurality of asynchronous replication workloads. A data replication system maintains a respective replication journal for each replication workload in an allocated portion of system memory of a source server node. Each replication journal is divided into journal barrier intervals by respective individual barriers for transmission to a destination server node. The data replication system waits for a triggering event to occur for generating a common barrier, wherein the triggering event is configured to prevent exhaustion of the allocated portion of system memory for storing the replication journals. The common barrier is generated to close the replication journals of some or all of the replication workloads in advance of the respective individual barriers associated, and the replication journals closed by the common barrier are transmitted to the destination server node.

Abstract: Techniques are provided for processing user input/output (I/O) write requests in a fault-tolerant data storage system (e.g., a RAID storage system) by selecting between performing a degraded write operation or a write operation to spare capacity, when the fault-tolerant data storage system is operating in a degraded mode. A method includes receiving a user I/O write request comprising data to be written to a RAID array operating in a degraded mode, and determining whether spare capacity has been allocated for rebuilding missing data of an inaccessible storage device of the RAID array and whether a missing data block, which is associated with I/O write request, has been rebuilt to the spare capacity. A degraded write operation is performed without using the spare capacity, when the missing data block, which is associated with the data of the I/O write request, has not been rebuilt to the allocated spare capacity.

Abstract: A method for accessing data where the method includes receiving, by an access client executing in user space, a request to read data that includes a file system identifier and an offset, identifying a storage server associated with the data, generating a command to copy the data to memory, and sending the command to the storage server.

Abstract: A storage system is configured to establish a redundant array of independent disks (RAID) arrangement comprising a plurality of stripes each having multiple portions distributed across multiple storage devices. The storage system is also configured to detect a failure of at least one of the storage devices, and responsive to the detected failure, to determine for each of two or more remaining ones of the storage devices a number of stripe portions, stored on that storage device, that are part of stripes impacted by the detected failure. The storage system is further configured to prioritize a particular one of the remaining storage devices for rebuilding of its stripe portions that are part of the impacted stripes, based at least in part on the determined numbers of stripe portions. The storage system illustratively balances the rebuilding of the stripe portions of the impacted stripes across the remaining storage devices.

Abstract: The presently disclosed subject matter includes various inventive aspects, which are directed for enabling execution of garbage collection process in a distributed storage-system.

Abstract: A storage system is configured to establish a redundant array of independent disks (RAID) arrangement comprising a plurality of stripes each having multiple portions distributed across multiple storage devices. The storage system is also configured to detect a failure of at least one of the storage devices, and responsive to the detected failure, to determine for each of two or more remaining ones of the storage devices a number of stripe portions, stored on that storage device, that are part of stripes impacted by the detected failure. The storage system is further configured to prioritize a particular one of the remaining storage devices for rebuilding of its stripe portions that are part of the impacted stripes, based at least in part on the determined numbers of stripe portions. The storage system illustratively balances the rebuilding of the stripe portions of the impacted stripes across the remaining storage devices.

Abstract: An apparatus comprises a storage system comprising a plurality of storage nodes each comprising one or more storage devices. Each of the storage nodes further comprises a network protocol target configured to receive delivery of input-output (IO) operations from a network protocol initiator of a host device, a data server configured to execute the IO operations on a given storage node, and a data client configured to communicate the IO operations to at least one of the data server on the given storage node and one or more data servers corresponding to one or more additional ones of the plurality of storage nodes. The data client has knowledge of a distribution of data across the plurality of storage nodes.

Abstract: A system for finding differences between a given block in two periodical snapshots. Data indicative of a coarse grain data structure corresponding to the given logical unit and including a plurality of entries wherein each entry is representative of a write or no-write operation to a respective memory chunk of in the logical unit. Data indicative of at least one bloom filter, each bloom filter includes a plurality of bits wherein each group of bits is representative of a probable false positive write indication or no-write operation to a block in the chunk. In response to a request to compare between a given block in at least two periodic snapshots: an older snapshotj and a younger snapshotk, perform: with respect to the block in a chunk, test in a selected bloom filter if the corresponding group of bits is representative of a false positive, and provide “possible snapshots difference” indication.

Abstract: The presently disclosed subject matter includes various inventive aspects, which are directed for enabling execution of deduplication during data writes in a distributed storage-system.

Abstract: Systems, methods, and circuitry for performing distributed speech processing are provided. In one example voice activation circuitry is configured to receive audio data detected by a gateway that is connected to a plurality of devices and recognize a key phrase based on the audio data. In response to recognizing the key phrase, the voice activation circuitry is configured to store the audio data in memory located in the gateway and provide the stored audio data to a selected device in the plurality of devices for speech processing.

Abstract: The presently disclosed subject matter includes various inventive aspects, which are directed for enabling execution of garbage collection process in a distributed storage-system.

Abstract: The presently disclosed subject matter includes various inventive aspects, which are directed for enabling execution of deduplication during data writes in a distributed storage-system.

Abstract: According to an aspect of the presently disclosed subject matter, there is provided a system for managing data in a storage system, the system including a storage layer which provides storage resource, and a snapshot layer that includes: a volume-version data structure, a chunk-version data structure and a IO handler.

Abstract: A IO handler receives a write command including write data that is associated with a LBA. The IO handler reserves a deduplication ID according to the LBA with which the write data is associated, within the scope of each LBA, each deduplication ID is unique. The IO handler computes a hash value for the write data. In case a deduplication database does not include an entry which is associated with the hash value, the IO handler: provides a reference key which is a combination of the LBA and the deduplication ID; adds to the deduplication database an entry which is uniquely associated with the hash value and references the reference key; and adds to a virtual address database an entry, including: the reference key; a reference indicator indicating if there is an entry that is associated with the present entry; and a pointer to where the write data is stored.