Abstract: An indirection mapping data structure can maintain a mapping between logical block addresses used by a host computer and physical data storage locations on a solid state drive. Changes to the indirection mapping data structure can be stored in journals. When a journal is full, the journal can be stored to a predetermined location on the cluster block determined based on the number of entries stored by the journal, leading to a number of journals scattered throughout the cluster block at predetermined locations. Each physical chunk of media, whether written with data or marked as defective is journaled. Such a journaling scheme, where the journal locations are predetermined and each physical chunk of media is journaled is referred to as physical media-aware spatially coupled journaling. During replay the spatially coupled journals can be retrieved from the predefined locations within cluster blocks and used to rebuild the indirection mapping data structure.

Abstract: An apparatus comprises a storage system comprising at least one processing device and a plurality of storage devices. The at least one processing device is configured to obtain a given input-output operation from a host device and to determine that the given input-output operation comprises an indicator having a particular value. The particular value indicates that the given input-output operation is a repeat of a prior input-output operation. The at least one processing device is further configured to rebuild at least one resource of the storage system that is designated for servicing the given input-output operation based at least in part on the determination that the given input-output operation comprises the indicator having the particular value.

Abstract: A distributed storage places data units and parity units constituting a stripe formed by divided data into storage nodes in a distributed manner. In reference to determination formulas, either a full-stripe parity calculation method or an RPM parity calculation method is selected so as to minimize an amount of network traffic.

Abstract: A peripheral device according to the present invention includes: a memory; and a processor. The processor performs operations. The operations includes: detecting a failure related to the peripheral device and notifying a host device of occurrence of the failure; transmitting the failure information to the host device when failure information relating to the failure is requested by the host device after notifying of the occurrence of the failure, storing the failure information in the memory when there is no request for the failure information from the host device, and reading the failure information from the memory and transmitting the read failure information to the host device when the stored failure information is requested by the host device; and initializing the peripheral device after storing the failure information in the memory when initialization is instructed by the host device.

Abstract: Methods, apparatus, and processor-readable storage media for automatically allocating device resources using machine learning techniques are provided herein. An example computer-implemented method includes determining values for multiple parameters from data obtained from one or more devices; generating at least one device component failure prediction by applying one or more machine learning techniques to at least a portion of the determined values; computing one or more qualifying values attributable to the at least one generated device component failure prediction by providing the at least one generated device component failure prediction to a conformal prediction framework; and automatically allocating one or more resources to at least a portion of the one or more devices based at least in part on the at least one generated device component failure prediction and the one or more computed qualifying values.

Abstract: An information processing apparatus includes: a memory and a processor. The processor, coupled to the memory, is configured to: determine, for each task of a plurality of tasks executed in a distributed stream data processing platform, a log score based on an indication associated with easiness of occurrence of a failure; and output a log message for each task of the plurality of tasks at an output frequency based on a log score of each task and a log score of at least one of an upstream task located upstream of each task and a downstream task located downstream of each task.

Abstract: In an embodiment, a computing system may restore data for a protected system using an emulated block device that presents a synthesized filesystem. Initially, a request to restore data for the protected system may be received. The request may include or otherwise indicate a particular file system format, a particular virtual disk format, and a recovery point representing a particular point in time for presentation of the restored data. Responsive and subsequent to receiving the request to restore the data, the computing system generates a first configuration of the emulated block device for presenting the synthesized filesystem, the first configuration being based on: a) an amount of data in the recovery point, b) the particular file system format, and c) the particular virtual disk format. The computing system also generates a configuration for the synthesized filesystem, and provides access to the emulated block device based on the determined configurations.

Abstract: Described herein, system that facilitates mapping of redundant array of independent nodes of a storage device. According to an embodiment, a system can comprise generating a first configuration of a storage cluster, wherein the storage cluster comprises a group of nodes and a group of disks, generating a second configuration of the storage cluster using the first configuration, wherein the group of nodes are divided into a first pair of nodes comprising a first node having access to a first group of disks and a second node having access to a second group of disks, and generating a third configuration of the storage cluster using the second configuration, wherein the first node comprises a first mapped node that manages the first group of disks of the first node and enables access to the second group of disks of the second node.

Abstract: A system, comprises at least one processor; and a memory coupled to the at least one processor and storing a function-performing module comprising processor-executable instructions which, when executed by the at least one processor, configure the at least one processor to perform a function associated with a data record; and a data corruption detection module comprising processor-executable instructions which, when executed by the at least one processor, configure the at least one processor to determine whether the function performed in association with the data record was performed according to a defined rule; and responsive to determining that the function was not performed according to the defined rule, generate a notification indicating data corruption and identifying the data record.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for resynchronizing data in a storage system. One of the methods includes determining that a particular disk of a capacity object of a storage system was offline for an interval of time, wherein the capacity object comprises a plurality of segments, and wherein the storage system comprises a segment usage table identifying a linked list of particular segments of the capacity object that are in use; determining a time point at which the particular disk went offline; determining one or more first segments of the capacity object that were modified after the time point, wherein determining one or more first segments comprises determining each segment of the segment usage table having a transaction ID that is larger than the time point; and resynchronizing, for each first segment, a portion of the particular disk corresponding to the first segment.

Abstract: A signal processing circuit has: n+1 (n being an integer of 2 or greater) operation circuits, each of which is configured to execute a prescribed operation process on inputted data; a signal supply unit that is configured to receive n pieces of input data extracted from one input signal and receive test data inputted separately from the n pieces of input data, sequentially select one operation circuit among the n+1 operation circuits and supply the test data to the one selected operation circuit, and supply the n pieces of input data to n operation circuits other than the one operation circuit among the n+1 operation circuits; and an anomaly determination unit that is configured to determine whether an anomaly has occurred in the one operation circuit on the basis of an operation result of an operation on the test data by the one operation circuit.

Abstract: A method includes obtaining, by a computing device of a storage network, data for storage and interpreting metadata associated with the data to determine data storage requirements. The method further includes selecting a plurality of storage units of the storage network as target storage units based on the data storage requirements and a storage sequence and transmitting a solicitation message to the target storage units. The method further includes receiving favorable responses from at least some of target storage units, selecting storage units from the at least some of the target storage units to produce a set of selected storage units, determining an error coding dispersal storage function, encoding a data segment of the data in accordance with the error coding dispersal storage function to produce a plurality of encoded data slices, and outputting the plurality of encoded data slices to the set of selected storage units for storage therein.

Abstract: A memory system includes a memory device including plural non-volatile memory cells storing firmware and a controller configured to load the firmware in a volatile memory and employ a plurality of cores, each capable of performing an operation based on the firmware. A core, which is in a standby state or an idle state between the plurality of cores, is configured to check whether an error has occurred in the volatile memory in which the firmware is loaded.

Abstract: A data processing framework suitable for use with data stores is described. The data processing framework identifies which data stores are storing corrupt or invalid data that may cause end user software applications to malfunction or crash altogether. Data parsing, validation and transformation may be performed as parts of a single operation to increase speed and reduce computing overhead.

Abstract: A method includes all-or-nothing (AONT) encoding a first data chunk of a plurality of data chunks in accordance with distributed data storage parameters to produce a first set of AONT encoded data pieces, where the distributed data storage parameters include a T number that corresponds to a minimum number AONT encoded data pieces needed to recover a data chunk of the plurality of data chunks, and where the first set of AONT encoded data pieces includes the T number of AONT encoded data pieces. The method further includes facilitating storage of the first set of AONT encoded data pieces in a set of storage units of the storage network, where the set of storage units includes the T number of storage units.

Abstract: A processor initiates a run of a target container in a distributed computing environment. A processor detects at least one error occurring during the initiation of the target container. A processor determines at least one fix image based on the at least one error. A processor performs an error recovery of the target container based on the at least one fix image. A processor runs, in response to successfully performing the error recovery of the target container, the target container in the distributed computing environment.

Abstract: A storage management technique involves: receiving from a requesting node a write request for writing target data into a first target storage space in a redundant array of independent disks (RAID); if a storage device associated with the first target storage space does not fail, acquiring first data stored in the first target storage space and a first parity value corresponding to the requesting node and stored in a parity storage space; determining a target parity value based on the target data, the first data, and the first parity value; and updating a stripe with the target data and the target parity value. Accordingly, locks caused by updating the parity value can be avoided, so that different nodes can perform parallel write to different storage spaces in the same stripe in the RAID.

Abstract: A method for managing memory element failures in a memory subsystem is described. The method includes detecting, by the memory subsystem, a failed memory element in the memory subsystem and transmitting a redundant memory request based on detection of the failed memory element. The redundant memory request seeks to utilize memory storage in an external storage system in place of the failed memory element in the memory subsystem. Thereafter, the memory subsystem receives, from the external storage system, a redundant memory request confirmation, which indicates that the redundant memory request has been fulfilled and includes an address of a location in the external storage system. In response to receipt of the redundant memory request confirmation, the memory subsystem updates memory management information to map a logical address, which was previously mapped to the failed memory element, to the location in the external storage system.

Abstract: A fault detector for detecting a fault in a digital processing circuit configured to transform an input data set to an output data set based on an energy conserving function. The fault detector includes an input sum of absolute squares circuit configured to determine an input sum of absolute squares value of the input data set, which has a predetermined length; an output sum of absolute squares circuit configured to determine an output sum of absolute squares value of the output data set; and an energy conservation check circuit configured to identify a fault in the digital processing circuit if a comparison based on the input sum of absolute squares value and the output sum of absolute squares value does not meet a predetermined energy conservation criteria.

Abstract: A method and system for performing a flexible Byzantine fault tolerant (BFT) protocol. The method includes sending, from a client device, a proposed value to a plurality of replica devices and receiving, from at least one of the plurality of replica devices, a safe vote on the proposed value. The replica device sends the safe vote, based on a first quorum being reached, to the client device and each of the other replica devices of the plurality of replica devices. The method further includes determining that a number of received safe votes for the proposed value meets or exceeds a second quorum threshold, selecting the proposed value based on the determination, and setting a period of time within which to receive additional votes. The method further includes, based on the period of time elapsing without receiving the additional votes, committing the selected value for the single view.