Abstract: Performance data is collected for input/output operations executed at a storage device of a plurality of storage devices of a software-defined storage network. Based on the collected performance data, a time-based I/O performance profile for the storage device is determined. A characteristic time-based I/O performance profile is determined for a representative group of storage devices having common characteristics with the storage device and based on previously collected performance data for devices of the representative group. It is determined that the difference between the time-based I/O performance profile for the storage device and the characteristic time-based I/O performance profile exceeds a predetermined deviance threshold that is indicative of a probable failure of the storage device. An indication is generated that the storage device exceeded the predetermined deviance threshold.

Abstract: Techniques are disclosed for generating and utilizing a time-based distribution of I/O latency and other performance characteristics to identify potential device failures in a system that includes storage devices, such as a distributed software-defined storage system. A user interface is implemented that allows users to request and selectively view I/O latency and other data over a configurable time-based or histogram-based distribution. The user interface further enables comparison of the I/O latency distribution to data from other devices in the same class to identify potential failures.

Abstract: An append-only streams capability may be implemented that allows the host (e.g., the file system) to determine an optimal stream size based on the data to be stored in that stream. The storage device may expose to the host one or more characteristics of the available streams on the device, including but not limited to the maximum number of inactive and active streams on the device, the erase block size, the maximum number of erase blocks that can be written in parallel, and an optimal write size of the data. Using this information, the host may determine which particular stream offered by the device is best suited for the data to be stored.

Abstract: Techniques are disclosed for generating and utilizing a time-based distribution of I/O latency and other performance characteristics to identify potential device failures in a system that includes storage devices, such as a distributed software-defined storage system. A user interface is implemented that allows users to request and selectively view I/O latency and other data over a configurable time-based or histogram-based distribution. The user interface further enables comparison of the I/O latency distribution to data from other devices in the same class to identify potential failures.

Abstract: Performance data is collected for input/output operations executed at a storage device of a plurality of storage devices of a software-defined storage network. Based on the collected performance data, a time-based I/O performance profile for the storage device is determined. A characteristic time-based I/O performance profile is determined for a representative group of storage devices having common characteristics with the storage device and based on previously collected performance data for devices of the representative group. It is determined that the difference between the time-based I/O performance profile for the storage device and the characteristic time-based I/O performance profile exceeds a predetermined deviance threshold that is indicative of a probable failure of the storage device. An indication is generated that the storage device exceeded the predetermined deviance threshold.

Abstract: An append-only streams capability may be implemented that allows the host (e.g., the file system) to determine an optimal stream size based on the data to be stored in that stream. The storage device may expose to the host one or more characteristics of the available streams on the device, including but not limited to the maximum number of inactive and active streams on the device, the erase block size, the maximum number of erase blocks that can be written in parallel, and an optimal write size of the data. Using this information, the host may determine which particular stream offered by the device is best suited for the data to be stored.

Abstract: Streaming functionality may be utilized for optimizing the storage of data on a solid state device. In one embodiment, an append-only streaming method may comprise determining a size of one or more related groups of data, determining a size of one or more erase blocks in a file system, requesting from the file system one or more stream identifiers based on the size of the one or more related groups of data and the size of the one or more erase blocks, requesting from a solid state device and using the one or more stream identifiers an optimal writable space on the solid state device, and writing data to the optimal writable space on the solid state device.