Abstract: In some embodiments, there is provided a system which allows data to be received into a placement intelligence. After the data is analyzed, the data is written to a persistent storage device. Subsequently, the data may be written. Periodically, self-optimization may occur to improve read speeds or other metrics.

Abstract: In some examples, there is provided a method for a storage controller to receive a request to write data at a virtual location, writing data at the next free physical location in sequence, writing metadata correlating the virtual location with the physical location at the physical location, and writing a counter at the physical location. The recorded metadata can be used to re-construct the mapping between a given physical location and its corresponding virtual location if the virtual block address is somehow lost. The recorded counter can be used to determine the most recently recorded mapping between the virtual location and physical location, thereby resolving any discrepancies between earlier recorded metadata.

Abstract: A system, comprising: a plurality of clusters, each cluster comprising two or more nodes and data storage; data storage comprising two or more storage arrays; each storage array comprising two or more storage devices; each storage device being configured to store data; each node being configured to receive requests to interact with data stored on a storage device; wherein the system is configured to provide at least two communication paths between any pair of components, the components comprising the nodes, storage arrays, and the storage devices.