Abstract: Systems and methods are disclosed for a unified file index for a file system. In one example, a Grand Unified File Index (GUFI) includes a tree replicating the directory hierarchy of one or more primary filesystems, and individual metadata stores for each directory. The GUFI tree permits fast traversal, efficient user space access controls, and simple tree directed operations such as renames, moves, or permission changes. In some examples, the individual metadata stores can be implemented as embedded databases on flash storage for speed. In some examples, use of summary tables at the directory or subtree level can eliminate wasteful executions, prune tree traversal, and further improve performance. In various examples, efficient operation can be achieved from laptop to supercomputer scale, across a wide mix of file distributions and filesystems.

Abstract: Efficient, scalable, programmable, and reliable computing systems, built from a homogeneous set of relatively humble processors arranged logically or physically into a Recurrent Multi-Stage Interconnection Network (RMIN) is provided. The RMIN may include a plurality of layers, where each of the plurality of layers includes a plurality of nodes. The RMIN may also include a plurality of links configured to connect each of the plurality of layers, and a plurality of recurrent links configured to connect a plurality of nodes in a last layer of the plurality of layers to plurality nodes in a first layer of the plurality of layers. The plurality of links, together with the plurality of recurrent links, may be configured to allow data originating in any layer of the plurality of layers to pass through each of the plurality of layers without interruption.