Abstract: Systems and methods for managing file operations over shared content in the presence of two or more heterogeneous file systems. A virtual file system provides data consistency pertaining to asynchronous interactions between the heterogeneous storage systems. Operations of the virtual file system include receiving a file system call from a first storage environment for performing one or more data operations at a second storage environment. After receiving the file system call, the virtual file system issues file system calls to the second storage environment and records a first set of metadata. To determine if and when the one or more data operations at the second storage environment have completed, the virtual file system accesses a second set of metadata from the second storage environment. The two sets of metadata are compared. If there are differences, then the virtual file system performs time delays until the two sets of metadata agree.

Abstract: A system and method for facilitating cache alignment in a cross-enterprise file collaboration system. The example method includes maintaining a plurality of messages in a cache, each message associated with a message offset; determining a message batch size; receiving a first request for a message characterized by a first offset; responding to the first request at least in part by sending an amount of data equal to the batch size starting at the first offset; receiving a second request for a second message of characterized by a second offset; and if the second offset plus the data batch size spans across a boundary determined by the first offset plus the data batch size, then responding to the second request by sending an amount of data equal to the first offset plus the data batch size minus the second offset. In a more specific embodiment, the first and second requests are received from different committers.

Abstract: A system and method for facilitating implementing a computing task (such as selectively transforming and/or writing data retrieved from a message stream of a message broker) via concurrent computing in a networked computing environment. The example method includes using a distributed software framework to encapsulate overhead functionality for facilitating extracting data from a data stream output from the message broker and writing associated data to one or more targets in a networked computing environment; and accommodating custom code as a plugin to one or more modules of the software framework. In a more specific embodiment, the one or more modules include one or more committers. The overhead functionality includes functionality for facilitating selective redistribution of work when a process becomes unreliable; tracking of offsets for message batches in the data stream; automatically assigning work to nodes in the networked computing environment.

Abstract: Systems and methods for managing file operations over shared content in the presence of two or more heterogeneous file systems. A virtual file system provides data consistency pertaining to asynchronous interactions between the heterogeneous storage systems. Operations of the virtual file system include receiving a file system call from a first storage environment for performing one or more data operations at a second storage environment. After receiving the file system call, the virtual file system issues file system calls to the second storage environment and records a first set of metadata. To determine if and when the one or more data operations at the second storage environment have completed, the virtual file system accesses a second set of metadata from the second storage environment. The two sets of metadata are compared. If there are differences, then the virtual file system performs time delays until the two sets of metadata agree.

Abstract: A system and method for facilitating implementing a computing task (such as selectively transforming and/or writing data retrieved from a message stream of a message broker) via concurrent computing in a networked computing environment. The example method includes using a distributed software framework to encapsulate overhead functionality for facilitating extracting data from a data stream output from the message broker and writing associated data to one or more targets in a networked computing environment; and accommodating custom code as a plugin to one or more modules of the software framework. In a more specific embodiment, the one or more modules include one or more committers. The overhead functionality includes functionality for facilitating selective redistribution of work when a process becomes unreliable; tracking of offsets for message batches in the data stream; automatically assigning work to nodes in the networked computing environment.

Abstract: A system and method for facilitating cache alignment in a cross-enterprise file collaboration system. The example method includes maintaining a plurality of messages in a cache, each message associated with a message offset; determining a message batch size; receiving a first request for a message characterized by a first offset; responding to the first request at least in part by sending an amount of data equal to the batch size starting at the first offset; receiving a second request for a second message of characterized by a second offset; and if the second offset plus the data batch size spans across a boundary determined by the first offset plus the data batch size, then responding to the second request by sending an amount of data equal to the first offset plus the data batch size minus the second offset. In a more specific embodiment, the first and second requests are received from different committers.