Abstract: Data management systems and methods include a cloud-based platform coupled to a system of agents or folders hosted on client devices. The platform does not store actual data but instead makes use of metadata provided by the agents to track a location of all data in the system and manage the distributed storage, movement and processing of the actual data among the agents. In so doing, the platform pools networked storage into “virtual clusters” using local storage at the agents. The agents collectively monitor, store, and transfer or move data, and perform data processing operations as directed by the platform, as described in detail herein. The agents include agents hosted on or coupled to processor-based devices, agents hosted on devices of a local area network, agents hosted on devices of a wide area network, agents hosted on mobile devices, and agents hosted on cloud-based devices.

Abstract: Embodiments of a distributed data management system include a platform comprising a processor coupled to databases. A grid including agents is coupled to the platform, and each agent is an agent of the platform independently running on a client device. The agents generate and provide to the platform metadata that corresponds to the content of memory accessible by the client devices corresponding to the agents. The agents generate the metadata by hashing fragments of the content. The platform uses the metadata instead of the content to generate and assign to the agents tasks including tasks controlling at least one of storing, transferring and processing of the content. A task is a processing operation performed on content accessible by the agent responsible for the task.