Abstract: In certain aspects, the invention features a system and method for (1) receiving reservations for a first subset of computing resources of a distributed computing system (DCS), wherein each of the reservations specifies a time period, (2) allocating the first subset according to the reservations, (3) receiving requests for use of at least a second subset of the DCS's computing resources, wherein each of the requests specifies a time period, (4) determining whether enough unallocated resources are available to fulfill all of the requests, wherein the unallocated resources include the DCS's resources not allocated according to the reservations, (5) allocating resources according to the requests, if there are enough unallocated resources available, and (6) allocating resources in accordance with an allocation criteria if there are not enough unallocated resources available.

Abstract: In one aspect, the present invention features a system including a local computing device in communication with a distributed computing system, the local computing device configured to perform computations for a first portion of a computer software application and to send a second portion of the application for computation on the distributed computing system.

Abstract: In certain aspects, the invention features a system and method for caching results, including receiving a job for computation by a distributed computing system having one or more node computing devices in communication with a cache, processing, on one of the node computing devices, the job to create an intermediate result for storage in the cache, wherein the intermediate result includes data wherein a time required to obtain the data by computation or retrieval from a data storage external to the distributed computer system is at least marginally greater than that of retrieving the intermediate result from the cache. In accordance with such aspects, the system and method further includes storing the intermediate result in the cache, and accessing the cache by presenting a lookup function to the cache, wherein the lookup function includes a key and a compute function configured to produce the intermediate result.

Abstract: In certain aspects, the invention features methods that include receiving a parent job configured to produce one or more descendant jobs, and scheduling computation of the parent job on a node computing device that is one of a plurality of node computing devices of a distributed computing system. Such an aspect also includes selectively rescheduling computation of a job other than a parent job from any one of the node computing devices to another of the node computing devices, and preventing rescheduling of the parent job unless each of the descendant jobs is completed or terminated.

Abstract: In one aspect, the present invention features a system including a local computing device in communication with a distributed computing system, the local computing device configured to perform computations for a first portion of a computer software application and to send a second portion of the application for computation on the distributed computing system.

Abstract: In certain aspects, the invention features a system and method for caching results, including receiving a job for computation by a distributed computing system having one or more node computing devices in communication with a cache, processing, on one of the node computing devices, the job to create an intermediate result for storage in the cache, wherein the intermediate result includes data wherein a time required to obtain the data by computation or retrieval from a data storage external to the distributed computer system is at least marginally greater than that of retrieving the intermediate result from the cache. In accordance with such aspects, the system and method further includes storing the intermediate result in the cache, and accessing the cache by presenting a lookup function to the cache, wherein the lookup function includes a key and a compute function configured to produce the intermediate result.

Abstract: In certain aspects, the invention features methods that include receiving a parent job configured to produce one or more descendant jobs, and scheduling computation of the parent job on a node computing device that is one of a plurality of node computing devices of a distributed computing system. Such an aspect also includes selectively rescheduling computation of a job other than a parent job from any one of the node computing devices to another of the node computing devices, and preventing rescheduling of the parent job unless each of the descendant jobs is completed or terminated.

Abstract: In certain aspects, the invention features a system and method for receiving a parent job configured to produce one or more descendant jobs, and scheduling computation of the parent job on a node computing device that is one of a plurality of node computing devices of a distributed computing system. In such an aspect, the distributed computing system further includes a scheduler server configured to selectively reschedule computation of a job other than a parent job from any one of the plurality of node computing devices to another of the node computing devices. Such an aspect further includes preventing rescheduling of the parent job unless each of the descendant jobs is completed or terminated.

Abstract: In certain aspects, the invention features a system and method for caching results, including receiving a job for computation by a distributed computing system having one or more node computing devices in communication with a cache, processing, on one of the node computing devices, the job to create an intermediate result for storage in the cache, wherein the intermediate result includes data wherein a time required to obtain the data by computation or retrieval from a data storage external to the distributed computer system is at least marginally greater than that of retrieving the intermediate result from the cache. In accordance with such aspects, the system and method further includes storing the intermediate result in the cache, and accessing the cache by presenting a lookup function to the cache, wherein the lookup function includes a key and a compute function configured to produce the intermediate result.

Abstract: In one aspect, the present invention features a system including a local computing device in communication with a distributed computing system, the local computing device configured to perform computations for a first portion of a computer software application and to send a second portion of the application for computation on the distributed computing system.

Abstract: In certain aspects, the invention features a system and method including receiving a parent job configured to produce one or more descendant jobs, and scheduling computation of the parent job on a node computing device that is one of a plurality of node computing devices of a distributed computing system. In such an aspect, the distributed computing system further includes a scheduler server configured to selectively reschedule computation of a job other than a parent job from any one of the plurality of node computing devices to another of the node computing devices, and to receive data descriptive of an indication that the parent job is not to be rescheduled unless each of the descendant jobs is completed or terminated. Such an aspect further includes preventing rescheduling of the parent job unless each of the descendant jobs is completed or terminated.

Abstract: In certain aspects, the invention features a system and method for receiving a parent job configured to produce one or more descendant jobs, and scheduling computation of the parent job on a node computing device that is one of a plurality of node computing devices of a distributed computing system. In such an aspect, the distributed computing system further includes a scheduler server configured to selectively reschedule computation of a job other than a parent job from any one of the plurality of node computing devices to another of the node computing devices. Such an aspect further includes preventing rescheduling of the parent job unless each of the descendant jobs is completed or terminated.

Abstract: In certain aspects, the invention features a system and method for caching results, including receiving a job for computation by a distributed computing system having one or more node computing devices in communication with a cache, processing, on one of the node computing devices, the job to create an intermediate result for storage in the cache, wherein the intermediate result includes data wherein a time required to obtain the data by computation or retrieval from a data storage external to the distributed computer system is at least marginally greater than that of retrieving the intermediate result from the cache. In accordance with such aspects, the system and method further includes storing the intermediate result in the cache, and accessing the cache by presenting a lookup function to the cache, wherein the lookup function includes a key and a compute function configured to produce the intermediate result.

Abstract: In certain aspects, the invention features a system and method for caching results, including receiving a job for computation by a distributed computing system having one or more node computing devices in communication with a cache, processing, on one of the node computing devices, the job to create an intermediate result for storage in the cache, wherein the intermediate result includes data wherein a time required to obtain the data by computation or retrieval from a data storage external to the distributed computer system is at least marginally greater than that of retrieving the intermediate result from the cache. In accordance with such aspects, the system and method further includes storing the intermediate result in the cache, and accessing the cache by presenting a lookup function to the cache, wherein the lookup function includes a key and a compute function configured to produce the intermediate result.

Abstract: In one aspect, the present invention features a system including a local computing device in communication with a distributed computing system, the local computing device configured to perform computations for a first portion of a computer software application and to send a second portion of the application for computation on the distributed computing system.

Abstract: In certain aspects, the invention features a system and method including receiving a parent job configured to produce one or more descendant jobs, and scheduling computation of the parent job on a node computing device that is one of a plurality of node computing devices of a distributed computing system. In such an aspect, the distributed computing system further includes a scheduler server configured to selectively reschedule computation of a job other than a parent job from any one of the plurality of node computing devices to another of the node computing devices, and to receive data descriptive of an indication that the parent job is not to be rescheduled unless each of the descendant jobs is completed or terminated. Such an aspect further includes preventing rescheduling of the parent job unless each of the descendant jobs is completed or terminated.

Abstract: In certain aspects, the invention features a system and method for caching results, including receiving a job for computation by a distributed computing system having one or more node computing devices in communication with a cache, processing, on one of the node computing devices, the job to create an intermediate result for storage in the cache, wherein the intermediate result includes data wherein a time required to obtain the data by computation or retrieval from a data storage external to the distributed computer system is at least marginally greater than that of retrieving the intermediate result from the cache. In accordance with such aspects, the system and method further includes storing the intermediate result in the cache, and accessing the cache by presenting a lookup function to the cache, wherein the lookup function includes a key and a compute function configured to produce the intermediate result.

Abstract: In certain aspects, the invention features a system and method for (1) receiving one or more reservations for use of at least a first subset of a plurality of computing resources of a distributed computing system, wherein each of the one or more reservations specifies a period of time for use of the computing resources, (2) allocating the first subset of the computing resources for use in accordance with the one or more reservations, (3) receiving one or more requests for use of at least a second subset of the plurality of computing resources of the distributed computing system, wherein each of the one or more requests specifies a period of time for use of the computing resources, (4) determining whether a sufficient amount of one or more unallocated computing resources are available to fulfill all of the one or more requests, wherein the one or more unallocated computing resources comprises the computing resources of the distributed computing system that are not allocated in accordance with said one or more