Abstract: A system, method and computer-readable media for managing a compute environment are disclosed. The method includes importing identity information from an identity manager into a module performs workload management and scheduling for a compute environment and, unless a conflict exists, modifying the behavior of the workload management and scheduling module to incorporate the imported identity information such that access to and use of the compute environment occurs according to the imported identity information. The compute environment may be a cluster or a grid wherein multiple compute environments communicate with multiple identity managers.

Abstract: System, method, and tangible computer-readable storage media are disclosed for providing a brokering service for compute resources. The method includes, at a brokering service, polling a group of separately administered compute environments to identify resource capabilities and information, each compute resource environment including the group of managed nodes for processing workload, receiving a request for compute resources at the brokering service system, the request for compute resources being associated with a service level agreement (SLA) and based on the resource capabilities across the group of compute resource environments, selecting compute resources in one or more of the group of compute resource environments. The brokering service system receives workload associated with the request and communicates the workload to the selected resources for processing.

Abstract: A system and method for reserving resources within a compute environment such as a cluster or grid are disclosed. The method aspect of the disclosure includes receiving a request for resource availability in a compute environment from a requestor, associating a transaction identification with the request and resources within the compute environment that can meet the request and presenting the transaction identification to the requestor. The transaction ID can also be associated with a time frame in which resources are available and can also be associated with modifications to the resources and supersets of resources that could be drawn upon to meet the request. The transaction ID can also be associated with metrics that identify how well the resource fit with the request and modifications that can make the resources better match the workload which would be submitted under the request.

Abstract: Disclosed herein are systems, methods, and computer-readable media for dynamically managing data-centric searches. The method includes identifying an event related to domain-specific searches to a database, identifying data at a first memory location in the database, duplicating the data to a new memory location, and distributing processing more domain-specific searches amongst an expanded search space including the new memory location and the first memory location. The expanded search space can be reduced or collapsed in response to a reduction event by removing duplicate data from the first memory location or the new memory location and adjusting the distribution of processing amongst the remaining memory location. The method can optionally include organizing multiple events by network segment, identifying a network segment associated with domain-specific searches, and duplicating the data to a new memory location in close proximity to the identified network segment.

Abstract: A systems, method and computer-readable media are disclosed for providing a dynamic roll-back reservation mask in a compute environment. The method of managing compute resources within a compute environment includes, based on an agreement between a compute resource provider and a customer, creating a roll-back reservation mask for compute resources which slides ahead of current time by a period of time. Within the roll-back reservation mask, the method specifies a subset of consumers and compute resource requests which can access compute resources associated with the roll-back reservation mask and, based on received data, the method dynamically modifies at least one of (1) the period of time the roll-back reservation mask slides ahead of current time and (2) the compute resources associated with the roll-back reservation mask.

Abstract: The present invention provides a system, method and computer-readable media for generating virtual private clusters out of a group of compute resources. Typically, the group of compute resources involves a group of clusters independently administered. The method provides for aggregating the group of compute resources, partitioning the aggregated group of compute resources and presenting to each user in an organization a partition representation the organization's virtual private cluster. The users transparently view their cluster and have control over its operation. The partitions may be static or dynamic.

Abstract: Disclosed are systems, hybrid compute environments, methods and computer-readable media for dynamically provisioning nodes for a workload. In the hybrid compute environment, each node communicates with a first resource manager associated with the first operating system and a second resource manager associated with a second operating system. The method includes receiving an instruction to provision at least one node in the hybrid compute environment from the first operating system to the second operating system, after provisioning the second operating system, pooling at least one signal from the resource manager associated with the at least one node, processing at least one signal from the second resource manager associated with the at least one node and consuming resources associated with the at least one node having the second operating system provisioned thereon.

Abstract: Disclosed are systems and methods of performing a power cap processing in a compute environment. The method includes determining of one of committed resources and dedicated resources in a compute environment exceed a threshold value for a job. If a determination is yes that the threshold value is exceeded, then the method includes preempting processing of the job in the compute environment by performing one of migrating the job to a new compute resources and performing a power reduction action associated with the job, such as slowing down a processor associated with a job or cancelling the job. When such a power state reduction action is taken, reservations associated with other jobs may also be adjusted.

Abstract: Disclosed herein are systems, methods, and non-transitory computer-readable storage media for constraining auto live migration of virtual machines using group tags, access control lists, and time constraints. A system assigns a hypervisor a group tag denoting membership in a group and assigns a virtual machine an affinity group tag that denotes a placement requirement on hypervisors. The affinity group tag can be positive, requiring a match, or negative, requiring a non-match. The system migrates the virtual machine to the hypervisor according to compatibility between the group tag and the affinity group tag. Limitations of virtual machine placement and live migration due to group tags can be overridden in the system by a forced migration triggered by a human or qualifying event. Additionally, an access control list can be added to group membership of hypervisors and a time dimension can be added to a group tag or an access control list.

Abstract: Disclosed herein are systems, methods, and computer-readable storage media for managing storage data input/output in a compute environment. The system receives data associated with workload or jobs that is to be processed in a compute environment. The system receives more data associated with a job that is to be scheduled to consume compute resources in the compute environment. Based on all the received data, the system transmits a signal to a storage input/output manager. The signal instructs the storage/output manager regarding how to manage a file transfer between the compute environment and a storage environment. The file transfer is associated with processing the job in the compute environment.

Abstract: A system, method and computer-readable media for managing a compute environment are disclosed. The method includes importing identity information from an identity manager into a module performs workload management and scheduling for a compute environment and, unless a conflict exists, modifying the behavior of the workload management and scheduling module to incorporate the imported identity information such that access to and use of the compute environment occurs according to the imported identity information. The compute environment may be a cluster or a grid wherein multiple compute environments communicate with multiple identity managers.

Abstract: Disclosed are a system, method and computer-readable medium relating to managing resources within a compute environment having a group of nodes or computing devices. The method comprises, for each node in the compute environment: traversing a list jobs having a fixed time relationship, wherein for each job in the list, the following steps occur: obtaining a range list of available timeframes for each job, converting each availability timeframe to a start range, shifting the resulting start range in time by a job offset, for a first job, copying the resulting start range into a node range, and for all subsequent jobs, logically AND'ing the start range with the node range. Next, the method comprises logically OR'ing the node range with a global range, generating a list of acceptable resources on which to start and the timeframe at which to start and creating reservations according to the list of acceptable resources for the resources in the group of computing devices and associated job offsets.

Abstract: Disclosed are systems, methods and non-transitory computer-readable storage media for managing resources between a web server and an on-demand compute environment. A system configured to practice the method receives, at the on-demand compute environment, an indication that web traffic directed to a web server should at least be partially served via the on-demand compute environment, provisions compute resources within the on-demand compute environment to respond to web traffic for the web server based on the indication to yield a provisioned on-demand compute environment. The system serves web traffic at the provisioned on-demand compute environment based on an established routing of the web traffic from the web server to the provisioned on-demand compute environment such that the use of the provisioned on-demand compute environment for the web traffic is transparent. After serving the web traffic via the provisioned resources, the system can release the provisioned compute resources for other uses.

Abstract: A system and method of reserving resources in a compute environment are disclosed. The method embodiment comprises receiving a request for resources within a computer environment, determining at least one completion time associated with at least one resource type required by the request, and reserving resources within the computer environment based on the determine of at least the completion time. A scaled wall clock time on a per resource basis may also be used to determine what resources to reserve. The system may determine whether to perform a start time analysis or a completion time analysis or a hybrid analysis in the process of generating a co-allocation map between a first type of resource and a second type of resource in preparation for reserving resources according to the generated co-allocation map.

Abstract: Disclosed are systems, methods, computer readable media, and compute environments for establishing a schedule for processing a job in a distributed compute environment. The method embodiment comprises converting a topology of a compute environment to a plurality of endpoint-to-endpoint paths, based on the plurality of endpoint-to-endpoint paths, mapping each replica resource of a plurality of resources to one or more endpoints where each respective resource is available, iteratively identifying schedule costs associated with a relationship between endpoints and resources, and committing a selected schedule cost from the identified schedule costs for processing a job in the compute environment.

Abstract: Disclosed are a system and method of integrating an on-demand compute environment into a local compute environment. The method includes receiving a request from an administrator to integrate an on-demand compute environment into a local compute environment and, in response to the request, automatically integrating local compute environment information with on-demand compute environment information to make available resources from the on-demand compute environment to requestors of resources in the local compute environment.

Abstract: A system, computer-readable medium and method for performing intelligent data pre-staging for a job submitted to a cluster environment. The method aspect comprises determining availability of compute resources including availability timeframes to process the submitted job, determining data requirements for processing the job and determining a co-allocation in time reservation.

Abstract: Disclosed are a system, method and computer-readable medium relating to managing resources within a compute environment having a group of nodes or computing devices. The method comprises, for each node in the compute environment: traversing a list jobs having a fixed time relationship, wherein for each job in the list, the following steps occur: obtaining a range list of available timeframes for each job, converting each availability timeframe to a start range, shifting the resulting start range in time by a job offset, for a first job, copying the resulting start range into a node range, and for all subsequent jobs, logically AND'ing the start range with the node range. Next, the method comprises logically OR'ing the node range with a global range, generating a list of acceptable resources on which to start and the timeframe at which to start and creating reservations according to the list of acceptable resources for the resources in the group of computing devices and associated job offsets.

Abstract: Disclosed is an on-demand system and method for managing resources in an on-demand compute environment from a local compute environment. The method includes receiving information at a local resource broker that is associated with resources within an on-demand compute environment, based on the information, communicating instructions from the local resource broker to the on-demand compute environment and modifying resources associated with the on-demand compute environment based on the instructions.

Abstract: A system and method are disclosed for receiving a request for resources in a compute environment to process workload, the request including a specification of a quality of fit. The system generates a substantial maximum potential quality of fit based on compute environment with an assumption of no competing workload to yield an analysis. The system evaluates a first resource allocation and a second resource allocation against the analysis to yield the first fit in a respective second fit. The system selects one of the first resource allocation and the second resource allocation based on a comparison of the first fit to the second fit as well as a cost associated with any delays.