Abstract: A method, apparatus, and computer program product for scheduling stream-based applications in a distributed computer system with configurable networks are provided. The method includes choosing, at a highest temporal level, jobs that will run, an optimal template alternative for the jobs that will run, network topology, and candidate processing nodes for processing elements of the optimal template alternative for each running job to maximize importance of work performed by the system. The method further includes making, at a medium temporal level, fractional allocations and re-allocations of the candidate processing elements to the processing nodes in the system to react to changing importance of the work. The method also includes revising, at a lowest temporal level, the fractional allocations and re-allocations on a continual basis to react to burstiness of the work, and to differences between projected and real progress of the work.

Abstract: An illustrative embodiment of the present invention includes a method for routing at least one packet from at least one source node to at least one destination node, each node is operatively coupled to a given packet switch within a plurality of packet switches operatively coupled to a given circuit switch. The method includes a step of establishing one or more Virtual Local Area Networks (VLANs). Each VLAN comprising a subset of the plurality of packet switches operatively coupled to the given circuit switch. At least one of the one or more VLANs comprises the at least one packet switch to which the source and destination nodes are operatively coupled. The method also includes a step of routing the at least one packet from the source node to the destination node over at least one loop-free path comprised of one or more packet switches within a given VLAN.

Abstract: A method, system, and computer program product for implementing stream processing are provided. The system includes an application framework and applications containing dataflow graphs managed by the application framework running on a first network. The system also includes at least one circuit switch in the first network having a configuration that is controlled by the application framework, a plurality of processing nodes interconnected by the first network over one of wireline and wireless links, and a second network for providing at least one of control and additional data transfer over the first network. The application framework reconfigures circuit switches in response to monitoring aspects of the applications and the first network.

Abstract: An illustrative embodiment of the present invention includes a method for routing at least one packet from at least one source node to at least one destination node, each node is operatively coupled to a given packet switch within a plurality of packet switches operatively coupled to a given circuit switch. The method includes a step of establishing one or more Virtual Local Area Networks (VLANs). Each VLAN comprising a subset of the plurality of packet switches operatively coupled to the given circuit switch. At least one of the one or more VLANs comprises the at least one packet switch to which the source and destination nodes are operatively coupled. The method also includes a step of routing the at least one packet from the source node to the destination node over at least one loop-free path comprised of one or more packet switches within a given VLAN.

Abstract: A method, apparatus, and computer program product for scheduling stream-based applications in a distributed computer system with configurable networks are provided. The method includes choosing, at a highest temporal level, jobs that will run, an optimal template alternative for the jobs that will run, network topology, and candidate processing nodes for processing elements of the optimal template alternative for each running job to maximize importance of work performed by the system. The method further includes making, at a medium temporal level, fractional allocations and re-allocations of the candidate processing elements to the processing nodes in the system to react to changing importance of the work. The method also includes revising, at a lowest temporal level, the fractional allocations and re-allocations on a continual basis to react to burstiness of the work, and to differences between projected and real progress of the work.

Abstract: A method, system, and computer program product for implementing stream processing are provided. The system includes an application framework and applications containing dataflow graphs managed by the application framework running on a first network. The system also includes at least one circuit switch in the first network having a configuration that is controlled by the application framework, a plurality of processing nodes interconnected by the first network over one of wireline and wireless links, and a second network for providing at least one of control and additional data transfer over the first network.