Abstract: A streams manager monitors cost of one or more VMs hosting a streaming application, determines when cost can be reduced, and requests a cloud manager provision one or more VMs that have a lower cost. In response, the cloud manager provisions the VM(s) that have the lower cost. The streams manager then deploys a portion of the streaming application to the VM(s), thereby reducing the cost of running the streaming application.

Abstract: A streams manager monitors cost of one or more VMs hosting a streaming application, determines when cost can be reduced, and requests a cloud manager provision one or more VMs that have a lower cost. In response, the cloud manager provisions the VM(s) that have the lower cost. The streams manager then deploys a portion of the streaming application to the VM(s), thereby reducing the cost of running the streaming application.

Abstract: Profile data for streaming operators is collected and classified according to the function and relationship of operators, and split rules are constructed for the operators. A streams manager monitors performance of a streaming application, and when the performance needs to be improved, the streams manager determines from the split rules how to split the flow graph for the streaming application. The streams manager requests virtual machines from a cloud manager. In response, the cloud manager provisions one or more virtual machines in a cloud. The streams manager then modifies the flow graph so a portion of the flow graph is deployed to the one or more virtual machines in the cloud. In this manner a streaming application can dynamically evolve to increase its performance as needed.

Abstract: Profile data for streaming operators is collected and classified according to the function and relationship of operators, and split rules are constructed for the operators. A streams manager monitors performance of a streaming application, and when the performance needs to be improved, the streams manager determines from the split rules how to split the flow graph for the streaming application. The streams manager requests virtual machines from a cloud manager. In response, the cloud manager provisions one or more virtual machines in a cloud. The streams manager then modifies the flow graph so a portion of the flow graph is deployed to the one or more virtual machines in the cloud. In this manner a streaming application can dynamically evolve to increase its performance as needed.

Abstract: A streams manager monitors performance of a streaming application on a physical machine, and determines operators that are underperforming and operators that are overperforming. When the performance needs to be improved, the streams manager automatically modifies the flow graph to deploy one or more operators of the streaming application that are overperforming to a virtual machine in a cloud. Moving the overperforming operators off of the physical machine to a VM leaves additional resources for the underperforming operators that are left on the physical machine to improve performance of the streaming application.

Abstract: A streams manager monitors performance of a streaming application, and when the performance needs to be improved, the streams manager requests a cloud manager provision one or more VMs on a server that has a specified hardware type, and optionally has specified available hardware capacity. In response, the cloud manager determines which available servers have the specified hardware type, and when available hardware capacity is specified, further determines which of the available servers with the specified hardware type have the specified available capacity. When there are multiple servers that satisfy the request from the streams manager, the cloud manager determines from historical performance logs for the servers which is preferred. The cloud manager then provisions the requested VM(s) on the specified hardware type and returns the requested VM(s) to the streams manager. The streams manager then deploys a portion of the streaming application to the VM(s).

Abstract: A streams manager monitors performance of a streaming application on a physical machine, and determines operators that are underperforming and operators that are overperforming. When the performance needs to be improved, the streams manager automatically modifies the flow graph to deploy one or more operators of the streaming application that are overperforming to a virtual machine in a cloud. Moving the overperforming operators off of the physical machine to a VM leaves additional resources for the underperforming operators that are left on the physical machine to improve performance of the streaming application.

Abstract: A streams manager monitors performance of a streaming application, and when the performance needs to be improved, the streams manager requests a cloud manager provision one or more VMs on a server that has a specified hardware type, and optionally has specified available hardware capacity. In response, the cloud manager determines which available servers have the specified hardware type, and when available hardware capacity is specified, further determines which of the available servers with the specified hardware type have the specified available capacity. When there are multiple servers that satisfy the request from the streams manager, the cloud manager determines from historical performance logs for the servers which is preferred. The cloud manager then provisions the requested VM(s) on the specified hardware type and returns the requested VM(s) to the streams manager. The streams manager then deploys a portion of the streaming application to the VM(s).

Abstract: A streams manager monitors operator performance of a streaming application to determine when the performance of an operator needs to be improved or optimized. The streams manager in conjunction with a cloud manager automatically determines one or more preferred virtual machines in a cloud with a specified streams infrastructure that best meet the needs of the underperforming operator or application component based on physical location attributes of the preferred virtual machines. The cloud manager determines the physical location attributes of the candidate virtual machines. The streams manager or the cloud manager can then determine a preferred virtual machine of the candidates to deploy the operator based on the physical location attributes. The streams manager then modifies the flow graph so one or more operators of the streaming application are deployed to a preferred virtual machine determined according to the physical location attributes of the preferred virtual machine.

Abstract: Performance thresholds are defined for operators in a flow graph for a streaming application. A streams manager deploys the flow graph to one or more virtual machines (VMs). The performance of each portion of the flow graph on each VM is monitored. A VM is selected. When the performance of the portion of the flow graph in the selected VM does not satisfy the defined performance threshold(s), a determination is made regarding whether the portion of the flow graph is underperforming or overperforming. When the portion of the flow graph is underperforming, the portion of the flow graph is split into multiple portions that are implemented on multiple VMs. When the portion of the flow graph is overperforming, a determination is made of whether a neighbor VM is also overperforming. When a neighbor VM is also overperforming, the two VMs may be coalesced into a single VM.

Abstract: Performance thresholds are defined for operators in a flow graph for a streaming application. A streams manager deploys the flow graph to one or more virtual machines (VMs). The performance of each portion of the flow graph on each VM is monitored. A VM is selected. When the performance of the portion of the flow graph in the selected VM does not satisfy the defined performance threshold(s), a determination is made regarding whether the portion of the flow graph is underperforming or overperforming. When the portion of the flow graph is underperforming, the portion of the flow graph is split into multiple portions that are implemented on multiple VMs. When the portion of the flow graph is overperforming, a determination is made of whether a neighbor VM is also overperforming. When a neighbor VM is also overperforming, the two VMs may be coalesced into a single VM.

Abstract: Performance thresholds are defined for operators in a flow graph for a streaming application. A streams manager deploys the flow graph to one or more virtual machines (VMs). The performance of each portion of the flow graph on each VM is monitored. A VM is selected. When the performance of the portion of the flow graph in the selected VM does not satisfy the defined performance threshold(s), a determination is made regarding whether the portion of the flow graph is underperforming or overperforming. When the portion of the flow graph is underperforming, the portion of the flow graph is split into multiple portions that are implemented on multiple VMs. When the portion of the flow graph is overperforming, a determination is made of whether a neighbor VM is also overperforming. When a neighbor VM is also overperforming, the two VMs may be coalesced into a single VM.

Abstract: A streams manager monitors operator performance of a streaming application to determine when the performance of an operator needs to be improved or optimized. The streams manager in conjunction with a cloud manager automatically determines one or more preferred virtual machines in a cloud with a specified streams infrastructure that best meet the needs of the underperforming operator or application component based on physical location attributes of the preferred virtual machines. The cloud manager determines the physical location attributes of the candidate virtual machines. The streams manager or the cloud manager can then determine a preferred virtual machine of the candidates to deploy the operator based on the physical location attributes. The streams manager then modifies the flow graph so one or more operators of the streaming application are deployed to a preferred virtual machine determined according to the physical location attributes of the preferred virtual machine.

Abstract: Performance thresholds are defined for operators in a flow graph for a streaming application. A streams manager deploys the flow graph to one or more virtual machines (VMs). The performance of each portion of the flow graph on each VM is monitored. A VM is selected. When the performance of the portion of the flow graph in the selected VM does not satisfy the defined performance threshold(s), a determination is made regarding whether the portion of the flow graph is underperforming or overperforming. When the portion of the flow graph is underperforming, the portion of the flow graph is split into multiple portions that are implemented on multiple VMs. When the portion of the flow graph is overperforming, a determination is made of whether a neighbor VM is also overperforming. When a neighbor VM is also overperforming, the two VMs may be coalesced into a single VM.

Abstract: Methods, apparatuses, and computer program product for distributed debugging of an application in a distributed computing environment are provided. Embodiments include a first debug module on a first host receiving a set breakpoint message from a management debug module of a management system. In response to receiving the set breakpoint message, the first debug module sets a breakpoint for executing a first service on the first host, for the application. Upon hitting the breakpoint while executing the first service for the application, the first debug module sends a breakpoint condition of the first service to the management debug module. In response to receiving the breakpoint condition, the management debug module sends to a second debug module of a second host, an instruction to pause execution of the second service of the second host.

Abstract: Methods, apparatuses, and computer program product for distributed debugging of an application in a distributed computing environment are provided. Embodiments include a first debug module on a first host receiving a set breakpoint message from a management debug module of a management system. In response to receiving the set breakpoint message, the first debug module sets a breakpoint for executing a first service on the first host, for the application. Upon hitting the breakpoint while executing the first service for the application, the first debug module sends a breakpoint condition of the first service to the management debug module. In response to receiving the breakpoint condition, the management debug module sends to a second debug module of a second host, an instruction to pause execution of the second service of the second host.

Abstract: Methods, apparatuses, and computer program products for discovering resources of a distributed computing environment are provided. Embodiments include a management system transmitting an application program interface (API) message to the distributed computing environment. Embodiments also include the management system receiving from the distributed computing environment, a response to the API message and based on the response, identifying a resource of the distributed computing environment.

Abstract: Methods, apparatuses, and computer program products for discovering resources of a distributed computing environment are provided. Embodiments include a management system transmitting an application program interface (API) message to the distributed computing environment. Embodiments also include the management system receiving from the distributed computing environment, a response to the API message and based on the response, identifying a resource of the distributed computing environment.

Abstract: Methods, apparatuses, and computer program product for distributed debugging of an application in a distributed computing environment are provided. Embodiments include a first debug module on a first host receiving a set breakpoint message from a management debug module of a management system. In response to receiving the set breakpoint message, the first debug module sets a breakpoint for executing a first service on the first host, for the application. Upon hitting the breakpoint while executing the first service for the application, the first debug module sends a breakpoint condition of the first service to the management debug module. In response to receiving the breakpoint condition, the management debug module sends to a second debug module of a second host, an instruction to pause execution of the second service of the second host.

Abstract: Methods, apparatuses, and computer program products for managing virtual machine images in a distributed computing environment are provided. Embodiments includes a management system recording dependencies between the virtual machine images in the image service repository and dependencies between the deployed virtual machines in the compute service and the virtual machine images in the image service repository. Based on the recorded dependencies between the virtual machine images and the dependencies between the deployed virtual machines and the virtual machine images, the management system identifies a virtual machine image that has no deployed virtual machine dependent upon it. Embodiments also include the management system deleting, by the management system, the identified virtual machine image from the image service repository.