Abstract: Embodiments of the preset disclosure include a method, a system, and a computer program product for rearranging a set of filters within a data streams environment. The method includes setting a first filter ordering of two or more filter processing elements. The method includes determining a filtering efficiency of the first filter ordering. The determining of the filtering efficiency includes monitoring a runtime, one or more tuples, and an amount of tuples retained after filtering of the first filter ordering. The method includes creating a second filter ordering of the two or more filter processing elements. The method includes comparing the filtering efficiency of the second filter ordering to the first filter ordering. The method includes selecting the second filter ordering in response to comparing the filtering efficiency of the second filter ordering to the filtering efficiency of the first filter ordering.

Abstract: Embodiments of the preset disclosure include a method, a system, and a computer program product for rearranging a set of filters within a data streams environment. The method includes setting a first filter ordering of two or more filter processing elements. The method includes determining a filtering efficiency of the first filter ordering. The determining of the filtering efficiency includes monitoring a runtime, one or more tuples, and an amount of tuples retained after filtering of the first filter ordering. The method includes creating a second filter ordering of the two or more filter processing elements. The method includes comparing the filtering efficiency of the second filter ordering to the first filter ordering. The method includes selecting the second filter ordering in response to comparing the filtering efficiency of the second filter ordering to the filtering efficiency of the first filter ordering.

Abstract: A streams manager monitors performance of a streaming application and determines if operators are underperforming according to a threshold. When the performance needs to be improved, the streams manager automatically modifies the flow graph to offload or reroute a stream of data, or part of a stream of data, to a similar operator to more efficiently utilize streaming resources. Operators are provided with multiple ports to allow the streams manager to send additional streams to the operator.

Abstract: A streams manager monitors performance of a streaming application and determines if operators are underperforming according to a threshold. When the performance needs to be improved, the streams manager automatically modifies the flow graph to offload or reroute a stream of data, or part of a stream of data, to a similar operator to more efficiently utilize streaming resources. Operators are provided with multiple ports to allow the streams manager to send additional streams to the operator.

Abstract: Tuple communication and decision determination is provided in a streaming environment. A processor: generates mission tuples wrapped in a computing object or that wrap the computing object, places the mission tuples in a computing stream of a stream application, accesses computing time upon, communicates the computing time to the mission tuples one of incrementally or periodically, determines: a current position in the computing stream for the mission tuples and a class and one or more sub-classes that each of the mission tuples belongs to, and communicates information: between the mission tuples and between the mission tuples and one or more runtime processes associated with the computing stream or one or more external processes associated with the computing stream. The mission tuples are configured to modify operations of the computing operators in the computing stream.

Abstract: One or more operators in a flow graph of a streaming application may include one or more triggers that indicate when action needs to be taken for the operator. A streams manager monitors performance of a streaming application and receives a notification when a trigger in an operator fires. In response to a trigger firing, the streams manager determines an appropriate action corresponding to the trigger. When the trigger indicates an adjustment of cloud resources are needed, the streams manager formulates a cloud resource request to a cloud manager. In response, the cloud manager adjusts the cloud resources for the operator to improve performance of the streaming application. A trigger may specify a trigger action for an operator, and may additionally specify a trigger action for one or more other affected operators. The firing of a trigger in one operator can therefore result in adjusting resources to multiple operators.

Abstract: One or more operators in a flow graph of a streaming application may include one or more triggers that indicate when action needs to be taken for the operator. A streams manager monitors performance of a streaming application and receives a notification when a trigger in an operator fires. In response to a trigger firing, the streams manager determines an appropriate action corresponding to the trigger. When the trigger indicates an adjustment of cloud resources are needed, the streams manager formulates a cloud resource request to a cloud manager. In response, the cloud manager adjusts the cloud resources for the operator to improve performance of the streaming application. A trigger may specify a trigger action for an operator, and may additionally specify a trigger action for one or more other affected operators. The firing of a trigger in one operator can therefore result in adjusting resources to multiple operators.

Abstract: Embodiments of the disclosure provide a method, system, and computer program product for managing a template on an operator graph. The method for managing a template on an operator graph can include receiving the template for processing a stream of tuples. The template can have a plurality of template elements operating on one or more computer processors. The method can include calculating a resource requirement of a template element from the template. The method can include calculating a resource availability of a virtual machine. The method can include allocating the template onto the operator graph. The operator graph can have a plurality of processing elements operating on one or more computer processors. The method can also include mapping the template element from the template onto the virtual machine as a function of the resource requirement of the template element and the resource availability of the virtual machine.

Abstract: Embodiments of the disclosure provide a method, system, and computer program product for managing a template on an operator graph. The method for managing a template on an operator graph can include receiving the template for processing a stream of tuples. The template can have a plurality of template elements operating on one or more computer processors. The method can include calculating a resource requirement of a template element from the template. The method can include calculating a resource availability of a virtual machine. The method can include allocating the template onto the operator graph. The operator graph can have a plurality of processing elements operating on one or more computer processors. The method can also include mapping the template element from the template onto the virtual machine as a function of the resource requirement of the template element and the resource availability of the virtual machine.

Abstract: A streams manager creates one or more helper operators when a streaming application is initially deployed. As the streaming application runs, the streams manager monitors performance of the streaming application. When a bottleneck is detected, the streams manager automatically adjusts a helper operator to help the operator experiencing the bottleneck, thereby dynamically improving performance of the streaming application. Helper operators can be dynamically created and destroyed by the streams manager as needed, and can be deployed to virtual machines in a cloud.

Abstract: A streams manager creates one or more helper operators when a streaming application is initially deployed. As the streaming application runs, the streams manager monitors performance of the streaming application. When a bottleneck is detected, the streams manager automatically adjusts a helper operator to help the operator experiencing the bottleneck, thereby dynamically improving performance of the streaming application. Helper operators can be dynamically created and destroyed by the streams manager as needed, and can be deployed to virtual machines in a cloud.

Abstract: Embodiments of the disclosure include a method, a system, and a computer program product for modifying a stream operator based on the virtual resources. The method includes receiving a first resource allocation and a second resource allocation of a virtual resource for a virtual machine supporting a stream computing application. The method also includes determining whether the second resource allocation changed within a tolerance relative to the first resource allocation. The method also includes identifying a stream operator in the stream computing application using the virtual resource of the virtual machine. The method also includes modifying the stream operator to accommodate the second resource allocation in response to the second resource allocation changing relative to the first resource allocation.

Abstract: Embodiments of the disclosure include a method, a system, and a computer program product for modifying a stream operator based on the virtual resources. The method includes receiving a first resource allocation and a second resource allocation of a virtual resource for a virtual machine supporting a stream computing application. The method also includes determining whether the second resource allocation changed within a tolerance relative to the first resource allocation. The method also includes identifying a stream operator in the stream computing application using the virtual resource of the virtual machine. The method also includes modifying the stream operator to accommodate the second resource allocation in response to the second resource allocation changing relative to the first resource allocation.

Abstract: One or more operators in a flow graph of a streaming application may include one or more triggers that indicate when action needs to be taken for the operator. A streams manager monitors performance of a streaming application and receives a notification when a trigger in an operator fires. In response to a trigger firing, the streams manager determines an appropriate action corresponding to the trigger. When the trigger indicates an adjustment of cloud resources are needed, the streams manager formulates a cloud resource request to a cloud manager. In response, the cloud manager adjusts the cloud resources for the operator to improve performance of the streaming application. A trigger may specify a trigger action for an operator, and may additionally specify a trigger action for one or more other affected operators. The firing of a trigger in one operator can therefore result in adjusting resources to multiple operators.

Abstract: One or more operators in a flow graph of a streaming application may include one or more triggers that indicate when action needs to be taken for the operator. A streams manager monitors performance of a streaming application and receives a notification when a trigger in an operator fires. In response to a trigger firing, the streams manager determines an appropriate action corresponding to the trigger. When the trigger indicates an adjustment of cloud resources are needed, the streams manager formulates a cloud resource request to a cloud manager. In response, the cloud manager adjusts the cloud resources for the operator to improve performance of the streaming application. A trigger may specify a trigger action for an operator, and may additionally specify a trigger action for one or more other affected operators. The firing of a trigger in one operator can therefore result in adjusting resources to multiple operators.

Abstract: Embodiments of the disclosure provide a method, system, and computer program product for managing a template on an operator graph. The method for managing a template on an operator graph can include receiving the template for processing a stream of tuples. The template can have a plurality of template elements operating on one or more computer processors. The method can include calculating a resource requirement of a template element from the template. The method can include calculating a resource availability of a virtual machine. The method can include allocating the template onto the operator graph. The operator graph can have a plurality of processing elements operating on one or more computer processors. The method can also include mapping the template element from the template onto the virtual machine as a function of the resource requirement of the template element and the resource availability of the virtual machine.

Abstract: Embodiments of the disclosure provide a method, system, and computer program product for managing a template on an operator graph. The method for managing a template on an operator graph can include receiving the template for processing a stream of tuples. The template can have a plurality of template elements operating on one or more computer processors. The method can include calculating a resource requirement of a template element from the template. The method can include calculating a resource availability of a virtual machine. The method can include allocating the template onto the operator graph. The operator graph can have a plurality of processing elements operating on one or more computer processors. The method can also include mapping the template element from the template onto the virtual machine as a function of the resource requirement of the template element and the resource availability of the virtual machine.

Abstract: A method of real-time file synchronization includes segmenting a file to be synchronized into a plurality of segments, each segment of the plurality of segments representing a portion of the file to be displayed on slave systems. The method further includes indexing the plurality of segments into a file index, the file index organized based on the format of the file to be synchronized. The method further includes generating a synchronization key, the synchronization key being included within the file to be synchronized. The method further includes transmitting a synchronization signal if a segment change is detected, the synchronization signal including a file index value, the file index value representing the segment change. The method further includes receiving the synchronization signal.

Abstract: A port compatibility connection engine for a large scale stream processing framework is provided. The port compatibility management unit analyzes port definitions of processing elements (PEs) to validate interconnectivity between said elements. In particular, the port compatibility management unit determines the ability of the PEs to produce and/or consume data streams based on the data stream schema definitions specified on the PE ports. In addition, the port compatibility management unit analyzes security, scope, persistence, and other factors that impact interconnectivity. The port compatibility management unit generates a connection topology snapshot based on the above analysis and identifies the combination of PEs that cannot interconnect and provides the information in an output format that allows for visualization, filtering, and automatic fix capability.

Abstract: A method of real-time file synchronization includes segmenting a file to be synchronized into a plurality of segments, each segment of the plurality of segments representing a portion of the file to be displayed on slave systems. The method further includes indexing the plurality of segments into a file index, the file index organized based on the format of the file to be synchronized. The method further includes generating a synchronization key, the synchronization key being included within the file to be synchronized. The method further includes transmitting a synchronization signal if a segment change is detected, the synchronization signal including a file index value, the file index value representing the segment change. The method further includes receiving the synchronization signal.