Abstract: A system and method for dynamic log management of stream processing in a distributed computing environment, such as, for example, a streaming application or stream analytics system. A streaming application can be deployed or published to a cluster, to execute as a client application. A cluster manager coordinates with worker nodes, to commit tasks associated with the streaming application. If a need arises to generate lower-level log data associated with the streaming application, for example to diagnose an underlying cause of a warning/error message, a configuration job can be committed to the cluster to execute as a separate log-configuration application. The log-configuration application operates with the cluster manager to determine the set of working nodes currently associated with the streaming application, and modify the logger configuration at those nodes, to record or otherwise provide log data according to a modified logging level, for example to provide lower-level log messages.

Abstract: An event processing system for distributing a continuous query, and processing events in an event stream, is disclosed. The system can synchronize timestamps across all partitions by adding a heartbeat propagator component propagating a heartbeat signal for silent partitions. The system can further include a timestamp tracker component that tracks the maximum observed timestamp across all partitions for each batch, and sends this to each partition. The system can distribute partitions of the events to the worker nodes, and instruct a heartbeat propagator component to generate a heartbeat for a first worker node corresponding to an event in a different partition. The system receives outputs from the worker nodes and combines these into a single result corresponding to a continuous query. The system can further implement a timestamp tracker to select a highest timestamp value of a previous batch, and send the value to the worker nodes.

Abstract: An event processing system for distributing a geospatial computation, and processing events in an event stream, is disclosed. The disclosed system and methods can apply a spatial function, such as distance, within Distance, and proximity, in parallel to a stream comprising event locations. The disclosed system improves over existing geospatial computations by providing an efficient parallel implementation that can handle a large number of moving objects in real time with little latency. A computing device receives an event stream comprising locations and can geohash the locations to obtain geohashes identifying geo grid cells containing the locations. The computing device can determine respective sets of neighboring geohashes identifying neighboring cells in the geo grid. The computing device then partitions the geospatial computation by mapping, based on the respective geo hash and the respective set of neighboring geo hashes, the events to processors.

Abstract: An event processing system for distributing a continuous query, and processing events in an event stream, is disclosed. The system can synchronize timestamps across all partitions by adding a heartbeat propagator component propagating a heartbeat signal for silent partitions. The system can further include a timestamp tracker component that tracks the maximum observed timestamp across all partitions for each batch, and sends this to each partition. The system can distribute partitions of the events to the worker nodes, and instruct a heartbeat propagator component to generate a heartbeat for a first worker node corresponding to an event in a different partition. The system receives outputs from the worker nodes and combines these into a single result corresponding to a continuous query. The system can further implement a timestamp tracker to select a highest timestamp value of a previous batch, and send the value to the worker nodes.

Abstract: An event processing system for distributing a continuous query, and processing events in an event stream, is disclosed. The system can synchronize timestamps across all partitions by adding a heartbeat propagator component propagating a heartbeat signal for silent partitions. The system can further include a timestamp tracker component that tracks the maximum observed timestamp across all partitions for each batch, and sends this to each partition. The system can distribute partitions of the events to the worker nodes, and instruct a heartbeat propagator component to generate a heartbeat for a first worker node corresponding to an event in a different partition. The system receives outputs from the worker nodes and combines these into a single result corresponding to a continuous query. The system can further implement a timestamp tracker to select a highest timestamp value of a previous batch, and send the value to the worker nodes.

Abstract: A system and method for dynamic log management of stream processing in a distributed computing environment, such as, for example, a streaming application or stream analytics system. A streaming application can be deployed or published to a cluster, to execute as a client application. A cluster manager coordinates with worker nodes, to commit tasks associated with the streaming application. If a need arises to generate lower-level log data associated with the streaming application, for example to diagnose an underlying cause of a warning/error message, a configuration job can be committed to the cluster to execute as a separate log-configuration application. The log-configuration application operates with the cluster manager to determine the set of working nodes currently associated with the streaming application, and modify the logger configuration at those nodes, to record or otherwise provide log data according to a modified logging level, for example to provide lower-level log messages.

Abstract: An event processing system for distributing geospatial computations with geo-fences is disclosed. The system can partition and distribute geo-fences efficiently for parallel computation, and can track a potentially unlimited number of moving objects. A computing device determines a minimum bounding rectangle (MBR) covering a geographic area indexed by a geo-grid, and partitions the MBR and a set of geo-fences to a plurality of processing nodes. The computing device receives input events of a stream comprising locations within the geographic area. The device distributes the events to partitions on processing nodes, based at least on the events' locations. The device can determine a partition identifier corresponding to a respective location in constant time. The computing device then combines partition results to obtain a single geospatial computation result.

Abstract: An event processing system for distributing geospatial computations with geo-fences is disclosed. The system can partition and distribute geo-fences efficiently for parallel computation, and can track a potentially unlimited number of moving objects. A computing device determines a minimum bounding rectangle (MBR) covering a geographic area indexed by a geo-grid, and partitions the MBR and a set of geo-fences to a plurality of processing nodes. The computing device receives input events of a stream comprising locations within the geographic area. The device distributes the events to partitions on processing nodes, based at least on the events' locations. The device can determine a partition identifier corresponding to a respective location in constant time. The computing device then combines partition results to obtain a single geospatial computation result.

Abstract: An event processing system for distributing a geospatial computation, and processing events in an event stream, is disclosed. The disclosed system and methods can apply a spatial function, such as distance, within Distance, and proximity, in parallel to a stream comprising event locations. The disclosed system improves over existing geospatial computations by providing an efficient parallel implementation that can handle a large number of moving objects in real time with little latency. A computing device receives an event stream comprising locations and can geohash the locations to obtain geohashes identifying geo grid cells containing the locations. The computing device can determine respective sets of neighboring geohashes identifying neighboring cells in the geo grid. The computing device then partitions the geospatial computation by mapping, based on the respective geo hash and the respective set of neighboring geo hashes, the events to processors.

Abstract: An event processing system for distributing a continuous query, and processing events in an event stream, is disclosed. The system can synchronize timestamps across all partitions by adding a heartbeat propagator component propagating a heartbeat signal for silent partitions. The system can further include a timestamp tracker component that tracks the maximum observed timestamp across all partitions for each batch, and sends this to each partition. The system can distribute partitions of the events to the worker nodes, and instruct a heartbeat propagator component to generate a heartbeat for a first worker node corresponding to an event in a different partition. The system receives outputs from the worker nodes and combines these into a single result corresponding to a continuous query. The system can further implement a timestamp tracker to select a highest timestamp value of a previous batch, and send the value to the worker nodes.

Abstract: An event processing system for distributing geospatial computations with geo-fences is disclosed. The system can partition and distribute geo-fences efficiently for parallel computation, and can track a potentially unlimited number of moving objects. A computing device determines a minimum bounding rectangle (MBR) covering a geographic area indexed by a geo-grid, and partitions the MBR and a set of geo-fences to a plurality of processing nodes. The computing device receives input events of a stream comprising locations within the geographic area. The device distributes the events to partitions on processing nodes, based at least on the events' locations. The device can determine a partition identifier corresponding to a respective location in constant time. The computing device then combines partition results to obtain a single geospatial computation result.

Abstract: An event processing system for distributing geospatial computations with geo-fences is disclosed. The system can partition and distribute geo-fences efficiently for parallel computation, and can track a potentially unlimited number of moving objects. A computing device determines a minimum bounding rectangle (MBR) covering a geographic area indexed by a geo-grid, and partitions the MBR and a set of geo-fences to a plurality of processing nodes. The computing device receives input events of a stream comprising locations within the geographic area. The device distributes the events to partitions on processing nodes, based at least on the events' locations. The device can determine a partition identifier corresponding to a respective location in constant time. The computing device then combines partition results to obtain a single geospatial computation result.

Abstract: Techniques for embedded event processing are provided. In some examples, instructions for executing at least a subset of complex event processing features may be received. A stream of events received by the edge computing device may be identified. Additionally, the events of the stream utilizing the subset of complex event processing features may be processed. Further, in some aspects, the processed events may be provided to a complex event platform of a server.

Abstract: Techniques for embedded event processing are provided. In some examples, instructions for executing at least a subset of complex event processing features may be received. A stream of events received by the edge computing device may be identified. Additionally, the events of the stream utilizing the subset of complex event processing features may be processed. Further, in some aspects, the processed events may be provided to a complex event platform of a server.