Abstract: A method includes receiving data packets from a stream partition of a plurality of stream partitions, processing the data packets with a plurality of stream processors to generate multiple table entries, transmitting the multiple table entries in batches to a plurality of staging tables, the plurality of staging tables being provided for a respective one of the plurality of stream partitions, and receiving the batches at a target table communicatively coupled to the plurality of staging tables, the batches being transmitted from the plurality of staging tables. The plurality of staging tables are updated in first batches at a first frequency and the target table is updated in second batches at a second frequency, the second frequency being different than the first frequency.

Abstract: A system includes a stream partition manager configured to receive data packets input from a plurality of actors, the actors including virtual representations of physical devices, and partition the data packets into a number of stream partitions based at least in part on one or more criteria. The system further includes a plurality of stream processors communicatively coupled to the stream partition manager. Individual stream processors of the plurality of stream processors being configured to receive data packets from a stream partition of the number of stream partitions, process the data packets to generate multiple table entries, and transmit the multiple table entries in batches. The system further includes a target table communicatively coupled to the plurality of stream processors. The target table is configured to receive and store the batches received from the individual stream processors.

Abstract: A system includes a stream partition manager configured to receive data packets input from a plurality of actors, the actors including virtual representations of physical devices, and partition the data packets into a number of stream partitions based at least in part on one or more criteria. The system further includes a plurality of stream processors communicatively coupled to the stream partition manager. Individual stream processors of the plurality of stream processors being configured to receive data packets from a stream partition of the number of stream partitions, process the data packets to generate multiple table entries, and transmit the multiple table entries in batches. The system further includes a target table communicatively coupled to the plurality of stream processors. The target table is configured to receive and store the batches received from the individual stream processors.

Abstract: Techniques for publishing data that is generated outside a service provider to a data store that is located within the service provider are described. For example, a device may implement a first communication protocol to provide a service. The device may generate log data and/or metric data indicating an event that occurred while performing the service, such as a time when an operation was performed, an error that occurred, a number of errors that have occurred, etc. The device may provide the log data and/or metric data to the service provider, which may implement a second communication protocol or otherwise be associated with a different environment. The service provider may store the log data and/or metric data in the data store that is associated with the service provider. Such process may be repeated for any number of devices that operate separately from the service provider.

Abstract: Techniques for publishing data that is generated outside a service provider to a data store that is located within the service provider are described. For example, a device may implement a first communication protocol to provide a service. The device may generate log data and/or metric data indicating an event that occurred while performing the service, such as a time when an operation was performed, an error that occurred, a number of errors that have occurred, etc. The device may provide the log data and/or metric data to the service provider, which may implement a second communication protocol or otherwise be associated with a different environment. The service provider may store the log data and/or metric data in the data store that is associated with the service provider. Such process may be repeated for any number of devices that operate separately from the service provider.