Abstract: A new approach is proposed to support grouping and storing a data stream based on the types of data items in the stream for efficient data batch processing and analysis. First, the data stream is uploaded to a cloud storage, wherein the stream of data includes a plurality of data items of different types generated by and collected from different users and/or devices. The data items are then retrieved, grouped and saved by a preprocessing unit into a plurality of batch data queues, wherein data items in each batch data queue are of the same type. One or more batch processing units are then configured to fetch and batch process data items from the batch data queues and store these data items of the same data type to one or more cloud storage files for further processing and analysis on the cloud storage one batch data queue at a time.

Abstract: A new approach is proposed to support grouping and storing a data stream based on the types of data items in the stream for efficient data batch processing and analysis. First, the data stream is uploaded to a cloud storage, wherein the stream of data includes a plurality of data items of different types generated by and collected from different users and/or devices. The data items are then retrieved, grouped and saved by a preprocessing unit into a plurality of batch data queues, wherein data items in each batch data queue are of the same type. One or more batch processing units are then configured to fetch and batch process data items from the batch data queues and store these data items of the same data type to one or more cloud storage files for further processing and analysis on the cloud storage one batch data queue at a time.