Abstract: A data processing and analysis system that optimizes the resources to be used for data storage and refresh events. A partitioner module for a data analysis system can receive a first client criteria and a first client dataset that includes tabular data and calculate scores that are used to generate partitioning strategies. The selected partitioning strategy can be implemented to produce aggregated data that can be stored in an intelligent data mart. The partitions can then be accessed by a data visualization platform for intelligent, dynamic responses to user requests for data analyses and generation of visualizations. By providing synchronous partitioning of data (especially big data) and intelligent refresh, the data can move from the back-end to the front-end with minimal user clicks and minimal latency in performance.

Abstract: A data processing and analysis system that optimizes the resources to be used for data storage and refresh events. A partitioner module for a data analysis system can receive a first client criteria and a first client dataset that includes tabular data and calculate scores that are used to generate partitioning strategies. The selected partitioning strategy can be implemented to produce aggregated data that can be stored in an intelligent data mart. The partitions can then be accessed by a data visualization platform for intelligent, dynamic responses to user requests for data analyses and generation of visualizations. By providing synchronous partitioning of data (especially big data) and intelligent refresh, the data can move from the back-end to the front-end with minimal user clicks and minimal latency in performance.