Abstract: An apparatus comprises a processing platform implementing a data set discovery engine and a data set valuation engine. The data set discovery engine is configured to generate data set similarity measures each relating a corresponding one of a plurality of data sets to one or more other ones of the plurality of data sets. The data set valuation engine is coupled to the data set discovery engine and configured to generate valuation measures for respective ones of at least a subset of the plurality of data sets based at least in part on respective ones of the data set similarity measures generated by the data set discovery engine. For example, the data set valuation engine may generate the valuation measure for a given data set as a function of valuation measures previously generated for respective other data sets determined to exhibit at least a threshold similarity to the given data set.

Abstract: An apparatus in one embodiment comprises a processing platform having one or more processing devices. The processing platform is configured to obtain metadata characterizing a plurality of data sets, to generate data set operational signatures for respective ones of at least a subset of the data sets based at least in part on the obtained metadata, and to automatically perform one or more management operations for each of one or more of the data sets based at least in part on respective corresponding ones of the data set operational signatures. The processing platform may be further configured to implement a target signature for a particular data set management policy, and to automatically perform a particular management operation for a given one of the data sets based at least in part on a result of a comparison of the data set operational signature for the given data set to the target signature.

Abstract: An apparatus in one embodiment comprises an ingestion manager, a plurality of ingestion engines associated with the ingestion manager, and an analytics platform configured to receive data from the ingestion engines under the control of the ingestion manager. The ingestion manager is configured to interact with one or more of the ingestion engines in conjunction with providing data to a given one of a plurality of analytics workspaces of the analytics platform. For example, the analytics workspaces of the analytics platform are illustratively configured to receive data from respective potentially disjoint subsets of the ingestion engines under the control of the ingestion manager. Additionally or alternatively, the ingestion manager may be configured to implement data-as-a-service functionality for one or more of the analytics workspaces of the analytics platform.

Abstract: An apparatus in one embodiment comprises a processing platform comprising one or more processing devices. The processing platform implements a database configured to store metric and level information for each of a plurality of models, and a metric mapper adapted to interface with the database. The metric mapper is configured to utilize the metric and level information stored in the database to establish an association between a first metric characterizing at least one of a workload and a resource in accordance with a first one of the models and a second metric characterizing at least one of a workload and a resource in accordance with a second one of the models. The established association is illustratively applied to relate service requirements specified at least in part using the first metric of the first model to service capabilities specified at least in part using the second metric of the second model.

Abstract: An apparatus comprises a processing platform configured for integration of compliance and analytic environments. The compliance and analytic environments are implemented at least in part by the processing platform. The processing platform comprises at least a portion of a data lake at least partially shared between the compliance and analytic environments. The processing platform further comprises one or more integration mechanisms supporting interaction between the compliance and analytic environments via the data lake.

Abstract: An apparatus in one embodiment comprises a processing platform implementing an Internet of Things (IoT) distributed management system accessible to a plurality of user devices over at least one network. The processing platform is configured to determine IoT infrastructure for a given IoT deployment in at least one particular usage context, to control placement of multiple workflow processes for the IoT deployment over a plurality of distributed locations within the IoT infrastructure, and to manage execution of the workflow processes at the distributed locations in accordance with one or more constraints of the particular usage context. The IoT deployment comprises one or more IoT platforms each configured to interact with a different set of IoT devices. The placement of multiple workflow processes over the plurality of distributed locations illustratively provides a designated distribution of data, services, applications and analytics for the IoT deployment in the particular usage context.

Abstract: An apparatus in one embodiment comprises a processing platform implementing a data set discovery engine. The data set discovery engine comprises a data set indexer configured to generate similarity indexes for a plurality of data sets, and a relativistic retriever coupled to the data set indexer and configured to obtain a suitability template for a query and to execute the query against one or more of the similarity indexes based at least in part on the suitability template. A given one of the similarity indexes comprises at least first and second auxiliary information generated from respective ones of at least first and second different similarity measures of a plurality of different similarity measures. The first and second similarity measures comprise selected ones of the plurality of different similarity measures that are supported by the data set discovery engine with the supported similarity measures comprising both frequency-based and non-frequency-based similarity measures.

Abstract: An apparatus in one embodiment comprises an analytics platform and a controller. The controller is associated with the analytics platform and configured to control automated deployment of analytics workspaces of the analytics platform. The analytics platform includes or otherwise has access to sets of at least data ingestion engines, data containers, analytics tools and virtual resources. The controller is configured to deploy a given one of the analytics workspaces of the analytics platform as an at least partially user-specified combination of particular selected ones of the data ingestion engines, data containers, analytics tools and virtual resources. The controller may additionally be configured to monitor usage of the combination of particular selected ones of the data ingestion engines, data containers, analytics tools and virtual resources of the given analytics workspace, and to alter the combination responsive to the monitoring.

Abstract: A data classification system is associated with a hybrid cloud comprising at least one private cloud and at least one public cloud. The data classification system comprises a data set classification model classifying data sets, a cloud classification model classifying the private and public clouds of the hybrid cloud, and mapping policies each specifying a particular mapping between one or more classes of the data set classification model and one or more classes of the cloud classification model. The data classification system classifies a received data set using the data set classification model, and determines for the received data set at least one cloud of the hybrid cloud to which the received data set should be directed for further processing based at least in part on a result of the classification of the received data set, the cloud classification model and a selected one of the mapping policies.

Abstract: Example embodiments of the present invention relate to a method, a system, and a computer program product for federated service requests of a logical data store comprising a plurality of heterogeneous data stores. The method includes providing a data abstraction services layer as a control plane for federated service requests of a logical data store, comprising a plurality of heterogeneous data stores, by an application operating on a processing device, receiving a service request at the data abstraction services layer from the application operating on the processing device directed to the logical data store, and returning results of the service request from the data abstraction services layer to the application operating on the processing device.

Abstract: An apparatus in one embodiment comprises an ingestion manager, a plurality of ingestion engines associated with the ingestion manager, and an analytics platform configured to receive data from the ingestion engines under the control of the ingestion manager. The ingestion manager is configured to interact with one or more of the ingestion engines in conjunction with providing data to a given one of a plurality of analytics workspaces of the analytics platform. For example, the analytics workspaces of the analytics platform are illustratively configured to receive data from respective potentially disjoint subsets of the ingestion engines under the control of the ingestion manager. Additionally or alternatively, the ingestion manager may be configured to implement data-as-a-service functionality for one or more of the analytics workspaces of the analytics platform.

Abstract: Example embodiments of the present invention include a method, a system, and a computer program product for provisioning a computing system in accordance with an automated data analytics lifecycle. The method includes defining a holistic context of an analytics lifecycle for an analytic problem. One or more data sets for solving the analytic problem and at least a portion of original data in the one or more data sets may be conditioned to generate conditioned data. The method also includes selecting a model to analyze at least one of the original data and the conditioned data and executing the selected model on at least one of a portion of the original data and a portion of the conditioned data to confirm an adequacy of the selected model. Results of execution may be communicated to at least one entity for provisioning computing resources to implement the selected model.

Abstract: A data storage system comprises a storage array and an associated indexer that may be implemented in whole or in part within the storage array. The storage array comprises storage devices and a controller. The indexer associated with the storage array is configured to generate indexes over data stored in the storage array. The controller comprises a query processing control point configured to utilize the indexes generated by the indexer to accelerate execution of queries directed to the data stored in the storage array. The indexes may be stored in a high-speed memory of the storage array, such as flash memory. The queries executed in the storage array may comprise analytic queries that would otherwise normally be executed in an analytic data store external to the storage array. By providing index-based processing of the queries within the storage array, query processing throughput of the data storage system is substantially improved.

Abstract: Example embodiments of the present invention provide a method, an apparatus, and a computer program product for scalable monitoring and error handling in multi-latency systems. The method includes gathering events from a multi-latency logical data store comprising a first data store having a first data latency and a second related data store having a second data latency substantially different than the first data latency. Processing then may be performed on the gathered events, with notification of the processed events provided toward downstream queues for consumption. In certain embodiments, consumption comprises holistic error handling; according, in those embodiments holistic error handling of the multi-latency logical data store may be performed according to the notification of the processed gathered events asynchronously from gathering events from the multi-latency logical data store.

Abstract: A data management system comprises a multi-latency logical data store and an associated controller. The multi-latency logical data store comprises a first data store having a first data latency and a second data store having a second data latency substantially different than the first data latency. The controller is configured to manage the multi-latency logical data store utilizing multi-latency data sets each of which provides at least one multi-latency link between at least a portion of a data set from the first data store and at least a portion of a data set from the second data store. By way of example, the first data store may comprise a low-latency data store and the second data store may comprise an analytic data store having a substantially higher data latency than the low-latency data store. The data management system is implemented using one or more processing devices of a processing platform.

Abstract: A processing device of an information processing system is configured to detect bursts of activity associated with a particular user, to map the bursts to tasks performed by the user, to generate a user model based on the mapping of bursts to tasks, and to provide personalized query processing to the user based on the user model. The user model may comprise a Hidden Markov Model. In one embodiment, a query is received from the user in a current time window, and a model parameter is obtained. Based on the model parameter, a most likely task for the user in the current time window is identified, and based on the query, the most likely task, and user classification, search results are ranked for presentation to the user. The processing device may be configured to communicate the user model to a cloud service provider, and to receive from the cloud service provider the ranked search results determined based on the user model.

Abstract: A computer implemented method, system and product comprising establishing a lease contract for an analytic subscription, defining an analytic subscription as an evaluation that is passed to a provider that provides a Boolean evaluation model and a potential true/false event expression, receiving, via the bus, events from the systems of records until the expiration of the lease; and rejecting during a specified period of time events received from the systems of record after the expiration of the lease period.

Abstract: A computer implemented method, system and product for transferring information between systems of record connected to a bus comprising generating an event in response a change in a system of record of the systems of record; transforming the change event into a generic event at an adapter for the system of record, wherein the adapter is communicatively coupled to the system of record and the bus; conveying the generic event to the bus from the adapter; reasoning on the generic event to determine if at least some information of the generic event should be propagated to another system of record; based on a positive determination, using a policy based system of record information filter to determine what information of the event to send to the another system of record, and propagating at least some of the information of the generic event in a new event to another adapter communicatively coupled to the another system of record; and translating the new event, at the adapter, to an event able to be understood by the

Abstract: A reasoning system is configured to interact with data processing elements of an information processing system. The reasoning system includes a reasoning module configured to perform one or more reasoning operations on metadata. The metadata characterizes data sets associated with the data processing elements in order to identify at least selected portions of one or more of the data sets as being suitable for use in achieving a designated purpose. The reasoning system also includes a dynamic information assembly module configured to utilize results of the one or more reasoning operations to assemble at least a subset of the selected portions so as to achieve the designated purpose. The reasoning system and associated data processing elements may be implemented, by way of example, in cloud infrastructure of a cloud service provider, or on another type of processing platform.

Abstract: A computer implemented method, system and product for transferring information between systems of record connected to a bus comprising generating an event in response a change in a system of record of the systems of record, transforming the change event into a generic event at an adaptor for the system of record; wherein the adapter is communicatively coupled to the system of record and the bus, conveying the generic event to the bus from the adapter, reasoning on the generic event to determine if at least some information of the generic event should be propagated to another system of record and based on a positive determination, propagating at least some of the information of the generic event in a new event to another adapter communicatively coupled to the another system of record; and translating the new event, at the adapter, to an event able to be understood by the another system of record.