Abstract: Disclosed herein is a computer-implemented method for the ingestion of data into a partitioned database, the method comprising: receiving data at at least one ingestion node of a graph database, storing the data as a disjoint set of vertices, in a partitioned database, analyzing the disjoint set of vertices to find a set of remote edges and a set of native edges, and storing the set of remote edges and the set of native edges as a set of disjointed vertices in the partitioned database.

Abstract: Techniques for generating a stream processing pipeline are provided. In one embodiment, a method includes generating a plurality of pipeline stages of a stream processing pipeline in accordance with a configuration file. The plurality of pipeline stages includes a first processing stage designated for a first data service and a second processing stage designated for a second data service and operating in parallel to the first processing stage.

Abstract: Techniques for providing virtualized entity-related services to a group of users are provided. The techniques include collecting entity-related data from multiple cloud providers. The data is collected via a data stream. Various portions of the data stream are stored in various databases. A portion of the data stream is stored in a graph database that stores relationships between the entities. A portion of the data stream is stored in a key-value database that persistently stores historical virtualized entity data for the group of users. A portion of the data stream is stored in a reverse-indexed database that stores globally-searchable entity data for the entities. A search query is received. Based on the content of the query, a combination of the databases searched. Search results are compared to policies or rules of the group. If an entity is out of compliance, a warning is issued and remedial action taken.

Abstract: Techniques for generating a stream processing pipeline are provided. In one embodiment, a method includes generating a plurality of pipeline stages of a stream processing pipeline in accordance with a configuration file. The plurality of pipeline stages includes a first processing stage designated for a first data service and a second processing stage designated for a second data service and operating in parallel to the first processing stage.

Abstract: Techniques for generating a stream processing pipeline are provided. In one embodiment, a method includes generating a plurality of pipeline stages of a stream processing pipeline in accordance with a configuration file. The plurality of pipeline stages includes a first processing stage designated for a first data service and a second processing stage designated for a second data service and operating in parallel to the first processing stage.

Abstract: Techniques for generating a stream processing pipeline are provided. In one embodiment, a method includes receiving a configuration file from a data service. The configuration file represents a pipeline configuration of the stream processing pipeline, and the pipeline configuration includes representations of a plurality of different types of pipeline stages configured based on a respective customization of an entity. The method further includes generating a plurality of pipeline stages in accordance with the pipeline configuration of the stream processing pipeline; collecting, at one or more pipeline stages of a first-type in the stream processing pipeline, data items from one or more data sources; processing the collected data items at one or more pipeline stages of a second-type in the stream processing pipeline; and transmitting, at one or more pipeline stages of a third-type in the stream processing pipeline, the processed data items to the data service.

Abstract: Techniques for generating a stream processing pipeline are provided. In one embodiment, a method includes generating a plurality of pipeline stages of a stream processing pipeline in accordance with a configuration file. The plurality of pipeline stages includes a first processing stage designated for a first data service and a second processing stage designated for a second data service and operating in parallel to the first processing stage.

Abstract: Techniques for generating a stream processing pipeline are provided. In one embodiment, a method includes generating a plurality of pipeline stages of a stream processing pipeline in accordance with a configuration file. The plurality of pipeline stages includes a first buffer stage designated for a first data service and a second buffer stage designated for a second data service. The method further includes collecting data items; processing the collected data items; and storing at least a portion of the processed data items in the first buffer stage and at least a portion of the processed data items in the second buffer stage. The method further includes transmitting the data items stored in the first buffer stage to the first data service at a first transmission rate; and transmitting the data items stored in the second buffer stage to the second data service at a second transmission rate.

Abstract: Techniques for generating a stream processing pipeline are provided. In one embodiment, a method includes receiving a configuration file from a data service. The configuration file represents a pipeline configuration of the stream processing pipeline, and the pipeline configuration includes representations of a plurality of different types of pipeline stages configured based on a respective customization of an entity. The method further includes generating a plurality of pipeline stages in accordance with the pipeline configuration of the stream processing pipeline; collecting, at one or more pipeline stages of a first-type in the stream processing pipeline, data items from one or more data sources; processing the collected data items at one or more pipeline stages of a second-type in the stream processing pipeline; and transmitting, at one or more pipeline stages of a third-type in the stream processing pipeline, the processed data items to the data service.

Abstract: Techniques for generating a stream processing pipeline are provided. In one embodiment, a method includes generating a plurality of pipeline stages of a stream processing pipeline in accordance with a configuration file. The plurality of pipeline stages includes a first buffer stage designated for a first data service and a second buffer stage designated for a second data service. The method further includes collecting data items; processing the collected data items; and storing at least a portion of the processed data items in the first buffer stage and at least a portion of the processed data items in the second buffer stage. The method further includes transmitting the data items stored in the first buffer stage to the first data service at a first transmission rate; and transmitting the data items stored in the second buffer stage to the second data service at a second transmission rate.