Abstract: A computer system identifies high-value information in data streams. The computer system receives a receiving a plurality of data streams. Each of the data streams includes a plurality of posts. Each of the posts includes a content portion and one or more source characteristics, In real time, for each post in a particular data stream: the system assigns the post a post identifier; generates a content packet and one or more source packets; queries memory to access a source profile using a respective source identifier included in the content packet; correlates the content packet with information from the source profile to produce a correlated content packet; and broadcasts the correlated content packet to a plurality of filter graph definitions.

Abstract: A computer system identifies high-value information in data streams. The computer system receives a filter graph definition. The filter graph definition includes a plurality of filter nodes, each filter node including one or more filters that accept or reject packets. Each respective filter is categorized by a number of operations, and the one or more filters are arranged in a general graph. The computer system performs one or more optimization operations, including: determining if a closed circuit exists within the graph, and when the closed circuit exists within the graph, removing the closed circuit; reordering the filters based at least in part on the number of operations; and parallelizing the general graph such that the one or more filters are configured to be executed on one or more processors.

Abstract: A computer system identifies high-value information in data streams. The computer system receives a plurality of filter graph definitions. Each of the filter graph definitions includes a plurality of filter nodes arranged in a two-dimensional graph by a plurality of graph edges. Each filter node is configured to accept or reject individual packets in a data stream based on content and/or metadata information associated with the individual packet. The system prepares the filter graph for execution. In response to receiving a data stream with a plurality of packets, the system distributes the packets to inputs of each of the executable filter graph definitions. The system identifies, using the executable filter graph definitions, packets with high-value information based on parallel execution of the filter nodes included in the respective filter graph definition.