Abstract: A method includes receiving a first post from an electronic source including first content; determining a source identifier; determining an attribute for the source by broadcasting the first post to a first plurality of filter graph definitions configured to identify attributes of sources according to the respective filter graph definition; and storing in memory, as a source profile identified by the source identifier for the source, the attribute for the source; receiving a second post from the source including second content; determining a source identifier; using the source identifier, querying the memory to access the source profile; correlating the second post with attributes of the source stored in the source profile to produce a correlated second post; and broadcasting the correlated second post to a second plurality of filter graph definitions configured to identify posts with high value information according to the respective filter graph definition.

Abstract: A computer system receives a data stream with a plurality of packets. In response to receiving the data stream with the plurality of packets, the computer system distributes individual packets of the plurality of packets to the inputs of each of a plurality of processing nodes. Each respective processing node has a local queue storing a respective number of packets to be processed by the respective processing node. Distributing a respective packet of the plurality of packets to the inputs of each of the plurality of processing nodes includes delaying sending the respective packet to each of the plurality of processing nodes by a delay time that is a non-linear function of an average number of packets in the local queues of the respective processing nodes.

Abstract: A method includes receiving a first post from an electronic source including first content; determining a source identifier; determining an attribute for the source by broadcasting the first post to a first plurality of filter graph definitions configured to identify attributes of sources according to the respective filter graph definition; and storing in memory, as a source profile identified by the source identifier for the source, the attribute for the source; receiving a second post from the source including second content; determining a source identifier; using the source identifier, querying the memory to access the source profile; correlating the second post with attributes of the source stored in the source profile to produce a correlated second post; and broadcasting the correlated second post to a second plurality of filter graph definitions configured to identify posts with high value information according to the respective filter graph definition.

Abstract: A computer system receives a data stream with a plurality of packets. In response to receiving the data stream with the plurality of packets, the computer system distributes individual packets of the plurality of packets to the inputs of each of a plurality of processing nodes. Each respective processing node has a local queue storing a respective number of packets to be processed by the respective processing node. Distributing a respective packet of the plurality of packets to the inputs of each of the plurality of processing nodes includes delaying sending the respective packet to each of the plurality of processing nodes by a delay time that is a non-linear function of an average number of packets in the local queues of the respective processing nodes.

Abstract: A computer system receives a data stream with a plurality of packets. In response to receiving the data stream with the plurality of packets, the computer system distributes individual packets of the plurality of packets to the inputs of each of a plurality of processing nodes. Each respective processing node has a local queue storing a respective number of packets to be processed by the respective processing node. Distributing a respective packet of the plurality of packets to the inputs of each of the plurality of processing nodes includes delaying sending the respective packet to each of the plurality of processing nodes by a delay time that is a non-linear function of an average number of packets in the local queues of the respective processing nodes.

Abstract: A method includes receiving a first post from an electronic source including first content; determining a source identifier; determining an attribute for the source by broadcasting the first post to a first plurality of filter graph definitions configured to identify attributes of sources according to the respective filter graph definition; and storing in memory, as a source profile identified by the source identifier for the source, the attribute for the source; receiving a second post from the source including second content; determining a source identifier; using the source identifier, querying the memory to access the source profile; correlating the second post with attributes of the source stored in the source profile to produce a correlated second post; and broadcasting the correlated second post to a second plurality of filter graph definitions configured to identify posts with high value information according to the respective filter graph definition.

Abstract: A computer system receives a data stream with a plurality of packets. In response to receiving the data stream with the plurality of packets, the computer system distributes individual packets of the plurality of packets to the inputs of each of a plurality of processing nodes. Each respective processing node has a local queue storing a respective number of packets to be processed by the respective processing node. Distributing a respective packet of the plurality of packets to the inputs of each of the plurality of processing nodes includes delaying sending the respective packet to each of the plurality of processing nodes by a delay time that is a non-linear function of an average number of packets in the local queues of the respective processing nodes.

Abstract: A computer system performs a continuous monitoring process for a data stream that includes a plurality of packets. The continuous monitoring process includes, without user intervention, distributing the plurality of packets to an input of a filter. The filter is configured to accept individual packets according to a filter graph definition. The process further includes identifying packets as accepted according to the filter graph definition. While performing the continuous monitoring process, the system repeatedly inserts instances of a debugging packet into the data stream for distribution to the input of the filter. The debugging packet is configured to be accepted by the filter. For each debugging packet, the system determines whether the debugging packet was accepted by the filter. When the respective debugging packet was not accepted by the filter, the system reports a problem with performance of the continuous monitoring process for the data stream.

Abstract: A computer system performs a continuous monitoring process for a data stream that includes a plurality of packets. The continuous monitoring process includes, without user intervention, distributing the plurality of packets to an input of a filter. The filter is configured to accept individual packets according to a filter graph definition. The process further includes identifying packets as accepted according to the filter graph definition. While performing the continuous monitoring process, the system repeatedly inserts instances of a debugging packet into the data stream for distribution to the input of the filter. The debugging packet is configured to be accepted by the filter. For each debugging packet, the system determines whether the debugging packet was accepted by the filter. When the respective debugging packet was not accepted by the filter, the system reports a problem with performance of the continuous monitoring process for the data stream.

Abstract: A computer system identifies high-value information in data streams. The computer system receives a filter graph definition. The filter graph definition includes a plurality of filter nodes, each filter node including one or more filters that accept or reject packets. Each respective filter is categorized by a number of operations, and the one or more filters are arranged in a general graph. The computer system performs one or more optimization operations, including: determining if a closed circuit exists within the graph, and when the closed circuit exists within the graph, removing the closed circuit; reordering the filters based at least in part on the number of operations; and parallelizing the general graph such that the one or more filters are configured to be executed on one or more processors.

Abstract: A computer system identifies high-value information in data streams. The computer system receives a plurality of filter graph definitions. Each of the filter graph definitions includes a plurality of filter nodes arranged in a two-dimensional graph by a plurality of graph edges. Each filter node is configured to accept or reject individual packets in a data stream based on content and/or metadata information associated with the individual packet. The system prepares the filter graph for execution. In response to receiving a data stream with a plurality of packets, the system distributes the packets to inputs of each of the executable filter graph definitions. The system identifies, using the executable filter graph definitions, packets with high-value information based on parallel execution of the filter nodes included in the respective filter graph definition.

Abstract: A computer system identifies high-value information in data streams. The computer system receives a receiving a plurality of data streams. Each of the data streams includes a plurality of posts. Each of the posts includes a content portion and one or more source characteristics, In real time, for each post in a particular data stream: the system assigns the post a post identifier; generates a content packet and one or more source packets; queries memory to access a source profile using a respective source identifier included in the content packet; correlates the content packet with information from the source profile to produce a correlated content packet; and broadcasts the correlated content packet to a plurality of filter graph definitions.

Abstract: A computer system identifies high-value information in data streams. The computer system receives a receiving a plurality of data streams. Each of the data streams includes a plurality of posts. Each of the posts includes a content portion and one or more source characteristics, In real time, for each post in a particular data stream: the system assigns the post a post identifier; generates a content packet and one or more source packets; queries memory to access a source profile using a respective source identifier included in the content packet; correlates the content packet with information from the source profile to produce a correlated content packet; and broadcasts the correlated content packet to a plurality of filter graph definitions.

Abstract: A computer system identifies high-value information in data streams. The computer system receives a plurality of filter graph definitions. Each of the filter graph definitions includes a plurality of filter nodes arranged in a two-dimensional graph by a plurality of graph edges. Each filter node is configured to accept or reject individual packets in a data stream based on content and/or metadata information associated with the individual packet. The system prepares the filter graph for execution. In response to receiving a data stream with a plurality of packets, the system distributes the packets to inputs of each of the executable filter graph definitions. The system identifies, using the executable filter graph definitions, packets with high-value information based on parallel execution of the filter nodes included in the respective filter graph definition.

Abstract: A computer system identifies high-value information in data streams. The computer system receives a filter graph definition. The filter graph definition includes a plurality of filter nodes, each filter node including one or more filters that accept or reject packets. Each respective filter is categorized by a number of operations, and the one or more filters are arranged in a general graph. The computer system performs one or more optimization operations, including: determining if a closed circuit exists within the graph, and when the closed circuit exists within the graph, removing the closed circuit; reordering the filters based at least in part on the number of operations; and parallelizing the general graph such that the one or more filters are configured to be executed on one or more processors.