Abstract: Methods and systems for maintaining a materialized view defined on a relation of a relational database include providing a materialized view maintenance system implemented in a computing device having at least a processor and a memory device. It is determined whether an update to a base relation is irrelevant with respect to the materialized view by performing content-based filtering on the base relation using the materialized view maintenance system. An estimate of at least one of an importance and an effect of the update to the base relation is generated. One or both of performing a load shedding operation on the relational database based upon the estimate and quantifying the effect of the update being omitted from the materialized view based on the estimate is performed. The maintained materialized view is displayed so as to exclude determined irrelevant updates.

Abstract: Methods and systems for maintaining a materialized view defined on a relation of a relational database include providing a materialized view maintenance system implemented in a computing device having at least a processor and a memory device. It is determined whether an update to a base relation is irrelevant with respect to the materialized view by performing content-based filtering on the base relation using the materialized view maintenance system. An estimate of at least one of an importance and an effect of the update to the base relation is generated. One or both of performing a load shedding operation on the relational database based upon the estimate and quantifying the effect of the update being omitted from the materialized view based on the estimate is performed. The maintained materialized view is displayed so as to exclude determined irrelevant updates.

Abstract: There are provided a system and method for resource adaptive, real-time new event detection. The method includes capturing, from among documents in a document streaming environment that includes a plurality of remote streaming document sources, first-story documents. The method further includes storing any of the documents determined to be the first-story documents in a memory. The method also includes classifying the documents as important or non-important based on pre-specified criteria. The method additionally includes storing, in the memory, only information of the documents classified as important, when the memory overflows. The method further includes discarding the documents that are classified as non-important when a document consumption rate from the memory is less than a document insertion rate into the memory. The method additionally includes removing the information of the documents classified as important from the memory subsequent to one of consumption and processing by a consumer.

Abstract: There are provided a method, a computer program product, and a system for maintaining a materialized view defined on a relation of a relational database. The method includes the step of performing content-based filtering on the relation to identify an update to the relation as being irrelevant with respect to the materialized view.

Abstract: Range query techniques are disclosed for use in accordance with data stream processing systems. A technique is provided for incrementally processing continual range queries against moving objects. This technique is applicable for location-aware services and applications. A technique for evaluating one or more continual range queries over one or more moving objects comprises maintaining a query index with one or more containment-encoded virtual constructs associated with the one or more continual range queries over the one or more moving objects, and incrementally evaluating the one or more continual range queries using the query index.

Abstract: Range query techniques are disclosed for use in accordance with data stream processing systems. A technique is provided for incrementally processing continual range queries against moving objects. This technique is applicable for location-aware services and applications. A technique for evaluating one or more continual range queries over one or more moving objects comprises maintaining a query index with one or more containment-encoded virtual constructs associated with the one or more continual range queries over the one or more moving objects, and incrementally evaluating the one or more continual range queries using the query index.

Abstract: Range query techniques are disclosed for use in accordance with data stream processing systems. A technique is provided for incrementally processing continual range queries against moving objects. This technique is applicable for location-aware services and applications. A technique for evaluating one or more continual range queries over one or more moving objects comprises maintaining a query index with one or more containment-encoded virtual constructs associated with the one or more continual range queries over the one or more moving objects, and incrementally evaluating the one or more continual range queries using the query index.

Abstract: Techniques are disclosed for detecting new events in a video stream that yield improved detection efficiency in real time. For example, a method determines whether a given event is a new event in a video stream. The video stream includes a plurality of events. A first step extracts a first set of features (e.g., text features) from the given event. The first set of features is computationally less expensive to process as compared to a second set of features (e.g., image features) associated with the given event. A second step computes one or more first dissimilarity values between the given event and one or more previous events in the video stream using only the first set of features when one or more first dissimilarity criteria exist. A third step determines whether the given event is a new event based on the one or more computed first dissimilarity values.

Abstract: There are provided a system and method for resource adaptive, real-time new event detection. The method includes capturing, from among documents in a document streaming environment that includes a plurality of remote streaming document sources, first-story documents. The method further includes storing any of the documents determined to be the first-story documents in a memory. The method also includes classifying the documents as important or non-important based on pre-specified criteria. The method additionally includes storing, in the memory, only information of the documents classified as important, when the memory overflows. The method further includes discarding the documents that are classified as non-important when a document consumption rate from the memory is less than a document insertion rate into the memory. The method additionally includes removing the information of the documents classified as important from the memory subsequent to one of consumption and processing by a consumer.

Abstract: Techniques are disclosed for adaptive source filtering and load shedding in such data stream processing systems. For example, in one aspect of the invention, a method for use in filtering data in a distributed data stream processing system, wherein a server receives and processes one or more data streams from one or more data sources, comprises the steps of the server periodically re-configuring one or more filters and sending the one or more periodically re-configured filters to the one or more data sources, and the one or more data sources performing data filtering based on the one or more periodically re-configured filters received from the server.

Abstract: There are provided a system and method for resource adaptive, real-time new event detection. The method includes capturing, from among documents in a document streaming environment, first-story documents that mention previously unmentioned events. The method further includes dynamically adjusting a thoroughness of the capturing step by controlling a number of keywords and documents considered according to a real-time system load.

Abstract: The present invention provides an index structure for managing weighted-sequences in large databases. A weighted-sequence is defined as a two-dimensional structure in which each element in the sequence is associated with a weight. A series of network events, for instance, is a weighted-sequence because each event is associated with a timestamp. Querying a large sequence database by events' occurrence patterns is a first step towards understanding the temporal causal relationships among the events. The index structure proposed herein enables the efficient retrieval from the database of all subsequences (contiguous and non-contiguous) that match a given query sequence both by events and by weights. The index structure also takes into consideration the nonuniform frequency distribution of events in the sequence data.

Abstract: A method (and structure) for monitoring continual range queries against events includes decomposing each range query with one or more predefined virtual constructs, building a query index, and using the query index to match an event with the range queries.

Abstract: Improved privacy preservation techniques are disclosed for use in accordance with data mining. By way of example, a technique for preserving privacy of data records for use in a data mining application comprises the following steps/operations. Different privacy levels are assigned to the data records. Condensed groups are constructed from the data records based on the privacy levels, wherein summary statistics are maintained for each condensed group. Pseudo-data is generated from the summary statistics, wherein the pseudo-data is available for use in the data mining application.

Abstract: A system and method for rights protection of a dataset that includes multiple trajectory objects includes determining an intensity power for embedding a watermarking key in a data trajectory. The data trajectory is modified to embed a watermarking key at the intensity power such that the intensity power guarantees an original pair-wise relationship between distance-based neighboring objects before and after embedding of the key such that a modified trajectory provides a watermarked version of the data trajectory.

Abstract: A storage system includes a plurality of data vats, and a processor including an optimizing unit that optimizes a value of data stored in the storage system. The optimizing unit optimizes the value by computing and implementing an optimal decision for allocating new data to a first data vat of the plurality of data vats, moving existing data from at least a second data vat of the plurality of data vats to the first data vat, and deleting existing data from the first data vat, based on an amount of data in each of the plurality of data vats.

Abstract: Distributed privacy preserving data mining techniques are provided. A first entity of a plurality of entities in a distributed computing environment exchanges summary information with a second entity of the plurality of entities via a privacy-preserving data sharing protocol such that the privacy of the summary information is preserved, the summary information associated with an entity relating to data stored at the entity. The first entity may then mine data based on at least the summary information obtained from the second entity via the privacy-preserving data sharing protocol. The first entity may obtain, from the second entity via the privacy-preserving data sharing protocol, information relating to the number of transactions in which a particular itemset occurs and/or information relating to the number of transactions in which a particular rule is satisfied.

Abstract: Improved privacy preservation techniques are disclosed for use in accordance with data mining. By way of example, a technique for preserving privacy of data records for use in a data mining application comprises the following steps/operations. Different privacy levels are assigned to the data records. Condensed groups are constructed from the data records based on the privacy levels, wherein summary statistics are maintained for each condensed group. Pseudo-data is generated from the summary statistics, wherein the pseudo-data is available for use in the data mining application. Principles of the invention are capable of handling both static and dynamic data sets.

Abstract: Range query techniques are disclosed for use in accordance with data stream processing systems. A technique is provided for incrementally processing continual range queries against moving objects. This may be done for location-aware services and applications. For example, a technique for evaluating one or more continual range queries over one or more moving objects comprises maintaining a query index with one or more containment-encoded virtual constructs associated with the one or more continual range queries over the one or more moving objects, and incrementally evaluating the one or more continual range queries using the query index.

Abstract: Range query techniques are disclosed for use in accordance with data stream processing systems. In one aspect of the invention, a technique is provided for indexing continual range queries for use in data stream processing. For example, a technique for use in processing a data stream comprises obtaining at least one range query to be associated with the data stream, and building a range query index based on the at least one range query using one or more virtual constructs such that the query index is adaptive to one or more changes in a distribution of range query sizes. The step/operation of building the range query index may further comprise building the range query index such that the range query index accommodates one or more changes in query positions outside a monitoring area of the at least one range query. In another aspect of the invention, a technique is provided for incrementally processing continual range queries against moving objects.