Abstract: A set of clusters associated with a plurality of web pages is received. A first data set and a second data set are generated by applying a first rule and the second rule, respectively, to web pages of a first cluster of the set of clusters. The second rule is substituted for the first rule responsive to having an acceptable extraction accuracy when applied to the first cluster. The extraction accuracy of the second rule is determined by comparing attributes of the second data set to attributes of the first data set.

Abstract: A system and method for determining optimal selection of paths for passively monitoring a communications network. A diagnostic set of paths is determined by ensuring that, for all pairs of links in the network, the set contains one path having only one member of that pair. A detection subset of paths is determined by ensuring that, for all the links in the network, one member of the subset contains that link. Selecting a minimum detection and diagnostic set of paths minimizes the communication overhead imposed by monitoring. During normal operation, only the detection subset need be monitored. Once an anomaly is detected, the system may switch to monitoring the full diagnostic set. The cost of deploying and operating the passive monitoring equipment is minimized by determining the minimum set of links on which a probe needs to be placed in order to monitor the diagnostic set of paths.