Abstract: A modular search object framework provides modular search results including entity and non-entity search results. The framework includes circuitry that outputs an interactive entity section based on an online search. The interactive section includes a plurality of moveable visual objects, such as cards that can be shuffled, flipped, or swiped around.

Abstract: A modular search object framework provides modular search results including entity and non-entity search results. The framework includes circuitry that outputs an interactive entity section based on an online search. The interactive section includes a plurality of moveable visual objects, such as cards that can be shuffled, flipped, or swiped around.

Abstract: A modular search object framework provides modular search results including entity and non-entity search results. The framework includes circuitry that outputs an interactive entity section based on an online search. The interactive section includes a plurality of moveable visual objects, such as cards that can be shuffled, flipped, or swiped around.

Abstract: Techniques for identifying duplicate webpages are provided. In one technique, one or more parameters of a first unique URL are identified where each of the one or more parameters do not substantially affect the content of the corresponding webpage. The first URL and subsequent URLs may be rewritten to drop each of the one or more parameters. Each of the subsequent URLs is compared to the first URL. If a subsequent URL is the same as the first URL, then the corresponding webpage of the subsequent URL is not accessed or crawled. In another technique, the parameters of multiple URLs are sorted, for example, alphabetically. If any URLs are the same, then the webpages of the duplicate URLs are not accessed or crawled.

Abstract: Generally, the present invention provides systems, methods and computer program products for detecting different content items with similar content by examining the anchortext of the link. A method of the present invention comprises selecting one of a plurality of websites, crawling the selected website to identify one or more content items, and downloading one or more content items of the selected website. A determination is then made as to the one or more linking relationships from the one or more content items of the selected website and one or more linking rules are learned based upon association rule mining of the one or more content items. The one or more linking rules are then applied to one or more content items of one or more websites in order to determine storage of the one or more content items based upon the one or more linking rules on a search provider's central server.

Abstract: Techniques for identifying duplicate webpages are provided. In one technique, one or more parameters of a first unique URL are identified where each of the one or more parameters do not substantially affect the content of the corresponding webpage. The first URL and subsequent URLs may be rewritten to drop each of the one or more parameters. Each of the subsequent URLs is compared to the first URL. If a subsequent URL is the same as the first URL, then the corresponding webpage of the subsequent URL is not accessed or crawled. In another technique, the parameters of multiple URLs are sorted, for example, alphabetically. If any URLs are the same, then the webpages of the duplicate URLs are not accessed or crawled.