Method and system for web resource location classification and detection

- Microsoft

A method and system for identifying locations associated with a web resource is provided. The location system identifies three different types of geographic locations: a provider location, a content location, and a serving location. A provider location identifies the geographic location of the entity that provides the web resource. A content location identifies the geographic location that is the subject of the web resource. A serving location identifies the geographic scope that the web page reaches. An application can select to use the type of location that is of particular interest.

Skip to: Description  ·  Claims  ·  References Cited  · Patent History  ·  Patent History
Description
TECHNICAL FIELD

The described technology relates generally to identifying a location associated with a web resource such as a web page.

BACKGROUND

Web resources such as web pages have geographic locations associated with them, which can be categorized as having a local or global geographic scope. For example, a web page that lists houses for sale within a certain region has a local geographic scope. In contrast, a web page with general information, such as an introduction to mathematics, is likely of interest to users from any location and thus has a global geographic scope.

Many location-based web applications have been developed to support mobile devices and local searching needs. Such location-based web applications include navigation systems, location-based search systems, local advertisement systems, geographic retrieval systems, and so on. These web applications typically need to detect a geographic location of a web resource and match it with the user's current location. For example, a cellular phone user may want to find a restaurant that is near the user's current location. A web application could match the user's current location as indicated by the cellular phone with the location of restaurants to identify which restaurants may be nearby.

Typically, web applications search web resources for location information (e.g., city names) and use that information when determining whether the web resource matches the user's location. A difficulty with such web applications is that location information of a web resource may have different purposes and thus different meanings. For example, a web page for a Chinese restaurant may contain the geographic locations “Peking” and “Redmond.” The geographic location of Peking indicates that the subject of the web page is somehow related to China, but the geographic location of Redmond indicates that the restaurant is located in Redmond, Wash., USA. If a web application is trying to match the user's current location, which may be in Beijing, to the location of the web page, the web application might erroneously report to the user the web page for the Chinese restaurant because it contains “Peking,” which is a geographic location related to Beijing.

It would be desirable to have a technique that would differentiate geographic locations associated with web resources so that web applications could use the geographic locations that are appropriate for their intended purpose.

SUMMARY

A method and system for identifying locations associated with a web resource is provided. The location system identifies three different types of geographic locations: a provider location, a content location, and a serving location. A provider location identifies the geographic location of the entity that provides the web resource. The location system identifies the provider location by identifying potential provider locations and then using a classifier to classify a potential provider location as being or not being a provider location. The location system may initially train the classifier by generating training data that includes potential provider locations, associated features of the web resource as feature vectors, and classifications. A content location identifies the geographic location that is the subject of the web resource. The location system identifies the content location using a geographic hierarchy of locations, assigning weights to each location indicating whether the location is likely the subject of the web resource, and calculating a power (e.g., relatedness) and spread (e.g., uniformity of relatedness) for each location. After the power and spread for each location are calculated, the location system then identifies those locations whose power meets a threshold power and whose spread meets a threshold spread as content locations. A serving location identifies the geographic scope that the web page reaches. The location system identifies the serving location using a power and spread calculation as described above. The location system, however, factors in serving locations of those web resources that include links to the target web resource and locations of those users who access the web resources based on analysis of web access logs. An application can select to use the type of location that is of particular interest.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram that illustrates a geographic hierarchy in one embodiment.

FIG. 2 is a block diagram that illustrates components of the location system in one embodiment.

FIG. 3 is a flow diagram that illustrates the processing of the train classifier component of the provider location components in one embodiment.

FIG. 4 is a flow diagram that illustrates the processing of the extract location string and feature component of the provider location components in one embodiment.

FIG. 5 is a flow diagram that illustrates the processing of the identify locations component of the content location components in one embodiment.

FIG. 6 is a block diagram that illustrates the processing of the compute weights component of the content location components in one embodiment.

FIG. 7 is a flow diagram that illustrates the processing of the compute geographic location weight component of the content location components in one embodiment.

FIG. 8 is a flow diagram that illustrates the processing of the compute power component of the content location components in one embodiment.

FIG. 9 is a flow diagram that illustrates the processing of the compute contribution of descendants component of the content location components in one embodiment.

FIG. 10 is a flow diagram that illustrates the processing of the compute contribution of ancestors component of the content location components in one embodiment.

FIG. 11 is a flow diagram that illustrates the processing of the compute spread component of the content location components in one embodiment.

FIG. 12 is a flow diagram that illustrates the processing of the traverse component of the content location components in one embodiment.

FIG. 13 is a flow diagram that illustrates the processing of the identify locations component of the serving location components in one embodiment.

FIG. 14 is a flow diagram that illustrates the processing of the initialize weights component of the serving location components in one embodiment.

FIG. 15 is a flow diagram that illustrates the processing of the compute weights component of the serving location components in one embodiment.

DETAILED DESCRIPTION

A method and system for identifying locations associated with a web resource is provided. In one embodiment, the location system identifies three different types of geographic locations: a provider location, a content location, and a serving location. A provider location identifies the geographic location of the entity (e.g., organization, corporation, or person) that provides the web resource. The provider location usually is a sequential address string including street address, city name, state name, zip code, country, and so on. For example, the provider location of a web site provided by a certain company may be the address of the corporate headquarters of the company. A content location identifies the geographic location that is the subject of the web resource. For example, a web page about the Great Wall of China would have “China” as a content location because the subject of the web page is about China. A serving location identifies the geographic scope that the web page reaches. For example, a web page about houses for sale in Redmond, Wash. may have a geographic scope of King County, Washington because the vast majority of the users who access that web page may be located in King County. The identification of the different types of locations may be used in various applications. For example, the provider location may be used by services such as map services, yellow page services, navigation services, shopping services, address management services, real estate services, and so on. The content location may be used by services such as location-based search services, web-based classified services, geographic information navigation and retrieval services, and so on. The serving location may be used by services such as local advertising services, marketing services, personalization services, and so on. In this way, an application can select to use the type of location that is of particular interest.

In one embodiment, the location system identifies the provider location by identifying potential provider locations and then using a classifier to classify a potential provider location as being or not being a provider location. The location system may initially train a classifier by generating training data that includes potential provider locations, associated features of the web resource as a feature vector, and a classification. The training data may be derived from a corpus of web resources. For example, the location system may extract strings from a web resource that are potentially provider locations. For example, the location system may look for street addresses, city names, state names, zip codes, and countries within the web resource. The location system then extracts features of the web resource that may indicate whether or not the extracted string is a provider location. The extracted features may include URL, title, anchor text, page content, referred frequency, level of web page within a web site, and spatial position of the extracted string on a web page. Some terms (e.g., “about us” and “contact us”) in a title, URL, or anchor text can be a hint that the web page contains provider location. The referred frequency indicates the number of times that a location is referenced within a web site. Since the address of a provider is typically provided on multiple web pages of a web site, a high referred frequency may tend to indicate that the extracted string is a provider location. Also, since provider locations are typically provided on the first level or second level web pages of a web site, the level of the web page from which the location string is extracted may indicate whether the extracted location string is a provider location. Since provider locations are often placed in footers of a web page, location of an location string within a web page may be used to help identify whether the location string is a provider location.

In one embodiment, the location system identifies the content location using a geographic hierarchy of locations, assigning weights to each location indicating whether the location is likely the subject of the web resource, and calculating a power and spread for each location. After the power and spread for each location are calculated, the location system then identifies those locations whose power meets a threshold power and whose spread meet a threshold spread as content locations. The power is a measure of the relatedness of a location to the web resource, and the spread is a measure of the uniformity of the power among sibling locations of the geographic hierarchy. For example, if a web resource mentions each of Redmond, Seattle, Bellevue, Spokane, and Tacoma the same number of times, then the content location may be more appropriately identified as their common ancestor—Washington State, rather than the cities individually because of the large power value of Washington State. In contrast, the location system does not identify any ancestor locations of Washington State (e.g., U.S.) because the ancestors' spread values are too small because cities in other states are not mentioned in the web resource. The location system may represent power by the following equation:

Power ( w , l ) = Wt ( w , l ) + j = 1 n Wt ( w , Child j ( l ) ) + t = 1 m Wt ( w , Ancestor i ( l ) ) Sibling i ( l ) ( 1 )
where Power(w,l) is the power of web resource w at location l in the geographic hierarchy, Wt(w,l) is the weight of location l for web resource w, Childj(l) is a descendant location l, n is the number of all descendant locations of location l, Ancestori(l) is an ancestor location of location l, m is the number of all ancestor locations of location l, and |Siblingi(l)| is the number of locations at the same level with location l within the subtree with Ancestori(l) as the root. This equation for power considers weights of both ancestor and descendant locations in addition to the weight of the current location. The location system may traverse the location hierarchy in a bottom-up manner to sum the weights of the descendant locations. The location system may also traverse the location hierarchy in a top-down manner to sum the weights of the ancestor locations. In this equation, the power of a location includes the power of the ancestor locations equally divided among sibling locations. One skilled in the art will appreciate that more complex strategies could be used to distribute the power of ancestor locations that would consider the geographic area or population density of the sibling locations.

In one embodiment, the location system when identifying the content location calculates the weight of the locations based on geographic keywords that are extracted from the web resource. For example, the geographic keywords may include geographic names (e.g., Redmond), postal codes (e.g., 98052), telephone numbers (e.g., 425-555-5555), and so on. The location system may assign a higher weight to postal codes and telephone numbers because they may be a more accurate indicator of content location than a geographic name. For example, some geographic names may ambiguously refer to different geographic locations; for example, “Washington” may refer to Washington State or Washington, D.C. Also some geographic names may ambiguously refer to geographic locations and persons; for example, “Washington” may refer to George Washington or Washington State. The location system may define the weight of the location by the following equation:

Wt ( gk ) = { Wt ( zt ) when gk is Zip or telephone number ( 1 - ( Wt ( zt ) ) × ( l f ( gn ) i f ( gn ) ) when gk is geograhic name ( 2 )
where Wt(gk) represents the weights of the geographic keyword gk, Wt(zt) represents the common weight of zip code and telephone number, ldf(gn) is the document frequency of each geographic name (gn) as a geographic keyword, and idf(gn) is the document frequency of gn as a general keyword. Due to the high reliability of zip codes and telephone numbers in correctly identifying unique geographic locations, the location system does not distinguish them and uses the same constant Wt(zt) (e.g., being greater than zero but less than one) to represent their common weight. The location system assigns weights of all geographic names subject to a common factor (1−Wt(zt)). The location system uses Wt(zt) to control the balance of weights between zip codes/telephone numbers and geographic names. The weight of each individual geographic name is adjusted by ldf(gn)/idf(gn). The value for ldf(gn) and idf(gn) are calculated from two corpuses. One is a geographic relevant document corpus, where the location system assumes that each reference of gn is from a geographic perspective and ldf(gn) represents the referred frequency of each geographic name. The other is a general document corpus that is used to compute idf(gn). The underlying reasoning of weighting each geographic name by the ratio of ldf(gn) to idf(gn) comes from the observation that a geographic name will be more likely to be truly about a geographic location if it is more frequently referred in the geographic corpus than in the general corpus.

After the weight for each geographic keyword is calculated, the location system then calculates the weight of each location by summing up the weights of the geographic keywords that are aliases for that location. For example, the geographic location of Redmond may have aliases of the geographic name of Redmond, zip code of 98052, and area code of 425. The location system represents the weight of a location by the following equation:

Wt ( w , l ) = gk rf ( w , gk ) × Wt ( gk ) ( 3 )
where Wt(w,l) represents the weight of location l for web resource w, gk (i.e., geographic keyword) represents any possible representations or aliases of location l, rf(w, gk) represents the referred frequency of gk in web resource w, and Wt(gk) is the weight of gk.

In one embodiment, the location system defines the spread of a location by the following equation:

Spread ( w , l ) = - i = 1 n Power ( w , l i ) j = 1 n Power ( w , l j ) × log ( Power ( w , l i ) j = 1 n Power ( w , l j ) ) log n ( 4 )
where Spread (w,l) is the spread for location l of web resource w, location li or location lj is a direct descendant location of location l, and n is the number of all direct descendants of l. After the Power and Spread are calculated for the locations, the location system identifies the content locations by traversing the geographic hierarchy in a top-down manner starting with the root location. The location system prunes any subtree when the Spread or Power ratio (i.e., power(location)/power(parent location)) of its root location does not exceed a given threshold Ts or Tp, respectively. When the traversal completes, the locations remaining in the geographic hierarchy represent the content location.

In one embodiment, the location system identifies the serving location of a target web resource using a power and spread calculation as described above. The location system, however, factors in serving locations of those web resources that include links to the target web resource. The location system assumes that web resources that reach a certain serving location are more likely referenced by other web resources that reach the same serving location. The location system may identify the serving locations of multiple web resources in parallel. The location system represents the weight of each location for a web resource by the following equation:

Wt ( w , l ) = { α 1 UserFreq ( w , l ) + ( 1 - α 1 ) ContentLoc ( w , l ) i = 0 α 2 j = 1 n SrvLoc i - 1 ( w j , l ) + ( 1 + α 2 ) SrvLoc i - 1 ( w , l ) i > 0 ( 5 )
where Wt(w,l) represents the weight of location l for web resource w, UserFreq(w,l) represents web resource w's access frequency by all users within location l, ContentLoc(w,l) is 0 or 1 indicating whether l is contained in the content location of w, wj is a web resource that has a link to web resource w, n is the number of all the web resources that have links to w, SrvLoci-1(wj,l) represents whether l is hierarchically contained in the intermediate serving location of web resource w after the (i−1)th iteration, and α1 and α2 are the weights of user access frequency and the serving location of other locations, respectively.

To calculate the serving location for all the web pages of a web site, the location system first calculates the content location for each web page. The location system also collects the location of users who access the various web pages of the web site (e.g., by accessing web log files). The location system then initializes the weights using Equation 5 with i=0. The location system then calculates the power and spread of each location and identifies the serving locations in the same manner as described above for the content locations. This completes the first iteration. The location system then calculates the weights for each location using Equation 5 with i>0. The location system calculates the power and spread of each location and identifies the serving locations as described above. The location system repeats this process until the solution converges on the final serving locations.

FIG. 1 is a diagram that illustrates a geographic hierarchy in one embodiment. The geographic hierarchy 100 includes a continent level 101, a country level 102, a state level 103, a county level 104, and a city level 105. One skilled in the art would appreciate that many different types of levels may be used; for example, a country may be divided into regions such as North, South, East, and West. In this example, Washington State has ancestor locations of North America and United States and has the descendant locations of King and Pierce counties and Seattle and Redmond cities. King and Pierce counties are direct descendants of Washington State and are sibling locations.

FIG. 2 is a block diagram that illustrates components of the location system in one embodiment. The location system 200 includes a web page store 201, an access store 202, provider location components 210, content location components 220, and serving location components 230. The provider location components include a train classifier component 211 and an extract location string and feature component 212. The train classifier component is responsible for training a classifier such as a support vector machine. The train classifier component invokes the extract location string and feature component to identify location strings and feature vectors of the web pages of the web page store. The train classifier component then inputs the classifications for the extracted location strings. The train classifier component then trains the classifier using the extracted location strings and feature vectors and their classifications. A support vector machine operates by finding a hyper-surface in the space of possible inputs. The hyper-surface attempts to split the positive examples from the negative examples by maximizing the distance between the nearest of the positive and negative examples to the hyper-surface. This allows for correct classification of data that is similar to, but not identical to, the training data. Various techniques can be used to train a support vector machine. One technique uses a sequential minimal optimization algorithm that breaks the large quadratic programming problem down into a series of small quadratic programming problems that can be solved analytically. (See Sequential Minimal Optimization, at the research web site of Microsoft Corporation identified as the document “˜jplatt/smo.hmtl.”) After the classifier is trained, the extract location string and feature component can be used to extract the location strings and the feature vectors for the web pages of a target web site. The classifier can then be used to classify the extracted location strings as being or not being a provider location.

The content location components include an identify locations component 221, a compute weights component 222, a compute power component 223, a compute spread component 224, and a traverse component 225. The identify locations component identifies the content locations associated with a target web page. The identify locations component invokes the compute weights component to compute the weights for the locations of the geographic hierarchy based on the content of the target web page. The identify locations component then invokes the compute power component and the compute spread component to compute the power and spread for each location of the geographic hierarchy. The identify locations component then invokes the traverse component to traverse the geographic hierarchy in a top-down manner. The traverse component prunes subtrees of the geographic hierarchy when the power ratio and spread of the root location of the subtree do not meet a threshold. The remaining locations in the geographic hierarchy represent the content locations of the target web page.

The serving location components include an identify locations component 231, an initialize weights component 232, and a compute weights component 233. The identify locations component identifies the serving locations associated with the web pages of a web site. The identify locations component invokes the initialize weights component to initialize the weights of the geographic hierarchy for a target web page. The initialize weights component initializes the weights based on the content locations of the target web page and the geographic locations of the users who access the target web page. The identify locations component then calculates the power and spread of each location of the geographic hierarchy using the compute power and compute spread components of the content location components. The identify locations component then identifies the serving locations by invoking the traverse component of the content location components. The remaining locations of the geographic hierarchy represent the serving locations of the first iteration of the identify locations component. The identify locations component then starts the second iteration by setting the weights of the geographic locations based on the remaining serving locations for the target web page and the remaining serving locations of the web pages that have links to the target web page of the previous iterations. Thus, the identify locations component identifies the serving locations of multiple web pages of one or more web sites in parallel. The identify locations component then invokes the compute power, compute spread, and traverse components to identify the serving locations for the second iteration. The identify locations component continues to perform the iterations until the serving locations converge on a solution.

The computing device on which the location system is implemented may include a central processing unit, memory, input devices (e.g., keyboard and pointing devices), output devices (e.g., display devices), and storage devices (e.g., disk drives). The memory and storage devices are computer-readable media that may contain instructions that implement the location system. In addition, the data structures and message structures may be stored or transmitted via a data transmission medium, such as a signal on a communication link. Various communication links may be used, such as the Internet, a local area network, a wide area network, a point-to-point dial-up connection, a cell phone network, and so on.

Embodiments of the location system may be implemented in various operating environments that include personal computers, server computers, hand-held or laptop devices, multiprocessor systems, microprocessor-based systems, programmable consumer electronics, digital cameras, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and so on. The computer systems may be cell phones, personal digital assistants, smart phones, personal computers, programmable consumer electronics, digital cameras, and so on.

The location system may be described in the general context of computer-executable instructions, such as program modules, executed by one or more computers or other devices. Generally, program modules include routines, programs, objects, components, data structures, and so on that perform particular tasks or implement particular abstract data types. Typically, the functionality of the program modules may be combined or distributed as desired in various embodiments.

FIGS. 3-4 are flow diagrams that illustrate the processing of components of the provider location components of the location system in one embodiment. FIG. 3 is a flow diagram that illustrates the processing of the train classifier component of the provider location components in one embodiment. The component loops extracting provider location strings and feature vectors for the web pages of the web sites of the web page store. The component then trains the classifier. In block 301, the component selects the next web site of the web page store. In decision block 302, if all the web sites have already been selected, then the component continues at block 306, else the component continues at block 303. In block 303, the component retrieves the web pages of the selected web site. In block 304, the component extracts the location strings and feature vectors for the selected web pages by invoking the extract location strings and features component. In block 305, the component inputs the classifications for the extracted location strings. For example, the component may prompt a user to indicate whether each location string represents a provider location. The component then loops to block 301 to select the next web site of the web page store.

FIG. 4 is a flow diagram that illustrates the processing of the extract location string and feature component of the provider location components in one embodiment. The component loops searching for location strings within the web pages of the selected web site. In block 401, the component finds the next location string within a web page. In decision block 402, if all the location strings have already been found, then the component returns, else the component continues at block 403. In blocks 403-404, the component generates the feature vector corresponding to the found location string and then loops to block 401 to select the next location string. As described above, the feature vector may include various features of the web pages from which the location string was extracted, such as location of the location string on a web page, hierarchy level of the web page within the web site, frequency of the location string within the web pages, and so on.

FIGS. 5-12 are flow diagrams that illustrate the processing of components of the content location components in one embodiment. FIG. 5 is a flow diagram that illustrates the processing of the identify locations component of the content location components in one embodiment. The component controls the overall process of identifying the content locations of a target web page. In block 501, the component invokes the compute weights component to compute the weights of the locations within the geographic hierarchy for the target web page. In block 502, the component invokes the compute power component to compute the power for the locations within the geographic hierarchy based on their weights. In block 503, the component invokes the compute spread component to compute the spread for the locations within the geographic hierarchy based on their power. In block 504, the component invokes the traverse component to traverse the geographic hierarchy to identify the content locations for the target web page. The component then completes.

FIG. 6 is a block diagram that illustrates the processing of the compute weights component of the content location components in one embodiment. The component loops selecting the geographic locations of the target web page and computing their weights. In block 601, the component selects the next geographic location of the geographic hierarchy. In decision block 602, if all the geographic locations have already been selected, then the component returns, else the component continues at block 603. In block 603, the component invokes the compute geographic location weight component passing the selected geographic location to compute the weight of the geographic location for the target web page. The component then loops to block 601 to select the next geographic location. One skilled in the art will appreciate that the processing of the compute weights component may alternatively identify geographic locations of the target web page first and then compute the weights for the locations of the geographic hierarchy, rather than selecting each location of the geographic hierarchy first. In general, these flow diagrams illustrate the functional processing of the components to facilitate the description of the technology. One skilled in the art will appreciate that these components may be optimized in various ways.

FIG. 7 is a flow diagram that illustrates the processing of the compute geographic location weight component of the content location components in one embodiment. The component is passed a geographic location and computes the weight of the geographic location for the target web page. The component loops summing the contributions of the aliases for the passed geographic location. In block 701, the component selects the next alias of the passed location on the target web page. In decision block 702, if all the aliases on the target web page have already been selected, then the component returns, else the component continues at block 703. In decision block 703, if the selected alias is a postal code or a telephone number, then the component continues at block 705, else the component continues at block 704. In block 704, the component calculates the weight for the geographic name using Equation 2. In block 705, the component calculates the weight for the postal code or telephone number using Equation 2. In block 706, the component determines the number of times that the selected alias is referred to on the target web page. In block 707, the component calculates the weight contribution of the selected alias using Equation 3. In block 708, the component adds the weight contribution of the selected alias to the weight of the passed geographic location. The component then loops to block 701 to select the next alias.

FIG. 8 is a flow diagram that illustrates the processing of the compute power component of the content location components in one embodiment. The component loops computing the power for each geographic location of the geographic hierarchy in a bottom-up manner. In block 801, the component selects the next geographic location of the geographic hierarchy. In decision block 802, if all the geographic locations have already been selected, then the component returns, else the component continues at block 803. In block 803, the component retrieves the weight of the selected geographic location. In block 804, the component invokes the compute contribution of descendants component to compute the contribution of the descendants to the power. In block 805, the component invokes the compute contribution of ancestors component to compute the contribution of the ancestors to the power. In block 806, the component calculates the power as a combination of the retrieved weight and the contributions. The component then loops to block 801 to select the next geographic location.

FIG. 9 is a flow diagram that illustrates the processing of the compute contribution of descendants component of the content location components in one embodiment. The component loops selecting the descendants of the passed geographic location and calculates the contribution of their weight to the power of the passed geographic location. In block 901, the component selects the next descendant. In decision block 902, if all the descendants have already been selected, then the component returns, else the component continues at block 903. In block 903, the component retrieves the weight for the selected descendant. In block 904, the component adds the retrieved weight to the running total weight for the passed geographic location of the descendants. The component then loops to block 901 to select the next descendant.

FIG. 10 is a flow diagram that illustrates the processing of the compute contribution of ancestors component of the content location components in one embodiment. The component loops selecting each ancestor location of the passed geographic location and aggregates the contribution of their weights to the power of the passed geographic location. In block 1001, the component selects the next ancestor location of the passed geographic location. In decision block 1002, if all the ancestor locations have already been selected, then the component continues at block 1005, else the component continues at block 1003. In block 1003, the component retrieves the weight of the selected ancestor location. In block 1004, the component adds the retrieved weight to a running total of the weights of the ancestor locations. The component then loops to block 1001 to select the next ancestor location. In block 1005, the component divides the total weight by the number of sibling locations of the passed geographic location and then returns.

FIG. 11 is a flow diagram that illustrates the processing of the compute spread component of the content location components in one embodiment. The component loops calculating the spread for each geographic location of the geographic hierarchy. In block 1101, the component selects the next geographic location of the geographic hierarchy. In decision block 1102, if all the geographic locations have already been selected, then the component returns, else the component continues at block 1103. In block 1103, the component sums the power of all descendant locations of the selected geographic location. In blocks 1104-1107, the component loops calculating the contribution to the spread of each direct descendant location of the selected geographic location. In block 1104, the component selects the next direct descendant location of the selected geographic location. In decision block 1105, if all the direct descendant locations of the selected geographic location already have been selected, then the component loops to block 1101 to select the next geographic location, else the component continues at block 1106. In block 1106, the component retrieves the power for the selected direct descendant location. In block 1107, the component adds the retrieved power to the spread for the selected geographic location and then loops to block 1104 to select the next direct descendant location of the selected geographic location.

FIG. 12 is a flow diagram that illustrates the processing of the traverse component of the content location components in one embodiment. The component is illustrated as a recursive component that traverses the geographic hierarchy in a top-down manner. The component is passed the geographic location that is currently being visited. In blocks 1201-1206, the component loops selecting each direct descendant location of the passed location and either prunes the location or marks its location as being a content location and recursively invokes the traverse component. In block 1201, the component selects the next direct descendant location of the passed location. In decision block 1202, if all the direct descendant locations have already been selected, then the component returns, else the component continues at block 1203. In decision block 1203, if the spread of the selected direct descendant location is greater than a threshold spread, then the component continues at block 1204, else the component prunes the subtree with the selected direct descendant location as its root by looping to block 1201 to select the next direct descendant location of the passed geographic location. In decision block 1204, if the power ratio of the selected direct descendant location is greater than a threshold power ratio, then the component continues at block 1205, else the component prunes the subtree with the selected direct descendant location as its root by looping to block 1201 to select the next direct descendant location of the passed geographic location. In block 1205, the component marks the passed geographic location as being a content location. In block 1206, the component recursively invokes the traverse component passing the selected direct descendant location. The component then loops to block 1201 to select the next direct descendant location.

FIGS. 13-15 are flow diagrams that illustrates the processing of the components of the serving location components of the location system in one embodiment. FIG. 13 is a flow diagram that illustrates the processing of the identify locations component of the serving location components in one embodiment. The component loops performing iterations that identify the serving locations of various web pages in parallel. The component identifies the serving locations of a geographic location for a target web page by factoring in the serving locations of the web pages that include a link to the target web page at each iteration. In block 1301, the component selects the next iteration. In decision block 1302, if this is the first iteration, then the component continues at block 1303, else the component continues at block 1304. In block 1303, the component invokes the initialize weights component of the serving location components to initialize the weights of the geographic locations for the web pages. In block 1304, the component invokes the compute weights component to compute the weights for the geographic locations for the web pages for this iteration. In block 1305, the component invokes the compute power component of the content location components to compute the power for the geographic hierarchy for each web page. In block 1306, the component invokes the compute spread component of the content location components to compute the spread for the geographic hierarchy for each web page. In block 1307, the component invokes the traverse component of the content location components to identify the serving locations of the geographic hierarchy for each web page. In decision block 1308, if the serving locations identified in this iteration and the last iteration are similar, then the component has converged on a solution and completes, else the component loops to block 1301 to select the next iteration.

FIG. 14 is a flow diagram that illustrates the processing of the initialize weights component of the serving location components in one embodiment. The component loops initializing the weights for the geographic locations for each web page. In block 1401, the component invokes the identify locations component of the content location components. In blocks 1402-1406, the component loops setting the weight for each location. In block 1402, the component selects the next location. In decision block 1403, if all the locations have already been selected, then the component returns, else the component continues at block 1404. In block 1404, the component calculates the contribution to the weights based on the frequency of users from the selected location accessing the target web page. In decision block 1405, if the selected location is contained in an identified location, then the component continues at block 1406, else the component loops to block 1401 to select the next location. In block 1406, the component increases the weight of the selected location to account for the selected location being contained in a content location. The component then loops to block 1401 to select the next location.

FIG. 15 is a flow diagram that illustrates the processing of the compute weights component of the serving location components in one embodiment. In block 1501, the component selects the next geographic location. In decision block 1502, if all the geographic locations have already been selected, then the component returns, else the component continues at block 1503. In blocks 1503-1506, the component loops factoring in the contribution to the weights of those web pages that link to the target web page. In block 1503, the component selects the next linked-from web page. In decision block 1504, if all the web pages have already been selected, then the component continues at block 1507, else the component continues at block 1505. In decision block 1505, if the selected geographic location is contained within an identified location, then the component continues at block 1506, else the component loops to block 1503 to select the next linked-from web page. In block 1506, the component increments the weight for the selected location and then loops to block 1503 to select the next linked-from web page. In decision block 1507, if the selected location is contained within an identified location, then the component continues at block 1508, else the component loops to block 1501 to select the next geographic location. In block 1508, the component increases the weight of the selected geographic location and loops to block 1501 to select the next geographic location.

From the foregoing, it will be appreciated that specific embodiments of the location system have been described herein for purposes of illustration, but that various modifications may be made without deviating from the spirit and scope of the invention. Accordingly, the invention is not limited except as by the appended claims.

Claims

1. A method in a computer system for identifying a content location associated with a web page, the content location identifying a geographic location that is a subject of the web page, the method comprising:

providing a spread threshold and a power threshold;
providing a geographic hierarchy of geographic locations;
for each of a plurality of geographic locations of the geographic hierarchy, calculating a weight for the geographic location that provides an indication that the web page is related to the geographic location based on geographic keywords contained on the web page; calculating a power for the geographic location that factors in the weight of ancestor and descendant geographic locations, the power being a measure of whether the geographic location is a subject of the web page based on weight of ancestor and descendant geographic locations of the geographic location; and calculating a spread for the geographic location based on the calculated power, the spread being a measure of the uniformity of the power among direct descendent geographic locations of the geographic location in the geographic hierarchy of geographic locations; and
after calculating the weight, power, and spread for the plurality of geographic locations, determining whether a geographic location has a power that meets the provided power threshold and a spread that meets the provided spread threshold; and determining that the geographic location has a power that meets the provided power threshold and a spread that meets the provided spread threshold, identifying the geographic location as a content location of the web page.

2. The method of claim 1 wherein the calculating of a weight is based on the weights for aliases of the location.

3. The method of claim 2 wherein an alias for a location is selected from a group consisting of a zip code and telephone number.

4. The method of claim 1 including pruning locations and their descendant locations that do not meet the provided power threshold or the provided spread threshold.

5. A method in a computer system for identifying a serving location associated with a target web page, the method comprising:

providing a power threshold and a spread threshold;
providing a geographic hierarchy of geographic locations;
identifying one or more content locations for the target web page, a content location of a web page identifying a geographic location that is a subject of the web page;
providing content locations associated with other web pages that include links to the target web page;
determining whether a geographic location associated with the target web page is an identified serving location based on the provided content locations associated with the other web pages by iteratively calculating a power for each geographic location that factors in weight of ancestor and descendant geographic locations, the power being a measure of whether the geographic location is a subject of the web page; calculating a spread for each geographic location based on the calculated power, the spread being a measure of the uniformity of the power among direct descendent geographic locations of the geographic location in the geographic hierarchy of geographic locations; marking each geographic location that has a power that meets the provided power threshold and a spread that meets the provided spread threshold as a serving location of the target web page until the serving locations converge on a solution
wherein the weight for each geographic location is computed based on a number of other web pages with links to the target web page and whether a serving location of the other web page is contained within a geographic location marked at a serving location.

6. The method of claim 5 wherein the determining factors in locations of users who access the web resource.

7. The method of claim 5 wherein the weight for each geographic location is initialized for a first iteration based on the frequency of access of the target web page by users associated with the geographic location and whether the geographic location is contained within an identified content location.

8. The method of claim 1 wherein the power is represented by the following equation: Power ⁢ ⁢ ( w, l ) = Wt ⁢ ⁢ ( w, l ) + ∑ j = 1 n ⁢ ⁢ Wt ⁢ ⁢ ( w, Child j ⁢ ⁢ ( l ) ) + ∑ t = 1 m ⁢ ⁢ Wt ⁢ ⁢ ( w, Ancestor i ⁢ ⁢ ( l ) )  Sibling i ⁢ ⁢ ( l )  where Power(w,l) is the power of web page w at geographic location l in the geographic hierarchy, Wt(w,l) is the weight of geographic location l for web page w, Childj(l) is a descendant geographic location l, n is the number of all descendant geographic locations of geographic location l, Ancestori(l) is an ancestor geographic location of geographic location l, m is the number of all ancestor geographic locations of geographic location l, and |Siblingi(l)| is the number of geographic locations at the same level with geographic location l within the subtree with Ancestori(l) as the root.

9. The method of claim 1 wherein the spread is represented by the following equation: Spread ⁢ ⁢ ( w, l ) = - ∑ i = 1 n ⁢ ⁢ Power ⁢ ⁢ ( w, l i ) ∑ j = 1 n ⁢ ⁢ Power ⁢ ⁢ ( w, l j ) × log ( Power ⁢ ⁢ ( w, l i ) ∑ j = 1 n ⁢ ⁢ Power ⁢ ⁢ ( w, l j ) ) log ⁢ ⁢ n where Spread(w,l) is the spread for geographic location l of web resource w, Power(w,l) is the power of web page w at geographic location l in the geographic hierarchy, geographic location li or geographic location lj is a direct descendant geographic location of geographic location l, and n is the number of all direct descendants geographic locations of l.

10. A computer-readable storage medium containing instructions for controlling a computer system to identify a content location associated with a web page, the content location identifying a geographic location that is a subject of the web page, by a method comprising:

providing a spread threshold and a power threshold;
accessing a geographic hierarchy of geographic locations;
for each of a plurality of geographic locations of the geographic hierarchy, calculating a weight for the geographic location that provides an indication that the web page is related to the geographic location based on geographic keywords contained on the web page; calculating a power for the geographic location that factors in the weight of ancestor and descendant geographic locations as indicated by the geographic hierarchy, the power being a measure of whether the geographic location is a subject of the web page based on weight of ancestor and descendent geographic locations of the geographic location; and calculating a spread for the geographic location based on the calculated power, the spread being a measure of the uniformity of the power among direct descendent geographic locations of the geographic location in the geographic hierarchy of geographic locations; and
after calculating the weight, power, and spread for each of the plurality of geographic locations, determining whether the geographic location has a power that meets the provided power threshold and a spread that meets the provided spread threshold; and after determining that a geographic location has a power that meets a power threshold and a spread that meets a spread threshold, indicating that the geographic location is the identified location of the web page.

11. The computer-readable storage medium of claim 9 wherein the calculating of a weight is based on the weights for aliases of the geographic location.

12. The computer-readable storage medium of claim 10 wherein an alias for a geographic location is selected from a group consisting of a zip code and telephone number.

13. The computer-readable storage medium of claim 9 including pruning geographic locations and their descendant locations that do not meet the provided power threshold or the provided spread threshold.

14. The computer-readable storage medium of claim 9 wherein the power is represented by the following equation: Power ⁢ ⁢ ( w, l ) = Wt ⁢ ⁢ ( w, l ) + ∑ j = 1 n ⁢ ⁢ Wt ⁢ ⁢ ( w, Child j ⁢ ⁢ ( l ) ) + ∑ t = 1 m ⁢ ⁢ Wt ⁢ ⁢ ( w, Ancestor i ⁢ ⁢ ( l ) )  Sibling i ⁢ ⁢ ( l )  where Power(w,l) is the power of web page w at geographic location l in the geographic hierarchy, Wt(w,l) is the weight of geographic location l for web page w, Childj(l) is a descendant geographic location l, n is the number of all descendant geographic locations of geographic location l, Ancestori(l) is an ancestor geographic location of geographic location l, m is the number of all ancestor geographic locations of geographic location l, and |Siblingi(l)| is the number of geographic locations at the same level with geographic location l within the subtree with Ancestori(l) as the root.

15. The computer-readable storage medium of claim 9 wherein the spread is represented by the following equation: Spread ⁢ ⁢ ( w, l ) = - ∑ i = 1 n ⁢ ⁢ Power ⁢ ⁢ ( w, l i ) ∑ j = 1 n ⁢ ⁢ Power ⁢ ⁢ ( w, l j ) × log ( Power ⁢ ⁢ ( w, l i ) ∑ j = 1 n ⁢ ⁢ Power ⁢ ⁢ ( w, l j ) ) log ⁢ ⁢ n where Spread(w,l) is the spread for geographic location l of web resource w, Power(w,l) is the power of web page w at geographic location l in the geographic hierarchy, geographic location li or geographic location lj is a direct descendant geographic location of geographic location l, and n is the number of all direct descendants of l.

Referenced Cited
U.S. Patent Documents
6516311 February 4, 2003 Yacoby et al.
6629136 September 30, 2003 Naidoo
6684250 January 27, 2004 Anderson et al.
6731612 May 4, 2004 Koss
6795710 September 21, 2004 Creemer
6973438 December 6, 2005 Philyaw
6976090 December 13, 2005 Ben-Shaul et al.
7257570 August 14, 2007 Riise et al.
7257577 August 14, 2007 Fagin et al.
20020156779 October 24, 2002 Elliott et al.
20030220835 November 27, 2003 Barnes
20040083133 April 29, 2004 Nicholas et al.
20050065916 March 24, 2005 Ge et al.
20050065959 March 24, 2005 Smith et al.
20060271531 November 30, 2006 O'Clair et al.
20070233649 October 4, 2007 Xie et al.
20070233864 October 4, 2007 Xie et al.
20080052151 February 28, 2008 Xie et al.
20080052413 February 28, 2008 Wang et al.
Foreign Patent Documents
1020040028832 April 2004 KR
102005035386 April 2005 KR
102005066778 June 2005 KR
1020060082219 July 2006 KR
Other references
  • Amitay, et al. “Web-a-where: Geotagging Web Content”, Proceedings of the SIGIR '04, Jul. 25-29, Sheffield, South Yorkshire, UK. Copyright 2004, 8 pages.
  • Brin, et al. “The Anatomy of a Large-Scale Hypertextual Web Search Engine”, Proceedings of the Seventh International World Wide Web Conference (WWW7), Apr. 1998.
  • Buyukkokten, et al. “Exploiting Geographical Location Information of Web Pages”, ACM SIGMOD Workshop on The Web and Databases (WebDB'99), Philadelphia, Pennsylvania, USA, 1999, pp. 91-96.
  • Columbia GeoSearch. Available at <http://geosearch.cs.columbia.edu>. Cited in Wang et al “ Application-driven Web Resource Location Detection”, CIKM '04, Nov. 8-13, 2004, Washington D.C., 8 pages.
  • Davision. “Topical Locality in the Web: Experiments and Observations,” Technical Report DCS-TR-414, Department of Computer Science, Rutgers University, Jul. 2000, pp. 1-22.
  • Ding, et al. “Computing Geographical Scopes of Web Resources”, Proceedings of 26th International Conference on Very Large Data Bases (VLDB 2000), Cairo, Egypt., 2000, 12 pages.
  • Gravano, et al. “Categorizing Web Queries According to Geographical Locality”, Proceedings of the 2003 ACM CIKM International Conference on Information and Knowledge Management (CIKM 2003), Nov. 3-8, 2003, New Orleans, Louisiana, USA. 9 pages.
  • Gravano. “GeoSearch: A Geographically-Aware Search Engine,” http://geosearch.cs.columbia.edu, [last accessed Feb. 23, 2007].
  • Guttman. “R-Trees: A Dynamic Index Structure For Spatial Searching,” 1984 ACM, pp. 47-57.
  • International Search Report and Written Opinion; International Patent Application No. PCT/US2007/005393; Filed Feb. 27, 2007; Applicant: Microsoft Corporation; Mailed on Aug. 29, 2007; 9 pages.
  • International Search Report and Written Opinion; International Patent Application No. PCT/US2007/076909; Filed Aug. 27, 2007; Applicant: Microsoft Corporation; Mailed on Jan. 31, 2008; 10 pages.
  • Jones, et al. “Using a Mobile Device to Vary the Pace of Search”, Human-Computer Interaction with Mobile Devices and Services, Mobile HCI 2003, Udine, Italy, 2003, Springer-Verlag Berlin Heidelberg 2003, pp. 390-394, 5 pages.
  • Kaasinen. “User needs for location-aware mobile services,” Pers Ubiquit Comput, 2003, vol. 7, Springer-Verlag London Limited 2003. pp. 70-79.
  • Larson. “Geographic Information Retrieval and Spatial Browsing” in Smith, et al. “GIS and Libraries: Patrons, Maps and Spatial Information”. University of Illinois, (1996), 81-124. Available online at http://sherlock.berkeley.edu/geo ir/PART1.html.
  • Ma, et al. “A Localness-Filter for Searched Web Pages”, Proceedings of the 5th Asia Pacific web Conference (APweb2003), Xi'an, China, 2003, p. 525-536.
  • McCurley. “Geospatial Mapping and Navigation of the Web”, Proceedings of the Tenth International World Wide Web Conference (WWW 10), ACM Press, May 1-5, 2001, Hong Kong, China, 9 pages.
  • Pramudiono, et al. “User Behavior Analysis of Location Aware Search Engine”, 3rd International Conference on Mobile Data Management, Singapore, Jan. 2002, 7 pages.
  • Sanderson, et al. “Analyzing geographic queries”, Proceedings of SIGIR 2004, Workshop on Geographic Information Retrieval, ACM Press, Sheffield, UK, 2004, 2 pages.
  • Song, et al. “Learning Block Importance Models for web Pages”, Proceedings of the Tenth International World Wide Web Conference (WWW13), New York, May 17-22, 2004. 9 pages.
  • Spirit project, http://www.geo-spirit.org, [last accessed Feb. 23, 2006].
  • Sterling. “Search Engine Watch—Local Search: The Hybrid Future,” Jan. 8, 2004, http://searchenginewatch.com/searchday/article.php/3296721, [last accessed Feb. 23, 2007].
  • Sullivan, D. Local Search Part 1-5. http://searchenginewatch.com/searchday/article.php/30913.
  • Theodoris, et al., “Efficient Cost Models for Spatial Queries Using R-Trees,” IEEE Transactions on Knowledge and Data Engineering, vol. 12, No. 1, Jan./Feb. 2000, pp. 19-32.
  • Vaid, et al. “Spatially Indexing Text Documents,” Report on Spatial Indexing Methods, Technical Report D12 2201, Spirit project, 2004, 37 pages.
  • Wang, et al., “Web Resource Geographic Location Classification and Detection,” WWW 2005, May 10-14, 2005, Chiba, Japan, ACM. pp. 1138-1139.
  • Wang, et al. “Application-driven Web Resource Location Detection”, Thirteenth Conference on Information and Knowledge Management (CIKM 2004) on May 25, 2004. 9 pages.
  • Wang, et al. “Detecting Dominant Locations from Search Queries”, Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval Salvador, Aug. 15-19, 2005, Salvador, Brazil. 8 pages.
  • Yahoo Local, http://local.yahoo.com, [last accessed Feb. 26, 2007].
Patent History
Patent number: 7574530
Type: Grant
Filed: Mar 10, 2005
Date of Patent: Aug 11, 2009
Patent Publication Number: 20060206624
Assignee: Microsoft Corporation (Redmond, WA)
Inventors: Chuang Wang (Wuhan), Wei-Ying Ma (Beijing), Xing Xie (Beijing)
Primary Examiner: Ario Etienne
Assistant Examiner: Hee Soo Kim
Attorney: Perkins Coie LLP
Application Number: 11/081,014
Classifications
Current U.S. Class: Computer-to-computer Data Addressing (709/245); Remote Data Accessing (709/217)
International Classification: G06F 15/16 (20060101);