Abstract: A method for determining a crawling schedule is disclosed, the method being executable at a crawling server coupled to a first web resource server and a second web resource server. The method comprises: acquiring a first new web page associated with the first web resource server; acquiring a second new web page associated with the second web resource server; determining a first crawling benefit parameter for the first new web page, the first crawling benefit parameter being based on a predicted popularity parameter and a predicted popularity decay parameter thereof; determining a second crawling benefit parameter for the second new web page, the second crawling benefit parameter being based on a predicted popularity parameter and a predicted popularity decay parameter thereof; based on the first crawling benefit parameter and the second crawling benefit parameter, determining a crawling order for the first new web page and the second new web page.

Abstract: A method and server for determining a creation time of a target page is disclosed. A page network of a plurality of pages including the target page and a plurality of links therebetween is created. Each page is a source or destination page for at least one link. Each page has a creation time and a creation time parameter. An initial value is assigned to the creation time parameter for each page. The creation time parameter of the target page is varied to maximize a page network probability which is based on a link probability for each link which is based at least in part on a difference between the creation time parameters of the source and destination pages thereof. The creation time of the target page is determined to be the value of the creation time parameter thereof which maximizes the page network probability.

Abstract: There is disclosed a method of setting up a crawling schedule, the method executable at a crawling server, the crawling server coupled to a communication network, the communication network having coupled thereto a first web resource server and a second web 5 resource server.

Abstract: A method for determining a creation time of a target page includes creating a page network having a plurality of pages including the target page and a plurality of links. Each of the source and destination pages for each link is one of the plurality of pages. Each page is a source page or a destination page for at least one of the links. A page network probability corresponding to a hypothetical creation time for the target page is determined. The page network probability is based on a link probability for each link of the plurality of links, the link probability being based on a creation time for the source page thereof and a creation time for the destination page thereof. A value of the hypothetical creation time providing the greatest value for the page network probability is determined, the value being the creation time for the target page.

Abstract: A method and server for determining a creation time of a target page is disclosed. A page network of a plurality of pages including the target page and a plurality of links therebetween is created. Each page is a source or destination page for at least one link. Each page has a creation time and a creation time parameter. An initial value is assigned to the creation time parameter for each page. The creation time parameter of the target page is varied to maximize a page network probability which is based on a link probability for each link which is based at least in part on a difference between the creation time parameters of the source and destination pages thereof. The creation time of the target page is determined to be the value of the creation time parameter thereof which maximizes the page network probability.

Abstract: A method for determining a creation time of a target page includes creating a page network having a plurality of pages including the target page and a plurality of links. Each of the source and destination pages for each link is one of the plurality of pages. Each page is a source page or a destination page for at least one of the links. A page network probability corresponding to a hypothetical creation time for the target page is determined. The page network probability is based on a link probability for each link of the plurality of links, the link probability being based on a creation time for the source page thereof and a creation time for the destination page thereof. A value of the hypothetical creation time providing the greatest value for the page network probability is determined, the value being the creation time for the target page.