Abstract: A link generation system, including a content discovery module for processing data files of a network server to identify servable data, and a link generator for generating links to the servable data to allow the servable content to be accessed using the links. The link generator generates encoded links for accessing dynamically generated data of the network server, the encoded links being in a form suitable for an indexing agent. The link generator processes a database of the network server to determine query data for retrieving servable data from the database. A proxy server receives a request generated in response to selecting one of the encoded links, translates the request, and forwards it to the network server to access corresponding dynamically generated data. The link generation system generates links that can be used to access all of a web site's content, in particular content for which no accessible link previously existed, including dynamically generated content.