Abstract: A device, system, and method are directed towards enabling a user to employ a set of database-like structured query expressions to manage data retrieval over a network, and the transformation and/or normalization of the data. In one embodiment, the retrieval expressions are configured as database-like structured query commands that may be performed upon at least a non-database arrangement of content over the network. In one embodiment, retrieved data is converted to at least one format intermediate to a first and second format in a sequence of transformations.
Abstract: Described is a system and method for employing user created database-structured queries and data extraction engines to crawl through Websites extracting and organizing data from selected sources on a network, such as the Internet. The structure of a query processed by a Data Extraction engine enables a user to treat the network as a searchable database. The database-structured queries provide a user with tools to match patterns on selected sites on the network. A user may automate database-structured queries to be executed on a regular frequency. Output of the database-structured queries may be placed into a data log, displayed on a user display screen, or optionally reshaped for use by a plurality of data analysis tools. Additionally, an optional graphical user interface is provided.