Abstract: The disclosed technology is generally directed to the retention of online files. An indication that a communication from a first user to a second user includes a reference to an online document is received. Responsive to the indication, via a first processor, a first request for metadata associated with the online document is sent. The first request is based on permissions associated with the second user. A signal is communicated to a second processor such that: if the first request is granted the signal includes the metadata, else the signal includes the reference to the first online document. Via the second processor, responsive to determining that the signal does not include the metadata, a second request for the metadata is made such that the second request has elevated permissions relative to the first request. Via the second processor, the online document is caused to be marked for retention.

Abstract: Content in a digital item is analyzed to identify individual terms. A count of at least some of the individual terms is obtained. A measure of the likelihood that the content is or contains natural language is obtained based on the count of at least some of the individual terms. If the measure of the likelihood that the content of the digital item is or contains natural language is above a threshold, the content of the digital item is forwarded to an indexer of a search engine. Otherwise, if the measure of the likelihood that the content of the digital item is or contains natural language is below the a threshold, the content of the digital item is not forwarded to the indexer or the content of the digital item is forwarded to the indexer together with the measure of the likelihood.