Abstract: A system and method for placing candidate spines into a display with the aid of a digital computer is provided. Candidate spines each having two or more clusters of documents are generated. Each cluster is associated with one or more concept scores for concepts identified within the documents of that cluster. A concept score vector is generated for each candidate spine by aggregating as spine concept scores, the cluster concept scores of the clusters associated with that candidate spine. The candidate spines are ordered by a number of the clusters associated with each candidate spine. Those candidate spines that are sufficiently dissimilar from the other candidate spines are identified based on the candidate spine concept score vectors. The sufficiently dissimilar candidate spines are placed in a display and at least a portion of the unplaced candidate spines are placed in relation to the placed candidate spines.

Abstract: A computer-implemented system and method for spine group generation and arrangement are provided. A set of spine groups each having one or more spines of clusters and at least one singleton cluster is obtained. A set of concentric rings are designated in a display and at least a portion of the spine groups are placed within the concentric rings. An innermost ring includes one or more of the spine groups that are unique from the other spine groups. A primary ring includes a majority of the spine groups placed within the display and an outermost ring delineates placement of descriptive labels for the placed spine groups.

Abstract: A computer-implemented system and method for selecting documents for review is provided. A master array of messages and topics for the messages is generated. The messages in the master array are sorted by the topics and the sorted messages are processed. During processing, each message in the master array is identified as unique, duplicate, or near duplicate. The unique messages are extracted from the duplicate and near duplicate messages, and entered into a log by creating a log entry for each of the unique messages. Each log entry includes a source of and identification information for one of the unique messages. The unique messages are then provided for document review.

Abstract: A computer-implemented system and method for generating document groupings is provided. A lexicon of terms extracted from a set of documents is generated. The lexicon includes a frequency of each extracted term within each document in the set. Concepts each having two or more of the extracted terms are generated. A subset of the documents in the set is selected based on the term frequencies. The subset of documents is grouped into clusters based on the concepts. A similarity of each document cluster is calculated with one or more documents based on a distance by summing the frequency of each term in that document and a weight of the cluster for each of the terms. The weights are updated until a rate of change for each cluster becomes constant.

Abstract: A computer-implemented system and method for generating and placing cluster groups is provided. A set of clusters each having one or more documents is maintained. A portion of the clusters is assigned to two or more spines. The cluster spines are ordered by cluster length. Those cluster spines that are unique are identified in decreasing cluster length order and placed. One or more of the remaining spines are placed in relation to at least one of the placed unique spines. At least one of the remaining clusters is placed in relation to one or more of the unique placed spines. Groups of clusters are displayed. Each group includes two or more of one such unique placed spine, the remaining spines placed in relation to that placed unique spine; and the remaining clusters placed in relation to the unique placed spine.

Abstract: A computer-implemented system and method for generating clusters for placement into a display is provided. A set of clusters is generated from a document set. A single cluster of related documents from the document set is obtained and at least one new cluster is added. One such document in the set is compared to the cluster. A difference in distance between the document and a common origin and the cluster and the common origin is determined. The document is designated as the new cluster when the difference fails to satisfy a predetermined threshold. One or more cluster spines each having two or more clusters placed along a vector are placed into a display. The clusters along each spine are identified as similar and the clusters of one such spine are also similar to further clusters located along a further spine having a small cosine rotation from that cluster spine.

Abstract: A computer-implemented system and method for placing groups of cluster spines into a display is provided. A shape is provided within a display and sectors are designated around the shape. One or more spine groups are placed into the display. Each spine group has two or more vectors of documents clusters and is placed adjacent to the shape within one of the sectors. A further spine group is placed into the display adjacent to one of the placed spine groups most similar to the further spine group. A determination is made that the further spine group overlaps the most similar placed spine group. The further spine group and the most similar placed spine group are translated away from the shape when rotation of the overlapping further spine group, away from the most similar placed spine group, places the further spine group into a different sector.

Abstract: A computer-implemented system and method for grafting cluster spines is provided. Cluster spines, each having two or more clusters of documents, are obtained. A score vector is generated for each of the cluster spines based on the documents within the clusters for that spine. The score vectors of the cluster spines are compared. Those cluster spines that are sufficiently dissimilar from the other cluster spines based on the comparison are placed into a display. At least one remaining cluster spine is grafted onto one of the displayed spines such that no overlap of the placed spine and the remaining spine occurs.

Abstract: A computer-implemented system and method for building spine groups is provided. Cluster spines, each having two or more clusters, are displayed. One or more candidate anchor clusters are identified for each of the cluster spines. Additional cluster spines are placed into the display by selecting one of the additional cluster spines and identifying one of the displayed cluster spines that is most similar to the selected additional cluster spine. A spine group is formed by grafting one of the clusters on the additional cluster spine to one of the candidate anchor clusters of the most similar cluster spine. An angle of the selected additional cluster spine is changed when the most similar cluster spine and the selected additional cluster spine exceed a maximum line segment.

Abstract: A computer-implemented system and method for populating clusters of documents is provided. A set of clusters is placed in a display in relation to a common origin. One of a plurality of unclustered documents in the display is selected and an angle ? of the document from the common origin is determined. An angle ? of the cluster relative to the common origin is computed for each cluster. A difference is determined between the document angle ? and one such cluster angle ?. A predetermined variance is applied to the difference. The document is placed into the cluster when the difference is less than the variance.

Abstract: A computer-implemented system and method for providing a display of clusters is provided. A plurality of cluster spines is presented in a two-dimensional display. Each cluster spine includes a vector of document clusters. A compass is positioned over at least a portion of the clusters of one or more of the spines. A spine label for at least one of the spines within the compass is placed around a circumference of the compass. One of the spine labels is pinned to the compass at a fixed location. The compass is reoriented within the display and the pinned spine label is displayed at the fixed location on the reoriented compass.

Abstract: A computer-implemented system and method for identifying relevant documents for display are provided. Themes for a set of documents are generated. The documents are clustered based on the themes. A matrix including an inner product of document frequency occurrences and cluster concept weightings for each theme is generated for the documents. From the matrix, documents most relevant to a particular theme are identified, and the relevant documents are displayed.

Abstract: A computer-implemented system and method for displaying clusters via a dynamic user interface is presented. Cluster spines are displayed and each cluster spine includes two or more clusters of documents. At least one compass frames at least a portion of one or more of the cluster spines in the display. At least one label is generated to identify a concept of one of the framed cluster spines. The label is circumferentially displayed around the compass. Then, the concept is changed as the compass moves over others of the cluster spines.

Abstract: A system and method for placing cluster groupers in a visual display is provided. Groupers of document clusters are obtained. One of the groupers is placed into a center of a display. A further grouper is selected, and a size of the further grouper is determined. An angle for placement of the further grouper and a radius from the center of the display for placement of the further grouper are also determined based on the grouper size to minimize overlap with the placed grouper. The further grouper is positioned in the display in relation to the grouper based on the determined angle and radius.

Abstract: A system and method for displaying spine groups is provided. Unique spine groups selected from a set of spine groups are placed around a shape defined in a display. One of the spine groups remaining in the set is selected and compared to each of the unique spine groups in the display. The unique spine group that is most similar to the selected spine group is identified. The selected spine group is placed adjacent to the unique spine group that is most similar.

Abstract: A computer-implemented system and method for visualizing message-related relationships within a social network is provided. Entities associated with a group of messages are identified. A social network is built based on a relationship of the entities and messages by connecting those entities that share at least one of the messages from the group. A representation of the social network is generated by representing each message with a node. The nodes are organized based on at least one characteristic of the messages.

Abstract: A system and method for placing spine groups within a display is provided. A shape is defined within a display. Groups of cluster spines are placed circumferentially around the defined shape. Overlap between at least two of the spine groups is identified. One of the overlapping spine groups is rotated in one of a clockwise and anticlockwise direction away from the other overlapping spine group. Overlap between the rotated spine group and at least one of the other overlapping spine group and another placed spine group is identified. The rotated overlapping spine group is moved in an outward direction away from the shape.

Abstract: A system and method for generating cluster spines is provided. Clusters of documents are maintained. Each document is associated with a document concept that is formed from one or more terms extracted from that document. At least one cluster concept is determined for each cluster. The document concepts are ranked and at least one of the document concepts that is highly ranked is selected as the cluster concept. One or more spines are formed. Each spine includes two or more clusters that share at least one of the cluster concepts. The shared cluster concept is identified as a spine concept. One or more of the remaining clusters is assigned to the spines based on a similarity between the cluster concepts for the remaining clusters and the spine concepts for the formed spines.

Abstract: A computer-implemented system and method for identifying duplicate and near duplicate messages is provided. A set of messages is obtained. A body of one such message is compared with the body of each other message. Those messages having matching bodies are identified as exact duplicates. The exact duplicates are removed from the set. The remaining messages are sorted in order of message length and a shorter message is compared with a longer message. A determination is made that the body of the shorter message is included in the body of the longer message and the shorter message is marked as a near duplicate of the longer message.

Abstract: A computer-implemented system and method for providing a display of clusters is provided. A plurality of cluster spines is presented in a two-dimensional display. Each cluster spine includes a vector of document clusters. A compass is positioned over at least a portion of the clusters of one or more of the spines. A spine label for at least one of the spines within the compass is placed around a circumference of the compass. One of the spine labels is pinned to the compass at a fixed location. The compass is reoriented within the display and the pinned spine label is displayed at the fixed location on the reoriented compass.