Abstract: In large installations of document management systems, files are often duplicated. Users may place their own copies of files in convenient locations, or for other reasons files may be unintentionally duplicated. Duplication of files causes many problems for systems reliant on document management, chiefly because the additional (identical) files accept extra storage space, and must be handled like all other files, which results in greater network and resource utilization (with a concomitant increase in processing, search and retrieval times). A tool to standardize the identification of duplicate files (based on their binary contents), as well as the identification of a primary duplicate (the original file) across multiple repositories in a manner that minimizes the time for identification is disclosed.

Abstract: A system and method for extracting full text from source files of any size in such a manner that all text can be rapidly and accurately searched via search engine while maintaining satisfactory system performance. A software tool that integrates with file shares or an enterprise content management system with the ability to merge and serialize the results of the extracted text via surrogate index files. The software tool is configured to handle text from large files in order to extract, store and access the file such that all of the text is searchable, regardless of the size of the original document in a reasonable amount of time. The Analytics Engine will omit this field during search and handle this field separately from other fields.

Abstract: A system and method of an in-place content management system that allows an organization to bring the power of an enterprise content management (ECM) system (supporting such features as check-out, check-in, security, audit, add, rename, move, delete, classification, legal holds and disposition) to the data where it resides on an NTFS file system, eliminating the need to move it somewhere else and without having to change the way end-users work. A utility or tool for content management that leverages the existing security that is already in place on files and folders and adds basic content management features such as check-out/check-in (preventing multiple users from editing the same document at the same time), audit history, and the ability to add classifications, trigger dispositions, and apply legal holds on documents where they currently reside.

Abstract: A system and method of updating Content Server metadata on order to update and re-organize documents in a content management system (i.e., Content Server). A content management system includes a tool for setting Content Server metadata attributes, based in values in the index. Content Server Category Attributes can be set, as can Content Server Classification values, as can Content Server RM Classification values.

Abstract: A system and method for automated document page classification and targeted data extraction. A method for identifying document page types using deep learning (Artificial Intelligence and Machine Learning), and page classification, based on trained models. The layout of the page, as well as where the features are on a given page, from which text is to be extracted are trained on (with human input guiding the construction) and stored in these models. Different types of pages, including text and images, could then be stored in these models, which can then be used for identifying the content on each page to look for the desired feature from which to extract text. Based on a page prediction, the solution then uses the appropriate pre-trained feature extraction model (if one exists) to extract the areas of interest for further OCR processing (retrieving the text).

Abstract: A system and method of dynamic search result permission checking. A system that provides end users the ability to search an index (i.e., Shinydocs Index) built from content from one or multiple source repositories, and only display results for which the user has sufficient permissions at source to view. User credentials are validated “on the fly”, such that these checks are performant across a multiple of possible back-end repositories sequentially or simultaneously. The resultant search results from the Index may be sourced from many disparate repositories, each of which have their own unique permission structure (to view individual items). A method for handling permissions in multiple repositories in a secure (yet performant) fashion in order to only display search results that the end-user is allowed to view based on source system permissions.

Abstract: A system and method of dynamic search result permission checking. A system that provides end users the ability to search an index (i.e., Shinydocs Index) built from content from one or multiple source repositories, and only display results for which the user has sufficient permissions at source to view. User credentials are validated “on the fly”, such that these checks are performant across a multiple of possible back-end repositories sequentially or simultaneously. The resultant search results from the Index may be sourced from many disparate repositories, each of which have their own unique permission structure (to view individual items). A method for handling permissions in multiple repositories in a secure (yet performant) fashion in order to only display search results that the end-user is allowed to view based on source system permissions.

Abstract: A system and method of improved performant content source crawling. A content source crawling technology that is performant and focused on an initial rapid crawling of a content source to find specific file signatures so that it can determine an inventory of files that have been modified since the last full index event, thereby minimizing the time and computing resources necessary to perform a full crawl on just the select files to update to the search index. A method of Signature Flagging is disclosed and is used to selectively crawl the metadata about contained files and folders found within a content source in order to create that information in an Index within the Shinydocs Search Library.

Abstract: A system and method for extracting full text from source files of any size in such a manner that all text can be rapidly and accurately searched via search engine while maintaining satisfactory system performance. A software tool that integrates with file shares or an enterprise content management system with the ability to merge and serialize the results of the extracted text via surrogate index files. The software tool is configured to handle text from large files in order to extract, store and access the file such that all of the text is searchable, regardless of the size of the original document in a reasonable amount of time. The Analytics Engine will omit this field during search and handle this field separately from other fields.

Abstract: In large installations of document management systems, files are often duplicated. Users may place their own copies of files in convenient locations, or for other reasons files may be unintentionally duplicated. Duplication of files causes many problems for systems reliant on document management, chiefly because the additional (identical) files accept extra storage space, and must be handled like all other files, which results in greater network and resource utilization (with a concomitant increase in processing, search and retrieval times). A tool to standardize the identification of duplicate files (based on their binary contents), as well as the identification of a primary duplicate (the original file) across multiple repositories in a manner that minimizes the time for identification is disclosed.

Abstract: A system and method of updating Content Server metadata on order to update and re-organize documents in a content management system (i.e., Content Server). A content management system includes a tool for setting Content Server metadata attributes, based in values in the index. Content Server Category Attributes can be set, as can Content Server Classification values, as can Content Server RM Classification values.