Abstract: New language constantly emerges from complex, collaborative human-human interactions like meetings—such as when a presenter handwrites a new term on a whiteboard while saying it redundantly. The system and method described includes devices for receiving various types of human communication activities (e.g., speech, writing and gestures) presented in a multimodally redundant manner, includes processors and recognizers for segmenting or parsing, and then recognizing selected sub-word units such as phonemes and syllables, and then includes alignment, refinement, and integration modules to find or at least an approximate match to the one or more terms that were presented in the multimodally redundant manner. Once the system has performed a successful integration, one or more terms may be newly enrolled into a database of the system, which permits the system to continuously learn and provide an association for proper names, abbreviations, acronyms, symbols, and other forms of communicated language.

Abstract: The system and method as described herein can be advantageously used in a plurality of scenarios, two of which include field markup and data collection and collaborative review. The system and method handles the allocation of digital paper pattern background and the creation of required page definition files embedded into digital paper enabled PDFs. Optionally, action palettes can be automatically overlaid on the drawings as legend boxes to enable field personnel to select the operations they want to perform on the digital paper as they would on a computer interface. For instance letting users select the types of callouts and clouds to add to their markup. These drawings can be printed or plotted onto paper and sent to a work site for markup.

Abstract: The system and method as described herein can be advantageously used in a plurality of scenarios, two of which include field markup and data collection and collaborative review. The system and method handles the allocation of digital paper pattern background and the creation of required page definition files embedded into digital paper enabled PDFs. Optionally, action palettes can be automatically overlaid on the drawings as legend boxes to enable field personnel to select the operations they want to perform on the digital paper as they would on a computer interface. For instance letting users select the types of callouts and clouds to add to their markup. These drawings can be printed or plotted onto paper and sent to a work site for markup.

Abstract: New language constantly emerges from complex, collaborative human-human interactions like meetings—such as when a presenter handwrites a new term on a whiteboard while saying it redundantly. The system and method described includes devices for receiving various types of human communication activities (e.g., speech, writing and gestures) presented in a multimodally redundant manner, includes processors and recognizers for segmenting or parsing, and then recognizing selected sub-word units such as phonemes and syllables, and then includes alignment, refinement, and integration modules to find or at least an approximate match to the one or more terms that were presented in the multimodally redundant manner. Once the system has performed a successful integration, one or more terms may be newly enrolled into a database of the system, which permits the system to continuously learn and provide an association for proper names, abbreviations, acronyms, symbols, and other forms of communicated language.