Abstract: An optimization system comprises a reception component that receives a cascade of classifiers. The system further includes an optimization component communicatively coupled to the reception component, the optimization component receives input relating to one of speed and accuracy of the cascade of classifiers and optimizes the cascade of classifiers based at least in part upon the received input and confidence scores associated with each classifier within the cascade of classifiers. The optimization component can utilize at least one of a steepest descent algorithm, a dynamic programming algorithm, a simulated annealing algorithm, and a branch and bound variant of a depth first search algorithm in connection with optimizing the cascade of classifiers.

Abstract: A digital ink annotation process and system for processing digital documents and digital ink annotations therein. The process and system maintain an annotation's position within a document such that the original intent and meaning of the annotation is preserved. This is true even if the document is edited, resized, displayed on a different device or otherwise modified. The digital ink annotation process includes automatic and manual grouping of digital ink strokes within a document to define digital ink annotations, classifying the annotations according to annotation type, and anchoring the annotations to appropriate regions or positions in a document. The process further includes reflowing the annotations in a new document layout such that the annotations conform and adapt to the new layout while preserving the original intents and meanings of the annotations.

Abstract: Flexible and efficient systems and methods for organizing, analyzing, and processing digital ink incrementally analyze input data (e.g., representing ink strokes) as the user continues to add to, edit, or modify the data. In this manner, processing is performed promptly as the ink is entered, and the processing system and method can effectively keep up with the user. This prevents long processing delays, because the systems and methods need not first process a large volume of ink data present after the user has entered has completely filled a page with ink.

Abstract: A two-dimensional representation of a document is leveraged to extract a hierarchical structure that facilitates recognition of the document. The visual structure is grammatically parsed utilizing two-dimensional adaptations of statistical parsing algorithms. This allows recognition of layout structures (e.g., columns, authors, titles, footnotes, etc.) and the like such that structural components of the document can be accurately interpreted. Additional techniques can also be employed to facilitate document layout recognition. For example, grammatical parsing techniques that utilize machine learning, parse scoring based on image representations, boosting techniques, and/or “fast features” and the like can be employed to facilitate in document recognition.

Abstract: Image recognition is utilized to facilitate in scoring parse trees for two-dimensional recognition tasks. Trees and subtrees are rendered as images and then utilized to determine parsing scores. Other instances of the subject invention can incorporate additional features such as stroke curvature and/or nearby white space as rendered images as well. Geometric constraints can also be employed to increase performance of a parsing process, substantially improving parsing speed, some even resolvable in polynomial time. Additional performance enhancements can be achieved in yet other instances of the subject invention by employing constellations of integral images and/or integral images of document features.

Abstract: Techniques for efficiently and accurately organizing freeform handwriting into lines. A global cost function is employed to find the simplest partitioning of electronic ink strokes into line groups that also maximize the “goodness” of the resulting lines and the consistency of their configuration. The “goodness” of a line may be based upon its linear regression error and the horizontal and vertical compactness of the strokes making up the line. The line consistency configuration for a grouping of strokes is measured by the angle difference between neighboring groups. The global cost function also takes into account the complexity of the stroke partitioning, measured by the number of lines into which the strokes are grouped. An initial grouping of strokes is made, and the cost for this initial grouping is determined. Alternate groupings of the initial stroke grouping are then generated.

Abstract: Grammatical parsing is utilized to parse structured layouts that are modeled as grammars. This type of parsing provides an optimal parse tree for the structured layout based on a grammatical cost function associated with a global search. Machine learning techniques facilitate in discriminatively selecting features and setting parameters in the grammatical parsing process. In one instance, labeled examples are parsed and a chart is generated. The chart is then converted into a subsequent set of labeled learning examples. Classifiers are then trained utilizing conventional machine learning and the subsequent example set. The classifiers are then employed to facilitate scoring of succedent sub-parses. A global reference grammar can also be established to facilitate in completing varying tasks without requiring additional grammar learning, substantially increasing the efficiency of the structured layout analysis techniques.

Abstract: A discriminative grammar framework utilizing a machine learning algorithm is employed to facilitate in learning scoring functions for parsing of unstructured information. The framework includes a discriminative context free grammar that is trained based on features of an example input. The flexibility of the framework allows information features and/or features output by arbitrary processes to be utilized as the example input as well. Myopic inside scoring is circumvented in the parsing process because contextual information is utilized to facilitate scoring function training.

Abstract: Electronic ink layout analysis systems and methods provide flexibility and efficiency in organizing, analyzing, and processing digital ink. These layout analysis systems and methods allow users substantial freedom in entering electronic ink into a pen-based computer system. Using these systems and methods, a user's input digital ink is not constrained by requirements that a user write in a specific screen orientation, that a user write in one specific orientation on all portions of a page, or that a user write using a specific minimum or maximum sized stroke. Rather, the systems and methods freely allow the user to write anywhere on a given page, in any orientation or size, while still enabling effective and efficient handwriting recognition and other processing of the input digital ink.

Abstract: The present invention leverages classification type detectors and/or context information to provide a systematic means to recognize and anchor annotation strokes, providing reflowable digital annotations. This allows annotations in digital documents to be archived, shared, searched, and easily manipulated. In one instance of the present invention, an annotation recognition method obtains an input of strokes that are grouped, classified, and anchored to underlying text and/or points in a document. Additional instances of the present invention utilize linguistic content, domain specific information, anchor context, and document context to facilitate in correctly recognizing an annotation.

Abstract: The present invention leverages spatial relationships to provide a systematic means to recognize text and/or graphics. This allows augmentation of a sketched shape with its symbolic meaning, enabling numerous features including smart editing, beautification, and interactive simulation of visual languages. The spatial recognition method obtains a search-based optimization over a large space of possible groupings from simultaneously grouped and recognized sketched shapes. The optimization utilizes a classifier that assigns a class label to a collection of strokes. The overall grouping optimization assumes the properties of the classifier so that if the classifier is scale and rotation invariant the optimization will be as well. Instances of the present invention employ a variant of AdaBoost to facilitate in recognizing/classifying symbols. Instances of the present invention employ dynamic programming and/or A-star search to perform optimization.

Abstract: The present invention relates to systems and methods that facilitate annotating digital documents (e.g., digital inking) with devices such as Tablet PCs, PDAs, cell phones, and the like. The systems and methods provide for multi-scale navigation during document annotating via a space-scale framework that fluidly generates and moves a zoom region relative to a document and writing utensil. A user can employ this zoom region to annotate various portions of the document at a size comfortable to the user and suitably scaled to the device display. The space-scale framework enables dynamic navigation, wherein the zoom region location, size, and shape, for example, can automatically adjust as the user annotates. When the user finishes annotating the document, the annotations scale back with the zoom region to original page size. These novel features provide advantages over conventional techniques that do not contemplate multi-scale navigation during document annotating.

Abstract: Systems, methods, and computer-readable media for making rich, flexible, and more natural electronic ink annotations in an electronic document include creating a first context node associated with a first portion of a base portion of an electronic document; creating a second context node associated with an annotation to the base portion; and linking the second context node with the first context node.

Abstract: A method of analyzing electronic ink, in which document data for a document containing electronic ink content is received from a software application running on a first processing thread. The first processing thread is employed to provide the document data to an electronic ink analysis process for analyzing on a second processing thread. Control of the first processing thread is then returned to the software application. After the results of the analysis are received, the results are reconciled with the current document data for the document.

Abstract: A digital ink annotation process and system for processing digital documents and digital ink annotations therein. The process and system maintain an annotation's position within a document such that the original intent and meaning of the annotation is preserved. This is true even if the document is edited, resized, displayed on a different device or otherwise modified. The digital ink annotation process includes automatic and manual grouping of digital ink strokes within a document to define digital ink annotations, classifying the annotations according to annotation type, and anchoring the annotations to appropriate regions or positions in a document. The process further includes reflowing the annotations in a new document layout such that the annotations conform and adapt to the new layout while preserving the original intents and meanings of the annotations.