Abstract: Various technologies and techniques are disclosed for improving handwriting recognition using a neural network by allowing a user to provide samples. A recognition operation is performed on the user's handwritten input, and the user is not satisfied with the recognition result. The user selects an option to train the neural network on one or more characters to improve the recognition results. The user is prompted to specify samples for the certain character, word, or phrase, and the neural network is adjusted for the certain character, word, or phrase. Handwritten input is later received from the user. A recognition operation is performed on the handwritten input using the neural network that was adjusted for the certain character or characters.

Abstract: A handwritten word is transcribed into a list of possibly correct transcriptions of the handwritten word. The list contains a number of text words, and this list is compared with previously stored set of lists of text words. Based on a metric, one or more nearest neighbor lists are selected from the set. A decision is made, according to a number of combination rules, as to which text word in the nearest neighbor lists or the recently transcribed list is the best transcription of the handwritten word. This best transcription is selected as the appropriate text word transcription of the handwritten word. The selected word is compared to a true transcription of the selected word Machine learning techniques are used when the selected and true transcriptions differ. The machine learning techniques create or update rules that are used to determine which text word of the nearest neighbor lists or the recently transcribed list is the correct transcription of the handwritten word.

Abstract: A method for classifying an input character, the method comprising the steps of, in a processing system, for a plurality of character models, decomposing the input character into one or more segments in accordance with a segmentation scheme associated with the character model, and evaluating the one or more segments against a segment model associated with the character model, by using fuzzy logic rules to produce a score indicative of the conformity with the segment model, the method further including selecting the character model that produced the highest score, and classifying the input character as a character associated with the character model that produced the highest score.

Abstract: A system and method that facilitates and effectuates in situ search for active note taking. The system and method includes receiving gestures from a stylus and a tablet associated with the system. Upon recognizing the gesture as belonging to a set of known and recognized gestures, the system creates an embeddable object, initiates a search with terms indicated by the gesture, associates the search results with the created object and inserts the object in close proximity with the terms that instigated the search.

Abstract: A natural input system is described for creating and editing complex structures in a typeset application. The natural input system receives a typeset representation of an object and converts the typeset format to generate a standard digital ink representation. The natural input system provides the generated ink representation to a natural input application where can be manipulated by the user with a rich set of correction and editing features provided by the natural input application. Once the end user is satisfied with the recognition result in the natural input application, the natural input system receives the recognition result based on the modified digital ink representation. The natural input system may convert the received recognition result to the typeset application format and provides the modified typeset representation to the typeset application for merging into the document the user is editing.

Abstract: A method and system for identifying multiple questionnaire pages. An embodiment of a method includes receiving a set of coordinates from a capture device, the set of coordinates indicating shapes made on multiple pages of a questionnaire without the use of a graphical user interface, and mapping each shape to a questionnaire answer on a different page. The method enables a processor to accurately and quickly determine which answers were entered on each questionnaire page attached to the capture device, without relying on the user to do so. Exemplary applications include a field survey and inventory.

Abstract: Techniques for efficiently and accurately organizing freeform handwriting into lines. A global cost function is employed to find the simplest partitioning of electronic ink strokes into line groups that also maximize the “goodness” of the resulting lines and the consistency of their configuration. The “goodness” of a line may be based upon its linear regression error and the horizontal and vertical compactness of the strokes making up the line. The line consistency configuration for a grouping of strokes is measured by the angle difference between neighboring groups. The global cost function also takes into account the complexity of the stroke partitioning, measured by the number of lines into which the strokes are grouped. An initial grouping of strokes is made, and the cost for this initial grouping is determined. Alternate groupings of the initial stroke grouping are then generated.

Abstract: In one aspect, the user can rapidly enter and search for text using a data entry system through a combination of entering one or more characters on a digitally displayed keyboard with a pointing device and using a search list to obtain a list of completion candidates. The user can activate the search list to obtain a list of completion candidates at any time while entering a partial text entry with the data entry system. When the search list is active, a list of completion candidates is displayed on a graphical user interface for the user to select from and the user can perform one of several actions. When the user deactivates the search list, the user can continue adding to or modifying the current partial text entry being entered, and may re-invoke the search list to further search for completion candidates based on the modified partial text entry.

Abstract: An apparatus is disclosed for providing data into a template document, the template document having a number of portions for completion by a user. The apparatus comprises: a verbal input device (72) arranged to receive and record a verbal passage, the verbal passage including information for a specific one of the portions of the template document; and a handwriting input device (70) arranged to decode handwritten information corresponding to the verbal passage, the handwritten information including identification of the specific portion of the template document. The apparatus also includes a data processing and storage device (78,82) arranged to: associate the verbal passage with the handwritten information based on the timings of the verbal passage and the handwritten information; determine from the verbal passage and the handwritten information the data to be provided into the specific portion of the template document; and associate the data with the specific portion of the template document.

Abstract: Embodiments consistent with the subject matter of this disclosure may transparently project text fragments from one or more buffers into one or more projection buffers by reference, instead of by copying. Clients or applications, such as, for example, compilers, language services, an editor's rendering system, or other client or application, may transparently process the projected text fragments projected into the projection buffers as if processing simple text files. In some embodiments, text of a first language, embedded in a document having text of one or more other languages, may be projected to a projection buffer and provided to an application, which may process text of the first language. In other embodiments, text may be elided from a document by projecting to a projection buffer only text not to be elided from the document.

Abstract: A device for detecting characters in an image includes a Hough transformer implemented to identify, as identified elements of writing, circular arcs or elliptical arcs in the image or in a preprocessed version of the image. The device further includes a character description generator implemented to obtain, on the basis of the identified circular arcs or elliptical arcs, a character description which describes locations of the identified circular arcs or elliptical arcs. In addition, the device includes a database comparator implemented to compare the character description with a plurality of comparative character descriptions which have character codes associated with them, so as to provide, as a result of the comparison, a character code of a detected character.

Abstract: Embodiments include an article of manufacture, apparatus, device, system, computer-program product, and method. In an embodiment, an article of manufacture includes a display surface that includes a machine-distinguishable form identifier keyed to an electronic version of the form and at least two fields. Each field of the at least two fields respectively includes a unique machine-distinguishable field identifier keyed to a field of the electronic version of a form, a content area that accepts a hand-formed entry, and a unique user-understandable field identifier.

Abstract: A character on which character recognition is being performed resides in one or more character strings, at least one of which excludes a subset of characters from a character set. In selecting character assignments for the character, one or more of multiple proposed character assignments for the character are eliminated as being a character in a subset of excluded characters.

Abstract: The subject invention leverages a scalable character glyph hash table to provide an efficient means to identify print characters where the character glyphs are identical over independent presentation. The hash table allows for quick determinations of glyph meta data as, for example, a pre-filter to traditional OCR techniques. The hash table can be trained for a particular environment, user, language, character set (e.g., alphabet), document type, and/or specific document and the like. This permits substantial flexibility and increases in speed in identifying unknown glyphs. The hash table itself can be composed of single or multiple tables that have a specific optimization purpose. In one instance of the subject invention, traditional OCR techniques can be utilized to update the hash tables as needed based on glyph frequency. This keeps the hash tables from growing by limiting updates that reduce its performance, while adding frequently determined glyphs to increase the pre-filter performance.

Abstract: An information processing apparatus includes a display acquisition unit including a display screen which displays information to a user, and an acquisition unit configured to acquire an input pattern written by the user, a storage unit which prestores, as a registered pattern, a pattern corresponding to the input pattern, a comparison unit configured to compare a shape and orientation of the input pattern with a shape and orientation of the registered pattern, a computation unit configured to compute a degree of difference between the orientation of the input pattern and the orientation of the registered pattern, and a selection unit configured to select a display orientation of a display target corresponding to the input pattern, displayed on the display screen, from a plurality of display orientations determined by a shape of the information processing apparatus, based on the computed degree of difference.

Abstract: Methods and systems for converting text into natural personal handwriting are provided. One aspect relates to the training of a computer to recognize a user's handwriting style. In one embodiment, the computer receives handwriting samples of at least one character written by the user, such as the character being provided as the beginning, middle, or ending character among a plurality of other characters. Further embodiments allow for increased personalization of the handwriting. Another aspect relates to system and methods for displaying a representation of a computer user's handwriting. In one embodiment, the handwriting comprises variant shapes of letters, personalized connection style between letters, and connection parts that look pressure-sensitive. In another embodiment, characters are adjusted, such as cutting portions of the character to create a more realistic recreation and synthesis of the handwriting.

Abstract: A system and method for automatically recognizing words or phrases in text.

Abstract: A method of compressing a digital ink input including a sequence of strokes is provided in which each stroke is represented as a series of digital words representing x and y co-ordinates, at least one reference co-ordinate of each stroke is expressed in absolute terms, and a co-ordinate other than the at least one reference co-ordinate is expressed as an offset from a preceding co-ordinate. The co-ordinate other than the at least one reference co-ordinate is represented as a combination of an estimate determined from the previous m co-ordinates and a residual error value.

Abstract: The claimed subject matter provides a system and/or a method that facilitates analyzing and/or recognizing a handwritten character. An interface component can receive at least one handwritten character. A personalization component can train a classifier based on an allograph related to a handwriting style to provide handwriting recognition for the at least one handwritten character. In addition, the personalization component can employ any suitable combiner to provide optimized recognition.

Abstract: A computer-based system is disclosed for the gathering and analysis of data and planning associated with that data captured during or related to events. The system is based on existing core technology that allows for the use of a digital pen land marked with respect to some spatial location on the surface of a computer screen that allows storage of ink data and allows for interpretation of handwritten characters. A mouse can be used in place of the digital pen, however, it is advantageous to use the digital pen on the surface of a computer screen. Part of the invention is able to capture real-time data in dynamic environments where the user must maintain active contact with the scene, allowing only minimal viewing of the computer screen. This minimal viewing component can be applied to, but not limited to, polling, traffic analysis, and sporting events. For the application to team sporting events, the minimal viewing component provides an efficient means for personnel to enter game statistics in real-time.

Abstract: Disclosed herein is a configuration of a writing volume of a spatial chirographic reader facilitating an on-line method of recognition of handwriting characters. The writing volume may be partitioned by an ink depth into a positioning stereographic hemisphere and an inking stereographic hemisphere. Two projection spheres may be made to intersect on a projection typeface plane forming a disc encapsulating the writing volume. A center of the disc may be a universal reference point for converting handwriting movements of a stylus to inferred rotations. Characters may be mapped to reference rotations, wherein on-line reader data may be compared to effect identification of the characters. Labeling of cardinal positions and graduation of rotation paths may be configured such that inking strokes of a particular writing system may be observable in a minimal number of integer factors of rotation of ? radians.

Abstract: A system and method for assisting with analysis and recognition of ink is described. Analysis hints may be associated with a field. The field may receive electronic ink. Based on the identity of the field and the analysis hint associated with it, at least one of analysis and recognition of ink may be assisted.

Abstract: Shape recognition is performed based on determining whether one or more ink strokes is not part of a shape or a partial shape. Ink strokes are divided into segments and the segments analyzed employing a relative angular distance histogram. The histogram analysis yields stable, incremental, and discriminating featurization results. Neural networks may also be employed along with the histogram analysis to determine complete shapes from partial shape entries and autocomplete suggestions provided to users for conversion of the shape into a known object.

Abstract: A game apparatus includes a CPU core. In response to a setting of a reverse input mode, the CPU core reverses vertically and horizontally BG/OBJ data corresponding to a question, and displays on an LCD an image based on the reversed BG/OBJ data. When a handwriting input operation associated with the image is accepted by a touch panel, the CPU core displays on the LCD an image based on handwriting input data corresponding to the accepted handwriting input operation.

Abstract: A number of regions and partitions may be created based on input handwritten atoms and a grammar parsing framework. Productions for tabular structures may be added to the grammar parsing framework to produce an extended grammar parsing framework. Each of the regions may be searched for a tabular structure. Upon finding a tabular structure, a type of tabular structure may be determined. Configuration partitions may be created, based on the added productions, and added to the created partitions. A set of configuration regions may be created based on the configuration partitions and added to the created regions. The productions for tabular structures and productions of the grammar parsing framework may be applied, as rewriting rules, to the atoms to produce possible recognition results. A best recognition result may be determined and displayed. A mechanism for correcting misrecognition errors, which may occur while recognizing tabular structures, may be provided.

Abstract: A method of inputting a series of characters into an electronic device 1 comprising a display 11, the method comprising: detecting a first input associated with a first one of a plurality of discrete areas 53 of the display 11 for entering characters on the display 11; and recognizing the first input in the first one of the plurality of discrete areas 53 as a first character input 59 while a second one of the plurality of discrete areas 53 is operable to detect a second input for recognition as a second character input 59, the recognition of the second character input 59 occurring separately to the recognition of the first character input 59.

Abstract: The invention provides a method/system for estimating the orientation of a segment of digital ink using pen orientation information. In one form, the invention is a method of estimating the orientation of a segment of digital ink, the method including the steps of: measuring the azimuth of the pen at a sampling rate during writer generation of the segment of digital ink; and estimating the orientation of the segment of digital ink using the measured azimuth of the pen at sampled points.

Abstract: Methods and systems are provided for analyzing and assessing documents using a writing profile for documents, such as a payment instrument. A method may include providing a document to a computer system. The document comprises at least one information field. Writing in at least one information field of the document may be compared to at least two writing profile representations from at least one information field of at least one other document.

Abstract: The invention provides a method/system for estimating the orientation of a segment of digital ink using pen orientation information. In one form, the invention is a method of estimating the orientation of a segment of digital ink, the method including the steps of: measuring the azimuth of the pen at a sampling rate during writer generation of the segment of digital ink; and estimating the orientation of the segment of digital ink using the measured azimuth of the pen at sampled points.

Abstract: The invention relates to a method for handwriting detection using a handwriting tool (2) being arranged for communicating with a further device (2) and comprising the following steps: recognizing characters using detection of movements carried out by means of said handwriting tool (2); determining the probability factor of at least one input character corresponding to a given character; and using said probability factor in a step for correction, completion and prediction of words being formed by said characters. The invention also relates to a device for such handwriting detection.

Abstract: A product is on a surface provided with a first position code which codes locations of a plurality of first points. In at least one zone on the surface, the product is further provided with a second position code which codes locations of a plurality of second points. The zone further comprises a field which is associated with a predetermined function to be performed in consequence of a sensing device being placed in the field. Methods and devices for coding and for recording of information from a surface are also described.

Abstract: Methods, systems, and computer-readable media for ascertaining neighborhood information in a dynamically changing environment, such as an electronic ink environment may include: (a) receiving data representing plural electronic ink strokes; (b) defining a first vertex associated with a first ink stroke; and (c) determining neighboring vertices to the first vertex, wherein the neighboring vertices are associated with ink stroke(s) other than the first ink stroke. Additional systems, methods, and computer-readable media may include: (a) receiving data representing plural electronic ink strokes; (b) defining plural vertices associated with the ink strokes; (c) receiving input indicating a selection of an ink component; and (d) determining at least one neighboring component by determining which ink component(s) located outside of the selection include one or more ink strokes having vertices that neighbor vertices included in the selection.

Abstract: Various technologies and techniques are disclosed that improve cursive handwriting recognition. Cursive handwriting input is received from a user. The system performs a hierarchical prototype search as part of a recognition operation. A same space search is performed against a mixed database that has both print and cursive samples. A same space search is also performed against a cursive database that has only cursive samples. The results of these two same space searches are merged into a combined alternate list. The combined alternate list is then used as a constraint for the dynamic time warp searches that are performed against the mixed and cursive databases, respectively. The results of the dynamic time warp searches are also merged into a final combined alternate list, and the combined alternate list is used to make a recognition decision regarding the user's handwritten input.

Abstract: A method and program product for tracking and presenting communication services consumed by an organization from a plurality of communications service providers are provided. The method comprises storing information relating to communications services expenses of the organization from two or more service providers in an invoices data store, storing information relating to services approved for use by the organization in an inventory data store, storing information relating to communications equipment in use by the organization in an inventory data store, and providing an interface for the tracking and presentation of the consumption of both wireless and wired communications services, including invoices, services, and inventory associated with the wired and wireless communications services.

Abstract: The present application describes systems and methods for real-time verification of form input using a digital pen. In one configuration, a user inputs data by checking or initialing boxes using a digital pen and then selects a complete indicator. The system then verifies that all required boxes have been checked and if they have not, the system provides real-time feedback to the operator.

Abstract: In a method and system to extract data from handwritten information when the information is captured as sequences of strokes, vectors, or marks, temporal data is stored within the color or gray-scale encoding of pixel values within a bitmapped image. A bitmapped image is used to create a derived image suitable for data extraction and a method of analyzing the image, including the encoded temporal data, to yield an adjusted image that better reflects the intent of the person who created the handwriting. While the primary application of the invention is in processing handwritten responses to assessment items, the system and method can be advantageously used to extract data from or to improve the presentation of information from an electronic representation of temporal human marks in many applications. Additionally, the system and method can be advantageously used to store and process other types of data within a bitmapped image.

Abstract: A method, system and computer program for creating a digital workflow associated with the completion of a paper form is provided. An electronic clipboard includes a panel for receiving a paper form, a computer including a clipboard computer application, and an input device that completes the paper form with handwritten input data and also created digital signals corresponding to the handwritten input data. The computer application interprets the digital signal data so as to define digital input data, which corresponds to the handwritten input data. The electronic clipboard also includes verification/correction facility that enables the display of the digital input data and verification and correction thereof using a series of input devices provided on the electronic clipboard. The electronic clipboard is linked to a remote computer.

Abstract: Embodiments of the invention present a system and method for generating digital links, or “ink tags,” from handwritten notes on a writing surface. Handwritten data, including one or more ink tags identifying digital content, is captured by a smart pen device and used to retrieve a digital document associated with the handwritten data. The handwritten data is analyzed to identify the ink tags. In one embodiment, a computing system performs optical character recognition on the handwriting data to identify a plurality of characters included in the handwriting data and compares one or more characters to formats associated with digital content. Responsive to identifying an ink tag, a digital link between the ink tag and a source for the digital content identified by the ink tag is generated, allowing the digital content to be retrieved by an interaction with the ink tag.

Abstract: In accordance with embodiments of the invention, embedded interaction code (EIC) symbols are recognized. EIC dots are generated based on effective EIC symbols, which have been generated by processing an image containing the EIC symbols, by obtaining graylevels of selected positions of the EIC-symbols. Rotated EIC dots are generated based on the EIC dots by determining which grid cells correspond to the EIC symbols and by determining which direction is a correct orientation of the EIC symbols. A homography matrix is updated with orientation information based on the EIC dots. EIC bits are extracted from the rotated EIC dots based on graylevels of selected positions of the rotated EIC dots.

Abstract: Systems and methods are disclosed that facilitate normalizing and beautifying digitally generated handwriting, such as can be generated on a tablet PC or via scanning a handwritten document. A classifier can identify extrema in the digital handwriting and label such extrema according to predefined categories (e.g., bottom, baseline, midline, top, other, . . . ). Multi-linear regression, polynomial regression, etc., can be performed to align labeled extrema to respective and corresponding desired points as indicated by the labels. Additionally, displacement techniques can be applied to the regressed handwriting to optimize legibility for reading by a human viewer and/or for character recognition by a handwriting recognition application. The displacement techniques can comprise a “rubber sheet” displacement algorithm in conjunction with a “rubber rod” displacement algorithm, which can collectively preserve spatial features of the handwriting during warping thereof.

Abstract: Systems and methods are provided for training neural networks and other systems with heterogeneous data. Heterogeneous data are partitioned into a number of data categories. A user or system may then assign an importance indication to each category as well as an order value which would affect training times and their distribution (higher order favoring larger categories and longer training times). Using those as input parameters, the ordered training generates a distribution of training iterations (across data categories) and a single training data stream so that the distribution of data samples in the stream is identical to the distribution of training iterations. Finally, the data steam is used to train a recognition system (e.g., an electronic ink recognition system).

Abstract: Methods and systems are provided for capturing written information from an information field of a document using a computer system. A document may be provided to the computer system. The document may include at least one information field. In one embodiment, a method includes assessing whether writing in an information field approximately matches a writing profile representation from at least one information field from at least one other document and associating the information field with the text representation corresponding to a matching writing profile representation.

Abstract: After markings have been placed on a pre-printed form by a user who interacted with an entity, the form is scanned to produce a scan file. The scan file is analyzed to identify whether user added markings are present on machine readable selection items. The method can take a number of automated actions, depending upon which pre-printed machine readable selection items were checked by the user. For example, in response to checkbox selections, the method can obtain (read) some form of electronically storable data relating to the entity based on which of the machine readable selection items the user checked. Alternatively, in response to other checkbox selections, the method can ignore the user added markings on the machine readable selection items. In addition, in response to the checkmarks, the system can maintain only an image of the user added handwritten text.

Abstract: A disclosed information processing system includes an input unit configured to input a file or an image of a form; an entry field obtaining unit configured to extract entry fields of the form from the input file or image; a label name obtaining unit configured to obtain label names of the extracted entry fields from characters or symbols in the form, the label names indicating information to be entered in the entry fields; a style information table storing unit configured to store a style information table that contains style information of the entry fields in association with the label names; a style information obtaining unit configured to search the style information table based on the obtained label names to obtain the style information of the entry fields; and an entry field definition output unit configured to output an entry field definition list including the entry fields, the label names, and the style information.

Abstract: The invention relates to on-line handwriting recognition. At least one auxiliary line is displayed on a touch sensitive panel. Each of the auxiliary lines constitutes a portion of more than one character of a character set. A character of the character set is drawn on the touch sensitive panel by completing one of the at least one auxiliary line into the character. The drawn character is recognized on the basis of said completion. The invention allows handwriting recognition that is significantly more reliable and easier to use than prior art techniques.

Abstract: Computer-readable media having computer-executable instructions and apparatuses detect a table in a handwritten document. Line segments are derived from drawing strokes so that a bounding frame of a candidate table is obtained. An associated table structure is consequently recognized from the bounding frame, lines segments within the bounding frame, and their intersection points. A classifier that reflects at least one table characteristic is determined, and the candidate table is consequently validated or rejected.

Abstract: There is disclosed a method and a device for inputting a character into an electronic device, said method comprising detecting an input, activating a temporary input area upon detection of said input, displaying said temporary input area on a display of said electronic device, and terminating the display and deactivating said temporary input area in case that a relevant event is detected. The relevant event may be another user-input.

Abstract: Described is a bimodal data input technology by which handwriting recognition results are combined with speech recognition results to improve overall recognition accuracy. Handwriting data and speech data corresponding to mathematical symbols are received and processed (including being recognized) into respective graphs. A fusion mechanism uses the speech graph to enhance the handwriting graph, e.g., to better distinguish between similar handwritten symbols that are often misrecognized. The graphs include nodes representing symbols, and arcs between the nodes representing probability scores. When arcs in the first and second graphs are determined to match one another, such as aligned in time and associated with corresponding symbols, the probability score in the second graph for that arc is used to adjust the matching probability score in the first graph. Normalization and smoothing may be performed to correspond the graphs to one another and to control the influence of one graph on the other.

Abstract: An image processing apparatus includes an image reader for reading an image. A display controller displays the read image on a display device. A determination unit receives an area specified by an operation performed on the image displayed on the display device so as to determine a processing area to be subjected to predetermined image processing. A setting unit sets an operation area for providing an instruction to execute the predetermined image processing on the processing area determined by the determination unit, the operation area being based on an end point of the area specified by the operation.

Abstract: A method and apparatus for capturing information encoded within a surface, such as location information or document metadata, and associating the information with a document is described. The captured information may be obtained by a camera associated with a pointing or writing device having a camera, such as an image-capturing pen.