Abstract: Handwriting recognition techniques employing a personalized handwriting recognition engine. The recognition techniques use examples of an individual's previous writing style to help recognize new pen input from that individual. The techniques also employ a shape trainer to select samples of an individual's handwriting that accurately represent the individual's writing style, for use as prototypes to recognize subsequent handwriting from the individual. The techniques also alternately or additionally employ an intelligent combiner to combine the recognition results from the personalized recognition engine and the conventional recognition engine (or engines). The combiner may use a comparative neural network to combine the recognition results from multiple recognition engines. The combiner alternately may use a rule-based system based on prior knowledge of different recognition engines.

Abstract: The present invention provides a method of copying, using a substrate, object data to a clipboard of a graphical user interface operating system, the substrate having a graphical representation of the object data disposed therein or thereon, the substrate also having coded data disposed therein or thereon, the coded data identifying a plurality of locations on the substrate, the coded data also identifying a layout of the graphical representation of the object data, the method including the steps of: receiving, from a sensing device and in a computer system, indicating data, the indicating data describing movement of the sensing device relative to the substrate, the indicating data also identifying the layout of the graphical representation of the object data, the sensing device, when moved relative to the substrate, adapted to read at least some of the coded data and generate, from the at least some coded data, the indicating data; retrieving, in the computer system and using the indicating data, the object

Abstract: The present invention relates to a method for processing information, an information processing system, and a handwriting input terminal. Said information processing system can operate in a handwriting input mode or a click input mode. Such system comprises a plurality of handwriting input terminals, and a data processing center communicatively connected with handwriting input terminals via a transceiver. Said method comprises following steps: S1: configuring a handwriting recognition module and a click position coordinate-key mapping module for the information processing system; S2: receiving information about working mode selection of the information processing system; S3: the handwriting input terminal receives and processes handwriting input signals to obtain coordinate information; S4: selecting the handwriting recognition module or click position coordinate-key mapping module to transform the coordinate information into corresponding character or key information based on the selected working mode.

Abstract: A method of enabling a user to initiate an action via a printed substrate, said substrate comprising user information and coded data, said coded data being indicative of a region identity associated with the substrate and of a plurality of locations on the substrate, said method comprising the steps of: receiving, in a computer system and from a sensing device, mode data and interaction data, the sensing device being operable in a plurality of modes and the mode data being indicative of one of said modes, the interaction data being indicative of the region identity and at least one position of the sensing device relative to the substrate, the sensing device generating the interaction data, when operatively positioned or moved relative to the substrate, by reading at least some of the coded data; identifying and retrieving at least part of a page description corresponding to the printed substrate using the region identity; determining a mode of the sensing device using the mode data; identifying an action usin

Abstract: An autonomous handheld device comprises a drawing module having drawing capabilities for electronically editing a drawing and a motion sensing feature for sensing self-motion. The autonomous handheld device is configured to associate the motion sensing feature with the drawing capability thereby to allow sensed motion of the motion sensing feature to modify the electronic editing.

Abstract: A system for enabling a user to access information, said system comprising: a printed substrate, said substrate comprising user information and coded data indicative of a region identity associated with the substrate and of a plurality of locations on the substrate; and a sensing device comprising: an optical sensor for sensing at least some of the coded data when the sensing device is operatively positioned or moved relative to the substrate; a mode selector for allowing the user to select a mode of operation; a processor for generating mode data using the selected mode and interaction data using the sensed coded data, said mode data being indicative of the selected mode, said interaction data being indicative of the region identity and at least one position of the sensing device relative to the substrate; and means for communicating the mode data and the interaction data to a computer system, wherein the mode data together with the interaction data determine a response in the computer system.

Abstract: An electronic document creating apparatus includes a document information obtaining device that obtains and inputs document identification information put on a sheet document. The document identification information specifies an electronic document stored in a folder. The electronic document serves as an output source of the sheet document. An electronic document extraction device is provided to extract an electronic document based on the document identification information. A new document creation device is provided to create a new electronic document by combining at least two electronic documents extracted by the electronic document extraction device. The new electronic document is stored in a folder.

Abstract: A method of providing information to a user via a printed substrate, said substrate comprising user information and coded data indicative of a region identity associated with the substrate and of a plurality of locations on the substrate, said method comprising the steps of: receiving, in a computer system, interaction data indicative of the region identity and at least one position of a sensing device relative to the substrate, the sensing device generating the interaction data, when operatively positioned or moved relative to the substrate, by reading at least some of the coded data; identifying and retrieving at least part of a page description corresponding to the printed substrate using the region identity; generating a query expression comprising one or more search terms, at least one of said search terms being identified using the page description and the at least one position of the sensing device; forming a request using the query expression; and sending the request, or a results resource including s

Abstract: A handwriting guide including an active and/or inactive writing guide is rendered by displaying a shaded outline object having a line for receiving electronic ink, displaying the active writing guide thereby indicating a location of a current active context, and expanding the active and/or inactive writing guide up to a maximum width of the outline object in response to receiving more electronic ink within a line. The active writing guide can comprise a bracket displayed on each corner of a writing area distinguished on a line and can correspond to an insertion point upon switching to text mode. A drawing guide that includes an active and/or inactive drawing guide is rendered by displaying a shaded drawing guide and the active drawing guide in response to detecting ink strokes within the drawing guide. The active drawing guide can comprise a bounding rectangle encompassing a drawing area that receives ink strokes.

Abstract: A method of controlling an electronic device including a touch sensitive display the method including displaying a plurality of graphical items on the touch sensitive display where each graphical item has an identity; detecting a coupling, formed by a user, of at least two graphical items, the coupling including, a trace on the touch sensitive display between the at least two graphical items; and, performing an action dependent upon the identity of the coupled graphical items.

Abstract: Techniques for processing handwriting input based upon a user's writing style. Some techniques employ the style in which the user writes a single character, while other techniques alternately or additionally employ a group of allographs that form a handwriting style. Some implementations of these techniques, such as those implemented in writing style analysis tool, analyze one or more characters written by a user to identify a community, such as a geographic region or cultural group, to which the user's handwriting style belongs. Other implementations analyze one or more characters of a user's handwriting in order to alternately or additionally categorize the user's handwriting into a particular handwriting style. The writing style analysis tool may then provide the user with a handwriting recognition application specifically configured for that user's personal handwriting style.

Abstract: A method for determining whether a disputed electronic signature is that of a purported signator includes the steps of (a) creating in a single step an ink on paper signature and an identical electronic signature of the purported signator; (b) verifying that the ink on paper signature is consistent with known ink on paper signatures of the purported signator; and (c) comparing the disputed electronic signature with the electronic signature of the purported signature to determine whether the disputed electronic signature is that of the purported signator.

Abstract: A system and method for encoding a document image and finding a location based on that image are described. A document page is encoded into codes associated with various locations of the document page. The codes are assembled into a code book. Captured images may then be similarly encoded and searched against the codes in the codebook. One or more codes and associated locations may be returned, thereby providing one or more possible locations for the captured images.

Abstract: A method and system for identifying multiple questionnaire pages. An embodiment of a method includes receiving a set of coordinates from a capture device, the set of coordinates indicating shapes made on multiple pages of a questionnaire without the use of a graphical user interface, and mapping each shape to a questionnaire answer on a different page. The method enables a processor to accurately and quickly determine which answers were entered on each questionnaire page attached to the capture device, without relying on the user to do so. Exemplary applications include a field survey and inventory.

Abstract: A method of estimating the orientation of digital ink is provided. The includes measuring, at a sampling rate during writing by an optically imaging pen on a surface printed with tags, the azimuth of the pen, and estimating, at the computer system, the orientation of the segment of digital ink using the measured azimuth of the pen at the sampled points. Each tag encodes data on an identity of the surface associated with a digital description of the surface and on the respective location of that tag on the surface. The digital description is stored by a computer system networked with the pen and the digital ink is generated by associating the digital description with the data encoded by the tags optically imaged by the pen during the writing.

Abstract: The present invention relates to a system, method and medium for receiving and acting upon user input. In one embodiment, the user may only have access to a limited input device, like a stylus. Using the present invention, a user is provided with intuitive responses from the system based on inputs from the limited input device.

Abstract: A system for estimating the orientation of digital ink is provided which has an optically imaging pen and a processor. The processor measures the azimuth of the pen at a sampling rate during writing by the pen on a surface printed with tags and estimates the orientation of the digital ink using the measured azimuth of the pen at the sampled points. Each tag encodes data on an identity of the surface associated with a digital description of the surface and on the respective location of that tag on the surface. The digital ink is generated by associating the digital description with the data encoded by the tags optically imaged by the pen during the writing.

Abstract: A system and method for storing document data in a serialized binary format recognition lattice structure so that the data is accessible to other applications. The lattice structure is generated that includes root node data. Child nodes correspond to columns of the recognition lattice. Each node includes a descriptor that is a collection of flags indicating presence of specific components of the node. The child nodes may include grandchild nodes with similar structure corresponding to elements within the columns. Each node further includes property information associated with the node. The recognition lattice is stored in a serial binary data format.

Abstract: Embodiments include an article of manufacture, apparatus, device, system, computer-program product, and method. In an embodiment, an article of manufacture includes a display surface that includes a machine-distinguishable form identifier keyed to an electronic version of the form and at least two fields. Each field of the at least two fields respectively includes a unique machine-distinguishable field identifier keyed to a field of the electronic version of a form, a content area that accepts a hand-formed entry, and a unique user-understandable field identifier.

Abstract: A method, in an apparatus for position decoding, operates to extract a sequence of positions from a sequence of images of a position-coding pattern, as recorded by a sensor. The method, which may be embodied as a computer program on a computer-readable storage medium, involves the steps of retrieving at least one reference position (P1, P1?); and extracting the sequence of positions solely by matching information obtained from each of the images with a corresponding pattern reference area (MA), which represents a known subset of the position-coding pattern with a given, direct or indirect, spatial relation to the reference position(s).

Abstract: Disclosed herein is a chirographic signal pulse-emitting source and chirographic reader system. In an embodiment according to the present invention, contact-free proximity sensors may replace mechanical sensors. Ultrasonic transducers emit position-signaling pulses from a tip of the signal pulse-emitting source. Ultrasonic sensors on a reader typeface frame receive the pulses (transmissions). Proximity may be determined from the duration of travel of a pulse. Also disclosed herein is a reader subsystem including at least two separate modules. The at least two separate modules may include a pulse transmitting unit for a hand-held part and a stationary typeface frame reader sensing and receiving unit. The method may provide multiple triangulation measurements from a sensor arrangement to sense a multi-dimensional direction of the signal pulse-emitting source. The method may also provide pulse-width resolution by averaging multiple triangulation measurements for each signal pulse.

Abstract: Computer-readable media having computer-executable instructions and apparatuses detect a structured handwritten object is detected in a handwritten document. A primitive structure, which is associated with a set of component objects, is formed. A candidate handwritten object is identified by detecting a corresponding logical structure. A classifier for the candidate handwritten object is determined. Consequently, the candidate handwritten object is validated from the classifier.

Abstract: A method and system for computer-based recognition of natural language data. The method is implemented on a distributed computer network and includes obtaining natural language data, such as digital ink handwriting, using an input device (415), receiving the natural language data on a server via a network, processing the natural language data using a recognizer (440) residing on the server (430) to produce intermediate format data (445), transmitting the intermediate format data (445) to an application (450), and decoding the intermediate format data 445 into computer-readable format data using the application (450) and context information associated with the application (450).

Abstract: A sensing device is provided having an image sensor for sensing and capturing images of tags on a surface, a processor and a transmitter. Each tag encodes data on an identity associated with the surface and a location and orientation of that tag on the surface. The processor identifies the tags from the captured images, determines an orientation, within the captured images, of the identified coded tags, decodes the data encoded by the tags at the determined orientation, and generates indicating data from the decoded data to include the identity and data regarding a position and/or movement of the sensing device relative to the surface. The transmitter transmits the indicating data to a computer system.

Abstract: The present invention relates to a system, method and medium for receiving and acting upon user input. In one embodiment, the user may only have access to a limited input device, like a stylus. Using the present invention, a user is provided with intuitive responses from the system based on inputs from the limited input device.

Abstract: In a combined holistic and analytic recognition system, a holistic recognition module recognizes an input word or phrase image by matching an input string of character features for the whole word or phrase against a string of prototype features for a plurality of reference words in a lexicon. This yields a holistic answer list of candidates for the input word or phrase. Based on each answer in the holistic answer list, the holistic recognition module creates segmentation hypotheses for each character in an answer. The analytical recognition module uses segmentation hypotheses from the holistic answer list to cut the image of the input string of characters into individual character images and to produce an analytical answer list. The holistic answer list and the analytic answer list are compared to find the best answer from the two lists.

Abstract: A dynamic database reordering system provides a linguistics database that contains words that are ordered according to a linguistics model that dictates the order in which words are presented to a user. While a user enters keystrokes on a keypad of a communications device is pressing keys, the invention predicts the words, letters, numbers, or word stubs that the user is trying to enter. The invention reorders the linguistics model order based on the user's usage of the system by tracking the user's word selections. Once a word has been selected as a result of a next key selection (the nexted word), a frequency value is applied to the selected word and the word ordered first by the linguistics model in the linguistics database for that key sequence. The frequency value of the nexted word will become greater than the frequency value of the first displayed word upon repeated nexting to the same word.

Abstract: In accordance with embodiments of the invention, embedded interaction code (EIC) symbols are recognized. EIC dots are generated based on effective EIC symbols, which have been generated by processing an image containing the EIC symbols, by obtaining graylevels of selected positions of the EIC-symbols. Rotated EIC dots are generated based on the EIC dots by determining which grid cells correspond to the EIC symbols and by determining which direction is a correct orientation of the EIC symbols. A homography matrix is updated with orientation information based on the EIC dots. EIC bits are extracted from the rotated EIC dots based on graylevels of selected positions of the rotated EIC dots.

Abstract: Systems and methods are disclosed that facilitate normalizing and beautifying digitally generated handwriting, such as can be generated on a tablet PC or via scanning a handwritten document. A classifier can identify extrema in the digital handwriting and label such extrema according to predefined categories (e.g., bottom, baseline, midline, top, other, . . . ). Multi-linear regression, polynomial regression, etc., can be performed to align labeled extrema to respective and corresponding desired points as indicated by the labels. Additionally, displacement techniques can be applied to the regressed handwriting to optimize legibility for reading by a human viewer and/or for character recognition by a handwriting recognition application. The displacement techniques can comprise a “rubber sheet” displacement algorithm in conjunction with a “rubber rod” displacement algorithm, which can collectively preserve spatial features of the handwriting during warping thereof.

Abstract: A sensing device for sensing coded data on a surface, generating indicating data using the coded data, and transmitting the indicating data to a computer system is provided. The coded data is indicative of an identity of a region of the surface and of a plurality of locations of the region, whilst the indicating data comprises data regarding a region identity of the surface and data regarding a position and/or movement of the sensing device relative to the surface. The sensing device comprises: (a) an image sensor configured for sensing and capturing images of at least some of the coded data when the sensing device is placed in an operative position relative to the surface; (b) a processor for generating the indicating data using the captured images; and (b) a transmitter for transmitting the indicating data to the computer system.

Abstract: Methods and systems for facilitating the selection of alternates for hand written word. Rules select words user based on operating modes and cursor positions and sequential orderings. User interfaces can also be used to select words and to provide alternates for the selected words having alternates. Words that the recognizer believes correct to a high actual or relative probability may be skipped over in automatic processes, and the display of words that the recognizer is less confident are correct can be modified. The user can adjust such sensitivity settings for determining the probability of correctness.

Abstract: The invention relates to on-line handwriting recognition. At least one auxiliary line is displayed on a touch sensitive panel. Each of the auxiliary lines constitutes a portion of more than one character of a character set. A character of the character set is drawn on the touch sensitive panel by completing one of the at least one auxiliary line into the character. The drawn character is recognized on the basis of said completion. The invention allows handwriting recognition that is significantly more reliable and easier to use than prior art techniques.

Abstract: A process and apparatus for determining the location of a captured array from a larger image is described. A non-repeating sequence may be folded into a non-repeating array in which the array is unique for every neighboring window of a given size. A portion of the array of the neighboring window may be captured and a subset of extracted bits corresponding to the captured array is decoded to identify error bits. The location of the captured array is determined within the non-repeating array by further processing the decoded bits.

Abstract: A method and apparatus for capturing information encoded within a surface, such as location information or document metadata, and associating the information with a document is described. The captured information may be obtained by a camera associated with a pointing or writing device having a camera, such as an image-capturing pen.

Abstract: Methods and apparatus are disclosed for locating an area of interest within a digital image of a form captured by an imaging scanner. Specific examples include methods and apparatus for optical mark reading with a digital imaging scanner. In many of the methods, an image of a response form is captured by a scanner, and target areas for possible responses are located within the image based upon an expected location being adjusted as necessary for certain error-inducing defects in the forms or scanning process. Also disclosed are steps to normalize the darkness values of pixels captured from an optically scanned form.

Abstract: The present invention leverages classification type detectors and/or context information to provide a systematic means to recognize and anchor annotation strokes, providing reflowable digital annotations. This allows annotations in digital documents to be archived, shared, searched, and easily manipulated. In one instance of the present invention, an annotation recognition method obtains an input of strokes that are grouped, classified, and anchored to underlying text and/or points in a document. Additional instances of the present invention utilize linguistic content, domain specific information, anchor context, and document context to facilitate in correctly recognizing an annotation.

Abstract: Systems and methods that determine a path of a pen tip as the pen tip is moved across a document are described. The document is watermarked with a maze pattern from which encoded position information is determined. A sequence of images is captured by a camera that is located in a pen. The path of the pen tip is determined by decoding the associated maze pattern and by matching the captured images with document images. If the position coordinates of any frame that is associated with a stroke cannot be determined from m-array decoding, the frames are transformed and then matched with an area of a document image. Once the position coordinates of at least one frame is determined, the position coordinates of other frames are determined by matching the frames in a neighboring area.

Abstract: A method and system for cleaning handwriting for redisplay of the handwriting or for improved recognition accuracy is provided. The cleanup system receives handwriting that has been digitized. The cleanup system then analyzes the handwriting to identify strokes that satisfy a cleanup criterion. When a stroke has been identified as satisfying some cleanup criteria, the cleanup system cleans up the handwriting based on the detected criteria. In this way, the cleanup system generates handwriting that may have a more visually pleasing appearance to the reader.

Abstract: An ink manager running at a computer system receives ink information entered at a pen-based input/display device and accumulates the ink information into ink strokes. The ink manager communicates with a handwriting recognition engine and includes an ink phrase termination engine that is configured to detect the occurrence of one or more ink phrase termination events by examining the ink information. Upon the occurrence of an ink phrase termination event, the ink manager notifies the handwriting recognition engine and organizes the preceding ink strokes into an ink phrase data structure. The ink manager may also pass the ink phrase to an application executing on the computer system that is associated with the ink information, and it, in response, may return a reference pointer and a recognition context to the ink manager. The reference pointer and recognition context are then appended to the ink phrase data structure.

Abstract: A digital pen and paper system comprises a pen arranged to make pen strokes on a document having a plurality of regions, to detect markings on the document, and to record them in a series of samples. The system is arranged to determine from the samples the position of the pen strokes. The system has defined therein a plurality of different warning conditions that determine when a warning will be produced in response to lost samples, and is arranged to select one of the warning conditions for one of the pen strokes depending on which of the regions the pen stroke is made.

Abstract: A method and system for enabling registration of a user to use a computer system. The method includes providing a printed registration form containing information relating to user registration, the form including coded data indicative of an identity of the form and of at least one reference point of the form. Indicating data is received, in a processing system associated with the computer system, from a sensing device regarding the identity of the form and a position of the sensing device relative to the form. The sensing device, when placed in an operative position relative to the form, generates the indicating data using at least some of the coded data on the form. The method further includes identifying, in the processing system and from the indicating data, at least one parameter relating to user registration, and storing the at least one parameter so as to be accessible by said computer system.

Abstract: In accordance with embodiments of the invention, local metadata is embedded into, and extracted from, an embedded interaction code document. A plurality of local-metadata values are assigned, in accordance with a set of local-metadata conflict-resolution rules, via a plurality of respective partial-share channels, to a plurality of respective local-metadata fields. The local metadata is decoded by decoding the partial-share channels and by resolving potentially conflicting decoded local-metadata values according to the set of local-metadata conflict-resolution rules. A local metadata value of a region to the left may be smaller than a local metadata value of a potentially conflicting region to the right, and the values may be non-continuous. A local metadata value of an upper region may be smaller than a local metadata value of a potentially conflicting lower region, and the values may be continuous.

Abstract: In a pen-based computing system, a printed version of a document having preexisting content is annotated using a smart pen. The smart pen captures handwriting gestures to obtain an electronic representation of the annotations. The smart pen computing system identifies a digital version of the document having the preexisting content and stores the electronic representation of the annotations in association with the digital document. The smart pen computing system may overlay the electronic representation of the annotations with the preexisting content to provide a digital representation of the annotated document.

Abstract: The presently described embodiments solve the problem of getting electronic calendar entries back onto the paper calendar. To do so, in one form, according to the presently described embodiments, an inkjet label printer is mounted next to the paper calendar. Each time a daily entry gets updated online, the label printer prints out a new sticky label whose size and markings correspond to the revised paper calendar entry for that day. It is then a simple process for the user to peel off the label and affix it to the correct location on the paper calendar.

Abstract: A standalone real time device to process handwritten text for further applications. The system includes a means for making visible markings on writing surface, accompanied with a motion detector for detecting the handwritten text. It also comprises a microprocessor for storing appropriate data and commands, an enhanced memory to provide storage space for information and data, and a power supply. The system further includes a display to provide visual feedback of processed data. Also, it further includes an audio reproduction device to provide audio feedback; and further includes wired or wireless communication means to transmit data to targeted devices via a transmission link in real time.

Abstract: The present invention relates to a jotting implement that infers hand-jotted information from viewing a jotting surface and environmental landmarks. The hand-jotted information is any information marked on the jotting surface as a result of writing, jotting, drawing, sketching or otherwise operating on the jotting surface as well as hand-generated information produced by moving the implement in the air with respect to the jotting surface. The jotting implement has a nib for jotting and an arrangement for determining when the nib is jotting on the jotting surface. Further, the implement has an optical unit for viewing an environmental landmark and the jotting surface. The implement has a processing unit for receiving optical data of the environmental landmark and the jotting surface from the optical unit and determining from the optical data the physical coordinates of the nib with respect to the jotting surface.

Abstract: A handwriting trajectory recognition system, having a motion detection unit adapted to output electric signals based on changes in acceleration of a body of the system in space. A control unit adapted to detect non-stroke regions intervals where the motions of the system body are temporarily stopped and recover handwritings based on the electric signals is provided.

Abstract: A method of enabling instruction of a computer to perform tasks, using an interface surface having command and object interactive elements, the interface surface having command and object interactive elements, the interface surface including coded data. The method includes having the computer system receive indicating data from a sensing device, which is generated when the sensing device is moved relative to the interface surface, the indicating data being indicative of a stroke designating the interactive elements. The computer system uses the indicating data to determine the interactive elements designated by the stroke before applying a command to at least one object using the designated interactive elements.

Abstract: The invention relates to a touchscreen-sensitive and transponder reading stylus. The object of the invention is to provide a small touchscreen-sensitive stylus whose power requirements are low and which allows transponder communication. The inventive stylus is characterized in that a hand-piece also accommodates an RF-ID electronic system and that it comprises a tip range that tapers in at least one direction of its scanning tip. Said tip area is provided with an antenna preferably in the form of an electric coil and is configured in such a manner that it is devoid of an electromagnetic screening, that an electromagnetic field emitted at the tapered end is substantially not attenuated and that it is suitable for the optically exact scanning of screens.

Abstract: An editing system is provided which is configured to include a paper 2, which is prepared to be able to specify entry locations, and on which paper space information is printed, a digital pen 1 for acquiring information entered by hand-writing as stroke data, and a pen server 3 for editing the paper space information on the basis of the stroke data acquired by the digital pen 1, wherein the pen server 3 is configured to include a command database 309 that stores command execution information indicating a content of an editing process correspondingly to commands for specifying the editing process, extracts the paper space information on the paper, specified with the digital pen 1 and searches for command execution information corresponding to the command entered on the paper 2 with reference to the command database 309 to execute the editing process, extracts the paper space information on the paper 2 specified with the digital pen 1, searches for command execution information corresponding to the command ente