Abstract: The present invention provides a user interface for a hand-held device that allows users to activate the full “card” for an entry using one gesture on a button while also giving the user the ability to reach a menu of context dependent commands using a second gesture on a button. In particular, the present invention recognizes certain button inputs as context menu gestures. When these gestures are made, a context menu appears. The user is then able to select a command in the context menu that is to be performed. The present invention also allows a user to open context menus while only using one hand to operate and hold the device.

Abstract: A user interface allows a user to input handwritten, key-press, and spoken text in a seamless, synchronized manner. A text input panel accepts soft keyboard presses and handwritten words, characters, and gestures. A text recognizer/synchronizer integrates textual input from various sources while recognizing and preserving the order in which a user entered text via the soft keyboard, via handwriting, and/or by speaking. Synchronized text may be displayed in a stage area of the text input panel before being passed to an operating system message router and/or an application program. While in handwriting recognition mode, various permutations and combinations of a word recognition area, a character recognition area, and a keybar/keypad may optionally be displayed.

Abstract: A method of embedding voice data in a computing system includes detecting a record event and detecting if a software application currently running on the computing system is voice-aware. The method also includes embedding the voice data within associated data in the software application, if the software application is voice-aware. If the software application is not voice-aware, the method also includes triggering a voice note application to record and store the voice data. A method in a computing system for modifying a user interface displayed on a display device includes receiving an indication from the computing device to modify the user interface. The method further includes displaying an identification block, a record toolbar, a note pad, and a note tab.

Abstract: Recognition results associated with handwritten electronic ink, voice recognition results or other forms of user input can be corrected by designating at least a portion of a visual display. Recognition results corresponding to the designated portion, and optionally, additional recognition results to provide context, are displayed. Portions of the displayed recognition results are then selected, and alternate recognition results made available. Alternate recognition results can be chosen, and the selected recognition results modified based upon the chosen alternate. The invention may include different user interfaces.

Abstract: A digital ink environment is provided for non-native ink application programs to create independent ink services for sharing between different application programs and transmission. The digital ink environment is provided for interacting with embedded or linked ink words or other ink data in a compound ink document. The user is provided with the freedom to input digital ink so they can write anywhere in the ink environment, in any orientation, and using any desired stroke size provided by the ink environment. The ink environment is provided in an activated state for in-situ user interaction and manipulation in a computing environment, for example a pen-based environment.

Abstract: An adaptive pen mode selection is included within a pen input based computing system. The adaptive pen mode selection automatically switches the operating mode from an input data mode to the data item selection mode when a pen stroke is made over an existing data item to permit it to be selected for editing, deletion and replacement. The adaptive pen mode selection provides an improved user interface returns the computer to the user specified operating mode when the selection operation has been completed to allow the user to continue entering data in the user specified operating mode. With adaptive pen mode selection, a user of a pen input based computing system does not need to change the operating mode of the computer to an data item selection mode using the control inputs in order to select one or more data items for editing.

Abstract: A user interface that accepts input data through both speech and the use of a pen or stylus. With the interface, a user can employ voice recognition to enter a large volume of data, and subsequently employ a stylus input to modify the input data. A user can also employ stylus input, such as data from a handwriting or character recognition operation, to control how subsequently spoken words are recognized by a voice recognition operation. Further, a user may input data using a stylus, and then modify the input data using a voice recognition operation. A user may also employ a voice recognition operation to control how handwriting or character data input through a stylus is recognized by a handwriting recognition operation or a character recognition operation. In addition to a user interface, a technique is disclosed for inputting data into a computer where information is shared between a speech input operation and a handwriting input operation.

Abstract: The present invention provides a user interface for a pen-based device that allows users to activate the full “card” for an entry using a single tap while also giving the user the ability to reach a menu of context dependent commands using a simple gesture. In particular, the present invention recognizes certain stylus and/or button inputs as context menu gestures. When these gestures are made, a context menu appears. The user is then able to select a command in the context menu that is to be performed. The present invention also allows a user to open context menus while only using one hand to operate and hold the device.

Abstract: Flexible and efficient systems and methods for organizing, analyzing, and processing digital ink incrementally analyze input data (e.g., representing ink strokes) as the user continues to add to, edit, or modify the data. In this manner, processing is performed promptly as the ink is entered, and the processing system and method can effectively keep up with the user. This prevents long processing delays, because the systems and methods need not first process a large volume of ink data present after the user has entered has completely filled a page with ink.

Abstract: Electronic ink layout analysis systems and methods provide flexibility and efficiency in organizing, analyzing, and processing digital ink. These layout analysis systems and methods allow users substantial freedom in entering electronic ink into a pen-based computer system. Using these systems and methods, a user's input digital ink is not constrained by requirements that a user write in a specific screen orientation, that a user write in one specific orientation on all portions of a page, or that a user write using a specific minimum or maximum sized stroke. Rather, the systems and methods freely allow the user to write anywhere on a given page, in any orientation or size, while still enabling effective and efficient handwriting recognition and other processing of the input digital ink.

Abstract: Flexible and efficient systems and methods for analyzing digital or electronic ink may automatically classify electronic ink strokes on a page into one or more types of stroke (such as drawing strokes, text strokes, music strokes, mathematical strokes, charts, flowcharts, tables, graphs, etc.). The systems and methods may include an input for receiving input ink data including at least one stroke set, and a processor for determining the type of stroke contained in the stroke set based, at least in part, on information regarding the contextual environment relating to the stroke set. The contextual environment relating to the stroke set may include one or more contextual features regarding the stroke set. These contextual features may include, for example, various features relating to the stroke(s) within the first stroke set, features relating to stroke(s) located within a predetermined range of the first stroke set, and/or features relating to stroke(s) associated in some manner with the first stroke set.

Abstract: A lasso select tool that allows a user to draw a flexible line of selection ink in order to select one or more graphical objects for manipulation. As the user draws this selection line, the lasso select tool continuously redraws and displays a connection line connecting one end of the selection line with the opposite end of the selection line. This connection line thus graphically demonstrates to the user the area that is presently encompassed by the resulting lasso enclosure. Further, the lasso select tool will change the appearance of any object selected with the lasso enclosure. The lasso select tool also selects objects that are only substantially encompassed by the lasso enclosure. For example, the lasso select tool may select ink objects that are only 60% or more encompassed by the lasso enclosure.

Abstract: A method, a computer system and a computer-readable medium having instructions for a processor stored thereon are provided for growing a page on a display. Input indicating a first position or designation of content on a page of an electronic document and an amount of white space to be inserted in the page is received. Responsive to the received input, at least some of the content of the page of the electronic document is moved to insert white space. The moving starts from a point based on the first position. The portion of the content being moved is moved a distance based on the amount of white space indicated in the received input. The page is grown by an amount based on the amount of the white space indicated in the received input. A respective size of other pages of the electronic document remains unchanged. Also provided are a method, a computer system and a computer-readable medium having instructions for a processor stored thereon for deleting a portion of a page and reducing a size of the page.

Abstract: A method and system for automatically determining when an application should switch from a writing mode to a text entry mode, and vice-versa. When a soft input panel (SIP) or input method (IM) is selected, the application is notified and enters a text entry mode. Inputting via the IM while in this mode causes a character to be sent to the application, while pen events in the application window enable text editing and the selection of text and ink data in the application widow. When the SIP is deselected, the application is notified and enters a pen (writing) mode, whereby the pen events are interpreted as digital ink strokes instead of characters. Sub-modes of the pen mode are also available, via which the pen events are used to manipulate existing ink in the application window. Visual feedback may be provided to remind the user of the current mode and/or sub-mode.

Abstract: A system and method for organizing and prioritizing recognized text. More particularly, a method and system for categorizing recognized text according to confidence levels in the correctness of the recognized text. The system and method may categorize recognized text into two or more different confidence levels. A user interface can display recognized text based upon the confidence level assigned to that text, thereby drawing a user's attention to that text for which the recognition process has a low confidence in its correctness estimate. The user interface may also allow a user to correct erroneously recognized text with different techniques, according to the level of confidence that the recognition process has in the correctness of the text.

Abstract: In a computing device, a method and system for searching for matching ink words or phrases, by comparing a given search term of at least one word (and possibly alternates) with the words in a document, including recognized ink words and any possible alternates for those recognized words as returned by a recognizer. Various matching tests are possible because of the use of alternates, which also may have corresponding probability rankings that may influence the search. Searching may occur in actively edited ink documents, or the recognition results may be saved as saved search file data that can be searched independent of recognition.

Abstract: An adaptive auto-scrolling merge operation automatically accepts pen-based input data into a hand-held or palm sized computer and places the input data onto a line of a window in which a user intended the input data to be placed. Computing systems that accept input from users typically accept data items to be inserted into a scrollable window that is displayed by the computer. When a user is inserting data items at the end of the window, computing systems may automatically scroll the displayed portion of the window when data has been added to the last line of the window. Because pen based systems do not use a cursor located at an insertion point to know where a user wants new data items to be inserted, the new data items are inserted into the document at the location corresponding to the place within the window in which the user drew the pen strokes used to create the data item.

Abstract: A method and system for automatically determining when an application should switch from a writing mode to a text entry mode, and vice-versa. When a soft input panel (SIP) or input method (IM) is selected, the application is notified and enters a text entry mode. Inputting via the IM while in this mode causes a character to be sent to the application, while pen events in the application window enable text editing and the selection of text and ink data in the application widow. When the SIP is deselected, the application is notified and enters a pen (writing) mode, whereby the pen events are interpreted as digital ink strokes instead of characters. Sub-modes of the pen mode are also available, via which the pen events are used to manipulate existing ink in the application window. Visual feedback may be provided to remind the user of the current mode and/or sub-mode.

Abstract: A system and method for use in computing systems that employ speech recognition capabilities. Where recognized speech can be dictation and commands, one or more buttons may be used to change modes of said computing systems to accept spoken words as dictation, or to accept spoken words as commands, as well as activate a microphone used for the speech recognition. The change in mode may occur responsive to the manner in which a button is pressed, where the manner may include such depressions as taps, press and holds, thumbwheel slides, and other forms of button manipulation.

Abstract: A method and system are provided for extending the functionality of application buttons on a limited resource computing device. Alternative application functions are launched based on the length of time an application button is pressed. A default function for an application is launched if the button is pressed for a short, i.e., normal, period of time. An alternative function of the application is launched if the button is pressed for a long, (e.g., at least one second), period of time. Still another function can be launched if the application button is pressed multiple times within a short period of time, e.g., double click.