Abstract: A user interface that accepts input data through both speech and the use of a pen or stylus. With the interface, a user can employ voice recognition to enter a large volume of data, and subsequently employ a stylus input to modify the input data. A user can also employ stylus input, such as data from a handwriting or character recognition operation, to control how subsequently spoken words are recognized by a voice recognition operation. Further, a user may input data using a stylus, and then modify the input data using a voice recognition operation. A user may also employ a voice recognition operation to control how handwriting or character data input through a stylus is recognized by a handwriting recognition operation or a character recognition operation. In addition to a user interface, a technique is disclosed for inputting data into a computer where information is shared between a speech input operation and a handwriting input operation.

Abstract: A user is provided with guidelines that are temporarily displayed with content, in order to assist the user in neatly and accurately writing electronic ink. The guidelines may appear when the user moves a writing tool, such as a stylus or pen, close to a display and writing surface. Alternately, the guidelines may appear after the user has begun to write electronic ink, so that the guidelines can correspond to the angle at which the user is writing, the size of the user's handwriting, or both. As the user writes the electronic ink onto the writing surface, the handwritten electronic ink is added to the content being rendered on the display. After the user has finished writing electronic ink and moves the writing tool away from the writing surface, the guidelines are deleted, and are not added to the displayed content. In this way, the user can employ the temporary guidelines to accurately and legibly write electronic ink into content, without the guidelines themselves becoming a permanent part of the content.

Abstract: A recognition tool according to the invention intelligently recognizes natural input before it is passed to a destination or target application. More particularly, the recognition tool according to the invention provides better formatting for text recognized from natural input, based upon the context in which the text is being inserted into a target application. The recognition tool also provides various tools for correcting inaccurately recognized text. For example, the recognition tool allows a user to select only a part of an inaccurate text, and then identifies alternate text candidates based upon the selected portion of the inaccurate text. Further, when the user selects text containing multiple words for correction, the recognition tool provides cross combinations of alternate text candidates for the user's selection.

Abstract: An improved system for managing user inputs and z-order in a graphic user interface (GUI) environment is disclosed. A GUI element may include a plurality of keys corresponding to keys on a typical keyboard, and may serve as a replacement for the keyboard. The system permits an application having an input focus to retain the input focus while inputs are received in the GUI element, and even transient user interface elements (e.g., menus) will remain displayed in those applications after the user inputs are entered. Input pen and mouse events may first be forwarded to the input area application, which may remove the events from the normal circulation, preventing other applications from learning of the events, and then post those events to the input panel application separately.

Abstract: A system, method, and user interface for interacting with electronically displayed content is disclosed. In response to a selection of an object, a list of menu options is displayed close to the selected object. In one embodiment, the list of menu options is displayed in a font larger than that used to display the selected object. Through the use of the invention, a user is provided with a technique for actively reading displayed content with minimal distractions from the user interface.

Abstract: Displaying image data with sub-pixel precision on display devices having pixels with separately controllable pixel sub-components, such as those used in liquid crystal display devices. Samples of the image data are obtained, and spatially different sets of one or more of the samples are mapped to individual pixel sub-components as opposed to mapping sets of samples to entire pixels. Luminous intensity values based on the mapped sets of samples are generated and used to control the operation of the separately controllable pixel sub-components. The image is thereby displayed on the display device, with different portions of the image being represented by different pixel sub-components, resulting an image with sub-pixel resolution. The image data can represent a text character, in which case the stem width of a stem of the text character can have a value that is not an integer multiple of the width of a full pixel.

Abstract: The present invention relates to methods and apparatus for increasing the perceived quality of displayed images. This is achieved in a variety of ways including the use of a plurality of device specific display characteristics when preparing images for display. It is also achieved through the monitoring of display device and/or ambient light conditions, e.g., on a periodic basis, and using the obtained information when controlling display output. Another approach to improving the perceived quality of displayed images involves the use of information relating to a specific user's ability to perceive image characteristics such as color. By customizing display output to an individual user's own physical perception capabilities and/or viewing characteristics it is possible to enhance the image quality perceived by the individual viewer as compared to embodiments which do not take into consideration individual user characteristics.

Abstract: The color of a pixel is represented in a pixel storage word, wherein color coordinate data and intensity data are coded separately in two fields of the pixel storage word, the color field and the intensity field. This permits a range of colors to be represented in a relatively small number of bits. In one embodiment of the invention, each of the three color coordinates of an input color is coded separately. The coded color components are concatenated and placed in a coded color field of the pixel storage word. In another embodiment of the invention, the color coordinate data is encoded as a color index, a binary value which maps to color coordinate data according to a predefined color table. Intensity data is also encoded with a binary value. The coded intensity can represent the intensity directly, or can be an index to intensity data stored in a predetermined intensity table.

Abstract: Display apparatus, and methods for displaying images, e.g., text, on gray scale and color monitors are described. Gray scale displays implemented in accordance with the present invention include displays having a resolution in a first dimension, e.g., the horizontal dimension, which is several time the resolution in a second dimension, e.g., the vertical dimension. Various other displays of the present invention are capable of operating as both gray scale and color display devices. In one such display, the color filter used to implement a color portion of the display is omitted from another, e.g., gray scale portion of the same display. In such an embodiment, text, e.g., captions, are displayed using the gray scale portion of the display while color images, e.g., graphics, are displayed on the color portion of the display. In another display of the present invention, a color filter with filter cells that can be switched between a color and a clear mode of operation are employed. When images, e.g.

Abstract: A computer system and method for highlighting and selecting elements of electronic documents is disclosed. In one embodiment, a selection area identifies an initial selection of data, and one or more selection handles appear on the selection area to allow dynamic resizing of the selection area to select a larger or smaller portion of data or number of items.

Abstract: Display apparatus, and methods for displaying images, e.g., text, on gray scale and color monitors are described. Gray scale displays implemented in accordance with the present invention include displays having a resolution in a first dimension, e.g., the horizontal dimension, which is several time the resolution in a second dimension, e.g., the vertical dimension. Various other displays of the present invention are capable of operating as both gray scale and color display devices. In one such display, the color filter used to implement a color portion of the display is omitted from another, e.g., gray scale portion of the same display. In such an embodiment, text, e.g., captions, are displayed using the gray scale portion of the display while color images, e.g., graphics, are displayed on the color portion of the display. In another display of the present invention, a color filter with filter cells that can be switched between a color and a clear mode of operation are employed. When images, e.g.

Abstract: Methods and apparatus for utilizing pixel sub-components which form a pixel element of an LCD display, e.g., as separate luminous intensity elements, are described. Each pixel of a color LCD display is comprised of three non-overlapping red, green and blue rectangular pixel sub-elements or sub-components. The invention takes advantage of the ability to control individual RGB pixel sub-elements to effectively increase a screen's resolution in the dimension perpendicular to the dimension in which the screen is striped, e.g., the RGB pixel sub-elements are arranged lengthwise. In order to utilize the effective resolution which can be obtained by treating RGB pixel sub-components separately, scaling or super sampling of digital representations of fonts is performed in one dimension at a rate that is greater than the scaling or sampling performed in the other dimension. In some embodiments where weighting is used in determining RGB pixel values, e.g.

Abstract: The present invention relates to switching modes of an input device based on events. The invention detects events that suggest that the user does not want to continue with a present mode of the input device and switches to another operation mode. The detection and response to user inputs simplifies the user's interactions with the system. In some embodiments, the user may be asked prior to switching modes for confirmation. The present invention may be used with limited input devices including styluses.

Abstract: Display apparatus, and methods for displaying images, e.g., text, on gray scale and color monitors where each pixel includes multiple pixel sub-components are described. Filtering and/or displaced sampling is used to generate pixel sub-component luminous intensity values. As a result of treating pixel sub-components as distinct light emitters corresponding to different image portions, resolution is enhanced but color errors may be introduced into the image being displayed. Various techniques for detecting noticeable and/or distracting color errors are described. In addition, various techniques for correcting, compensating for, or reducing color errors are described. In one particular embodiment, red, green and blue pixel sub-component luminous intensity values are examined and compared to a range of luminous intensity values which is determined as a function of utilized foreground and background pixel colors.

Abstract: A method and apparatus for simulating at least one gesture of a pointing device such as a mouse. A left click, right click, left drag, right drag, and/or mouse movement may be simulated using a stylus in conjunction with a touch-sensitive display surface. For example, a computer having the display surface may detect whether a stylus is being held down on a touch-sensitive display surface for at least a threshold amount of time. The computer may further detect whether the stylus is then removed from the touch-sensitive display surface after at least the threshold amount of time. Responsive to the stylus being removed, the computer may generate at least one event representing a right mouse button being pressed.

Abstract: The present invention relates to a system, method and medium for receiving and acting upon user input. In one embodiment, the user may only have access to a limited input device, like a stylus. Using the present invention, a user is provided with intuitive responses from the system based on inputs from the limited input device.

Abstract: A computer system and method for providing user feedback when creating, modifying, or editing electronic documents. An insertion point icon is placed in a document at a position for insertion and/or deletion of text, graphics, data, etc. Upon receiving an user input indicating movement, the insertion point icon is divided into two icons, one stationary at the position, and one moving with user input. When movement is complete, space contained between the icons may be deleted or inserted. The system may be used to shift handwritten text to subsequent lines on an electronic document containing handwritten text, and may be used to bring two groups of text together, deleting space in between. A connection line may be displayed between the icons to provide feedback regarding the action to be taken.

Abstract: Methods for classifying, anchoring, and transforming ink are disclosed. Ink drawings and ink annotations are captured and stored with additional information that allows the various described methods to associate the ink with one or more displayed elements. During reformatting or re-flowing a displayed document, the ink may be properly displayed as originally intended.

Abstract: An architecture for an integrated shopping service that enables electronic shopping from within a software application. The software application includes web browsing functionality, with the capability to navigate to a limited set of web sites. The client machine on which the software runs maintains a local list of the limited set of web sites that can be accessed from within the software application. A directory server maintains a list of retail web sites that can be added to the client's local list of accessible web sites. Each client machine that runs the software application connects to the directory server in order to add web sites to the locally-maintained list of sites that can be accessed from within the integrated shopping service.

Abstract: The resolution of text rendered on a display device having sub-pixel elements, such as an RGB LCD for example, and in particular, on a display device having horizontal striping is enhanced by (i) overscaling (or oversampling) character outline information in the vertical (or Y) direction, and (ii) filtering displaced information from the overscaled (or oversampled) character outline information. Metrics associated with character outline information may be appropriately adjusted. The vertical (or Y) position of the baseline of adjacent characters may be constrained by forcing the first pixel above the baseline to be composed of a full number N of scan conversion source samples, where N corresponds to an overscaling (or oversampling) factor. Groups of scan conversion source samples may be converted into packed pixel index values. Color values may be selectively filtered when the differences in the intensity of adjacent sub-pixel elements would otherwise be irritating to view.