Abstract: A system and a method are disclosed for organizing content collected in a pen-based computing system. A plurality of groups of stroke data are obtained. Each group of stroke data is associated with a timestamp based on the timing of strokes made by the smart pen. The groups of stroke data are grouped into one or more snippets based on a temporal proximity of the timestamps and spatial proximity of the stroke data. A request to associate a snippet to a tag is received. An association between the snippet and the tag is stored responsive to the request.

Abstract: A “self-addressing” writing surface, such as paper, includes an encoded identifier that is uniquely associated with the recipient or a group of recipients. A pen-based computing system is used to capture writing made on the writing surface. The captured writing and the recipient identifier are sent electronically to a routing system, which identifies the recipient to which the content is to be routed based on the recipient identifier. The routing system forwards the message to the identified recipient, thereby enabling communication from the writer to the recipient associated with the writing surface.

Abstract: A system and method receives a plurality of data streams from a smart pen device and a computing device, and indexes the data streams to a synchronized time index. A processor receives a first data stream representing gesture data captured by a smart pen device, and a second data stream representing a sequence of states associated with applications executing on a computing device, such that each state identifies content displayed by a computing device while the gesture data is captured. For example, a state could be a particular page of a digital document displayed by the computing device. After receiving the first and second data streams, the processor indexes the data streams to a synchronized time index, and stores the indexed data streams in a memory.

Abstract: A system and a method are disclosed for organizing content collected in a pen-based computing system. A plurality of groups of stroke data are obtained. Each group of stroke data is associated with a timestamp based on the timing of strokes made by the smart pen. The groups of stroke data are grouped into one or more snippets based on a temporal proximity of the timestamps and spatial proximity of the stroke data. A request to associate a snippet to a tag is received. An association between the snippet and the tag is stored responsive to the request.

Abstract: A system and a method are disclosed for smart zooming content displayed in a pen-based computing system. Content is displayed in a paper strip interface including at least a first and a second paper strip. When the zoom level associated with the content of the first paper strip is changed, the content of the first paper strip is transformed accordingly. A determination is made if applying the same transformation to the content of the second paper strip will cause the content to exceed the boundaries of the second paper strip. If so, then a second transformation is determined and applied to the content of the second paper strip.

Abstract: A system and a method are disclosed for displaying content collected in a pen-based computing system. Content collected in the pen-based computing system includes stroke data collected by a smart pen as well as other contextual data collected by the pen-based computing system. The collected stroke data are grouped into snippets and used to create paper strips. Paper strips are arranged based on metadata associated with the collected content.

Abstract: A system and a method are disclosed for organizing content collected in a pen-based computing system. Content collected in the pen-based computing system includes stroke data collected by a smart pen as well as other contextual data collected by the pen-based computing system. The collected stroke data includes timestamps and positional data. Based on correlations of spatial and temporal data, collected stroke data is grouped into clusters of stroke data. The clusters of stroke data, along with contextual data, are further grouped into snippets based on temporal correlations.

Abstract: An instruction is presented to a user for making a target gesture. The target gesture may be a portion of an exemplary or model symbol. The instruction may be presented in various ways, such as being printed on a writing surface or being played in audio format through a speaker of a smart pen device. A writing gesture made on a writing surface by the user is digitally captured using a smart pen device. The captured writing gesture is compared to the target gesture and feedback is determined based on this comparison. This feedback may indicate the correctness of the user's writing gesture. The feedback may be presented to the user through various means, including through the smart pen device. The comparison may also be used to determine a next instruction for the user to follow.

Abstract: In a pen-based computing system, a user-specific smart pen application is created from a template application using customer authoring tools. The template application contains computer program code that is to be executed by a processor of a smart pen. Application content and a representation for printed content are received. The application content, provided by user or customer, defines functional interactions between the printed content representation and a smart pen. The template application is combined with application content to generate a user-specific application comprising instructions for being executed on a processor of a smart pen. The user-specific application is stored on a storage medium.

Abstract: A central device concurrently receives handwriting gestures from a plurality of smart pen devices. Each set of handwriting gestures includes a sequence of spatial positions of the corresponding smart pen device with respect to a writing surface. Representations of the handwriting gestures are displayed on a display screen, and the representations show relative timing between the different sets of handwriting gestures. In one embodiment, a portion of the received handwriting gestures is outputted for display.

Abstract: A system and a method are disclosed for calibrating writing on a writing surface to a digital document. One or more calibration parameters associated with a writing surface and a digital document of a display device are determined. The calibration parameters indicate a spatial offset between a reference position on the writing surface and a reference position in the digital document. A gesture captured by a smart pen is received. The gesture includes a sequence of spatial positions representing movement of the smart pen with respect to the writing surface. The sequence of spatial positions is mapped to a sequence of spatial positions in the digital document based on the calibration parameters.

Abstract: A system and method establishes a connection between a smart pen and a computing device, and establishes a privilege level that regulates data requests for specific data from the smart pen. The smart pen determines whether a connection should be established between the smart pen and a computing device, based on device information received from the computing device. If a connection is established, a privilege level is established for an application executing on the computing device based on the device information, which determines whether a request from the application for specific data from the smart pen is allowed or denied.

Abstract: A system and method receives a plurality of data streams from a smart pen device and a computing device, and indexes the data streams to a synchronized time index. A processor receives a first data stream representing gesture data captured by a smart pen device, and a second data stream representing a sequence of states associated with applications executing on a computing device, such that each state identifies content displayed by a computing device while the gesture data is captured. For example, a state could be a particular page of a digital document displayed by the computing device. After receiving the first and second data streams, the processor indexes the data streams to a synchronized time index, and stores the indexed data streams in a memory.

Abstract: A system and method are disclosed for interacting with digital workbooks. An identifier, identifying a physical workbook, is received. The physical workbook is associated with a digital book and can be displayed on a display screen of a computing system. Captured interactions between the smart pen and the writing surface of the workbook are received. One or more completed areas of the workbook are identified based on the one or more captured interactions. Based on the one or more completed areas of the workbook, a portion of the digital book is selected and displayed.

Abstract: In a pen-based computing system, a user-specific smart pen application is created from a template application using customer authoring tools. The template application contains computer program code that is to be executed by a processor of a smart pen. Application content and a representation for printed content are received. The application content, provided by user or customer, defines functional interactions between the printed content representation and a smart pen. The template application is combined with application content to generate a user-specific application comprising instructions for being executed on a processor of a smart pen. The user-specific application is stored on a storage medium.

Abstract: In a pen-based computing system, a user-specific smart pen application is created from a template application using customer authoring tools. The template application contains computer program code that is to be executed by a processor of a smart pen. Application content and a representation for printed content are received. The application content, provided by user or customer, defines functional interactions between the printed content representation and a smart pen. The template application is combined with application content to generate a user-specific application comprising instructions for being executed on a processor of a smart pen. The user-specific application is stored on a storage medium.

Abstract: Embodiments of the invention present a system and method for controlling audio capture by a smart pen based computing system. An audio capture mechanism that is independent from a gesture capture system is included on the smart pen to control audio capture by one or more microphones included on the smart pen. In one embodiment, the audio capture mechanism comprises a shared function button, such as a power button. For example, a user interaction with the shared function button initiates audio capture by the one or more microphones on the smart pen and a second user interaction with the shared audio function stops audio capture. Alternatively, audio capture is stopped after completion of a predefined time interval after the user interaction with the shared function button.

Abstract: Embodiments of the invention present a system and method for identifying relationships between different types of data captured by a pen-based computing system, such as a smart pen. The pen-based computing system generates one or more sessions including different types of data that are associated with each other. In one embodiment, the pen-based computing system generates an index file including captured audio data and written data, where the written data is associated with a temporal location of the audio data corresponding to the time the written data was captured. For example, the pen-based computing system applies one or more heuristic processes to the received data to identify relationships between various types of the received data, used to associated different types of data with each other.