Abstract: A system and a method are disclosed for calibrating writing on a writing surface to a digital document. One or more calibration parameters associated with a writing surface and a digital document of a display device are determined. The calibration parameters indicate a spatial offset between a reference position on the writing surface and a reference position in the digital document. A gesture captured by a smart pen is received. The gesture includes a sequence of spatial positions representing movement of the smart pen with respect to the writing surface. The sequence of spatial positions is mapped to a sequence of spatial positions in the digital document based on the calibration parameters.

Abstract: A system and method are disclosed for interacting with digital workbooks. An identifier, identifying a physical workbook, is received. The physical workbook is associated with a digital book and can be displayed on a display screen of a computing system. Captured interactions between the smart pen and the writing surface of the workbook are received. One or more completed areas of the workbook are identified based on the one or more captured interactions. Based on the one or more completed areas of the workbook, a portion of the digital book is selected and displayed.

Abstract: A method of selecting content using a pen-based computing system. Gestures generated by a user with a smart pen on a writing surface are captured and used to select content. The content can be written or audio content. Optionally additional content linked to the selected content is also selected.

Abstract: A system and a method are disclosed for calibrating writing on a writing surface to a digital document. One or more calibration parameters associated with a writing surface and a digital document of a display device are determined. The calibration parameters indicate a spatial offset between a reference position on the writing surface and a reference position in the digital document. A gesture captured by a smart pen is received. The gesture includes a sequence of spatial positions representing movement of the smart pen with respect to the writing surface. The sequence of spatial positions is mapped to a sequence of spatial positions in the digital document based on the calibration parameters.

Abstract: A central device concurrently receives handwriting gestures from a plurality of smart pen devices. Each set of handwriting gestures includes a sequence of spatial positions of the corresponding smart pen device with respect to a writing surface. Representations of the handwriting gestures are displayed on a display screen, and the representations show relative timing between the different sets of handwriting gestures. In one embodiment, a portion of the received handwriting gestures is outputted for display.

Abstract: A system and method receives a plurality of data streams from a smart pen device and a computing device, and indexes the data streams to a synchronized time index. A processor receives a first data stream representing gesture data captured by a smart pen device, and a second data stream representing a sequence of states associated with applications executing on a computing device, such that each state identifies content displayed by a computing device while the gesture data is captured. For example, a state could be a particular page of a digital document displayed by the computing device. After receiving the first and second data streams, the processor indexes the data streams to a synchronized time index, and stores the indexed data streams in a memory.

Abstract: A method of selecting content using a pen-based computing system. Gestures generated by a user with a smart pen on a writing surface are captured and used to select content. The content can be written or audio content. Optionally additional content linked to the selected content is also selected.

Abstract: In a pen-based computing system, a user-specific smart pen application is created from a template application using customer authoring tools. The template application contains computer program code that is to be executed by a processor of a smart pen. Application content and a representation for printed content are received. The application content, provided by user or customer, defines functional interactions between the printed content representation and a smart pen. The template application is combined with application content to generate a user-specific application comprising instructions for being executed on a processor of a smart pen. The user-specific application is stored on a storage medium.

Abstract: A system and a method are disclosed for calibrating writing on a writing surface to a digital document. One or more calibration parameters associated with a writing surface and a digital document of a display device are determined. The calibration parameters indicate a spatial offset between a reference position on the writing surface and a reference position in the digital document. A gesture captured by a smart pen is received. The gesture includes a sequence of spatial positions representing movement of the smart pen with respect to the writing surface. The sequence of spatial positions is mapped to a sequence of spatial positions in the digital document based on the calibration parameters.

Abstract: A system and method receives a plurality of data streams from a smart pen device and a computing device, and indexes the data streams to a synchronized time index. A processor receives a first data stream representing gesture data captured by a smart pen device, and a second data stream representing a sequence of states associated with applications executing on a computing device, such that each state identifies content displayed by a computing device while the gesture data is captured. For example, a state could be a particular page of a digital document displayed by the computing device. After receiving the first and second data streams, the processor indexes the data streams to a synchronized time index, and stores the indexed data streams in a memory.

Abstract: A central device concurrently receives handwriting gestures from a plurality of smart pen devices. Each set of handwriting gestures includes a sequence of spatial positions of the corresponding smart pen device with respect to a writing surface. Representations of the handwriting gestures are displayed on a display screen, and the representations show relative timing between the different sets of handwriting gestures. In one embodiment, a portion of the received handwriting gestures is outputted for display.

Abstract: A system and method are disclosed for interacting with digital workbooks. An identifier, identifying a physical workbook, is received. The physical workbook is associated with a digital book and can be displayed on a display screen of a computing system. Captured interactions between the smart pen and the writing surface of the workbook are received. One or more completed areas of the workbook are identified based on the one or more captured interactions. Based on the one or more completed areas of the workbook, a portion of the digital book is selected and displayed.

Abstract: In a pen-based computing system, a user-specific smart pen application is created from a template application using customer authoring tools. The template application contains computer program code that is to be executed by a processor of a smart pen. Application content and a representation for printed content are received. The application content, provided by user or customer, defines functional interactions between the printed content representation and a smart pen. The template application is combined with application content to generate a user-specific application comprising instructions for being executed on a processor of a smart pen. The user-specific application is stored on a storage medium.