Abstract: A facility for adapting the prediction of ink is described. In some examples, the facility receives information about a spatial movement by a user. On the basis of the received information, the facility predicts future spatial movement by the user, and generates an ink stroke that reflects both the spatial movement described by the received information and at least a portion of the predicted future spatial movement. The facility enforces against the generated ink stroke a limit that has the effect of controlling the area of a portion of the ink stroke corresponding to the at least a portion of the predicted future spatial movement, and causes the generated ink stroke, subject to the enforcement of the limit, to be displayed.

Abstract: A computing device includes a digital input system that provides digital input functionality for the computing device. The digital input system receives both a first input and a second input. The first input is typically an input with the user's dominant hand (e.g., using a pen, stylus, finger, etc.), and the second input is typically an input with the user's non-dominant hand. The digital input system determines whether a second input is received simultaneously with the first input, and selects one of multiple behaviors for the first input based on whether the second input is received simultaneously with the first input. Various different behaviors for the first input can be selected from, such as freehand or freeform input, constraining digital input corresponding to the first input to be along an edge of a stencil, and so forth.

Abstract: Systems and methods are provided for improving the latency for display of ink during user creation of ink content with an object, such as a stylus, mouse, finger (or other touch input), or other drawing device. In order to reduce or minimize the time for display of ink content created by a user, aspects of the technology described herein generate predictive wet ink that can be displayed with actual wet ink. The predictive wet ink is calculated by extending an active ink segment a predictive distance. The predictive distance is intended to be a distance between a termination ink point for an active wet ink segment and a tip of the writing object. In one aspect, the predictive distance is calculated by determining the current latency period on a touch device and the velocity of the writing object.

Abstract: Methods, systems, and apparatuses for natural content editing with gestures include a gesture recognition engine with an input component that receives first information concerning content rendered to a user interface and second information concerning a user gesture applied to the user interface. A context-free gesture recognizer obtains shape features based on the second information and generates a context-free gesture hypothesis for the user gesture based on the shape features. A context-aware gesture recognizer obtains contextual features based on the first information and the second information and evaluates the context-free gesture hypothesis based on the contextual features to make a final gesture decision for the user gesture. An output component outputs the final gesture decision for the user gesture to the application. An application programming interface enables an application to invoke the gesture recognition engine and allows for customized gesture configuration and recognition.

Abstract: A facility for adapting the prediction of ink is described. In some examples, the facility receives information about a spatial movement by a user. On the basis of the received information, the facility predicts future spatial movement by the user, and generates an ink stroke that reflects both the spatial movement described by the received information and at least a portion of the predicted future spatial movement. The facility enforces against the generated ink stroke a limit that has the effect of controlling the area of a portion of the ink stroke corresponding to the at least a portion of the predicted future spatial movement, and causes the generated ink stroke, subject to the enforcement of the limit, to be displayed.

Abstract: A facility for adapting the prediction of ink is described. In some examples, the facility receives information about a spatial movement by a user. On the basis of the received information, the facility predicts future spatial movement by the user, and generates an ink stroke that reflects both the spatial movement described by the received information and at least a portion of the predicted future spatial movement. The facility enforces against the generated ink stroke a limit that has the effect of controlling the area of a portion of the ink stroke corresponding to the at least a portion of the predicted future spatial movement, and causes the generated ink stroke, subject to the enforcement of the limit, to be displayed.

Abstract: Systems and methods are provided for improving the latency for display of ink during user creation of ink content with an object, such as a stylus, mouse, finger (or other touch input), or other drawing device. In order to reduce or minimize the time for display of ink content created by a user, aspects of the technology described herein generate predictive wet ink that can be displayed with actual wet ink. The predictive wet ink is calculated by extending an active ink segment a predictive distance. The predictive distance is intended to be a distance between a termination ink point for an active wet ink segment and a tip of the writing object. In one aspect, the predictive distance is calculated by determining the current latency period on a touch device and the velocity of the writing object.

Abstract: Methods, systems, and apparatuses for beautifying raw drawing data include a beautification engine having a raw data processor that receives the drawing data and identifies a set of segments in the data. A beautification director constructs a structural representation of the set of segments data that specifies a topological relationship between the segments. A single primitive beautifier identifies a segment in the structural representation to be beautified and a single primitive beautification action is applied to the segment to generate beautified raw drawing data. A multiple primitive beautifier identifies adjacent segments in the structural representation to be beautified and a multiple beautification action is applied to the adjacent segments to generate further beautified drawing data.

Abstract: A computing device includes a digital input system that allows freehand digital inputs to be received (e.g., via movement of a pen, stylus, finger, etc.). The digital input system provides functionality allowing applications to receive digital inputs from a user and control the display of data based on the digital inputs. The digital input system receives digital input from a user and analyzes the digital input to collect input data for the digital input. As the digital input is received, the input data is made available to an application, allowing the application to operate on the input data (e.g., modify the input data and/or generate additional input data) and provide the operated-on input data to the digital input system. The digital input system then proceeds to control the display of data based on the operated-on input data.

Abstract: Platform-specific user interface (UI) objects may be generated based on received free hand input. In response to receiving free hand input, the received free hand input is analyzed. Based on the analysis of the received free hand input, one or more elements associated with the free hand input are identified. The one or more elements can comprise shapes or text corresponding to the received free hand input. For each of at least one of the one or more elements, the one or more elements are analyzed. Analyzing the at least one element may comprise analyzing a context of the at least one element. A UI object corresponding to the at least one element is determined. Executable platform-specific UI code associated with the determined UI object is generated.

Abstract: The manipulation system described herein provides a common platform and application-programming interface (API) for applications to communicate with various multi-touch hardware devices, and facilitates the interpretation of multi-touch input as one or more manipulations. Manipulations map more directly to user intentions than do individual touch inputs and add support for basic transformation of objects using multiple touch contacts. An application can use manipulations to support rotating, resizing, and translating multiple objects at the same time. The manipulation system outputs two-dimensional (2D) affine transforms that contain rotation, scale, and translation information. Thus, using the manipulation system the application author can focus more on building touch-capable applications and let the manipulation system handle the underlying transformations and communication with the multi-touch hardware.

Abstract: The manipulation system described herein provides a common platform and application-programming interface (API) for applications to communicate with various multi-touch hardware devices, and facilitates the interpretation of multi-touch input as one or more manipulations. Manipulations map more directly to user intentions than do individual touch inputs and add support for basic transformation of objects using multiple touch contacts. An application can use manipulations to support rotating, resizing, and translating multiple objects at the same time. The manipulation system outputs two-dimensional (2D) affine transforms that contain rotation, scale, and translation information. Thus, using the manipulation system the application author can focus more on building touch-capable applications and let the manipulation system handle the underlying transformations and communication with the multi-touch hardware.

Abstract: Symbol recognition techniques may be applied to documents comprising various forms of content. Documents including both text and mathematical expressions may be problematic, as applying a recognizer that does not match the content may produce anomalous results. Instead, a parser may evaluate the document to classify respective regions as one of a text region or a mathematics region, based on the characteristics of each type of content. The recognizer corresponding to the content of each region may be applied to produce a composite document comprising both recognized text expressions and recognized mathematical expressions. Additional functionality may be presented based on the recognized content; e.g.

Abstract: A computing device includes a digital input system that provides digital input functionality for the computing device. The digital input system receives both a first input and a second input. The first input is typically an input with the user's dominant hand (e.g., using a pen, stylus, finger, etc.), and the second input is typically an input with the user's non-dominant hand. The digital input system determines whether a second input is received simultaneously with the first input, and selects one of multiple behaviors for the first input based on whether the second input is received simultaneously with the first input. Various different behaviors for the first input can be selected from, such as freehand or freeform input, constraining digital input corresponding to the first input to be along an edge of a stencil, and so forth.

Abstract: A computing device includes a digital input system that allows freehand digital inputs to be received (e.g., via movement of a pen, stylus, finger, etc.). The digital input system provides functionality allowing applications to receive digital inputs from a user and control the display of data based on the digital inputs. The digital input system receives digital input from a user and analyzes the digital input to collect input data for the digital input. As the digital input is received, the input data is made available to an application, allowing the application to operate on the input data (e.g., modify the input data and/or generate additional input data) and provide the operated-on input data to the digital input system. The digital input system then proceeds to control the display of data based on the operated-on input data.

Abstract: A platform-level container configured to hold natively-supported ink stroke data structures is maintained. The platform-level container is accessible to a plurality of different applications. An ink stroke visual corresponding to each ink stroke data structure held by the platform-level container is rendered via a display. An ink stroke change event corresponding to an ink stroke data structure held by the platform-level container is recognized. The ink stroke data structure is changed to an updated ink stroke data structure in accordance with the ink stroke change event. An ink stroke visual corresponding to the updated ink stroke data structure is rendered via the display without re-rendering ink stroke visuals corresponding to unchanged ink stroke data structures.

Abstract: Digital ink is generated to represent a visual component, such as a letter, number, character, and/or other symbol. The digital ink is generated by obtaining multiple different curves that combine to generate the visual component. These different curves can have various different characteristics (e.g., different thicknesses) to provide the desired visual component. The combined curves are converted into a set of primitives that make up the parts of the combined curves, and the set of primitives are converted into a digital ink format. Data describing the set of primitives in digital ink format can be stored and subsequently used to display the visual component as digital ink.

Abstract: A computing device includes a digital input system that provides digital input functionality for the computing device. The digital input system receives both a first input and a second input. The first input is typically an input with the user's dominant hand (e.g., using a pen, stylus, finger, etc.), and the second input is typically an input with the user's non-dominant hand. The digital input system determines whether a second input is received simultaneously with the first input, and selects one of multiple behaviors for the first input based on whether the second input is received simultaneously with the first input. Various different behaviors for the first input can be selected from, such as freehand or freeform input, constraining digital input corresponding to the first input to be along an edge of a stencil, and so forth.

Abstract: The inertia system provides a common platform and application-programming interface (API) for applications to extend the input received from various multi-touch hardware devices to simulate real-world behavior of application objects. To move naturally, application objects should exhibit physical characteristics such as elasticity and deceleration. When a user lifts all contacts from an object, the inertia system provides additional manipulation events to the application so that the application can handle the events as if the user was still moving the object with touch. The inertia system generates the events based on a simulation of the behavior of the objects. If the user moves an object into another object, the inertia system simulates the boundary characteristics of the objects. Thus, the inertia system provides more realistic movement for application objects manipulated using multi-touch hardware and the API provides a consistent feel to manipulations across applications.

Abstract: A facility for processing ink input is described. In one example facility, the facility receives ink input from an input device. The facility generates and renders ink stroke data structures in response to received ink input in accordance with an ink input processing pipeline. The facility provides to an executing application access to information traversing the ink input processing pipeline at a selected point in the ink input processing pipeline.