Abstract: The subject disclosure relates to user input into a computer system, and a technology by which one or more users interact with a computer system via a combination of input modalities. When the input data of two or more input modalities are related, they are combined to interpret an intended meaning of the input. For example, speech when combined with one input gesture has one intended meaning, e.g., convert the speech to verbatim text for consumption by a program, while the exact speech when combined with a different input gesture has a different meaning, e.g., convert the speech to a command that controls the operation of that same program.

Abstract: The subject disclosure relates to user input into a computer system, and a technology by which one or more users interact with a computer system via a combination of input modalities. When the input data of two or more input modalities are related, they are combined to interpret an intended meaning of the input. For example, speech when combined with one input gesture has one intended meaning, e.g., convert the speech to verbatim text for consumption by a program, while the exact speech when combined with a different input gesture has a different meaning, e.g., convert the speech to a command that controls the operation of that same program.

Abstract: The subject disclosure relates to user input into a computer system, and a technology by which one or more users interact with a computer system via a combination of input modalities. When the input data of two or more input modalities are related, they are combined to interpret an intended meaning of the input. For example, speech when combined with one input gesture has one intended meaning, e.g., convert the speech to verbatim text for consumption by a program, while the exact speech when combined with a different input gesture has a different meaning, e.g., convert the speech to a command that controls the operation of that same program.

Abstract: The subject disclosure relates to user input into a computer system, and a technology by which one or more users interact with a computer system via a combination of input modalities. When the input data of two or more input modalities are related, they are combined to interpret an intended meaning of the input. For example, speech when combined with one input gesture has one intended meaning, e.g., convert the speech to verbatim text for consumption by a program, while the exact speech when combined with a different input gesture has a different meaning, e.g., convert the speech to a command that controls the operation of that same program.

Abstract: The subject disclosure relates to user input into a computer system, and a technology by which one or more users interact with a computer system via a combination of input modalities. When the input data of two or more input modalities are related, they are combined to interpret an intended meaning of the input. For example, speech when combined with one input gesture has one intended meaning, e.g., convert the speech to verbatim text for consumption by a program, while the exact speech when combined with a different input gesture has a different meaning, e.g., convert the speech to a command that controls the operation of that same program.

Abstract: The subject disclosure is directed towards saving undo state information for a digital art program. Changed state data is computed (e.g., via GPU-side logic) based upon the state information of the current state of a canvas and the previous state information, e.g., via an XOR operation or parallel XOR operations. The changed state data is compressed into compressed state data, e.g., via run-length encoding, and the compressed state data is stored, e.g., in a circular buffer in GPU memory. For an undo command, the compressed data is decompressed into the changed state data, and the bitwise operation reversed.

Abstract: Technologies are described herein for authoring, sharing, and consuming online courses. A lesson creation extension executing in conjunction with a presentation application can be utilized to create an augmented presentation document having one or more slides. A video recording of a presentation of the slides may be made and associated with the slides. Digital ink made on the slides may also be recorded. The slides might also be created to include quizzes, interactive labs, and other types of interactive content. The augmented presentation document can then be published to a portal system for sharing. A lesson player can be utilized to play back the lesson from the portal system. During playback, the recorded audio, video and digital ink are played back in synchronization by the lesson player.

Abstract: A painting system is described herein for producing artwork. In one implementation, the painting system operates by receiving an input image of any type from any source. The painting system then imports the input image into a painting mechanism. Thereafter, the painting system allows a user to produce artwork by modifying the input image, as if the input image constituted paint that the user applied in manual fashion using the painting mechanism. This technology facilitates the production of artwork, as the user can leverage an already-existing image in producing the artwork.

Abstract: The subject disclosure is directed towards saving undo state information for a digital art program. Changed state data is computed (e.g., via GPU-side logic) based upon the state information of the current state of a canvas and the previous state information, e.g., via an XOR operation or parallel XOR operations. The changed state data is compressed into compressed state data, e.g., via run-length encoding, and the compressed state data is stored, e.g., in a circular buffer in GPU memory. For an undo command, the compressed data is decompressed into the changed state data, and the bitwise operation reversed.

Abstract: A graphics system is described for simulating the interaction of two or more types of media on a simulated canvas. The graphics system performs this task by consulting a media adhesion matrix which determines a type of behavior that is produced when an attempt is made to add a new medium over the top of an existing medium. In one scenario, the new medium is a watercolor medium which does not apply over a hydrophobic media (such as an oil medium), but may tunnel under such hydrophobic medium in a flow layer during a simulation operation. Various provisions are also disclosed herein to improve the efficiency of the simulation operation.

Abstract: Various technologies described herein pertain to simulating oil painting. Data can be received from a sensor that indicates a desired orientation of an image editing tool with respect to a computer-implemented canvas. The computer-implemented canvas can include a paint map, which includes color values and height values of pixels representative of oil paint deposited on the computer-implemented canvas. Moreover, a footprint of the image editing tool upon the computer-implemented canvas can be computed based upon the data from the sensor. Further, an oil paint ridge model can be generated by modulating height values of a subset of the pixels from the paint map that are outside the footprint and less than or equal to a predetermined distance from an edge of the footprint. A display screen of a computing device can be caused to update an image rendered thereupon based upon the oil paint ridge model.

Abstract: Learning content may be provided to a user where the learning content may contain learning objectives. A response to the learning content may be received. The response may be analyzed by determining whether the response was the proper response to the learning objectives. If the response was a proper response, less questions on the learning objective may be presented in the future and the if response was an improper response, additional questions on the learning objective may be presented in the future.

Abstract: The subject disclosure is directed towards a digital art program, including user interfaces for user interaction with the digital art program. Described are interactive elements, tools, effects, features, commands and so forth for operating and experiencing the digital art program.

Abstract: The subject disclosure relates to user input into a computer system, and a technology by which one or more users interact with a computer system via a combination of input modalities. When the input data of two or more input modalities are related, they are combined to interpret an intended meaning of the input. For example, speech when combined with one input gesture has one intended meaning, e.g., convert the speech to verbatim text for consumption by a program, while the exact speech when combined with a different input gesture has a different meaning, e.g., convert the speech to a command that controls the operation of that same program.

Abstract: Overlaying electronic ink over a document. A typical scenario may be where one it would be useful to mark up a document with electronic ink, such as by making handwritten comments, drawings, and the like over the underlying document. In some embodiments, a developer may easily define an inking surface, such as a transparent or opaque window, over a document. The inking surface may act as an input interface such that a user may write onto the inking surface such that is appears that the document itself is being marked up.

Abstract: A method for displaying input from a portable computing device on a second computing device is described. Later inputs on the portable computing device are displayed in a scrolling fashion on the second computing device with later input being displayed below previous input without regard to the location of the input on the portable computing device.

Abstract: A method and system is described for displaying input from a portable computing device to a second computing device. On the second computing device, a display region is created. The region may be a stand alone application or a region inside an application. The second computing device then receives a communication that represents the portable input on the portable computing device. The portable input is then scaled to fit the display region and the portable input is displayed on the second computing device.

Abstract: Notes and other input may be entered directly onto computer based content. The notes may be taken on a portable computing device that contains metadata from the computer based content. The metadata and input are stored and once the portable computing device is in communication with the second computing device displaying the computer based content, the input is displayed near the computer based content that was displayed at the time the input was created.

Abstract: A lasso select tool that allows a user to draw a flexible line of selection ink in order to select one or more graphical objects for manipulation. As the user draws this selection line, the lasso select tool continuously redraws and displays a connection line connecting one end of the selection line with the opposite end of the selection line. This connection line thus graphically demonstrates to the user the area that is presently encompassed by the resulting lasso enclosure. Further, the lasso select tool will change the appearance of any object selected with the lasso enclosure. The lasso select tool also selects objects that are only substantially encompassed by the lasso enclosure. For example, the lasso select tool may select ink objects that are only 60% or more encompassed by the lasso enclosure.

Abstract: A system and method for storing document data in a serialized binary format recognition lattice structure so that the data is accessible to other applications. The lattice structure is generated that includes root node data. Child nodes correspond to columns of the recognition lattice. Each node includes a descriptor that is a collection of flags indicating presence of specific components of the node. The child nodes may include grandchild nodes with similar structure corresponding to elements within the columns. Each node further includes property information associated with the node. The recognition lattice is stored in a serial binary data format.