Abstract: Systems and methods for generating a design difference caption are provided. In particular, a computing device may receive a capture request to capture a content item, capture the content item with metadata associated with the content item, and generate one or more semantic embeddings of content data using one or more semantic models. The content data may include the content item and the metadata. The computing device may further store the one or more semantic embeddings in a content database, provide captured content history stored in the content database, the capture content history including a list of captured content items, receive a user query to search the captured content history; and provide search results based on the user query.

Abstract: In accordance with examples of the present disclosure, a productivity application provides a concept-level text editing tool that assists users to create a document by generating suggestions of new contents (e.g., an outline or text) of the document while also improving the quality of existing contents of the document. More particularly, the present disclosure teaches the ability to generate an outline by providing step-by-step suggestions of a next outline item, generate text suggestions based on selected outline items, generate new outline item suggestions from selected text, and generate a list of natural language suggestions for an existing outline and/or existing text in the document. It should be appreciated that any implementation or modification to the document or the outline based on the suggestions is vetted by the user.

Abstract: In some examples, systems and methods for generating predicted ink strokes, using ink-based semantics, are provided. Ink stroke data may be received, the ink stroke data and a semantic context may be input into a model. From the model, one or more predicted ink strokes may be determined. Further, an indication of the one or more predicted ink strokes may be generated.

Abstract: In some examples, systems and methods for generating predicted ink strokes, using text-based semantics, are provided. Ink stroke data may be received, the ink stroke data may be input into a first model, and text data may be received from the first model. The text data may correspond to the ink stroke data. The text data and a semantic context may be input into a second model. A predicted ink stroke may be determined, from the second model. Further, an indication of the predicted ink stroke may be generated.

Abstract: In some examples, systems and methods for formatting ink are provided. Ink stroke data may be received, letters may be identified from the ink stroke data, and spacing may be identified between the letters. A user command and semantic context may be received. An action may be determined based on the user command, the semantic context, and the spacing between the letters. Further, the action may be performed.

Abstract: A computing device includes a digital input system that provides digital input functionality for the computing device. The digital input system receives both a first input and a second input. The first input is typically an input with the user's dominant hand (e.g., using a pen, stylus, finger, etc.), and the second input is typically an input with the user's non-dominant hand. The digital input system determines whether a second input is received simultaneously with the first input, and selects one of multiple behaviors for the first input based on whether the second input is received simultaneously with the first input. Various different behaviors for the first input can be selected from, such as freehand or freeform input, constraining digital input corresponding to the first input to be along an edge of a stencil, and so forth.

Abstract: Resolution enhancement techniques are described. An apparatus may receive first image data at a first resolution, and second image data at a resolution less than the first resolution. The second image data may be scaled to the first resolution and compared to the first image data. Application of a neural network may scale the first image data to a resolution higher than the first resolution. The application of the neural network may incorporate signals based on the scaled second image data. The signals may include information obtained by comparing the scaled second image data to the resolution of the first image data.

Abstract: A computing device includes a digital input system that provides digital input functionality for the computing device. The digital input system receives both a first input and a second input. The first input is typically an input with the user's dominant hand (e.g., using a pen, stylus, finger, etc.), and the second input is typically an input with the user's non-dominant hand. The digital input system determines whether a second input is received simultaneously with the first input, and selects one of multiple behaviors for the first input based on whether the second input is received simultaneously with the first input. Various different behaviors for the first input can be selected from, such as freehand or freeform input, constraining digital input corresponding to the first input to be along an edge of a stencil, and so forth.

Abstract: A computing device includes a digital input system that provides digital input functionality for the computing device. The digital input system receives both a first input and a second input. The first input is typically an input with the user's dominant hand (e.g., using a pen, stylus, finger, etc.), and the second input is typically an input with the user's non-dominant hand. The digital input system determines whether a second input is received simultaneously with the first input, and selects one of multiple behaviors for the first input based on whether the second input is received simultaneously with the first input. Various different behaviors for the first input can be selected from, such as freehand or freeform input, constraining digital input corresponding to the first input to be along an edge of a stencil, and so forth.

Abstract: Resolution enhancement techniques are described. An apparatus may receive first image data at a first resolution, and second image data at a resolution less than the first resolution. The second image data may be scaled to the first resolution and compared to the first image data. Application of a neural network may scale the first image data to a resolution higher than the first resolution. The application of the neural network may incorporate signals based on the scaled second image data. The signals may include information obtained by comparing the scaled second image data to the resolution of the first image data.

Abstract: Resolution enhancement techniques are described. An apparatus may receive first image data at a first resolution, and second image data at a resolution less than the first resolution. The second image data may be scaled to the first resolution and compared to the first image data. Application of a neural network may scale the first image data to a resolution higher than the first resolution. The application of the neural network may incorporate signals based on the scaled second image data. The signals may include information obtained by comparing the scaled second image data to the resolution of the first image data.

Abstract: A computing device includes a digital input system that provides digital input functionality for the computing device. The digital input system receives both a first input and a second input. The first input is typically an input with the user's dominant hand (e.g., using a pen, stylus, finger, etc.), and the second input is typically an input with the user's non-dominant hand. The digital input system determines whether a second input is received simultaneously with the first input, and selects one of multiple behaviors for the first input based on whether the second input is received simultaneously with the first input. Various different behaviors for the first input can be selected from, such as freehand or freeform input, constraining digital input corresponding to the first input to be along an edge of a stencil, and so forth.

Abstract: Different types of user inputs can be input by a user via a keyboard of an input device. These different types of user inputs include, for example, key strikes, multi-touch interactions, single finger motions, and/or mouse clicks. Touch information regarding the pressure applied to the keys of a pressure sensitive keyboard over time (or the contact area of the user input for other types of keyboards over time) is used to classify the intent of the user input as one of the various types of user inputs.

Abstract: A computing device includes a digital input system that provides digital input functionality for the computing device. The digital input system receives both a first input and a second input. The first input is typically an input with the user's dominant hand (e.g., using a pen, stylus, finger, etc.), and the second input is typically an input with the user's non-dominant hand. The digital input system determines whether a second input is received simultaneously with the first input, and selects one of multiple behaviors for the first input based on whether the second input is received simultaneously with the first input. Various different behaviors for the first input can be selected from, such as freehand or freeform input, constraining digital input corresponding to the first input to be along an edge of a stencil, and so forth.

Abstract: A holographic interaction device is described. In one or more implementations, an input device includes an input portion comprising a plurality of controls that are configured to generate signals to be processed as inputs by a computing device that is communicatively coupled to the controls. The input device also includes a holographic recording mechanism disposed over a surface of the input portion, the holographic recording mechanism is configured to output a hologram in response to receipt of light, from a light source, that is viewable by a user over the input portion.

Abstract: Different types of user inputs can be input by a user via a keyboard of an input device. These different types of user inputs include, for example, key strikes, multi-touch interactions, single finger motions, and/or mouse clicks. Touch information regarding the pressure applied to the keys of a pressure sensitive keyboard over time (or the contact area of the user input for other types of keyboards over time) is used to classify the intent of the user input as one of the various types of user inputs.

Abstract: Bezel gesture techniques are described. In one or more implementations, a determination is made that an input involves detection of an object by one or more bezel sensors. The bezel sensors are associated with a display device of a computing device. A location is identified from the input that corresponds to the detection of the object and an item is displayed at a location on the display device that is based at least in part on the identified location.

Abstract: A holographic interaction device is described. In one or more implementations, an input device includes an input portion comprising a plurality of controls that are configured to generate signals to be processed as inputs by a computing device that is communicatively coupled to the controls. The input device also includes a holographic recording mechanism disposed over a surface of the input portion, the holographic recording mechanism is configured to output a hologram in response to receipt of light, from a light source, that is viewable by a user over the input portion.

Abstract: Gesture-initiated keyboard operations are described. In one or more implementations, one or more touch inputs that involve interaction with a key of a keyboard are identified. Touch inputs can be identified using touchscreen functionality of a display device or using one or more pressure-sensitive touch sensors. Based on this touch input(s), a gesture is recognized. The gesture is configured to initiate an operation that corresponds to at least one key that is not included in the keys of the keyboard. In one or more implementations, the operation is a shift, caps lock, backspace, enter, tab, or control operation.

Abstract: Audio feedback techniques are described. In one or more implementations, a signal is received from a pressure sensitive key of an input device and audio feedback is determined, from the signal, which is to be output as corresponding to the pressure sensitive key. The determined audio feedback is then caused to be output.