Abstract: In non-limiting examples of the present disclosure, systems, methods and devices for collecting and surfacing web content are provided. Web content from a webpage may be displayed in a web browser. A type associated with the webpage may be identified. An indication to add a new section corresponding to the webpage to a content collection pane may be received. A plurality of elements on the webpage may be identified based on the identified type associated with the webpage. A subset of web content from the webpage corresponding to the plurality of elements may be extracted. The new section may be added to the content collection pane, wherein the new section comprises the subset of web content extracted from the webpage.

Abstract: In non-limiting examples of the present disclosure, systems, methods and devices for automating web browser task actions are presented. An indication to record a new action may be received. One or more steps associated with the action may be performed during the recording. Each step may comprise interaction with a different webpage element corresponding to an HTML node. The HTML node, and one or more additional HTML nodes may be extracted and/or tagged, and a machine learning model may be applied to the extracted/tagged nodes. The machine learning model may have been trained to create templates for identifying interacted-with web elements. The automated action may be performed by applying the machine learning model to one or more websites. The machine learning model may identify the correct web elements to interact with and move through the action steps in an automated manner to perform the action.

Abstract: A technique is described herein for facilitating movement of graphical objects across display screens. In one manner of operation, the method includes: displaying a representation of a first movement as a user moves a graphical object across a source screen; detecting that the user has moved the graphical object into a graphical source portal associated with the source screen; associating the graphical object with two or more graphical destination portals provided by the plural display screens, in addition to the graphical source portal, such that the graphical object is accessible from the graphical source portal and any graphical destination portal; detecting that the user has removed the graphical object from a chosen graphical portal in a chosen screen; displaying the graphical object as having been removed from all graphical portals; and displaying a second movement as the user moves the graphical object across the chosen screen to a final destination.

Abstract: In non-limiting examples of the present disclosure, systems, methods and devices for collecting and surfacing web content are provided. Web content from a webpage may be displayed in a web browser. A type associated with the webpage may be identified. An indication to add a new section corresponding to the webpage to a content collection pane may be received. A plurality of elements on the webpage may be identified based on the identified type associated with the webpage. A subset of web content from the webpage corresponding to the plurality of elements may be extracted. The new section may be added to the content collection pane, wherein the new section comprises the subset of web content extracted from the webpage.

Abstract: A gesture language for a device with multiple touch surfaces is described. Generally, a series of new touch input models is described that includes touch input interactions on two disjoint touch-sensitive surfaces. For example, a mobile device can include a primary display on a “front” side of the device, and a secondary display or touch-sensitive surface on the “back” side of the device, such as a surface that is opposite the primary display. Accordingly, the gesture language can include a series of “back touch” interactions with the touch-sensitive surface on the backside of the device. Example interactions include direct and indirect touch input on the back side, as well as simultaneous touch input on both sides of the device.

Abstract: A technique is described herein for helping a user move a source object that appears on a user interface presentation to a target destination. The technique involves performing semantic analysis on both the source object and at least one candidate target destination. The semantic analysis yields a score that reflects the relationship between the source object and the candidate target destination. The technique then presents a representation of the candidate target destination that is visually enhanced to an extent that is dependent on its output score. The technique then allows the user to move the source object to a representation of a selected target destination, whereupon it becomes associated with the target destination. The technique can produce the enhanced representation by changing a characteristic of an on-screen target identifier (that already exists on the user interface presentation), or by displaying a transient target identifier.

Abstract: Techniques are described herein that are capable of making a state-based determination of information to be displayed on a screen region of a hinge that is coupled to other screen regions. For instance, a state of a hinge that is coupled between a first screen region and a second screen region may be determined. Information that is to be displayed on a third screen region that is provided on the hinge may be determine based at least in part on the state of the hinge.

Abstract: Techniques are described herein that are capable of making a state-based determination of information to be displayed on a screen region of a hinge that is coupled to other screen regions. For instance, a state of a hinge that is coupled between a first screen region and a second screen region may be determined. Information that is to be displayed on a third screen region that is provided on the hinge may be determine based at least in part on the state of the hinge.

Abstract: A technique is described herein for helping a user move a source object that appears on a user interface presentation to a target destination. The technique involves performing semantic analysis on both the source object and at least one candidate target destination. The semantic analysis yields a score that reflects the relationship between the source object and the candidate target destination. The technique then presents a representation of the candidate target destination that is visually enhanced to an extent that is dependent on its output score. The technique then allows the user to move the source object to a representation of a selected target destination, whereupon it becomes associated with the target destination. The technique can produce the enhanced representation by changing a characteristic of an on-screen target identifier (that already exists on the user interface presentation), or by displaying a transient target identifier.

Abstract: A technique is described herein for facilitating movement of graphical objects across display screens. In one manner of operation, the method includes: displaying a representation of a first movement as a user moves a graphical object across a source screen; detecting that the user has moved the graphical object into a graphical source portal associated with the source screen; associating the graphical object with two or more graphical destination portals provided by the plural display screens, in addition to the graphical source portal, such that the graphical object is accessible from the graphical source portal and any graphical destination portal; detecting that the user has removed the graphical object from a chosen graphical portal in a chosen screen; displaying the graphical object as having been removed from all graphical portals; and displaying a second movement as the user moves the graphical object across the chosen screen to a final destination.

Abstract: Techniques are described herein that are capable of making a state-based determination of information to be displayed on a screen region of a hinge that is coupled to other screen regions. For instance, a state of a hinge that is coupled between a first screen region and a second screen region may be determined. Information that is to be displayed on a third screen region that is provided on the hinge may be determine based at least in part on the state of the hinge.

Abstract: A system for executing context based operations can include a processor and a memory device comprising a plurality of instructions that, in response to an execution by the processor, cause the processor to detect context information corresponding to input wherein the context information comprises device information, a subject of the input, device usage information, or a combination thereof. The processor can also store a link between the context information and the input. Additionally, the processor can detect an operation corresponding to the context information and the input and execute the operation based on the context information and the input.

Abstract: Implementations described herein provide a multifinger keyboard that is generated based on detected input. Each key of the multifinger keyboard includes multiple input zones, which are positioned and dimensioned to correlate with a present orientation of a user's fingers. The multifinger keyboard is automatically regenerated to account for drift and other changes in position of a user's hand relative to the keyboard, thereby providing reliable targeting without requiring physical homing indicators. Each input zone may be associated with different output values, such that applying different input types to a single input zone results in different outputs. Potential outputs are determined based on concurrent inputs received at the multifinger keyboard, from which a final output is generated.

Abstract: Techniques are described herein that are capable of making a state-based determination of information to be displayed on a screen region of a hinge that is coupled to other screen regions. For instance, a state of a hinge that is coupled between a first screen region and a second screen region may be determined. Information that is to be displayed on a third screen region that is provided on the hinge may be determine based at least in part on the state of the hinge.

Abstract: A gesture language for a device with multiple touch surfaces is described. Generally, a series of new touch input models is described that includes touch input interactions on two disjoint touch-sensitive surfaces. For example, a mobile device can include a primary display on a “front” side of the device, and a secondary display or touch-sensitive surface on the “back” side of the device, such as a surface that is opposite the primary display. Accordingly, the gesture language can include a series of “back touch” interactions with the touch-sensitive surface on the backside of the device. Example interactions include direct and indirect touch input on the back side, as well as simultaneous touch input on both sides of the device.

Abstract: A computing device that processes data from multiple sensors to modify image elements on a display for viewing is described. In implementations, a display adapter circuit in a computing device processes hinge data from a first sensor and orientation data from a second sensor and infers a viewing angle to output the image elements for display. In implementations, the display adapter circuit adapts the display device to enable display of the image elements at the inferred viewing angle while the computing device is between a closed position and a fully open position. The computing device can also or instead be implemented to transition display of modified image elements while first and second housings of the computing device move relative to one another.