Abstract: Disclosed is a spatial computing system and associated methods that provide multi-modality interactions for precise and imprecise interactions with two-dimensional (“2D”) and three-dimensional (“3D”) user interfaces (“UI”) that are presented in a 3D interactive space. The multi-modality interactions are provided by a dynamic spatial pointer. The dynamic spatial pointer has a first 3D representation for navigating the 3D interactive space and selecting one of the presented UI elements. The dynamic spatial pointer converts from the first 3D representation to a different second 3D representation in response to attaching to one of the 3D UI elements, and converts to a first 2D representation in response to attaching to one of the 2D UI elements. The second 3D representation remains attached to and tracks the 3D form of the 3D UI element, and the first 2D representation remains attached to and tracks the 2D plane of the 2D UI element.

Abstract: A computer-implemented method for generating a color of an object displayed on a GUI. The method includes displaying on a graphical user interface a set of icons, each icon of the set being associated with a color, detecting a first user interaction on a first icon of the set, detecting a second user interaction that comprises at least a slide, modifying a value of a parameter of a first color associated with the first icon, the modification of the value being performed with the second user interaction, and computing a first new color that is the first color with the modified value of a parameter.

Abstract: The present disclosure relates to systems, methods, and non-transitory computer readable media for generating coachmarks and concise instructions based on operation descriptions for performing application operations. For example, the disclosed systems can utilize a multi-task summarization neural network to analyze an operation description and generate a coachmark and a concise instruction corresponding to the operation description. In addition, the disclosed systems can provide a coachmark and a concise instruction for display within a user interface to, directly within a client application, guide a user to perform an operation by interacting with a particular user interface element.

Abstract: A method of controlling an environment using a roaming electronic assistant. The method comprises capturing a plurality of associations of voice commands to device commands coded for a first electronic assistant (EA) device by a home electronic assistant (EA) client application, where each association links a voice command to a corresponding device command coded for the first EA device, and where the first EA device takes action in a home environment based on the voice commands, sending the associations of voice commands to device commands coded for the first EA device to an EA client application executing on a computer system, and building a mapping of the associations for the first EA device to associations for a second EA device by the EA client application, where each association for the second EA device links a voice command to a device command coded for the second EA device.

Abstract: A display and interaction method in a user interface and devices, computer program products and systems therefor are disclosed. An information object display area includes a plurality of information objects displayed on a track. The track extends along a path created between an outer and inner elliptical border in the interface. A plurality of elliptical frames are generated along the track, each in contact with the outer and inner elliptical borders, and first and second neighboring elliptical frames adjacent to it. Information objects are displayed based on the elliptical frames. In response to receiving user input associated with movement of a pointer, the center of the inner elliptical border is moved in the direction of pointer movement while resizing the inner border so that it remains within the outer border. The elliptical frames are resized and moved along the track so that all the elliptical frames remain in contact with the borders and their neighboring elliptical frames.

Abstract: Example systems and methods for displaying an edit tracker of form-based entries on a graphical user interface are described herein. Form based data items including a name and a data entry box are displayed in an area of the graphical user interface. As edits are made to the data items (e.g., changed or new data values are added to the data entry boxes), an edit tracker entry for each changed data item is displayed. The edit tracker entries can include the item name of the data item, the item value of the data item, and the changed item value of the data item. As various modifications are made, some of which may be made within nested or other tabs of the graphical user interface, the edit tracker can include the entries, allowing the user to quickly identify changes, quickly navigate to the changes, and/or undo individual changes.

Abstract: Techniques are described herein for handling transactions where only a portion of submitted changes are committed. In some embodiments, a system receives, through a page of a user interface, a request to submit a plurality of changes to a set of data objects. The system identifies, based on the page of the user interface through which the request was submitted, a first subset of one or more changes that require further review and a second subset of one or more changes that do not require further review before being committed to the database. The first subset of one or more changes are cached for further review, and a respective approval transaction may be initiated. A commit transaction may be initiated directly for the second set of one or more changes to commit the changes to the database without further review.