Abstract: Execution systems for augmenting legacy user interfaces include a memory, one or more input/output device, and one or more processors coupled to the memory and the one or more input/output devices. The one or more processors are configured to load a workflow described according to a workflow structure, the workflow structure describing subprocesses of the workflow, routings between the subprocesses, and actions that make up the subprocesses; connect to a legacy user interface based on the workflow; receive a message from the legacy user interface; determine a subprocess for responding to the message based on the workflow; and perform one or more actions of the determined subprocess to respond to the message. In some embodiments, performing the one or more actions includes presenting information from the message to an operator, soliciting input from the operator, and sending a response to the legacy user interface based on the input.

Abstract: A hierarchical representation of entities relate to development of at least one product. A portion of a document is selected. For the selected portion of the document, an indication associated with at least one of the entities in the hierarchical representation is received. Based on the received indication, a link is created between the selected portion of the document and the at least one of the entities in the hierarchical representation.

Abstract: An electronic device having a touch-sensitive surface and a processing method for the electronic device. When a pressing operation on an application icon is detected on the touch-sensitive surface, a menu including m operation options is displayed on a display screen of the electronic device so that a user quickly performs different operations on an application program. The m operation options are determined based on at least one of: a quantity of times that an operation option is tapped, a time at which an operation option is taped, a location of the electronic device when an operation option is tapped, unread information in an application corresponding to the application icon, data obtained before the application is suspended, data obtained when the application runs in the background, or a communication object in the application.

Abstract: Systems and methods are described herein for generating a search query using flexible autocomplete suggestions. A text input is received, and a plurality of portions of the text input, each corresponding to a different search parameter, are identified. For each of the identified portions, at least one suggested alternate text is retrieved based on the corresponding attribute, and a user interface element is generated for display in which the original text of the respective portion is displayed, along with the suggested alternate texts for that portion, which are selectable by the user. Upon receiving selection of a suggested alternate text in at least one user interface element, a search query is generated based on each portion for which no alternate has been selected, and each selected alternate text. Search request are retrieved in response to the search query, and the results are generated for display to the user.

Abstract: Disclosed are methods and systems that allow a user to access indicia representing executable form items, click and drag them into a space on a display screen, and build a form of executable form items. The disclosed methods and systems allow the executable form items to be arranged and rearranged as the user is building the form. The form as it is being built on a display is executable as execution codes are attached the form items when the indicia is dragged onto a form view screen. A user will not need to consider how to define the manner in which the form items function. That is a user, in a single step, will select a form item that is a particular type to the build the form, and this form will immediately be executable. The form can then become part of a form flow.

Abstract: A method of operating a display unit enhances functionality of one hand control and a terminal supports the same. The method of operating the input area, output on the display unit, includes: determining whether one-hand operation mode is set; and displaying a first input module in which a key map area is displayed to be biased to a specific direction based on a center of the display unit when the one-hand operation mode is set.

Abstract: Systems and methods for design element association and modification are provided. An example method for editing elements in multiple artboards includes receiving an isolation session-initiation user input that identifies a first design element arrangement on a first artboard in a workspace on a user interface. The method also includes, responsive to receiving the isolation session-initiation user input, identifying a second artboard in the workspace based on the second artboard including a second design element arrangement that is associated with the first design element arrangement, and updating the user interface to display the first artboard and the second artboard within an isolation session. As an example updating the user interface may include displaying the first design element arrangement and the second design element arrangement using a first style, and displaying other portions of the first artboard and the second artboard using a second style.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for animating a drag gesture are disclosed. In one aspect, a method includes the actions of receiving a user input that drags a user interface element along a user-induced path across a display. The actions further include moving the user interface element along the user-induced path across the display. The actions further include determining that the user input has ceased. The actions further include determining an additional path and a speed for the user interface element to move along the additional path based on the user-induced path and a speed of the user input. The actions further include moving the user interface element along the additional path to a resting location at the determined speed for the user interface element to move along the additional path.

Abstract: A computer-implemented method comprising determining, by the processor, a set of objects of the plurality of objects having the shared coordinates (XS, YS) and at a location along the depth direction (ZS); and prioritizing, by the processor, an object from the set of objects based on at least two of metadata of the set of objects, screen areas of the set of objects, transparency of the set of objects, and opaqueness of at least one object of the set of objects currently displayed to improve the selection of at least one of mutually occluded objects and mutually partially occluded objects in the virtual environment. The method includes associating the prioritized object with the viewer input device for detecting interactions with the prioritized object displayed on the display device by the viewer input device. The prioritized object is updated on the screen of the display device based on the interactions.

Abstract: Systems are provided that include electronic equipment and electronic devices. A system may include electronic equipment such as a thermostat or other equipment in a vehicle or home, vehicle navigation equipment, networking equipment, computer equipment, equipment with speakers for playing audio, and other electronic equipment. An electronic device such as a portable electronic device may be placed in the vicinity of electronic equipment by a user. In response to detecting that the electronic device is adjacent to the electronic equipment, control circuitry in the electronic device can automatically display content of the electric device such as a user control interface for the electronic device or information related to operation of the electronic equipment. The system may monitor the position of the electronic device relative to the electronic equipment and can dynamically update the displayed content based on the current device position.

Abstract: A method of operating a machine via a display device user interface includes generating a text tree display control comprising a tree of text blocks on a first portion of a machine display interface, generating a term control comprising individual terms identified in the text tree display control on a second portion of the machine display interface, generating a navigation control comprising a visual representation of each branch of the text tree display control on a third portion of the machine display interface, operating an individual area of the term control comprising an individual term, to highlight and change all instances of the individual term in the text tree display control, and operating the navigation control to reorder branches of the text tree display control.

Abstract: In some embodiments, an electronic device performs an action in response to detection of a sequence of one or more motion gestures. Motion gesture information of a first electronic device optionally includes a first portion representing a respective attitude of the first electronic device relative to a frame of reference and a second portion that includes movement of the first electronic device from the respective attitude of the first electronic device. In accordance with a determination that the movement of the first electronic device during the second portion of the motion gesture meets movement criteria for a movement gesture that corresponds to the respective attitude of the first electronic device, a process is initiated to control the first electronic device or a second electronic device in accordance with the second portion of the motion gesture.

Abstract: A method for generating a visual illustration of data organized in a multiway graph is provided. In an embodiment, a computer system maintains a plurality of nodes and edges within a multiway graph and displays a visual user interface with a first node positioned at the center of the visual user interface and child nodes positioned at radially symmetric positions surrounding the first node. The computer system receives a first input that specifies a selection of a first child node. In response to receiving the first input, the computer system updates the visual user interface to display: the first node, positioned at the center; the child nodes, positioned at radially symmetric positions surrounding the first node; the first child node positioned below the first node; and grandchild nodes of the first child node, displayed as polygons positioned at radially symmetric positions around a circular area surrounding the child nodes.

Abstract: A neural network system can select content based on user and item content embeddings in an approach that can be updated in real time on the user device without server support. Requests for content sent to the server can include an anonymous user embedding that includes data describing the user's inputs. The content that is nearest to the user embedding in a joint embedding space can be returned as suggested content.

Abstract: An electronic device includes a microphone, a processor, and a memory. The memory stores an application for monitoring user information, and the memory stores instructions that, when executed by the processor, cause the electronic device to record a plurality of parameters associated with the user information in the application when a predefined event occurs to record a first parameter and the first parameter is not recorded in the application, to output a message for obtaining the first parameter, to receive a user response associated with the first parameter, to transmit data associated with the user response to an external server, to receive a first response from the external server, and to record the first parameter in the application by allowing the electronic device to have information about sequences of states of the electronic device. The first response includes information about sequences of states of the electronic device for recording the first parameter in the application.

Abstract: A computer-implemented method includes restricting an accessible number of applications while an application-limiting state exists in a vehicle. In this embodiment, the restricting including re-ordering displayed application icons such that applications having a user-designated priority associated therewith are still accessible on a vehicle display being limited by the restricting.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for audio messaging interface for messaging platform. One of the methods includes receiving, by a first client on a first user device, a request to record an audio message, wherein the first client is configured to provide a user interface for the platform for a user using the first user device who is logged in to a user account on the platform; recording audio through a microphone of the first user device; generating a platform message by (i) generating a video file that includes the recorded audio as an audio portion of the video file and programmatically generated minimal video content as a video portion of the video file, and (ii) including the video file in the platform message; and posting, by the first client, the platform message to the platform, in response to a post request.

Abstract: A system controls an electronic device in a teleconferencing system through remote screen-receiving devices that access software applications on a screen-sending device. Access is provided through a point-to-point private wireless network. The software applications are replicated on the remote screen-receiving devices. The software allows users of the remote screen-receiving device to simultaneously manipulate or use one or more common software applications. The concurrent manipulation or use occurs without the screen-sending device applying a software application locking.

Abstract: An augmented reality system that includes processors and storage devices storing instructions. The instructions configure the processors to perform operations. The operations include identifying a writing object in a video feed being displayed in an augmented reality viewer, identify a tip of the writing object based on a contour of the writing object, and tracking movements of the tip in the augmented reality viewer. The operations may also include generating a virtual file, the virtual file storing the tracked movements and generating a text file by performing an image recognition operation associating the tracked movements stored in the virtual file with one or more characters.

Abstract: In one disclosed method, a first application accessed by a client device receives an indicator of an action that a second application is configured to take with respect to a third application. The client device accesses a fourth application and presents, based at least in part on the indicator received by the first application, a user interface element for the fourth application. Based at least in part on detecting selection of the user interface element, the client device presents a user interface configured to cause the second application to take the action with respect to the third application in response to a user input. The client device detects the user input to the user interface and causes, based at least in part on the user input, the second application to perform the action with respect to the third application.