Abstract: A computer-implemented method for providing user interface functionalities is disclosed. The method includes providing a base design system layer including web browser components providing platform-agnostic user interface functionalities, an application programming interface (API) that extends the base design system layer into a second design system layer providing platform-specific user interface functionalities, inheriting and extending extensible APIs from the second design system layer, building a third design system layer using the extensible APIs, providing product-specific user interface functionalities using the third design system layer, inheriting and extending extensible APIs from the second design system layer, building a fourth design system layer using the extensible APIs, and providing presentation-specific user interface functionalities using the fourth design system layer.

Abstract: When a multimedia conference between multiple users at multiple locations is established, a first cursor controlled by a first user in a first location is provided. A first event associated with the multimedia conference is detected. In response to detecting the first event associated with the multimedia conference, control of cursors in the multimedia conference can be handled in various ways to enhance the multimedia conference. For example, control of the first cursor can be switched from the first user to a second user at a second location, a second cursor can be provided to the multimedia conference that is controlled by the second user, or control of the first cursor can be merged so that the first cursor can be controlled by both the first user and the second user. This allows for enhanced control of the cursor in the multimedia conference that more closely resembles an in-person conference.

Abstract: Systems and methods are disclosed for collaborative information analysis via electronic communications. In accordance with one implementation, a method is provided for analyzing electronic communications. The method includes, for example, receiving a selection of one of a plurality of electronic communication systems. Moreover, the method includes receiving, from the selected electronic communication system, an electronic communication comprising a plurality of terms and identifying at least one term of interest from the plurality of terms. The method further includes searching for information pertaining to the at least one term of interest and receiving information responsive to the search. The method also includes creating an object corresponding to the at least one term of interest and sharing a representation of the object with one or more users.

Abstract: Certain aspects of the present disclosure provide techniques for providing an augmented reality user interface, including: receiving, by an image sensor of an electronic device, an image of a physical document; determining a document type associated with the physical document by performing image recognition on the image of the physical document; determining an augmented reality template to display on a display of the electronic device; displaying the augmented reality template on the display of the electronic device, wherein the augmented reality template is aligned in three dimensions with the physical document; determining a distance between the physical document and the electronic device; and enabling one or more interactive user interface elements within the augmented reality template displayed on the display of the electronic device if the determined distance between the physical document and the electronic device is less than a threshold distance.

Abstract: A text input system is described for inputting text to a computing device. The text input system has a memory storing a composing region comprising a plurality of text items selected by a user for potential input into the computing device. The text input system has a composing region updater which detects one of the plurality of text items as being a designated symbol. The composing region updater is configured to detect a corrective action acting to correct associated text associated with the selected text items and, when the corrective action is detected, to return the plurality of text items including the designated symbol to the composing region.

Abstract: Disclosed here is a system to enable interaction between a user with a disability and a computer program. The system can obtain a representation of a user interface to present to a user. The system can determine an element associated with the user interface, where the element is configured to provide information to the user, however, the user interface presentation of the element at least partially fails to provide the information to the user. Based on the element, the system can determine an appropriate test to perform. The appropriate test indicates at least two of: a test to perform with a keyboard, a gesture test to perform with a mobile screen reader, and an audio test to perform with a screen reader. The system can generate an indication of the appropriate test. The system can provide the indication of the appropriate test prior to releasing the user interface to the user.

Abstract: A method of providing user access history for a collaborative document includes receiving, by a server, a first request for the collaborative document from a client device of a user of a plurality of users that have permission to access the collaborative document; providing the collaborative document to the client device for presentation to the user in a user interface on the client device; determining whether a collaborator type of the user matches a predefined collaborator type; responsive to determining that the collaborator type of the user matches the predefined collaborator type: creating a first user access history for the collaborative document based on accesses of the collaborative document by one or more of the plurality of users, and providing the first user access history for the collaborative document to the client device for display within a consolidated view of the user interface presenting the collaborative document.

Abstract: A method of configuring a building management system for operation, the building management system including a plurality of building system components, the method comprising: accessing a widget library, the widget library comprising a plurality of individual images that each represent operation of one or more building system components; dragging and dropping one or more individual images from the widget library onto an editor page; dragging and dropping one or more points of the one or more building system components onto each of one or more of the individual images on the editor page; in response to dragging and dropping the one or more points onto each of one or more of the individual images on the editor page, automatically binding the one or more points with the respective individual image; and saving the individual images along with the binding with their respective one or more points.

Abstract: The present disclosure involves systems, software, and computer implemented methods for personalizing media content. Personalization digital media templates can be retrieved that designate (i) particular types of media content to be combined with particular preselected digital video files and (ii) particular times within particular preselected digital video files at which the particular types of media content are to be combined with the particular preselected digital video files, the particular times being relative to the times within the preselected digital video files at which emotionally impactful moments occur. Digital media content can be assembled for the personalized digital video files using particular preselected digital video files, the digital media templates, and the personal digital media file. The assembled digital media content can be encoded using a common video codec to generate the personalized digital video files.

Abstract: Methods, systems, and devices supporting web browser tab navigation are described. A device (e.g., a user device) may initiate, via a web browser and in a first tab of a set of tabs of the web browser, a video conference session of a video conference application. The device may render a visual component in a user interface of the video conference session that indicates enablement of tab navigation functionality for the video conference application. In some examples, enablement of the tab navigation functionality may be based on an extension being installed in the web browser. The device may then receive an input via the visual component to visually distinguish the first tab for a duration of the video conference session, and cause for display a visual marker associated with the first tab for the duration of the video conference session based on receiving the input.

Abstract: Computerized systems and methods are provided for automatically detecting an indication that a task has been completed and associated user interface functionality. These systems and methods improve existing technologies by automatically detecting indications that tasks have been completed via new logic or rules and improving the functionality and computing resource consumption relative to existing machine learning models. These systems also improve the way computers operate by reducing computing resource consumption, such as memory, network latency, I/O, and the like.

Abstract: Usability improvement is achievable with respect to use of screen divisional display of windows of plural applications. Provided is an information processing apparatus including a control unit that displays divisional display information on a display screen as information associated with screen divisional display of windows of plural applications on the display screen, on the basis of a trigger operation, and displays the windows of the plural selected applications on the basis of a following operation for the displayed divisional display information while dividing display of the windows into at least a first region and a second region of the display screen. The following operation includes an operation that selects the applications for which the screen divisional display is to be executed.

Abstract: Various methods, apparatuses/systems, and media for implementing an attended automation module are disclosed. A processor implements a primary desktop on a graphical user interface (GUI) window. The primary desktop is being created in response to calling a higher level application programming interface (API) from a higher level library in connection with a primary desktop session. The processor also determines that a primary session is being conducted on the primary desktop; accesses a lower level library that stores lower level APIs; calls the lower level APIs; dynamically creates, in response to calling the lower level APIs, a plurality of child desktops each associated with a corresponding lower level API; displays the plurality of child desktops on the GUI window; and simultaneously runs each of the plurality of child desktops on the GUI window in parallel independent of running of the primary desktop.

Abstract: A computing system causes instructional media to be played on a device to a user. An instructor in the instructional media provides guidance as to how to perform an activity when the instructional media is played on the device. The computing system obtains user data pertaining to performance of the activity by the user. The computing system generates a user-customized portion of the instructional media based upon the user data and a computer-implemented model. The computing system causes the user-customized portion to be played on the device to the user, where the device emits audible words reproduced in a voice of the instructor, where the audible words are based upon the user data, and further where the device displays generated images of the instructor depicting the instructor speaking the audible words as the device emits the audible words.

Abstract: Disclosed are methods, systems, and non-transitory computer-readable medium for automatic time keeping of an electronic checklist. One method may include: receiving a user and/or system input associated with a graphical user interface (GUI) of an electronic checklist; determining whether the user and/or system input triggers a timer event; in response to determining that the user and/or system input triggers the timer event, determining whether the timer event is a first type of timer event or a second type of timer event; in response to determining that the timer event is the first type of timer event, performing a first timer process; and in response to determining that the timer event is the second type of timer event, performing a second timer process.

Abstract: Disclosed are methods, systems, and non-transitory computer-readable medium for managing vehicle guidance using a GUI. One method may include: obtaining flight management system (FMS) data; updating an aircraft configuration state based on the FMS data; obtaining a current mode, active command, and a second command for a guidance panel based on the configuration state; and generating a guidance panel GUI based on the current mode, the active command, and the second command. Another method may include: obtaining vehicle data; updating a vehicle configuration state based on the vehicle data if the vehicle data has updated information; obtaining a current mode, active command, and a second command for a guidance panel of the vehicle based on the vehicle configuration state; generating a guidance panel GUI based on the current mode, the active command, and the second command; and displaying the guidance panel GUI on the guidance panel.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for machine learning for home understanding and notification. In one aspect, a method includes collecting activity data from one or more devices in a home network, generating a graph-based knowledge base including two or more nodes based on the activity data, where each node is an object, person, or routine and wherein each link is a relationship between two nodes, generating, based on the graph-based knowledge base, one or more rules, determining, based in part on the activity data, an occurrence of a particular rule of the one or more rules, generating a notification responsive to the particular rule, presenting the notification to a user, receiving, user feedback responsive to the notification, where the user feedback includes a natural language label for the particular rule, and updating the particular rule based on the user feedback.

Abstract: A smartwatch including a first screen cooperating with a first display management device of said smartwatch contributing to broadcasting information pertaining to functions provided by the smartwatch and a second screen that is separate from the first screen cooperating with a second display management device of the smartwatch contributing to broadcasting information concerning all or part of a visual message pertaining to a visual and/or audio animation occurring within an environment wherein the smartwatch is located, the information being transmitted from a display control server controlling the second display management device of the smartwatch.

Abstract: Techniques for server-based UI rendering are described. In an example, a system receives, from a device, a request associated with rendering a UI that includes multiple UI components. The system receives, from a first source associated with a first UI component, availability information indicating that the first UI component is available for use by other UI components. Based at least in part on the availability information, the system determines that the first UI component is available for use by a second UI component. The system receives, from a second source associated with the second UI component, event information indicating content presentable in the first UI component and an event trigger at the second UI component to present the content. Further, the system sends, to the device, a set of instructions associated with the rendering of the UI. The set of instructions includes the event information.

Abstract: Systems and methods are described for providing a user interface for display of metric data. A plurality of graphical controls can be displayed in the user interface to modify the generation of the metric data. For example, a first graphical control may enable a user to specify a processing criterion and a second graphical control may enable a user to specify an aggregation criterion and a grouping criterion. Based on the aggregation criterion, aggregated data can be generated from data processed using the processing criterion. The grouping criterion can be used to extract metric data from the aggregated data and a preview of the metric data can be displayed in the user interface.