Abstract: A computer-implemented method comprising determining, by the processor, a set of objects of the plurality of objects having the shared coordinates (XS, YS) and at a location along the depth direction (ZS); and prioritizing, by the processor, an object from the set of objects based on at least two of metadata of the set of objects, screen areas of the set of objects, transparency of the set of objects, and opaqueness of at least one object of the set of objects currently displayed to improve the selection of at least one of mutually occluded objects and mutually partially occluded objects in the virtual environment. The method includes associating the prioritized object with the viewer input device for detecting interactions with the prioritized object displayed on the display device by the viewer input device. The prioritized object is updated on the screen of the display device based on the interactions.

Abstract: A method of operating a machine via a display device user interface includes generating a text tree display control comprising a tree of text blocks on a first portion of a machine display interface, generating a term control comprising individual terms identified in the text tree display control on a second portion of the machine display interface, generating a navigation control comprising a visual representation of each branch of the text tree display control on a third portion of the machine display interface, operating an individual area of the term control comprising an individual term, to highlight and change all instances of the individual term in the text tree display control, and operating the navigation control to reorder branches of the text tree display control.

Abstract: Systems are provided that include electronic equipment and electronic devices. A system may include electronic equipment such as a thermostat or other equipment in a vehicle or home, vehicle navigation equipment, networking equipment, computer equipment, equipment with speakers for playing audio, and other electronic equipment. An electronic device such as a portable electronic device may be placed in the vicinity of electronic equipment by a user. In response to detecting that the electronic device is adjacent to the electronic equipment, control circuitry in the electronic device can automatically display content of the electric device such as a user control interface for the electronic device or information related to operation of the electronic equipment. The system may monitor the position of the electronic device relative to the electronic equipment and can dynamically update the displayed content based on the current device position.

Abstract: A method for generating a visual illustration of data organized in a multiway graph is provided. In an embodiment, a computer system maintains a plurality of nodes and edges within a multiway graph and displays a visual user interface with a first node positioned at the center of the visual user interface and child nodes positioned at radially symmetric positions surrounding the first node. The computer system receives a first input that specifies a selection of a first child node. In response to receiving the first input, the computer system updates the visual user interface to display: the first node, positioned at the center; the child nodes, positioned at radially symmetric positions surrounding the first node; the first child node positioned below the first node; and grandchild nodes of the first child node, displayed as polygons positioned at radially symmetric positions around a circular area surrounding the child nodes.

Abstract: A neural network system can select content based on user and item content embeddings in an approach that can be updated in real time on the user device without server support. Requests for content sent to the server can include an anonymous user embedding that includes data describing the user's inputs. The content that is nearest to the user embedding in a joint embedding space can be returned as suggested content.

Abstract: In some embodiments, an electronic device performs an action in response to detection of a sequence of one or more motion gestures. Motion gesture information of a first electronic device optionally includes a first portion representing a respective attitude of the first electronic device relative to a frame of reference and a second portion that includes movement of the first electronic device from the respective attitude of the first electronic device. In accordance with a determination that the movement of the first electronic device during the second portion of the motion gesture meets movement criteria for a movement gesture that corresponds to the respective attitude of the first electronic device, a process is initiated to control the first electronic device or a second electronic device in accordance with the second portion of the motion gesture.

Abstract: An electronic device includes a microphone, a processor, and a memory. The memory stores an application for monitoring user information, and the memory stores instructions that, when executed by the processor, cause the electronic device to record a plurality of parameters associated with the user information in the application when a predefined event occurs to record a first parameter and the first parameter is not recorded in the application, to output a message for obtaining the first parameter, to receive a user response associated with the first parameter, to transmit data associated with the user response to an external server, to receive a first response from the external server, and to record the first parameter in the application by allowing the electronic device to have information about sequences of states of the electronic device. The first response includes information about sequences of states of the electronic device for recording the first parameter in the application.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for audio messaging interface for messaging platform. One of the methods includes receiving, by a first client on a first user device, a request to record an audio message, wherein the first client is configured to provide a user interface for the platform for a user using the first user device who is logged in to a user account on the platform; recording audio through a microphone of the first user device; generating a platform message by (i) generating a video file that includes the recorded audio as an audio portion of the video file and programmatically generated minimal video content as a video portion of the video file, and (ii) including the video file in the platform message; and posting, by the first client, the platform message to the platform, in response to a post request.

Abstract: A computer-implemented method includes restricting an accessible number of applications while an application-limiting state exists in a vehicle. In this embodiment, the restricting including re-ordering displayed application icons such that applications having a user-designated priority associated therewith are still accessible on a vehicle display being limited by the restricting.

Abstract: A system controls an electronic device in a teleconferencing system through remote screen-receiving devices that access software applications on a screen-sending device. Access is provided through a point-to-point private wireless network. The software applications are replicated on the remote screen-receiving devices. The software allows users of the remote screen-receiving device to simultaneously manipulate or use one or more common software applications. The concurrent manipulation or use occurs without the screen-sending device applying a software application locking.

Abstract: An augmented reality system that includes processors and storage devices storing instructions. The instructions configure the processors to perform operations. The operations include identifying a writing object in a video feed being displayed in an augmented reality viewer, identify a tip of the writing object based on a contour of the writing object, and tracking movements of the tip in the augmented reality viewer. The operations may also include generating a virtual file, the virtual file storing the tracked movements and generating a text file by performing an image recognition operation associating the tracked movements stored in the virtual file with one or more characters.

Abstract: In one disclosed method, a first application accessed by a client device receives an indicator of an action that a second application is configured to take with respect to a third application. The client device accesses a fourth application and presents, based at least in part on the indicator received by the first application, a user interface element for the fourth application. Based at least in part on detecting selection of the user interface element, the client device presents a user interface configured to cause the second application to take the action with respect to the third application in response to a user input. The client device detects the user input to the user interface and causes, based at least in part on the user input, the second application to perform the action with respect to the third application.

Abstract: Mechanisms are described for receiving touch inputs on a touch screen display in a way that does not obscure the images and content presented on the display. Content, including selectable elements, is displayed in a main portion of a display, where as an input region that does not overlap with the main portion is provided on the display for receiving touch input selecting particular selectable elements. An extrapolated touch input in the main portion of the display is determined based on the location of the touch input in the input region, such that selection of a particular selectable element may be accomplished when the location of the extrapolated touch input coincides with the location of the selectable element.

Abstract: A diagram based visual procedure note writing, in one aspect, presents an image representing a structure on a user interface display. A plurality of objects is presented on the user interface display. Responsive to an object being placed onto the image of the structure, metadata associated with the object is updated based on region information associated with a position where the object is placed onto the image. The updated metadata is presented on the user interface display. A note is composed based on the updated metadata.

Abstract: A framework for anatomy-aware adaptation of a graphical user interface. Landmarks are first detected by passing one or more current images through a trained machine learning model. A body section may then be inferred based on the detected landmarks. One or more user interface elements may be determined based on the inferred body section. A graphical user interface may then be adapted with the determined one or more user interface elements.

Abstract: Aspects of the present disclosure provide techniques for providing a graphical user interface. Embodiments include displaying text input fields corresponding to days of a week. Embodiments include receiving a selection of a first text input field of the text input fields corresponding to a day of the week. Embodiments include displaying, based on the selection of the first text input field, an additional text input field for entering text related to the day of the week. Embodiments include receiving a selection of a second text input field of the text input fields corresponding to another day of the week. Embodiments include displaying, based on the selection of the second text input field, an additional text input field for entering text related to the other day of the week in place of the additional text input field related to the day of the week.

Abstract: Systems and methods are described for receiving, at a wearable electronic device, a cue to trigger a form-filling mode in which the wearable electronic device includes memory, at least one camera and the at least one processing device. Responsive to receiving the cue, the systems and methods may trigger the at least one camera to capture an image of a physical form where the physical form includes a plurality of fields, and wherein the wearable electronic device uses the image to analyze the plurality of fields, obtain information to complete said fields. The systems and methods may also include detecting a hover input over a respective blank field in the plurality of fields, retrieving, based on the respective blank field and the stored information, a portion of the stored information to fill in the respective blank field, and providing, by the wearable device, the retrieved portion.

Abstract: Techniques are described for providing normalized object exposure in a collaborative platform. Implementations provide a collaborative platform to enable multiple users to collaborate to address an issue collectively. The platform enables a user to create a work routine in which objects may be added and manipulated by multiple users. The objects may be normalized through use of a normalized object contract. Tools may be added to the work routine, and linked to objects to apply functionality to the object data of the objects. The tools may also comply with the normalized object contract to be consumable within the platform. Through the contract, objects may exhibit a shared common state such that multiple users and/or processes access the same state for a particular object at any given time in a work routine.

Abstract: Systems, methods, and computer program products for delivery/read receipts for electronic messaging are disclosed. During one-on-one electronic messaging sessions in a conversation view format, only a single read receipt is shown only for the most recent message transmitted in the conversation. In some implementations, a delivery receipt is shown which then can be replaced or morphed into a read receipt. In a group conversation, a read receipt can be displayed for the recipient who most recently caught up in the ongoing conversation.

Abstract: A widget recommendation system and method recommends user interface widgets for an event that contains content or a presentation. In one embodiment, the system recommends user interface widgets for a landing page for the content or presentation of an event. The system and method may extract features from past events and recommend the user interface widgets.