Abstract: Methods, systems and apparatus, including computer programs encoded on computer storage media for determining asset efficiency. Unmanned Aerial Vehicles (UAVs) may be used to obtain aerial images of locations, property or structures. The aerial images may be geo-rectified, and a ortho-mosaic, digital surface model, or a point cloud may be created. In the context of an operation where mobile assets are used, such as construction or earth moving equipment, location-based event information may be obtained. The system determines efficiency clusters for particular assets, and provides an exploration interface to present and navigate via the efficiency cluster.

Abstract: An input method for a virtual keyboard includes: in response to acquiring a click operation on the virtual keyboard, determining a click position of the click operation; determining a first probability that the click operation belongs to each key based on the click position and a current response region corresponding to each key in the virtual keyboard; determining a second probability that the click operation belongs to each key based on an input character sequence; and determining a target key corresponding to the click operation based on the first probability and the second probability for each key.

Abstract: Techniques for embedding a web browser in a graphical display view of a process plant include presenting a graphical display view including (i) indications of one or more process control elements, such as a control module, a function block, a process plant entity, or a process section of the process plant, and (ii) a web browser having web content from a source address. The web browser is presented according to one or several presentation parameters, such as such as a size and position of the web browser within the display view. Furthermore, the presentation parameters include restrictions on functions performed within the web browser, such as a sandbox or sandbox attributes. The presentation parameters also include a source whitelist that specifies web addresses which are allowed to be set as the source address for presenting web content.

Abstract: A computing device can receive at least a first post in association with a first account, a second post in association with the first account, the second post being associated with the first post, a third post in association with a second account, the third post being associated with the first post, a fourth post in association with the second account, the fourth post being associated with the first post, and a fifth post in association with a third account, the fifth post being associated with the first post, determine that the first account and the second account are most relevant to a conversation, and based on determining that the first account and the second account are most relevant to the conversation, present the first post, the second post, the third post, and the fourth post without presenting the fifth post.

Abstract: A method to present recommended operator actions of a suggestion system and to provide interaction with the suggestion system. Recommendations for two or more software applications are generated. Display and control elements for the recommendations of the two or more software applications are jointly displayed and an activation of one of the jointly displayed display and operating elements is detected. The software application assigned to the activated display and control element is opened and display and control elements are jointly displayed, each of which represent one of several recommended operator actions for the opened software.

Abstract: Display of supplemental content on a smartwatch wearable mobile device. A method establishes, on supplemental physical display plane(s) of a smartwatch wearable mobile device, virtual display plane(s). The smartwatch includes a primary physical display plane and the supplemental physical display plane(s). The supplemental physical display plane(s) at least partially surround the primary physical display plane. The method displays primary content on the primary physical display plane and supplemental content on the virtual display plane(s). The method also receives touch sensor input from a touch sensor of the smartwatch and maps the touch sensor input to interface element(s) of the supplemental content on the virtual display plane(s). The method selects the interface element(s) based on the mapping the touch sensor input to the interface element.

Abstract: An apparatus and method for moving thumbnails on a screen is provided. In a case where thumbnails desired by a user among a displayed list of thumbnails are moved by a drag-and-drop operation, if the number of thumbnails as movement targets is large, it takes time to perform a selection operation. Where one of a plurality of thumbnails displayed as a list is dragged and dropped by a user, based on a drop position, a thumbnail group including the dragged thumbnail and thumbnails positioned on a first side of the dragged thumbnail or on a second side, opposite the first side, of the dragged thumbnail among the displayed list of thumbnails is determined as a movement target for subsequent movement thereof.

Abstract: In some implementations, a computing device can present a dynamic street scene overlay when presenting a map view on a display of the computing device. The dynamic street scene overlay can be presented such that a user can clearly view both the dynamic street scene and the map view. The dynamic street scene can be dynamically adjusted in response to the user manipulating the map view to a different location. The dynamic street scene can be presented such that the objects in the images of the dynamic street scene have a three-dimensional look and feel. The dynamic street scene can be presented such that the dynamic street scene does not prevent the user from viewing and interacting with the map view.

Abstract: Disclosed herein are system, method, and computer-readable storage medium embodiments for ordered macro building. An embodiment may include operations of displaying, via a user interface, a first user interface object and a second user interface object, populating a macro building pane comprising a first macro building object and a second macro building object, in response to the first user interface object receiving a first interaction and in response to the second user interface object receiving a second interaction, and compiling a macro with at least the first interaction and the second interaction, the first interaction being with a first application and the second interaction being with a second application.

Abstract: Aspects of the present disclosure involve systems, methods, devices, and the like for presenting a user interface. In one embodiment, a system and method is introduced that enables the customization of a user interface on a mobile application. The customized user interface is generated in response to a user interaction with the mobile application. In another embodiment, a system and method are introduced which generate the customized user interface including modules used to present a customized layout created using tiles which are presented on the user interface, wherein each of the tiles are placed and customized specific to the user of the mobile device application.

Abstract: A method for displaying information and receiving inputs with a medical device includes displaying a first interface on a display of the medical device, receiving various inputs from a user, displaying a second interface on the display of the medical device, and receiving vital signs data from the patient using the second interface. The first interface includes a login area including one or more prompts for information identifying a user of the medical device and profile selection area including two or more profiles offered by the medical device. The method further involves receiving user identifying information from the user via the login area, confirming the user identifying information, activating the profile selection area in response to confirming the user identifying information, receiving a profile selection from the user via the profile selection area, and receiving patient identification information from the user with the medical device.

Abstract: Systems and methods are disclosed preventing accidents by altering user interfaces of self-driving vehicles based on movements of passengers in the self-driving vehicles. The system and methods generate for display media content on a user interface for a self-driving vehicle and determine whether a value of movement from a wearable user device of a user within the self-driving vehicle exceeds a threshold value (indicating the maximum value at which the self-driving vehicle removes the media content on the user interface). Responsive to a determination that the value of the movement from the wearable user device exceeds the threshold value, the system and methods remove the media content on the user interface for the self-driving vehicle.

Abstract: An electronic device comprising a touch screen, a plurality of first keys arranged along a periphery of the touch screen, a storage configured to stores a character array, and at least one controller configured to execute a character editing process according to an operation on the first key by allocating at least one of characters and phrases included in the character array to each of the first keys and accepting, when detecting the operation on one of the first keys, editing the at least one of the characters and the phrases allocated to the first key on which the operation is detected.

Abstract: A method, system, and program product are provided for controlling layers in a graphical user interface. The method includes an operating system function of a mobile computing device running a current application with a current layer of user interaction via the graphical user interface, detecting an event providing a top layer display, determining if the top layer display has sufficient relevance to the user to interrupt the current application. If the top layer display does not have sufficient relevance, the method makes the top layer display control transparent so that the user continues to interact with the current application in the graphical user interface while maintaining the top layer in visual order. When the top layer is control transparent, the method may provide a visual cue of control transparency to the user.

Abstract: An object stack feature for graphical user interfaces can include a method for arranging items displayed in a visual interface into a stack where each item of the stack has a corresponding visual representation in the stack. The method can include in response to receiving an indication to stack two or more items displayed in a visual interface, creating a stack object comprising a list of the two or more items and a seed value for an ordered seed. The ordered seed can be supplied to an arrangement function that outputs positions for items in the stack object. An arrangement can be generated using the arrangement function and each of the two or more items can be displayed in the visual interface in the arrangement generated by the arrangement function.

Abstract: The present invention provides an electronic device and a method for controlling the electronic device. According to the present invention, in case a mirroring connection request is received from a first external device, a second external device paired with the first external device is also made to be mirrored so that a mirroring screen of the first external device and a mirroring screen of the second external device can be displayed together.

Abstract: Display of supplemental content on a smartwatch wearable mobile device. A method establishes, on supplemental physical display plane(s) of a smartwatch wearable mobile device, virtual display plane(s). The smartwatch includes a primary physical display plane and the supplemental physical display plane(s). The supplemental physical display plane(s) at least partially surround the primary physical display plane. The method displays primary content on the primary physical display plane and supplemental content on the virtual display plane(s). The method also receives touch sensor input from a touch sensor of the smartwatch and maps the touch sensor input to interface element(s) of the supplemental content on the virtual display plane(s). The method selects the interface element(s) based on the mapping the touch sensor input to the interface element.

Abstract: The present invention is directed to systems and methods for providing an improved interactive and educational eBook platform through an improved eReader. The system provides a platform through which a book is transformed into an interactive, multi-language, assisted reading, read-aloud eBook and is displayed in an eReader with an improved graphical user interface that provides features which enhance the effectiveness of eBook learning.

Abstract: Systems and methods for generating an overview for videos by reconstructing a representation of underlying content and linking from points in the overview to specific points in the video. Mechanisms are provided to create three different types of navigable overviews for different types of how-to and instructional videos. A two-dimensional overview is generated when content is two-dimensional, such as instructional videos on electronic whiteboard or other flat content. The three-dimensional overview is created when the content is three-dimensional, such as how-to videos illustrating the use of specific three-dimensional tangible articles. In three-dimensional case, when 3D model is available, the video segments are directly linked to corresponding points on the model. When a model is not available, a rough overview is first created from the captured video and camera orientation metadata.

Abstract: Context-specific user interfaces for use with a portable multifunction device are disclosed. The methods described herein for context-specific user interfaces provide indications of time and, optionally, a variety of additional information. Further disclosed are non-transitory computer-readable storage media, systems, and devices configured to perform the methods described herein.