Abstract: An automated testing system is described for efficient visual verification of graphical user interfaces of software applications. A pattern is formed for the user interface of a page of the application indicating regions of the page where user interface elements should be located and identifying which user interface element should be located in which region. During test execution, image recognition is performed using previously stored snapshots of user interface elements to determine whether the application's user interface elements appear in correct positions on the page.

Abstract: A method and system for previewing a media item recommendation queue. A server receives a request from a first device for at least a portion of a media item recommendation queue associated with a second device. The server provides to the first device a plurality of recommendation queue entries from a top portion of the media item recommendation queue associated with the second device. The order of the plurality of recommendation queue entries in the media item recommendation queue is based on a plurality of priority indicators associated with the second device. The server receives a request from the first device to couple the second device to the first device and couples the second device to the first device, wherein media item recommendations generated by the second device are directed to the first device.

Abstract: A system and method are presented for automatically switching to different applications, settings, or GUIs based on orientation of a mobile device. The system provides a user with the ability to maximize screen “real estate,” limit the number of user inputs required to perform a particular action, and to maximize efficiency when using a mobile device. In some examples, the system allows a user to access multiple applications or user menus by changing the mobile device's orientation from a first orientation to a second orientation. The system may also allow the user to establish which actions take place upon changing the mobile device's orientation.

Abstract: A collaborative computing device group operative under a shared multiple discrete desktop user interface is established from a first desktop of a first computing device and a different discrete desktop of a second computing device physically located in user visual proximity to the first computing device. A color-coded graphical representation of a user-interface control port that allows authorized cursor navigation to and from the second computing device is displayed on the first desktop oriented in a respective direction of the second computing device. A cursor of the second computing device is authorized to migrate, under control of a user of the second computing device, from the different discrete desktop through the color-coded graphical representation of the user-interface control port of the second computing device to the first desktop and the first computing device is controlled in accordance with visual navigation and control of the cursor of the second computing device.

Abstract: An example method includes outputting a plurality of characters, receiving an input indicative of a slide gesture across one or more regions associated with a group of characters included in the plurality of characters, determining, based on an origination point and/or a speed of movement, whether the slide gesture represents a character string level selection or a character level selection, responsive to determining that the slide gesture represents the character string level selection, outputting a graphical selection of at least one character string included in the group of characters, such that the at least one character string is visually differentiated from any of the plurality of characters not included in the group of characters, and responsive to determining that the slide gesture represents the character level selection, outputting, in single character increments, a graphical selection of at least one character included in the group of characters.

Abstract: An image display device displays operation items of an electron microscope on an operation screen, and a storage device stores information of assist buttons which display image state information acquired via a detector of the electron microscope. The information of the assist buttons corresponds to image quality of an acquired image via the detector as well as to observation conditions composed of a combination of parameter setting values of the electron microscope, an operation program which analyzes the image quality of the acquired image. The information of the assist buttons is acquired based on analytical results of the image quality as well as current observation conditions, and the assist buttons are displayed on a predetermined part of the operation screen. Accordingly, the skills of a novice user operating a charged particle beam apparatus can be improved.

Abstract: A gallery user interface element that includes multiple selectable service user interface elements. Each of the selectable service user interface elements, when selected, initiates a corresponding predetermined action. Thus, the gallery may be used to initiate any number of predetermined actions by selecting appropriate service user interface elements. The predetermined actions may be performed by a number of user interface elements that are collectively offered by a variety of different applications, application extensions, or the system itself. The predetermined actions may include at least one predetermined action that extends an extendible canvas with one or more additional user interface elements. The gallery may include multiple pinnable elements and have different versions depending on a context in which the gallery was opened.

Abstract: Timeline management is described, including selecting a segment of a timeline, activating a control, and replacing the segment of the timeline with a visual indicator used to identify the segment of the timeline.

Abstract: Described is a technology by which network connections are unified into a single user interface for user interaction with those networks. Upon receiving information identifying available networks that correspond to different types of media, a user interface component aggregates the available network connections and displays representations of the available network connections on the user interface. The result is a single user interface page on which the available networks are represented as available network connections that may correspond to destinations, for example by displaying a network name and/or a user-friendly name maintained in a network profile. Also displayable is connectivity status, security-related information, signal strength information for wireless network connections, and other information. The user may choose to show all available network connections, or only subset of the available network connections (e.g., only wireless, or only dial-up and VPN).

Abstract: A computer-implemented system and method for flexibly taking actions upon activation of rule-based triggers are provided. A collection of documents is stored in a storage device within a computing environment. An activity of a user performed on a document from the collection is observed. At least one of an application, operation, key word, time, place, project, topic, different document from the collection, and different user is identified. A connection associated with the user is determined to at least one of the application, operation, key word, time, place, project, topic, different document from the collection, and different user based on the observed activity. A rule based on the connection and the observed activity is defined. The rule and a corresponding action are stored as a trigger. Rule satisfaction by at least one of a further activity, event, and stimuli activates the trigger, which causes performance of the corresponding action.

Abstract: Virtual desktops generated by a virtual desktop application locally executing on a tablet computing device, can further display remote applications. The tablet computing device executes an operating system that does not contemplate a mouse pointer and that displays a native desktop. In many instances, the virtual desktop is displayed on the tablet computing device such that the virtual desktop appears to be the native desktop. The virtual desktops therefore include a mouse pointer which can be used to interact with the remote applications. The remote applications generate graphical application output when they execute on a remote server. The graphical application output is transmitted to the tablet computing device and displayed in an application output window displayed within the virtual desktop. Using a virtual trackpad or other virtual input device, a user can interact with the remote applications via the application output displayed on the virtual desktop.

Abstract: A computer implemented method and an apparatus for facilitating voice user interface (VUI) design are provided. The method comprises identifying a plurality of user intentions from user interaction data. The method further comprises associating each user intention with at least one feature from among a plurality of features. One or more features from among the plurality of features are extracted from natural language utterances associated with the user interaction data. Further, the method comprises computing a plurality of distance metrics corresponding to pairs of user intentions from among the plurality of user intentions. A distance metric is computed for each pair of user intentions from among the pairs of user intentions. Furthermore, the method comprises generating a plurality of clusters based on the plurality of distance metrics. Each cluster comprises a set of user intentions. The method further comprises provisioning a VUI design recommendation based on the plurality of clusters.

Abstract: Dynamic media players are disclosed. A method for providing the dynamic media players includes presenting, by a processor of an electronic device, a user interface (UI) including a media player portion and a scrollable portion, providing a first playback of a first media item in a first media player in the first media player portion, and scrolling to an area in the scrollable portion that includes a second media player while continuing the first playback of the first media item by the first media player that remains visible in the UI. The method also includes determining that the second media player is configured to start a second playback of a second media item upon scrolling to the area in the scrollable portion and preventing the second media player from providing the second playback of the second media item during the first playback of the first media item.

Abstract: Techniques for the aggregate and hierarchical display of grouped items spanning multiple storage locations are described. Some techniques may aggregate items in response to user input identifying a scope for item retrieval. The user input may identify a scope such as selection of a local storage location or a search query for retrieving items. The aggregated items may span multiple storage locations and include items within the identified scope and related items outside the identified scope. A group of aggregated items are presented in a hierarchical display within a user interface. The hierarchical display may visually differentiate items inside and outside of the identified scope, and may identify parent-child relationship between related items. An aggregate header for the group of aggregated items may be displayed indicating total items in the group and a status for items in the group within the identified scope. Other embodiments are described and claimed.

Abstract: In a virtualized system, a number of Virtual Machines (VMs) have their own GUIs. A full screen desktop has active corners that roll up in response to user action, such as mouse move or touch screen action. An active corner of the desktop rolls up allowing a user to select another VM application or another display mode without taking any special actions for getting out of a full screen mode. The switch feature does not take up any space on the desktop.

Abstract: Negotiation of a future communication through a personal virtual assistant is provided. A trigger command is received. The trigger command identifies a communication received for a recipient from a sender. Schedule information is accessed. The schedule information is related to the recipient of the received communication. A plurality of options is presented to the sender. The plurality of options are for arranging a future communication between the sender and the recipient, and include at least one option determined based on the accessed schedule information. A selection of an option for arranging a future communication is received. The selected option is executed to arrange the future communication.

Abstract: The system and method described herein may identify one or more virtual desktop extensions available in a cloud computing environment and launch virtual machine instances to host the available virtual desktop extensions in the cloud. For example, a virtual desktop extension manager may receive a virtual desktop extension request from a client desktop and determine whether authentication credentials for the client desktop indicate that the client desktop has access to the requested virtual desktop extension. In response to authenticating the client desktop, the virtual desktop extension manager may then launch a virtual machine instance to host the virtual desktop extension in the cloud and provide the client desktop with information for locally controlling the virtual desktop extension remotely hosted in the cloud.

Abstract: A computer implemented method and an apparatus for determining user browsing behavior are provided. One or more web pages corresponding to a web domain are configured by associating the one or more web pages with tags. A control file is downloaded on a user device when a first web page access by a user to a tagged web page from among the one or more tagged web pages is detected. The control file facilitates recording of user activity related to a web domain on one or more tabs of a web browser associated with the user device. Recorded user activity corresponding to at least one web browsing session is received and user browsing behavior is determined based on the recorded user activity.

Abstract: An approach is provided for supporting multi-media conferencing. Textual information (e.g., text associated with a presentation) is received for display during a conference session to multiple participants. For a particular participant, configuration information corresponding to the participant specifies language assistance for the textual information. Language assistance involves augmenting the textual information according to the configuration information for comprehension of the textual information by the particular participant. In one embodiment, the augmented textual information includes language translation of the textual information. Additionally, the augmented textual information can encompass definitions of terms, including acronyms. The augmented textual information is forwarded for display to the participant during the conference session.

Abstract: A personalized website theme for a website is received. The personalized website theme is distinct from a standard theme of the website. Further, a set of data is sent to the computing device. The set of data includes an indicium indicating the personalized website theme so that the computing device displays the website according to the personalized website theme at least prior to a request for identifying data associated with access to an account on the website.