Abstract: A method of adjusting elements of a GUI to reflect multi-selection of GUI items, comprising presenting a plurality of selectable GUI items each characterized by one or more unique attributes and one or more action GUI configured to initiate one or more actions adjusted according to a multi-selection of the selectable GUI items, analyzing user input to detect multiple indications gradually indicated by a user to select a group of selectable GUI items, responsive to detection of each of the indications, appending the unique attribute(s) of the respective selectable GUI item selected in the respective indication to the action GUI element(s) such that the action GUI element(s) is dynamically adjusted to aggregate the unique attribute(s) of all of the selectable GUI items of the group, and responsive to activation of the action GUI element(s), initiate the action(s) adjusted according to all of the selectable GUI items of the group.

Abstract: A device that includes an extended reality application is employed by a user to access an extended reality environment. A selection of a first user interface object included in a plurality of user interface objects displayed in the extended reality environment is received via an input device associated with the extended reality environment. Each user interface object included in the plurality of user interface objects is associated with a different set of dashboard panels. At least a first portion of a first set of dashboard panels associated with the first user interface object is displayed in a foreground area of a workspace of the XR environment. The foreground area has a first depth relative to a user viewpoint within the XR environment. The workspace further comprises a background area having a second depth relative to the user viewpoint within the XR environment.

Abstract: A method of displaying media content on a display screen of a communication device. The method includes receiving an indication of a state transition of a first Activity of an application program being executed on a processor of the communication device. The processor, in response to the indication, executes program code in order to monitor a memory state of the operating system so as to determine a user interface state associated with the first Activity. The processor further determines whether the first Activity is finishing based at least in part on the user interface state. Upon determining the first Activity is finishing, the processor causes the media content to be displayed upon further determining that a predetermined condition associated with the communication device exists.

Abstract: A method of displaying media content on a display screen of a communication device including a processor and a memory including program code, an application program, and a user application. The application program includes a plurality of activities associated with a plurality of display windows rendered by the display screen. The method includes receiving, at a monitoring process, status callbacks provided by an operating system of the device wherein the status callbacks relate to memory state. Values of at least one of the status callbacks are inspected wherein the at least one of the status callbacks includes a user interface (UI) state value. Based at least in part upon inspection of the UI state value, it is determined that a first activity is finishing. Media content is then displayed upon the display screen upon further determining that a predetermined condition associated with the communication device exists.

Abstract: A method and electronic device are provided for processing data. Analog text included in a document is detected. A first area of the analog text that converts to digital text and a second area of the analog text that does not convert to the digital text are determined. The digital text is displayed in the first area that converts to the digital text, and an image of at least a portion of the analog text is displayed in the second area that does not convert to digital text.

Abstract: Audio playback is used to enhance the control of Personal Digital Entertainment devices. Embodiments of the present invention provide audio message files associated with the activation of a control or provide other device status messaging Audio messages are also provided in file sets that are user selectable to give the user a choice of ‘themes’.

Abstract: A device is provided for visually indicating a replay status of media items on a media device. Aspects of the device include displaying in a graphical user interface (GUI) of the media device a representation of a first media item; displaying a profile score of the first media item that is based on user preferences; and displaying a replay score for the first media item that affects replay of the first media item.

Abstract: This is directed to adjusting the size of displayed text in response to receiving user instructions. An electronic device can display text or other content using one or more default sizes. A user can direct the device to increase a display size of text by providing a corresponding input. In response to receiving the instruction, the electronic device can increase the display size of the text and display the beginning of the text (e.g., the beginning of a sentence), even though an input may be detected in a region near the end of the text. In some cases, when the user instructs the device to increase the display size of text beyond a maximum level, the electronic device can provide an audio output corresponding to the text instead of or in addition to increasing the display size of the text.

Abstract: A method of defining a voice browser for browsing a plurality of voice sites, at least some of the voice sites having different telephone numbers, the voice sites being configured to be accessed by telephone, is provided including storing information relating to voice sites visited by a voice user; and providing forward and back functions, comprising transferring a user from one voice site to another, in response to commands by the user. Computer program code and systems are also provided.

Abstract: A computer-implemented method and system are provided for visually indicating a replay status of media items on a media device. Aspects of the method and system include displaying in a graphical user interface (GUI) of the media device a representation of a first media item; displaying a profile score of the first media item that is based on user preferences; and displaying a replay score for the first media item that affects replay of the first media item.

Abstract: A screen reader software product for low-vision users, the software having a reader module collecting textual and non-textual display information generated by a web browser or word processor. Font styling, interface layout information and the like are communicated to the end user by sounds broadcast simultaneously rather than serially with the synthesized speech to improve the speed and efficiency in which information may be digested by the end user.

Abstract: Systems and methods for providing an enhanced auditory behavior to a graphical user interface are described. Control elements portrayed by the graphical user interface on a display are associated with at least two states. When transitioning between states, a sound effect specified for that transition can be provided to provide further user or designer customization of the interface appearance. Movement of objects can be accompanied by a repeated sound effect. Characteristics of both sound effects can be easily adjusted in volume, pitch and frequency.

Abstract: An accessible electronic device with a display and a touch-sensitive surface: displays a first plurality of user-selectable objects; detects a finger contact on the touch-sensitive surface; detects movement of the finger contact across the touch sensitive surface to an activation region that corresponds to a first user-selectable object; while detecting the finger contact at the activation region, initiates output of audible accessibility information associated with the first user-selectable object; detects termination of the finger contact while the finger contact is at the activation region that corresponds to the first user-selectable object; and, in response: performs a predefined operation associated with the first user-selectable object if the device has output at least a predefined portion of the audible accessibility information associated with the first user-selectable object when the termination of the finger contact is detected; and forgoes performing the predefined operation otherwise.

Abstract: An embodiment provides a system and method for sharing between computing devices via a sharing interface, a speech recognition program profile for one or more applications. Another embodiment provides a system and method for sharing between computing devices via an sharing interface, a speech recognition program profile for one or more games. In an embodiment of the invention a personal computer or tablet may comprise a computing device and or a sharing interface. In an embodiment of the invention a cell phone may comprise a computing device and or a sharing interface. In an embodiment of the invention a game play device may be a computing device and or a sharing interface.

Abstract: Various techniques for adaptively varying audio feedback data on an electronic device are provided. In one embodiment, an audio user interface implementing certain aspects of the present disclosure may devolve or evolve the verbosity of audio feedback in response to user interface events based at least partially upon the verbosity level of audio feedback provided during previous occurrences of the user interface event. In another embodiment, an audio user interface may be configured to vary the verbosity of audio feedback associated with a navigable list of items based at least partially upon the speed at which a user navigates the list. In a further embodiment, an audio user interface may be configured to vary audio feedback verbosity based upon the contextual importance of a user interface event. Electronic devices implementing the present techniques provide an improved user experience with regard to audio user interfaces.

Abstract: A development system, including a scenario generator for generating a plurality of sample interactions representative of interactions between a dialog system and a user of the dialog system on the basis of definition data for the dialog system. The definition data includes state machine code, prompt data, and recognition data. A simulator generates prompts of sample interactions on the basis of the prompt data, and the scenario generator generates responses to the prompts on the basis of the recognition data. A scenario editor allows a user to modify the sample interactions. A grammar learner then updates the prompt data and the recognition data on the basis of the modified sample interactions. An application builder generates the definition data from specification data provided by a developer, an application template, and/or an existing dialog application.

Abstract: A method of visually presenting a message includes detecting that a screen reader application is being used in a computer system having a graphical user interface (GUI). The GUI presents messages of a first type by displaying a popup window and presents messages of a second type in a predefined field of the GUI. The screen reader application is configured to detect display of the popup window but not configured to detect presentation of the messages of the second type in the predefined field. The method includes detecting a system event that causes a first message to be presented in the predefined field, the system event resulting from evaluating user input information. The method includes presenting, in response to detecting the system event, a second message in the popup window, the second message being associated with the first message. The predefined field may relate to a message log.

Abstract: A track ball cursor positioning sub-system is employed by a handheld electronic device including an operating system and a plurality of applications having a plurality of predetermined scaling values. The cursor positioning sub-system includes a track ball cursor positioning device adapted to output a plurality of device pulses, and a track ball cursor resolution controller adapted to repetitively input the device pulses and to responsively output to the operating system a plurality of cursor movement events. The cursor resolution controller is further adapted to be controlled by the operating system or by the applications to learn which one of the applications is active and to automatically scale a number of the cursor movement events for a corresponding number of the device pulses based upon a corresponding one of the predetermined scaling values of the active one of the applications.

Abstract: A method, user interface module, computer program product, computer system and system that enable a graphical user interface to be used by persons with visual disabilities. The graphical user interface includes a toolbar, which provides features that enable a visually disabled user to navigate and activate the functions provided by buttons or other controls on the communication toolbar. As a user navigates around the user interface, auditory messages are read describing functionality of different features of the graphical user interface. The text can be audibly read by, for example, a screen reader module. By using a hotkey or menu navigation, a user can issue commands that would normally be issued by clicking on the toolbar. Furthermore, the user can type text into text input boxes, select items from combo boxes, enable broadcast messages to be read, and choose to listen to status messages.

Abstract: Systems and methods for providing an enhanced auditory behavior to a graphical user interface are described. Control elements portrayed by the graphical user interface on a display are associated with at least two states. When transitioning between states, a sound effect specified for that transition can be provided to provide further user or designer customization of the interface appearance. Movement of objects can be accompanied by a repeated sound effect. Characteristics of both sound effects can be easily adjusted in volume, pitch and frequency.

Abstract: The present invention includes a mobile device that is capable of storing media and optionally a wireless network connection for streaming live data between the device and the database. The data from the orientation sensor and the position sensor both go directly into the mobile device as input to a controller in the device. The controller controls in part an audio/video output that is modulated based upon the relative position of the user to an object of interest as well as the user's orientation.

Abstract: A control system for a modular, mixed initiative, human-machine interface. The control system comprises moves, the moves defining units of interaction about a topic of information. The moves comprise at least one system move and at least one user move. Each system move is structured such that it contains information regarding pre-processing to be performed, information to develop a prompt to be issued to the user and information that enables possible user moves which can follow the system move to be listed. Each user move is structured such that it contains information relating to interpretation grammars that trigger the user move, information relating to processing to be performed based upon received and recognized data and information regarding the next move to be invoked. A corresponding method is provided.

Abstract: A communication system includes a criteria matrix for calculating a dialogue score in response to a request for a dialogue model from a dialogue node within a communication action. The criteria matrix also incorporates a dialogue selection table for selecting an appropriate dialogue type, based on the calculated score.

Abstract: A system is described which includes a content retriever to retrieve and format data and a media file playlist generated by the content retriever from the data. The media file playlist includes a playlist entry title identifying a title for a media file, a filename identifying the media file, and a metadata tag containing data for performing an action associated with the media file. The system also includes a text file playlist generated by the content retriever from the text data, formatted in XML (extensible markup language).

Abstract: The invention relates to a method and arrangement for expanding a desktop. Especially the invention relates to a method and arrangement for expanding a desktop virtually. The objects of the invention are fulfilled by relating an audible sound to the application, window or other user interface element as it is shifted out of the display. The sound related to the user interface element may also be characteristic for the element it is related to. In addition, the element can be located by only listening to the sound related to the element.

Abstract: A communication system includes a selection module for selecting appropriate user interface types for nodes within a task. The selection module interacts with a selection criteria library and a user interface dialogue model library to determine an appropriate user interface. Selection criteria library and user interface dialogue model library may be selectively and dynamically adapted to reflect environmental, customer and organization changes.

Abstract: A method for presenting to an end-user the intermediate matching search results of a keyword search in an index list of information. The method comprising the steps of: coupling to a search engine a graphical user interface for accepting keyword search terms for searching the indexed list of information with the search engine; receiving one or more keyword search terms with one or more separation characters separating there between; performing a keyword search with the one or more keyword search terms received when a separation character is received; and presenting the number of documents matching the keyword search terms to the end-user, and presenting a graphical menu item on a display. In accordance with another embodiment of the present invention, an information processing system and computer readable storage medium carries out the above method.