Abstract: A method, a computer program product, and a computer system render a plurality of applications and tabs thereof on a plurality of displays. The method includes determining the applications and the tabs thereof that are open across the displays and keywords associated with the tabs. The method includes generating a data structure corresponding to a current view across the displays comprising information associated with the displays, the applications, the tabs, and summarized contents based on the keywords. The method includes monitoring a user operation context provided by a user indicative of requested information in a selected tab among the tabs. The method includes updating the data structure with the user operation context indicative of the selected tab, a corresponding application, and a corresponding display. The method includes rendering an updated view across the displays in which the selected tab is positioned to be viewed by the user.

Abstract: A system can determine a first coordinate location and a second coordinate location collectively representing a spatial positioning of a graphical object in a user interface. The system can determine a first pitch for a foreground sound based on the first coordinate location. The foreground sound may be a synthesized voice describing textual content associated with the graphical object. The system can determine a second pitch for a background sound based on the second coordinate location. The system can generate an audio signal configured to cause an audio device to output a composite sound that includes the foreground sound at the first pitch and the background sound at the second pitch.

Abstract: The present disclosure provides an augmented reality information prompting system, including: a head pose detector to detect a user's head pose to generate head pose data; an operation control device to generate operation control data based on the user's operation; and a processor to receive the head pose data from the head pose detector and generate a first display control instruction based on the head pose data, and to receive the operation control data from the operation control device and generate a second display control instruction based on the operation control data; an augmented reality display configured to receive the first and second display control instructions from the processor, and to operate prompt information based on the first and second display control instructions. The present disclosure further relates to a display control method used for the system, as well as an electronic equipment and a non-transitory computer-readable storage medium.

Abstract: Methods, apparatus, systems, computing devices, computing entities, and/or the like for identifying one or more visual impairments of a user, mapping the visual impairments to one or more accessibility solutions, (e.g., program code entries) and dynamically modifying a display presentation based at least in part on the identified accessibility solutions.

Abstract: A device may initiate an automated script to perform one or more interactions with a browser application and identify a first element in a page rendered by the browser application that satisfies one or more accessibility criteria, wherein the first element may include text that is readable by a screen reader application and/or an attribute that causes the first element to be navigable using a keyboard. The device may modify the first element to be inaccessible to the screen reader application and the keyboard and insert, into the page, a second element including text that is readable by the screen reader application to describe the one or more interactions that the automated script is performing. The client device may restore the page to an original state based on determining that the automated script has finished executing.

Abstract: A system for managing content sent to a screen reader is provided. The system is configured to monitor the context of a window, wherein the window context is minimized or active; and when the window context is minimized: monitor for a received textual message in a dynamic area of the window; generate, for each consecutive time interval of a pre-determined fixed time period, an announcement, for each textual message context, indicating that a textual message of a particular context has been detected responsive to the first textual message of the particular context being detected during the time interval and not for any subsequent textual message of the particular context detected during the time interval; and send one announcement for each textual message context per time interval to the screen reader if at least one textual message for a particular context was received during the time interval.

Abstract: One or more tactile effects may be mapped to application user interface elements, formatting properties, and document structure and applied to a display comprising tactile capabilities (e.g., deformable screens, vibrations, static charges, heat, etc.). Formatting, structure, and user interface elements may be mapped to different screen variations that may be felt by a visually impaired user. A visually impaired user may be able to utilize his/her sense of touch to more easily comprehend formatting and structure of a document, as well as to have greater confidence to author professional and consistently formatted and structured documents. A tactile effect may be applied to a location of a displayed user interface element, formatting property, or document structure, or may be applied to a designated area of the display.

Abstract: There is disclosed a system, including apparatus, methods and computer programs, for running native software applications (apps) and HTML5 web-based apps on a computing device, particularly a mobile computing device, in a multitasking mode of operation. In one embodiment, touch screen displays having one or more browsers are adapted to run one or more HTML5 apps, and receive input from hand gestures. One or more software modules execute on the operating system and are responsive to a dragging gesture applied to an HTML5 app displayed in a full screen mode, to subdivide the screen display and display the HTML5 app in one of the subdivided areas and display icons used to launch a second HTML5 app in a different one of the subdivided areas. The second HTML5 app is run concurrently with the first HTML5 app in order to provide multi-tasking between the first and second apps.

Abstract: An image processing apparatus, including a display, a memory, and a controller, to provide a plurality of functions is provided. The controller controls the display to display one of a first screen, through which one of the plurality of functions is selectable; a second screen, through which one of a plurality of options for the selected function is selectable; and a third screen, through which selection of the one of the plurality of options is indicated. When the controller reads shortcut information that indicates a first option for a selected one of the functions, and when the first option is permitted to the user, the third screen is displayed. When the first option is not permitted to the user, and if there is a second option permitted to the user, the second screen is displayed.

Abstract: Provided are methods of dynamically and selectively providing audio and video feedbacks in response to a voice command. A method may include recognizing a voice command in a user speech received through a user device, generating at least one of audio data and video data by analyzing the voice command and associated context information, and selectively outputting the audio data and the video data through at least one of a display device and a speaker coupled to a user device based on the analysis result.

Abstract: Features are disclosed for processing and interpreting natural language, such as interpretations of user utterances, in multi-turn dialog interactions. Context information regarding interpretations of user utterances and system responses to the user utterances can be maintained. Subsequent user utterances can be interpreted using the context information, rather than being interpreted without context. In some cases, interpretations of subsequent user utterances can be merged with interpretations of prior user utterances using a rule-based framework. Rules may be defined to determine which interpretations may be merged and under what circumstances they may be merged.

Abstract: A computer-implemented method and system for supporting a person at a site, venue, or location where the person may have a requirement. The method and system include storing a requirement code in a handheld device, and storing the requirement code and at least one characteristic relating to the requirement code in a requirement certification database. The requirement code is transmitted from the handheld device to a sensor at the site, and action data is received by a facility of the site from the requirement certification database. The action data is indicative of an action to be performed by the facility, dependent on the requirement code and the at least one characteristic, such that the facility adapts its function to a requirement of the person having the requirement.

Abstract: A system, method, and computer-readable medium for performing a web site accessibility operation. The web site accessibility operation automatically enables web site accessibility features for a differently abled user. In certain embodiments, the accessibility features are customized to ease accessibility factors. In certain embodiments, the web site accessibility operation intelligently detects a disability of a user and automatically enables web site accessibility features based upon the detected disability. When performing a web site accessibility operation, a user access a website an analyzer module determines whether the user has a disability and if so what type of disability. Based upon the determination the analyzer module automatically modifies the web site to optimize the accessibility of the web site for the identified disability.

Abstract: Techniques to provide a user interface usable by anyone including the visually impaired are disclosed. Embodiments include dividing a display area of an electronic device into a workspace comprising a plurality of sections; associating each section with a different category; displaying a pane in a section including information for the associated category; receiving a touch gesture on a pane for a section; and outputting an audio signal comprising information of the pane. Other embodiments are described and claimed.

Abstract: In an example method, an electronic device receives data regarding a graphical user interface to be presented on a display of the electronic device. The electronic device identifies one or more key regions of the graphical user interface based on the received data and one or more rules. The one or more rules pertain to at least one of a geometric shape, a geometric size, a location, or a hierarchical property. The graphical user interface is presented on the display of the electronic device, and the at least one of the key regions of the graphical user interface is indicated using the electronic device.

Abstract: A digital magazine application executing on a client device presents content retrieved from various sources to a user by presenting content regions that are each associated with various content items. When the digital magazine application identifies a type of interaction with a content region, the content region is modified to present information about various content items associated with the content region. For example, if the digital magazine application determines that a user positions a pointer at least a threshold distance from a surface of a display device for at least a threshold length of time at a location along a length and along a width of a display device where a content region is presented, the content region is modified. For example, the content region is increased in size and information describing content items associated with the content region is presented.

Abstract: A device includes a display unit which displays display screens, an input unit which receives a gesture input, and a controller which detects whether a gesture, input on the input unit, is in a gesture input region where gesture input is accepted on one of the display screens of the display unit. The controller displays gesture input regions for the display screen when the gesture is not detected in the gesture input region.

Abstract: A method for providing visual cues to a user of a graphical user interface (GUI) for a computer system is disclosed. The visual cues indicate a relationship with an icon having text and/or image elements. In some embodiments, the method receives a color for labeling an icon that has a text-element and an image-element. The method applies the color to a background-region of the text-element of the icon without applying the color to the image-element. In some embodiments, the method does not affect the font of the text. In some embodiments, the method receives a selection of an icon. The icon has a background-region that has a first color. The method changes the first color of the background-region to a second color but retains the first color in a section of the background-region. In some of these embodiments, the method outlines the section of the background-region with a third color.

Abstract: A computerized method of presenting information from a variety of sources on a display device. Specifically the present invention describes a graphical user interface for organizing the simultaneous display of information from a multitude of information sources. In particular, the present invention comprises a graphical user interface which organizes content from a variety of information sources into a grid of tiles, each of which can refresh its content independently of the others. The grid functionality manages the refresh rates of the multiple information sources. The present invention is intended to operate in a platform independent manner.

Abstract: A system for generating audio impressions of data for a visually-impaired user. The system receives data that is displayable by a chart. The data comprises a plurality of values. The system generates an audio impression of the received data. The audio impression includes a first portion and a second portion. The first portion is based upon at least a first value of the received data. The second portion is based upon at least a second value of the received data. An audible difference between the first portion and the second portion reflects the magnitude of a difference between the first value and the second value.

Abstract: A method is performed by an accessible electronic device with a display and a touch-sensitive surface. The method includes: displaying a plurality of user interface elements on the display, wherein a current focus is on a first user interface element; detecting a first finger gesture on the touch-sensitive surface, wherein the first finger gesture is independent of contacting a location on the touch-sensitive surface that corresponds to a second user interface element; and, in response to detecting the first finger gesture: changing the current focus from the first user interface element in the plurality of user interface elements to the second user interface element in the plurality of user interface elements; and outputting accessibility information associated with the second user interface element.

Abstract: The method of the invention enables selection of an item (21) from a plurality of items (21, 23, 25). The method comprises the steps of visually representing a selected item (21) and reproducing at least part of an audio segment representing the selected item (21). The method further comprises applying a visual spatial effect to the visual representation of the selected item (21) and applying a spatial audio effect corresponding to the visual spatial effect to the reproduction of the audio segment. The device of the invention comprises electronic circuitry which is operative to perform the method of the invention. The computer program product of the invention enables a programmable device to perform the method of the invention.

Abstract: Audio data and video data are processed to determine one or more audible events and visual events, respectively. Contemporaneous presentation of the video data with audio data may be synchronized based at least in part on the audible events and the visual events. Audio processing functions, such as filtering, may be initiated for audio data based at least in part on the visual events.

Abstract: A screen reader application for visually impaired users suppresses unwanted content that is output by Braille or text-to-speech. The invention accesses, but does not modify, the document object model of the web page and enumerates web page elements for the end user to either hide or skip to. The end user selections are saved as rules which may be applied according to various levels of scope include web page specific, site specific or web-wide. A screen magnification application for visually impaired users automatically sets the visual focus and magnification level on a web page element according to end-user selection.

Abstract: A screen reader software product for low-vision users, the software having a reader module collecting textual and non-textual display information generated by a web browser or word processor. Font styling, interface layout information and the like are communicated to the end user by sounds broadcast simultaneously rather than serially with the synthesized speech to improve the speed and efficiency in which information may be digested by the end user.

Abstract: A method and system utilizes an interface for the blind and low vision passengers in a touch screen passenger information module (PIM). The PIM is enabled to operate in at least two modes. A low vision mode provides different user input framework on the touch screen as well as appropriate audio prompting. The interface enables a blind or low vision person to interact with the PIM easily, including using the PIM to pay for the fare. The low vision mode can be initiated by the passenger.

Abstract: In one embodiment, a user interface narrator may use a narration proxy 312 to ensure that non-interactive user interface 308 items may be read by the narration control 212 of an operating system 210. The user interface narrator may use a narration control 212 of an operating system 210 to vocalize a user interface 222. The user interface narrator may detect a narration proxy 312 representing a user interface item 304. The user interface narrator may vocalize the narration proxy 312 with the narration control 212.

Abstract: In one embodiment, a user interface narrator may repurpose a data retrieval event 232 to narrate user interface items 304 not under input control focus 306. The user interface narrator may use a narration control 212 of an operating system 210 to vocalize a user interface 222. The user interface narrator may execute an application task outside of an input control focus 306. The user interface narrator may receive a repurposed data retrieval event 232 for an application binary interface 230 of the operating system 210 to alert a narration control 212 of a task event for the application task.

Abstract: In one embodiment, a user interface narrator may use data binding to associate an item control label 404 with a control list item 402. The user interface narrator may use a narration control 212 of an operating system 210 to vocalize a user interface 222 of an application module 220. The user interface narrator may receive from the application module 220 a control list item 402 associated with an item control label 404 via an item data binding. The user interface narrator may vocalize the item control label 404 with the narration control 212.

Abstract: The present invention generally relates to a method and system for providing VoIP clients with the ability to confirm accuracy in conversation data over a digital communication channel. More specifically, a method and system is provided for verifying, via a visual representation whether a receiving client captures accurate information from a particular portion of the digital voice conversation. In response to a triggering event, a visual representation, including information extracted from the particular portion of the digital voice conversation, may be generated for verifying the accuracy. Based on the needs of the clients engaging in the conversation, one or more visual representations and corresponding verifications can be exchanged. In this manner, a multi-tiered oral agreement with authentication may be generated over a digital communication channel.

Abstract: A computer-implemented user interface method for a computing device is disclosed. The method includes associating each of a plurality of telephone keys with a direction of each key relative to a center of a telephone keypad, receiving a contact from a user of the device at a location on a touchscreen display of a computing device and an input at a direction relative to the location of the user contact, and causing a telephone number to be entered on the computing device based on the direction of each key relative to the center of the telephone keypad corresponding to the direction relative to the location of the user contact.

Abstract: A device may receive information identifying a type of impairment, and provide, based on the type of impairment, a user interface. The user interface may allow a user to specify a command and an action that is to be performed, by an application, based on detecting the command. The action may relate to the type of impairment. The device may further receive configuration information via the user interface, where the configuration information identifies the command and the action. The device may configure the application based on the configuration information, detect, using the application, the command, and perform, using the application, the action based on detecting the command.

Abstract: Systems and methods for providing an enhanced auditory behavior to a graphical user interface are described. Control elements portrayed by the graphical user interface on a display are associated with at least two states. When transitioning between states, a sound effect specified for that transition can be provided to provide further user or designer customization of the interface appearance. Movement of objects can be accompanied by a repeated sound effect. Characteristics of both sound effects can be easily adjusted in volume, pitch and frequency.

Abstract: The computer readable storage medium includes computer executable instructions for implementing a videodescription player module. The computer executable instructions implementing a user interface for selecting one or more videodescription output options among a plurality of videodescription output options. A videodescription player module generates a videodescription output that includes vocal communication information according to the selected output option.

Abstract: A method includes receiving user input indicating a selection of a first multimedia channel from a set of multimedia channels for display. The method further includes determining a first user-selected audio indicator associated with the first multimedia channel. The method additionally includes providing the first audio indicator for audible output in response to receiving the user input indicating the selection of the first multimedia channel. Another method includes providing a user interface to facilitate an association of one or more audio indicators with one or more corresponding channel selection actions.

Abstract: A method for controlling a peripheral device includes receiving input from a user at a workstation adapted to the user, determining whether the received input can be valid, generating a job ticket from the valid input, sending the job ticket to the peripheral device and receiving an identifier representing the job ticket from the peripheral device.

Abstract: An approach is provided for a messaging interface between applications and a user. A plurality of messages associated respectively with a plurality of programs is stored in a common message database according to timing information corresponding to the messages. A subset of the messages is retrieved based on the timing information. The subset of messages is filtered based on message type. The filtered messages are output to a non-visual communication program for presentation of the filtered messages.

Abstract: A data processing device is connected to a web data providing unit that provides web data via a network. The web data has at least one of first web data and second web data corresponding to the first web data. A screen reader can be installed on the data processing device. The displaying unit displays the web data. The screen reader voices the first web data displayed on the displaying unit and fails to voice the second web data displayed on the displaying unit. The acquiring unit acquires the web data from the web data providing unit. The determining unit determines, based on visually impaired information indicating that the user is a visually impaired, whether or not the acquiring unit should acquire the first web data from the web data providing unit even if the user instructs the acquiring unit to acquire the second web data from the web data providing unit.

Abstract: An information processing apparatus includes: a storage unit storing content data and first group identification information for identifying first groups in which the content data are arranged in a predetermined unit; a parameter output unit outputting a parameter representing an amount of displacement of an operating object in response to an operation on the operating object which can be displaced in a predetermined range by a user's operation; a selection unit sequentially selecting the content data while the parameter is in a first range and sequentially selecting the first groups by sequentially selecting the first group identification information stored in the storage unit while the parameter is a value in a second range; and a notification unit notifying what content data is selected when the content data are selected by the selection unit and notifying what group is selected when the first groups are selected by the selection unit.

Abstract: In a computer-implemented method, a portion of an electronic document is displayed on a touch screen display of a portable multifunction device. The displayed portion has a vertical position and a horizontal position in the electronic document. An object is detected on or near the displayed portion of the electronic document. In response to detecting the object, a vertical bar and a horizontal bar are displayed on top of the displayed portion. The vertical bar has a vertical position on top of the displayed portion that corresponds to the vertical position in the electronic document of the displayed portion. The horizontal bar has a horizontal position on top of the displayed portion that corresponds to the horizontal position in the electronic document of the displayed portion. After a predetermined condition is met, display of the vertical bar and of the horizontal bar is ceased.

Abstract: Unused menu items are automatically removed from a TV menu such as a cross-media bar (XMB).

Abstract: Embodiments of the invention include a method and apparatus for describing elements within a virtual world to a user of the virtual world. An element may be identified based on a position of an avatar within the virtual world. The avatar is a representation of the user within the virtual world. A tag associated with the element is selected. The tag includes a description of the element. The element is described to the user based on the description.

Abstract: Embodiments of the invention include a method and apparatus for describing elements within a virtual world to a user of the virtual world. An element may be identified based on a position of an avatar within the virtual world. The avatar is a representation of the user within the virtual world. A tag associated with the element is selected. The tag includes a description of the element. The element is described to the user based on the description.

Abstract: A mobile terminal is used to assist individuals with disabilities. The mobile terminal (e.g., a “smartphone” or other commercially available wireless handheld device) may be loaded with software. The software may be configured to: (i) receive information about a sensory deficit associated with a user, (ii) receive information about a sensory proficiency associated with the user, (iii) determine whether an event associated with a sensory deficit satisfies a criterion, and if so (iv) provide an assistive output based on a sensory proficiency and the event.

Abstract: Many embodiments may comprise logic such as hardware and/or code to implement user interface for traversal of long sorted lists, via audible mapping of the lists, using sensor based gesture recognition, audio and tactile feedback and button selection while on the go. In several embodiments, such user interface modalities are physically small in size, enabling a user to be truly mobile by reducing the cognitive load required to operate the device. For some embodiments, the user interface may be divided across multiple worn devices, such as a mobile device, watch, earpiece, and ring. Rotation of the watch may be translated into navigation instructions, allowing the user to traverse the list while the user receives audio feedback via the earpiece to describe items in the list as well as audio feedback regarding the navigation state. Many embodiments offer the user a simple user interface to traverse the list without visual feedback.

Abstract: A remote control system of the present invention is provided with a TV apparatus and a remote controller, and performs two-way communication. The remote controller is provided with a microphone and a speaker, and generates and outputs sound source data. Furthermore, by the use of wireless communication modules, the sound source data produced by the remote controller is transmitted to the TV apparatus, and the sound source data is transmitted from the TV apparatus to the remote controller, that is, the sound source data is exchanged, with the result that the sound source data is outputted from the TV apparatus and the remote controller.

Abstract: The present invention relates to information processing technologies and discloses an encoding and decoding method and device to solve the poor decoding quality problem. The technical solution of the present invention includes: encoding each sample of an input signal to generate an encoded signal of a core layer; comparing residuals of all or a part of the samples of the input signal with encoding thresholds, where the residuals are generated by core layer encoding, and performing encoding according to comparison results to generate an encoded signal of an enhancement layer; and writing the encoded signal of the core layer and the encoded signal of the enhancement layer into a bitstream to generate an encoded signal of the input signal.

Abstract: A system and method for managing production printing workflow is disclosed. The system includes workflow management software which manages and facilitates the procedural stages of the workflow including job origination, job preparation, job submission and job fulfillment. The workflow management software provides an integrated object oriented interface which visually reflects and interacts with the workflow. The software further provides functionality to create, manage and manipulate compound documents as ordered collections of documents.

Abstract: Various techniques for adaptively varying audio feedback data on an electronic device are provided. In one embodiment, an audio user interface implementing certain aspects of the present disclosure may devolve or evolve the verbosity of audio feedback in response to user interface events based at least partially upon the verbosity level of audio feedback provided during previous occurrences of the user interface event. In another embodiment, an audio user interface may be configured to vary the verbosity of audio feedback associated with a navigable list of items based at least partially upon the speed at which a user navigates the list. In a further embodiment, an audio user interface may be configured to vary audio feedback verbosity based upon the contextual importance of a user interface event. Electronic devices implementing the present techniques provide an improved user experience with regard to audio user interfaces.

Abstract: Map interactivity for a visually-impaired user is provided. A map is displayed on a display module of a device and a grid is overlaid onto the displayed map using a rendering module. Each cell of the grill corresponds to a location on the map. Further, a user selection is received using the input module concerning a cell of the grid from the displayed map. Information associated with a selected cell is retrieved using the location module within the device and a speech segment relating to the information is output using an output module.