Abstract: Techniques for improved text-to-speech processing are disclosed. The improved text-to-speech processing can convert text from an electronic document into an audio output that includes speech associated with the text as well as audio contextual cues. One aspect provides audio contextual cues to the listener when outputting speech (spoken text) pertaining to a document. The audio contextual cues can be based on an analysis of a document prior to a text-to-speech conversion. Another aspect can produce an audio summary for a file. The audio summary for a document can thereafter be presented to a user so that the user can hear a summary of the document without having to process the document to produce its spoken text via text-to-speech conversion.

Abstract: Systems, methods, and non-transitory computer-readable storage media are provided for remotely controlling a hearing device. A hearing device configured to communicate with a control device transmits status data, including settings, to the control device. The control device displays the status data in an interface configured to receive input specifying new settings, upon which a command is sent to the hearing device to change the current setting. The control device can automatically change the settings based on a determined current environment to be a stored program optimized to the current environment. The current environment can be determined based on the location of the hearing device or another device connected to the control device. Quick mode allows settings to be viewed and changed quickly by displaying multiple related settings as one and overriding interface buttons. Remote listen mode receives audio data from a microphone and transmit it to the hearing device.

Abstract: Techniques that enable a user to interact with an electronic device using spatial gestures without touching the electronic device. An electronic device provides a contactless mode of operation during which a user can interact with the electronic device using touchless gestures. A touchless gesture may be used to indicate an action to be performed and also to set an action-related parameter value that is then used when the action is performed.

Abstract: An electronic device presents a first user interface element of a first type and a second user interface element of a second type. In a sighted mode, the device detects a first interaction with the first user interface element, and performs an operation in accordance with sighted-mode gesture responses for the first user interface element. The device detects a second interaction with the second user interface element, and performs an operation in accordance with sighted-mode gesture responses for the second user interface element. In an accessible mode, the device detects a third interaction with the first user interface element, and performs an operation in accordance with accessible-mode gesture responses for the first user interface element. The device detects a series of interactions with the second user interface element; and, for each interaction, performs an operation in accordance with the sighted-mode gesture responses for the second user interface element.

Abstract: An accessible electronic device with a display and a touch-sensitive surface: displays a first plurality of user-selectable objects; detects a finger contact on the touch-sensitive surface; detects movement of the finger contact across the touch sensitive surface to an activation region that corresponds to a first user-selectable object; while detecting the finger contact at the activation region, initiates output of audible accessibility information associated with the first user-selectable object; detects termination of the finger contact while the finger contact is at the activation region that corresponds to the first user-selectable object; and, in response: performs a predefined operation associated with the first user-selectable object if the device has output at least a predefined portion of the audible accessibility information associated with the first user-selectable object when the termination of the finger contact is detected; and forgoes performing the predefined operation otherwise.

Abstract: An accessibility method is performed by an electronic device with a display and a touch-sensitive surface. The method includes: mapping at least a first portion of the display to the touch-sensitive surface; concurrently displaying a plurality of user interface containers on the display; detecting a user interface container selection event that selects a first user interface container in the plurality of user interface containers; and, in response to detecting the user interface container selection event: ceasing to map the first portion of the display to the touch-sensitive surface, and proportionally mapping the first user interface container to be substantially coextensive with the touch-sensitive surface.

Abstract: The electronic device with one or more processors and memory receives a first document including a plurality of links. The electronic device outputs a voice reading of at least a portion of the first document, and outputs audible information identifying a link of the plurality of links. In response to outputting the audible information identifying the link, the electronic device receives from the user a voice command regarding the link, and, in response to receiving from the user the voice command, outputs a voice reading of at least a portion of a second document associated with the link.

Abstract: Systems, methods, and non-transitory computer-readable storage media are provided for remotely controlling a hearing device. A hearing device configured to communicate with a control device transmits status data, including settings, to the control device. The control device displays the status data in an interface configured to receive input specifying new settings, upon which a command is sent to the hearing device to change the current setting. The control device can automatically change the settings based on a determined current environment to be a stored program optimized to the current environment. The current environment can be determined based on the location of the hearing device or another device connected to the control device. Quick mode allows settings to be viewed and changed quickly by displaying multiple related settings as one and overriding interface buttons. Remote listen mode receives audio data from a microphone and transmit it to the hearing device.

Abstract: An accessibility method is performed by an electronic device with a display and a touch-sensitive surface. The method includes: displaying a plurality of user interface elements on the display; in response to detecting a first user interface navigation gesture by a finger on the touch-sensitive surface, navigating in the plurality of user interface elements in accordance with a current navigable unit type; in response to detecting a first user interface navigation setting gesture on the touch-sensitive surface: changing the current navigable unit type from the first navigable unit type to a second navigable unit type; and outputting accessibility information about the second navigable unit type; after changing the current navigable unit type, in response to detecting a second user interface navigation gesture by the finger on the touch-sensitive surface, navigating in the plurality of user interface elements in accordance with the current navigable unit type.

Abstract: A method includes displaying a user interface of an application on a device's touch-sensitive display. The user interface includes a plurality of regions, including a respective region at a respective hierarchy level. The respective region has two or more child regions at a hierarchy level below the respective hierarchy level. The method includes detecting a first contact at a location that corresponds to the respective region and that does not correspond to any of the two or more child regions. When the application is configured to process the first contact, not in conjunction with the respective region, but in conjunction with at least one child region of the two or more child regions, the method includes identifying a respective child region in accordance with positions of the child regions relative to the location, and processing the first contact in conjunction with the identified respective child region using the application.

Abstract: Techniques that enable a user to select, from among multiple languages, a language to be used for performing text-to-speech conversion. In some embodiments, upon determining that multiple languages may be used to perform text-to-speech conversion for a portion of text, the multiple languages may be displayed to the user. The user may then select a particular language to be used from the multiple languages. The portion of text may then be converted to speech in the user-selected language.

Abstract: An electronic device with a display bounded by a plurality of edges: displays a first portion of a first window on the display while not displaying a remaining portion of the first window on the display, wherein: the remaining portion of the first window extends in a virtual sense beyond at least one edge of the display; detects a first input that positions a cursor at a location on the display, the location being: over the displayed first portion of the first window, and within a predefined distance of an edge of the display; in response to detecting the first input that positions the cursor at the location on the display, activates a window adjustment mode; while the window adjustment mode is active, detects a second input; and, in response to detecting the second input, adjusts the first window in accordance with the second input.

Abstract: An accessibility method is performed by an electronic device with a display and a touch-sensitive surface. The method includes: displaying a plurality of user interface elements on the display; in response to detecting a first user interface navigation gesture by a finger on the touch-sensitive surface, navigating in the plurality of user interface elements in accordance with a current navigable unit type; in response to detecting a first user interface navigation setting gesture on the touch-sensitive surface: changing the current navigable unit type from the first navigable unit type to a second navigable unit type; and outputting accessibility information about the second navigable unit type; after changing the current navigable unit type, in response to detecting a second user interface navigation gesture by the finger on the touch-sensitive surface, navigating in the plurality of user interface elements in accordance with the current navigable unit type.

Abstract: Disclosed herein are systems, methods, and non-transitory computer-readable storage media for operating a computing device having at least two user interface (UI) navigation modes capable of being concurrently activated in said device, and both UI navigation modes being responsive to a predefined set of touch gestures on a touch-sensitive display of the computing device.

Abstract: An electronic device with a display and a touch-sensitive surface displays, on the display, a first visual indicator that corresponds to a virtual touch. The device receives a first input from an adaptive input device. In response to receiving the first input from the adaptive input device, the device displays a first menu on the display. The first menu includes a virtual touches selection icon. In response to detecting selection of the virtual touches selection icon, a menu of virtual multitouch contacts is displayed.

Abstract: An electronic device presents a first user interface element of a first type and a second user interface element of a second type. In a sighted mode, the device detects a first interaction with the first user interface element, and performs an operation in accordance with sighted-mode gesture responses for the first user interface element. The device detects a second interaction with the second user interface element, and performs an operation in accordance with sighted-mode gesture responses for the second user interface element. In an accessible mode, the device detects a third interaction with the first user interface element, and performs an operation in accordance with accessible-mode gesture responses for the first user interface element. The device detects a series of interactions with the second user interface element; and, for each interaction, performs an operation in accordance with the sighted-mode gesture responses for the second user interface element.

Abstract: Methods and systems are disclosed that allow automated testing of an application program that is configured to receive a touch input. A testing mechanism can be configured to identify the touch input that is designed to produce a specified result. The testing mechanism can generate one or more signals simulating the touch input. The testing mechanism can then check the state of the user interface of the application program being tested and determine whether the actual result conforms to the specified result.

Abstract: A method includes displaying a user interface of an application on a device's touch-sensitive display. The user interface includes a plurality of regions, including a respective region at a respective hierarchy level. The respective region has two or more child regions at a hierarchy level below the respective hierarchy level. The method includes detecting a first contact at a location that corresponds to the respective region and that does not correspond to any of the two or more child regions. When the application is configured to process the first contact, not in conjunction with the respective region, but in conjunction with at least one child region of the two or more child regions, the method includes identifying a respective child region in accordance with positions of the child regions relative to the location, and processing the first contact in conjunction with the identified respective child region using the application.

Abstract: A method includes displaying a user interface of an application on a device's touch-sensitive display. The user interface includes a plurality of regions, including a respective region at a respective hierarchy level. The respective region has two or more child regions at a hierarchy level below the respective hierarchy level. The method includes detecting a first contact at a location that corresponds to the respective region and that does not correspond to any of the two or more child regions. When the application is configured to process the first contact, not in conjunction with the respective region, but in conjunction with at least one child region of the two or more child regions, the method includes identifying a respective child region in accordance with positions of the child regions relative to the location, and processing the first contact in conjunction with the identified respective child region using the application.

Abstract: An accessible electronic device with a display and a touch-sensitive surface: displays a first plurality of user-selectable objects; detects a finger contact on the touch-sensitive surface; detects movement of the finger contact across the touch sensitive surface to an activation region that corresponds to a first user-selectable object; while detecting the finger contact at the activation region, initiates output of audible accessibility information associated with the first user-selectable object; detects termination of the finger contact while the finger contact is at the activation region that corresponds to the first user-selectable object; and, in response: performs a predefined operation associated with the first user-selectable object if the device has output at least a predefined portion of the audible accessibility information associated with the first user-selectable object when the termination of the finger contact is detected; and forgoes performing the predefined operation otherwise.