Abstract: A computer-implemented method for avatar rendering of virtual presentations is disclosed. The computer-implemented method includes extracting visual content from a presentation. The computer-implemented method further includes extracting audio content from the presentation. The computer-implemented method includes correlating the visual content with the audio content of the presentation. The computer-implemented method includes generating a virtual avatar to dynamically render a virtual presentation to a viewer, based at least in part, on the correlated visual content and audio content of the presentation.

Abstract: According to an embodiment, an image processing apparatus includes: a character recognition processor which reads an image of a document and extracts text information in the document; a setting manager which manages settings including a setting to allow or prohibit a function of character recognition; a job controller which controls job execution related to reading of the document; and an operation controller which provides a setting menu to receive a setting of at least one item related to the job execution and receives a setting, in which when the function of the character recognition is set to be prohibited, the operation controller hides a function that requires the character recognition from the setting menu or indicates that the function is not to be set, and when the function that requires the character recognition has already been set, the operation controller enables the function to be replaced by another function.

Abstract: Video relay services, communication systems, non-transitory machine-readable storage media, and methods are disclosed herein. A video relay service may include at least one server configured to receive a video stream including sign language content from a video communication device during a real-time communication session. The server may also be configured to automatically translate the sign language content into a verbal language translation during the real-time communication session without assistance of a human sign language interpreter. Further, the server may be configured to transmit the verbal language translation during the real-time communication session.

Abstract: Provided are an AR display method, an AR display apparatus and an AR display device, the device including: a display assembly used for displaying a virtual content, an optical assembly, and a micro mirror array coupled to the optical assembly; the micro mirror array is located on a propagation path of light emitted from the display assembly.

Abstract: The glasses with display may include a bridge, two temples hingedly coupled to the bridge, and a directional microphone array, the directional microphone array including two or more microphones positioned on the bridge or the temples. The glasses with display may also include a user microphone array, the user microphone array including one or more microphones positioned on the temples and oriented toward the mouth of a user wearing the glasses with display or one or more bone conduction microphones. In addition, the glasses with display include two lenses positioned in the bridge, at least one of the lenses including a display, the display visible by the user, the display including one or more of a directional display, closed caption display, and user volume display. The glasses with display additionally include a processor adapted to receive audio signals from the directional microphone array and the user microphone array, or from a separate mobile device, the processor adapted to control the display.

Abstract: Computer-implemented method of browsing a resource through voice interaction comprising the following steps: A. acquiring (100) from a user a request aimed at browsing a resource; B. downloading (130) the requested resource; C. performing a syntactic parsing (135) of the downloaded resource; D. extracting (150) from the downloaded resource one or more lists, if any, of selectable shortcuts pointing to portions inside or outside the downloaded resource through a syntactic analysis and/or a semantic analysis and/or a morphological-visual analysis of extraction of lists of selectable shortcuts on the basis of an ontology (245) corresponding to the type of resource; E. on the basis of the ontology (245) corresponding to the type of resource, building (225) a list of one or more lists of selectable shortcuts extracted in step D ordered according to a list prioritisation; F.

Abstract: A method, an apparatus, and a system for speech recognition are provided. a third-party application corresponding to a speech signal of a user can be determined according to the speech signal and by means of semantic analysis; and third-party application registry information is searched for and a third-party program is started, so that the user does not need to tap the third-party application to start the corresponding program, thereby providing more intelligent service for the user and facilitating use for the user.

Abstract: A method for improving reading proficiency in persons in need of improvement. The method includes the steps of providing a body of digital text on an electronic device; extracting a selected portion of digital text from the body of digital text; analyzing the selected portion by natural language processing to produce a phonetical font, the phonetical font including a representation of a letter that when heard or said voices a phoneme of the letter; rendering the analyzed selected portion into the phonetical font; and utilizing the phonetical font to increase reading proficiency.

Abstract: A method for adjusting a hearing device (12) adapted to be worn behind an ear (28) comprises: determining a cymba angle (54) between a cartilage (50) above the cymba (46) of the ear (28) and a viewing direction (38) of the user; estimating a tilt angle (39) of the hearing device (12) with respect to the viewing direction (38) from the cymba angle (54); and adjusting a beam former direction (37) of a beam former (34) of the hearing device (12), such that the beam former direction (37) is aligned with the viewing direction (38).

Abstract: A semantic recognition method and a semantic recognition device are provided. A spectrogram of a speech signal is generated. At least one keyword of the spectrogram is detected by inputting the spectrogram into a neural network model. A semantic category to which each of the at least one keyword belongs is distinguished. A semantic intention of the speech signal is determined according to the at least one keyword and the semantic category of the at least one keyword.

Abstract: Systems and methods for eyewear devices with integrated heads-up displays are provided. In one embodiment, an eyewear device provides an integrated heads-up display having a partially reflective element carried by an eyeglass lens to reflect towards the user computer-generated imagery projected on to it, while permitting the passage of light through the reflective surface in the direction of view of the user. The display mechanism further includes a cooperating projector assembly housed by a frame of the eyewear device in an overhead configuration relative to the partially reflective element. The projector assembly is housed by a top bar of the eyewear frame, with the reflective surface being housed wholly within the lens.

Abstract: This invention is augmented reality eyewear with a radial, honeycomb, or nested-ring array of selectively-movable reflective elements. These reflective elements can each be moved from a first configuration which is parallel to a line of sight from an eye to a second configuration which is perpendicular to this line of sight. The second configuration reflects light displaying a virtual image to the eye and blocks environmental light in the area of the virtual image. Since light from the environment does not shine through the virtual object, the virtual object appears solid instead of “ghost like.

Abstract: This invention relates to an Extended Perception System that extends the perception of an object's surroundings. Three closely related primary sets of embodiments of this invention include: one set of embodiments is mounted on a set of one or more vehicles; a second set of embodiments is worn by a set of one or more persons and/or animals; and a third set of embodiments which can be in a location fixed with respect to terrestrial and/or other features. Improvements to head-mounted displays are disclosed.

Abstract: System and method for analyzing audio data are provided. Audio data captured by one or more audio sensors included in a wearable apparatus from an environment of a wearer of the wearable apparatus may be obtained. The audio data may be analyzed to detect a repetition in the audio data, the repetition may comprise a first occurrence of a repeated element followed by one or more successive occurrences of the repeated element. The audio data may be analyzed to determine whether the repetition is meaningful. The audio data may be analyzed to determine which of the one or more successive occurrences of the repeated element were produced by the wearer. A feedback may be provided to a user when the repetition is meaningless and all of the one or more successive occurrences of the repeated element were produced by the wearer.

Abstract: According to one or more examples of the present disclosure there is provided a fluency aid comprising: an altered auditory feedback, AAF, generator operable to receive an input signal derived from speech of a user and to apply a predefined variation to the input signal in order to generate a feedback signal for providing altered auditory feedback to the user, wherein the AAF generator is further operable to automatically change a property of the variation that is applied to the input signal.

Abstract: Approaches presented herein enable displaying a virtual image in a real-world or virtual-world environment. More specifically, a virtual image is transmitted, via a virtual image projection component, through a substantially transparent medium onto a set of pinpoint mirrors in contact with the medium. The virtual image is transmitted, via the set of pinpoint mirrors, through the medium onto a set of optical elements that widens a field of view of the virtual image. A view of the virtual image transposed on a real-world or a virtual reality image is provided, via the set of optical elements, to a user looking through the medium. The light forming the virtual image is perceived by the human eye, but, because each pinpoint mirror of the set is smaller than the pupil of the human eye, none of the set of pinpoint mirrors is perceivable by the human eye due to their size.

Abstract: A telephone system is described herein, wherein the telephone system is configured to assist a hearing-impaired person with telephone communications as well as face-to-face conversations. In telephone communication sessions, the telephone system is configured to audibly emit spoken utterances while simultaneously depicting a transcription of the spoken utterances on a display. When the telephone system is not employed in a telephone communication session, the telephone system is configured to display transcriptions of spoken utterances of people who are in proximity to the telephone system.

Abstract: A method and an apparatus for image recognition based on a retina prosthesis. The method includes: recognizing meaning of an image captured; and converting the meaning of the image into a corresponding meaning prompt signal and transmitting the meaning prompt signal to a corresponding retina prosthesis electrode in connection with a retina. The method can effectively improve the problem that the existing retina prosthesis cannot recognize colors or complex scenes, enhance the recognition function of the retina prosthesis, and improve the quality of life of blind patients.

Abstract: Various implementations include approaches for demonstrating device capabilities in a wearable audio device. In certain cases, these approaches include initiating a demonstration using the wearable audio device to provide the user with an example of the device capabilities. In particular aspects, the wearable audio device is configured to apply acoustic demonstration settings at the wearable audio device based upon the demonstration mode, and output an acoustic signal for playback at the wearable audio device.

Abstract: A wearable device providing an augmented reality experience for the benefit of hearing impaired persons is disclosed. The augmented reality experience displays a virtual text caption box that includes text that has been translated from speech detected from surrounding speakers.

Abstract: A hearing assistive system includes a personal communication device and a head-worn device. The personal communication device has a user interface for user interaction, a processor controlling the user interface and for running an application program, and input and output transducers. The head-worn device has an input transducer adapted for converting sound into an electric signal applied to a processor outputting a modified audio signal via an output transducer. The application program generates a data packet modulated on an audio carrier for output via the output transducer, decodes a data packet modulated on an audio carrier and received via the input transducer. The head-worn device has an audio signaling block having a detector block and a response block. The detector block detects and decodes the data packet received by the input transducer. The response block generates a data packet modulated on an audio carrier for output via the output transducer.

Abstract: A method of forecasting subjective efficacy of a hearing prosthesis implanted in a recipient, including subjecting a recipient to a plurality of temporally spaced aural training tasks, the aural training tasks evoking hearing percepts with the hearing prosthesis, obtaining first data indicative of the recipient's ability to hear with the hearing prosthesis based on performance by the recipient of the temporally spaced aural training tasks, and forecasting second data based on the first data, wherein the second data are indicative of the recipient's ability to hear with the hearing prosthesis at one or more temporal locations in the future.

Abstract: A wearable device for binaural audio is described. The wearable device includes a feedback mechanism, a microphone, an always on binaural recorder (AOBR), and a processor. The AOBR is to capture ambient noise via the microphone and interpret the ambient noise. An alert is issued by the processor to the feedback mechanism based on a notification detected via the microphone in the ambient noise.

Abstract: The present disclosure relates to a fluency aid comprising: a first microphone; a second microphone; and an altered auditory feedback, AAF, generator operable to receive a first input signal derived from sound detected by the first microphone and to generate a feedback signal for providing altered auditory feedback to a user of the fluency aid; wherein the fluency aid is configured such that a second input signal derived from sound detected by the second microphone bypasses the AAF generator.

Abstract: Systems and methods for eyewear devices with integrated heads-up displays are provided. In one embodiment, an eyewear device provides an integrated heads-up display having a partially reflective element carried by an eyeglass lens to reflect towards the user computer-generated imagery projected on to it, while permitting the passage of light through the reflective surface in the direction of view of the user. The display mechanism further includes a cooperating projector assembly housed by a frame of the eyewear device in an overhead configuration relative to the partially reflective element. The projector assembly is housed by a top bar of the eyewear frame, with the reflective surface being housed wholly within the lens.

Abstract: A wearable device for binaural audio is described. The wearable device includes a feedback mechanism, a microphone, an always on binaural recorder (AOBR), and a processor. The AOBR is to capture ambient noise via the microphone and interpret the ambient noise. An alert is issued by the processor to the feedback mechanism based on a notification detected via the microphone in the ambient noise.

Abstract: There is provided a method of operating a hearing device (10, 11) to be worn by a user, comprising: defining a plurality of hearing device services and assigning to each hearing device service a service access confirmation level selected from a plurality of hierarchically structured service access confirmation levels; providing an access software platform for enabling third party service access to the hearing device services; providing at least one application program adapted to provide a third party service to the hearing device, each application program adapted to utilize the access software platform and at least one of the hearing device services; providing a manufacturer access service for approving or denying access to the hearing device for each of the application programs depending on whether or not approval for the respective service access confirmation level(s) has been previously obtained.

Abstract: An Environmental Navigation Aid is provided, and can be a rechargeable, portable, handheld device that can convert environmental information, such as distance to a target object, into tactile values for presentation to a user's palm or fingers by way of a tactile feedback wheel. The nature of the target object composition can be factored into the behavior of the feedback wheel. The Environmental Navigation Aid can be paired with a wireless charging dock that can also serve as a homing beacon when the handheld device is pointed at the changing dock. Stand-alone homing beacons for additional orientation referencing tasks can be added to an Environmental Navigation Aid as a system. The Environmental Navigation Aid is designed to assist the blind in perception of the world around them.

Abstract: According to an embodiment, a voice processing device includes a receiver, a separator, and an output controller. The receiver is configured to receive n input signals input into n voice input devices respectively corresponding to n sound sources, where n is an integer of 2 or more. The separator is configured to separate the input signals by the sound sources to produce n separation signals. The output controller is configured to, according to the number of sound sources having uttered voice sounds, switch between an output signal produced based on the input signal and an output signal produced based on the separation signal, and output the output signal.

Abstract: In one aspect, a device includes a processor, at least one camera accessible to the processor, and memory accessible to the processor. The memory bears instructions executable by the processor to identify, at least in part based on input from the at least one camera, a source of sound. The instructions are also executable to, based at toast in part on input from at least one microphone, execute beamforming and provide audio at a hearing aid comprising sound from the source.

Abstract: Systems for providing network-based communication services are provided, such systems comprising a platform configured to facilitate interaction between users requesting interpretation/translation services and individuals capable of fulfilling such requests. Both the content submitted through the system for interpretation/translation and the resulting interpretation/translation may be prerecorded, which facilitates the accuracy of the end-product. Methods for facilitating communication services over a network are also provided, such methods comprising the steps of receiving a request for interpretation/translation, receiving acceptance of the request from an interpreter/translator, receiving a response that corresponds with an interpretation/translation of the content, and making the response available to one or more users via a server.

Abstract: The translator detects audio with the use of at least one microphone. The system analyzes the audio input to determine the spoken words. The translator determines the phonemes of the spoken words and outputs each phoneme to the user. The translator maps each phoneme to a haptic code that represents the detected phoneme. After determining the phonemes to output to the user, the system actuates multiple actuators to communicate the code to the user. The actuators contact the user to communicate the code associated with each phoneme of the audio input.

Abstract: A method for automatically delaying playback of a message at a captioning device may include obtaining, at the captioning device, a request to playback of the message. The method may also include, in response to the request, automatically delaying the playback of the message at the captioning device in order to allow the captioning system to receive the audio of the message from a beginning of the playback of the audio of the message.

Abstract: In one embodiment, a computer program product includes a computer readable storage medium having program instructions embodied therewith. The embodied program instructions are executable by a processing circuit to cause the processing circuit to receive collected data from one or more data collection devices. The collected data is aggregated over a period of time lasting at least one month, and the collected data includes audio data of a user of the one or more data collection devices. The embodied program instructions also cause the processing circuit to store the audio data to a computer readable storage medium. Moreover, the embodied program instructions cause the processing circuit to analyze the audio data for indications of hearing loss in the user over the period of time.

Abstract: Methods and arrangements for filtering audio in a noisy environment involving receiving audio input at a user's location, using a plurality of audio input devices in proximity with a user. The audio is then separated into sources in response to a user selection. After the selection is made, the amplitudes of the audio sources are adjusted based on the selection. Other variants and embodiments are broadly contemplated herein.

Abstract: Systems and methods for eyewear devices with integrated heads-up displays are provided. In one embodiment, an eyewear device provides an integrated heads-up display in a display area that is elongate and extends laterally across a user's field of view. A display mechanism forming part of the eyewear device can be configured to display visual information in the form of text messages, with no more than a single laterally extending line of text characters being displayable at any particular time. The display mechanism can comprise a partially reflective element carried by an eyeglass lens to reflect towards the user computer-generated imagery projected on to it, the display mechanism further including a cooperating projector assembly housed by a frame of the eyewear device in an overhead configuration relative to the partially reflective element.

Abstract: Techniques include outputting to a developer an offer to opt-in to a translation feature that enables human translators to translate their web page to a target language. In response to receiving a first request to opt-in to the translation feature, the server: generates and stores a web page copy, obtains from the human translators translations of at least a portion of the web page from its source language to the target language, modifies the web page copy based on the obtained translations to obtain a translated web page that is a translated version of the web page, detects a second request for the web page from a computing device associated with the target language, and in response to detecting the second request outputs, to the computing device, the translated web page with additional content relevant to the computing device or a user associated with the computing device.

Abstract: A 2D and/or 3D video processing device comprising a camera and a display captures images of a viewer as the viewer observes displayed 2D and/or 3D video content in a viewport. Face and/or eye tracking of viewer images is utilized to generate a different viewport. Current and different viewports may comprise 2D and/or 3D video content from a single source or from different sources. The sources of 2D and/or 3D content may be scrolled, zoomed and/or navigated through for generating the different viewport. Content for the different viewport may be processed. Images of a viewer's positions, angles and/or movements of face, facial expression, eyes and/or physical gestures are captured by the camera and interpreted by face and/or eye tracking. The different viewport may be generated for navigating through 3D content and/or for rotating a 3D object. The 2D and/or 3D video processing device communicates via wire, wireless and/or optical interfaces.

Abstract: Vision-assist systems including user eye tracking cameras are disclosed. A vision-assist system includes a processor, a memory module communicatively coupled to the processor, a user eye tracking camera communicatively coupled to the processor, an environment camera communicatively coupled to the processor, a feedback device communicatively coupled to the processor, and machine readable instructions stored in the memory module that, when executed by the processor, cause the vision-assist system to receive environment image data from the environment camera, determine a location of an individual speaking to a user based on the environment image data, receive user eye tracking image data from the user eye tracking camera, determine a pose of the user's eyes based on the user eye tracking image data, and provide feedback to the user with the feedback device based on the location of the individual speaking to the user and the pose of the user's eyes.

Abstract: An electronic device is provided with an activation unit for activating an application wherein character input to a character input area is possible, a memory for storing a predetermined character string corresponding to the application, an operation unit for inputting a first character string and a second character string, a display unit for displaying the first character string and the second character string input from the operation unit, a determination unit for determining whether or not the second character string matches the predetermined character string, and a control unit which, when the determination unit determines that the second character string matches the predetermined character string, functions to control an activation unit to activate an application corresponding to the predetermined character string and functions to input the first character string in the character input area of the application.

Abstract: A method for automatically delaying playback of a voice message at a captioning device may include receiving, at a captioning device, a request from a user to play back a voice message that is stored on the captioning device. The method may also include, in response to the request from the user, automatically delaying the playback of the voice message, at the captioning device, until an establishment of a connection between the captioning device and a remote call assistant, in order to allow the remote call assistant to caption on the captioning device, in real-time, the voice message from the very beginning of the playback of the voice message.

Abstract: A device for stuttering alleviation is disclosed, comprising a speech sensor, configured to output signals indicative of speech, a processing unit configured to detect stuttering, log stuttering and/or produce stimulation indication based on stimulation rules Said device may further comprise a remote server and a server user interface, configured to allow the speech therapist access to the processing unit. Further provided is a method for accelerating the learning procedure for obtaining a permanent fluent speech, comprising receiving and analyzing speech parameters, determining whether a negative reinforcement is required and executing the negative reinforcement.

Abstract: Disclosed are database systems, methods, and computer program products for generating identifiers for user interface elements of a web page of a web application. In some implementations, a server of a database system analyzes a copy of source code for a first web page. The first web page may comprise user interface elements capable of being generated from the source code. The server identifies one or more of the user interface elements of the first web page as not having a unique identifier or as having a dynamically generated identifier. The server generates, for each identified user interface element, a further unique identifier to be associated with the respective identified user interface element. The server generates edited source code comprising one or more further unique identifiers for the identified one or more user interface elements. The server stores the edited source code in a database of the database system.

Abstract: In an aspect, a method of monitoring one or more symptoms of a person include repeating, over a period of time, the steps of: selecting, by the person, one or more symbolic representations corresponding to one or more symptoms from a predefined set of symbolic representations presented to the person; and electronically recording data regarding the one or more symbolic representations selected by the person such that the data is electronically accessible later for generating a history of the symptoms of the person over the period of time. The one or more symbolic representations corresponding to one or more symptoms is selected using an electronic device having a component for displaying the predefined set of symbolic representations that is coupled to a user input for receiving the selection of the one or more symbolic representations by the person.

Abstract: Methods and systems are described for monitoring patient speech to determine compliance of the patient with a prescribed regimen for treating for a brain-related disorder. Patient speech is detected with an audio sensor at the patient location, and speech data is transmitted to a monitoring location. Patient speech is processed at the patient location and/or monitoring location to identify speech parameters and/or patterns that indicate whether the patient has complied with the prescribed treatment regimen. Patient identity may be determined through biometric identification or other authentication techniques. The system may provide a report to an interested party, for example a medical care provider, based on whether (and/or the extent to which) the patient has complied with the prescribed treatment regimen. The monitoring system may transmit a report to a wireless device such as a pager or cell phone, generate an alarm or notification, and/or store information for later use.

Abstract: Methods and systems are described for monitoring patient speech to determine compliance of the patient with a prescribed regimen for treating for a brain-related disorder. Patient speech is detected with an audio sensor at the patient location, and speech data is transmitted to a monitoring location. The audio sensor and other components at the patient location may be incorporated into, or associated with, a cell phone, computing system, or stand-alone microprocessor-based device, for example. Patient speech is processed at the patient location and/or monitoring location to identify speech parameters and/or patterns that indicate whether the patient has complied with the prescribed treatment regimen. Patient identity may be determined through biometric identification or other authentication techniques. The system may provide a report to an interested party, for example a medical care provider, based on whether (and/or the extent to which) the patient has complied with the prescribed treatment regimen.

Abstract: A method to generate a contact list may include receiving an identifier of a first communication device at a captioning system. The first communication device may configured to provide first audio data to a second communication device. The second communication device may be configured to receive first text data of the first audio data from the captioning system. The method may further include receiving and storing contact data from each of multiple communication devices at the captioning system. The method may further include selecting the contact data from the multiple communication devices that include the identifier of the first communication device as selected contact data and generating a contact list based on the selected contact data. The method may also include sending the contact list to the first communication device to provide the contact list as contacts for presentation on an electronic display of the first communication device.

Abstract: Techniques include outputting to a developer an offer to opt-in to a translation feature that enables human translators to translate their web page to a target language. In response to receiving a first request to opt-in to the translation feature, the server: generates and stores a web page copy, obtains from the human translators translations of at least a portion of the web page from its source language to the target language, modifies the web page copy based on the obtained translations to obtain a translated web page that is a translated version of the web page, detects a second request for the web page from a computing device associated with the target language, and in response to detecting the second request outputs, to the computing device, the translated web page with additional content relevant to the computing device or a user associated with the computing device.

Abstract: Methods and devices are described for allowing users to use portable computer devices such as smart phones to share microphone signals and/or closed captioning text generated by speech recognition processing of the microphone signals. Under user direction, the portable devices exchange messages to form a signal sharing group to facilitate their conversation.

Abstract: Apparatuses and methods are disclosed for providing captioning of a video communication session for a conversation between at least two users in which media data is communicated between at least two communication devices during a video communication session involving a video captioning service. The video captioning service provides text captions for the far-end audio of the video communication session, in which the user of the second communication device is associated with a hearing-capable user that is not authorized to receive text captions from the video communication service during the video communication session.