Abstract: An electronic walking assistance device, has a cane portion, having surfaces for holding against arms and/or hands of a user; and an electromotive device, which automatically creates motion to follow a movement of the user, enabling walking assistance without lifting the handle portion or the electromotive device off the ground.

Abstract: An image of a real-world environment including one or more users, is received from an image capture device. A mask status of a first user of is determined by a processor based on the image. A stream of audio including speech from one or more users is captured from one or more audio transceivers. A first user speech from the stream of audio identified by the processor. The stream of audio is parsed, by the processor and based on the first user speech and based on an audio processing technique, to create a first user speech element. An augmented view that includes the first user speech element is generated, for a wearable computing device, based on the first user speech and based on the mask status.

Abstract: An information processing apparatus includes circuitry. The circuitry estimates an intention indicated in first nonverbal information, which is nonverbal information of a first user, based on a feature amount of the first nonverbal information and a nonverbal expression model indicating a relation between the first nonverbal information and an intention. The circuitry converts the first nonverbal information into second nonverbal information to be output to a second user based on the estimated intention and a set conversion rule of the nonverbal information.

Abstract: A control device including a control section configured to cause a sound output section to output sound in a case where it is determined that an operation is performed on an input section by a target object coming into contact with a contact region, the input section having the contact region touched by the target object, wherein the control section adjusts a loudness peak as a control parameter for performing control in such a manner that the sound output section outputs the sound, the loudness peak being a maximum value of loudness indicating intensity of the sound.

Abstract: Techniques for receiving a voice command from a user and, in response, providing audible content to the user via a first device and providing visual content for the user via a second device. In some instances, the first device includes a microphone for generating audio signals that include user speech, as well as a speaker for outputting audible content in response to identified voice commands from the speech. However, the first device might not include a display for displaying graphical content. As such, the first device may be configured to identify devices that include displays and that are proximate to the first device. The first device may then instruct one or more of these other devices to output visual content associated with a user's voice command.

Abstract: A nonverbal information generation apparatus includes a nonverbal information generation unit that generates time-information-stamped nonverbal information that corresponds to time-information-stamped text feature quantities on the basis of the time-information-stamped text feature quantities and a learned nonverbal information generation model. The time-information-stamped text feature quantities are configured to include feature quantities that have been extracted from text and time information representing times assigned to predetermined units of the text. The nonverbal information is information for controlling an expression unit that expresses behavior that corresponds to the text.

Abstract: At least one exemplary embodiment is directed to a method of determining hearing loss using audio cues whose spectrum is orthogonal to each other to identify a wearer's hearing loss, and using the information to adjust audio to normal listening levels.

Abstract: A computer-implemented method for avatar rendering of virtual presentations is disclosed. The computer-implemented method includes extracting visual content from a presentation. The computer-implemented method further includes extracting audio content from the presentation. The computer-implemented method includes correlating the visual content with the audio content of the presentation. The computer-implemented method includes generating a virtual avatar to dynamically render a virtual presentation to a viewer, based at least in part, on the correlated visual content and audio content of the presentation.

Abstract: According to an embodiment, an image processing apparatus includes: a character recognition processor which reads an image of a document and extracts text information in the document; a setting manager which manages settings including a setting to allow or prohibit a function of character recognition; a job controller which controls job execution related to reading of the document; and an operation controller which provides a setting menu to receive a setting of at least one item related to the job execution and receives a setting, in which when the function of the character recognition is set to be prohibited, the operation controller hides a function that requires the character recognition from the setting menu or indicates that the function is not to be set, and when the function that requires the character recognition has already been set, the operation controller enables the function to be replaced by another function.

Abstract: Video relay services, communication systems, non-transitory machine-readable storage media, and methods are disclosed herein. A video relay service may include at least one server configured to receive a video stream including sign language content from a video communication device during a real-time communication session. The server may also be configured to automatically translate the sign language content into a verbal language translation during the real-time communication session without assistance of a human sign language interpreter. Further, the server may be configured to transmit the verbal language translation during the real-time communication session.

Abstract: Provided are an AR display method, an AR display apparatus and an AR display device, the device including: a display assembly used for displaying a virtual content, an optical assembly, and a micro mirror array coupled to the optical assembly; the micro mirror array is located on a propagation path of light emitted from the display assembly.

Abstract: The glasses with display may include a bridge, two temples hingedly coupled to the bridge, and a directional microphone array, the directional microphone array including two or more microphones positioned on the bridge or the temples. The glasses with display may also include a user microphone array, the user microphone array including one or more microphones positioned on the temples and oriented toward the mouth of a user wearing the glasses with display or one or more bone conduction microphones. In addition, the glasses with display include two lenses positioned in the bridge, at least one of the lenses including a display, the display visible by the user, the display including one or more of a directional display, closed caption display, and user volume display. The glasses with display additionally include a processor adapted to receive audio signals from the directional microphone array and the user microphone array, or from a separate mobile device, the processor adapted to control the display.

Abstract: Computer-implemented method of browsing a resource through voice interaction comprising the following steps: A. acquiring (100) from a user a request aimed at browsing a resource; B. downloading (130) the requested resource; C. performing a syntactic parsing (135) of the downloaded resource; D. extracting (150) from the downloaded resource one or more lists, if any, of selectable shortcuts pointing to portions inside or outside the downloaded resource through a syntactic analysis and/or a semantic analysis and/or a morphological-visual analysis of extraction of lists of selectable shortcuts on the basis of an ontology (245) corresponding to the type of resource; E. on the basis of the ontology (245) corresponding to the type of resource, building (225) a list of one or more lists of selectable shortcuts extracted in step D ordered according to a list prioritisation; F.

Abstract: A method, an apparatus, and a system for speech recognition are provided. a third-party application corresponding to a speech signal of a user can be determined according to the speech signal and by means of semantic analysis; and third-party application registry information is searched for and a third-party program is started, so that the user does not need to tap the third-party application to start the corresponding program, thereby providing more intelligent service for the user and facilitating use for the user.

Abstract: A method for improving reading proficiency in persons in need of improvement. The method includes the steps of providing a body of digital text on an electronic device; extracting a selected portion of digital text from the body of digital text; analyzing the selected portion by natural language processing to produce a phonetical font, the phonetical font including a representation of a letter that when heard or said voices a phoneme of the letter; rendering the analyzed selected portion into the phonetical font; and utilizing the phonetical font to increase reading proficiency.

Abstract: A method for adjusting a hearing device (12) adapted to be worn behind an ear (28) comprises: determining a cymba angle (54) between a cartilage (50) above the cymba (46) of the ear (28) and a viewing direction (38) of the user; estimating a tilt angle (39) of the hearing device (12) with respect to the viewing direction (38) from the cymba angle (54); and adjusting a beam former direction (37) of a beam former (34) of the hearing device (12), such that the beam former direction (37) is aligned with the viewing direction (38).

Abstract: A semantic recognition method and a semantic recognition device are provided. A spectrogram of a speech signal is generated. At least one keyword of the spectrogram is detected by inputting the spectrogram into a neural network model. A semantic category to which each of the at least one keyword belongs is distinguished. A semantic intention of the speech signal is determined according to the at least one keyword and the semantic category of the at least one keyword.

Abstract: Systems and methods for eyewear devices with integrated heads-up displays are provided. In one embodiment, an eyewear device provides an integrated heads-up display having a partially reflective element carried by an eyeglass lens to reflect towards the user computer-generated imagery projected on to it, while permitting the passage of light through the reflective surface in the direction of view of the user. The display mechanism further includes a cooperating projector assembly housed by a frame of the eyewear device in an overhead configuration relative to the partially reflective element. The projector assembly is housed by a top bar of the eyewear frame, with the reflective surface being housed wholly within the lens.

Abstract: This invention is augmented reality eyewear with a radial, honeycomb, or nested-ring array of selectively-movable reflective elements. These reflective elements can each be moved from a first configuration which is parallel to a line of sight from an eye to a second configuration which is perpendicular to this line of sight. The second configuration reflects light displaying a virtual image to the eye and blocks environmental light in the area of the virtual image. Since light from the environment does not shine through the virtual object, the virtual object appears solid instead of “ghost like.

Abstract: This invention relates to an Extended Perception System that extends the perception of an object's surroundings. Three closely related primary sets of embodiments of this invention include: one set of embodiments is mounted on a set of one or more vehicles; a second set of embodiments is worn by a set of one or more persons and/or animals; and a third set of embodiments which can be in a location fixed with respect to terrestrial and/or other features. Improvements to head-mounted displays are disclosed.

Abstract: System and method for analyzing audio data are provided. Audio data captured by one or more audio sensors included in a wearable apparatus from an environment of a wearer of the wearable apparatus may be obtained. The audio data may be analyzed to detect a repetition in the audio data, the repetition may comprise a first occurrence of a repeated element followed by one or more successive occurrences of the repeated element. The audio data may be analyzed to determine whether the repetition is meaningful. The audio data may be analyzed to determine which of the one or more successive occurrences of the repeated element were produced by the wearer. A feedback may be provided to a user when the repetition is meaningless and all of the one or more successive occurrences of the repeated element were produced by the wearer.

Abstract: According to one or more examples of the present disclosure there is provided a fluency aid comprising: an altered auditory feedback, AAF, generator operable to receive an input signal derived from speech of a user and to apply a predefined variation to the input signal in order to generate a feedback signal for providing altered auditory feedback to the user, wherein the AAF generator is further operable to automatically change a property of the variation that is applied to the input signal.

Abstract: A telephone system is described herein, wherein the telephone system is configured to assist a hearing-impaired person with telephone communications as well as face-to-face conversations. In telephone communication sessions, the telephone system is configured to audibly emit spoken utterances while simultaneously depicting a transcription of the spoken utterances on a display. When the telephone system is not employed in a telephone communication session, the telephone system is configured to display transcriptions of spoken utterances of people who are in proximity to the telephone system.

Abstract: Approaches presented herein enable displaying a virtual image in a real-world or virtual-world environment. More specifically, a virtual image is transmitted, via a virtual image projection component, through a substantially transparent medium onto a set of pinpoint mirrors in contact with the medium. The virtual image is transmitted, via the set of pinpoint mirrors, through the medium onto a set of optical elements that widens a field of view of the virtual image. A view of the virtual image transposed on a real-world or a virtual reality image is provided, via the set of optical elements, to a user looking through the medium. The light forming the virtual image is perceived by the human eye, but, because each pinpoint mirror of the set is smaller than the pupil of the human eye, none of the set of pinpoint mirrors is perceivable by the human eye due to their size.

Abstract: A method and an apparatus for image recognition based on a retina prosthesis. The method includes: recognizing meaning of an image captured; and converting the meaning of the image into a corresponding meaning prompt signal and transmitting the meaning prompt signal to a corresponding retina prosthesis electrode in connection with a retina. The method can effectively improve the problem that the existing retina prosthesis cannot recognize colors or complex scenes, enhance the recognition function of the retina prosthesis, and improve the quality of life of blind patients.

Abstract: Various implementations include approaches for demonstrating device capabilities in a wearable audio device. In certain cases, these approaches include initiating a demonstration using the wearable audio device to provide the user with an example of the device capabilities. In particular aspects, the wearable audio device is configured to apply acoustic demonstration settings at the wearable audio device based upon the demonstration mode, and output an acoustic signal for playback at the wearable audio device.

Abstract: A wearable device providing an augmented reality experience for the benefit of hearing impaired persons is disclosed. The augmented reality experience displays a virtual text caption box that includes text that has been translated from speech detected from surrounding speakers.

Abstract: A hearing assistive system includes a personal communication device and a head-worn device. The personal communication device has a user interface for user interaction, a processor controlling the user interface and for running an application program, and input and output transducers. The head-worn device has an input transducer adapted for converting sound into an electric signal applied to a processor outputting a modified audio signal via an output transducer. The application program generates a data packet modulated on an audio carrier for output via the output transducer, decodes a data packet modulated on an audio carrier and received via the input transducer. The head-worn device has an audio signaling block having a detector block and a response block. The detector block detects and decodes the data packet received by the input transducer. The response block generates a data packet modulated on an audio carrier for output via the output transducer.

Abstract: A method of forecasting subjective efficacy of a hearing prosthesis implanted in a recipient, including subjecting a recipient to a plurality of temporally spaced aural training tasks, the aural training tasks evoking hearing percepts with the hearing prosthesis, obtaining first data indicative of the recipient's ability to hear with the hearing prosthesis based on performance by the recipient of the temporally spaced aural training tasks, and forecasting second data based on the first data, wherein the second data are indicative of the recipient's ability to hear with the hearing prosthesis at one or more temporal locations in the future.

Abstract: A wearable device for binaural audio is described. The wearable device includes a feedback mechanism, a microphone, an always on binaural recorder (AOBR), and a processor. The AOBR is to capture ambient noise via the microphone and interpret the ambient noise. An alert is issued by the processor to the feedback mechanism based on a notification detected via the microphone in the ambient noise.

Abstract: The present disclosure relates to a fluency aid comprising: a first microphone; a second microphone; and an altered auditory feedback, AAF, generator operable to receive a first input signal derived from sound detected by the first microphone and to generate a feedback signal for providing altered auditory feedback to a user of the fluency aid; wherein the fluency aid is configured such that a second input signal derived from sound detected by the second microphone bypasses the AAF generator.

Abstract: Systems and methods for eyewear devices with integrated heads-up displays are provided. In one embodiment, an eyewear device provides an integrated heads-up display having a partially reflective element carried by an eyeglass lens to reflect towards the user computer-generated imagery projected on to it, while permitting the passage of light through the reflective surface in the direction of view of the user. The display mechanism further includes a cooperating projector assembly housed by a frame of the eyewear device in an overhead configuration relative to the partially reflective element. The projector assembly is housed by a top bar of the eyewear frame, with the reflective surface being housed wholly within the lens.

Abstract: A wearable device for binaural audio is described. The wearable device includes a feedback mechanism, a microphone, an always on binaural recorder (AOBR), and a processor. The AOBR is to capture ambient noise via the microphone and interpret the ambient noise. An alert is issued by the processor to the feedback mechanism based on a notification detected via the microphone in the ambient noise.

Abstract: There is provided a method of operating a hearing device (10, 11) to be worn by a user, comprising: defining a plurality of hearing device services and assigning to each hearing device service a service access confirmation level selected from a plurality of hierarchically structured service access confirmation levels; providing an access software platform for enabling third party service access to the hearing device services; providing at least one application program adapted to provide a third party service to the hearing device, each application program adapted to utilize the access software platform and at least one of the hearing device services; providing a manufacturer access service for approving or denying access to the hearing device for each of the application programs depending on whether or not approval for the respective service access confirmation level(s) has been previously obtained.

Abstract: An Environmental Navigation Aid is provided, and can be a rechargeable, portable, handheld device that can convert environmental information, such as distance to a target object, into tactile values for presentation to a user's palm or fingers by way of a tactile feedback wheel. The nature of the target object composition can be factored into the behavior of the feedback wheel. The Environmental Navigation Aid can be paired with a wireless charging dock that can also serve as a homing beacon when the handheld device is pointed at the changing dock. Stand-alone homing beacons for additional orientation referencing tasks can be added to an Environmental Navigation Aid as a system. The Environmental Navigation Aid is designed to assist the blind in perception of the world around them.

Abstract: According to an embodiment, a voice processing device includes a receiver, a separator, and an output controller. The receiver is configured to receive n input signals input into n voice input devices respectively corresponding to n sound sources, where n is an integer of 2 or more. The separator is configured to separate the input signals by the sound sources to produce n separation signals. The output controller is configured to, according to the number of sound sources having uttered voice sounds, switch between an output signal produced based on the input signal and an output signal produced based on the separation signal, and output the output signal.

Abstract: In one aspect, a device includes a processor, at least one camera accessible to the processor, and memory accessible to the processor. The memory bears instructions executable by the processor to identify, at least in part based on input from the at least one camera, a source of sound. The instructions are also executable to, based at toast in part on input from at least one microphone, execute beamforming and provide audio at a hearing aid comprising sound from the source.

Abstract: Systems for providing network-based communication services are provided, such systems comprising a platform configured to facilitate interaction between users requesting interpretation/translation services and individuals capable of fulfilling such requests. Both the content submitted through the system for interpretation/translation and the resulting interpretation/translation may be prerecorded, which facilitates the accuracy of the end-product. Methods for facilitating communication services over a network are also provided, such methods comprising the steps of receiving a request for interpretation/translation, receiving acceptance of the request from an interpreter/translator, receiving a response that corresponds with an interpretation/translation of the content, and making the response available to one or more users via a server.

Abstract: The translator detects audio with the use of at least one microphone. The system analyzes the audio input to determine the spoken words. The translator determines the phonemes of the spoken words and outputs each phoneme to the user. The translator maps each phoneme to a haptic code that represents the detected phoneme. After determining the phonemes to output to the user, the system actuates multiple actuators to communicate the code to the user. The actuators contact the user to communicate the code associated with each phoneme of the audio input.

Abstract: A method for automatically delaying playback of a message at a captioning device may include obtaining, at the captioning device, a request to playback of the message. The method may also include, in response to the request, automatically delaying the playback of the message at the captioning device in order to allow the captioning system to receive the audio of the message from a beginning of the playback of the audio of the message.

Abstract: In one embodiment, a computer program product includes a computer readable storage medium having program instructions embodied therewith. The embodied program instructions are executable by a processing circuit to cause the processing circuit to receive collected data from one or more data collection devices. The collected data is aggregated over a period of time lasting at least one month, and the collected data includes audio data of a user of the one or more data collection devices. The embodied program instructions also cause the processing circuit to store the audio data to a computer readable storage medium. Moreover, the embodied program instructions cause the processing circuit to analyze the audio data for indications of hearing loss in the user over the period of time.

Abstract: Methods and arrangements for filtering audio in a noisy environment involving receiving audio input at a user's location, using a plurality of audio input devices in proximity with a user. The audio is then separated into sources in response to a user selection. After the selection is made, the amplitudes of the audio sources are adjusted based on the selection. Other variants and embodiments are broadly contemplated herein.

Abstract: Systems and methods for eyewear devices with integrated heads-up displays are provided. In one embodiment, an eyewear device provides an integrated heads-up display in a display area that is elongate and extends laterally across a user's field of view. A display mechanism forming part of the eyewear device can be configured to display visual information in the form of text messages, with no more than a single laterally extending line of text characters being displayable at any particular time. The display mechanism can comprise a partially reflective element carried by an eyeglass lens to reflect towards the user computer-generated imagery projected on to it, the display mechanism further including a cooperating projector assembly housed by a frame of the eyewear device in an overhead configuration relative to the partially reflective element.

Abstract: Techniques include outputting to a developer an offer to opt-in to a translation feature that enables human translators to translate their web page to a target language. In response to receiving a first request to opt-in to the translation feature, the server: generates and stores a web page copy, obtains from the human translators translations of at least a portion of the web page from its source language to the target language, modifies the web page copy based on the obtained translations to obtain a translated web page that is a translated version of the web page, detects a second request for the web page from a computing device associated with the target language, and in response to detecting the second request outputs, to the computing device, the translated web page with additional content relevant to the computing device or a user associated with the computing device.

Abstract: A 2D and/or 3D video processing device comprising a camera and a display captures images of a viewer as the viewer observes displayed 2D and/or 3D video content in a viewport. Face and/or eye tracking of viewer images is utilized to generate a different viewport. Current and different viewports may comprise 2D and/or 3D video content from a single source or from different sources. The sources of 2D and/or 3D content may be scrolled, zoomed and/or navigated through for generating the different viewport. Content for the different viewport may be processed. Images of a viewer's positions, angles and/or movements of face, facial expression, eyes and/or physical gestures are captured by the camera and interpreted by face and/or eye tracking. The different viewport may be generated for navigating through 3D content and/or for rotating a 3D object. The 2D and/or 3D video processing device communicates via wire, wireless and/or optical interfaces.

Abstract: Vision-assist systems including user eye tracking cameras are disclosed. A vision-assist system includes a processor, a memory module communicatively coupled to the processor, a user eye tracking camera communicatively coupled to the processor, an environment camera communicatively coupled to the processor, a feedback device communicatively coupled to the processor, and machine readable instructions stored in the memory module that, when executed by the processor, cause the vision-assist system to receive environment image data from the environment camera, determine a location of an individual speaking to a user based on the environment image data, receive user eye tracking image data from the user eye tracking camera, determine a pose of the user's eyes based on the user eye tracking image data, and provide feedback to the user with the feedback device based on the location of the individual speaking to the user and the pose of the user's eyes.

Abstract: An electronic device is provided with an activation unit for activating an application wherein character input to a character input area is possible, a memory for storing a predetermined character string corresponding to the application, an operation unit for inputting a first character string and a second character string, a display unit for displaying the first character string and the second character string input from the operation unit, a determination unit for determining whether or not the second character string matches the predetermined character string, and a control unit which, when the determination unit determines that the second character string matches the predetermined character string, functions to control an activation unit to activate an application corresponding to the predetermined character string and functions to input the first character string in the character input area of the application.

Abstract: A method for automatically delaying playback of a voice message at a captioning device may include receiving, at a captioning device, a request from a user to play back a voice message that is stored on the captioning device. The method may also include, in response to the request from the user, automatically delaying the playback of the voice message, at the captioning device, until an establishment of a connection between the captioning device and a remote call assistant, in order to allow the remote call assistant to caption on the captioning device, in real-time, the voice message from the very beginning of the playback of the voice message.

Abstract: A device for stuttering alleviation is disclosed, comprising a speech sensor, configured to output signals indicative of speech, a processing unit configured to detect stuttering, log stuttering and/or produce stimulation indication based on stimulation rules Said device may further comprise a remote server and a server user interface, configured to allow the speech therapist access to the processing unit. Further provided is a method for accelerating the learning procedure for obtaining a permanent fluent speech, comprising receiving and analyzing speech parameters, determining whether a negative reinforcement is required and executing the negative reinforcement.

Abstract: Disclosed are database systems, methods, and computer program products for generating identifiers for user interface elements of a web page of a web application. In some implementations, a server of a database system analyzes a copy of source code for a first web page. The first web page may comprise user interface elements capable of being generated from the source code. The server identifies one or more of the user interface elements of the first web page as not having a unique identifier or as having a dynamically generated identifier. The server generates, for each identified user interface element, a further unique identifier to be associated with the respective identified user interface element. The server generates edited source code comprising one or more further unique identifiers for the identified one or more user interface elements. The server stores the edited source code in a database of the database system.