Abstract: The digital restaurant menu with touch screen comprises an electronic tablet, a plurality of operator controls, one or more wireless communication circuits, one or more speakers, and a microphone. The electronic tablet may be adapted for use in a restaurant and may present one or more menus to a user via a display screen and/or audibly via the one or more speakers. The electronic tablet may be adapted for use by a visually-impaired user. The one or more menus may be navigated using the plurality of operator controls, a touch sensitive overlay, voice commands spoken into the microphone, or combinations thereof. The plurality of operator controls may comprise braille relief. The electronic tablet may be operable to communicate with one or more external devices via the one or more wireless communication circuits.

Abstract: A nonverbal information generation apparatus includes a display unit that partitions text into predetermined units, displays the text partitioned into the predetermined units, and makes nonverbal information that represents information about behavior of a verbal output agent or nonverbal information that represents information about behavior of a receiver of verbal information of the verbal output agent that corresponds to the text when the verbal output agent outputs the verbal information visible in association with the predetermined units of the text.

Abstract: A voice recognition device 10 includes: a phonological awareness feature amount extraction unit 11 that transforms an acoustic feature amount sequence of input voice into a phonological awareness feature amount sequence for the language 1 using a first model parameter group; a phonological awareness feature amount extraction unit 12 that transforms the acoustic feature amount sequence of the input voice into a phonological awareness feature amount sequence for the language 2 using a second model parameter group; a phonological recognition unit 13 that generates a posterior probability sequence from the acoustic feature amount sequence of the input voice, the phonological awareness feature amount sequence for the language 1, and the phonological awareness feature amount sequence for the language 2 using a third model parameter group; and a voice text transformation unit 14 that performs voice recognition based on the posterior probability sequence to output text of a voice recognition result.

Abstract: Systems, methods, and non-transitory computer readable media including instructions for determining and interpreting facial skin micromovements are disclosed. Determining facial skin micromovements includes controlling at least one coherent light source for projecting a plurality of light spots on a facial region of an individual, wherein the plurality of light spots includes at least a first light spot and a second light spot spaced from the first light spot. Reflected light from the first light spot is analyzed to determine changes in first spot reflections. Reflected light from the second light spot is analyzed to determine changes in second spot reflections. Based on the determined changes in the first spot reflections and the second spot reflections, the facial skin micromovements are determined. The facial skin micromovements derived from analyzing the first spot reflections and analyzing the second spot reflections are interpreted. An output of the interpretation is generated.

Abstract: Methods and system for providing digital audio mapping are provided wherein data representing real or virtual worlds is obtained from internal or external data sources and used to generate a digital auditory map that can be navigated using auditory sound cues. The digital audio map can be created by a digital audio map generator and presented to the user through a digital audio map presentation interface. The digital audio map presentation interface can provide multiple navigation modes to the user, including a tree-based mode, a grid-based mode, and a first-person-based mode. The user is able to dynamically select the preferred navigation mode.

Abstract: An electronic walking assistance device, has a cane portion, having surfaces for holding against arms and/or hands of a user; and an electromotive device, which automatically creates motion to follow a movement of the user, enabling walking assistance without lifting the handle portion or the electromotive device off the ground.

Abstract: An image of a real-world environment including one or more users, is received from an image capture device. A mask status of a first user of is determined by a processor based on the image. A stream of audio including speech from one or more users is captured from one or more audio transceivers. A first user speech from the stream of audio identified by the processor. The stream of audio is parsed, by the processor and based on the first user speech and based on an audio processing technique, to create a first user speech element. An augmented view that includes the first user speech element is generated, for a wearable computing device, based on the first user speech and based on the mask status.

Abstract: An information processing apparatus includes circuitry. The circuitry estimates an intention indicated in first nonverbal information, which is nonverbal information of a first user, based on a feature amount of the first nonverbal information and a nonverbal expression model indicating a relation between the first nonverbal information and an intention. The circuitry converts the first nonverbal information into second nonverbal information to be output to a second user based on the estimated intention and a set conversion rule of the nonverbal information.

Abstract: A control device including a control section configured to cause a sound output section to output sound in a case where it is determined that an operation is performed on an input section by a target object coming into contact with a contact region, the input section having the contact region touched by the target object, wherein the control section adjusts a loudness peak as a control parameter for performing control in such a manner that the sound output section outputs the sound, the loudness peak being a maximum value of loudness indicating intensity of the sound.

Abstract: Techniques for receiving a voice command from a user and, in response, providing audible content to the user via a first device and providing visual content for the user via a second device. In some instances, the first device includes a microphone for generating audio signals that include user speech, as well as a speaker for outputting audible content in response to identified voice commands from the speech. However, the first device might not include a display for displaying graphical content. As such, the first device may be configured to identify devices that include displays and that are proximate to the first device. The first device may then instruct one or more of these other devices to output visual content associated with a user's voice command.

Abstract: A nonverbal information generation apparatus includes a nonverbal information generation unit that generates time-information-stamped nonverbal information that corresponds to time-information-stamped text feature quantities on the basis of the time-information-stamped text feature quantities and a learned nonverbal information generation model. The time-information-stamped text feature quantities are configured to include feature quantities that have been extracted from text and time information representing times assigned to predetermined units of the text. The nonverbal information is information for controlling an expression unit that expresses behavior that corresponds to the text.

Abstract: At least one exemplary embodiment is directed to a method of determining hearing loss using audio cues whose spectrum is orthogonal to each other to identify a wearer's hearing loss, and using the information to adjust audio to normal listening levels.

Abstract: A computer-implemented method for avatar rendering of virtual presentations is disclosed. The computer-implemented method includes extracting visual content from a presentation. The computer-implemented method further includes extracting audio content from the presentation. The computer-implemented method includes correlating the visual content with the audio content of the presentation. The computer-implemented method includes generating a virtual avatar to dynamically render a virtual presentation to a viewer, based at least in part, on the correlated visual content and audio content of the presentation.

Abstract: According to an embodiment, an image processing apparatus includes: a character recognition processor which reads an image of a document and extracts text information in the document; a setting manager which manages settings including a setting to allow or prohibit a function of character recognition; a job controller which controls job execution related to reading of the document; and an operation controller which provides a setting menu to receive a setting of at least one item related to the job execution and receives a setting, in which when the function of the character recognition is set to be prohibited, the operation controller hides a function that requires the character recognition from the setting menu or indicates that the function is not to be set, and when the function that requires the character recognition has already been set, the operation controller enables the function to be replaced by another function.

Abstract: Video relay services, communication systems, non-transitory machine-readable storage media, and methods are disclosed herein. A video relay service may include at least one server configured to receive a video stream including sign language content from a video communication device during a real-time communication session. The server may also be configured to automatically translate the sign language content into a verbal language translation during the real-time communication session without assistance of a human sign language interpreter. Further, the server may be configured to transmit the verbal language translation during the real-time communication session.

Abstract: Provided are an AR display method, an AR display apparatus and an AR display device, the device including: a display assembly used for displaying a virtual content, an optical assembly, and a micro mirror array coupled to the optical assembly; the micro mirror array is located on a propagation path of light emitted from the display assembly.

Abstract: The glasses with display may include a bridge, two temples hingedly coupled to the bridge, and a directional microphone array, the directional microphone array including two or more microphones positioned on the bridge or the temples. The glasses with display may also include a user microphone array, the user microphone array including one or more microphones positioned on the temples and oriented toward the mouth of a user wearing the glasses with display or one or more bone conduction microphones. In addition, the glasses with display include two lenses positioned in the bridge, at least one of the lenses including a display, the display visible by the user, the display including one or more of a directional display, closed caption display, and user volume display. The glasses with display additionally include a processor adapted to receive audio signals from the directional microphone array and the user microphone array, or from a separate mobile device, the processor adapted to control the display.

Abstract: Computer-implemented method of browsing a resource through voice interaction comprising the following steps: A. acquiring (100) from a user a request aimed at browsing a resource; B. downloading (130) the requested resource; C. performing a syntactic parsing (135) of the downloaded resource; D. extracting (150) from the downloaded resource one or more lists, if any, of selectable shortcuts pointing to portions inside or outside the downloaded resource through a syntactic analysis and/or a semantic analysis and/or a morphological-visual analysis of extraction of lists of selectable shortcuts on the basis of an ontology (245) corresponding to the type of resource; E. on the basis of the ontology (245) corresponding to the type of resource, building (225) a list of one or more lists of selectable shortcuts extracted in step D ordered according to a list prioritisation; F.

Abstract: A method, an apparatus, and a system for speech recognition are provided. a third-party application corresponding to a speech signal of a user can be determined according to the speech signal and by means of semantic analysis; and third-party application registry information is searched for and a third-party program is started, so that the user does not need to tap the third-party application to start the corresponding program, thereby providing more intelligent service for the user and facilitating use for the user.

Abstract: A method for improving reading proficiency in persons in need of improvement. The method includes the steps of providing a body of digital text on an electronic device; extracting a selected portion of digital text from the body of digital text; analyzing the selected portion by natural language processing to produce a phonetical font, the phonetical font including a representation of a letter that when heard or said voices a phoneme of the letter; rendering the analyzed selected portion into the phonetical font; and utilizing the phonetical font to increase reading proficiency.

Abstract: A method for adjusting a hearing device (12) adapted to be worn behind an ear (28) comprises: determining a cymba angle (54) between a cartilage (50) above the cymba (46) of the ear (28) and a viewing direction (38) of the user; estimating a tilt angle (39) of the hearing device (12) with respect to the viewing direction (38) from the cymba angle (54); and adjusting a beam former direction (37) of a beam former (34) of the hearing device (12), such that the beam former direction (37) is aligned with the viewing direction (38).

Abstract: A semantic recognition method and a semantic recognition device are provided. A spectrogram of a speech signal is generated. At least one keyword of the spectrogram is detected by inputting the spectrogram into a neural network model. A semantic category to which each of the at least one keyword belongs is distinguished. A semantic intention of the speech signal is determined according to the at least one keyword and the semantic category of the at least one keyword.

Abstract: Systems and methods for eyewear devices with integrated heads-up displays are provided. In one embodiment, an eyewear device provides an integrated heads-up display having a partially reflective element carried by an eyeglass lens to reflect towards the user computer-generated imagery projected on to it, while permitting the passage of light through the reflective surface in the direction of view of the user. The display mechanism further includes a cooperating projector assembly housed by a frame of the eyewear device in an overhead configuration relative to the partially reflective element. The projector assembly is housed by a top bar of the eyewear frame, with the reflective surface being housed wholly within the lens.

Abstract: This invention is augmented reality eyewear with a radial, honeycomb, or nested-ring array of selectively-movable reflective elements. These reflective elements can each be moved from a first configuration which is parallel to a line of sight from an eye to a second configuration which is perpendicular to this line of sight. The second configuration reflects light displaying a virtual image to the eye and blocks environmental light in the area of the virtual image. Since light from the environment does not shine through the virtual object, the virtual object appears solid instead of “ghost like.

Abstract: This invention relates to an Extended Perception System that extends the perception of an object's surroundings. Three closely related primary sets of embodiments of this invention include: one set of embodiments is mounted on a set of one or more vehicles; a second set of embodiments is worn by a set of one or more persons and/or animals; and a third set of embodiments which can be in a location fixed with respect to terrestrial and/or other features. Improvements to head-mounted displays are disclosed.

Abstract: System and method for analyzing audio data are provided. Audio data captured by one or more audio sensors included in a wearable apparatus from an environment of a wearer of the wearable apparatus may be obtained. The audio data may be analyzed to detect a repetition in the audio data, the repetition may comprise a first occurrence of a repeated element followed by one or more successive occurrences of the repeated element. The audio data may be analyzed to determine whether the repetition is meaningful. The audio data may be analyzed to determine which of the one or more successive occurrences of the repeated element were produced by the wearer. A feedback may be provided to a user when the repetition is meaningless and all of the one or more successive occurrences of the repeated element were produced by the wearer.

Abstract: According to one or more examples of the present disclosure there is provided a fluency aid comprising: an altered auditory feedback, AAF, generator operable to receive an input signal derived from speech of a user and to apply a predefined variation to the input signal in order to generate a feedback signal for providing altered auditory feedback to the user, wherein the AAF generator is further operable to automatically change a property of the variation that is applied to the input signal.

Abstract: Approaches presented herein enable displaying a virtual image in a real-world or virtual-world environment. More specifically, a virtual image is transmitted, via a virtual image projection component, through a substantially transparent medium onto a set of pinpoint mirrors in contact with the medium. The virtual image is transmitted, via the set of pinpoint mirrors, through the medium onto a set of optical elements that widens a field of view of the virtual image. A view of the virtual image transposed on a real-world or a virtual reality image is provided, via the set of optical elements, to a user looking through the medium. The light forming the virtual image is perceived by the human eye, but, because each pinpoint mirror of the set is smaller than the pupil of the human eye, none of the set of pinpoint mirrors is perceivable by the human eye due to their size.

Abstract: A telephone system is described herein, wherein the telephone system is configured to assist a hearing-impaired person with telephone communications as well as face-to-face conversations. In telephone communication sessions, the telephone system is configured to audibly emit spoken utterances while simultaneously depicting a transcription of the spoken utterances on a display. When the telephone system is not employed in a telephone communication session, the telephone system is configured to display transcriptions of spoken utterances of people who are in proximity to the telephone system.

Abstract: A method and an apparatus for image recognition based on a retina prosthesis. The method includes: recognizing meaning of an image captured; and converting the meaning of the image into a corresponding meaning prompt signal and transmitting the meaning prompt signal to a corresponding retina prosthesis electrode in connection with a retina. The method can effectively improve the problem that the existing retina prosthesis cannot recognize colors or complex scenes, enhance the recognition function of the retina prosthesis, and improve the quality of life of blind patients.

Abstract: Various implementations include approaches for demonstrating device capabilities in a wearable audio device. In certain cases, these approaches include initiating a demonstration using the wearable audio device to provide the user with an example of the device capabilities. In particular aspects, the wearable audio device is configured to apply acoustic demonstration settings at the wearable audio device based upon the demonstration mode, and output an acoustic signal for playback at the wearable audio device.

Abstract: A wearable device providing an augmented reality experience for the benefit of hearing impaired persons is disclosed. The augmented reality experience displays a virtual text caption box that includes text that has been translated from speech detected from surrounding speakers.

Abstract: A hearing assistive system includes a personal communication device and a head-worn device. The personal communication device has a user interface for user interaction, a processor controlling the user interface and for running an application program, and input and output transducers. The head-worn device has an input transducer adapted for converting sound into an electric signal applied to a processor outputting a modified audio signal via an output transducer. The application program generates a data packet modulated on an audio carrier for output via the output transducer, decodes a data packet modulated on an audio carrier and received via the input transducer. The head-worn device has an audio signaling block having a detector block and a response block. The detector block detects and decodes the data packet received by the input transducer. The response block generates a data packet modulated on an audio carrier for output via the output transducer.

Abstract: A method of forecasting subjective efficacy of a hearing prosthesis implanted in a recipient, including subjecting a recipient to a plurality of temporally spaced aural training tasks, the aural training tasks evoking hearing percepts with the hearing prosthesis, obtaining first data indicative of the recipient's ability to hear with the hearing prosthesis based on performance by the recipient of the temporally spaced aural training tasks, and forecasting second data based on the first data, wherein the second data are indicative of the recipient's ability to hear with the hearing prosthesis at one or more temporal locations in the future.

Abstract: A wearable device for binaural audio is described. The wearable device includes a feedback mechanism, a microphone, an always on binaural recorder (AOBR), and a processor. The AOBR is to capture ambient noise via the microphone and interpret the ambient noise. An alert is issued by the processor to the feedback mechanism based on a notification detected via the microphone in the ambient noise.

Abstract: The present disclosure relates to a fluency aid comprising: a first microphone; a second microphone; and an altered auditory feedback, AAF, generator operable to receive a first input signal derived from sound detected by the first microphone and to generate a feedback signal for providing altered auditory feedback to a user of the fluency aid; wherein the fluency aid is configured such that a second input signal derived from sound detected by the second microphone bypasses the AAF generator.

Abstract: Systems and methods for eyewear devices with integrated heads-up displays are provided. In one embodiment, an eyewear device provides an integrated heads-up display having a partially reflective element carried by an eyeglass lens to reflect towards the user computer-generated imagery projected on to it, while permitting the passage of light through the reflective surface in the direction of view of the user. The display mechanism further includes a cooperating projector assembly housed by a frame of the eyewear device in an overhead configuration relative to the partially reflective element. The projector assembly is housed by a top bar of the eyewear frame, with the reflective surface being housed wholly within the lens.

Abstract: A wearable device for binaural audio is described. The wearable device includes a feedback mechanism, a microphone, an always on binaural recorder (AOBR), and a processor. The AOBR is to capture ambient noise via the microphone and interpret the ambient noise. An alert is issued by the processor to the feedback mechanism based on a notification detected via the microphone in the ambient noise.

Abstract: There is provided a method of operating a hearing device (10, 11) to be worn by a user, comprising: defining a plurality of hearing device services and assigning to each hearing device service a service access confirmation level selected from a plurality of hierarchically structured service access confirmation levels; providing an access software platform for enabling third party service access to the hearing device services; providing at least one application program adapted to provide a third party service to the hearing device, each application program adapted to utilize the access software platform and at least one of the hearing device services; providing a manufacturer access service for approving or denying access to the hearing device for each of the application programs depending on whether or not approval for the respective service access confirmation level(s) has been previously obtained.

Abstract: An Environmental Navigation Aid is provided, and can be a rechargeable, portable, handheld device that can convert environmental information, such as distance to a target object, into tactile values for presentation to a user's palm or fingers by way of a tactile feedback wheel. The nature of the target object composition can be factored into the behavior of the feedback wheel. The Environmental Navigation Aid can be paired with a wireless charging dock that can also serve as a homing beacon when the handheld device is pointed at the changing dock. Stand-alone homing beacons for additional orientation referencing tasks can be added to an Environmental Navigation Aid as a system. The Environmental Navigation Aid is designed to assist the blind in perception of the world around them.

Abstract: According to an embodiment, a voice processing device includes a receiver, a separator, and an output controller. The receiver is configured to receive n input signals input into n voice input devices respectively corresponding to n sound sources, where n is an integer of 2 or more. The separator is configured to separate the input signals by the sound sources to produce n separation signals. The output controller is configured to, according to the number of sound sources having uttered voice sounds, switch between an output signal produced based on the input signal and an output signal produced based on the separation signal, and output the output signal.

Abstract: In one aspect, a device includes a processor, at least one camera accessible to the processor, and memory accessible to the processor. The memory bears instructions executable by the processor to identify, at least in part based on input from the at least one camera, a source of sound. The instructions are also executable to, based at toast in part on input from at least one microphone, execute beamforming and provide audio at a hearing aid comprising sound from the source.

Abstract: Systems for providing network-based communication services are provided, such systems comprising a platform configured to facilitate interaction between users requesting interpretation/translation services and individuals capable of fulfilling such requests. Both the content submitted through the system for interpretation/translation and the resulting interpretation/translation may be prerecorded, which facilitates the accuracy of the end-product. Methods for facilitating communication services over a network are also provided, such methods comprising the steps of receiving a request for interpretation/translation, receiving acceptance of the request from an interpreter/translator, receiving a response that corresponds with an interpretation/translation of the content, and making the response available to one or more users via a server.

Abstract: The translator detects audio with the use of at least one microphone. The system analyzes the audio input to determine the spoken words. The translator determines the phonemes of the spoken words and outputs each phoneme to the user. The translator maps each phoneme to a haptic code that represents the detected phoneme. After determining the phonemes to output to the user, the system actuates multiple actuators to communicate the code to the user. The actuators contact the user to communicate the code associated with each phoneme of the audio input.

Abstract: A method for automatically delaying playback of a message at a captioning device may include obtaining, at the captioning device, a request to playback of the message. The method may also include, in response to the request, automatically delaying the playback of the message at the captioning device in order to allow the captioning system to receive the audio of the message from a beginning of the playback of the audio of the message.

Abstract: In one embodiment, a computer program product includes a computer readable storage medium having program instructions embodied therewith. The embodied program instructions are executable by a processing circuit to cause the processing circuit to receive collected data from one or more data collection devices. The collected data is aggregated over a period of time lasting at least one month, and the collected data includes audio data of a user of the one or more data collection devices. The embodied program instructions also cause the processing circuit to store the audio data to a computer readable storage medium. Moreover, the embodied program instructions cause the processing circuit to analyze the audio data for indications of hearing loss in the user over the period of time.

Abstract: Methods and arrangements for filtering audio in a noisy environment involving receiving audio input at a user's location, using a plurality of audio input devices in proximity with a user. The audio is then separated into sources in response to a user selection. After the selection is made, the amplitudes of the audio sources are adjusted based on the selection. Other variants and embodiments are broadly contemplated herein.

Abstract: Systems and methods for eyewear devices with integrated heads-up displays are provided. In one embodiment, an eyewear device provides an integrated heads-up display in a display area that is elongate and extends laterally across a user's field of view. A display mechanism forming part of the eyewear device can be configured to display visual information in the form of text messages, with no more than a single laterally extending line of text characters being displayable at any particular time. The display mechanism can comprise a partially reflective element carried by an eyeglass lens to reflect towards the user computer-generated imagery projected on to it, the display mechanism further including a cooperating projector assembly housed by a frame of the eyewear device in an overhead configuration relative to the partially reflective element.

Abstract: Techniques include outputting to a developer an offer to opt-in to a translation feature that enables human translators to translate their web page to a target language. In response to receiving a first request to opt-in to the translation feature, the server: generates and stores a web page copy, obtains from the human translators translations of at least a portion of the web page from its source language to the target language, modifies the web page copy based on the obtained translations to obtain a translated web page that is a translated version of the web page, detects a second request for the web page from a computing device associated with the target language, and in response to detecting the second request outputs, to the computing device, the translated web page with additional content relevant to the computing device or a user associated with the computing device.

Abstract: A 2D and/or 3D video processing device comprising a camera and a display captures images of a viewer as the viewer observes displayed 2D and/or 3D video content in a viewport. Face and/or eye tracking of viewer images is utilized to generate a different viewport. Current and different viewports may comprise 2D and/or 3D video content from a single source or from different sources. The sources of 2D and/or 3D content may be scrolled, zoomed and/or navigated through for generating the different viewport. Content for the different viewport may be processed. Images of a viewer's positions, angles and/or movements of face, facial expression, eyes and/or physical gestures are captured by the camera and interpreted by face and/or eye tracking. The different viewport may be generated for navigating through 3D content and/or for rotating a 3D object. The 2D and/or 3D video processing device communicates via wire, wireless and/or optical interfaces.