Abstract: A system for identifying spoken language in a telecommunications relay service, which includes a call serving entity; and a plurality of automatic speech recognition groups where each of the automatic speech recognition groups includes an associated automatic speech recognition engine that recognizes and transcribes speech to a predefined language. One of the plurality of automatic speech recognition groups is set as a default automatic speech recognition group and automatic speech recognition engines transcribe and convert peer voices into text packets. The text packets are scored by the automatic speech recognition engine and transmitted to the call serving entity to determine whether the text packets meet a predetermined threshold based on their respective scores with the text packet having the highest score that meets or exceeds the predetermine threshold transmitted to a user.

Abstract: A system is provided that includes a first network interface for a first network type and a second network interface for a second network type that is different from the first network type. The system also includes at least one processor configured to cause the system to perform operations. The operations may include obtaining, from the first network interface, audio from a communication session with a remote device established over the first network and obtaining an indication of a communication device available to participate in the communication session and direct audio obtained from the communication session to a remote transcription system. The operations may also include directing the audio to the second network interface for transmission to the communication device, obtaining transcript data from the remote transcription system based on the audio, and directing the transcript data to the second network interface for transmission to the communication device.

Abstract: Methods and systems are provided for providing enhanced incoming call notifications for users who utilized a relay application designed for those with speech, visual, or hearing impairments or disabilities. An indication that a calling party is attempting to initiate an incoming call intended for a receiving party that utilizes a relay application that assists users having hearing, visual, or speech disabilities is received by an intermediate party. A chat session is established utilizing the relay application between the intermediate party and the calling party. Additionally, a Voice over Internet Protocol (VoIP) session is established that does not include a voice session. Upon the chat session being terminated from within the relay application, the VoIP session is terminated.

Abstract: A tool for providing a secure communication channel during three-way communications. The tool initiates a three-way communication from a user device, wherein the three-way communication is a connection between a user, a third-party interpreter, and a service provider. The tool enables a passthrough function of a secured switch for transmitting non-privileged data during the three-way communication. The tool determines whether privileged data is to be transmitted during the three-way communication. Responsive to a determination that privileged data is to be transmitted during the three-way communication, the tool mutes an audio communication component. The tool activates a bypass function of the secured switch for transmitting the privileged data on an alternate audio communication component.

Abstract: Disclosed are systems, devices, and methods for detecting a trachea, an exemplary system comprising an imaging device configured to obtain image data and a computing device configured to generate a three-dimensional (3D) model, identify a potential connected component in a first slice image, identify a potential connected component in a second slice image, label the first slice image as a top slice image, label the connected component in the top slice image as an active object, associate each connected component in a current slice image with a corresponding connected component in a previous slice image based on a connectivity criterion, label each connected component in the current slice image associated with a connected component of the preceding slice image as the active object, and identify the active object as the trachea, based on a length of the active object.

Abstract: The present disclosure provides a method, a browser client, and a server for reading web page information by speech. The browser client is installed with a text to speech (TTS) engine. The method includes: sending, by a browser client, a page access request to a server, where the page access request includes a page address and TTS identity information; receiving, by the browser client, response data returned by the server, where the response data includes a TTS standard version number determined by the server according to the TTS identity information, and TTS page data corresponding to the page address; and reading, by the browser client, the TTS page data by speech according to the TTS standard version number by using a TTS engine. In the present disclosure, page information is read by speech by using the TTS engine installed on the browser client.

Abstract: A method of adapting a display comprises receiving a sequence of a plurality of facial images of a face of at least one user located in front of a display; analyzing the plurality of facial images to detect a hand to face gesture of the user; and updating, according to the hand to face gesture, a dataset documenting a plurality of facial touch event frequencies of a plurality of facial touch events in a plurality of facial locations. Each of the plurality of facial touch events is prompted by one of a plurality of previously captured hand to face gestures of the user. The method further comprises, based on the plurality of facial touch event frequencies, generating a presentation on the display. In response to detection of an impending facial touch, a destruction event may be depicted. A presentation may be also generated showing scoring of multiple persons.

Abstract: A system and method for use with an assisted user's communication device that includes a display. The method includes providing a user communication device including a processor that is programmed to perform the step of, upon disconnection of an emergency call to a hearing user in which a captioning service has provided text transcription of voice messages from the hearing user, maintaining a link to the captioning service for a predetermined period of time. The processor also is programmed to perform the step of recognizing the call as an emergency call upon placement of the call, and the captioning service is automatically initiated upon the processor performing that recognition.

Abstract: A method and a device for providing a hearing aid user guide is disclosed. The device comprises a communication interface and a processing unit connected to the communication interface. The processing unit is configured for: obtaining at least one hearing aid setting of a hearing aid via the communication interface; configuring a user guide based on the at least one hearing aid setting; and providing the user guide.

Abstract: Techniques are described herein for multi-modal interaction between users, automated assistants, and other computing services. In various implementations, a user may engage with the automated assistant in order to further engage with a third party computing service. In some implementations, the user may advance through dialog state machines associated with third party computing service using both verbal input modalities and input modalities other than verbal modalities, such as visual/tactile modalities.

Abstract: A method of operating a captioned telephone call in which an assisted user's (AU's) captioned device is connected by a first line to a hearing user's (HU's) device and by a second line to a relay providing captioning for a conversation is disclosed. The method includes capturing an AU's voice signal via a microphone, transmitting the voice signal from the captioned device to the HU's device on the first line, obtaining a combined voice signal including both users' voice signals from the first line at the captioned device, cancelling the AU's voice signal from the combined signal to generate an independent HU voice signal, broadcasting the HU's voice signal via a speaker, transmitting the independent HU's voice signal to the relay, receiving captions at the captioned device from the relay corresponding to the HU's voice signal, and presenting the captions as text on a display screen.

Abstract: A real-time audio transcription, video conferencing, and online collaboration system system includes a microphone that records audio from a lecturer, a camera that captures video from the lecturer and/or users, and a user interface for viewing a transcription of the audio. The audio recording is transmitted to a storage device, such as a personal computer or mobile device, which transmits the audio to a voice-to-text application for transcription. The storage device may do so via a third-party cloud server, a web application, or a software application. The transcribed text is then transmitted to a user interface for viewing by hearing-impaired persons. The transcribed text is provided in real-time with the lecturer and audio-recording and presented word-for-word to the user during transcription and may be edited in real-time to improve accuracy of the automatic transcription.

Abstract: Techniques are described herein for multi-modal interaction between users, automated assistants, and other computing services. In various implementations, a user may engage with the automated assistant in order to further engage with a third party computing service. In some implementations, the user may advance through dialog state machines associated with third party computing service using both verbal input modalities and input modalities other than verbal modalities, such as visual/tactile modalities.

Abstract: A hearing aid having a hearing aid housing, includes: a microphone; a processing unit configured to process an audio signal for compensating a hearing loss of a user; a battery provided closer to a second end of the hearing aid housing than to a first end of the hearing aid housing; one or more wireless communication units for wireless communication; at least a part of a first antenna for electromagnetic field emission and/or electromagnetic field reception, the at least a part of the first antenna being interconnected with one of the one or more wireless communication units; and a second antenna for electromagnetic field emission and/or electromagnetic field reception, the second antenna being interconnected with one of the one or more wireless communication units; wherein the second antenna is between a center axis of the battery and the second end of the hearing aid.

Abstract: A method of operating a captioned telephone comprising the steps of dialing a telephone number to a relay gateway, connecting to the gateway over a communication network, performing a test to assess communication network quality, based on the test results, setting up the captioned telephone to operate in at least one of a first mode and a second mode wherein each of the first and second modes is one of (i) a PSTN mode in which data is communicated between the captioned telephone and the relay gateway via analog transmission and (ii) an IP mode in which data is communicated between the captioned telephone and the relay gateway via the Internet.

Abstract: A method may include obtaining first audio data originating at a first device during a communication session between the first device and a second device. The method may also include obtaining an availability of revoiced transcription units in a transcription system and in response to establishment of the communication session, selecting, based on the availability of revoiced transcription units, a revoiced transcription unit instead of a non-revoiced transcription unit to generate a transcript of the first audio data. The method may also include obtaining revoiced audio generated by a revoicing of the first audio data by a captioning assistant and generating a transcription of the revoiced audio using an automatic speech recognition system. The method may further include in response to selecting the revoiced transcription unit, directing the transcription of the revoiced audio to the second device as the transcript of the first audio data.

Abstract: Systems and methods for developing, deploying, and/or providing location-based controls for remote visitation in controlled-environment facilities are disclosed. In some embodiments, a method may include identifying a request to establish a visitation session between a resident and a non-resident of a controlled-environment facility, wherein the visitation session includes at least one of: a voice or a video call, and wherein the non-resident operates a mobile device; receiving spatial information of the mobile device; and applying a rule to the visitation session based upon the spatial information.

Abstract: A method may include obtaining first audio data originating at a first device during a communication session between the first device and a second device. The method may also include obtaining an availability of revoiced transcription units in a transcription system and in response to establishment of the communication session, selecting, based on the availability of revoiced transcription units, a revoiced transcription unit instead of a non-revoiced transcription unit to generate a transcript of the first audio data. The method may also include obtaining revoiced audio generated by a revoicing of the first audio data by a captioning assistant and generating a transcription of the revoiced audio using an automatic speech recognition system. The method may further include in response to selecting the revoiced transcription unit, directing the transcription of the revoiced audio to the second device as the transcript of the first audio data.

Abstract: Methods and systems are provided for providing enhanced incoming call notifications for users who utilized a relay application designed for those with speech, visual, or hearing impairments or disabilities. An indication that a calling party is attempting to initiate an incoming call intended for a receiving party that utilizes a relay application that assists users having hearing, visual, or speech disabilities is received by an intermediate party. A chat session is established utilizing the relay application between the intermediate party and the calling party. Additionally, a Voice over Internet Protocol (VoIP) session is established that does not include a voice session. Upon the chat session being terminated from within the relay application, the VoIP session is terminated.

Abstract: A system and a method for switching call agents in telecommunications relay service includes a TRS server system. The TRS server system includes a voice handler for processing voice data, a text handler for processing text data, and a controller for controlling, establishing, and terminating voice paths and data paths. The voice handler transmits a peer's voice to a first CA such that the first CA transcribes and converts the peer's voice into text data. The text handler receives the text data generated by the first CA. The controller selects a second CA; establishes a voice path and a data path between the second CA and the TRS server system; and terminate the voice path and data path associated with the first CA.

Abstract: Techniques are described herein for multi-modal interaction between users, automated assistants, and other computing services. In various implementations, a user may engage with the automated assistant in order to further engage with a third party computing service. In some implementations, the user may advance through dialog state machines associated with third party computing service using both verbal input modalities and input modalities other than verbal modalities, such as visual/tactile modalities.

Abstract: A method may include obtaining first audio data originating at a first device during a communication session between the first device and a second device. The method may also include obtaining a first text string that is a transcription of the first audio data, where the first text string may be generated using automatic speech recognition technology using the first audio data. The method may also include obtaining a second text string that is a transcription of second audio data, where the second audio data may include a revoicing of the first audio data by a captioning assistant and the second text string may be generated by the automatic speech recognition technology using the second audio data. The method may further include generating an output text string from the first text string and the second text string and using the output text string as a transcription of the speech.

Abstract: A method to generate a contact list may include receiving an identifier of a first communication device at a captioning system. The first communication device may be configured to provide first audio data to a second communication device. The second communication device may be configured to receive first text data of the first audio data from the captioning system. The method may further include receiving and storing contact data from each of multiple communication devices at the captioning system. The method may further include selecting the contact data from the multiple communication devices that include the identifier of the first communication device as selected contact data and generating a contact list based on the selected contact data. The method may also include sending the contact list to the first communication device to provide the contact list as contacts for presentation on an electronic display of the first communication device.

Abstract: Disclosed herein is method of performing speech recognition using audio and visual information, where the visual information provides data related to a person's face. Image preprocessing identifies regions of interest, which is then combined with the audio data before being processed by a speech recognition engine.

Abstract: A system for remote body communication that includes a processor configured to receive a video feed of a person performing a body communication. The processor is configured to determine whether the body communication is indicative of an emergency situation, translate the body communication, to a text or audio communication, and transmit the video feed and the text or audio communication to a receiving monitoring station. The processor then receives a responsive video feed of a responsive body communication and a responsive text or audio communication indicative of an instruction related to the emergency situation, and outputs the responsive video feed of the responsive body communication and the responsive text or audio communication via an operatively connected output processor.

Abstract: Method and apparatus is disclosed for a user to communicate with an electronic device. A processor receives user intention actions comprising facial expression (FE) information indicative of facial expressions and body information indicative of motion or position of one or more body parts of the user. When the FE or body information crosses a first level, the processor starts generating first signals based on the FE or body information to communicate with the electronic device. When the FE or body information crosses a second level, the processor can end generation of the first signals or modify the first signals. An image processing or eye gaze tracking system can provide some FE information or body information. The signals can modify attributes of an object of interest. Use of thresholds that are independent of sensor position or orientation with respect to the user's body are also disclosed.

Abstract: Aspects of the disclosure include a computer-implemented method for interacting with a user. Identity information for a user can be received. The identity information can be analyzed to identify the user. User information for an identified user can be retrieved, the user information indicating that a voice interacting with the identified user is to be translated into image data to help the identified user communicate with the voice. Translated image data translating voice instructions by the voice can be retrieved. The translated image data can be displayed to the identified user.

Abstract: A computer-implemented method to provide transcriptions of an audio communication session is disclosed. The method may include receiving audio data at a first device from a second device over a first wireless network connection of a first wireless network type and providing the audio data to a speaker of the first device for output of the audio data. The method may further include encoding the audio data at the first device based on a second wireless network type and transmitting the encoded audio data from the first device over a second wireless network of the second wireless network type.

Abstract: According to a first aspect, the invention relates to a method to support clinical decision by characterizing images acquired in sequence through a video medical device. The method comprises defining at least one image quantitative criterion, storing sequential images in a buffer, for each image (10) in the buffer, automatically determining, using a first algorithm, at least one output based on said image quantitative criterion and attaching said output to a timeline (11).

Abstract: Disclosed are systems, devices, and methods for detecting a trachea, an exemplary system comprising an imaging device configured to obtain image data and a computing device configured to generate a three-dimensional (3D) model, identify a potential connected component in a first slice image, identify a potential connected component in a second slice image, label the first slice image as a top slice image, label the connected component in the top slice image as an active object, associate each connected component in a current slice image with a corresponding connected component in a previous slice image based on a connectivity criterion, label each connected component in the current slice image associated with a connected component of the preceding slice image as the active object, and identify the active object as the trachea, based on a length of the active object.

Abstract: A system and method for use with an assisted user's communication device that includes a display. The method includes providing a user communication device including a processor that is programmed to perform the step of, upon disconnection of an emergency call to a hearing user in which a captioning service has provided text transcription of voice messages from the hearing user, maintaining a link to the captioning service for a predetermined period of time. The processor also is programmed to perform the step of recognizing the call as an emergency call upon placement of the call, and the captioning service is automatically initiated upon the processor performing that recognition.

Abstract: Systems and methods are provided for making purchases at a merchant point-of-sale (POS) device using a mobile device. Transaction information may be communicated from the POS device to the mobile device and an authorization from the purchaser to proceed with the transaction returned to the POS device from the mobile device. After authorization, the POS device may communicate the transaction information together with an identifier of the mobile device to a financial institution to process payment. The financial institution may confirm the transaction with the purchaser at the mobile device using the identifier of the mobile device. Upon receiving a confirmation response from the mobile device, the financial institution may then transfer funds from a purchaser account to a merchant account.

Abstract: System and method for seamless switching between operator networks is disclosed. The present invention relates to communication networks and, more particularly, to switching between operators in communication networks. A network element termed as the service aggregator is provided that resides in the operator's network and acts as an intermediate between the mobile user and the operator. In addition, a switching module is provided on the mobile device of the user that interacts with the service aggregator to perform switching. Base station continuously broadcasts signaling information to the mobile device. Based on such signaling information received, the mobile device decides if it wishes to switch to another operator's network. The service aggregator establishes connection with the service gateway of the new network. Further, service aggregator sends handover signal and the mobile device switches seamlessly to the new operator's network.

Abstract: A method and system for assessing captioning quality of a call assistant (CA) that transcribes a hearing user's (HU's) voice signal during a call with an assisted user (AU) into caption text, the method comprising the steps of receiving an HU voice signal at a relay, providing the HU voice signal to a first CA to transcribe into first caption text, providing the first caption text to a second CA for correction, the text corrected by the second CA being a true text caption and comparing the first caption text to the true text caption to identify a quality factor associated with the first caption text.

Abstract: A mouthpiece for providing non-invasive neuromodulation to a patient. The mouthpiece includes an elongated housing having a center of gravity located within a posterior region, a positioning pad attached to the top surface of the elongated housing for minimizing contact between a patient's upper teeth and the exterior top surface of the elongated housing, and a printed circuit board mounted to a bottom portion of the elongated housing, the printed circuit board having a plurality of electrodes for delivering subcutaneous local electrical stimulation to the patient's tongue. In some embodiments, the mouthpiece includes at least one locator disposed along the anterior region of the elongated housing for contacting a patient's teeth to securely position the mouthpiece within the patient's mouth.

Abstract: The present disclosure provides a method, a browser client, and a server for reading web page information by speech. The browser client is installed with a text to speech (TTS) engine. The method includes: sending, by a browser client, a page access request to a server, where the page access request includes a page address and TTS identity information; receiving, by the browser client, response data returned by the server, where the response data includes a TTS standard version number determined by the server according to the TTS identity information, and TTS page data corresponding to the page address; and reading, by the browser client, the TTS page data by speech according to the TTS standard version number by using a TTS engine. In the present disclosure, page information is read by speech by using the TTS engine installed on the browser client.

Abstract: Apparatuses and methods are disclosed for automatically connecting to a relay service and establish a captioning communication session during a call between a hearing-impaired user and a far-end user. The apparatus includes communication elements configured to receive captions from a relay service, and a processor configured to automatically connect to the relay service and establish a captioning communication session during a call responsive to a determination that a connection to the relay service failed during a time in which the hearing-impaired user desired captions to be enabled. A method includes determining captions are desired by the hearing-impaired user at a first time to be enabled for display to the communication device during a call, detecting a failed connection to the relay service at a second time, and automatically connecting with the relay service and establishing a new captioning communication session at a third time during the call.

Abstract: A call assistant device is used to command a call management system to perform a specified task in association with a specified call. The call assistant device can be an Internet of Things (IoT) based device, which can include one or more buttons and connect to a communication network wirelessly. When a user activates the call assistant device, e.g., presses a button, the call assistant device sends a message to the call management system to perform a specified task. Upon receiving the message, the call management system executes the specified task in association with a specified call of the user. The task to be performed can be any task that can be performed in association with a call, e.g., generating a summary of the call, bookmarking a specified moment in the call, sending a panic alert to a particular user, or generating an action item.

Abstract: An apparatus and method for use in treating tinnitus, employs a sound processing unit, a tactile unit, and an interface therebetween. The tactile unit comprises an array of stimulators each of which can be independently actuated to apply a tactile stimulus to a subject, and an input for receiving a plurality of actuation signals from the interface and directing individual actuation signals to individual stimulators. The sound processing unit receives an audio signal at an input, analyses the signal with a digital signal processor to generate the actuation signals which are representative of the audio signal, and provides the plurality of actuation signals to the interface. In a preferred embodiment the digital signal processor divides the audio signal into a series of frames in the time domain, performs a transform on each frame to generate a set of coefficients representing said frame, and maps the set of coefficients to a set of actuation signals to be applied to the array.

Abstract: An audio normalization gain value is applied to an audio signal to produce a normalized signal. The normalized signal is processed to compute dynamic range control (DRC) gain values in accordance with a selected one of several pre-defined DRC characteristics. The audio signal is encoded, and the DRC gain values are provided as metadata associated with the encoded audio signal. Several other embodiments are also described and claimed.

Abstract: A non-transitory computer-readable recording medium storing computer-readable instructions for a mobile terminal is provided.

Abstract: A method for accessing offline voicemail messages within a mobile messaging application may be provided. First, a voice mail message may be received and the voicemail message may be transcribed to text. Next, the voicemail message and the text transcription may be stored. The recipient may then be presented with a list of voicemail messages and the voicemail message may be retrieved in response to the recipient. The recipient may read or listen to the voicemail message or both. The recipient may also annotate the voicemail message.

Abstract: A method may include obtaining first audio data originating at a first device during a communication session between the first device and a second device. The method may also include obtaining a first text string that is a transcription of the first audio data, where the first text string may be generated using automatic speech recognition technology using the first audio data. The method may also include obtaining a second text string that is a transcription of second audio data, where the second audio data may include a revoicing of the first audio data by a captioning assistant and the second text string may be generated by the automatic speech recognition technology using the second audio data. The method may further include generating an output text string from the first text string and the second text string and using the output text string as a transcription of the speech.

Abstract: A method of operating a captioned telephone comprising the steps of dialing a telephone number to a relay gateway, connecting to the gateway over a communication network, performing a test to assess communication network quality, based on the test results, setting up the captioned telephone to operate in at least one of a first mode and a second mode wherein each of the first and second modes is one of (i) a PSTN mode in which data is communicated between the captioned telephone and the relay gateway via analog transmission and (ii) an IP mode in which data is communicated between the captioned telephone and the relay gateway via the Internet.

Abstract: Disclosed is a method and a hearing device. The hearing device comprises a first microphone for provision of a first microphone input signal; a sound impulse suppression module configured for detecting a sound impulse in the first microphone input signal; a processor for processing the first microphone input signal in a processing set of frequency bands to obtain an electrical output signal; and a receiver for converting the electrical output signal to an audio output signal, wherein the sound impulse suppression module is configured to apply a detection scheme on the first microphone input signal, wherein the detection scheme defines a detection set of frequency bands, wherein the frequency bands of the detection set covers a part of the frequency bands of the processing set, and wherein a sound impulse is detected based on the detection set of frequency bands.

Abstract: Systems and methods for developing, deploying, and/or providing location-based controls for remote visitation in controlled-environment facilities are disclosed. In some embodiments, a method may include identifying a request to establish a visitation session between a resident and a non-resident of a controlled-environment facility, wherein the visitation session includes at least one of: a voice or a video call, and wherein the non-resident operates a mobile device; receiving spacial information of the mobile device; and applying a rule to the visitation session based upon the spacial information.

Abstract: An apparatus may include a hardware processor and a storage medium. The storage medium may be coupled to the processor, and may store instructions. When executed by the processor, the instructions may cause the apparatus to receive a direction signal indicating a first direction in which a head of a user is facing with respect to a fixed direction. The instructions may also cause the apparatus to convert the first direction in which the head is facing with respect to the fixed direction into a second direction in which the head is facing with respect to a third direction, connecting the head and an object. Additionally, the instructions may cause the apparatus to generate an audio signal having characteristics such that a sound generated from the audio signal is perceived by the user as arriving from the third direction.

Abstract: A system and method, the method comprising receiving, at a processor, an hearing user's (HU's) voice signal from an HU participant during a first call, wherein the first call is a communication across a communication network, the processor programmed to perform the steps of, examining at least a portion of the voice signal to determine an identity of the HU, identifying a voice model associated with the identity of the HU, wherein the voice model comprises a plurality of rules, and further wherein each of the plurality of rules is a rule for transcribing a word in the HU voice signal into text and generating a text output, wherein the text output is a transcription of a plurality of words identified in the HU voice signal, and further wherein at least one of the plurality of words identified is identified using at least one rule of the plurality of rules.

Abstract: A system is provided that includes a first network interface for a first network type and a second network interface for a second network type that is different from the first network type. The system also includes at least one processor configured to cause the system to perform operations. The operations may include obtaining, from the first network interface, audio from a communication session with a remote device established over the first network and obtaining an indication of a communication device available to participate in the communication session and direct audio obtained from the communication session to a remote transcription system. The operations may also include directing the audio to the second network interface for transmission to the communication device, obtaining transcript data from the remote transcription system based on the audio, and directing the transcript data to the second network interface for transmission to the communication device.

Abstract: A communication system and method for displaying text captions corresponding to voice communications between an assisted user's mobile wireless device and a separate hearing user's device includes at least one communication component configured to enable the appliance to communicate with a relay, a display, and a processor operably coupled to the at least one communication component and the display. The processor is configured to enable the assisted user to establish an association between the appliance and the mobile device, receive text originating at the relay, the text corresponding to a transcript of the hearing user's voice signal originating at the hearing user's device, and cause text captions corresponding to the received text to be displayed on the display.