Patents by Inventor Kevin R. Colwell

Kevin R. Colwell has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20230005484
    Abstract: A relay for captioning a hearing user's (HU's) voice signal during a phone call between an HU and a hearing assisted user (AU), the HU using an HU device and the AU using an AU device where the HU voice signal is transmitted from the HU device to the AU device, the relay comprising a display screen, a processor linked to the display and programmed to perform the steps of receiving the HU voice signal from the AU device, transmitting the HU voice signal to a remote automatic speech recognition (ASR) server running ASR software that converts the HU voice signal to ASR generated text, the remote ASR server located at a remote location from the relay, receiving the ASR generated text from the ASR server, present the ASR generated text for viewing by a call assistant (CA) via the display and transmitting the ASR generated text to the AU device.
    Type: Application
    Filed: June 23, 2022
    Publication date: January 5, 2023
    Inventors: Robert M. Engelke, Kevin R. Colwell, Christopher Engelke
  • Patent number: 11539900
    Abstract: A system and method for facilitating communication between an assisted user (AU) and a hearing user (HU) includes receiving an HU voice signal as the AU and HU participate in a call using AU and HU communication devices, transcribing HU voice signal segments into verbatim caption segments, processing each verbatim caption segment to identify an intended communication (IC) intended by the HU upon uttering an associated one of the HU voice signal segments, for at least a portion of the HU voice signal segments (i) using an associated IC to generate an enhanced caption different than the associated verbatim caption, (ii) for each of a first subset of the HU voice signal segments, presenting the verbatim captions via the AU communication device display for consumption, and (iii) for each of a second subset of the HU voice signal segments, presenting enhanced captions via the AU communication device display for consumption.
    Type: Grant
    Filed: February 19, 2021
    Date of Patent: December 27, 2022
    Assignee: Ultratec, Inc.
    Inventors: Christopher Engelke, Kevin R. Colwell, Robert M. Engelke
  • Patent number: 11368581
    Abstract: A method to transcribe communications includes obtaining an audio message from a first device during a voice communication session with a second device including a display screen, providing the message to a first speech recognition system to generate a first message transcript, providing the transcript to the second device for presentation on the screen, obtaining an indication that a transcript quality is below a threshold, providing, in response, the message to a second system to generate a second transcript while still providing it to the first system to generate the first transcript and providing the first transcript to the second device for presentation on the display screen, and in response to an event occurring that indicates the second transcript is to be provided to the second device instead of the first transcript, providing the second transcript to the second device for presentation on the screen instead of the first transcript.
    Type: Grant
    Filed: September 11, 2020
    Date of Patent: June 21, 2022
    Assignee: Ultratec, Inc.
    Inventors: Robert M. Engelke, Kevin R. Colwell, Christopher Engelke
  • Publication number: 20220150352
    Abstract: A communication system and method for displaying text captions corresponding to voice communications between an assisted user's mobile wireless device and a separate hearing user's device includes at least one communication component configured to enable the appliance to communicate with a relay, a display, and a processor operably coupled to the at least one communication component and the display. The processor is configured to enable the assisted user to establish an association between the appliance and the mobile device, receive text originating at the relay, the text corresponding to a transcript of the hearing user's voice signal originating at the hearing user's device, and cause text captions corresponding to the received text to be displayed on the display.
    Type: Application
    Filed: January 19, 2022
    Publication date: May 12, 2022
    Inventors: Robert M. Engelke, Kevin R. Colwell, Troy D. Vitek
  • Publication number: 20220150353
    Abstract: A captioning relay for captioning hearing user (HU) voice signals comprising a plurality of separate captioning resources and a captioning administrator module that receives HU voice signal segments corresponding to a plurality of separate ongoing calls between HUs and AUs and provides the voice signal segments in a first in, first out order to the captioning resources, the administrator module providing each voice signal segment from each call to any one of the captioning resources to be captioned without regard to which captioning resource captioned prior voice signal segments generated during the call and, the administrator module further receiving caption segments back from the captioning resources and providing those captioning segments to AU devices associated with the calls that generated corresponding HU voice signal segments, and wherein the number of captioning resources is less than the number of ongoing calls.
    Type: Application
    Filed: January 26, 2022
    Publication date: May 12, 2022
    Inventors: Robert M. Engelke, Kevin R. Colwell, Christopher Engelke
  • Publication number: 20220103683
    Abstract: A captioning relay for captioning hearing user (HU) voice signals comprising a plurality of separate captioning resources and a captioning administrator module that receives HU voice signal segments corresponding to a plurality of separate ongoing calls between HUs and AUs and provides the voice signal segments in a first in, first out order to the captioning resources, the administrator module providing each voice signal segment from each call to any one of the captioning resources to be captioned without regard to which captioning resource captioned prior voice signal segments generated during the call and, the administrator module further receiving caption segments back from the captioning resources and providing those captioning segments to AU devices associated with the calls that generated corresponding HU voice signal segments, and wherein the number of captioning resources is less than the number of ongoing calls.
    Type: Application
    Filed: December 14, 2021
    Publication date: March 31, 2022
    Inventors: Robert M. Engelke, Kevin R. Colwell, Christopher Engelke
  • Patent number: 11272047
    Abstract: A system and method for use with an assisted user's communication device that includes a display. The method includes providing a user communication device including a processor that is programmed to perform the step of, upon disconnection of an emergency call to a hearing user in which a captioning service has provided text transcription of voice messages from the hearing user, maintaining a link to the captioning service for a predetermined period of time. The processor also is programmed to perform the step of recognizing the call as an emergency call upon placement of the call, and the captioning service is automatically initiated upon the processor performing that recognition.
    Type: Grant
    Filed: September 8, 2020
    Date of Patent: March 8, 2022
    Assignee: Ultratec, Inc.
    Inventors: Robert M. Engelke, Kevin R. Colwell, Troy D. Vitek
  • Patent number: 11258900
    Abstract: A communication system and method for displaying text captions corresponding to voice communications between an assisted user's mobile wireless device and a separate hearing user's device includes at least one communication component configured to enable the appliance to communicate with a relay, a display, and a processor operably coupled to the at least one communication component and the display. The processor is configured to enable the assisted user to establish an association between the appliance and the mobile device, receive text originating at the relay, the text corresponding to a transcript of the hearing user's voice signal originating at the hearing user's device, and cause text captions corresponding to the received text to be displayed on the display.
    Type: Grant
    Filed: September 3, 2019
    Date of Patent: February 22, 2022
    Assignee: Ultratec, Inc.
    Inventors: Robert M. Engelke, Kevin R. Colwell, Troy D. Vitek
  • Publication number: 20220053091
    Abstract: A method of operating a captioned telephone call in which an assisted user's (AU's) captioned device is connected by a first line to a hearing user's (HU's) device and by a second line to a relay providing captioning for a conversation is disclosed. The method includes capturing an AU's voice signal via a microphone, transmitting the voice signal from the captioned device to the HU's device on the first line, obtaining a combined voice signal including both users' voice signals from the first line at the captioned device, cancelling the AU's voice signal from the combined signal to generate an independent HU voice signal, broadcasting the HU's voice signal via a speaker, transmitting the independent HU's voice signal to the relay, receiving captions at the captioned device from the relay corresponding to the HU's voice signal, and presenting the captions as text on a display screen.
    Type: Application
    Filed: October 28, 2021
    Publication date: February 17, 2022
    Inventors: Robert M. Engelke, Kevin R. Colwell, Troy D. Vitek
  • Publication number: 20220028394
    Abstract: A captioning relay for captioning hearing user (HU) voice signals comprising a plurality of separate captioning resources and a captioning administrator module that receives HU voice signal segments corresponding to a plurality of separate ongoing calls between HUs and AUs and provides the voice signal segments in a first in, first out order to the captioning resources, the administrator module providing each voice signal segment from each call to any one of the captioning resources to be captioned without regard to which captioning resource captioned prior voice signal segments generated during the call and, the administrator module further receiving caption segments back from the captioning resources and providing those captioning segments to AU devices associated with the calls that generated corresponding HU voice signal segments, and wherein the number of captioning resources is less than the number of ongoing calls.
    Type: Application
    Filed: October 11, 2021
    Publication date: January 27, 2022
    Inventors: Robert M. Engelke, Kevin R. Colwell, Christopher Engelke
  • Publication number: 20220014622
    Abstract: A captioning relay for captioning hearing user (HU) voice signals comprising a plurality of separate captioning resources and a captioning administrator module that receives HU voice signal segments corresponding to a plurality of separate ongoing calls between HUs and AUs and provides the voice signal segments in a first in, first out order to the captioning resources, the administrator module providing each voice signal segment from each call to any one of the captioning resources to be captioned without regard to which captioning resource captioned prior voice signal segments generated during the call and, the administrator module further receiving caption segments back from the captioning resources and providing those captioning segments to AU devices associated with the calls that generated corresponding HU voice signal segments, and wherein the number of captioning resources is less than the number of ongoing calls.
    Type: Application
    Filed: September 27, 2021
    Publication date: January 13, 2022
    Inventors: Robert M. Engelke, Kevin R. Colwell, Christopher Engelke
  • Publication number: 20220014623
    Abstract: A captioning relay for captioning hearing user (HU) voice signals comprising a plurality of separate captioning resources and a captioning administrator module that receives HU voice signal segments corresponding to a plurality of separate ongoing calls between HUs and AUs and provides the voice signal segments in a first in, first out order to the captioning resources, the administrator module providing each voice signal segment from each call to any one of the captioning resources to be captioned without regard to which captioning resource captioned prior voice signal segments generated during the call and, the administrator module further receiving caption segments back from the captioning resources and providing those captioning segments to AU devices associated with the calls that generated corresponding HU voice signal segments, and wherein the number of captioning resources is less than the number of ongoing calls.
    Type: Application
    Filed: September 27, 2021
    Publication date: January 13, 2022
    Inventors: Robert M. Engelke, Kevin R. Colwell, Christopher Engelke
  • Patent number: 11201957
    Abstract: A text-assisted telephony system for use by an assisted user while communicating with a hearing user via a hearing user's phone device. The system includes first and second assisted user's communication devices, each including a processor, a microphone, a speaker, a display and a communication component. One processor is programmed to establish a voice call with the hearing user's phone device. One processor is programmed to establish a communication link with the other processor. Each processor is programmed to generate an alert indicating when an incoming call is received and to enable an assisted user to answer the call and, upon one of the devices being used to answer a call, that device receiving text captions from a remote relay corresponding to a hearing user's voice signal and presenting the text captions to the assisted user via the device display.
    Type: Grant
    Filed: September 12, 2019
    Date of Patent: December 14, 2021
    Assignee: Ultratec, Inc.
    Inventors: Christopher R. Engelke, Kevin R. Colwell, Troy Vitek
  • Patent number: 11190637
    Abstract: A method of operating a captioned telephone call in which an assisted user's (AU's) captioned device is connected by a first line to a hearing user's (HU's) device and by a second line to a relay providing captioning for a conversation is disclosed. The method includes capturing an AU's voice signal via a microphone, transmitting the voice signal from the captioned device to the HU's device on the first line, obtaining a combined voice signal including both users' voice signals from the first line at the captioned device, cancelling the AU's voice signal from the combined signal to generate an independent HU voice signal, broadcasting the HU's voice signal via a speaker, transmitting the independent HU's voice signal to the relay, receiving captions at the captioned device from the relay corresponding to the HU's voice signal, and presenting the captions as text on a display screen.
    Type: Grant
    Filed: November 13, 2020
    Date of Patent: November 30, 2021
    Assignee: Ultratec, Inc.
    Inventors: Robert M Engelke, Kevin R Colwell, Troy D Vitek
  • Patent number: 11190630
    Abstract: A communication system and method usable to facilitate communication between a hearing user and an assisted user. In particular, the system employs a wireless portable tablet or other portable electronic computing device linked to a captioning enabled phone as a remote interface for that phone, thereby providing an assisted user with more options, more freedom, and improved usability of the system.
    Type: Grant
    Filed: December 4, 2018
    Date of Patent: November 30, 2021
    Assignee: ULTRATEC, INC.
    Inventors: Christopher R. Engelke, Kevin R. Colwell, Troy Vitek
  • Patent number: 11153432
    Abstract: A method of operating a captioned telephone comprising the steps of dialing a telephone number to a relay gateway, connecting to the gateway over a communication network, performing a test to assess communication network quality, based on the test results, setting up the captioned telephone to operate in at least one of a first mode and a second mode wherein each of the first and second modes is one of (i) a PSTN mode in which data is communicated between the captioned telephone and the relay gateway via analog transmission and (ii) an IP mode in which data is communicated between the captioned telephone and the relay gateway via the Internet.
    Type: Grant
    Filed: January 27, 2020
    Date of Patent: October 19, 2021
    Assignee: Ultratec, Inc.
    Inventors: Robert M. Engelke, Kevin R. Colwell, Troy Vitek
  • Publication number: 20210306455
    Abstract: A method for maintaining contact information in a hearing impaired assisted user's communication device includes the steps of (a) providing a web site for altering assisted user contact information, (b) linking a proxy device to the web site, (c) receiving an identifier associated with the assisted user's device via the proxy device, (d) identifying an assisted user's device via the received identifier, (e) enabling the proxy device to be used to modify contact information for the assisted user associated with the received identifier, (f) starting a timer to time out a sync timeout period, (g) during the sync timeout period, receiving an indication via the assisted user's device confirming a desire to update the assisted user's contact information, (h) updating the assisted user's contact information, and (i) at the end of the timeout period, ceasing an indication that updated data is ready to be used from the assisted user's device.
    Type: Application
    Filed: June 14, 2021
    Publication date: September 30, 2021
    Inventors: Robert M. Engelke, Kevin R. Colwell, Troy Vitek
  • Publication number: 20210274039
    Abstract: A captioning relay for captioning hearing user (HU) voice signals comprising a plurality of separate captioning resources and a captioning administrator module that receives HU voice signal segments corresponding to a plurality of separate ongoing calls between HUs and AUs and provides the voice signal segments in a first in, first out order to the captioning resources, the administrator module providing each voice signal segment from each call to any one of the captioning resources to be captioned without regard to which captioning resource captioned prior voice signal segments generated during the call and, the administrator module further receiving caption segments back from the captioning resources and providing those captioning segments to AU devices associated with the calls that generated corresponding HU voice signal segments, and wherein the number of captioning resources is less than the number of ongoing calls.
    Type: Application
    Filed: May 14, 2021
    Publication date: September 2, 2021
    Inventors: Robert M. Engelke, Kevin R. Colwell, Christopher Engelke
  • Publication number: 20210266473
    Abstract: A system and method for facilitating communication between an assisted user (AU) and a hearing user (HU) includes receiving an HU voice signal as the AU and HU participate in a call using AU and HU communication devices, transcribing HU voice signal segments into verbatim caption segments, processing each verbatim caption segment to identify an intended communication (IC) intended by the HU upon uttering an associated one of the HU voice signal segments, for at least a portion of the HU voice signal segments (i) using an associated IC to generate an enhanced caption different than the associated verbatim caption, (ii) for each of a first subset of the HU voice signal segments, presenting the verbatim captions via the AU communication device display for consumption, and (iii) for each of a second subset of the HU voice signal segments, presenting enhanced captions via the AU communication device display for consumption.
    Type: Application
    Filed: February 19, 2021
    Publication date: August 26, 2021
    Inventors: Christopher Engelke, Kevin R. Colwell, Robert M. Engelke
  • Publication number: 20210234959
    Abstract: A system includes a first user device configured to perform captioning session operations, a call-assistant (CA) device remote from the first user device, and a remote relay server separate from the CA device. The relay server initiates a captioning process, receives, from the first user device, a request to initiate a captioning session, establishes the session, assigns the session to the CA, receives first audio data from the first user device derived from a second user device, directs the first audio data to the CA device, receives, from the CA device, second audio data related to the first audio data and derived from CA speech, accesses an ASR engine trained to the CA voice, generates captioned text including a transcription of the second audio data, generates screen information including the transcription, directs the screen information to the CA device, and directs the captioned text to the first user device.
    Type: Application
    Filed: April 16, 2021
    Publication date: July 29, 2021
    Inventors: Robert M. Engelke, Kevin R. Colwell, Christopher Engelke