RESPONSIVE COMMUNICATION SYSTEM
A spoken communication system and method of communicating spoken communication, includes a server and at least one communication device that are in digital communication with each other over the Internet via a communication channel. The at least one communication device receives spoken communication and digitally communicate the spoken communication to the server. The spoken communication is isolated from interception on the Internet by deleting the spoken communication from the at least one communication device after digitally communicating the spoken communication to the server and deleting the spoken communication from storage on the server. Also, privacy is ensured to a user by avoiding building a database of user's habits or characteristics from the spoken communication.
The present application is a continuation of U.S. patent application Ser. No. 16/861,507, filed Apr. 29, 2020, which is a continuation of U.S. Pat. No. 10,666,448, issued May 26, 2020 which claims benefit of International Patent Application No. PCT/IB2017/052779, filed May 11, 2017, which claims the benefit of U.S. Provisional Patent Application Ser. No. 62/379,528 filed Aug. 25, 2016 and U.S. Provisional Patent Application Ser. No. 62/361,728 filed Jul. 13, 2016.
BACKGROUND OF THE INVENTIONThe present invention is directed to a communication system that is restricted to a community, such as a family or other unit, and, in particular, to a system that provides spoken, or oral, communication among family members. While the invention is capable of providing spoken communication within a residence, it is also capable of providing such communication among several residences and among several platforms for residents that are outside of the residence(s).
Currently, home communication systems are permanently installed wall-mounted fixtures, known as intercoms, which require the user to be located in front of the fixture, and press and hold a button while speaking into a microphone. The person to whom the communication is directed needs to be near a corresponding unit. Such units require hard-wired communication cable interconnecting the units, as well as a source of power.
Various web-enabled communication techniques are available. Some even pick-up casual conversations without the conscious knowledge of the users. Such techniques provide access to the communication by the service provider. The service provider is able, through permission given via the user agreement, to record conversations and to extract information about the users from the on-line communications sent to their computers to provide marketing pitches, and the like. Communications among family members are often very sensitive and most private, and recording of such communication is typically not desired.
SUMMARY OF THE INVENTIONThe invention provide a spoken communication system and method that maintains all communication by the users of the system isolated from capture by systems on the Internet, and helps ensure privacy and security. Known Internet systems tend to build databases of users habits and characteristics in order to market to the users and even potentially worse. By isolating the system from the interception by others on the Internet, the system provides privacy with exceptional functionality and versatility.
The invention provide a spoken communication system and method that maintains all communication by the users of the system isolated from capture by systems on the Internet, and helps ensure privacy and security. Known Internet systems tend to build databases of users habits and characteristics in order to market to the users and even potentially worse. By isolating the system from the interception by others on the Internet, the system provides privacy with exceptional functionality and versatility.
A spoken communication system and method of communicating spoken communication, according to an aspect of the invention, includes a server and at least one communication device that are in digital communication with each other over the Internet via a communication channel. The at least one communication device receives spoken communication and digitally communicate the spoken communication to the server. The spoken communication is deleted from the at least one communication device after digitally communicating the spoken communication to the server and the spoken communication is deleted from storage on the server.
The spoken communication may be encrypted on the communication channel. The at least one communication device may be non-responsive to spoken communication below a threshold volume. The at least one communication device may be non-responsive to spoken communication above a threshold volume. The communication channel may be opened upon receiving a spoken communication and closed a period of time after the server detects that spoken communication has ended.
The at least one communication device may have at least one processor, at least one microphone, at least one speaker and a Wi-Fi interface in order to facilitate sending and receiving spoken communication. The at least one communication device may be a smart speaker.
A spoken communication system and method of communicating spoken communication, according to an aspect of the invention, includes a server and at least one communication device that are in digital communication with each other over the Internet via a communication channel. The at least one communication device receives spoken communication and digitally communicate the spoken communication to the server. Privacy is provided to to a user by avoiding building a database of user's habits or characteristics from the spoken communication.
The providing privacy may include avoiding marketing to the user of the at least one communication device.
These and other objects, advantages, and features of this invention will become apparent upon review of the following specification in conjunction with the drawings.
Referring now to the drawings and the illustrative embodiments depicted therein,
Spoken communication system 10 may include a plurality of routers 18 in digital communication with server 14. One or more domestic devices 12 may be in digital communication with each of the routers 18. This use of routers facilitates, for example, domestic devices 12 in communication with one of the routers 18 in a residence, such as a primary residence being in digital communication with domestic devices 12 in communication with another of the router 18 in a different residence, such as a second residence. The term “digital communication” can be via wireless Wi-Fi, wired Ethernet, Bluetooth, 3G, 4G, LTE cellular networks, or other forms of digital communication known in the art. All such protocols are intended to be included in the term digital communication unless a particular protocol is specified. All digital communication in the spoken communication system, including digital communication to and from the server 14, domestic devices 12, and mobile devices 22 may be encrypted for further privacy and security. Server 14 may be a physical server of the type that may be physically located in a residence or may be a logical server defined from a cloud web service of the type known in the art. Server 14 is managed though a website or user management portal 20, which may be accessed through any number of means, such as through a browser, or an application on a mobile phone or tablet.
One or more mobile devices 22 may be in digital communication with server 14. Mobile devices 22 are devices that are web-enabled to communicate via a cellular network or other wireless network, such as a smart phone, tablet, or the like and include at least a speaker and a microphone. Mobile device 22 may receive spoken communication from one of domestic devices 12 via server 14 and transfer spoken communication to domestic devices or other mobile devices. This allows system 10 to communicate spoken communication to a user who is out of the residence without the need to place a call to that user or receive a call from that user. Thereby, seamless spoken communication can be provided hands-free from inside the residence to and from a community user not within range of a domestic device 12. A community user is a user that is a member of a family or other community and has permission to be a user of the system.
Turning to
If the server 14 determines it has not received a voicemail, the server 14 will next determine if it has received an audio stream request at 122. If the server 14 has received an audio stream request, the server 14 will next determine if the system is enabled at 124. If the system 10 is not enabled, the server 14 will return to the idle state at 114. If the system 10 is enabled, the server will open a communication channel at 126 to all devices connected to server 14. The server 14 will then return to the idle state at 114.
If the server 14 determines that it has not received an audio stream request, the server 14 will next determine if a device is requesting connection at 128 to server 14. If a domestic device or a mobile device is requesting connection, the server 14 will determine if the device provides proper authorization at 130. If the server 14 determines that the device did not provide proper authorization, the server 14 returns to the idle state at 114. If the device does provide proper authorization, the server 14 allows the connection and adds the device to the server registry at 132. The server 14 then sends configuration data to the device at 138. This configuration data comprises all the data the device requires to begin functioning. This data may include vocal profiles, system status, and other relevant information. The server 14 then returns to the idle state at 114.
If the server 14 determines that a device is not requesting a connection, the server 14 next determines if a new user name is being defined at 134. If a new user name is being defined, the server 14 adds the new user name to a database stored on the server and sends the new user name to all devices at 136 connected to the server 14. The server 14 then returns to the idle state at 114.
Turning now to
If the server 14 determines a router information request is not occurring, the server 14 determines if a device is attempting to make a call at 144. If a device is attempting to make a call, the server connects the requesting device to a telephone network at 146 in order to facilitate the call. The server 14 will maintain the connection between the device and the telephone network until the conclusion of the call. The server 14 then returns to the idle state 114.
If the server 14 determines that a device is not attempting to make a call, then the server 14 determines if a new vocal profile is being defined at 148. If it is determined that a new vocal profile is being defined, the server 14 adds the new vocal profile to a database stored on the server 14 and distributes the new vocal profile to each connected device at 150. The vocal profiles allow the system 10 to ensure that only authenticated users are able to access the system 10. When a user issues a spoken command, the device or the server 14 may verify that the user is an authenticated user by comparing the user's voice to the stored vocal profiles. The server 14 then returns to the idle state at 114.
If the server 14 determines that a new vocal profile is not being defined, the server 14 then determines if the system 10 is being enabled or disabled at 152. If the server 14 determines that the system 10 is being enabled or disabled, the server 14 sends the appropriate enable or disable command to each connected device at 154. The server 14 then returns to the idle state at 114.
If the server determines that the system 10 is not being enabled or disabled, then the server determines if a device is being enabled or disabled at 156. If the server 14 determines that a device is being enabled or disabled, the server 14 sends the appropriate enable or disable command to the specified device at 158. The server 14 then returns to the idle state at 114.
If the server determines that a device is not being enabled or disabled, the server 14 then determines if a request to open a communication channel has been received at 160. If the server 14 determines that an open communication channel request has not been received, the server returns to the idle state at 114. If the server 14 determines that an open communication channel request has been received, the server 14 then opens the communication channel and then determines if the spoken communication has ended at 162. The server typically accomplishes this by measuring the sound volume received against the typical ambient sound levels. If the server 14 detects spoken communication, then the conversation between users is still ongoing, and the server 14 returns to the idle state at 114. If the server 14 does not detect spoken communication, the server 14 then determines if a variable amount of time without spoken communication at 164. This variable time can be adjusted for the optimum time for the users of the system 10. If the server 14 determines that a variable amount of time has not passed, then the server 14 will return to the idle state at 114. If the server 14 determines that a variable amount of time has passed, the server 14 determines that the conversation between users has ended and closes the communication channel at 166. The server 14 then returns to the idle state at 114.
Turning to
Next, the domestic device program enters an idle state at 222. From the idle state, the domestic device program again determines if it is connected at 224 to the server 14. If it is not, the domestic device program returns attempting to connect at 214 to server 14. If the domestic device program is connected to the server 14, it next determines if it has received an enable or disable command at 226 from the server 14. The domestic device 12 receives commands from the user by the user speaking an activation word or phrase followed by a command. Both the activation phrase and the commands may be defined by the user. For example, the activation word may by “system” and the command may be “enable.” The user could then provide a system enable command by speaking “system enable” within range of a domestic device 12. Any reasonable number of activation words and commands can be created and stored by the server 14. Additionally, the activation words and commands may be in any language. If the domestic device program has received an enable or disable command, the domestic device program provides an audio alert via the speaker 36 and appropriately enables or disables at 228. The domestic device program then returns to the idle state at 222. If domestic device program has not received such a command, it next determines if a communication channel has been opened at 230 by the server 14. If it has, domestic device 12 determines if it is a standby mode at 232. Standby mode is defined as a mode where the domestic device will only respond to an enable command. All other commands, such as ones to establish communication to other users, will be ignored. If the domestic device is in a standby mode, the domestic device disregards the open communication channel and returns to the idle state at 222. If the domestic device is not in a standby mode, the domestic device program provides an audio alert via the speaker 36, and sends and receives spoken communication to and from the server 14 via the microphone 34 and speaker 36 to establish communication at 234. The domestic device program then returns to the idle state at 222.
If the domestic device program determines a communication channel has not been opened, it next determines if the microphone is detecting sound at 236. If it is not, the domestic device program returns to the idle state at 222. Detecting sound includes determining if the detected sound is above a variable threshold. This variable threshold is provided in order adapt to the specific location and ambient sound level of each domestic device 12 and to specific user needs and desires. If it does detect sound, then the domestic device program next determines if the sound is above a variable cutoff threshold at 238. The variable cutoff threshold is provided in order to ensure that certain spoken communication is not analyzed or recorded. If the sound is above the variable cutoff threshold, the domestic device program requests that the server 14 disable the system at 240. Moving to
If the domestic device program determines that the audio clip is not an enable or disable command, it next determines if the domestic device 12 is in standby mode at 250. The device is placed into standby mode after it received a disable request from the user or the server 14. If the domestic device 12 is in standby mode, the domestic device program deletes the audio clip at 256 and returns to the idle state at 222. If the domestic device 12 is not in standby mode, the domestic device program determines if the audio clip is a voice call command at 252. If it is, the domestic device program provides an audio alert via the speaker 36 and sends the call request at 248 to the server 14. The domestic device program then deletes the recorded audio clip at 256 and returns to the idle state at 222. If the audio clip is not a voice call command, the domestic device program next determines if the audio clip is an open communication channel command at 254. If it is not, the domestic device program deletes the recorded audio clip at 256 and returns to the idle state at 222. If the audio clip is an open communication channel command, the domestic device program provides an audio alert via the speaker 36 and establishes and open communication channel with the server 14 at 258. At the conclusion of the communication, the domestic device program then deletes the recorded audio clip at 256 and returns to the idle state at 222.
As mentioned previously, the server 14 may restrict communications to only registered devices. Turning now to
Then, the domestic device 12 ceases broadcasting its Wi-Fi signal, and instead attempts to connect at 324 to the server 14. This connection may be achieved through a router 18 or any other device that provides digital communication with the server 14. This connection process may require any sort of authentication or credentials inherent in such a connection. For example, the device may need to provide a password to access the wireless network broadcast by a router 18. Either immediately before or immediately after the connection is established, the domestic device program transmits the registration information to the server 14, in order to login at 326. The domestic device program then determines if the login was successful at 328. If the login was not successful, the domestic device program returns to broadcasting a Wi-Fi signal at 310. If the login was successful, the domestic device program sends a registry request at 330 to the server 14, so that the server 14 may store the domestic device's 12 registration information to facilitate future connections. Next, the domestic device program enters the idle state at 222.
A mobile communication application is run on a smart phone, tablet, or other mobile device 22 that is connected to the Internet through a Wi-Fi or cellular data service, such as 3G, 4G, LTE, or the like. As shown in
If the mobile communication application determines that a new vocal profile is not being created, it next determines if the user selected voicemail playback at 432. If so, the mobile communication application retrieves the selected voicemail from local storage at 434, and plays the selected voicemail at 436 for the user. The mobile communication application then returns to the idle state at 422.
If a user has not selected a voicemail, the mobile communication application then determines if the server 14 is broadcasting spoken communication at 438. If it is, the mobile communication application then enables the mobile device's 22 speaker at 440 and audibly broadcasts the received spoken communication received from the server 14. The mobile communication application then returns to the idle state at 422.
If the mobile communication application determines that the server 14 is not sending spoken communication, then it determines if the user selected to transit audio communication at 442. It is understood that the mobile communication application could recognize the user's intent in any number of ways. For example, the mobile communication application could provide a button labeled “speak.” A button could be a physical button or on a touchscreen device. Additionally, the mobile communication application could be responsive to a spoken command. If the mobile communication application determines the user does wish to send audio communication, it then enables the mobile device's 22 microphone at 444 and records the audio. It then sends the spoken communication to the server 14 at 446. The server 14 is then responsible for broadcasting the audio communication to the proper device(s) (
Turning to
If the user is not attempting to send a voicemail, the mobile communication application determines if the user wishes to delete a voicemail at 454. Similarly to sending spoken communication, the mobile communication application can recognize the user's intent in any number of ways such as a button or voice command. If the user does wish to delete a voicemail, the mobile communication application removes the voicemail from local storage at 456. The mobile communication application then returns to the idle state at 422.
If the user is not attempting to delete a voicemail, the mobile communication application determines if the user wishes to enable or disable at 458 a domestic device 12 or the system 10. Similarly to sending spoken communication, the mobile communication application can recognize the user's intent in any number of ways, such as a button or voice command. If the user does wish to enable or disable a domestic device 12 or the system 10, the mobile communication application sends the appropriate enable or disable command at 460 to the server 14. The mobile communication application then returns to the idle state at 422.
If the user is not attempting to enable or disable a domestic device 12 or the system 10, the mobile communication application determines if the digital mobile device 22 has received a voicemail at 462 from the server 14. If it has not, the mobile communication application returns to the idle state 422. If the digital mobile device 22 has received a voicemail from the server 14, the voicemail is stored in local storage and a notification is sent to the user at 464. The notification can take many forms, such as displaying a message on the screen, sending a text message or an email, or other various means of notification. Then, the mobile communication application returns to the idle state at 422.
Thus, it is seen that embodiments of the invention provide a spoken communication system that is both versatile and unrestricted geographically, yet maintains all communication by the users of the system isolated from capture by systems on the Internet, and helps ensure privacy and security. Such Internet systems tend to build databases of users habits and characteristics in order to market to the users and even potentially worse. By isolating the system from the interception by others on the Internet, the system provides privacy with exceptional functionality and versatility.
While the foregoing description describes several embodiments of the present invention, it will be understood by those skilled in the art that variations and modifications to these embodiments may be made without departing from the spirit and scope of the invention, as defined in the claims below. The present invention encompasses all combinations of various embodiments or aspects of the invention described herein. It is understood that any and all embodiments of the present invention may be taken in conjunction with any other embodiment to describe additional embodiments of the present invention. Furthermore, any elements of an embodiment may be combined with any and all other elements of any of the embodiments to describe additional embodiments.
Claims
1. A spoken communication system, comprising:
- a server and at least one communication device that are in digital communication with each other over the Internet via a communication channel;
- wherein said at least one communication device is adapted to receive spoken communication and digitally communicate the spoken communication to the server; and
- wherein the spoken communication is deleted from the at least one communication device after digitally communicated to the server and deleted from storage on the server.
2. The spoken communication system as claimed in claim 1 wherein digital communication of the spoken communication is encrypted on the communication channel.
3. The spoken communication system as claimed in claim 1 wherein the digital communication of the spoken communication is isolated from capture by systems on the Internet.
4. The spoken communication system as claimed in claim 1 wherein the at least one communication device is not responsive to spoken communication below a threshold volume.
5. The spoken communication system as claimed in claim 1, wherein the at least one communication device is unresponsive to spoken communication above a threshold volume.
6. The spoken communication system as claimed in claim 1 wherein the communication channel is open upon receiving a spoken communication and closed a period of time after the server detects that spoken communication has ended.
7. The spoken communication system as claimed in claim 1 wherein said at least one communication device comprises at least one processor, at least one microphone, at least one speaker and a Wi-Fi interface in order to facilitate sending and receiving spoken communication.
8. The spoken communication system as claimed in claim 7 wherein said at least one communication device comprises a smart speaker.
9. The spoken communication system as claimed in claim 1 wherein said at least one communication device comprises a smart speaker.
10. A method of communicating spoken communication, comprising:
- having a server and at least one communication device that are in digital communication with each other over the Internet via a communication channel;
- wherein said at least one communication device receives spoken communication and digitally communicate the spoken communication to the server; and
- isolating the spoken communication from interception on the Internet by deleting the spoken communication from the at least one communication device after digitally communicating the spoken communication to the server and deleting the spoken communication from storage on the server.
11. The method as claimed in claim 10 including encrypting the spoken communication on the communication channel.
12. The method as claimed in claim 10 wherein the at least one communication device is not responsive to spoken communication below a threshold volume.
13. The method as claimed in claim 10, wherein the at least one communication device is unresponsive to spoken communication above a threshold volume.
14. The method as claimed in claim 10 including opening the communication channel upon receiving a spoken communication and closing the communication channel a period of time after the server detects that spoken communication has ended.
15. The method as claimed in claim 10 wherein said at least one communication device comprises at least one processor, at least one microphone, at least one speaker and a Wi-Fi interface in order to facilitate sending and receiving spoken communication.
16. The method as claimed in claim 15 wherein said at least one communication device comprises a smart speaker.
17. The method as claimed in claim 10 wherein said at least one communication device comprises a smart speaker.
18. A method of communicating spoken communication, comprising:
- having a server and at least one communication device that are in digital communication with each other over the Internet via a communication channel;
- wherein said at least one communication device receives spoken communication and digitally communicate the spoken communication to the server; and
- providing privacy to a user by avoiding building a database of user's habits or characteristics from the spoken communication.
19. The method as claimed in claim 18 wherein the providing privacy includes avoiding marketing to the user of the at least one communication device.
Type: Application
Filed: Aug 20, 2021
Publication Date: Dec 9, 2021
Inventors: James P. DeLapa (Grand Rapids, MI), Samuel-Hunter Berndt (Belding, MI), Can Gokcek (Belleville, MI)
Application Number: 17/407,638