MULTIPROTOCOL AUDIO/VOICE INTERNET-OF-THINGS DEVICES AND RELATED SYSTEM
A system of multiprotocol audio/voice devices includes a plurality of consumer electronic multiprotocol audio/voice devices and a wearable multiprotocol audio/voice device accessible by a user. The wearable multiprotocol audio/voice device may determine wireless protocols acceptable by the plurality of consumer electronic multiprotocol audio/voice devices, and the user may control the plurality of consumer electronic multiprotocol audio/voice devices by the wearable multiprotocol audio/voice device without requiring a unique application. The wearable multiprotocol audio/voice device includes a package housing a digital signal processor (DSP), wireless communication modules, and a multipoint control unit (MCU) coupled to the DSP and the wireless communication modules. The DSP is coupled to a microphone and configured to provide voice control signals to the MCU. The wireless communication modules are coupled to antennas. The MCU enables wireless radio frequency (RF) communication links over the wireless protocols.
Latest LIBRE WIRELESS TECHNOLOGIES INC. Patents:
- DYNAMIC DIRECT MULTINODE (DDM) WIRELESS NETWORK
- Internet-of-things devices and related methods for performing in-call interactions
- Multiprotocol audio/voice internet-of-things devices and related system
- INTERNET-OF-THINGS DEVICES AND RELATED METHODS FOR PERFORMING IN-CALL INTERACTIONS
- DYNAMIC DIRECT MULTINODE (DDM) WIRELESS NETWORK
The present application is a Continuation of U.S. application Ser. No. 15/788,201, filed on Oct. 19, 2017, the entire contents of which are hereby incorporated by reference.
BACKGROUNDThe internet-of-things (IoT) refers to the networking of physical objects embedded with electronic devices. As more objects are networked, new ways of interacting with them become available. IoT devices can collect, process, act on, and communicate data for such purposes as automation, user reporting, and remote control. IoT devices are rapidly being deployed in home, industrial, metropolitan, and environmental applications, and using voice control for ease of use.
Multiple IoT devices can be connected using wireless radio frequency (RF) communication links. However, conventional IoT devices establish the communication links by using various wireless protocols. Numerous wireless protocols exist, including WiFi™, Bluetooth™, ZigBee™, and more. Manufacturers of different IoT devices may use any one of these numerous wireless protocols. The existence of numerous wireless protocols hinders linking all available IoT devices, and is commonly referred to as the “basket of remotes” problem.
In one solution, a unique software application is installed on an IoT device in order to enable it to communicate with IoT devices having different wireless protocols. This solution is difficult to implement, particularly due to the complexity of the software and the need for the software developer to be familiar with the numerous wireless protocols. If installed on a device that uses voice control, the software may need to re-implement algorithms that relate voice commands to protocol commands in light of the additional protocols. Moreover, it is difficult for IoT devices operating only on a local network to install the software.
SUMMARYThe present disclosure is directed to multiprotocol audio/voice internet-of-things (IoT) devices and related system, substantially as shown in and/or described in connection with at least one of the figures, and as set forth in the claims.
The following description contains specific information pertaining to implementations in the present disclosure. The drawings in the present application and their accompanying detailed description are directed to merely exemplary implementations. Unless noted otherwise, like or corresponding elements among the figures may be indicated by like or corresponding reference numerals. Moreover, the drawings and illustrations in the present application are generally not to scale, and are not intended to correspond to actual relative dimensions.
As shown in
As further shown in
Notably, in wireless communication system 100, devices having different wireless protocols do not connect to and communicate with each other. For example, WiFi™-enabled router 102 does not communicate with ZigBee™-enabled light control panel 108, and neither WiFi™-enabled router 102 nor ZigBee™-enabled light control panel 108 communicates with Bluetooth™-enabled speaker 114. In practice, use of numerous IoT devices burdens a user with a need for multiple gateways, one for each protocol.
As shown in
Antennas 234a and 234b located outside package 232 are used to receive or transmit RF signals according to various wireless protocols. For example, antenna 234a is used to receive or transmit RF signals according to the WiFi™ and Bluetooth™ protocols, and antenna 234b is used to receive or transmit RF signals according to the ZigBee™ protocol. Antennas 234a and 234b may be, for example, patch antennas or microstrip antennas or other types of antennas. In one implementation, antennas 234a and 234b may each be an antenna array having more than one element.
As shown in
WiFi™ communication module 242, Bluetooth™ communication module 244, and ZigBee™ communication module 246 process RF signals according to the standards of the WiFi™ protocol, the Bluetooth™ protocol, and the ZigBee™ protocol respectively. Because concurrent use of multiple wireless protocols generally results in interference and collisions, WiFi™ communication module 242, Bluetooth™ communication module 244, and ZigBee™ communication module 246 are also responsive to and controlled by control signals from MCU 250. As shown in
In
As shown in
Microphone 252 is coupled to DSP 254 through line 280. DSP 254 is configured to receive and process voice signals from microphone 252. DSP 254 performs voice signal conditioning, such as noise filtration, voice cleanup, and gain control. DSP 254 also performs voice recognition analysis. Optionally, as shown in
As shown in
As also shown in
MCU 250 may process information from external hardware communication interfaces such as external inter-IC sound (I2S) (shown as “Aux In (I2S)” in
MAVID™ 231 in
Antennas 235a, 235b, and 235c in
For the purpose of an example only, an exemplary use of MAVID™ 231 is described hereafter. While MAVID™ 231 is streaming audio to a speaker (not shown in
In
As shown in
When using multiprotocol devices in the present implementation, IoT devices having different wireless protocols can be conveniently controlled from a single MAVID™ gateway by voice command. Also, the need for installing a unique application to connect to each IoT device having a unique wireless protocol is reduced and voice control algorithms generally do not need to be re-implemented; and IoT devices, especially IoT devices operating only on a local network, would generally not need to install new software.
By embedding MAVID™ chips 531 in each consumer electronic MAVID™, multiple consumer electronics can be conveniently controlled from a single gateway by voice command. In the present implementation, MAVID™ 530 is a gateway. In various implementations, any of MAVIDs™ 531 may be a gateway instead of or in addition to MAVID™ 530. Moreover, using MAVID™ chips 531 in each consumer electronic MAVID™ facilitates dynamic selection of wireless protocols. For example, MAVID™ 530 and a consumer electronic MAVID™ integrated with one of MAVID™ chips 531 may be communicating over the Bluetooth™ protocol, and then, based on distance calculations, signal strengths, bit error rates, scans, or information stored in memory may coordinate with each other and switch to communicating over the ZigBee™ protocol if determined to be advantageous.
When using multiprotocol devices in the present implementation, IoT devices having different wireless protocols can be conveniently controlled from a single MAVID™ gateway by voice command. Moreover, in the present implementation, because a unique software application (i.e. a unique “app”) is not required to connect to each IoT device that is itself a consumer electronic MAVID™, i.e. itself has a MAVID™ chip embedded therein voice control algorithms do not need to be re-implemented, and the MAVID™-enabled IoT devices do not need to install new software.
Thus, various implementations of the present application achieve improved multiprotocol audio/voice devices for use in wireless IoT applications. From the above description it is manifest that various techniques can be used for implementing the concepts described in the present application without departing from the scope of those concepts. Moreover, while the concepts have been described with specific reference to certain implementations, a person of ordinary skill in the art would recognize that changes can be made in form and detail without departing from the scope of those concepts. As such, the described implementations are to be considered in all respects as illustrative and not restrictive. It should also be understood that the present application is not limited to the particular implementations described above, but many rearrangements, modifications, and substitutions are possible without departing from the scope of the present disclosure.
Claims
1-22. (canceled)
23. A system, comprising:
- a multiprotocol audio/voice device including: two or more communication circuits, each of which is configured to process an RF signal according to a distinctive wireless protocol; a multipoint control unit (MCU) configured to receive information reported by the two or more communication circuits, and manage a coexistence of multiple RF communication links over different wireless protocols; a microphone configured to receive a voice from a user and generate voice signals; a digital signal processor (DSP) configured to perform voice recognition analysis on the voice signals from the microphone, and employ a wake-up scheme to change an operational state of the multiprotocol audio/voice device on occurrence of a detectable event via the voice recognition analysis; and a flash memory configured to store a previous multiprotocol connection's configuration to reduce processing burden of the MCU upon a subsequent multiprotocol connection;
- the multiprotocol audio/voice device being configured to:
- receive a voice command;
- in response to the voice command, connect to and utilize a cloud platform over a first wireless protocol, and connect to a consumer electronic device over a second wireless protocol.
24. The system of claim 23, wherein the first wireless protocol or the second wireless protocol comprises WiFi, ZigBee, Bluetooth, third generation mobile technology (3G), fourth generation mobile technology (4G), Long Range (LoRa), Z-Wave, IR remote, and Digital Enhanced Cordless Technology (DECT).
25. The system of claim 23, wherein, to connect to and utilize the cloud platform, the multiprotocol audio/voice device is configured to:
- connect to a router over the first wireless protocol; and
- instruct the router to connect to and utilize the cloud platform over an internet protocol (IP) connection.
26. The system of claim 23, wherein the consumer electronic device is selected from the group consisting of: a speaker, a television, a lighting system, a telephone, a computer, a printer, a flash drive, an on-board diagnostics (OBD) dongle, a refrigerator, a coffee maker, a home security alarm, a security camera, a thermostat, and a heating, ventilation, and air conditioning (HVAC) device.
27. The system of claim 26, wherein the multiprotocol audio/voice device is configured to connect to the consumer electronic device over a wireless communication without internet.
28. The system of claim 27, wherein the multiprotocol audio/voice device is configured to process the voice command with the DSP, without connecting to the internet.
29. The system of claim 23, wherein the multiprotocol audio/voice device is selected from the group consisting of: a necklace, a button, a watch, eyeglasses, headphones, a hub, a remote, a speaker and an earpiece.
30. The system of claim 23, wherein, to connect to the consumer electronic device, the multiprotocol audio/voice device is configured to determine the second wireless protocol acceptable by the consumer electronic device.
31. The system of claim 23, wherein, to connect to the consumer electronic device, the multiprotocol audio/voice device is configured to determine the second wireless protocol acceptable by the consumer electronic device based on a location estimation.
32. The system of claim 23, wherein, to connect to the consumer electronic device, the multiprotocol audio/voice device is configured to determine the second wireless protocol acceptable by the consumer electronic device based on information in the flash memory of the multiprotocol audio/voice device.
33. The system of claim 23, wherein the multiprotocol audio/voice device is a gateway.
34. A system of multiprotocol audio/voice devices comprising:
- a plurality of consumer electronic devices;
- a multiprotocol audio/voice device including: two or more communication circuits, each of which is configured to process an RF signal according to a distinctive wireless protocol; a multipoint control unit (MCU) configured to receive information reported by the two or more communication circuits, and manage a coexistence of multiple RF communication links over different wireless protocols; a microphone configured to receive a voice from a user and generate voice signals; a digital signal processor (DSP) configured to perform voice recognition analysis on the voice signals from the microphone, and employ a wake-up scheme to change an operational state of the multiprotocol audio/voice device on occurrence of a detectable event via the voice recognition analysis; and a flash memory configured to store a previous multiprotocol connection's configuration to reduce processing burden of the MCU upon a subsequent multiprotocol connection;
- the multiprotocol audio/voice device being configured to, in response to a voice command, connect to and utilize a cloud platform over a first wireless protocol, and connect to a consumer electronic device of the plurality of consumer electronic devices over a second wireless protocol.
35. The system of claim 34, wherein the first wireless protocol or the second wireless protocol comprises WiFi, ZigBee, Bluetooth, third generation mobile technology (3G), fourth generation mobile technology (4G), Long Range (LoRa), Z-Wave, IR remote, and Digital Enhanced Cordless Technology (DECT).
36. The system of claim 34, wherein, to connect to and utilize the cloud platform, the multiprotocol audio/voice device is configured to:
- connect to a router over the first wireless protocol; and
- instruct the router to connect to and utilize the cloud platform over an internet protocol (IP) connection.
37. The system of claim 34, wherein the plurality of consumer electronic devices are selected from the group consisting of: a speaker, a television, a lighting system, a telephone, a computer, a printer, a flash drive, an on-board diagnostics (OBD) dongle, a refrigerator, a coffee maker, a home security alarm, a security camera, a thermostat, and a heating, ventilation, and air conditioning (HVAC) device.
38. The system of claim 37, wherein the multiprotocol audio/voice device is configured to connect to the consumer electronic device over a wireless communication without internet.
39. the system of claim 38, wherein the multiprotocol audio/voice device is configured to process the voice command with the DSP, without connecting to the internet.
40. The system of claim 34, wherein the multiprotocol audio/voice device is selected from the group consisting of: a necklace, a button, a watch, eyeglasses, headphones, a hub, a remote, a speaker and an earpiece.
41. The system of claim 34, wherein, to connect to the consumer electronic device, the multiprotocol audio/voice device is configured to determine the second wireless protocol acceptable by the consumer electronic device.
42. The system of claim 34, wherein, to connect to the consumer electronic device, the multiprotocol audio/voice device is configured to determine the second wireless protocol acceptable by the consumer electronic device based on a location estimation.
Type: Application
Filed: Jan 4, 2021
Publication Date: Apr 29, 2021
Applicant: LIBRE WIRELESS TECHNOLOGIES INC. (Palo Alto, CA)
Inventor: Hooman KASHEF (Coto de Caza, CA)
Application Number: 17/141,152