Smart Acoustic Drum and Sing Music System
A system that wirelessly integrates actual drum equipment and singing equipment with a computer and the internet to allow musicians and or singers remotely located from one another to play music and or a competitive real or simulated music and or singing competition. An individual musician may opt to play music solo or practice to improve basic music, drumming, and or singing techniques. The system includes smart music and drum systems, an audio detection system, and drum motion sensing devices, all containing circuits and contact sensors or motion sensors, coupled with signal processing and radio frequency transmitter circuitry, thereby wirelessly communicating game performance information to a remote receiver-computer. The computer displays musician and or singing information, and visually simulates and controls a music and or a singing competition between two or more musicians, via the internet, having similar equipment and remotely located from each other. Standard drum sets may be retrofitted with the sensors and associated circuitry to convert such drum sets into “smart drum sets” for use with the system. Standard microphones may be retrofitted with the sensors and associated circuitry to convert such microphones into “smart microphones” for use with the system. The system employs specially developed computer software to process musician performance data, control the music competition, communicate music and information between musicians and or singers, generate and control visual simulations, and display singer and or musician performance information.
Latest Patents:
- Plants and Seeds of Corn Variety CV867308
- ELECTRONIC DEVICE WITH THREE-DIMENSIONAL NANOPROBE DEVICE
- TERMINAL TRANSMITTER STATE DETERMINATION METHOD, SYSTEM, BASE STATION AND TERMINAL
- NODE SELECTION METHOD, TERMINAL, AND NETWORK SIDE DEVICE
- ACCESS POINT APPARATUS, STATION APPARATUS, AND COMMUNICATION METHOD
This application is a divisional of U.S. patent application Ser. No. 12/799,520, filed Apr. 26, 2010, which is a divisional and claims the benefit and priority of U.S. patent application Ser. No. 09/570,233, filed May 12, 2000 and U.S. patent application Ser. No. 12/799,523, filed Apr. 26, 2010, all of which, in turn, claims the benefit and priority of U.S. provisional patent application 60/133,722, filed May 12, 1999, for all subject matter common hereto. The above referenced applications are incorporated herein by reference as if restated in full.
REFERENCE TO MICROFICHE APPENDIXA microfiche appendix including 1 microfiche with 27 frames accompanies and forms a part of this application.
FIELD OF INVENTIONThis invention relates to a smart musical instrument and smart singing system coupling real music and or singing equipment, and a computer. More particularly, this invention relates to a system wherein musical instruments, and singers, communicate wirelessly to a computer and thereby, if desired, to a remote participant or group via the internet.
BACKGROUND OF THE INVENTIONA number of patented drum and sing devices embody sensing components and software. Typically, these devices display music information that relates to a drummer's stroke and singing style. The information is displayed or signaled by the drum and smart singing systems or simulations of drum and smart singing systems via interactive software and electronics. None of these cooperates with drum strokes and singing styles that sense each actual drum stroke or strokes and or singing styles for local and or remote interactive drum and or singing musical interaction.
It is desirable to remotely communicate the actual performance location and music of the musician, whereby more sophisticated analysis and prediction possibilities are realizable via computer technology and state-of-the-art display music techniques. Furthermore, it is also desirable to use such performance information in an expanded capacity to provide interactive music, and singing competition, amongst numerous music and singing musicians in locations remote from each other.
SUMMARY OF INVENTIONThis invention relates to a system that interconnects real musical instruments or virtual music instruments and or singers to a computer. In a preferred embodiment, the computer is coupled wirelessly to one or more musical instruments and or singers. Furthermore, the invention, summarized below, allows one or more musicians and singers to enter into a competition against one another. Each musician and or singer logs-in to figuratively ask the computer who is available to practice or play music in a musical and or singing contest. Once a musician and or singer pairs up against another musician and or singer anywhere in the world and musical play and or singers sing, and then play ensues, the computer and display show each musical and singing participant's score via animation or graphics that preferably relate to a musician's and or singer's individual performance statistics. A single singer and or musician may practice singing or play music without a musician or singing opponent and improve basic musical rhythm and singing skills using the computer and music to track their performance. The system application is unlimited and much of this system can be used not only for music and singing competition on the Internet, but for other musical instruments and singers as well. Musical implements, and singers, with sensors attached according to this invention are used for training purposes, for interactive musical and singing internet competition. The technology can be used for training, competition, and the improvement of music response related reflexes and coordination. With little or no modification, the technology also has applications in medicine, particularly musical physical therapy.
1. Smart Drum InstrumentA wireless real or virtual drum instrument is constructed to contain, and or alternatively, a standard drum instrument is modified to contain multiple drum triggers, sensors, or a transducer array, located on the drum-head, and or face, and or hitting surface. Upon impact of the head of the drum with a drumstick, the impacted sensors produce detectable variances representing the magnitude and time duration of the drum-drumstick impact force, and or momentum, and the proximate location of such contact relative to a preferred location on the face of the drumhead. The variances are electronically processed into digitally coded information and remotely transmitted by an electrical communication circuit either contained within or attached to the drumhead and or drum-face.
In each of the drum instrument devices according to this invention, in an alternative embodiment, the transducers are or include piezo-active elements and or drum-triggers. As used herein “piezo-active” includes piezoelectric and or piezoresistive components. Piezo-active components are defined as components wherein the electrical properties of which, when the component is subjected to a physical force, vary. A drum-trigger converts energy produced by a drumstick into electrical impulses. The impulses are then supplied to the drum module (brain of the system).
The smart drum instrument system uses biofeedback to create an intelligent drum training and entertainment system. The smart drum instrument system is a diagnostic and analysis tool used to improve a drummer's skills by instantaneous visual and acoustic feedback, and cues, with little or no human intervention. The smart drum instrument system takes the generated data and reconstructs it into a useful a visual format, which can be presented in a variety of ways including, 3-dimensional animation. The smart drum instrument system integrated circuit and or circuits can be designed anywhere within the drum including the head and or drumstick.
The smart drum instruments have the means via its built-in microcontroller to process, analyze, and store, drumstick hitting pattern data, and transmit the drumstick hitting pattern data to the computer and or the Internet for further analysis. In playback mode, the smart drum instrument system memorizes how many times each sensor was struck. This allows the drummer to know his or her hitting pattern. Using a computer algorithm, we can analyze, and calculate, a drum stroke pattern having a personalized musical drumstick hitting detection system for each musician.
2. Smart Singing SystemThe smart singing system has a microphone attached and or is detachable to a singer. The smart microphone can be held in the hand of the singer or worn on the singer's chess area. A smart microphone that is hand-held, or worn on the singer, has a transducer built in, when touched by the singer and or impacted by the singer's hand, the sensor produces a detectable variance representing impact with the hand. The variance is electronically processed into coded information, and remotely transmitted by an electrical communication circuit for display and audio reproduction. In one alternative embodiment, the communication circuit is contained within the smart microphone. Preferably, the communication circuit for the smart microphone is located inside the stem.
The smart singing system uses biofeedback to create an intelligent voice and or music training entertainment system. The smart singing system is a diagnostic and analysis tool used to improve a singer's skills by visual and or acoustic feedback cues, with little or no human intervention. The smart singing system takes the generated data and reconstructs it into a useful visual format which can be presented in a variety of ways including 3-dimensional animation.
3. Wireless Signal Receiver and ComputerAt each remote player site, wireless radio frequency equipment receives the digitally coded transmitted signals from the drum set, the microphone, the drum swing motion sensing device, and audio feedback. The signals are demodulated and processed into serial binary data suitable for communications to the computer via either serial or parallel ports. As the game progresses, the computer under the control of the music and sing software, monitors and directs the flow of communications between the musicians and singers via the internet, and displays the music and singing game simulations, and performance information.
4. Computer Drumming Software SystemAt each remote player site, a computer under the control of the music and singing software, monitors and controls the sequential play of the musical and singing game, and interacts with the musical game and or singing player's game at the local site, and also competing musical and singing players at other remote sites via the internet. The software system generates the musical and singing game simulations for display and tracks each musical player's and singing player's performance as the musical and or singing game progresses. The above, and further features and advantages of the invention will be better understood with reference to the accompanying drawings, and the following detailed description of preferred embodiment.
As shown in
The smart drum system 20 has a head 40 and a stick 42. As shown in
In an alternative embodiment,
In a second alternative embodiment, to retrofit a standard drum, contact sensors 46 are part of an adapter 40 attached to an ordinary drumhead as seen in
A drumstick contacting any sensor 46, produces a detectable variance indicating the magnitude, and duration of a sensor-ball impact. The variance may be a change in resistance of a piezoresistive transducer or a voltage change in the case of a piezoelectric transducer. As shown in
A radio frequency transmitting circuit 58, receives the serial digital data from the microcontroller 56 and wirelessly transmits the information via an internal antenna 60 to a receiver 26 (
The smart microphone uses 22 in
A hand touching the smart microphone 60 and containing the sensor pad 65, 66, or 67 produces a detectable variance indicating the hand-sensor smart microphone event. The variance may be a change in resistance in the case of a piezoresistive transducer (similar, but not limited to Cooper Instruments LPM 562) or a voltage change in the case of a piezoelectric transducer. As illustrated in
A radio frequency transmitter circuit 74, receives the serial digital data from the microcontroller 72 and wirelessly transmits the information via an internal antenna 76 to the receiver 26 (
At each local and remote player site, a wireless radio frequency signal receiver 26 is connected to the computer 28 by either the serial (USB) or parallel computer ports, as shown in the functional block diagram,
At each remote player site, the computer 28 (
If competitive play mode has been selected, the program generates a player participation request and sends 134 the request to the GGC game internet server (GGC server) 34 (
If single music and or singer player practice mode is selected, the internet communications sequences are disabled, other software sequential operating routines continue as described above, and the player's drum system stroke, hand-smart microphone contact, and audio feedback information are communicated only to the computer located at that local players site. and the performance information analyzed and displayed only at the local players site.
When a game is won, lost, or terminated, the music and sing software system generates the appropriate output signals 156 (
The motion sensor plate 80 having a top motion plate 82 and a bottom motion plate 84 is diagrammatically shown in
Applying an energizing high frequency alternating electrical signal having a frequency in the range from 100 MHz to 200 MHz from an oscillator 87 to the motion plate capacitive network 88 produces an electromagnetic field above the surface of each platelet 83 of the capacitive components of the motion sensor plate 80. Any object, including a golf club, passing near the surface of the energized motion plate will cause a perturbation of the electromagnetic field as illustrated by the sample possible pathways 90 across the plate in
The electrical signal from the comparative amplifier network 92 is applied to an analog-to-digital signal converter 94 (ADC) and the ADC digitized output signal is converted into a serial digital data stream by a multiplexer 96. This data identifies each platelet having had its field disturbed. The serial digital data can be input directly by wire from a multiplexer 96 to the computer 28 located at the site of the player and motion sensor plate 80, or as in the preferred embodiment, illustrated in
The computer 28, under the control of the game system software, will analyze the serial digital club motion signal, recognize from the transmitted signals the platelets 83 over which the club head passed and display the golf club swing motion.
The motion sensors further comprise spatial orientation devices such as a gyro meter and an accelerometer to derive spatial orientation and or translational acceleration data housed inside or mounted to the golf club, sports implement, or gaming item. A gyroscope or equivalently a gyro meter is hereon and heretofore understood to be, and or comprise, spatial orientation devices, and each of the latter is understood to be included in the former.
When a game is won, lost, or terminated, the gaming software system generates the appropriate output signals 156 (
Using programming as contained in the accompanying microfiche appendix, one skilled in the art can readily accomplish the game programming described. Alternative programming will be apparent as well from the foregoing functional description and the illustrations contained in the appended drawings.
While a preferred embodiment has been described, it will be appreciated that many variations and modifications in the system, its operation, and its various components may be made without departure from the spirit and scope of invention as set forth in the appended claims.
Claims
1. A computerized interactive music and singing system comprising a local, and a remote player site; comprising a music implement, comprising: a drum; a drumstick; a musical instrument; and a smart microphone, comprising: a microphone with a sensor, attachable and or detachable to said musical instrument, said drum, and or said drumsticks; a first array of sensors, mounted on the face side of said drumhead of said drum; a second array of sensors, comprising a contact sensor mounted to said microphone; a first computer, programmed to process data derived from data acquired by said first and said second sensor arrays; a first communication link, for transmitting data derived from said data acquired by said first sensor array to said first computer; a second communication link, for transmitting data derived from said data acquired by said second sensor array to said first computer; a second computer, programmed to communicate with a remote player site; a display monitor, connected to said second computer; a third communication link, for transmitting data derived from said data acquired by said first computer to said second computer; and a fourth communication link, for transmitting data derived from said data acquired by said second computer to said first computer; wherein said second computer is further programmed to analyze the performance data of a person drumming said drum and or playing said musical instrument, and or acoustic data from said microphone.
2. The computerized interactive music and singing system as recited in claim 1, wherein said first computer is further programmed to send the results of said performance analysis to said second computer upon completion of said performance analysis via said third communications link.
3. The computerized interactive music and singing system as recited in claim 1, wherein said second sensor array, comprises a motion sensing device and or a motion detector, mounted internally and or externally to said drum set and or said musical instrument, and or internally or externally to said smart microphone or a sound implement.
4. The computerized interactive music and singing system as recited in claim 1, wherein said first sensor array comprises piezo-active transducers, and or drum-triggers, and or pressure sensors, and or force sensors.
5. The computerized interactive music and singing system as recited in claim 1, further comprising electronic circuitry for outputting to said first communications link, a signal representing the energy, and momentum, of a drumstick contact event with said drum, derived from data acquired by said first sensor array.
6. The computerized interactive music and singing system as recited in claim 5, wherein said electronic circuitry comprises a computing device mounted to said drum, and or a drum set, and or said musical instrument, and or said smart microphone, programmed to convert data acquired by said first sensor array, and said second sensor array, into a time-multiplexed serial digital data stream, containing a respective binary-coded word for each channel.
7. The computerized interactive music and singing system as recited in claim 1, wherein said second computer further comprises a competition server, connected to said second computer via a network, comprising a fourth communication link, wherein said second computer is further programmed to process data from said music implement, and or the competition server, representing the user performance of a competition at a remote site during the turn of said competitor; wherein said competition server selects remote players from a queue of awaiting players in response to a first musician, and or singer, indicating a readiness to compete.
8. The competition server system as recited in claim 7, wherein said music implement, and or said competition server, is programmed to establish connections amongst subscribing players at a plurality of remote locations via said network.
9. The competition server system as recited in claim 7, wherein said second computer is further programmed to create, and manage, a plurality of music and singing games, and or music and singing competitors, wherein said music and singing games comprise one or more first computers of opponents connected to said first computers, wherein each first computer comprises a network port for connecting to said network, a serial data port for receiving a serial data stream from a respective set of sensors designed to detect the motion of a respective music implement and or singing equipment items being manipulated by a respective musician and or a singer, and a port for connecting to its respective display monitor, wherein each first computer is programmed to perform the following: processing the digital data stream from said respective set of sensors into music and or singing game data; having a format representing music and or singing game results for said first computer player; controlling the respective display monitor via said second computer to provide visual feedback concerning the progress of the game; transmitting said game data from said first computer to said second computer that comprises data to be transmitted to said competition server; and said second computer polling said competition server for receipt of game data, and or messages, from opponents at remote sites.
10. The computerized interactive music and singing system as recited in claim 1, further comprising an electronic drum set and or a standard drum set, retrofitted with electronic devices, and an electronic smart microphone and or a standard microphone, retrofitted with electronic devices, operatively connected to said first computer.
11. A computerized interactive drum and music system, wherein said first computer programming comprises: a serial port listener software program, that receives acquired data from said first sensor array and said second sensor array; a socket event listener, that receives data from said competition server; and a main thread for alternately processing data received by either said socket event listener or said serial port listener in accordance with a sports competition format; wherein acquired data from said first sensor array, and said second sensor array, are processed by said first computer and the results are sent to said competition server only if data has been previously received from said competition server indicating that it is that musician and or singer's turn to play a music implement, and or sing, and or play a sound implement, otherwise, acquired data from said drum set, said drum set motion sensing device, said microphone, and or said computer, and or an audio system, is ignored if data has been previously received from said competition server indicating that it is a remote player's turn to play a musical implement and or sing; wherein controlling the reception of data received from said first sensor array, and said second sensor array is allowed only during that musician's and or singer's turn to play, thus allowing and controlling sequential play, the use of one or more said music implements, and or said drum sets, and the use of one or more said microphones.
12. The computerized interactive music and singing system as recited in claim 5, wherein said computer programming further comprises musician training software, providing training as a function of the data received from said music implement, said drum set, said drum motion sensing device, and said audio system.
13. The computerized interactive music and singing system as recited in claim 1, wherein said second computer further comprises audible drumming music image simulation and display software for displaying images that simulate the results of said performance analysis.
14. A computerized interactive drum system comprising: a drum; a drumstick; and a smart microphone, comprising a microphone with a sensor, attachable and or detachable to said drum; a drumstick; a row of sensors, mounted on said face of said drum set, for acquiring data from respective channels, and said acquired data representing a force, a time of contact, an energy, a frequency, and a position of impact of a drumstick relative to each impacted sensor on drumhead; an accelerometer, attached to said drum set, a music and or singing tool, a music implement, and or an audio implement, to detect spatial translational motion and or rotational orientation of a drumstick, adapted to sense acceleration along three orthogonal axes; a first computer having a data input port for receiving data and an output port for communicating with said display monitor of said first computer; a first communications link, for communicating data derived from said impact data acquired by said sensor array in said respective channels to said data input port.
15. The computerized interactive music and singing system as recited in claim 1, wherein said first communications link comprises a wireless transmitter housed inside and or attached to said drum set, and or smart microphone, and a wireless receiver coupled to an input port of said first computer.
16. The computerized interactive music and singing system as recited in claim 7, wherein said second computer further comprises audible image simulation and or display software for the display of real and or simulated musical implement images, and of participants, and the results of said performance analysis.
17. The computerized interactive music and singing system as recited in claim 7, wherein said second computer programming further comprises single local and remote musician training software providing training as a function of the data received from said drum, said drum motion sensing device, and said audio system.
18. The computerized interactive music and singing system as recited in claim 5, wherein said second communications link further comprises a wireless transmitter mounted inside said audio system, and a wireless receiver, coupled to an input port of said first computer.
19. The computerized interactive drum system of claim 14, wherein the first computer is adapted for at least one of identifying a stroke, recognizing an event, inferring the commencement of the event, inferring the conclusion of the event, identifying the stroke cycle, a measure of force, and a time duration, based on at least some of the information sensed by said first sensor array.
20. The computerized interactive music and smart singing system as recited in claim 17, wherein said second computer is further programmed to create and manage a plurality of games for musicians, wherein said games comprise one or more said computers of musical opponents connected to said first computers; wherein, each first computer comprises a network port for connecting to said network, a serial data port for receiving a serial data stream from a respective set of sensors designed to detect the motion of respective musical implements and or equipment items being manipulated by a respective musician, wherein each first computer is programmed to perform the following: processing the digital data stream from said respective set of sensors into game data, having a format representing game results of said musician; providing visual feedback concerning the progress of the game to said second computer operatively connected to the display monitor; transmitting said game data from said first computer to said second computer, comprising data from said music implements and or said drum sets.
Type: Application
Filed: Jun 12, 2020
Publication Date: Jan 21, 2021
Applicants: (Bronx, NY), (Salt Point, NY)
Inventors: Wilbert Quinc Murdock , Philip Alister Williams
Application Number: 16/899,627