Abstract: An arithmetic processing apparatus, includes a memory; and a processor coupled to the memory and the processor configured to: estimate an optical flow between consecutive frames of a moving image, and generate a sound wave corresponding to a target moving image, based on an optical flow estimated for the target moving image, and a deep neural network that generates a sound wave corresponding to an input optical flow and that has performed learning, by associating with time, an optical flow estimated for a moving image with sound wave and a sound wave of the moving image with sound wave.

Abstract: An apparatus for emulating a variety of string instruments with a variety of configurations in order to measure the resulting, actual tension of a string on that instrument. The tension may be measured in real-time.

Abstract: A sensor includes: an upper electrode; a lower electrode provided facing the upper electrode; an upper electrode support portion provided in an upper portion of the upper electrode; a deforming portion provided at both ends of the upper electrode support portion and enabling a distance between the upper electrode and the lower electrode to be changed; a rotatable actuator arranged facing the upper electrode support portion; and a member arranged between the upper electrode support portion and the actuator, and capable of moving relative to at least one of the actuator and the upper electrode support portion when the actuator presses the upper electrode support portion.

Abstract: In the prior art, in electronic picture books having a functionality in which scrolling is performed such that an image seems to be moved when a screen is stroked by a hand, it has not been possible to achieve a special representation that greatly surprises the reader by using the scroll functionality. To solve this problem, provided herein is an electronic picture book in which a partial range of an image is displayed and a display range of the image changes due to the screen being stroked by a hand, shapes, colors, and special effects of element images sequentially change in coordination with change to the display range, and a manner and an extent of the change differ depending on the element image. Moreover, the shapes, colors, and special effects of these element images also undergo a different change in coordination with elapsing of time.

Abstract: A software operated method/system for both breathing training and respiratory muscle training in which a user inhales and exhales via a mouthpiece through a hand-held breathing chamber so that pressure, time and direction of air breathed through the chamber is automatically measured. The breathing results are automatically processed and displaying on a remote screen as a real-time interactive graphic representing such air pressure, time and direction. The users base-line is established and a menu of training choices including interactive games is displayed.

Abstract: The present invention provides, for musical instruments such as organs, action-magnets and action-magnet drivers that facilitate reduction of wiring, connections, and logic circuitry. Some embodiments of present invention provide stop action-magnets, also called SAM's, comprising integral drive circuitry and, which may further comprise additional integral circuitry. Embodiments of this invention may comprise, logic circuits such as a shift-register cells, micro-controllers, or both. Some embodiments of this invention comprise shift-cells and registers combining both SIPO and PISO functions for addressing SAM's. A single-coil SAM embodiment of the present invention may respond to signals intended to operate traditional two-coil SAM's. In another embodiment, a pipe action-magnet driver comprises logic circuitry. In yet another embodiment a pipe action-magnet comprises an integral driver that further comprises logic circuitry.

Abstract: An optoelectronic pickup for a musical instrument includes at least one light source which directs light to impinge a sound generating element of the musical instrument in at least one photoreceiver located to detect the reflected light, so as to generate an electrical signal that is responsive to sound generating element movement.

Abstract: Embodiments generally relate to sensing key press activation. In one embodiment, a method includes providing a signal in an electronic device. The method further includes causing the signal to reflect off of a key of the electronic device. The method further includes determining a movement of the key based on a reflection of the signal.

Abstract: An acoustic instrument is fitted with a flexible member that is fitted into the instrument and attached to the bridge of the instrument in such a fashion that the member vibrates freely in sync with the instrument. A compact optical pickup unit is attached to the flexible member in an arrangement comprised of cooperating optoelectronic devices which are mechanically isolated from the vibrations of the instrument and are positioned on the member. The member interferes with, and when stationary entirely obstructs, the path of a light beam generated by a light emitting device (LED) which is directed towards a light receiving device, the frequency and intensity of the vibrations of the member modulating the frequency and intensity of the light from the LED impinging on the receiving device. The result is an electronic output signal that corresponds to both the frequency of the note (or notes) played and to the tonal quality of the acoustic instrument on which the pickup is mounted.

Abstract: A sensor obtains an angular rate of a stick member. A sound source map includes plural areas disposed in a virtual space. CPU presumes a direction of a turning axis of the stick member based on the angular rate obtained by the sensor, while a user is operating the stick member, calculates an angular rate of a top of the stick member based on the angular rate obtained by the sensor with the angular rate in the longitudinal direction of the stick member removed, calculates a position of the holding member in the virtual space after a predetermined time, based on the recent direction of the turning axis of the stick member and recent angular rate of the top of the stick member, and sends a sound generating unit a note-on event of a musical tone assigned to an area corresponding to the calculated position among the plural areas.

Abstract: A musical instrument (1) includes a stick (10) to be held by a player and provided with a marker (15) at a leading end that emits light and switches off; a camera unit (20) that captures an image of the player holding the stick (10); and a center unit (30) that generates a percussion instrument sound based on a position of the marker (15) while emitting light in image-capture space captured by the camera unit (20), in which the stick (10) causes the marker (15) to emit light under the condition of detecting start of a down swing movement by the player, and causes the marker (15) to switch off under the condition of detecting the end of this movement.

Abstract: A human interface device may include at least one analog control pressure surface that may operate in conjunction with at least one optical tube assembly (OTA) to allow precision human control of signal modulation, such as an audio signal being generated by a musical instrument. Each OTA may be incorporated within a body and may include a tube and an emitter-sensor pair wherein when pressure is applied to at least one of the pressure surfaces, the amount of light transferred within a sensor-emitter pair of an OTA is altered to selectively effect the signal modulation. Any type of control range may be expressed that depends on dynamic range and “touch” control. Accordingly, the human interface device may allow more “feeling” or expressiveness through application of pressure rather than positioning.

Abstract: A musical instrument location transmitting device and system includes a musical instrument having a location transmitting device and an electric power source permanently secured in the musical instrument in a position that requires removal of a musical component of the musical instrument in order to remove the location transmitting device. The location transmitting device includes a location sensing unit and a wireless transmitter that outputs a location of the musical instrument. A system wirelessly monitors a location of the musical instruments. A method of making a musical instrument includes coupling a location transmitting device inside a musical instrument and closing the musical instrument to permanently install the location transmitting device.

Abstract: An optoelectronic pickup for a musical instrument includes at least one light source which directs light to impinge a sound generating element of the musical instrument in at least one photoreceiver located to detect the reflected light, so as to generate an electrical signal that is responsive to sound generating element movement.

Abstract: A programmable pickup director switching system for a musical instrument having a plurality of pickup coils and a pickup director control board communicatively interconnected to the plurality of pickup coils. The system also includes a push/pull potentiometer structured and arranged to activate different combinations of one or more of the plurality of pickup coils, a main multi-position switch having m positions, and a bank select switch having n positions. Additionally, the system includes a switching matrix configured to switch one or more of the plurality of pickup coils into a signal path based on a position of at least one of the main multi-position switch, the bank select switch and the push/pull potentiometer.

Abstract: Systems and methods for a digital instrument are described, for example to simulate or be used in conjunction with a stringed instrument. A sensor system detects the location of one or more fingers or objects at selected locations on a playing surface of the instrument, and the detected locations are combined with information indicative of one or more strings being played to generate a digital signal containing information as to the notes being played.

Abstract: A controller configured to interactively control images, such as visual images including video images in interactive-multi-media including video games and the like. In one preferred embodiment, a controller is configured to generate a plurality of electromagnetic beams, whereby the user may selectively interrupt one or more of the electromagnetic beams to generate, control, or manipulate a visual image, rendered on a display. Advantageously, the user may control the visual image without having to physically depress buttons, to control one or more visual subjects.

Abstract: An electronic musical instrument includes a plurality of touch sensors each configured to generate an electrical signal representative of a musical note in response to being touched by a user, one or more proximity sensors each configured to generate an electrical signal representative of a musical key based on a distance between the user and the sensor, a controller configured to generate electrical signals representative of sound based on the electrical signals from the plurality of touch sensors and one or more proximity sensors, and one or more transducers configured to generate sound based on the electrical signals generated by the controller.

Abstract: A human interface device may include at least one analog control pressure surface that may operate in conjunction with at least one optical tube assembly (OTA) to allow precision human control of signal modulation, such as an audio signal being generated by a musical instrument. Each OTA may be incorporated within a body and may include a tube and an emitter-sensor pair wherein when pressure is applied to at least one of the pressure surfaces, the amount of light transferred within a sensor-emitter pair of an OTA is altered to selectively effect the signal modulation. Any type of control range may be expressed that depends on dynamic range and “touch” control. Accordingly, the human interface device may allow more “feeling” or expressiveness through application of pressure rather than positioning.

Abstract: A mobile replacement-dialogue recording system enables the creation of replacement-dialogue items by mobile users not at a media recording studio. Studio-users prepare guide media video, audio and text data which are made available to mobile users through a media server. A mobile user's mobile replacement-dialogue recording device obtains guide media and allows the user to view the guide media in rehearsal mode. The mobile replacement-dialogue recording device then records the mobile user's dialogue performance while presenting the mobile user with synchronized guide media. The mobile user can review, delete, and rerecord the resulting potential replacement dialogue, as well as create feedback media characterizing the replacement dialogue. Selected replacement dialogue items can be transmitted to the media server. A studio-module can then obtain the selected replacement dialogue items and feedback media from the media server so that they may be used in media-replacement.

Abstract: An optoelectronic pickup for a musical instrument includes at least one light source which directs light to impinge a sound generating element of the musical instrument in at least one photoreceiver located to detect the reflected light, so as to generate an electrical signal that is responsive to sound generating element movement.

Abstract: An acoustic instrument is fitted with a flexible member that is fitted into the instrument and attached to the bridge of the instrument in such a fashion that the member vibrates freely in sync with the instrument. A compact optical pickup unit is attached to the flexible member in an arrangement comprised of cooperating optoelectronic devices which are mechanically isolated from the vibrations of the instrument and are positioned on the member. The member interferes with, and when stationary entirely obstructs, the path of a light beam generated by a light emitting device (LED) which is directed towards a light receiving device, the frequency and intensity of the vibrations of the member modulating the frequency and intensity of the light from the LED impinging on the receiving device. The result is an electronic output signal that corresponds to both the frequency of the note (or notes) played and to the tonal quality of the acoustic instrument on which the pickup is mounted.

Abstract: An optoelectronic pickup for a musical instrument includes at least one light source which directs light to impinge a sound generating element of the musical instrument in at least one photoreceiver located to detect the reflected light, so as to generate an electrical signal that is responsive to sound generating element movement.

Abstract: A optoelectronic pickup for a musical instrument includes at least one light source which directs light to impinge a string of the musical instrument in at least one photoreceiver located to detect the reflected light, so as to generate an electrical signal that is responsive to string vibrations. A number of dissimilar filter approaches are included to control undesired effects of spurious light, the filter approaches may be structure-based, signal processing-based, and/or optics-based.

Abstract: The free-space gesture MIDI controller technique described herein marries the technologies embodied in a free-space gesture controller with MIDI controller technology, allowing a user to control an infinite variety of electronic musical instruments through body gesture and pose. One embodiment of the free-space gesture MIDI controller technique described herein uses a human body gesture recognition capability of a free-space gesture control system and translates human gestures into musical actions. Rather than directly connecting a specific musical instrument to the free-space gesture controller, the technique generalizes its capability and instead outputs standard MIDI signals, thereby allowing the free-space gesture control system to control any MIDI-capable instrument.

Abstract: An optoelectronic pickup for a musical instrument includes at least one light source which directs light to impinge a sound generating element of the musical instrument in at least one photoreceiver located to detect the reflected light, so as to generate an electrical signal that is responsive to sound generating element movement.

Abstract: The invention provides a music controller, in the form of a bowing sensor. The music controller comprises a musical bow member (4) movable over a guide (2). Associated with the guide (2) is at least one optical flow sensor (6) for monitoring the speed and/or angle of the musical bow member (4) when it is moved longitudinally in contact with the guide, and optionally a pressure sensor (14) for monitoring the pressure of the bow member on the guide. That monitored data, combined with input from a keyboard or ribbon controller (16) enables an attached sound generating device (12) to generate sound that emulates the sound of a real bowed performance or other desired output.

Abstract: A harp comprising a body, a set of strings attached to the body, an optical pickup to generate an analog signal produced by the vibration of a string within the set of strings, at least one circuit board to convert the analog signals to a corresponding digital signal, wherein the digital signal is then processed.

Abstract: An optoelectronic pickup for a musical instrument includes at least one light source which directs light to impinge a string of the musical instrument in at least one photoreceiver located to detect the reflected light, so as to generate an electrical signal that is responsive to string vibrations. A number of different filter approaches are disclosed that can control undesired effects of spurious light. The filter approaches may be structure-based, signal processing-based, and/or optics-based.

Abstract: An optoelectronic pickup for a musical instrument includes at least one light source which directs light to impinge a sound generating element of the musical instrument in at least one photoreceiver located to detect the reflected light, so as to generate an electrical signal that is responsive to sound generating element movement.

Abstract: The invention provides a music controller, in the form of a bowing sensor. The music controller includes a musical bow member (4) movable over a guide (2). Associated with the guide (2) is at least one optical flow sensor (6) for monitoring the speed and/or angle of the musical bow member (4) when it is moved longitudinally in contact with the guide, and optionally a pressure sensor (14) for monitoring the pressure of the bow member on the guide. That monitored data, combined with input from a keyboard or ribbon controller (16) enables an attached sound generating device (12) to generate sound that emulates the sound of a real bowed performance or other desired output.

Abstract: The present invention relates to an interactive sound-and-light art device with wireless transmission and sensing functions, which is primarily composed of a plurality of acoustic sensor nodes in artistic shapes, whereas each of the plural acoustic sensor nodes is designed to interact with people through the detection of multi-track music playing or voice-based exhibition of twitter conversations. Substantially, each acoustic sensor node is an artistically-shaped frame having a plurality of sensors embedded therein, which includes sensors for detecting environmental information, and sensors for detection human motion. Moreover, each artistically-shaped frame can further be embedded with interactive components, using which each acoustic sensor node is able to interact with people through multi-track music playing or exhibition of LED light variations, according to the detection of its environment sensors and human motion sensors.

Abstract: A laser pick-up apparatus and method for a stringed musical instrument. The laser pick-up includes a laser diode affixed to the musical instrument. The laser diode is capable of generating a laser beam. The laser pick-up also includes a photodetector affixed to the musical instrument adjacent the laser diode. The photodetector is capable of detecting light from the laser beam. The photodetector includes a conversion mechanism for converting the detected light into electrical signals. The laser diode is positioned on the musical instrument to direct the laser beam toward the string. The laser beam is reflected off the string and received by the photodetector. The photodetector then converts the detected light from the reflected laser beam into electrical signals which provide sound to an amplifier.

Abstract: Systems and methods for a digital instrument are described, for example to simulate or be used in conjunction with a stringed instrument. A sensor system detects the location of one or more fingers or objects at selected locations on a playing surface of the instrument, and the detected locations are combined with information indicative of one or more strings being played to generate a digital signal containing information as to the notes being played.

Abstract: An optoelectronic pickup for a musical instrument includes at least one light source which directs light to impinge a string of the musical instrument in at least one photoreceiver located to detect the reflected light, so as to generate an electrical signal that is responsive to string vibrations. A number of different filter approaches are disclosed that can control undesired effects of spurious light. The filter approaches may be structure-based, signal processing-based, and/or optics-based.

Abstract: The invention provides a music controller, in the form of a bowing sensor. The music controller comprises a musical bow member (4) movable over a guide (2). Associated with the guide (2) is at least one optical flow sensor (6) for monitoring the speed and/or angle of the musical bow member (4) when it is moved longitudinally in contact with the guide, and optionally a pressure sensor (14) for monitoring the pressure of the bow member on the guide. That monitored data, combined with input from a keyboard or ribbon controller (16) enables an attached sound generating device (12) to generate sound that emulates the sound of a real bowed performance or other desired output.

Abstract: A harp comprising a body, a set of strings attached to the body, an optical pickup to generate an analog signal produced by the vibration of a string within the set of strings, at least one circuit board to convert the analog signals to a corresponding digital signal, wherein the digital signal is then processed.

Abstract: Photodiodes in combination with an amplifier of transimpedance configuration provides an optical vibration detector having a linear frequency response with a light emitter and sensor of sufficiently small size to be inserted between strings of a musical instrument in order to provide signals suitable for amplification. The frequencies of vibrating strings of a musical instrument can be converted in accordance with either of two converter embodiments to control a music synthesizer, an automatic music transcription arrangement or the like.

Abstract: An optoelectronic pickup for a musical instrument includes at least one light source which directs light to impinge a sound generating element of the musical instrument in at least one photoreceiver located to detect the reflected light, so as to generate an electrical signal that is responsive to sound generating element movement.

Abstract: Systems and methods for a digital instrument are described, for example to simulate or be used in conjunction with a stringed instrument. A sensor system detects the location of one or more fingers or objects at selected locations on a playing surface of the instrument, and the detected locations are combined with information indicative of one or more strings being played to generate a digital signal containing information as to the notes being played.

Abstract: An optical fiber connector includes a housing, a plurality of lenses fixed to the housing, a plurality of optical fibers, and a glue. The housing defines a plurality of blind holes and receiving cavities. Each blind hole includes a first receiving hole portion. Each receiving cavity is in communication with the corresponding first receiving hole portion. Each optical fiber is received in the corresponding blind hole and includes a core portion. The glue is applied in each receiving cavity and fixes the optical fibers in the housing. Along a lengthwise direction of each blind hole, a projection of each receiving cavity on a plane perpendicular to the lengthwise direction covers that of the core portion. The glue surrounds the core portion, and a distal end of the core portion contacts an inner surface of the housing in the corresponding receiving cavity facing the respective blind hole.

Abstract: An optoelectronic pickup for a musical instrument includes at least one light source which directs light to impinge a string of the musical instrument in at least one photoreceiver located to detect the reflected light, so as to generate an electrical signal that is responsive to string vibrations. A number of different filter approaches are disclosed that can control undesired effects of spurious light. The filter approaches may be structure-based, signal processing-based, and/or optics-based.

Abstract: A technique for combining music and choreographed movement improves physiological and cognitive processes through purposeful movement to a steady beat. Users perform examples of the technique by purposefully executing one or more movement instructions in time with one or more musical selections. The movement instructions require concentration on both the beat pattern of the music and on the movement pattern to execute the movement instruction successfully.

Abstract: Systems and methods for a digital instrument are described, for example to simulate or be used in conjunction with a stringed instrument. A sensor system detects the location of one or more fingers or objects at selected locations on a playing surface of the instrument, and the detected locations are combined with information indicative of one or more strings being played to generate a digital signal containing information as to the notes being played.

Abstract: A sound pickup for musical cymbals includes an integrated assembly attachable to a cymbal stand. The integrated assembly includes a plurality of microphones arranged to achieve optimal quality and relatively constant loudness regardless of cymbal tilt. In one embodiment, two microphones are used, with signal phase from one microphone being inverted prior to combination with the signal from the other microphone. An illumination system having one or more light sources and a controller is optional. The controller includes a processor couplable to the pickup by way of a cable having at least one signal conductor for delivering audio signals from the microphone to the processor. The controller also includes an illumination control signal source delivering a DC voltage bias to the pickup for actuating the light sources.

Abstract: Systems are shown herein for use in stringed musical instruments for producing digital frequency and volume data. A finger contact sensor system detects the location of one or more fingers or objects at selected locations on a finger board of the instrument. Further string movement sensor systems determine if one or more strings are being played. A control system processes information from the finger contacting and string movement sensor systems to generate a digital signal containing the frequency data corresponding to the finger contacting point on the finger board and volume data corresponding to the sensed movement of a corresponding string.

Abstract: The present invention proposes a new system for reproducing of sound of musical instruments through the detection of acoustic vibrations by using fiber optic sensors, preferably fiber Bragg gratings. This system has the potential to be immune to radio-frequency interference and may provide a faithful representation of the instrument's acoustic spectrum without distorting the sound of the instrument.

Abstract: An optical pickup transducer senses vibrations of string instruments transducing the vibrations into an electrical signal with fidelity, high signal-to-noise ratio and with exclusion of extraneous effects such as noise. The transducer includes a housing with an upper deck that holds one or more light emitters, and a lower deck that holds light sensors in a one-to-one arrangement with the emitters so that each sensor is physically in opposition to each emitter. For application to the string instruments, each string is conducted through the light beam between an emitter and a sensor. The sensors may be photodiodes, so that their electrical output is related to the amount of incident light and therefore varies with the movement of the string, that is, the string modulates the incident light on the photodiode. This electrical output is then amplified to drive a loudspeaker.

Abstract: An optoelectronic pickup for a musical instrument includes at least one light source which directs light to impinge a string of the musical instrument in at least one photoreceiver located to detect the reflected light, so as to generate an electrical signal that is responsive to string vibrations. A number of different filter approaches are disclosed that can control undesired effects of spurious light. The filter approaches may be structure-based, signal processing-based, and/or optics-based.

Abstract: A removable electronic drum head for an acoustic drum is disclosed. The electronic drum head includes an elastic strike layer, a rigid plate centered below the elastic strike layer. A first sensor is attached to a bottom surface of the rigid plate. A structural body supports the elastic strike layer, rigid plate and first sensor. The structural body is further adapted to attach to an acoustic drum. Other optional foam layers may be included above and below the rigid plate.