Abstract: A speech-processing system may provide access to multiple virtual assistants via one or more voice-controlled devices. Each assistant may leverage language processing and language generation features of the speech-processing system, while handling different commands and/or providing access to different back applications. Different assistants may be available for use with a particular voice-controlled device based on time, location, the particular user, etc. The voice-controlled device may include components for facilitating user interaction with multiple assistants. For example, a multi-assistant component may facilitate enabling/disabling assistants, assigning gestures and/or wakewords, etc. The multi-assistant component may handle routing commands to a command processing subsystem corresponding to an assistant invoked by the command. The voice controlled device may further include observer components, each configured to monitor the voice-controlled device for invocations of a particular assistant.

Abstract: An information processing device includes a control part which receives an input of information indicating one or more times in a playback time of a musical piece, and generates a file including information pertaining to a timbre control performed from each of the one or more times; and a transmission part which transmits an audio signal of the musical piece and the information pertaining to the timbre control in the file to a device which outputs a synthetic sound of a playback sound of the musical piece and a playing sound of a musical instrument.

Abstract: An embodiment may involve a server device transmitting, over a wide area network, a first playlist with a first duration to a client device. Possibly while the client device is playing out a current audio file of a first plurality of audio files in the playlist, the server device may receive an instruction from the client device and generate a second playlist. The second playlist may include references to a second plurality of audio files, where playout of the second plurality of audio files may have a duration that is less than the duration of the playout of the first plurality of audio files. The server device may transmit, over the wide area network, the second playlist to the client device. Reception of the second playlist at the client device may cause the audio player application to retrieve and play out the second plurality of audio files.

Abstract: An autonomous driving system includes: a Human Machine Interface; and a control device configured to control autonomous driving of a vehicle, present a first operation instruction to a driver of the vehicle during the autonomous driving, the first operation instruction requesting the driver to perform a first response operation performed in response to a first request or a first proposal by presenting the first request or the first proposal to the driver via the Human Machine Interface, and prohibit presenting a second operation instruction different from the first operation instruction until the first response operation is completed or until a timing at which the first response operation is predicted to be completed, the second operation instruction requesting the driver to perform a second response operation performed in response to a second request or a second proposal by presenting the second request or the second proposal.

Abstract: A speech-processing system may provide access to multiple virtual assistants via one or more voice-controlled devices. Each assistant may leverage language processing and language generation features of the speech-processing system, while handling different commands and/or providing access to different back applications. Different assistants may be available for use with a particular voice-controlled device based on time, location, the particular user, etc. The voice-controlled device may include components for facilitating user interaction with multiple assistants. For example, a multi-assistant component may facilitate enabling/disabling assistants, assigning gestures and/or wakewords, etc. The multi-assistant component may handle routing commands to a command processing subsystem corresponding to an assistant invoked by the command. The voice controlled device may further include observer components, each configured to monitor the voice-controlled device for invocations of a particular assistant.

Abstract: In various embodiments, an alert personalization application personalizes in-vehicle alerts. The alert personalization application estimates an increase in a negative emotion associated with an occupant of a vehicle based on at least one characteristic of the occupant. Subsequently, the alert personalization application determines that the increase is associated with a negative reaction to an in-vehicle alert that has a first alert characteristic. In response, the alert personalization application determines that the first alert characteristic should be replaced with a second alert characteristic. The alert personalization causes another in-vehicle alert to be generated that has the second alert characteristic instead of the first alert characteristic. Advantageously, personalizing alert characteristics that influence how and/or when in-vehicle alerts are generated can increase the effectiveness of in-vehicle alerts and can improve driving safety.

Abstract: A timbre creation method, system, and computer program product include performing a timbre analysis of a sound from an input source to generate a digital fingerprint of the sound, performing deep learning to create a patch that matches the digital fingerprint, and generating a second patch for a synthesizer which reproduces a timbre that complements the digital fingerprint based on the patch.

Abstract: Exemplary embodiments described in this disclosure are generally directed to systems and methods for reducing anxiety in an occupant of a vehicle. In one exemplary method, a computer that is provided in a vehicle receives from a source such as a server computer, information that is used to determine a behavioral profile of an occupant of the vehicle. The computer utilizes the behavioral profile to identify a behavior characteristic of the occupant. The behavior characteristic is matched by the computer to one of various behavior categories such as an amaxophobia sufferer category or a controlling personality category. The computer then executes one or more operations in the vehicle based on the behavior category to which the occupant belongs. If the occupant belongs to the amaxophobia sufferer category, the computer may, for example, play an audio track, display a video clip, and/or change a driving characteristic of the vehicle.

Abstract: This invention eliminates most mechanical switching in vibrational pickup circuits by using variable gains to combine signals of sensors in differential amplifiers as J?1 humbucking pairs for J>1 number of sensors, with the sensors matched to produce the same level and phase of unwanted hum from external sources. It can also combine J>1 number of matched sensors with K>1 number of dissimilar sensors which are matched only to each other in the same manner. This produces not only all the possible mechanically switched humbucking signals, but all the continuously-varying combinations of humbucking signals in between.

Abstract: This invention continues and adds to the embodiments under Non-provisional patent application Ser. No. 16/840,644, adding circuits using small dual-coil humbucking pickups made to mount in the same holes as and replace single-coil pickups. It also develops circuits to match the value of tone capacitors to the lumped inductances of pickup circuits. A mechanical switching system for 3 single-sized humbuckers can produce 21 distinct tonal circuits from 48 different switch combinations, using a 6-way circuit switch and three 2-way mode switches. A digitally-controlled solid-state switching system can avoid the duplicate circuits, and control even more pickups for more tones.

Abstract: Gesture-controlled virtual reality systems and methods of controlling the same are disclosed herein. An example apparatus includes at least two of an on-body sensor, an off-body sensor, and an RF local triangulation system to detect at least one of a position or a movement of a body part of a user relative to a virtual instrument. The example apparatus includes a processor to generate an audio output of the virtual instrument in response to the at least one of the position or the movement.

Abstract: Systems, devices, and methods, etc., that provide digital audio toolboxes, music kits, digital audio tracks, etc., herein supply digital audio tracks such as music for combination with and synchronization with digital pre-existing media tracks. The toolkits, etc., herein provide users with visual tracks in media, to create, provide and/or synchronize precisely timed tracks used in audio media productions, or otherwise to provide multiple, precisely timed and synced tracks where a music/sound design track from the toolkits is added to a pre-made media track such as a visual footage.

Abstract: A sound generating analog synthesizer comprising a controller electronically connected to rotate at least one knob, actuate at least one switch, and make at least one patch connection; said knob comprising a drive system, a shaft position sensor, and a potentiometer; wherein said controller rotates at least one knob by generating instructions to said drive system; said at least one switch comprising an electronic connection to said controller to turn on or off said switch upon receiving instructions from said controller; and at least one patch connection, comprising at least one patch switch, wherein said at least one patch switch controls connection between at least one input of said patch and at least one output of said patch; and a control system to interpolate the potentiometer, switch and patch connections between at least two predetermined settings.

Abstract: The teachings described herein are generally directed to a system, method, and apparatus for separating and mixing tracks within music. The system can have a video that is synchronized with the variations in the musical tempo through a variable timing reference track designed and provided for a user of the preselected performance that was prerecorded, wherein the designing of the variable timing reference track includes creating a tempo map having variable tempos, rhythms, and beats using notes from the preselected performance.

Abstract: A self-adaptive management method and system thereof are provided. The method includes: sending, by a target AMA server based on pre-stored address information of at least one AMF server, first detection information to the at least one AMF server; receiving, by the at least one AMF server, the first detection information, and returning, by the at least one AMF server, first detection response corresponding to the first detection information to the target AMA server; receiving, by the target AMA server, the first detection response, selecting, by the target AMA server, a target AMF server from the at least one AMF server, and sending, by the target AMA server, a join request to the target AMF server; receiving, by the target AMF server, the join request, and adding, by the target AMF server, the target AMA server to a network node corresponding to the target AMF server.

Abstract: This invention develops the math and topology necessary to determine the potential number of tonally distinct connections of sensors, musical vibration sensors in particular. It claims the methods and sensor topological circuit combinations, including phase reversals from inverting sensor connections, up to any arbitrary number of sensors, excepting those already patented or in use. It distinguishes which of those sensor topological circuit combinations are humbucking for electromagnetic pickups. It presents a micro-controller system driving a crosspoint switch, with a simplified human interface, which allows a shift from bright to warm tones and back, particularly for humbucking outputs, without the user needing to know which pickups are used in what combinations. It suggests the limits of mechanical switches and develops a pickup switching system for dual-coil humbucking pickups.

Abstract: According to an aspect of the inventive concept, there is provided an apparatus for processing an output signal of an analog-digital converter, includes: a first frequency conversion unit for converting a frequency of the output signal of the analog-digital converter so that a band where spurious components exist moves to a band where direct current components exist in the output signal of the analog-digital converter; a spurious component blocking unit for eliminating, from an output signal of the first frequency conversion unit, spurious components which have moved to the band where direct current components exist; and a second frequency conversion unit for restoring a frequency of an output signal of the spurious component blocking unit to the original frequency of the output signal of the analog-digital converter.

Abstract: A pipelined run-to-completion processor includes no instruction counter and only fetches instructions either: as a result of being prompted from the outside by an input data value and/or an initial fetch information value, or as a result of execution of a fetch instruction. Initially the processor is not clocking. An incoming value kick-starts the processor to start clocking and to fetch a block of instructions from a section of code in a table. The input data value and/or the initial fetch information value determines the section and table from which the block is fetched. A LUT converts a table number in the initial fetch information value into a base address where the table is found. Fetch instructions at the ends of sections of code cause program execution to jump from section to section. A finished instruction causes an output data value to be output and stops clocking of the processor.

Abstract: A pipelined run-to-completion processor includes no instruction counter and only fetches instructions either: as a result of being prompted from the outside by an input data value and/or an initial fetch information value, or as a result of execution of a fetch instruction. Initially the processor is not clocking. An incoming value kick-starts the processor to start clocking and to fetch a block of instructions from a section of code in a table. The input data value and/or the initial fetch information value determines the section and table from which the block is fetched. A LUT converts a table number in the initial fetch information value into a base address where the table is found. Fetch instructions at the ends of sections of code cause program execution to jump from section to section. A finished instruction causes an output data value to be output and stops clocking of the processor.

Abstract: The invention relates to a microphone system (1) having a microphone module (2) and having a base station (3), wherein the microphone system (1) is designed to wirelessly transfer audio information (5) and additional information (6) from the microphone module (2) to the base station (3), wherein the microphone system (1), in particular the microphone module (2) is designed to transfer the additional information (5) and the audio information (6) via a common channel and/or in a common data stream.

Abstract: An electronic device is provided. The electronic device includes a display; a memory for storing at least one audio signal; a communication circuit configured to establish wireless communication with an external device; and a processor electrically connected with the display, the memory, and the communication circuit, wherein the memory stores instructions for, when executed, causing the processor to: produce the at least one audio signal, receive data associated with a gesture through the communication circuit from the external device apply a sound effect, selected based at least in part on the data associated with the gesture, to the produced at least one audio source, and output or store a resulting audio signal, wherein the resulting audio signal represents application of the sound effect to the produced at least one audio signal.

Abstract: An approach is provided in which an information handling system configures a reinforcement learning model based inspiration selections received from a user. The information handling system performs training iterations using the configured reinforcement learning model, which generates multiple actions and multiple rewards corresponding to multiple actions. The information handling system determines that the multiple rewards reach an empirical threshold and, in turn, generates a musical composition based on the multiple actions.

Abstract: Notwithstanding practical limitations imposed by mobile device platforms and applications, truly captivating musical instruments may be synthesized in ways that allow musically expressive performances to be captured and rendered in real-time. Synthetic musical instruments that provide a game, grading or instructional mode are described in which one or more qualities of a user's performance are assessed relative to a musical score. By providing a range of modes (from score-assisted to fully user-expressive), user interactions with synthetic musical instruments are made more engaging and tend to capture user interest over generally longer periods of time. Synthetic musical instruments are described in which force dynamics of user gestures (such as finger contact forces applied to a multi-touch sensitive display or surface and/or the temporal extent and applied pressure of sustained contact thereon) are captured and drive the digital synthesis in ways that enhance expressiveness of user performances.

Abstract: An electronic device is provided. The electronic device includes a touch screen display, at least one of a speaker and a sound interface, a processor configured to electrically connect to the touch screen display, the speaker, and the sound interface, and a memory configured to electrically connect to the processor. The memory stores instructions for, when executed, causing the processor to display at least one item comprising a musical instrument shape on the touch screen display, receive a touch input through the touch screen display, load sound data corresponding to the at least one item based on the touch input, process the sound data based at least in part on information associated with the touch input, and output the processed sound data through the speaker or the sound interface.

Abstract: A recording and entertainment system is provided. A mobile kiosk is capable or being outfitted with one or more cameras for capturing visual content, an audio recording system, a display device, a computer to control recording, storing, processing, and playing the captured visual and audio content. The captured video and audio are then processed and edited to produce remembrance products in various forms, including videos. Karaoke function is provided by a means for recognizing songs being performed and displaying lyrics on the display. Camera tilt, noise suppression, noise cancelation, voice control of the computer, a battery pack to free kiosk for movement, means for internet communication of the visual and audio content, means for confirming that objects of the visual content capture are within the field of view, robotic control of the kiosk, and interactive gaming means are additional features that can be utilized with the system.

Abstract: An exercise training system for facilitating tempo-based exercising using a computing device. The system includes a music library module having a plurality of selectable music files stored in a data storage device. The system includes a video instruction library module including a plurality of selectable video instruction files stored in a data storage device. The system includes a builder module to manage organization of selected music files and video instruction files into a coordinated music stream and a coordinated video instruction stream using a processor. The system includes a tempo registration module for selectably altering an effective tempo of each of the music stream and the video instruction stream to each match a selectable desired tempo using a processor. The system includes a tempo selection module to permit a user to select a value for the desired tempo.

Abstract: There is described a device and method for assigning a tag to a media file associated with metadata describing features of the media file. The metadata is converted into a query feature vector associated with the media file. A weighted distance is calculated between the query vector and each of a plurality of tag feature vectors, where each tag feature vector is included in a tag instance stored in a database, each tag instance further comprising a tag and a weight vector. The weighted distance is determined by comparing each feature of the query vector with the corresponding feature in the tag feature vector to obtain an initial distance value for that feature, modifying the initial distance value by a weight for that feature obtained from the weight vector in the tag instance to obtain a comparison value for that feature, and combining the comparison values of all of the features to obtain the weighted distance.

Abstract: A keyswitch with force feedback function includes a vibrating source, a switching circuit and a controller. The vibrating source is connected to a cap of the keyswitch. The switching circuit is switched on according to states of the keyswitch. The controller is electrically connected to the vibrating source and the switching circuit. When the switching circuit is switched on, the controller outputs a first driving signal to the vibrating source, and the vibrating source transmits a pressing vibration to the cap of the keyswitch. A period of the first driving signal is smaller than or equal to a predetermined period, a user can feel vibration of the keyswitch due to the pressing vibration.

Abstract: Technologies are generally described for a virtual instrument playing system.

Abstract: A reproduction apparatus (2) collects sounds on which spread codes are superimposed with a microphone (20) to calculate correlation values between the collected sound signals and the same spread codes as those of an apparatus which performed the superimposition to identify content reproduced by a reproduction apparatus (1) in accordance with the intensity of the peaks of the calculated correlation values. A control portion (22) identifies content which is correlated with the identified content and is necessary for the reproduction apparatus (2). The control portion (22) reads out the identified content data from a content data storage portion (25) to output the musical score data and the audio data to a display portion (23) and a reproduction portion (26), respectively. The display portion (23) displays the input musical score data on a screen, while the reproduction portion (26) reproduces the input audio data to generate sound signals.

Abstract: At a timing at which a music playing operation is made by way of a music playing member, it is determined whether the position coordinates of the music playing member belong to any of a plurality of regions arranged on a virtual plane based on layout information store in memory, and in a case of having determined as belonging to the region, it is determined whether the pitch angle of the music playing member detected by way of a pitch angle sensor belongs to the pitch angle range corresponding to the region, and in the case of having determined as belonging to the pitch angle range corresponding to the region, the generation of a sound of a musical note corresponding to the region is instructed.

Abstract: Methods are provided for adjusting a music output of a vehicle audio system based on driver movements performed while listening to the music. In one embodiment, a music output of a vehicle infotainment system is adjusted responsive to monitored user behavior inside a vehicle, the monitored user behavior manifesting a user mood. In another embodiment, the music output is adjusted based on each of a user mood and a control gesture, wherein both the user mood and the gesture are identified based on user information gathered from vehicle biometric sensors and cameras while music is playing inside the vehicle.

Abstract: The apparatus displays, on a display screen, an icon placement region having a time axis defined therein, and displays, in accordance with an input instruction, an icon image with which feature amount information of material data indicative of a sound material is associated. The apparatus further sets a type of a feature amount database, where material data and feature amount information of the material data are associated with each other, along the time axis in accordance with an input instruction. Then, the apparatus references the feature amount database of a type having correspondence relationship in time axis with an icon image to identify material data similar to the feature amount information corresponding to the icon image, and audibly generates a sound at timing corresponding to a position, on the time axis, of the icon image and with content corresponding to the identified material data.

Abstract: A musical playback amusement system is disclosed. A primary audio track defined by a plurality of time-sequence audio data elements and associated synchronization identifiers are loaded and played back on a first interactive device. A second interactive device is in communication with the first interactive device to receive playback synchronization commands that coordinates playback of a secondary track loaded on the second interactive device. The synchronization identifiers in the primary track are transmitted from the first to the second interactive device as the playback synchronization commands in coordination with the playback of the primary audio track.

Abstract: A control pedal includes a pedal body having a foot contact surface at an upper side; at least a sensing unit arranged on the foot contact surface for detecting a touch action and generating a sensor signal according to the detected touch action; a microprocessor arranged in an interior of the pedal body for generating an operation instruction according to the sensor signal; and a transmission unit for transmitting the operation instruction to an electronic device to control a page turning action, sound volume adjustment, or audio mode switch.

Abstract: In an audio analysis apparatus, a component acquirer acquires a component matrix composed of an array of component values, columns of the component matrix corresponding to the sequence of unit periods of an audio signal and rows of the component matrix corresponding to a series of unit bands of the audio signal arranged in a frequency-axis direction. A difference generator generates a plurality of shift matrices each obtained by shifting the columns of the component matrix in the time-axis direction with a different shift amount, and generates a plurality of difference matrices each composed of an array of element values in correspondence to the plurality of the shift matrices, the element value representing a difference between the corresponding component values of the shift matrix and the component matrix.

Abstract: Techniques have been developed for capturing and rendering musical performances on handheld or other portable devices using signal processing techniques suitable given the somewhat limited capabilities of such devices and in ways that facilitate efficient encoding and communication of such captured performances via wireless networks. The developed techniques facilitate the capture, encoding and use of gesture streams for rendering of a musical performance. In some embodiments, a gesture stream encoding facilitates audible rendering of the musical performance locally on the portable device on which the musical performance is captured, typically in real time. In some embodiments, a gesture stream efficiently codes the musical performance for transmission from the portable device on which the musical performance is captured to (or toward) a remote device on which the musical performance is (or can be) rendered.

Abstract: A method for outputting data by using a proximity sensor in a mobile device is provided. The method includes emitting light in a proximity sensing mode and detecting light reflected by a gesture, processing a signal of the detected light, comparing the processed signal with a preset value, providing comparison data based on the compared signal with the preset value, and outputting data converted based on a result of analyzing the comparison data.

Abstract: A system and method is disclosed that facilitates the processing of a sound signal. In embodiments, an input sound signal can be processed according to a computational model using predetermined parameters. A sound signal originating from a musical instrument can be processed according to coefficients that are generated using a learning model.

Abstract: A method and system for generating a synthetic simulation of a media recording is disclosed. One embodiment accesses a sound reference archive and heuristically creates a new sound that is matched against at least one sound in the sound reference archive. The media recording is analyzed and a synthetic sound based on the analyzing of the media recording is generated.

Abstract: A sound capture device is affixed to an acoustic instrument to capture the natural sound output of the instrument. The captured sound signal is routed to an electronic sound augmentation system that is configured to augment the captured sound with spatial sound effects such as reverb, echo, delay, etc. The processed and augmented sound is then reproduced via a vibrating driver that has been affixed to the body of the acoustic instrument. This creates a situation where the body of the musical instrument, responding to a series of vibrations produced by the vibrating driver, acts as a speaker component, reproducing a rich augmented sound output that comprises the sum of the sound produced by the original sound production capabilities of the acoustical instrument plus the added augmented or enhanced sound effects.

Abstract: Disclosed herein are systems, methods, and computer readable-media for adaptive content rendition, the method comprising receiving media content for playback to a user, adapting the media content for playback on a first device in the user's first location, receiving a notification when the user changes to a second location, adapting the media content for playback on a second device in the second location, and transitioning media content playback from the first device to second device. One aspect conserves energy by optionally turning off the first device after transitioning to the second device. Another aspect includes playback devices that are “dumb devices” which receive media content already prepared for playback, “smart devices” which receive media content in a less than ready form and prepare the media content for playback, or hybrid smart and dumb devices. A single device may be substituted by a plurality of devices.

Abstract: An index calculating unit calculates a tonality index of a signal component of each area of the input signal transformed into a time frequency domain based on intensity of the signal component and a function obtained by approximating the intensity of the signal component. A similarity calculating unit calculates a similarity between a feature quantity in each area of the input signal obtained based on the index and the feature quantity in each area of the reference signal obtained based on the index calculated on the reference signal transformed into the time frequency domain. A music identifying unit identifies music of the input signal based on the similarity. The present technology can be applied to a music search apparatus that identifies music from an input signal.

Abstract: An input image of a customizable product comprising a markup is partitioned into a plurality of image regions based on color and color differences. The partitioning comprises assigning a color difference value to plurality of locations within the input image. The partitioning further comprises assigning each of the plurality of locations to an image region of the plurality of image regions, where the assigning occurs according to a particular order. The particular order is based at least in part on color difference values associated with the plurality of locations. Data representing at least a particular portion of the markup in the input image based on the partitioning is identified. Data representing at least the portion of the markup is used in a visualization of the customizable product or a manufacturing control associated with the customizable product.

Abstract: An apparatus for signal processing, wherein a disc is placed on a turntable and is provided with a groove which can be followed by the pick-up element, and employing a time-code signal wherein during use of the disc the said time-code signal controls the digital audio source.

Abstract: In an un-tuned state, the strings of a string instrument are excited, and a standard adjustment factor is determined for each string. When a pitch is generated as a result of a string being strummed (e.g., during normal playing of the instrument), the pitch generated by the string is adjusted by the standard adjustment factor and an intonation adjustment factor that accounts for intonation errors. An adjusted pitch is output that is in-tune and has accurate intonation.

Abstract: Described is a technology by which a playback list comprising similar songs is automatically built based on automatically detected/generated song attributes, such as by extracting numeric features of each song. The attributes may be downloaded from a remote connection, and/or may be locally generated on the playback device. To build a playlist, a seed song's attributes may be compared against attributes of other songs to determine which other songs are similar to the seed song and thus included in the playlist. Another way to build a playlist is based on similarity of songs to a set of user provided-attributes, such as corresponding to moods or usage modes such as “resting” “reading” “jogging” or “driving” moods/modes. The playlist may be dynamically adjusted based on user interaction with the device, such as when a user skips a song, queues a song, or dequeues a song.

Abstract: An object of the present invention is to provide a musical performance device by which the arrangement of a virtual musical instrument set is suitably changed based on the position of the instrument player, and whereby the instrument player need not play in an uncomfortable position. In the present invention, set layout information includes standard set layout information that serves as reference for the arrangement of a plurality of virtual pads, and a CPU judges whether an operation to form a square has been performed with a pair of drumstick sections. When judged that this operation has been performed, the CPU uniformly adjusts the arrangement of the virtual pads based on preset position coordinates on a captured image plane corresponding to the standard set layout information and the position coordinates of the drumstick sections on the captured image plane at the time of the operation to form a square.

Abstract: Disclosed are a portable terminal with a music performance function and a method for playing a variety of musical instruments. The method includes: selecting a particular piece of music and a particular musical instrument from the portable terminal, according to a user request, and executing a music performance mode corresponding to the selected musical instrument; detecting a first input signal input to a screen according to the selected musical instrument in the musical performance mode; determining, if the first input signal is detected, whether a second input signal for executing audio source data is detected; analyzing the first and second input signals, in association with each other; and outputting audio source data of the selected music, according to the analyzed result, via audio signals.

Abstract: An object of the present invention is to provide a musical performance device by which layout information, such as information regarding the arrangement of a virtual musical instrument set, can be quickly and easily changed during musical performance and whereby the variety of musical performance can be increased. In the present invention, a CPU identifies a musical tone associated with a virtual pad in an area where the position coordinates of a marker section are located in an image captured by a camera unit section at a shot timing by a drumstick section, and emits the identified musical tone. When the position coordinates of the marker section in an image captured at a shot timing are within the area of a control pad on a virtual plane, the CPU switches processing target set layout information to other set layout information among a plurality of set layout information.