Abstract: A method of processing sound includes arranging objects of a plurality of performers in a virtual space. The method also includes receiving a plurality of sound signals respectively corresponding to the plurality of performers. The method also includes obtaining, using a trained model, sound volume adjustment parameters respectively for the plurality of performers. The trained model is trained to learn a relationship between each sound signal, among the plurality of sound signals, that corresponds to each performer of the plurality of performers and each sound volume adjustment parameter, among the sound volume adjustment parameters, that corresponds to the each sound signal. The method also includes adjusting and mixing sound volumes respectively of the plurality of sound signals based on the sound volume adjustment parameters obtained using the trained model.

Abstract: A model data control method includes receiving first model data of a performer and second model data of an instrument, receiving calibration data related to a size of the performer or the instrument, receiving motion data of the performer, correcting the first model data or the second model data, using the calibration data, rendering the first model data and the second model data after the correcting, and controlling the first model data using the motion data

Abstract: A control device in one embodiment includes a first transmission unit, a first receiving unit, and a first generation unit. The first transmission unit is configured to transmit first performance data including contents of playing a keyboard instrument at a first communication base to a second communication base. The first receiving unit is configured to receive second performance data from the second communication base. The first generation unit is configured to generate a drive signal to produce a sound in accordance with the second performance data and output the drive signal to a sound generation device at the first communication base. At least one of the first performance data and the second performance data includes a key position signal indicating a key press amount on the keyboard instrument.

Abstract: A method for outputting data according to an embodiment includes acquiring performance data generated by a performance operation, specifying a musical score performance position in a predetermined musical score based on the performance data, reproducing first data based on the musical score performance position, assigning first position information, corresponding to a first virtual position set corresponding to the first data, to the first data, and outputting playback data including the first data to which the first position information is assigned.

Abstract: An image control system includes an estimation circuit, an obtaining circuit, and an image control circuit, which circuits can be at least one processor. The estimation circuit receives an output from a trained model in response to an input of an acoustic signal indicating a performance of a musical piece. The estimation circuit estimates musical performance information based on the output. The musical performance information is associated with the performance indicated by the acoustic signal relative to the musical piece. The obtaining circuit obtains manipulation information that is associated with a playback of an image. The image control circuit controls the playback of the image based on the musical performance information. The image control circuit controls the playback of the image based on the manipulation information upon obtaining the manipulation information.

Abstract: A data modification method of controlling sound , the method according to an embodiment includes providing a selection user interface that allows a user to select a modification mode to be applied to sound control data defining timing information of a sound generation from among a plurality of modification modes including a first modification mode and a second modification mode, modifying the sound control data by correcting the timing information and adding correction information according to an amount of correction of the timing information in a predetermined data section to the predetermined data section, in a state where the first modification mode is selected to be applied, and modifying the sound control data by correcting the timing information based on beat positions according to a predetermined tempo, in a state where the second modification mode is selected to be applied.

Abstract: A signal processing device includes an electronic controller including at least one processor. The electronic controller is configured to execute a reception unit, a generation unit, and a processing unit. The reception unit is configured to receive first time-series data that include sound data, and second time-series data that are generated based on the first time-series data and that include at least data indicating a timing of a human action. The generation unit is configured to generate, based on the second time-series data, third time-series data notifying of the timing of the human action. The processing unit is configured to synchronize and output an output signal based on the first time-series data and an output signal based on the third time-series data, such that the timing of the human action for the first time-series data and the timing of the human action for the third time-series data match.

Abstract: An image control system includes an estimation circuit, an obtaining circuit, and an image control circuit, which circuits can be at least one processor. The estimation circuit receives an output from a trained model in response to an input of an acoustic signal indicating a performance of a musical piece. The estimation circuit estimates musical performance information based on the output. The musical performance information is associated with the performance indicated by the acoustic signal relative to the musical piece. The obtaining circuit obtains manipulation information that is associated with a playback of an image. The image control circuit controls the playback of the image based on the musical performance information. The image control circuit controls the playback of the image based on the manipulation information upon obtaining the manipulation information.

Abstract: A musical score processing method that is realized by a computer includes receiving a control data related to displaying of a musical piece from a music processor that executes a process related to the musical piece and that is realized by a music processing program, using inter-application communication, based on a musical score processing program, and executing a display control process by displaying a musical score of the musical piece on a display device and controlling the displaying in accordance with the control data that has been received, based on the musical score processing program. The music processing program is separate from the musical score processing program.

Abstract: A chord estimation apparatus estimates a first chord from an audio signal, and estimates a second chord by inputting the estimated first chord to a trained model that has learned a chord modification tendency.

Abstract: A musical score processing method that is realized by a computer includes receiving a control data related to displaying of a musical piece from a music processor that executes a process related to the musical piece and that is realized by a music processing program, using inter-application communication, based on a musical score processing program, and executing a display control process by displaying a musical score of the musical piece on a display device and controlling the displaying in accordance with the control data that has been received, based on the musical score processing program. The music processing program is separate from the musical score processing program.

Abstract: A chord estimation apparatus estimates a first chord from an audio signal, and estimates a second chord by inputting the estimated first chord to a trained model that has learned a chord modification tendency.

Abstract: Once obtained a turn-over instruction to proceed a score on one image area to which one grand staff among plural grand staves displayed on a screen of a user I/F belongs, a controller of a score displaying apparatus performs a process of scrolling the image areas upward on the screen of the user I/F, disposing the image area on which the turn-over instruction is accepted at a highest level of the screen of the user I/F, sequentially aligning a plurality of consecutive image areas in a forward direction on a timeline of the score with respect to the image area on which the turn-over instruction is accepted below the image area on which the turn-over instruction is accepted, and displaying the image areas on the screen of the user I/F.

Abstract: A controller of a score displaying apparatus operates in a view mode displaying a score on a screen of a user I/F 12, and a writing mode obtaining information indicating writing on the score via the user I/F 12. In response to one operation specifying one grand staff by a user in the view mode, the controller performs a process of enlarging an image of an image area to which the specified grand staff belongs and displaying the enlarged image on a foreground of a center of the screen, and performs a process of switching a control mode from the view mode to the writing mode.

Abstract: A sound signal processing apparatus and system includes a control device having a processor and a memory storing instructions that causes the processor to acquire a plurality of sound signals representing sounds recorded at a plurality of positions in a sound space, respectively, and correlate the plurality of sound signals with a plurality of pieces of position information indicating the recording positions, respectively. Sound signals, from among the acquired plurality of signals correlated with the plurality of pieces of position information, are selected as a mixing target. The selected sound signals are mixed to be synchronized with each other.

Abstract: A user inputs, as a query pattern, a desired search-object rhythm pattern using a control, corresponding to a desired one of a plurality of performance parts constituting a performance data set (automatic accompaniment data set), in a rhythm input device. An input rhythm pattern storage section stores the input rhythm pattern (query pattern) into a RAM on the basis of a clock signal output from a bar line clock output section and input trigger data. A part identification section identifies a search-object performance part corresponding to the user-operated control. For the identified performance part, a rhythm pattern search section searches an automatic accompaniment database for an automatic accompaniment data set including a rhythm pattern that matches, i.e. has the highest similarity to, the input rhythm pattern (query pattern).

Abstract: A user inputs, as a query pattern, a desired search-object rhythm pattern by operating a rhythm input device. At that time, a determination is made of a style of operation performed by a user on a rhythm input device, such as whether the user has operated a single key or a plurality of keys, or duration or intensity of the operation, and then, a user-intended performance part is identified, on the basis of the determined style of operation, from among one or more performance parts constituting a performance data set (automatic accompaniment data set). For the thus-identified performance part, a rhythm pattern search section searches an automatic accompaniment database for an automatic accompaniment data set including a rhythm pattern that matches the input rhythm pattern (query pattern).

Abstract: When a music audio to be analyzed is to be divided into a plurality of possible pattern segments based on estimated beat positions, it is divided in a plurality of different ways according to individual division models obtained by sequentially shifting the leading or first beat position of the possible pattern segments. Such division can provide plural sets of possible pattern segments with each of the sets corresponding to one of the division models. For each of the sets, comparison is made between individual possible pattern segments and individual reference performance patterns. For each of the possible pattern segments of the set, at least one reference performance pattern that matches the possible pattern segment is determined. Then, at least one combination of reference performance patterns is identified for each of the sets of possible pattern segments. One optimal combination is selected from among the identified combinations.

Abstract: Once obtained a turn-over instruction to proceed a score on one image area to which one grand staff among plural grand staves displayed on a screen of a user I/F belongs, a controller of a score displaying apparatus performs a process of scrolling the image areas upward on the screen of the user I/F, disposing the image area on which the turn-over instruction is accepted at a highest level of the screen of the user I/F, sequentially aligning a plurality of consecutive image areas in a forward direction on a timeline of the score with respect to the image area on which the turn-over instruction is accepted below the image area on which the turn-over instruction is accepted, and displaying the image areas on the screen of the user I/F.

Abstract: A controller of a score displaying apparatus operates in a view mode displaying a score on a screen of a user I/F 12, and a writing mode obtaining information indicating writing on the score via the user I/F 12. In response to one operation specifying one grand staff by a user in the view mode, the controller performs a process of enlarging an image of an image area to which the specified grand staff belongs and displaying the enlarged image on a foreground of a center of the screen, and performs a process of switching a control mode from the view mode to the writing mode.