Abstract: Generating a pitched musical part from an electronic music file comprised of instrumental parts includes generating a control stream that indicates which of the instrumental parts has a highest value for a period of time, selecting one of the instrumental parts for the period of time based on the control stream, and outputting the selected instrumental part for the period of time to produce the musical part. Generating a non-pitched musical part from an electronic music file includes identifying patterns in the electronic music file and selectively combining the patterns to produce the musical part.

Abstract: A computer-readable medium stores a data structure that encodes an audio performance for interactive playback. The data structure includes a virtual instrument pool, which encodes an interactive part of the audio performance. Audio content of the interactive part is encoded at least in a sequence of synthesizer control data. Each datum in the synthesizer control data specifies a digital sample of the audio content to be played back. The data structure also includes a global accompaniment pool, which encodes non-interactive portions of the audio performance. The global accompaniment pool includes timing information to synchronize the playback of the audio performance.