Abstract: A behavioral based environment system and method for controlling an interactive playground. The system includes a system supervisor unit that utilizes a rule file, a scene file and a MIDI file in conjunction with a variety of sensor input to create an appropriate system response. Output control signals generated by the system supervisor unit are transmitted to other coupled computers to effectuate audio, visual and other effects in an interactive playground environment. The system supervisor has the desirable ability to load different scene, rule and MIDI files to create different system behavior in response to sensor stimuli, thereby creating a more adaptive behavioral based environment.