Abstract: A method for voice-based programming of a voice-controlled device includes executing, by a voice-controlled device, an application for recognizing spoken programming commands, the application including a plurality of keyword phrases each associated with an action. The method includes receiving, by a voice-controlled device, an audio signal representing a user utterance. The method includes identifying, by the voice-controlled device, within the received audio signal, one of the plurality of keyword phrases and data for use in taking the action associated with the one of the plurality of keyword phrases. The method includes modifying, by the voice-controlled device, at least one data structure stored by the voice-controlled device responsive to the identified one of the plurality of keyword phrases and data.