Abstract: An audiovisual cueing system includes a visual game focusing on the fifteen vowel sounds of American English. Players take spoken turns corresponding with a sound-based word pattern determined by cards in play. Each card includes a color border, image, and featured word. The stressed vowel sounds in the color and object guide players to use the same sound in the underlined part of the featured word despite different spelling patterns. Players compare colors on cards in hand with a discard pile card, and if there is a match, the matched card is discarded and six corresponding words spoken in succession (e.g., “blue moon soon, blue moon June”). The act of speaking these words in succession provides a moment of learning and practice that benefits the player, while the game objective (winning) compels the learner to persist. The first player to discard all cards in hand is awarded points or wins.

Abstract: Computer-implemented systems and methods for automatically integrating a machine learning component to improve a spoken language skill of a speaker. The method includes selecting an anchor phrase and a target word as part of an interactive game, presenting a visual representation of the anchor phrase and the target word to the speaker, processing a received and digitized anchor phrase and target word with a speech engine, extracting a plurality of features from speech engine output with a feature extraction device and transmitting the plurality of features to a plurality of classifiers, deriving a plurality of classifier outputs from the plurality of features with the feedback classifiers and transmitting the plurality of classifier outputs to a resolver, selecting a feedback response with the resolver using a set of pre-defined rules based at least in part on the plurality of classifier outputs, and presenting the feedback response to the speaker.