Abstract: A device for headphone audio management includes a processor that is configured to receive an audio signal corresponding to audio received by one or more microphones. The processor is also configured to process the audio signal using an audio classifier to generate a classification result for a first portion of the audio signal. The processor is further configured to, based on determining that the classification result indicates that the first portion of the audio signal corresponds to relevant audio, update a headset configuration of a headset to enable a second portion of the audio signal to be output by the headset.