Abstract: An audio processing device including a factorization unit which factorizes frequency information obtained by performing time-frequency transformation on an audio signal of a plurality of channels into a channel matrix representing characteristics of a channel direction, a frequency matrix representing characteristics of a frequency direction, and a time matrix representing characteristics of a time direction; and an extraction unit which extracts the frequency information of audio from an arbitrary designated direction based on the channel matrix, the frequency matrix, and the time matrix.