Abstract: Systems and methods are described herein for identifying diminished capacity of a voice call participant based on audio data analysis. A server generates an audio image based on an audio file comprising speech data corresponding to a first user on a voice call. The server determines a diminished capacity score based on one or more characteristics of the audio image analyzed using a deep learning classification model. The server applies a security protocol to an account associated with the first user when the diminished capacity score is at or above a threshold value. The server receives a transaction request corresponding to the account from the first user. The server processes the transaction request based on the security protocol applied to the account.

Abstract: Systems and methods are described herein for identifying diminished capacity of a voice call participant based on audio data analysis. A server generates an audio image based on an audio file comprising speech data corresponding to a first user on a voice call. The server determines a diminished capacity score based on one or more characteristics of the audio image analyzed using a deep learning classification model. The server applies a security protocol to an account associated with the first user when the diminished capacity score is at or above a threshold value. The server receives a transaction request corresponding to the account from the first user. The server processes the transaction request based on the security protocol applied to the account.