Abstract: Deep learning models, such as diffusion models, can synthesize images from noise. Diffusion models implement a complex denoising process involving many denoising operations. It can be a challenge to understand the mechanics of diffusion models. To better understand how and when structure is formed, saliency maps and concept formation intensity can be extracted from the sampling network of a diffusion model. Using the input map and the output map of a given denoising operation in a sampling network, a noise gradient map representative of the predicted noise of a given denoising operation can be determined. The noise gradient maps from the denoising operations at different indices can be combined to generate a saliency map. A concept formation intensity value can be determined from a noise gradient map. Concept formation intensity values from the denoising operations at different indices can be plotted.

Abstract: Detection of synthetic content in portrait videos, e.g., deep fakes, is achieved. Detectors blindly utilizing deep learning are not effective in catching fake content, as generative models produce realistic results. However, biological signals hidden in portrait videos which are neither spatially nor temporally preserved in fake content, can be used as implicit descriptors of authenticity. 99.39% accuracy in pairwise separation is achieved. A generalized classifier for fake content is formulated by analyzing signal transformations and corresponding feature sets. Signal maps are generated, and a CNN employed to improve the classifier for detecting synthetic content. Evaluation on several datasets produced superior detection rates against baselines, independent of the source generator, or properties of available fake content.

Abstract: Detection of synthetic content in portrait videos, e.g., deep fakes, is achieved. Detectors blindly utilizing deep learning are not effective in catching fake content, as generative models produce realistic results. However, biological signals hidden in portrait videos which are neither spatially nor temporally preserved in fake content, can be used as implicit descriptors of authenticity. 99.39% accuracy in pairwise separation is achieved. A generalized classifier for fake content is formulated by analyzing signal transformations and corresponding feature sets. Signal maps are generated, and a CNN employed to improve the classifier for detecting synthetic content. Evaluation on several datasets produced superior detection rates against baselines, independent of the source generator, or properties of available fake content.

Abstract: An apparatus to facilitate deepfake detection models utilizing subject-specific libraries is disclosed. The apparatus includes one or more processors to store a plurality of deepfake detection models corresponding to a plurality of subjects of interest; receive a query to identify whether data pertaining to a target subject of interest is a deepfake, the target subject of interest comprised in the plurality of subjects of interest and associated with a subject identifier (ID); identify a deepfake detection model corresponding to the subject ID; extract features for deepfake detection from the data; input the extracted features to the identified deepfake detection model corresponding to the subject ID; and responsive to an output of the deepfake detection model exceeding a determined deepfake threshold, generate a notification, in response to the query, indicating a possible deepfake attack corresponding to the target subject of interest.

Abstract: An apparatus to facilitate generator exploitation for deepfake detection is disclosed. The apparatus includes one or more processors to: alter a generative neural network of a deepfake generator with one or more modifications for deepfake detection; train the generative neural network having the one or more modifications and a discriminative neural network of the deepfake generator, wherein training the generative neural network and the discriminative neural network to facilitate the generative neural network to generate deepfake content comprising the one or more modifications; and communicate identification of the one or more modifications to a deepfake detector to cause the deepfake detector to identify deepfake content generated by the deepfake generator that comprises at least one of the one or more modifications.

Abstract: An apparatus to facilitate an authenticator-integrated generative adversarial network (GAN) for secure deepfake generation is disclosed.

Abstract: Detection of synthetic content in portrait videos, e.g., deep fakes, is achieved. Detectors blindly utilizing deep learning are not effective in catching fake content, as generative models produce realistic results. However, biological signals hidden in portrait videos which are neither spatially nor temporally preserved in fake content, can be used as implicit descriptors of authenticity. 99.39% accuracy in pairwise separation is achieved. A generalized classifier for fake content is formulated by analyzing signal transformations and corresponding feature sets. Signal maps are generated, and a CNN employed to improve the classifier for detecting synthetic content. Evaluation on several datasets produced superior detection rates against baselines, independent of the source generator, or properties of available fake content.