Abstract: A visual analytics method and system is disclosed for visualizing an operation of an image classification model having at least one convolutional neural network layer. The image classification model classifies sample images into one of a predefined set of possible classes. The visual analytics method determines a unified ordering of the predefined set of possible classes based on a similarity hierarchy such that classes that are similar to one another are clustered together in the unified ordering. The visual analytics method displays various graphical depictions, including a class hierarchy viewer, a confusion matrix, and a response map. In each case, the elements of the graphical depictions are arranged in accordance with the unified ordering. Using the method, a user a better able to understand the training process of the model, diagnose the separation power of the different feature detectors of the model, and improve the architecture of the model.

Abstract: A computing system includes a processing system with at least one processing unit. The processing system is configured to execute a face alignment method upon receiving image data with a facial image. The processing system is configured to apply a neural network to the facial image. The neural network is configured to provide a final estimate of parameter data for the facial image based on the image data and an initial estimate of the parameter data. The neural network includes at least one visualization layer, which is configured to generate a feature map based on a current estimate of the parameter data. The parameter data includes head pose data and face shape data.

Abstract: A visual analytics method and system is disclosed for visualizing an operation of an image classification model having at least one convolutional neural network layer. The image classification model classifies sample images into one of a predefined set of possible classes. The visual analytics method determines a unified ordering of the predefined set of possible classes based on a similarity hierarchy such that classes that are similar to one another are clustered together in the unified ordering. The visual analytics method displays various graphical depictions, including a class hierarchy viewer, a confusion matrix, and a response map. In each case, the elements of the graphical depictions are arranged in accordance with the unified ordering. Using the method, a user a better able to understand the training process of the model, diagnose the separation power of the different feature detectors of the model, and improve the architecture of the model.

Abstract: A computing system includes a processing system with at least one processing unit. The processing system is configured to execute a face alignment method upon receiving image data with a facial image. The processing system is configured to apply a neural network to the facial image. The neural network is configured to provide a final estimate of parameter data for the facial image based on the image data and an initial estimate of the parameter data. The neural network includes at least one visualization layer, which is configured to generate a feature map based on a current estimate of the parameter data. The parameter data includes head pose data and face shape data.