Abstract: Weaknesses may be exposed in image object detectors. An image object is overlaid onto a background image at each of a plurality of locations, the background image including a scene in which the image objects can be present. A detector model is used to attempt detection of the image object as overlaid onto the background image, the detector model being trained to identify the image object in background images, the detection resulting in background scene detection scores indicative of likelihood of the image object being detected at each of the plurality of locations. A detectability map is displayed overlaid on the background image, the detectability map including, for each of the plurality of locations, a bounding box of the image object illustrated according to the respective detection score.

Abstract: Weaknesses may be exposed in image object detectors. An image object is overlaid onto a background image at each of a plurality of locations, the background image including a scene in which the image objects can be present. A detector model is used to attempt detection of the image object as overlaid onto the background image, the detector model being trained to identify the image object in background images, the detection resulting in background scene detection scores indicative of likelihood of the image object being detected at each of the plurality of locations. A detectability map is displayed overlaid on the background image, the detectability map including, for each of the plurality of locations, a bounding box of the image object illustrated according to the respective detection score.

Abstract: A visual analytics method and system is disclosed for visualizing an operation of an image classification model having at least one convolutional neural network layer. The image classification model classifies sample images into one of a predefined set of possible classes. The visual analytics method determines a unified ordering of the predefined set of possible classes based on a similarity hierarchy such that classes that are similar to one another are clustered together in the unified ordering. The visual analytics method displays various graphical depictions, including a class hierarchy viewer, a confusion matrix, and a response map. In each case, the elements of the graphical depictions are arranged in accordance with the unified ordering. Using the method, a user a better able to understand the training process of the model, diagnose the separation power of the different feature detectors of the model, and improve the architecture of the model.

Abstract: A system includes a display device, a memory configured to store a visual analysis application and image data including a plurality of images including detectable objects; and a processor, operatively connected to the memory and the display device. The processor is configured to execute the visual analysis application to learn generative factors from objects detected in the plurality of images, visualize the generative factors in a user interface provided to the display device, receive grouped combinations of the generative factors and values to apply to the generative factors to control object features, create generated objects by applying the values of the generative factors to the objects detected in the plurality of images, combine the generated objects into the original images to create generated images, and apply a discriminator to the generated images to reject unrealistic images.

Abstract: A system includes a display device, a memory configured to store a visual analysis application and image data including a plurality of images including detectable objects; and a processor, operatively connected to the memory and the display device. The processor is configured to execute the visual analysis application to learn generative factors from objects detected in the plurality of images, visualize the generative factors in a user interface provided to the display device, receive grouped combinations of the generative factors and values to apply to the generative factors to control object features, create generated objects by applying the values of the generative factors to the objects detected in the plurality of images, combine the generated objects into the original images to create generated images, and apply a discriminator to the generated images to reject unrealistic images.

Abstract: A visual analytics method and system is disclosed for visualizing an operation of an image classification model having at least one convolutional neural network layer. The image classification model classifies sample images into one of a predefined set of possible classes. The visual analytics method determines a unified ordering of the predefined set of possible classes based on a similarity hierarchy such that classes that are similar to one another are clustered together in the unified ordering. The visual analytics method displays various graphical depictions, including a class hierarchy viewer, a confusion matrix, and a response map. In each case, the elements of the graphical depictions are arranged in accordance with the unified ordering. Using the method, a user a better able to understand the training process of the model, diagnose the separation power of the different feature detectors of the model, and improve the architecture of the model.