Abstract: One or more systems and/or methods for combining vectors output by multiple different mechanisms for content item retrieval are provided. An image encoder may output a first set of vectors generated by an image model using an input image as input. A text encoder may output a second set of vectors generated by a text model using input text as input. A vector combination module may combine the first set of vectors and the second set of vectors to create a vector output. A weight is applied to the vector output to create a weighted output. An output vector is generated based upon a combination of the first set of vectors, the second set of vectors, and the weighted output. The output vector is used to query a catalog to identify a content item related to the input image and the input text.

Abstract: A system for multi-tier visual recognition comprises a processor and a memory. The processor is configured to calculate a rank for each of a plurality of object models. The plurality of object models are used for visual recognition. Each of the plurality of object models has a size. The processor is configured to divide the plurality of object models into a plurality of sets based at least in part on the rank for each of the plurality of object models, and provide a first set of the plurality of sets to a first tier and a second set of the plurality of sets to a second tier. The memory coupled to the processor and configured to provide the processor with instructions.

Abstract: A system for multi-tier visual recognition comprises a processor and a memory. The processor is configured to calculate a rank for each of a plurality of object models. The plurality of object models are used for visual recognition. Each of the plurality of object models has a size. The processor is configured to divide the plurality of object models into a plurality of sets based at least in part on the rank for each of the plurality of object models, and provide a first set of the plurality of sets to a first tier and a second set of the plurality of sets to a second tier. The memory coupled to the processor and configured to provide the processor with instructions.

Abstract: A system for multi-tier visual recognition comprises a processor and a memory. The processor is configured to calculate a rank for each of a plurality of object models. The plurality of object models are used for visual recognition. Each of the plurality of object models has a size. The processor is configured to divide the plurality of object models into a plurality of sets based at least in part on the rank for each of the plurality of object models, and provide a first set of the plurality of sets to a first tier and a second set of the plurality of sets to a second tier. The memory coupled to the processor and configured to provide the processor with instructions.

Abstract: A system for tagging an object comprises and interface and a processor. The interface is configured to receive an image. The processor is configured to determine a key frame. Determining a key frame comprises determining that the image is stable. The processor is configured to determine a tag for an item in the key frame.

Abstract: A system for determining piles comprises an interface and a processor. The interface is configured to receive an image. The processor is configured to determine one or more attributes of the image; to determine whether the image is a member of a top of a hierarchy based at least in part on the attributes. In the event it is determined that the image is a member of the top of the hierarchy: determine a set of elements of the hierarchy the image is a member of, based at least in part on the attributes and determine which of the set of entities are piles.

Abstract: A system for link acquisition and usage using image recognition comprises an interface, a processor, and a memory. The interface is for receiving an image. The processor is configured to: determine one or more tags for the image; determine one or more links associated with the one or more tags; and cause an action associated with a selected link of the one or more links. The memory is coupled to the processor and is configured to provide the processor with instructions.

Abstract: A system for monitoring an image tagging system comprises a processor and a memory. The processor is configured to provide a user display for a type of monitoring of an image tagging system. The user display includes image tagging monitoring for: a) in the event that a computer vision match is found, a computer vision match and an associated computer vision tag and, b) in the event that no computer vision match is found, a human vision match and an associated human vision tag. A memory coupled to the processor and configured to provide the processor with instructions.

Abstract: A system for tagging an image comprises a processor and a memory. The processor is configured to analyze an image associated with an image query using one or more computer vision analysis types to determine zero or more computer vision matches. Each computer vision match has one or more associated computer vision tags. In the event that it is determined that there are zero computer vision matches, the processor is further configured to analyze the image associated with the image query using a human vision analysis system to determine zero or more human vision matches. Each human vision match has one or more associated human vision tags. A memory coupled to the processor and configured to provide the processor with instructions.

Abstract: A system for determining piles comprises an interface and a processor. The interface is configured to receive an image. The processor is configured to determine one or more attributes of the image; to determine whether the image is a member of a top of a hierarchy based at least in part on the attributes. In the event it is determined that the image is a member of the top of the hierarchy,: determine a set of elements of the hierarchy the image is a member of, based at least in part on the attributes and determine which of the set of entities are piles.

Abstract: A system for tagging an object comprises and interface and a processor. The interface is configured to receive an image. The processor is configured to determine a key frame. Determining a key frame comprises determining that the image is stable. The processor is configured to determine a tag for an item in the key frame.