Abstract: A process for linking related images and videos is disclosed. The process can include receiving listing information including the images and the video, processing the images using an image processor to determine one or more image descriptors, processing the video using a video processor to determine video descriptors, comparing the image descriptors to the video descriptors, calculating a similarity value for each of the image descriptors in relation to each of the video descriptors, and linking the videos and the images based upon the calculated similarity value. The method can also include causing the display of a user interface including a video linking user interface element operable to cause playback of a relevant portion of the video linked with the displayed image and an image linking user interface element operable to cause display of a relevant image linked with a portion of the video playback.

Abstract: A process for linking related images and videos is disclosed. The process can include receiving listing information including the images and the video, processing the images using an image processor to determine one or more image descriptors, processing the video using a video processor to determine video descriptors, comparing the image descriptors to the video descriptors, calculating a similarity value for each of the image descriptors in relation to each of the video descriptors, and linking the videos and the images based upon the calculated similarity value. The method can also include causing the display of a user interface including a video linking user interface element operable to cause playback of a relevant portion of the video linked with the displayed image and an image linking user interface element operable to cause display of a relevant image linked with a portion of the video playback.

Abstract: Systems and methods are provided for automatically generating a video associated with an item in the marketplace. An image receiver receives images associated with an item of an item listing. An image extractor generates visual descriptors for each image through computer vision analysis and extracts a unique set of images by removing redundant images. An image sorter sorts images in the unique set of images based on an item category and generates a sequence of images for generating a video. A text placer automatically identifies a region in an image and inserts text into the image using textual attributes as predicted by a model. A video data optimizes a generated video using another model trained based on manual adjustments previously made to other exemplary video data. The disclosed technology publishes the automatically generated video data for viewing by viewers in the marketplace.

Abstract: Systems and methods are provided for automatically generating a thumbnail for a video on an online shopping site. The disclosed technology automatically generates a thumbnail for a video, where the thumbnail represents an item but not necessarily content of the video. A thumbnail generator receives a video that describes the item and an ordered list of item images associated with the item used in an item listing. The thumbnail generator extracts video frames from the video based on sampling rules and determines similarity scores for the sampled video frames. A similarity score indicates a degree of similarity between content of a video frame and an item image. The thumbnail generator determines weighted similarity scores based item images and occurrences of sampled video frames in the video. The disclosed technology generates a thumbnail for the video by selecting a sample video frame based on the weighted similarity scores.

Abstract: A process for linking related images and videos is disclosed. The process can include receiving listing information including the images and the video, processing the images using an image processor to determine one or more image descriptors, processing the video using a video processor to determine video descriptors, comparing the image descriptors to the video descriptors, calculating a similarity value for each of the image descriptors in relation to each of the video descriptors, and linking the videos and the images based upon the calculated similarity value. The method can also include causing the display of a user interface including a video linking user interface element operable to cause playback of a relevant portion of the video linked with the displayed image and an image linking user interface element operable to cause display of a relevant image linked with a portion of the video playback.