Abstract: Systems and methods are described for server-side contextual analysis of content available at a given uniform resource identifier (URI), which utilizes headless browser techniques to analyze a more complete and accurate version of page content than using existing techniques. For example, systems and methods are described for performing contextual analysis of content that would typically be displayed to a client device but is not included in an HTML file or other initial page source file available at the initially provided URI. The contextual analysis performed may include analyzing text using natural language processing and analyzing images using computer vision techniques.

Abstract: Systems and methods are described for dynamically generating a graphical code that is placed within an advertisement, which may in in turn be placed dynamically over video or image content delivered to a client device. A portion of a stored advertisement unit may be created to have a color-coded section designated to be later replaced with a graphical code. When a user requests to view image or video content on or in which a given advertisement will be shown, a server may generate a tag that contains a URI that includes tracking parameters to identify what advertisement was scanned and/or other data associated with the advertisement, a publisher, or a client device. A graphical code may be generated to represent the given URI, then that graphical code may be inserted into a previously color-coded area of an ad creative before delivery to a client device for presentation.

Abstract: Systems and methods are provided for integrating supplemental overlay content within streaming video content that is to be broadcast to viewer devices. The overlay content to include in the streaming video content may be dynamically determined during video streaming and incorporated within individual frames of the video data, such as by a computing device of a user who is broadcasting his play of a video game or other activity, prior to the user's computing device sending those video frames (with embedded overlay content therein) to a streaming platform to be broadcast to potentially many viewers' devices.

Abstract: Systems and methods are described for server-side manipulation of underlying video content in order to dynamically place overlay content within a video stream in a manner whereby a viewing user sees the advertisement content over or integrated within a portion of the base video content. Segments of the original video file may be modified by a server to display overlay content over a portion of the original content, and a revised manifest file may be generated by the server and sent to a client device. The revised manifest file may cause a video player on the client device to present in sequence (a) a first original portion of the video, (b) a second portion of the video modified to include overlaid advertisement content or other overlay content within the second portion, followed by (c) a third original portion of the video.

Abstract: Systems and methods are described for server-side manipulation of underlying video content in order to dynamically place overlay content or other supplemental content within a video stream in a manner whereby a viewing user sees the advertisement content over or integrated within a portion of the base video content. Segments of the original video file may be modified by a server to display overlay content over a portion of the original content or integrated within the portion of the original content, and revised manifest data may be generated by the server and sent to a client device for playback. The systems and methods may include introducing a delay in the live stream relative to its original source in order to provide time for server-side creation of replacement video portions that include overlay content or other supplemental content.

Abstract: Systems and methods are described for server-side contextual analysis of content available at a given uniform resource identifier (URI), which utilizes headless browser techniques to analyze a more complete and accurate version of page content than using existing techniques. For example, systems and methods are described for performing contextual analysis of content that would typically be displayed to a client device but is not included in an HTML file or other initial page source file available at the initially provided URI. The contextual analysis performed may include analyzing text using natural language processing and analyzing images using computer vision techniques.

Abstract: Systems and methods are provided for integrating supplemental overlay content within streaming video content that is to be broadcast to viewer devices. The overlay content to include in the streaming video content may be dynamically determined during video streaming and incorporated within individual frames of the video data, such as by a computing device of a user who is broadcasting his play of a video game or other activity, prior to the user's computing device sending those video frames (with embedded overlay content therein) to a streaming platform to be broadcast to potentially many viewers' devices.

Abstract: Systems and methods are described for server-side manipulation of underlying video content in order to dynamically place overlay content within a video stream in a manner whereby a viewing user sees the advertisement content over or integrated within a portion of the base video content. Segments of the original video file may be modified by a server to display overlay content over a portion of the original content, and a revised manifest file may be generated by the server and sent to a client device. The revised manifest file may cause a video player on the client device to present in sequence (a) a first original portion of the video, (b) a second portion of the video modified to include overlaid advertisement content or other overlay content within the second portion, followed by (c) a third original portion of the video.

Abstract: Systems and methods are described for server-side manipulation of underlying video content in order to dynamically place overlay content or other supplemental content within a video stream in a manner whereby a viewing user sees the advertisement content over or integrated within a portion of the base video content. Segments of the original video file may be modified by a server to display overlay content over a portion of the original content or integrated within the portion of the original content, and revised manifest data may be generated by the server and sent to a client device for playback. The systems and methods may include introducing a delay in the live stream relative to its original source in order to provide time for server-side creation of replacement video portions that include overlay content or other supplemental content.

Abstract: Systems and methods are provided for generating labeled image data for improved training of an image classifier, such as a multi-layered machine learning model configured to identify target image objects in image data. When the initially trained classifier is unable to identify a particular object in input image data, such as an object that did not appear in initial training data, feature information determined by the classifier for the given image data may be provided to a clustering model. The clustering model may group image data having similar features into different clusters or groups, which may in turn be labeled at the group level by an annotator. The image data assigned to the different clusters, along with the associated labels, may subsequently be used as training data for training a classifier to identify the labeled objects in images.

Abstract: Systems and methods are provided for delayed display of supplemental content in association with an underlying page image or other portion of a page. An initial portion of a page may be displayed and associated code may be executed. The code may cause a computing system to perform operations including determining that at least a predetermined minimum percentage of a certain image or other specific portion within the page is visible during display of the page, tracking an amount of time that the minimum percentage of the page image or other content portion remains visible during user interaction with the page, then causing display of overlay content over a portion of the particular image or other portion of the page based on a determination that the amount of time that the minimum percentage of the image or content portion has remained visible exceeds a threshold.

Abstract: Systems and methods are provided for identifying one or more portions of images or video frames that are appropriate for augmented overlay of advertisement or other visual content, and augmenting the image or video data to include such additional visual content. Identifying the portions appropriate for overlay or augmentation may include employing one or more machine learning models configured to identify objects or regions of an image or video frame that meet criteria for visual augmentation. The pose of the augmented content presented within the image or video frame may correspond to the pose of one or more real-world objects in the real world scene captured within the original image or video.

Abstract: Systems and methods are provided for analyzing images or video using computer vision. Data comprising real time or near real time information or historical information is retrieved that is associated with a sporting event at a physical location. A time segment is identified of a display device at the physical location for acquisition. The display device is configurable to present visual sponsorship data during the time segment for an assigned sponsor. It is determined that one or more rules are satisfied by the data. An indication is transmitted that the first rule is satisfied to a computing device of a sponsor. A bid or valuation is generated based at least on the first rule being satisfied. A request to acquire the time segment is received from the computing device of the sponsor, and the display device at the physical location is caused to present visual sponsorship data for the sponsor during the time segment.

Abstract: Systems and methods are provided for integrating supplemental overlay content within streaming video content that is to be broadcast to viewer devices. The overlay content to include in the streaming video content may be dynamically determined during video streaming and incorporated within individual frames of the video data, such as by a computing device of a user who is broadcasting his play of a video game or other activity, prior to the user's computing device sending those video frames (with embedded overlay content therein) to a streaming platform to be broadcast to potentially many viewers' devices.

Abstract: Systems and methods are provided for generating and using classification models to automatically classify pages or other source content as including text about one or more real-world events. Generating the classification models may include analyzing text content of a large number of different pages from both a reference source and from more dynamic sources, such as from publisher sources via a network. Features for training classifiers may be determined based in part on the top n-grams identified among pages that have been determined to be associated with a given event.

Abstract: Systems and methods are described for training machine learning models to detect objects in image or video data. A system may select a first sample set of frames from one or more video files. Indications of a location of an object of interest in each of at least two sample frames may be received, then the system may determine the location of the object of interest across a number of intermediary frames using a tracker. Annotation data may be stored identifying the objects of interest in the sample frames, and the annotation data may be used in training a machine learning model to identify the object of interest in subsequently provided image or video data.

Abstract: Systems and methods are described for identifying at least one sports team depicted in media content, such as image or video data. Features of the media content may be provided as input to a first set of classification models that are each trained to identify at least one type of scene associated with one or more sports, then features of the media content may be provided to a second set of classification models trained to identify at least one object associated with one or more sports. Once a sport depicted in the media content is determined based on the first and second set of classification models, the system may determine a team depicted in the media content based at least in part by comparing aspects of the media content to stored data associated with various teams that play the identified sport.

Abstract: Systems and methods are provided for analyzing images or video using computer vision. Media items, including images or videos, are retrieved from one or more media channels, such as social media network services, streaming media networks, or broadcast networks. A media item is identified that depicts a object associated with a sponsor. A media cost equivalent is determined that is associated with the media item as distributed by the media channels. Using computer vision, a percentage is determined for the media cost equivalent. The percentage is determined based at least in part on at least one of size, clarity, duration or position of the sponsor object or another object in the media item. A sponsor valuation is calculated based at least in part on the media cost equivalent adjusted by the percentage.

Abstract: Systems and methods are described for augmenting video data based on automated identification of one or more objects depicted in the video data. One or more classification models may identify an object of interest in video data. An aggregated duration count may be maintained that reflects a length of time that the object of interest has been depicted in the video data. This duration or additional metric data derived in part from the duration may be displayed in association with display of the video data and continuously updated during playback of the video data.

Abstract: Systems and methods are described for using video fingerprinting to detect depiction of one or more objects of interest in video data. An object of interest may first be identified in one or more frames of video data. A system may then create a digital video fingerprint representing the one or more frames in which the object is depicted. A potentially large amount of subsequent video data may then be received or retrieved, and the system may determine that the object appears in a portion of the subsequent video data based at least in part by identifying that the digital video fingerprint at least substantially matches a portion of the subsequent video data.