Abstract: A method for scene frame matching for automatic content recognition. The method includes receiving fingerprints indicative of frames of a media stream. The method also includes obtaining scene centroids of corresponding scenes of the media stream. Each scene includes fingerprints ranging from an initial frame having a corresponding initial fingerprint and a last frame having a corresponding last fingerprint. Each scene centroid represents a mean of fingerprints corresponding to a respective scene. The mean of fingerprints is determined by an average of pixel values corresponding to the fingerprints of the respective scene. For each scene centroid, the method includes determining a distance between the respective scene centroid and a target fingerprint of a corresponding target frame of the media stream and determining a target scene of the target frame as being the respective scene of the scene centroid having a shortest distance to the target fingerprint of the target frame.

Abstract: A system and method includes operations and steps for inferring a demographic of a user based on a selection of an advertisement by the user. A media device stream is received from a media device by data processing hardware. The data processing hardware may identify frames of the media device stream for insertion of an overlay. The overlay can include first and second interactive portions corresponding to respective first and second advertisements. The user can select one of the first interactive portion and the second interactive portion corresponding to one of the first advertisement and the second advertisement. The selection can be received by the data processing hardware, and the demographic of the user can be inferred based on the selection.

Abstract: A method for flagging advertisement frames for automatic content recognition is provided. The method includes receiving broadcast fingerprints indicative of broadcast frames of a media stream comprising a series of broadcast scenes. The method also includes receiving advertisement fingerprints indicative of ad frames of ad scenes. The method further includes determining a scene change between a first broadcast scene and a second broadcast scene. The scene change is based on a Pearson correlation coefficient between an initial broadcast fingerprint of an initial broadcast frame of the second broadcast scene and a last broadcast fingerprint of a last broadcast frame of the first broadcast scene. The method also further includes determining whether the second broadcast scene is one of the ad scenes. When the second broadcast scene is one of the ad scenes, the method associates an identification of the second broadcast scene as the one of the ad scenes.

Abstract: A method for cold matching by automatic content recognition includes receiving, at data processing hardware, broadcast fingerprints indicative of broadcast frames of a broadcast media stream. The method also includes receiving, at the data processing hardware, media device fingerprints indicative of media device frames of a media device stream at a corresponding media device. The method further includes determining, by the data processing hardware, that a search block comprising a plurality of media device fingerprints corresponding to sequential media device frames of the media device stream includes at least one media device fingerprint having a match correlation to at least one broadcast fingerprint. The match correlation is based on a Pearson correlation coefficient. The method also includes identifying, by the data processing hardware, the at least one media device fingerprint having the match correlation to the at least one broadcast fingerprint as corresponding to a match media device frame.

Abstract: An electronic device and method for media content to be replaced other media content is disclosed. The method includes receiving first media content comprising a set of media content segments. The method includes receiving second media content comprising a first media content segment. The method includes receiving scheduling information identifying a second media content segment of the set of media content segments to be replaced with the first media content segment. The method includes determining that the first content feed is transmitted according to a first broadcast timing and that the second content feed is transmitted according to a second broadcast timing. The method includes syncing the first broadcast timing with the second broadcast timing. The method includes replacing the second media content segment with the first media content segment when the first content feed and the second content feed are synced.

Abstract: A system and method includes an automatic content recognition (ACR) headend to perform ACR recognition on a video stream that is also being streamed to a smart TV, to detect timing of an upcoming ad spot to be delivered within the video stream. An addressable TV (ATV) engine can be in communication with the ACR head end and to: determine, from data of an ad campaign, whether a first ad to be delivered to the ad spot is off target for the ad spot; notify the ad replacer client to replace the first ad with an addressable ad when the first ad is off target for the ad spot; and provide, to the ad replacer client, criteria with which to constrain an ad request to obtain a second ad that is on target for the ad spot.

Abstract: A method includes receiving, at a data processing device, a fingerprint of a media segment to be displayed on a media device and determining, by the data processing device, a number of times the media segment has been displayed on the media device based on the fingerprint. The method further includes determining, by the data processing device, whether the number of times the media segment has been displayed on the media device satisfies a threshold criterion. When the number of times the media segment has been displayed on the media device satisfies the threshold criterion, the method includes identifying, by the data processing device, an overlay content segment to be displayed on the electronic device in lieu of the media segment and instructing, by the data processing device, the media device to display the overlay content segment in lieu of the media segment.

Abstract: A method, system, or device determine when media content is to be displayed. The method can include receiving media content on a broadcast channel from a content feed. The method can also include receiving an identifier for upcoming media content from an automatic content recognition (ACR) system in response to a trigger event. The method can include receiving overlay content from an overlay content server. The method can include storing the overlay content at a memory device. The method can include determining a time that the media content is to be displayed using the identifier.

Abstract: The disclosure provides a method for interactive control of live television broadcast streams. The method includes receiving a streaming live media feed from a television broadcaster and displaying an overlay on media content of the streaming live media feed. The overlay includes a play control option unassociated with an intermediary feed source of the live media feed between the television broadcaster and the media device. The method further includes receiving a first selection input of the play control option and determining that the selection input corresponds to a play mode at a first location within the media content of the streaming live media feed by determining that a first fingerprint fails to match a second fingerprint. Furthermore, the method includes overlaying targeted overlay content on the streaming live media feed.

Abstract: A method for a frame certainty metric for automatic content recognition. The method includes determining a frame match between media device frames of a media device stream relative to broadcast frames of a broadcast media stream and determining whether to shift the frame match by determining the following: a first frame certainty metric based on a first media device fingerprint and a target broadcast fingerprint; a second frame certainty metric based on a second media device fingerprint sequentially adjacent the first media device fingerprint and the target broadcast fingerprint; a third frame certainty metric based on a third media device fingerprint sequentially adjacent the first media device fingerprint and the target broadcast fingerprint; and a greatest frame certainty metric. The method further includes identifying the media device fingerprint corresponding to the greatest frame certainty metric as a target media device fingerprint matching the target broadcast fingerprint.

Abstract: A computing device includes memory for storing commercial metadata and offer metadata harvested from within an offer distribution network. A processor compares the commercial metadata related to a broadcast commercial to be streamed to a client media device with the offer metadata related to available offers from offer providers, to generate a comparison. The processor then selects an offer from the available offers based on the comparison; determines when and over what video stream the broadcast commercial is to be streamed; detects that a screen device is paired to the client media device; and delivers the offer to a display of the screen device during streaming of the broadcast commercial over the video stream to the client media device. When a user of the screen device selects an indicia of the offer, the offer is collected into a virtual wallet from which the offer can be redeemed in various ways.

Abstract: A method is disclosed for identifying the media content. The method includes receiving fingerprint media content from a content provider to obtain a first set of fingerprints, the first set of fingerprints including a first subset of fingerprints in a first fingerprint layout and a second subset of fingerprints in a second fingerprint layout. The method can include receiving a second set of fingerprints for media content displayed on the electronic device, the second set of fingerprints comprising a third subset of fingerprints in the first fingerprint layout and a fourth subset of fingerprints in the second fingerprint layout. The method can include matching a first fingerprint in the first subset of fingerprints to a second fingerprint in the third subset of fingerprints or a third fingerprint in the second subset of fingerprints to a fourth fingerprint in the fourth subset of fingerprints in order to identify the media content.

Abstract: A server device includes memory to store: a database of frame fingerprints ordered sequentially by media item number and frame number for media items, and a hash table containing (key, value) entries each including a hashed frame fingerprint and index number(s) to the database. A processor coupled to the memory is to, for an input set of hashed frame fingerprints, select a most recent hashed frame fingerprint. The processor performs a lookup with the most recent hashed frame fingerprint to identify a plurality of index numbers from a matching entry. The processor retrieves a target plurality of frame fingerprints from the database using each of the plurality of index numbers as a starting point; calculates a rank distance between the input set and each respective target plurality of frame fingerprints; and selects the target plurality of frame fingerprints for which the rank distance is shortest, to identify a media item.

Abstract: A system and method includes an automatic content recognition (ACR) headend to perform ACR recognition on a video stream that is also being streamed to a smart TV, to detect timing of an upcoming ad spot to be delivered within the video stream. An addressable TV (ATV) engine can be in communication with the ACR head end and to: determine, from data of an ad campaign, whether a first ad to be delivered to the ad spot is off target for the ad spot; notify the ad replacer client to replace the first ad with an addressable ad when the first ad is off target for the ad spot; and provide, to the ad replacer client, criteria with which to constrain an ad request to obtain a second ad that is on target for the ad spot.

Abstract: The disclosure provides a method for determining viewer data from interactive overlays. The method includes receiving media content from a content feed. The media device includes a unique identifier (UID). The method also includes determining a media program associated with the received media content based on a fingerprint of the received media content. The method further includes overlaying interactive overlay content onto the media program of the media content in an overlay area. The overlay area corresponds to a spatial position within at least one frame of the media content. The method also includes receiving a feedback response from a viewer based on the interactive overlay content. The method further includes determining viewer information from the feedback response of the viewer. The method further includes associating the viewer information of the feedback response with the UID of the media device.

Abstract: A method for targeted content placement using overlays includes receiving media content from a content feed and displaying the media content from the content feed at a display of the media device. As the display of the media device displays the media content, the method also includes fingerprinting at least one frame of the media content to obtain a fingerprint and identifying an in-frame advertisement based on the obtained fingerprint. The in-frame advertisement corresponds to an advertisement within a portion of the at least one frame. The method further includes determining a target overlay location within the at least one frame with the in-frame advertisement, the target overlay location corresponding to a size of the in-frame advertisement, and superimposing overlay content at the target overlay location when the display of the media device displays the at least one frame with the in-frame advertisement.

Abstract: The disclosure provides a method for interactive control of live television broadcast streams. The method includes receiving a streaming live media feed from a television broadcaster and displaying an overlay on media content of the streaming live media feed. The overlay includes a play control option unassociated with an intermediary feed source of the live media feed between the television broadcaster and the media device. The method further includes receiving a first selection input of the play control option and determining that the selection input corresponds to a play mode at a first location within the media content of the streaming live media feed by determining that a first fingerprint fails to match a second fingerprint. Furthermore, the method includes overlaying targeted overlay content on the streaming live media feed.

Abstract: The disclosure provides a method for employing automatic content recognition to allow resumption of watching interrupted media program from television broadcast. The method includes detecting a viewing cessation of a media program on a channel of a media device. A television broadcaster provides media content including the channel. The channel includes the media program. The method also includes, in response to detecting the viewing cessation of the media program, identifying the channel, the media program, the television broadcaster, and a location of the viewing cessation within the media program. The method further includes detecting a viewing recommencement of the channel of the media device. In response to detecting the viewing recommencement, the method includes overlaying a selectable indicator on the channel. The selectable indicator is configured to receive a selection input to resume viewing of the media program starting at the location of the viewing cessation of the media program.

Abstract: A computing device includes memory for storing commercial metadata and offer metadata harvested from within an offer distribution network. A processor compares the commercial metadata related to a broadcast commercial to be streamed to a client media device with the offer metadata related to available offers from offer providers, to generate a comparison. The processor then selects an offer from the available offers based on the comparison; determines when and over what video stream the broadcast commercial is to be streamed; detects that a screen device is paired to the client media device; and delivers the offer to a display of the screen device during streaming of the broadcast commercial over the video stream to the client media device. When a user of the screen device selects an indicia of the offer, the offer is collected into a virtual wallet from which the offer can be redeemed in various ways.

Abstract: A method is disclosed for identifying the media content. The method includes receiving fingerprint media content from a content provider to obtain a first set of fingerprints, the first set of fingerprints including a first subset of fingerprints in a first fingerprint layout and a second subset of fingerprints in a second fingerprint layout. The method can include receiving a second set of fingerprints for media content displayed on the electronic device, the second set of fingerprints comprising a third subset of fingerprints in the first fingerprint layout and a fourth subset of fingerprints in the second fingerprint layout. The method can include matching a first fingerprint in the first subset of fingerprints to a second fingerprint in the third subset of fingerprints or a third fingerprint in the second subset of fingerprints to a fourth fingerprint in the fourth subset of fingerprints in order to identify the media content.