Abstract: Systems and methods of identifying unknown video content are described. An example method may include receiving a first fingerprint and a second fingerprint. The first fingerprint may be a color-based fingerprint derived from colors in a portion of the unknown video content, and the second fingerprint may be at least partially based on a feature other than the colors of the unknown video content. A reference database of reference fingerprints may then be queried using one of the first fingerprint or the second fingerprint to obtain a candidate group of fingerprints. The candidate group of fingerprints may then be queried using the other of the first fingerprint and the second fingerprint to identify at least one query fingerprint. The unknown video content may then be identified using the at least one query fingerprint.

Abstract: In one aspect, an example method includes (i) providing, by a playback device, replacement media content for display; (ii) determining, by the playback device, that a remote control transmitted to the playback device an instruction configured to cause a modification to operation of the playback device while the playback device displays the replacement media content; (iii) determining, by the playback device based on the instruction, an overlay that the playback device is configured to provide for display in conjunction with the modification; (iv) determining, by the playback device, a region within a display of the playback device corresponding to the overlay; and (v) modifying, by the playback device, a transparency of the region such that the overlay is visible through the replacement media content when the playback device provides the overlay for display.

Abstract: A media client ascertains a plurality of matching points between (i) query fingerprints representing a media stream being received by the client and (ii) reference fingerprints, each identified matching point defining a respective match between a query fingerprint that is timestamped with client time defined according to a clock of the client and a reference fingerprint that is timestamped with true time defined according to a timeline within a known media stream. Further, the client performs linear regression based on the timestamps of the ascertained plurality of matching points, to establish a mapping between true time and client time. The client then uses the established mapping as a basis to determine a client-time point at which the client should perform an action with respect to media stream being received by the client. And the client performs the action at the determined client-time point.

Abstract: A computing system identifies a media stream being received by a client, based on fingerprint matching conducted with query fingerprints generated by the client at a frame rate. The computing system then causes the client to increase the frame rate, in order to facilitate establishment by the computing system of synchronous lock between true time within the media stream and client time according to an clock of the client. The computing system then uses the established synchronous lock as a basis to map a true-time point at which a content revision should be performed in the media stream to a client-time point at which the client should perform the content revision. And the computing system causes the client to perform the content revision at the determined client-time point.

Abstract: A computing system identifies multiple matching points between (i) query fingerprints representing a media stream being received by a client and (ii) reference fingerprints, each identified matching point defining a respective match between a query fingerprint timestamped with client time defined according to a clock of the client and a reference fingerprint timestamped with true time defined according to a timeline within a known media stream. Further, the computing system performs linear regression based on the timestamps of the matching points, to establish a mapping between true time and client time. The computing system then uses the mapping to determine a client-time point at which the client should perform a content revision or other action with respect to the media stream being received by the client. And the computing system causes the client to perform the content revision or other action at the determined client-time point.

Abstract: Methods and systems to authorize devices and/or perform other actions based on identifying content distributors are described. In some example embodiments, the methods and systems access video content playing at a client device, calculate fingerprints of a portion of the video content, identify a distributor of the video content based on the fingerprints, and perform an action in response to the identification of the distributor of the video content, such as actions to authorize the client device or other associated devices (e.g., second screens) to receive content from the distributor, actions to present sponsored content to the client device or associated devices, and so on.

Abstract: In one aspect, an example method includes (i) identifying, by a playback device, a media device based on a control message received from the media device by way of an audio and/or video interface, where the media device provides media content to the playback device; (ii) providing, by the playback device, replacement media content for display; (iii) determining, by the playback device, that while the playback device is displaying the replacement media content a remote control transmitted an instruction to the identified media device; (iv) determining, by the playback device, a playback-modification action corresponding to the instruction and the identified media device; and (v) modifying, by the playback device, playback of the replacement media content in accordance with the playback-modification action.

Abstract: Examples described herein may perform various operations based on mood congruency. An example method involves accessing, by a processor, from a database, a score that represents a degree of congruency between a first mood vector that describes first media data and a second mood vector that describes second media data, wherein the score is generated based on (i) a first value that the first mood vector associates with a first mood, (ii) a second value that the second mood vector associates with a second mood, and (iii) a degree of congruency between the first and second moods, based on the score, comparing, by the processor, a first characteristic of the first media data, other than the first mood, with a second characteristic of the second media data, other than the second mood, and based at least in part on an output of the comparing, providing an indicator to a module.

Abstract: Methods and systems to insert advertisements and/or other supplemental or replacement content into a stream of video content are described. In some example embodiments, the methods and systems receive a request to replace a portion of video content currently playing at a client device with supplemental video content, such as an advertisement. In response to the request, the methods and systems determine one or more fingerprints of the video content plating at the client device, identify one or more frames of the video content at which to insert the supplemental video content based on the one or more fingerprints, and insert the supplemental video content at the identified one or more frames of the video content.

Abstract: In one aspect, an example method includes (i) presenting, by a playback device, first media content from a first source; (ii) encountering, by the playback device, a trigger to switch from presenting the first media content from the first source to presenting second media content from a second source; (iii) determining, by the playback device, that the playback device is presenting the first media content from the first source in a muted state; and (iv) responsive to encountering the trigger, and based on the determining that the playback device is presenting the first media content from the first source in a muted state, presenting, by the playback device, the second media content from the second source in the muted state.

Abstract: When a media client is receiving a media stream, the media client determines an upcoming time point at which the media client is to perform a content revision involving insertion (e.g., substitution or overlaying) of new content. The media client further determines an advanced time point when the media client should initiate a process of acquiring the new content, setting the advanced time point sufficiently in advance of the upcoming content-revision time point to enable the media client to obtain at least enough of the new content to be able to start the content revision on time. In an example implementation, the media client could determine the advanced time point by predicting how long the content-acquisition process will take, based on consideration of past instances of content acquisition, possibly correlated with operational factors such as content source, processor load, memory load, network speed, and time of day.

Abstract: Techniques of providing motion video content along with audio content are disclosed. In some example embodiments, a computer-implemented system is configured to perform operations comprising: receiving primary audio content; determining that at least one reference audio content satisfies a predetermined similarity threshold based on a comparison of the primary audio content with the at least one reference audio content; for each one of the at least one reference audio content, identifying motion video content based on the motion video content being stored in association with the one of the at least one reference audio content and not stored in association with the primary audio content; and causing the identified motion video content to be displayed on a device concurrently with a presentation of the primary audio content on the device.

Abstract: Methods and systems to authorize devices and/or perform other actions based on identifying content distributors are described. In some example embodiments, the methods and systems access video content playing at a client device, calculate fingerprints of a portion of the video content, identify a distributor of the video content based on the fingerprints, and perform an action in response to the identification of the distributor of the video content, such as actions to authorize the client device or other associated devices (e.g., second screens) to receive content from the distributor, actions to present sponsored content to the client device or associated devices, and so on.

Abstract: Examples described herein may perform various operations based on mood congruency. An example method involves accessing, from a database, a first mood vector that describes first media data and specifies an association between a first value and a first mood, accessing, from the database, a second mood vector that describes a second media data and specifies an association between a second value and a second mood, retrieving a first score that represents congruency between the first and second moods, the first score being retrieved from a data structure that correlates the first and second moods, using a processor, generating a second score that represents congruency between the first and second mood vectors, the generating the second score being based on the accessed first and second values and the retrieved first score, and, based on at least the generated second score, providing an indicator to a module.

Abstract: When a media client is receiving a media stream, the media client determines an upcoming time point at which the media client is to perform a content revision involving insertion (e.g., substitution or overlaying) of new content. The media client further determines an advanced time point when the media client should initiate a process of acquiring the new content, setting the advanced time point sufficiently in advance of the upcoming content-revision time point to enable the media client to obtain at least enough of the new content to be able to start the content revision on time. In an example implementation, the media client could determine the advanced time point by predicting how long the content-acquisition process will take, based on consideration of past instances of content acquisition, possibly correlated with operational factors such as content source, processor load, memory load, network speed, and time of day.

Abstract: Example methods and systems for inserting information into playing content are described. In some example embodiments, the methods and systems may identify at a playback device, content by comparing a fingerprint of the real-time content to reference fingerprints, each of the reference fingerprints corresponding to different media, identify, at the playback device, a break in the real-time content playing via the playback device based on the identification of the real-time content, select an information segment to present during the break based on information captured by a location determination component, and insert the information segment into the real-time content playing via the playback device upon an occurrence of the break.

Abstract: In one aspect, an example method includes (i) determining, by a playback device, a loudness level of first media content that the playback device is receiving from a first source; (ii) comparing, by the playback device, the determined loudness level of the first media content with a reference loudness level indicated by a loudness level profile for the first media content; (iii) determining, by the playback device, a target volume level for the playback device based on a difference between the determined loudness level of the first media content and the reference loudness level; and (iv) while the playback device presents second media content from a second source in place of the first media content, adjusting, by the playback device, a volume of the playback device toward the target volume level.

Abstract: Example methods and systems for displaying actionable elements over playing content, such as video content, are described. In some example embodiments, the methods and systems identify video content currently playing within a display environment provided by a playback device, and display an actionable element within the display environment provided by the playback device that is based on the identified video content and includes one or more user-selectable options to perform an action associated with the identified video content. Further, in some example embodiments, the methods and systems may perform an action (e.g., present supplemental content and/or information) in response to a selection of one or more of the user-selectable options.

Abstract: Example methods and systems for displaying actionable elements over playing content, such as video content, are described. In some example embodiments, the methods and systems identify video content currently playing within a display environment provided by a playback device, and display an actionable element within the display environment provided by the playback device that is based on the identified video content and includes one or more user-selectable options to perform an action associated with the identified video content. Further, in some example embodiments, the methods and systems may perform an action (e.g., present supplemental content and/or information) in response to a selection of one or more of the user-selectable options.

Abstract: Methods and systems for modification of electronic system operation based on acoustic ambience classification are presented. In an example method, at least one audio signal present in a physical environment of a user is detected. The at least one audio signal is analyzed to extract at least one audio feature from the audio signal. The audio signal is classified based on the audio feature to produce at least one classification of the audio signal. Operation of an electronic system interacting with the user in the physical environment is modified based on the classification of the audio signal.