Abstract: An early warning system is provided. The early warning system includes a plurality of sensors, a server, and an information appliance device. The sensors produce status information. The server produces event information according to the status information of the sensors, transforms the event information into a first multimedia signal, and transmits the first multimedia signal to the information appliance device through a computer network. The information appliance device is connected to a display device, wherein the information appliance device transforms the first multimedia signal into a second multimedia signal capable of displaying through the display device. The disclosure further provides an early warning server, an early warning method, and a computer program product for report information.

Abstract: Sponsored-content may be placed based on images in video content. A first image in a frame of a video content item is identified. The first image is matched with a second stored image. A sponsored-content item to be presented is selected based on an association between the second stored image and the sponsored-content item.

Abstract: The present invention relates to a system and method for providing an image-based video service. The present invention provides a system for providing image-based video service, including a cache system configured to store video information that matches image-related data; a fingerprint extraction unit configured to extract the fingerprint of an image corresponding to input image-related data; and a matching unit configured to determine video information that matches the fingerprint of the image extracted by the fingerprint extraction unit; wherein the system for providing image-based video service determines video information, matching image-related data received from a client terminal, via the cache system or the matching unit, and transmits video result information corresponding to the determined video information to the client terminal, and a method using the same.

Abstract: Methods and apparatus for identifying an operating state of an AV device are described. An example method includes extracting, at a first AV device, data communicated via a data bus coupling a processor of the first AV device to a HDMI interface, the HDMI interface coupled to a second AV device different than the first AV device; analyzing a temporal sequence of the extracted data to determine if additional information is needed from the second AV device to identify a current operating state of the second AV device; when the temporal sequence is missing an expected message related to the current operating state of the second AV device, causing an AV network controller of the first AV device to request information from the second AV device; and analyzing a response from the second AV device including the requested information to identify the current operating state of the second AV device.

Abstract: The availability of a new information service is publicized by displaying an icon in an EPG when the presence of a new information service is detected. A list of new services is then displayed responsive to a user command. When one of the new services is displayed instead of the list.

Abstract: Disclosed are various embodiments for identifying importance of scenes or moments in video content relative to one another. Closed captioning data is extracted from a video content feature. A textual analysis of the closed captioning data is performed. The importance level of scenes can be ranked with respect to one another.

Abstract: An automatic content recognition (ACR)-enabled connected TV device may be operable to present an overlay offering a coupon utilizing an ACR system, where the overlay may also be presented on a paired device. The ACR-enabled connected TV device may present information associated with a value of the coupon based on interaction with the presented overlay by the viewer. The value of the coupon may be determined based on a profile associated with the ACR-enabled connected TV device. The profile may be determined and maintained utilizing the ACR system. The viewer may obtain the coupon associated with the value information from a microsite assigned to the viewer. The viewer may share information on a link of the microsite with one or more other viewers. The value of the coupon may change when one or more of the other viewers click on the link of the microsite to obtain the coupon.

Abstract: Methods and apparatus to detect an operating state of a display are disclosed. An example device to detect an operating state of a display includes an optical fiber, an optical-to-electrical converter, and a logic circuit. The optical fiber is optically coupled to a light source of the display. The light energy source is configured to emit light. The optical-to-electrical converter is coupled to the light source via the optical fiber and configured to convert light from the light source into an electrical signal. The logic circuit is coupled to the optical-to-electrical converter and configured to generate an output signal indicative of the operating state of the display based on the electrical signal.

Abstract: Aspects herein describe at least a new method, system, and computer readable storage media for recognizing the content of the audio. A computing device determines whether the content comprises a product and/or service, correlates the product and/or service with one or more promotional deals provided by an organization such as a financial institution, generates a subset of the one or more promotional deals based on the correlation, and transmits the subset to a multimedia viewing device such as a television. The subset of the one or more promotional deals may be viewed by a viewer. The one or more promotional deals are displayed on a portion of the screen of the television for viewing by the viewer. The viewer may make a purchase decision based on the one or more promotional deals displayed.

Abstract: Systems, methods and/or techniques for detection of user-initiated events in relation to a media device are described, for example utilizing a content recognition system. A method may be executed in a media device that is operable to play video content. The method may include receiving user interaction with the media device and the user interaction causes initiation of a feature that affects video content that plays on the media device. The method may include receiving one or more interactive events from a content recognition system in response to the user interaction. The method may comprise executing the one or more interactive events to affect video content that is playing on the media device, and display one or more overlay windows corresponding to the affected video content. One or more video fingerprints that correspond to the affected video content may be communicated to the content recognition system.

Abstract: Example systems and methods to wirelessly meter audio/visual (A/V) devices are disclosed. A disclosed example method receives media content from an A/V source device, embeds a video overlay in the wirelessly received media content, and wirelessly transmits the media content and the video overlay to the wireless A/V device. The example method wirelessly receives audience identification information in response to the transmitted video overlay, and wirelessly receives audience behavior information.

Abstract: Methods and apparatus to monitor audio/visual content from various sources are disclosed. Example methods disclosed herein to monitor a media presentation can include counting zero crossings associated with a plurality of audio samples of an audio signal corresponding to the media presentation, and determining whether the audio signal is muted based on whether a number of zero crossings satisfies a first threshold. Such example methods can also include, when the audio signal is determined to not be muted, determining a source of the media presentation based on whether the audio signal is determined to be compressed.

Abstract: A media system replaces content in a first sequence of media content. The media system presents the first sequence of media content to an end-user and generates a fingerprint of the sequence of media content. The fingerprint is for comparison with a plurality of reference fingerprints so as to identify the first sequence of media content and determine a reference position within the first sequence of media content. The media system sends a request for a replacement sequence of content to a content replacement system, and receives replacement media content selected based on the identified first sequence of media content. The media system presents the replacement media content to the end-user instead of the first sequence of media content. Presenting the replacement media content begins at a position in the first sequence of media content that is determined based on the reference position.

Abstract: Digital video signature apparatus and methods for use with video program identification systems are disclosed. The example apparatus and methods generate a signature associated with a video program. An example system includes a frame scanner to scan video frames associated with the video program. The frame scanner is to select a video frame based on a number of intra-coded macro blocks within the video frame. The example system also includes an intra-coded macro block extractor to extract intra-coded macro blocks from the video frame and a scaled image extractor to extract a scaled image from the intra-coded macro blocks. A signature generator is also included in the example system to calculate a plurality of centroids associated with video frame based on the scaled image and to form the signature based on the plurality of centroids.

Abstract: Determining ranked candidate media in response to media query data corresponding to a query media includes receiving the media query data including feature data of the query media, coordinate data, and boundary data, matching the features with corresponding features of an media database using the feature data to identify features in the media database within a predetermined hamming distance in a hash table from the corresponding features of the query media to obtain matched features in the media database, determining candidate media whose number of matched features exceeds a matched feature threshold, generating a geometry similarity score between the query media and each candidate media using the feature data and the coordinate data, generating a boundary similarity score between the query media and each candidate media using the boundary data, ranking the candidate media based on the numbers of matched features, the geometry similarity scores and the boundary similarity scores.

Abstract: A system that incorporates teachings of the subject disclosure may include, for example, determining if a commercial contains one of metadata, close captioning information, recognizable speech in an audio component of the commercial, or a combination thereof. In response to determining that the commercial does not contain metadata, but does contain close captioning information, an advertised show is identified based on the close captioning information. Likewise, in response to determining that the commercial contains neither metadata, nor close captioning information, but does contain recognizable speech in an audio component of the commercial, the advertised show is identified based on the recognizable speech. Other embodiments are disclosed.

Abstract: An automatic content recognition (ACR) enabled (ACR-enabled) connected TV device may be operable to present, utilizing ACR, an overlay starting at a time that is synchronized to an identified event in presented content. The overlay may comprise one or more messages associated with an online social network. The presented content may comprise a program, a movie, a game or a commercial. The one or more messages may be pre-generated, before presentation of the content, for presentation synchronized to the identified event during the presentation of the content. The one or more messages may be generate during broadcast or streaming of a program or a movie, and the presented content, which comprises the program or the movie, may be presented during a time-delayed playback. The ACR-enabled connected TV device may track, utilizing the ACR, how each of the presented one or more messages is actually being viewed and/or interacted with.

Abstract: A method for recognizing a content, a display apparatus and a content recognition system thereof are provided. The method for recognizing a content of a display apparatus includes acquiring caption information of an image content which is currently displayed, transmitting the acquired caption information to a content recognition server, when the content recognition server compares the acquired caption information with caption information stored in the content recognition server and recognizes a content corresponding to the acquired caption information, receiving information regarding the recognized content from the content recognition server, and displaying information related to the recognized content.

Abstract: This method for synchronizing a first multimedia stream rendered on a first terminal and a second multimedia stream rendered on a second terminal, comprises a step of generation, from an original audio sequence of the first stream, of original audio fingerprints, and further comprises steps of : a) generation from a first sequence of the first stream first audio fingerprints; b) comparison between the first fingerprints and the original fingerprints in order to obtain one or more first synchronization positions; c) correlation of the first sequence with one or more pieces of the original sequence located around the first synchronization positions in order to obtain a second synchronization position d) rendering of the second stream on the second terminal using the second synchronization position.

Abstract: An automatic content recognition (ACR) enabled (ACR-enabled) connected TV device may be operable to collect viewing data, utilizing ACR. The viewing data may comprise viewer interaction information and/or content presentation information associated with the ACR-enabled connected TV device and/or a paired device. The ACR-enabled connected TV device may store the collected viewing data in the ACR-enabled connected TV device. The stored viewing data may be communicated to one or more network providers, by the ACR-enabled connected TV device, for determining customized services for the ACR-enabled connected TV device. The viewing data may be used to determine how to manage advertisements associated with the ACR-enabled connected TV device and/or at a network level associated with the one or more network providers. The viewing data may be used to determine user profiles. The viewing data may also be used to determine programming and/or advertisements targeted to the ACR-enabled connected TV device.

Abstract: A media system, receives a received sequence of media content, for presentation at the media system and generates a comparison fingerprint of the received sequence of media content. The comparison fingerprint is for comparison with a plurality of reference fingerprints so as to identify the received sequence of media content. The media system sends a request for identification of additional content to a server system. The request is based at least in part on the comparison fingerprint. The media system receives a response to the request, including information enabling additional content to be selected for display at the media system based at least in part on the identification of the received sequence of media content, and presents a displayed sequence of media content that includes at least a portion of the received sequence of media content and at least a portion of the additional content.

Abstract: Included is a unit configured to calculate feature points of a scene image of a screen acquired from a television program that is currently on air on a given number of broadcast stations, or a simulcast distribution server at predetermined intervals, and save, in a storage unit, feature point data of a predetermined time period on a broadcast station basis; a unit configured to receive feature point data of an image of a television program currently being watched by a user, the feature point data having been transmitted from a mobile terminal of the user; and a unit configured to check the received feature point data against the feature point data saved in the storage unit and identify a scene image that satisfies a predetermined matching condition.

Abstract: A method for controlling an image display apparatus includes determining a type of a video signal included in an input signal, determining whether three-dimensional (3D) format information is included in the input signal, if the video signal is a 3D video signal, requesting 3D format information about the video signal to a server that stores 3D format information, if the input signal does not include the 3D format information about the video signal, and processing, upon receipt of 3D format information from the server in response to the 3D format information request, the video signal according to the 3D format information and displaying a 3D image based on the processed video signal.

Abstract: Systems and methods are disclosed for customizing, distributing and processing audio fingerprint data. One or more items of audio content are processed to generate pre-recorded audio fingerprints. After identifying one or more specific devices in accordance to panelist and/or household data from a central site, an activation message is communicated to the identified devices, together with the pre-recorded audio fingerprint in accordance with a predetermined schedule. After receiving the activation message, the portable device records the audio content, forms an audio fingerprint, and performs local matching to determine if a match exists. The matching result is then communicated back to the central site for further processing and analysis.

Abstract: An apparatus for processing digital service signals includes a receiving module configured to receive contents having watermarks, where the watermarks are inserted in audio or video frames of the contents, the watermarks carry channel information related to the contents, and content information having URL information for additional data of the contents. An extracting module is configured to extract the watermarks from the audio or video frames, and an obtaining module is configured to obtain the additional data over an IP(Internet Protocol) network using the extracted watermarks.

Abstract: Example methods and systems for displaying actionable elements over playing content, such as video content, are described. In some example embodiments, the methods and systems identify video content currently playing within a display environment provided by a playback device, and display an actionable element within the display environment provided by the playback device that is based on the identified video content and includes one or more user-selectable options to perform an action associated with the identified video content. Further, in some example embodiments, the methods and systems may perform an action (e.g., present supplemental content and/or information) in response to a selection of one or more of the user-selectable options.

Abstract: A receiving device includes: a receiver configured to receive AV content; a feature extractor configured to extract a feature from data of the received AV content; an identification result acquirer configured to acquire an identification result of the AV content identified from the extracted feature by using an Automatic Content Recognition technique; a command acquirer configured to acquire a command for controlling operation of an application program run in conjunction with the AV content in accordance with the acquired identification result; and a controller configured to control operation of the application program in accordance with the acquired command.

Abstract: Methods and apparatus to identify media content using temporal signal characteristics are disclosed. An example method includes generating a reference signature based on a reference signal corresponding to known media, generating sums based on peaks in a media signal corresponding to media, identifying signal peaks based on the generated sums, generating a second signature based on normalized curve features, wherein the normalized curve features respectively correspond to the identified signal peaks at a corresponding temporal locations of the corresponding signal peak, and determining whether the media signal corresponds to the reference signal based on a comparison of the reference signature and the second signature.

Abstract: Disclosed herein is an information processing apparatus which cooperates with a terminal apparatus to configure a home network system, including: a frame visual attribute setting section configured to set a frame visual attribute to a window provided on a screen to display a reproduced piece of content; a publication section configured to publish a command adapted to request notification of the frame visual attribute set to the window from the terminal apparatus to the terminal apparatus; and a notification section configured to notify the terminal apparatus of the frame visual attribute of the window in response to calling of the command from the terminal apparatus.

Abstract: Embodiments are disclosed for methods and systems for adjusting audio/video data. In some embodiments, a method for performing adjustments includes receiving audio content and video content and analyzing the video content to identify image data indicating a channel generating the audio and video content. The method further includes adjusting the audio data of the audio content responsive to a type of content on the channel.

Abstract: Set top box logs are received from a television provider and processed to identify channel tunes and channel tune times. The channel tunes and channel tune times of the log data can be compared to expected air times of television advertisements on channels, and an impression values, e.g., projected viewers, can be generated for each television advertisement.

Abstract: A system, method, and computer program product for automatically analyzing multimedia data are disclosed. Embodiments receive multimedia data, detect portions having specified features, and output a corresponding subset of the multimedia data. Content features from downloaded or streaming movies or video clips are identified as a human probably would do, but in essentially real time. Embodiments then generate an index or menu based on individual consumer preferences. Consumers can peruse the index, or produce customized trailers, or edit and tag content with metadata as desired. The tool can categorize and cluster content by feature, to assemble a library of scenes or scene clusters according to user-selected criteria. The results may be sent to visual search engines so that further related content may be identified for use as a customized trailer, replacement content for advertisements, or as material to be shared with others.

Abstract: Disclosed herein is a receiving apparatus including: an extracting part configured to extract signature data representing a feature of reproduced content from the content; a profile generating part configured to generate user profile data; a query generating part configured to generate a query containing the signature data and the user profile data, transmit the query thus generated to a transmitting apparatus, and receive a response that is sent back from the transmitting apparatus in accordance with the query and that has been caused to match with the user profile data in the transmitting apparatus; and an application executing part configured to acquire and execute an application in conjunction with reproduction of the content based on the response thus received.

Abstract: Apparatus, system and method for performing an action such as accessing supplementary data and/or executing software on a device capable of receiving multimedia are disclosed. After multimedia is received, a monitoring code is detected and a signature is extracted in response thereto from an audio portion of the multimedia. The ancillary code includes a plurality of code symbols arranged in a plurality of layers in a predetermined time period, and the signature is extracted from features of the audio of the multimedia. Supplementary data is accessed and/or software is executed using the detected code and/or signature.

Abstract: User engagement in unwatched videos is predicted by collecting and aggregating data describing user engagement with watched videos. The data are normalized to reduce the influence of factors other than the content of the videos on user engagement. Engagement metrics are calculated for segments of watched videos that indicate user engagement with each segment relative to overall user engagement with the watched videos. Features of the watched videos within time windows are characterized, and a function is learned that relates the features of the videos within the time windows to the engagement metrics for the time windows. The features of a time window of an unwatched video are characterized, and the learned function is applied to the features to predict user engagement to the time window of the unwatched video. The unwatched video can be enhanced based on the predicted user engagement.

Abstract: A method for tracking user behavior includes providing multiple frames from a source to an electronic device, automatically capturing one of the multiple frames viewed on a display device connected to the electronic device based on an event, matching a pattern of the captured frame with a frame template by searching a plurality of frame templates, using the matched frame template to extract information from the captured frame, and storing the extracted information for tracking user behavior.

Abstract: A computerized method for engaging a user of a mobile computer system, The mobile computer system may be connectible to a server over a wide area network. An audio signal of ambient audio is autonomously sampled in the vicinity of the mobile computer system to capture one or more audio samples of the audio signal. The multiple samples of the audio signal are autonomously sampled without requiring any interaction from the user, thus avoiding an input from the user to capture each of the samples. The audio sample may be processed to extract an audio signature of the audio sample. The audio signature may be compared with multiple previously stored reference audio signatures. Upon matching the audio signature with at least one reference audio signature a matched reference audio signature may be produced.

Abstract: A video processing device includes a content analyzer that receives a video signal and generates content recognition data based on the video signal, wherein the content recognition data is associated with at least one timestamp included in the video signal. A metadata search device generates time-coded metadata in response to content recognition data and in accordance with the at least one time stamp. A metadata association device generates a processed video signal from the video signal, wherein the processed video signal includes the time-coded metadata.

Abstract: The present disclosure relates to a system and method for monitoring audio-video (AV) streams transported over a network. The system may include an AV probe deployed between an AV tuner and AV destination customer premise equipment. The AV probe may receive an incoming AV stream. The AV probe may generate a thumbnail stream by capturing thumbnails of the incoming AV stream. The AV probe may transmit, substantially in real-time, the thumbnail stream to a monitoring engine and the incoming AV stream to the AV destination customer premise equipment.

Abstract: A receiving device includes: a receiver configured to receive AV content; a feature extractor configured to extract a feature from data of the received AV content; an identification result acquirer configured to acquire an identification result of the AV content identified from the extracted feature by using an Automatic Content Recognition technique; a command acquirer configured to acquire a command for controlling operation of an application program run in conjunction with the AV content in accordance with the acquired identification result; and a controller configured to control operation of the application program in accordance with the acquired command.

Abstract: Various of the disclosed embodiments contemplate television viewing behavior data collected from a plurality of television set top boxes by using aggregation to detect an excess or a deficit in viewership for a group of television set top boxes. In some embodiments, a group of set top boxes can be associated with a particular television service provider, cable television head-end, or data warehouse. Additionally, some embodiments can clean television viewing behavior data by detecting and correcting aberrant viewership in a time series, e.g. based on a weekly or an approximately monthly frequency. In some embodiments, the aberrant viewership can be detected by calculating a minimum expected number of viewers for a day and comparing it to the actual number of households that reported viewers for that day.

Abstract: A system and method for the automated real-time detection and processing of commercial messages, public service announcements or similar short-duration, repeated TV programming segments occurring in one or more broadcast video steams is described. A process is utilized that identifies possible commercial segments by identifying discrete video segments that have specific short durations among other attributes. Video segments that appear to have these characteristics are considered likely to be television commercials, promotions, or public service announcements and are stored in a TV Ad database which is separate from the primary television content database. Incoming video from a plurality of television programming sources is process into fingerprints and placed in a master TV content database. At the same time, said incoming programming is tested for matches in a TV ad database. If a match is found, then the presumed TV ad is removed from the master content database.

Abstract: A method of selecting a factor for estimating characteristics of viewers who view a same content is disclosed. This method includes: storing a multi-layered hierarchal list of attribute words expressing viewer attributes, each of which is a candidate of the factor; extracting the attribute words from the same content; generating a first vector indicative of frequencies with which the attribute words occur in the same content; for a successively-selected one of the attribute words, successively generating a second vector indicative of frequencies with which the attribute words occur in ones of sets of learned-text information which contain the successively-selected attribute word; calculating a similarity score between the vectors on a per-attribute-word basis; and selecting one of the attribute words as the factor, which is associated with subordinate attribute words on a lower layer, based on a dispersion level of the similarity scores calculated for the subordinate attribute words.

Abstract: Methods and apparatus for monitoring locally inserted media content are disclosed. A disclosed method includes obtaining identification data and inserting the identification data in the media content after the media content has been received at a media consumption location. Another disclosed method includes receiving media content before the media content is output by a consumer receiving device and monitoring the received media content. Monitoring the received media content may include extracting signatures from the received media content and transmitting the extracted signatures to another location.

Abstract: An Internet Protocol television system includes a user profile agent, a keyword detection agent, and an information search agent. The user profile agent is in communication with a multimedia device, and generates a user profile based on information received from the multimedia device. The keyword detection agent is in communication with the user profile agent, and searches text associated with a multimedia video stream transmitted to the multimedia device for keywords associated with the user profile. The information search agent is in communication with the keyword detection agent, and connects to an information source associated with the keywords detected by the keyword detection agent, and provides additional information associated with the keywords to the multimedia device.

Abstract: An embodiment of the present invention includes a technique for extracting private user data. A data sequence in a packetized transport stream is parsed to obtain a user data identifier (UDI) associated with a pre-defined data structure. The UDI is registered with a registration authority and is different from a standard identifier that is defined by a standard organization in a published standard document. The UDI is recognized. The private user data is extracted from the data sequence according to the pre-defined data structure corresponding to the recognized UDI.

Abstract: Methods and apparatus to monitor media exposure are disclosed. An example implementation includes transmitting a start signal from a mailable meter to at least one mailable meter to at least one wearable meter; receiving a first audio at the mailable meter upon transmission of the start signal; receiving a second audio at the at least one wearable meter upon reception of the start signal; deriving a signature of the first received audio at the mailable meter; deriving a signature of the second received audio at the at least one wearable meter; transmitting the signature of the second received audio and an identification number from the at least one wearable meter to the mailable meter; and storing the signature of the first received audio and the identification number at the mailable meter as audience measurement data if the signature of the first received audio and the signature of the second received audio correlate.

Abstract: An automatic content recognition (ACR)-enabled connected TV device coupled to an ACR system may be operable to detect, utilizing the ACR system, interaction with and/or watching of certain content by a viewer. A reward may be presented by the ACR-enabled connected TV device, utilizing the ACR system, based on the detected interaction and/or watching. The certain content may comprise a program, a commercial, a movie or a game associated with a network that is being presented. The reward may be redeemed to unlock additional features and/or content. The interaction may comprise sharing by the viewer, information on the certain content with one or more other viewers. The ACR-enabled connected TV device may then present the reward based on the sharing. The ACR-enabled connected TV device may be operable to present, utilizing the ACR system, information on alternative content with a higher reward value for the viewer to interact and/or watch.

Abstract: A system for extracting and monitoring media tags within video content includes at least one server in communication with a plurality of content sources, the server receiving video content from the content sources, a recorder saving the video content, a detector receiving at least one frame of the video content, the detector detecting one or more unknown text within the frame and creating one or more images, each image associated with one of the one or more unknown text, the detector generating metadata associated with the one or more unknown text appearing in the frame, and an optical character recognition engine scanning the one or more images and converting the one or more images into one or more known text. The server further determines that the one or more known text is a media tag.

Abstract: Methods, systems, and computer programs are provided for measuring the performance of a remote display. One method includes an operation for embedding in display frames a respective frame identifier and a respective frame picture. The respective frame picture is placed in a respective region that depends of the value of the respective frame identifier. Additionally, the method includes operations for sending the plurality of display frames to a remote client, and for extracting each received frame picture from the respective region of each received display frame at the remote client based on the received frame identifier. The received frame quality is calculated for each received display frame based on the comparison of the extracted received frame picture with the respective frame picture. Further, the method includes an operation for calculating a remote display quality for the remote client based on the calculated received frame quality for the received display frames.