Abstract: An automated content recognition system accurately and reliably generates content identification information for multimedia content without accessing the multimedia content or a reliable source of the multimedia content. The system receives content-based queries having fingerprints of multimedia content. The system compares the individual queries to one another to match queries and thereby form query clusters that correspond to the same multimedia content. The system aggregates identification information from the queries in a cluster to generate reliable content identification information from otherwise unreliable identification information.

Abstract: Technology described herein provides techniques for screen detection. This could be a dynamic screen, such as a display screen of an electronic device, or a static screen such as a street sign. In one aspect, a screen is detected in frames of image data. An active image and/or an average color image may be formed based on frames of image data. A set of lines that are candidate for boundaries of a screen are identified in the frames. The active image and/or an average color is integrated on both sides of each line in the set of lines to form integration results. A set of screen candidates are formed based on the integration results. Screens in the screen candidates are scored according to a criterion. One or top few of the screens in the set of screen candidates is selected based on the scoring.

Abstract: Techniques for aligning images are disclosed. The frames might have been captured by a video camera on a hand held device, as one example. Collaboratively aligning related frames of image data is taught. Collaborative alignment determines a correspondence between pixels in pairs of the frames of image data, as well as a confidence in that correspondence. A coordinate system (or transformation) is assigned to each of the frames that is consistent with the correspondences between each of the frame pairs. The confidence in the respective correspondences may be used to provide a weighting to a correspondence when assigning the coordinate systems. Outlying frames may be discarded, and the process repeated for a robust solution.

Abstract: Techniques for aligning images are disclosed. The frames might have been captured by a video camera on a hand held device, as one example. Collaboratively aligning related frames of image data is taught. Collaborative alignment determines a correspondence between pixels in pairs of the frames of image data, as well as a confidence in that correspondence. A coordinate system (or transformation) is assigned to each of the frames that is consistent with the correspondences between each of the frame pairs. The confidence in the respective correspondences may be used to provide a weighting to a correspondence when assigning the coordinate systems. Outlying frames may be discarded, and the process repeated for a robust solution.

Abstract: An automated content recognition system accurately and reliably generates content identification information for multimedia content without accessing the multimedia content or a reliable source of the multimedia content. The system receives content-based queries having fingerprints of multimedia content. The system compares the individual queries to one another to match queries and thereby form query clusters that correspond to the same multimedia content. The system aggregates identification information from the queries in a cluster to generate reliable content identification information from otherwise unreliable identification information.

Abstract: A method analyzes the visual content of media such as videos for collecting together visually-similar appearances in their constituent images (e.g. same scenes, same objects, faces of the same people.) As a result, the most relevant and salient (of clearest and largest presence) visual appearances depicted in the videos are presented to the user, both for the sake of summarizing the video content for the users to “see before they watch” (that is, judge by the depicted video content in a filmstrip-like summary whether they want to mouse-click on the video and actually spend time watching it), as well as for allowing to users to further refine their video search result set according to the most relevant and salient video content returned (e.g. largest screen-time faces).

Abstract: Technology described herein provides techniques for screen detection. This could be a dynamic screen, such as a display screen of an electronic device, or a static screen such as a street sign. In one aspect, a screen is detected in frames of image data. An active image and/or an average color image may be formed based on frames of image data. A set of lines that are candidate for boundaries of a screen are identified in the frames. The active image and/or an average color is integrated on both sides of each line in the set of lines to form integration results. A set of screen candidates are formed based on the integration results. Screens in the screen candidates are scored according to a criterion. One or top few of the screens in the set of screen candidates is selected based on the scoring.

Abstract: Systems and methods for identifying and searching video are disclosed. A video search and identification system includes a catalog representing relationships between video, data and/or objects to enable querying and search based on visual representations of video as well as data or other information associated with the video. In one example, the catalog includes video nodes, metadata nodes and card nodes, although additional or fewer node types may be used. A visual-based video identification system is provided to identify content in video sources. An unidentified video source is accessed and visual fingerprints of one or more frames are generated as query signatures for matching against a base set of known signatures. Confidence measures are generated at the bit level to assist in query signature processing.

Abstract: Systems and methods for identifying and searching video are disclosed. A video search and identification system includes a catalog representing relationships between video, data and/or objects to enable querying and search based on visual representations of video as well as data or other information associated with the video. In one example, the catalog includes video nodes, metadata nodes and card nodes, although additional or fewer node types may be used. A visual-based video identification system is provided to identify content in video sources. An unidentified video source is accessed and visual fingerprints of one or more frames are generated as query signatures for matching against a base set of known signatures. Confidence measures are generated at the bit level to assist in query signature processing.

Abstract: Method, apparatus and computer program product that uses a novel algorithm for edge detection suitable for both natural as well as noisy images. A scale adaptive threshold is used along with a recursive decision process to reveal the significant edges of all lengths and orientations and to localize them accurately even in low-contrast and very noisy images. Further the algorithm is use for fiber detection and enhancement by utilizing stochastic completion-like process from both sides of a fiber. The algorithm relies on an efficient multiscale algorithm for computing all “significantly different” oriented means in an image in 0(N log p), where N is the number of pixels in the image, and p is the length of the longest structure of interest. Experimental results on both natural and noisy images present confirmation of the method, apparatus and computer program product.

Abstract: A method analyzes the visual content of media such as videos for collecting together visually-similar appearances in their constituent images (e.g. same scenes, same objects, faces of the same people.) As a result, the most relevant and salient (of clearest and largest presence) visual appearances depicted in the videos are presented to the user, both for the sake of summarizing the video content for the users to “see before they watch” (that is, judge by the depicted video content in a filmstrip-like summary whether they want to mouse-click on the video and actually spend time watching it), as well as for allowing to users to further refine their video search result set according to the most relevant and salient video content returned (e.g. largest screen-time faces).

Abstract: A method analyzes the visual content of media such as videos for collecting together visually-similar appearances in their constituent images (e.g. same scenes, same objects, faces of the same people.) As a result, the most relevant and salient (of clearest and largest presence) visual appearances depicted in the videos are presented to the user, both for the sake of summarizing the video content for the users to “see before they watch” (that is, judge by the depicted video content in a filmstrip-like summary whether they want to mouse-click on the video and actually spend time watching it), as well as for allowing to users to further refine their video search result set according to the most relevant and salient video content returned (e.g. largest screen-time faces).

Abstract: A method analyzes the visual content of media such as videos for collecting together visually-similar appearances in their constituent images (e.g. same scenes, same objects, faces of the same people.) As a result, the most relevant and salient (of clearest and largest presence) visual appearances depicted in the videos are presented to the user, both for the sake of summarizing the video content for the users to “see before they watch” (that is, judge by the depicted video content in a filmstrip-like summary whether they want to mouse-click on the video and actually spend time watching it), as well as for allowing to users to further refine their video search result set according to the most relevant and salient video content returned (e.g. largest screen-time faces).

Abstract: A method of processing an image includes the steps of computing a plurality of line averages for a first image; identifying a set of pairs of line averages having high edge strengths; identifying a set of maximal pairs of line averages from among the set of line averages having high edge strength; expanding each of the maximal pairs of line averages into line stacks to form a set of line stacks; applying the set of line stacks to a second image so as to compute lines averages for the second image; shifting the line stacks to center the stacks on areas of highest edge strength and computing a distance between line stacks of the first and second images.

Abstract: A novel multiscale approach that combines segmentation with classification to detect abnormal brain structures in medical imagery, and demonstrate its utility in detecting multiple sclerosis lesions in 3D MRI data. The method uses segmentation to obtain a hierarchical decomposition of a multi-channel, anisotropic MRI scan. It then produces a rich set of features describing the segments in terms of intensity, shape, location, and neighborhood relations. These features are then fed into a decision tree-based classifier, trained with data labeled by experts, enabling the detection of lesions in all scales. Unlike common approaches that use voxel-by-voxel analysis, our system can utilize regional properties that are often important for characterizing abnormal brain structures. Experiments show successful detections of lesions in both simulated and real MR images.

Abstract: Method, apparatus and computer program product that uses a novel algorithm for edge detection suitable for both natural as well as noisy images. A scale adaptive threshold is used along with a recursive decision process to reveal the significant edges of all lengths and orientations and to localize them accurately even in low-contrast and very noisy images. Further the algorithm is use for fiber detection and enhancement by utilizing stochastic completion-like process from both sides of a fiber. The algorithm relies on an efficient multiscale algorithm for computing all “significantly different” oriented means in an image in 0(N log p), where N is the number of pixels in the image, and p is the length of the longest structure of interest. Experimental results on both natural and noisy images present confirmation of the method, apparatus and computer program product.

Abstract: A method analyzes the visual content of media such as videos for collecting together visually-similar appearances in their constituent images (e.g. same scenes, same objects, faces of the same people.) As a result, the most relevant and salient (of clearest and largest presence) visual appearances depicted in the videos are presented to the user, both for the sake of summarizing the video content for the users to “see before they watch” (that is, judge by the depicted video content in a filmstrip-like summary whether they want to mouse-click on the video and actually spend time watching it), as well as for allowing to users to further refine their video search result set according to the most relevant and salient video content returned (e.g. largest screen-time faces).

Abstract: A method analyzes the visual content of media such as videos for collecting together visually-similar appearances in their constituent images (e.g. same scenes, same objects, faces of the same people.) As a result, the most relevant and salient (of clearest and largest presence) visual appearances depicted in the videos are presented to the user, both for the sake of summarizing the video content for the users to “see before they watch” (that is, judge by the depicted video content in a filmstrip-like summary whether they want to mouse-click on the video and actually spend time watching it), as well as for allowing to users to further refine their video search result set according to the most relevant and salient video content returned (e.g. largest screen-time faces).

Abstract: A method of processing an image includes the steps of computing a plurality of line averages for a first image; identifying a set of pairs of line averages having high edge strengths; identifying a set of maximal pairs of line averages from among the set of line averages having high edge strength; expanding each of the maximal pairs of line averages into line stacks to form a set of line stacks; applying the set of line stacks to a second image so as to compute lines averages for the second image; shifting the line stacks to center the stacks on areas of highest edge strength and computing a distance between line stacks of the first and second images.