Abstract: A data-enhanced video viewing system scans videos in order to detect and extract certain objects, such as human faces, so as to compile non-time based synopses, including “facelines” of people appearing in the video sequence. It can also provide a time-based synopsis that includes timestamps for all detected objects. The data-enhanced video viewing system can be deployed on a network for a client to request data extraction on one or more designated videos. The designated video may be one of those that have been uploaded to social networks, uploaded to online video hosting sites, streamed over the Internet or other network, or uploaded directly by the user.

Abstract: A Convolutional Neural Network (CNN) includes an initial set of convolutional layers and max pooling units, in which any input is convoluted with the learned image filters and the output is a stack of the different filter responses. Max pooling produces a scaled version of the output. The process can be repeated several times, resulting in a stack of space invariant-scaled images. Since the operation is space invariant, the computations of these layers not need to be recomputed if interested just in certain regions of the image. A Region Of Interest (ROI) Pooling layer is used to select regions to be processed by the set of fully connected layers, which uses the response of the multiple convolutional layers of the network to determine the regions where the objects (of different scales) could be located. This object proposal method is implemented as a Region Of Interest (ROI) Selector.

Abstract: A computer vision pipeline detects tracks and classifies people or other specified class of objects in a steam of video. The ability to not only detect motion, but to distinguish people or other specified objects, can improve the systems usefulness in applications like security monitoring. A motion detection module provides a motion bitmap and a background subtraction module provides a foreground bitmap, and an object tracking module uses these bitmaps identify and track the specified classes of objects. From these objects and tracks, categorized object data can then be generated.

Abstract: A Convolutional Neural Network (CNN) includes an initial set of convolutional layers and max pooling units, in which any input is convoluted with the learned image filters and the output is a stack of the different filter responses. Max pooling produces a scaled version of the output. The process can be repeated several times, resulting in a stack of space invariant-scaled images. Since the operation is space invariant, the computations of these layers not need to be recomputed if interested just in certain regions of the image. A Region Of Interest (ROI) Pooling layer is used to select regions to be processed by the set of fully connected layers, which uses the response of the multiple convolutional layers of the network to determine the regions where the objects (of different scales) could be located. This object proposal method is implemented as a Region Of Interest (ROI) Selector.

Abstract: A computer vision pipeline detects tracks and classifies people or other specified class of objects in a steam of video. The ability to not only detect motion, but to distinguish people or other specified objects, can improve the systems usefulness in applications like security monitoring. A motion detection module provides a motion bitmap and a background subtraction module provides a foreground bitmap, and an object tracking module uses these bitmaps identify and track the specified classes of objects. From these objects and tracks, categorized object data can then be generated.

Abstract: A data-enhanced video viewing system scans videos in order to detect and extract certain objects, such as human faces, so as to compile non-time based synopses, including “facelines” of people appearing in the video sequence. It can also provide a time-based synopsis that includes timestamps for all detected objects. The data-enhanced video viewing system can be deployed on a network for a client to request data extraction on one or more designated videos. The designated video may be one of those that have been uploaded to social networks, uploaded to online video hosting sites, streamed over the Internet or other network, or uploaded directly by the user.