Abstract: A pipeline architecture for analyzing multiple streams of video is embodied, in part, in a layer of application program interfaces (APIs) to each stage of processing. Buffer queuing is used between some stages, which helps moderate the load on the CPU(s). Through the layer of APIs, innumerable video analysis applications can access and analyze video data flowing through the pipeline, and can annotate portions of the video data (e.g., frames and groups of frames), based on the analyses performed, with information that describes the frame or group. These annotated frames and groups flow through the pipeline to subsequent stages of processing, at which increasingly complex analyses can be performed. At each stage, portions of the video data that are of little or no interest are removed from the video data. Ultimately, “events” are constructed and stored in a database, from which cross-event and historical analyses may be performed and associations with, and among, events may be made.

Abstract: A method of managing video data storage in a video surveillance system is disclosed. The disclosed methods extend the amount of calendar time for which video and image data can be stored on a storage device. The disclosed methods apply decision criteria, such as rules, configuration data and preferences, to support intelligent automatic reduction of stored surveillance data such that images and video data of most interest are maintained while less important data is deleted, compressed or archived.

Abstract: A method that determines whether a detected event is a significant event requiring action in a video surveillance system. Determined event attributes and object attributes are analyzed to determine if the potential event should trigger an action by the surveillance system. If the potential event should trigger an action, at least one action is triggered. Actions may include relevant event attribute and object attribute information. Potential event may include events detected by a sensor, or external events communicated by an external system to the surveillance system. Event attributes may include location and type of the potential event. Object attributes may include an identification of an object, and attributes associated with the identified object. If an object cannot be positively identified, object attributes may include potential object identifications or determined group associations of the object.

Abstract: A pipeline architecture for analyzing multiple streams of video is embodied, in part, in a layer of application program interfaces (APIs) to each stage of processing. Buffer queuing is used between some stages, which helps moderate the load on the CPU(s). Through the layer of APIs, innumerable video analysis applications can access and analyze video data flowing through the pipeline, and can annotate portions of the video data (e.g., frames and groups of frames), based on the analyses performed, with information that describes the frame or group. These annotated frames and groups flow through the pipeline to subsequent stages of processing, at which increasingly complex analyses can be performed. At each stage, portions of the video data that are of little or no interest are removed from the video data. Ultimately, “events” are constructed and stored in a database, from which cross-event and historical analyses may be performed and associations with, and among, events may be made.

Abstract: A television viewer interface system allows a viewer to schedule recordings of program material. The system determines if any conflicts exist with the viewer's recording selection and any previously scheduled recordings. If any conflicts are discovered, the system displays a conflict warning to the viewer indicating that a scheduling conflict exists with the viewer's recording selection. The conflict warning allows the user to cancel a scheduled recording. The system displays a list of scheduled recordings to the viewer as a list of programs that the system will record on a particular day or all of the scheduled recordings can also be displayed in a scrollable list.

Abstract: A pipeline architecture for analyzing multiple streams of video is embodied, in part, in a layer of application program interfaces (APIs) to each stage of processing. Buffer queuing is used between some stages, which helps moderate the load on the CPU(s). Through the layer of APIs, innumerable video analysis applications can access and analyze video data flowing through the pipeline, and can annotate portions of the video data (e.g., frames and groups of frames), based on the analyses performed, with information that describes the frame or group. These annotated frames and groups flow through the pipeline to subsequent stages of processing, at which increasingly complex analyses can be performed. At each stage, portions of the video data that are of little or no interest are removed from the video data. Ultimately, “events” are constructed and stored in a database, from which cross-event and historical analyses may be performed and associations with, and among, events may be made.

Abstract: A method of identifying an object captured in a video image in a multi-camera video surveillance system is disclosed. Sets of identifying information are stored in profiles, each profile being associated with one object. The disclosed method of identifying an object includes comparing identifying information extracted from images captured by the video surveillance system to one or more stored profiles. A confidence score is calculated for each comparison and used to determine a best match between the extracted set of identifying information and an object. In one embodiment, the method is used as part of a facial recognition system incorporated into a video surveillance system.

Abstract: A multimedia program bookmarking system provides a bookmark function that allows the user to bookmark a program where he left off. The invention records the frame of the program where the user stopped when the user commands the system to do so. Alternatively, the invention automatically bookmarks the program for the user if the user exits viewing the program. The invention displays an indicator indicating that a bookmark has been saved and the user can, at any time, access his bookmark and continue playback of the program from where he left off. Bookmarks within a single program can be set for different users. Remote controls are encoded for a specific user in a household, allowing each person in the household to have a personal remote control and therefore, personal bookmarks. The invention notes that a set of bookmarks belongs to a certain encoded remote control. The user can alternatively select a specific set of bookmarks manually, through a menu.

Abstract: An automatic playback overshoot correction system predicts the position in the program material where the user expects to be when the user stops the fast forward or reverse progression of the program material. The invention determines the position where the program material was stopped. The media controller transitions to the new mode that the user selected, starting at the stopped position with an overshoot correction factor added or subtracted from it. The invention adapts to the user by remembering how much the user corrects after he stops the fast forward or reverse mode. Correction factors are calculated using the user's corrections and adjusting the correction factors if the user continues to make corrections.

Abstract: A multimedia visual progress indication system that provides a trick play bar that is overlaid onto the program material or displayed on a dedicated display. A cache bar inside of the trick play bar indicates the length of a recording session or the length of stored program material and expands to the right when material is being recorded. Every half hour (or selected increment), the cache bar slides to the left. Time marks are displayed inside the trick play bar giving the user a visual reference point from which to judge the current time and visual time reference points. The time marks are in any increment of time needed. The total length of the stored program material or next time or counter increment in the recording cycle is displayed on the right hand end of the trick play bar. A position indicator moves within the trick play bar and tells the user visually where his current position is within the program material.

Abstract: A television viewer interface system provides a viewer interface that allows the viewer to access different functions of a system. The invention's construct allows items called video loopsets to be stored on a storage device and displays single or multiple video loopsets in the background area of the screen on a TV or monitor. Temporal elements are drawn onto the screen over the video loops. A highlight bar is responsive to the user's commands and is used to indicate the current menu item that can be selected by the user. Information is presented in a successive disclosure format where the user navigates through menus by moving the highlight bar to the right to obtain more information or to the left to see less information and return to the previous location. Whispering arrows are provided on each screen that tell the user that more information is available in that particular direction.

Abstract: A multimedia schedule presentation system provides a program guide area which is a list of the programs that are currently airing, was aired, or is scheduled. The program guide area is semi-transparent and overlays on the broadcast program material that the user is currently watching. The invention displays the program guide information in two different modes: two column or three column. The two column mode displays the available channels in a rotating endless list fashion in the left hand column and the programs for the highlighted channel in the right hand column. The current time period is shown above the left column on the screen and is easily changed by the user. Below the time display is the listing of the channels available to the user. Next to each channel number is the station ID and the title of the current program that is being aired. A description of the current highlighted program is displayed above the two columns.