Abstract: Simultaneously processing video input data from thousands of input streams, in real-time or after the fact, automatically carries out logging of video data, extraction of metadata, derivation of additional metadata from extracted metadata, association of extracted metadata and derived metadata with specific video inputs, and record video data and/or metadata in databases for further analysis or viewing, while maintaining linkage between extracted and derived metadata and the video and/or metadata used in its extraction or derivation. Metadata associated with video data using video and associated metadata from additional video data inputs and/or improved processing methods are improved as such information becomes available for processing.