Abstract: Embodiments are disclosed for using natural language processing (NLP) to manage security video data. A method of using NLP to search security video data includes receiving, by a surveillance video query system, a text query. A query embedding corresponding to the text query is obtained using a text query model. One or more matching frame embeddings that match the query embedding are identified in a vector database. Matching surveillance video data corresponding to the one or more matching frame embeddings is then obtained from a surveillance video data store. The matching surveillance video data is returned in response to receipt of the text query.
Type:
Grant
Filed:
September 6, 2023
Date of Patent:
April 9, 2024
Assignee:
Coram AI, Inc.
Inventors:
Ashesh Jain, Peter Ondruska, Yawei Ye, Qiangui Huang