Abstract: A system and method for generating federated machine learning (ML) model are provided herein. The method may include: distributing, by a software agent executed by a computing device, a first machine learning model to a plurality of user devices, wherein the software agent provides the plurality of user devices with instructions for the training of the first ML model; each of the plurality of user devices, training the first ML model individually by submitting to the first ML model labelled user data sets, wherein the training of the ML model proceeds according to the instructions provided by the software agent; receiving, by the computing device, the individually trained first ML models, and identifying whether the ML models have been trained according to the software agent's instructions; and combining the individually trained first ML models to create a federated ML model which has been trained according to the software agent's instructions.

Abstract: A system and a method for training a machine learning model with a subclass of one or more predefined classes of visual objects obtained from a video, are provided herein. The method includes: presenting to a human operator, over an electronic display, a plurality of visual objects obtained from the video, wherein the plurality of visual objects belongs to one or more predefined classes of visual objects; receiving from the human operator, a selection of some of the plurality of visual objects, wherein the selection is directed at visual objects belonging to at least one subclass of the one or more predefined classes; and training a machine learning model, using a computer processor, to distinguish between visual objects belonging to the at least one subclass and visual objects belonging to the predefined one or more classes but not belonging to the at least one subclass, based on said selection.

Abstract: A method and system for generating an interaction-aware video synopsis are provided herein. The method may include the following steps: obtaining, a source video containing a plurality of source objects; extracting the source objects from the source video; detecting at least one object-interaction between at least two source objects; generating synopsis objects by sampling respective source objects; and generating a synopsis video having an overall play time shorter than the overall play time of the source video, by determining a play time for each one of the synopsis objects, wherein a relative display time in the synopsis video of the at least two synopsis objects created from the at least two source objects, detected as having an object-interaction therebetween, is the same as the relative display time of the at least two source objects in the source video.

Abstract: A method and system for querying a video by incorporating video analytics and large language models (LLM). The method may include the following steps: receiving a video stream having a sequence of frames and including one or more objects; applying video analytics algorithms to the video stream, to yield video analytics features indicative of the one or more objects; receiving a user query comprising a verbal or auditory enquiry relating to the one or more objects in the video stream; carrying out a selection of at least one of the one or more objects in the video stream; generating, a prompt which is usable as a query for a large language model (LLM), based on: the user query, the video analytics features, and the selection of the at least one of the one or more objects; and applying, the prompt to the LLM, to yield an LLM response.

Abstract: A method and system for alarm verification based on video analytics of a plurality of alerts issued by an alert system, wherein the alert system includes at least one sensor, are provided herein. The system may include: a server comprising a computer processor and an interface for communicating with the alert system, wherein the computer processor is configured to: receive at least one alert issued by the alert system; receive at least one video clip associated with the at least one alert; and analyze, by the computer processor, using video analytics algorithms, the at least one video clip, and determine whether the at least one alert is reliable above a predefined threshold.

Abstract: A method and system for alarm verification based on video analytics of a plurality of alerts issued by an alert system, wherein the alert system includes at least one sensor, are provided herein. The system may include: a server comprising a computer processor and an interface for communicating with the alert system, wherein the computer processor is configured to: receive at least one alert issued by the alert system; receive at least one video clip associated with the at least one alert; and analyze, by the computer processor, using video analytics algorithms, the at least one video clip, and determine whether the at least one alert is reliable above a predefined threshold.

Abstract: A method and system for generating an interaction-aware video synopsis are provided herein. The method may include the following steps: obtaining, a source video containing a plurality of source objects; extracting the source objects from the source video; detecting at least one object-interaction between at least two source objects; generating synopsis objects by sampling respective source objects; and generating a synopsis video having an overall play time shorter than the overall play time of the source video, by determining a play time for each one of the synopsis objects, wherein a relative display time in the synopsis video of the at least two synopsis objects created from the at least two source objects, detected as having an object-interaction therebetween, is the same as the relative display time of the at least two source objects in the source video.

Abstract: A method and system for alarm verification based on video analytics of a plurality of alerts issued by an alert system, wherein the alert system includes at least one sensor, are provided herein. The system may include: a server comprising a computer processor and an interface for communicating with the alert system, wherein the computer processor is configured to: receive at least one alert issued by the alert system; receive at least one video clip associated with the at least one alert; and analyze, by the computer processor, using video analytics algorithms, the at least one video clip, and determine whether the at least one alert is reliable above a predefined threshold.

Abstract: A system and a method for training a machine learning model with a subclass of one or more predefined classes of visual objects obtained from a video, are provided herein. The method includes: presenting to a human operator, over an electronic display, a plurality of visual objects obtained from the video, wherein the plurality of visual objects belongs to one or more predefined classes of visual objects; receiving from the human operator, a selection of some of the plurality of visual objects, wherein the selection is directed at visual objects belonging to at least one subclass of the one or more predefined classes; and training a machine learning model, using a computer processor, to distinguish between visual objects belonging to the at least one subclass and visual objects belonging to the predefined one or more classes but not belonging to the at least one subclass, based on said selection.

Abstract: Systems and methods for cloud-based device management. In one implementation, a processing device receives one or more images captured in relation to a device, processes the one or more images to determine a presence of one or more identifiers within the one or more images, based on a determination that an identifier is present within the one or more images, processes the identifier in relation to an information repository to determine a permission status with respect to the identifier; identifies an instruction protocol associated with the device, generates an instruction corresponding to the permission status and the instruction protocol, and provides the instruction to the device.

Abstract: A building radar-camera system includes a camera configured to capture one or images, the one or more images including first locations within the one or more images of one or more points on a world-plane and a radar system configured to capture radar data indicating second locations on the world-plane of the one or more points. The system includes one or more processing circuits configured to receive a correspondence between the first locations and the second locations of the one or more points, generate a sphere-to-plane homography, the sphere-to-plane homography translating between points captured by the camera modeled on a unit-sphere and the world-plane based on the correspondence between the first locations and the second locations, and translate one or more additional points captured by the camera or captured by the radar system between the unit-sphere and the world-plane based on the sphere-to-plane homography.

Abstract: Systems and methods are disclosed for dynamic image capture and processing. In one implementation, a processing device receives a first video stream, the first video stream being captured via an optical sensor configured with a first set of capture parameters. The processing device processes the first video stream with a first set of processing parameters. The processing device receives a second video stream, the second video stream being captured via the optical sensor configured with a second set of capture parameters. The processing device processes the second video stream with a second set of processing parameters. The processing device provides an output based on at least one of (a) the first video stream, as processed, or (b) the second video stream, as processed.

Abstract: A system and a method for visual analysis of customer interaction at a scene are provided herein. The method may include: receiving at least one video sequence comprising a sequence of frames, captured by cameras covering the scene which includes at least one staff person and at least one customer; detecting, using a computer processor, persons in the at least one video sequence; classifying, using the computer processor, the persons to at least one customer; calculating a signature for the at least one person, enabling a recognition of the at least person appearing in other frames of the video sequences; and carrying out a visual analysis, using the computer processor and based on the at least one video sequence of at least one customer interaction which is visible at the scene, to yield an indication of the interaction between the staff person and the at least one customer.

Abstract: A building access system for a building including a front facing camera system configured to capture one or more images of a face of a user, wherein one or more front facing camera processing circuits configured to detect and authenticate the user based on the one or more images captured by the front facing camera system and operate building equipment. The system further including a down facing camera system configured to capture one or more overhead images of the user from an overhead perspective, wherein one or more down facing camera processing circuits configured to detect whether a second user is tailgating the user based on the one or more overhead images captured by the down facing camera system and generate an alarm in response to a detection that the second user is tailgating the user.

Abstract: A building radar-camera system includes a camera configured to capture one or images, the one or more images including first locations within the one or more images of one or more points on a world-plane and a radar system configured to capture radar data indicating second locations on the world-plane of the one or more points. The system includes one or more processing circuits configured to receive a correspondence between the first locations and the second locations of the one or more points, generate a sphere-to-plane homography, the sphere-to-plane homography translating between points captured by the camera modeled on a unit-sphere and the world-plane based on the correspondence between the first locations and the second locations, and translate one or more additional points captured by the camera or captured by the radar system between the unit-sphere and the world-plane based on the sphere-to-plane homography.

Abstract: A building radar-camera system includes a camera configured to capture one or images, the one or more images including first locations within the one or more images of one or more points on a world-plane and a radar system configured to capture radar data indicating second locations on the world-plane of the one or more points. The system includes one or more processing circuits configured to receive a correspondence between the first locations and the second locations of the one or more points, generate a sphere-to-plane homography, the sphere-to-plane homography translating between points captured by the camera modeled on a unit-sphere and the world-plane based on the correspondence between the first locations and the second locations, and translate one or more additional points captured by the camera or captured by the radar system between the unit-sphere and the world-plane based on the sphere-to-plane homography.

Abstract: Systems and methods for cloud-based device management. In one implementation, a processing device receives one or more images captured in relation to a device, processes the one or more images to determine a presence of one or more identifiers within the one or more images, based on a determination that an identifier is present within the one or more images, processes the identifier in relation to an information repository to determine a permission status with respect to the identifier; identifies an instruction protocol associated with the device, generates an instruction corresponding to the permission status and the instruction protocol, and provides the instruction to the device.

Abstract: A building access system for a building including a front facing camera system configured to capture one or more images of a face of a user, wherein one or more front facing camera processing circuits configured to detect and authenticate the user based on the one or more images captured by the front facing camera system and operate building equipment. The system further including a down facing camera system configured to capture one or more overhead images of the user from an overhead perspective, wherein one or more down facing camera processing circuits configured to detect whether a second user is tailgating the user based on the one or more overhead images captured by the down facing camera system and generate an alarm in response to a detection that the second user is tailgating the user.

Abstract: A building radar-camera system includes a camera configured to capture one or images, the one or more images including first locations within the one or more images of one or more points on a world-plane and a radar system configured to capture radar data indicating second locations on the world-plane of the one or more points. The system includes one or more processing circuits configured to receive a correspondence between the first locations and the second locations of the one or more points, generate a sphere-to-plane homography, the sphere-to-plane homography translating between points captured by the camera modeled on a unit-sphere and the world-plane based on the correspondence between the first locations and the second locations, and translate one or more additional points captured by the camera or captured by the radar system between the unit-sphere and the world-plane based on the sphere-to-plane homography.

Abstract: Systems and methods for cloud-based device management. In one implementation, a processing device receives one or more images captured in relation to a device, processes the one or more images to determine a presence of one or more identifiers within the one or more images, based on a determination that an identifier is present within the one or more images, processes the identifier in relation to an information repository to determine a permission status with respect to the identifier; identifies an instruction protocol associated with the device, generates an instruction corresponding to the permission status and the instruction protocol, and provides the instruction to the device.