Abstract: A method for implementing application self-optimization in serverless edge computing environments is presented. The method includes requesting deployment of an application pipeline on data received from a plurality of sensors, the application pipeline including a plurality of microservices, enabling communication between a plurality of pods and a plurality of analytics units (AUs), each pod of the plurality of pods including a sidecar, determining whether each of the plurality of AUs maintains any state to differentiate between stateful AUs and stateless AUs, scaling the stateful AUs and the stateless AUs, enabling communication directly between the sidecars of the plurality of pods, and reusing and resharing common AUs of the plurality of AUs across different applications.

Abstract: Systems and methods for video analytic processing with neuro-symbolic artificial intelligence are provided. These systems and methods include detecting and extracting one or more objects from one or more video frames, and identifying the attributes associated with each of the one or more objects. These further include extracting context from a question, and compiling a series of inquiries to identify the information needed to answer the question and identify missing information. These further include storing intermediate information about the extracted objects and identified attributes, and determining whether the question requires further modeling of data to obtain missing information. These further include mining the one or more video frames for missing information, and compiling the intermediate information from the data storage and missing information based on the context of the question to produce a final answer.

Abstract: Methods and systems for face clustering include determining a quality score for each of a set of input images. A first subset of the input images is clustered, having respective quality scores that exceed a predetermined threshold, to form an initial set of clusters. A second subset of the input images is clustered, having respective quality scores below the predetermined threshold. An action is performed responsive to the clustered images after the second subset is added to the initial set of clusters.

Abstract: A computer-implemented method executed by at least one processor for detecting tattoos on a human body is presented. The method includes inputting a plurality of images into a tattoo detector, selecting one or more images of the plurality of images including tattoos, extracting, via a feature extractor, tattoo feature vectors from the tattoos found in the one or more images of the plurality of images including tattoos, applying a deep learning tattoo matching model to determine potential matches between the tattoo feature vectors and preexisting tattoo images stored in a tattoo training database, and generating a similarity score between the tattoo feature vectors and one or more of the preexisting tattoo images stored in the tattoo training database.

Abstract: A computer-implemented method is provided. The method includes classifying a video clip of consecutive video frames into one of predefined new classes in relation to a base training set class. The method further includes controlling a system of a motor vehicle for accident avoidance responsive to the one of the predefined classes indicating an impending collision. The classifying step includes extracting video frame features from the video clip. The classifying step further includes aggregating the video frame features of the consecutive video frames into a single frame feature to form a video level feature presentation. The classifying step also includes mapping, by a distance-based classifier, the video level feature presentation into a classification prediction based on cosine similarity.

Abstract: A method for implementing application self-optimization in serverless edge computing environments is presented. The method includes requesting deployment of an application pipeline on data received from a plurality of sensors, the application pipeline including a plurality of microservices, enabling communication between a plurality of pods and a plurality of analytics units (AUs), each pod of the plurality of pods including a sidecar, determining whether each of the plurality of AUs maintains any state to differentiate between stateful AUs and stateless AUs, scaling the stateful AUs and the stateless AUs, enabling communication directly between the sidecars of the plurality of pods, and reusing and resharing common AUs of the plurality of AUs across different applications.

Abstract: Methods and systems for face recognition and response include extracting a face image from a video stream. A pre-processed index is searched for a watchlist image that matches the face image, based on a similarity distance that is computed from a normalized similarity score to satisfy metric properties. The index of the watchlist includes similarity distances between face images stored in the watchlist. An action is performed responsive to a determination that the extracted face image matches the watchlist image.

Abstract: Methods and systems of training a neural network include training a feature extractor and a classifier using a first set of training data that includes one or more base cases. The classifier is trained with few-shot adaptation using a second set of training data, smaller than the first set of training data, while keeping parameters of the feature extractor constant.

Abstract: Methods and systems for detecting and predicting anomalies include processing frames of a video stream to determine values of a feature corresponding to each frame. A feature time series is generated that corresponds to values of the identified feature over time. A matrix profile is generated that identifies similarities of sub-sequences of the time series to other sub-sequences of the feature time series. An anomaly is detected by determining that a value of the matrix profile exceeds a threshold value. An automatic action is performed responsive to the detected anomaly.

Abstract: A method is provided for classifying objects. The method detects objects in one or more images. The method tags each object with multiple features. Each feature describes a specific object attribute and has a range of values to assist with a determination of an overall quality of the one or more images. The method specifies a set of training examples by classifying the overall quality of at least some of the objects as being of an acceptable quality or an unacceptable quality, based on a user's domain knowledge about an application program that takes the objects as inputs. The method constructs a plurality of first-level classifiers using the set of training examples. The method constructs a second-level classifier from outputs of the first-level automatic classifiers. The second-level classifier is for providing a classification for at least some of the objects of either the acceptable quality or the unacceptable quality.

Abstract: A computer-implemented method for emulating an object recognizer includes receiving testing image data, and emulating, by employing a first object recognizer, a second object recognizer. Emulating the second object recognizer includes using the first object recognizer to perform object recognition on a testing object from the testing image data to generate data, the data including a feature representation for the testing object, and classifying the testing object based on the feature representation and a machine learning model configured to predict whether the testing object would be recognized by a second object recognizer. The method further includes triggering an action to be performed based on the classification.

Abstract: Methods and systems for face clustering include determining a quality score for each of a set of input images. A first subset of the input images is clustered, having respective quality scores that exceed a predetermined threshold, to form an initial set of clusters. A second subset of the input images is clustered, having respective quality scores below the predetermined threshold. An action is performed responsive to the clustered images after the second subset is added to the initial set of clusters.

Abstract: Systems and methods for video analytic processing with neuro-symbolic artificial intelligence are provided. These systems and methods include detecting and extracting one or more objects from one or more video frames, and identifying the attributes associated with each of the one or more objects. These further include extracting context from a question, and compiling a series of inquiries to identify the information needed to answer the question and identify missing information. These further include storing intermediate information about the extracted objects and identified attributes, and determining whether the question requires further modeling of data to obtain missing information. These further include mining the one or more video frames for missing information, and compiling the intermediate information from the data storage and missing information based on the context of the question to produce a final answer.

Abstract: A method for real-time cross-spectral object association and depth estimation is presented. The method includes synthesizing, by a cross-spectral generative adversarial network (CS-GAN), visual images from different data streams obtained from a plurality of different types of sensors, applying a feature-preserving loss function resulting in real-time pairing of corresponding cross-spectral objects, and applying dual bottleneck residual layers with skip connections to accelerate real-time inference and to accelerate convergence during model training.

Abstract: A computer-implemented method executed by at least one processor for person identification is presented. The method includes employing one or more cameras to receive a video stream including a plurality of frames to extract features therefrom, detecting, via an object detection model, objects within the plurality of frames, detecting, via a key point detection model, persons within the plurality of frames, detecting, via a color detection model, color of clothing worn by the persons, detecting, via a gender and age detection model, an age and a gender of the persons, establishing a spatial connection between the objects and the persons, storing the features in a feature database, each feature associated with a confidence value, and normalizing, via a ranking component, the confidence values of each of the features.

Abstract: Methods and systems for image clustering include matching a new image to a representative image of a cluster. The new image is set as a representative of the cluster with a first time limit. The new image is set as a representative of the cluster with a second time limit, responsive to a determination that the new image has matched at least one incoming image during the first time limit.

Abstract: A method for free flow fever screening is presented. The method includes capturing a plurality of frames from thermal data streams and visual data streams related to a same scene to define thermal data frames and visual data frames, detecting and tracking a plurality of individuals moving in a free-flow setting within the visual data frames, and generating a tracking identification for each individual of the plurality of individuals present in a field-of-view of the one or more cameras across several frames of the plurality of frames. The method further includes fusing the thermal data frames and the visual data frames, measuring, by a fever-screener, a temperature of each individual of the plurality of individuals within and across the plurality of frames derived from the thermal data streams and the visual data streams, and generating a notification when a temperature of an individual exceeds a predetermined threshold temperature.

Abstract: Systems and methods for enabling automated log analysis with controllable resource requirements are provided. A training set for log pattern learning is generated based on heterogeneous logs generated by a computer system. An incremental learning process is implemented to generate a set of log patterns from the training set. The heterogeneous logs are parsed using the set of log patterns. A set of applications is applied to the parsed logs.

Abstract: Methods and systems for video analysis and response include detecting face images within video streams. Noisy images are filtered from the detected face images. Batches of the remaining detected face images are clustered to generate mini-clusters, constrained by temporal locality. The mini-clusters are globally clustered to generate merged clusters formed of face images for respective people, using camera-chain information to constrain a set of the video streams being considered. Analytics are performed on the merged clusters to identify a tracked individual's movements through an environment. A response is performed to the tracked individual's movements.

Abstract: Methods and systems for face recognition and response include extracting a face image from a video stream. A pre-processed index is searched for a watchlist image that matches the face image, based on a similarity distance that is computed from a normalized similarity score to satisfy metric properties. The index of the watchlist includes similarity distances between face images stored in the watchlist. An action is performed responsive to a determination that the extracted face image matches the watchlist image.