Abstract: Certain aspects of the present disclosure provide techniques and apparatus for biometric authentication using an anti-spoofing protection model refined using online data. The method generally includes receiving a biometric data input for a user. Features for the received biometric data input are extracted through a first machine learning model. It is determined, using the extracted features for the received biometric data input and a second machine learning model, whether the received biometric data input for the user is authentic or inauthentic. It is determined whether to add the extracted features for the received biometric data input, labeled with an indication of whether the received biometric data input is authentic or inauthentic, to a finetuning data set. The second machine learning model is adjusted based on the finetuning data set.

Abstract: Certain aspects of the present disclosure provide techniques for generating fine depth maps for images of a scene based on semantic segmentation and segment-based refinement neural networks. An example method generally includes generating, through a segmentation neural network, a segmentation map based on an image of a scene. The segmentation map generally comprises a map segmenting the scene into a plurality of regions, and each region of the plurality of regions is generally associated with one of a plurality of categories. A first depth map of the scene is generated through a first depth neural network based on a depth measurement of the scene. A second depth map of the scene is generated through a depth refinement neural network based on the segmentation map and the first depth map. One or more actions are taken based on the second depth map of the scene.

Abstract: Systems and techniques are provided for unsupervised scene-decompositional normalizing flows. An example process can include obtaining a scene-decompositional model having a normalizing flow neural network architecture. The process can include determining, based on processing data depicting multiple targets in a scene using the scene-decompositional model, a distribution of scene data as a mixture of flows from one or more background components and one or more foreground components. The process can further include identifying, based on processing the distribution of scene data using the scene-decompositional model, a target associated with the one or more foreground components and included in the data depicting the multiple targets in the scene.

Abstract: Systems and techniques are described herein for performing optical flow estimation for one or more frames. For example, a process can include determining an optical flow prediction associated with a plurality of frames. The process can include determining a position of at least one feature associated with a first frame and determining, based on the position of the at least one feature in the first frame and the optical flow prediction, a position estimate of a search area for searching for the at least one feature in a second frame.

Abstract: Certain aspects of the present disclosure provide techniques and apparatus for efficient processing of visual content using machine learning models. An example method generally includes generating, from an input, an embedding tensor for the input. The embedding tensor for the input is projected into a reduced-dimensional space projection of the embedding tensor based on a projection matrix. An attention value for the input is derived based on the reduced-dimensional space projection of the embedding tensor and a non-linear attention function. A match, in the reduced-dimensional space, is identified between a portion of the input and a corresponding portion of a target against which the input is evaluated based on the attention value for the input. One or more actions are taken based on identifying the match.

Abstract: Aspects of the present disclosure relate to a novel framework for integrating both semantic and instance contexts for panoptic segmentation. In one example aspect, a method for processing image data includes: processing semantic feature data and instance feature data with a panoptic encoding generator to generate a panoptic encoding; processing the panoptic encoding to generate a panoptic segmentation features; and generating the panoptic segmentation mask based on the panoptic segmentation features.

Abstract: A processor-implemented method of video processing using includes receiving, via an artificial neural network (ANN), a video including a first frame and a second frame. A saliency map is generated based on the first frame of the video. The second frame of the video is sampled based on the saliency map. A first portion of the second frame is sampled at a first resolution and a second portion of the second frame is sampled at a second resolution. The first resolution is different than the second resolution. A resampled second frame is generated based on the sampling of the second frame. The resampled second frame is processed to determine an inference associated with the video.

Abstract: Certain aspects of the present disclosure provide techniques method for self-supervised training of a machine learning model to predict the location of a device in a spatial environment, such as a spatial environment including multiple discrete planes. An example method generally includes receiving an input data set of scene data. A generator model is trained to map scene data in the input data set to points in three-dimensional space. One or more critic models are trained to backpropagate a gradient to the generator model to push the points in the three-dimensional space to one of a plurality of planes in the three-dimensional space. At least the generator is deployed.

Abstract: Systems and techniques are described herein for performing optical flow estimation for one or more frames. For example, a process can include determining an optical flow prediction associated with a plurality of frames. The process can include determining a position of at least one feature associated with a first frame and determining, based on the position of the at least one feature in the first frame and the optical flow prediction, a position estimate of a search area for searching for the at least one feature in a second frame. The process can include determining, from within the search area, a position of the at least one feature in the second frame.

Abstract: Certain aspects of the present disclosure provide techniques for using shaped convolution kernels, comprising: receiving an input data patch, and processing the input data patch with a shaped kernel to generate convolution output.

Abstract: Certain aspects of the present disclosure provide techniques for domain adaptation. An input tensor comprising channel state information (CSI) for a wireless signal is determined, where each channel in the input tensor corresponds to a respective degree of freedom (DoF) in the wireless signal. A domain-adapted tensor is generated by processing the input tensor using a domain-adaptation network comprising, for each respective DoF in the wireless signal, a respective convolution path. The domain-adapted tensor is provided to a neural network trained for position estimation.

Abstract: Certain aspects of the present disclosure provide techniques for parameterized activation functions. Input data is processed with at least one layer of the neural network model comprising a parameterized activation function, and at least one trainable parameter of the parameterized activation function is updated based at least in part on output from the at least one layer of the neural network model. The at least one trainable parameter may adjust at least one of a range over which the parameterized activation function is nonlinear or a shape of the parameterized activation function, and/or may adjust a location of at least one pivot of the parameterized activation function.

Abstract: Certain aspects of the present disclosure provide techniques for training neural networks using hierarchical supervision. An example method generally includes training a neural network with a plurality of stages using a training data set and an initial number of classification clusters into which data in the training data set can be classified. A cluster-validation set performance metric is generated for each stage based on a reduced number of classification clusters relative to the initial number of classification clusters and a validation data set. A number of classification clusters to implement at each stage is selected based on the cluster-validation set performance metric and an angle selected relative to the cluster-validation set performance metric for a last stage of the neural network. The neural network is retrained based on the training data set and the selected number of classification clusters for each stage, and the trained neural network is deployed.

Abstract: Certain aspects of the present disclosure provide techniques for cross-task distillation. A depth map is generated by processing an input image using a first machine learning model, and a segmentation map is generated by processing the depth map using a second machine learning model. A segmentation loss is computed based on the segmentation map and a ground-truth segmentation map, and the first machine learning model is refined based on the segmentation loss.

Abstract: Systems and techniques are described herein for performing optical flow estimation for one or more frames. For example, a process can include determining an optical flow prediction associated with a plurality of frames. The process can include determining a position of at least one feature associated with a first frame and determining, based on the position of the at least one feature in the first frame and the optical flow prediction, a position estimate of a search area for searching for the at least one feature in a second frame.

Abstract: Certain aspects of the present disclosure provide techniques for training and inferencing with machine learning localization models. In one aspect, a method, includes training a machine learning model based on input data for performing localization of an object in a target space, including: determining parameters of a neural network configured to map samples in an input space based on the input data to samples in an intrinsic space; and determining parameters of a coupling matrix configured to transport the samples in the intrinsic space to the target space.

Abstract: Disclosed are systems, methods, and non-transitory media for performing passive radio frequency (RF) location detection operations. In some aspects, RF data, such as RF signals including channel state information (CSI), can be received from a wireless device. The RF data can be provided to a self-supervised machine-learning architecture that is configured to perform object location estimation.

Abstract: Certain aspects of the present disclosure provide techniques and apparatus for biometric authentication using neural-network-based anti-spoofing protection mechanisms. An example method generally includes receiving an image of a biometric data source for a user; extracting, through a first artificial neural network, features for at least the received image; combining the extracted features for the at least the received image and a combined feature representation of a plurality of enrollment biometric data source images; determining, using the combined extracted features for the at least the received image and the combined feature representation as input into a second artificial neural network, whether the received image of the biometric data source for the user is from a real biometric data source or a copy of the real biometric data source; and taking one or more actions to allow or deny the user access to a protected resource based on the determination.

Abstract: Certain aspects of the present disclosure provide a method, including: processing input data with a feature extraction stage of a machine learning model to generate a feature map; applying an attention map to the feature map to generate an augmented feature map; processing the augmented feature map with a refinement stage of the machine learning model to generate a refined feature map; processing the refined feature map with a first regression stage of the machine learning model to generate multi-dimensional task output data; and processing the refined feature data with an attention stage of the machine learning model to generate an updated attention map.

Abstract: Certain aspects of the present disclosure provide a method of processing video data. In one example, the method includes receiving input video data; sampling a first subset of clips from the input video data; providing the first subset of clips to a first component of a machine learning model to generate first output; sampling a second subset of clips from the input video data, wherein the second subset of clips comprises fewer clips than the first subset of clips; providing the second subset of clips to a second component of the machine learning model to generate a second output; aggregating the first output from the first component of the machine learning model with the second output from the second component of the machine learning model to generate aggregated output; and determining a characteristic of the input video data based on the aggregated output.