Abstract: A cross-modality knowledge transfer system is provided for adapting one or more source model networks to one or more target model networks. The system is configured to perform steps of providing the TI paired datasets through the source feature encoders of the one or more source model networks, extracting TI source features and TI source moments from the TI paired data by the BN layers of the one or more source model networks, providing the TI paired datasets and the unlabeled TR datasets through the one or more target model networks to extract TI target features and TR target moments, training jointly all the feature encoders of the one or more target model networks by matching the extracted TI target features and TR target moments with the TI source features and TI source moments along with mixing weights, and forming a final target model network by combining the trained one or more target model networks.

Abstract: The present disclosure provides a system and a method for generating a radar image of a scene. The method comprises receiving radar measurements of a scene collected from a set of antennas, wherein the set of antennas are under uncertainties caused by one or a combination of position ambiguities and clock ambiguities of each of the antennas. The method further comprises generating the radar image of the scene by solving a sparse recovery problem. The sparse recovery problem determines, until a termination condition is met, a set of image shifts of the radar image corresponding to different uncertainties of the antennas and updates an estimate of the radar image, based on the determined set of image shifts of the radar image. The sparse recovery problem is solved with a neural network denoiser that denoises a filtering of the estimate of the radar image.

Abstract: An imaging photoplethysmography (iPPG) system is provided. The iPPG system receives a sequence of images of different regions of the skin of the person, where each region including pixels of different intensities indicative of variation of coloration of the skin. The iPPG system further transforms the sequence of images into a multidimensional time-series signal, each dimension corresponding to a different region from the different regions of the skin. The iPPG system further processes the multidimensional time-series signal with a time-series U-Net neural network wherein the pass-through layers include a recurrent neural network (RNN) to generate a PPG waveform, where the vital sign of the person is estimated based on the PPG waveform, and the iPPG system further renders the estimated vital sign of the person.

Abstract: Systems, methods and apparatus for image processing for reconstructing a super resolution (SR) image from multispectral (MS) images. A processor to iteratively, fuse a MS image with an associated PAN image of the scene. Each iteration includes using a gradient descent (GD) approach with a learned forward operator, to generate an intermediate high-resolution multispectral (IHRMS) image with an increased spatial resolution and a smaller error to the DSRMS image compared to the stored MS image. Project the IHRMS image using a trained convolutional neural network (CNN) to obtain an estimated synthesized high-resolution multispectral (ESHRMS) image, for a first iteration. Use the ESHRMS image and the PAN image, as an input to the GD approach for following iterations. The updated IHRMS image is an input to another trained CNN for the following iterations. After predetermined number of iterations, output the fused high-spatial and high-spectral resolution MS image.

Abstract: Systems, methods and apparatus for image processing for reconstructing a super resolution (SR) image from multispectral (MS) images. A processor to iteratively, fuse a MS image with an associated PAN image of the scene. Each iteration includes using a gradient descent (GD) approach with a learned forward operator, to generate an intermediate high-resolution multispectral (IHRMS) image with an increased spatial resolution and a smaller error to the DSRMS image compared to the stored MS image. Project the IHRMS image using a trained convolutional neural network (CNN) to obtain an estimated synthesized high-resolution multispectral (ESHRMS) image, for a first iteration. Use the ESHRMS image and the PAN image, as an input to the GD approach for following iterations. The updated IHRMS image is an input to another trained CNN for the following iterations. After predetermined number of iterations, output the fused high-spatial and high-spectral resolution MS image.