Abstract: Systems and methods for a radar system to produce a radar image of a region of interest (ROI). A set of antennas to transmit radar pulses to the ROI and to measure a set of reflections from the ROI corresponding to the transmitted radar pulses. A processor acquires an estimate of the radar image, by matching the reflections of the ROI measurements for each antenna. Determine a set of shifts of the radar image. Wherein each shift corresponds to an antenna, and is caused by an uncertainty in a position of the antenna. Update the estimate of the radar image, based on the determined set of shifts of the radar image. Wherein for each antenna, the estimate of the radar image is shifted by the determined shift of the radar image corresponding to the antenna, that fits the reflections of the ROI measurements of the antenna.

Abstract: Systems and methods for a computer implemented image reconstruction system that includes an input interface to receive measurements of a scene. A memory to store a sparsity enforcing neural network (SENN) formed by layers of nodes propagating messages through the layers. Wherein at least one node of the SENN modifies an incoming message with a non-linear function to produce an outgoing message and propagates the outgoing message to another node of the SENN. Wherein the non-linear function is a dual-projection function that limits the incoming message if the incoming message exceeds a threshold. Such that, the SENN is trained to reconstruct an image of the scene from the measurements of the scene. A processor to process the measurements with the SENN to reconstruct the image of the scene. Finally, an output interface to render the reconstructed image of the scene.

Abstract: A method propagates a pulse of wave through the material to receive a set of echoes resulted from scattering the pulse by different portions of the material and simulates a propagation of the pulse in the material using a neural network to determine a simulated set of echoes. Each node in a layer of the neural network corresponds to a portion of the material and assigned a value the permittivity of the portion of the material, such that the values of the nodes at locations of the portions form the image of the distribution of the permittivity of the material. The connection between two layers in the neural network models a scattering event. The method updates the values of the nodes by reducing an error between the received set of echoes and the simulated set of echoes to produce an image of the distribution of the permittivity of the material.

Abstract: Systems and methods for radar systems to produce a radar image of a region of interest (ROI with targets. Sensors to transmit source signals to the ROI and to measure echoes reflected back from the targets corresponding to the transmitted source signals. A processor to calculate an estimate of a noisy and a partial Euclidean Distance Matrix (EDM) of the sensors and the targets. Decompose the noisy and the partial EDM into a low rank EDM that corresponds to locations to actual sensors and target locations, and a sparse matrix of distance errors, using a constrained optimization process. The low rank EDM is mapped into the sensors and the targets locations, to obtain estimated actual sensor locations. Implement an inverse imaging process using the estimated actual sensor locations and the received data, to produce the radar image to output to a communication channel.

Abstract: A remote photoplethysmography (RPPG) system includes an input interface to receive a sequence of measurements of intensities of different regions of a skin of a person indicative of vital signs of the person; a solver to solve an optimization problem to determine frequency coefficients of photoplethysmographic waveforms corresponding to the measured intensities at the different regions, wherein the solver determines the frequency coefficients to reduce a distance between intensities of the skin reconstructed from the frequency coefficients and the corresponding measured intensities of the skin while enforcing joint sparsity on the frequency coefficients; and an estimator to estimate the vital signs of the person from the determined frequency coefficients of photoplethysmographic waveforms.

Abstract: Systems and methods for image processing for increasing resolution of a multi-spectral image. Accept a multi-spectral image including a set of images of a scene. A memory to store a set of dictionaries trained for different channels, and a set of filters trained for the different channels. A hardware processor is to process the set of images of the different channels with the set of filters, and to fuse, for each channel, the set of structures, to produce a set of fused structures. Wherein a fused structure of the channel is fused as a weighted combination of the set of structures using weights corresponding to the channel, such that the fused structures of different channels are combined with different weights. To process the set of fused structures with corresponding dictionaries from the set of dictionaries, to produce a super-resolution multi-spectral image. An output interface to render the super-resolution multi-spectral image.

Abstract: Systems and methods for image processing for increasing resolution of a multi-spectral image. Accept a multi-spectral image including a set of images of a scene. A memory to store a set of dictionaries trained for different channels, and a set of filters trained for the different channels. A hardware processor is to process the set of images of the different channels with the set of filters, and to fuse, for each channel, the set of structures, to produce a set of fused structures. Wherein a fused structure of the channel is fused as a weighted combination of the set of structures using weights corresponding to the channel, such that the fused structures of different channels are combined with different weights. To process the set of fused structures with corresponding dictionaries from the set of dictionaries, to produce a super-resolution multi-spectral image. An output interface to render the super-resolution multi-spectral image.

Abstract: A radar imaging system to reconstruct a radar reflectivity image of a scene including an object moving with the scene, includes an optical sensor to track the object over a period of time including multiple time steps to produce, for each of the multiple time steps, a deformation of a nominal shape of the object, and an electromagnetic sensor to acquire snapshots of the scene over the multiple time steps to produce a set of radar reflectivity image of the object with deformed shapes defined by the corresponding deformations of the nominal shape of the object.

Abstract: Systems and methods for a radar system to produce a radar image of a region of interest (ROI). A set of antennas to transmit radar pulses to the ROI and to measure a set of reflections from the ROI corresponding to the transmitted radar pulses. A processor acquires an estimate of the radar image, by matching the reflections of the ROI measurements for each antenna. Determine a set of shifts of the radar image. Wherein each shift corresponds to an antenna, and is caused by an uncertainty in a position of the antenna. Update the estimate of the radar image, based on the determined set of shifts of the radar image. Wherein for each antenna, the estimate of the radar image is shifted by the determined shift of the radar image corresponding to the antenna, that fits the reflections of the ROI measurements of the antenna.

Abstract: Systems and methods for image processing including a memory having stored multi-angled view images of a scene. Each multi-angled view image includes pixels, and at least one multi-angled view image includes a clouded area in the scene, resulting in missing pixels. A processor configured to align three multi-angled view images in the multi-angled view images to a target view angle of the scene, to form a set of aligned multi-angled view images representing a target point of view of the scene, at least one aligned multi-angled view image of the at least three multi-angled view images, has missing pixels due to the clouded area. Form a matrix using vectorized aligned multi-angled view images, wherein the matrix is incomplete due to the missing pixels. Complete the matrix using a matrix completion to combine the aligned multi-angled view images to produce a fused image of the scene without the clouded area.

Abstract: Systems and methods for determining flows by acquiring a video of the flows with a camera, wherein the flows are pedestrians in a scene. The video includes a set of frames, wherein motion vectors are extracted from each frame in the set, and a data matrix is constructed from the motion vectors in the set of frames. A low rank Koopman operator can be determined from the data matrix and a spectrum of the low rank Koopman operator can be analyzed to determine a set of Koopman modes. Then, the frames are segmented into independent flows according to a clustering of the Koopman modes.

Abstract: Systems and methods for a computer implemented image reconstruction system that includes an input interface to receive measurements of a scene. A memory to store a sparsity enforcing neural network (SENN) formed by layers of nodes propagating messages through the layers. Wherein at least one node of the SENN modifies an incoming message with a non-linear function to produce an outgoing message and propagates the outgoing message to another node of the SENN. Wherein the non-linear function is a dual-projection function that limits the incoming message if the incoming message exceeds a threshold. Such that, the SENN is trained to reconstruct an image of the scene from the measurements of the scene. A processor to process the measurements with the SENN to reconstruct the image of the scene. Finally, an output interface to render the reconstructed image of the scene.

Abstract: Systems and methods for determining flows by acquiring a video of the flows with a camera, wherein the flows are pedestrians in a scene. The video includes a set of frames, wherein motion vectors are extracted from each frame in the set, and a data matrix is constructed from the motion vectors in the set of frames. A low rank Koopman operator can be determined from the data matrix and a spectrum of the low rank Koopman operator can be analyzed to determine a set of Koopman modes. Then, the frames are segmented into independent flows according to a clustering of the Koopman modes.

Abstract: Systems and methods for image processing including a memory having stored multi-angled view images of a scene. Each multi-angled view image includes pixels, and at least one multi-angled view image includes a clouded area in the scene, resulting in missing pixels. A processor configured to align three multi-angled view images in the multi-angled view images to a target view angle of the scene, to form a set of aligned multi-angled view images representing a target point of view of the scene, at least one aligned multi-angled view image of the at least three multi-angled view images, has missing pixels due to the clouded area. Form a matrix using vectorized aligned multi-angled view images, wherein the matrix is incomplete due to the missing pixels. Complete the matrix using a matrix completion to combine the aligned multi-angled view images to produce a fused image of the scene without the clouded area.

Abstract: A system and method determines a noise free image of a scene located behind a wall. A transmit antenna emits a radar pulse from different locations in front of the wall, wherein the radar pulses propagate through the wall and are reflected by the scene as echoes. A set of stationary receive antennas acquire the echoes corresponding to each pulse transmitted from each different location. A radar imaging subsystem connected to the transmit antenna and the set of receive antennas determines a noisy image of the scene for each location of the transmit antenna. A total variation denoiser denoises each noisy image to produce a corresponding denoised image. A combiner combines incoherently the denoised images to produce the noise free image.

Abstract: A method and system for generating an image of a scene behind a wall, wherein the scene is represented as a grid, by first transmitting a radar pulse through the wall using a transmitter and receiving a set of echoes corresponding to the radar pulse being reflected by the scene in a receiver at a known location. Based on the location, an imaging operator that relates the set of echoes to the grid is determined. Using the imaging operator, a sparse delay kernel that matches a response of a current image to a similar response in the set of echoes is determined. Then, the current image is updated, based on the set of echoes, the imaging operator, and the sparse delay kernel. The transmitting, the receiving, the determining, the obtaining, and the updating steps are repeated for different locations until a termination condition is reached.

Abstract: A method and system determines flows by first acquiring a video of the flows with a camera, wherein the flows are pedestrians in a scene, wherein the video includes a set of frames. Motion vectors are extracted from each frame in the set, and a data matrix is constructed from the motion vectors in the set of frames. A low rank Koopman operator is determined from the data matrix and a spectrum of the low rank Koopman operator is analyzed to determine a set of Koopman modes. Then, the frames are segmented into independent flows according to a clustering of the Koopman modes.

Abstract: A method propagates a pulse of wave through the material to receive a set of echoes resulted from scattering the pulse by different portions of the material and simulates a propagation of the pulse in the material using a neural network to determine a simulated set of echoes. Each node in a layer of the neural network corresponds to a portion of the material and assigned a value the permittivity of the portion of the material, such that the values of the nodes at locations of the portions form the image of the distribution of the permittivity of the material. The connection between two layers in the neural network models a scattering event. The method updates the values of the nodes by reducing an error between the received set of echoes and the simulated set of echoes to produce an image of the distribution of the permittivity of the material.

Abstract: A method segments and tracks content in a video stream including sets of one or more images by first determining measured data from each set of one or more images. An adaptive step-size parameter and a low-dimensional subspace characterizing motion of the content the measured data are initialized. A sparse vector representing a sparse component that characterizes the motion of the content different from the motion of the content characterized by the low-dimensional subspace is determined. A change in the low-dimensional subspace for the measured data is determined using a proximal point iteration and the parameter, which is updated according to the change. A low-rank subspace matrix representing the low-dimensional subspace is updated according to the change and the parameter. Then, the low-rank matrix representing the low-dimensional subspace and the sparse vector are outputted.

Abstract: A method separates foreground from background in a sequence of images, by first acquiring the sequence of images and a depth map of a scene by a camera. Groups of pixels are determined based on the depth map. Then, the sequence of images is decomposed into a sparse foreground component, and a low rank background component, according to apparent motion in the sequence of images, and the groups.