Abstract: A computer implemented method of encoding data. The method includes providing a first set of parameters that represent at least a part of the data, determining for parameters in the first set of parameters a weighted first sum depending on the parameters that is positive, providing a first parameter that represents at least a part of the data, and determining an encoding of the data depending on a ratio between the first parameter and the first sum or a root of a predetermined order of the first sum.

Abstract: A computer-implemented system and method relate to object discovery. The system and method include receiving a source image and generating input data by associating each pixel of the source image with predetermined phase values. An encoder encodes the input data to generate latent representation data in spherical coordinates. A decoder decodes the latent representation data to generate spherical reconstruction data of the source image. The spherical reconstruction data includes a radial component and a plurality of phase components. A reconstructed image is generated based at least on the radial component. The reconstructed image is a reconstruction of the source image.

Abstract: A computer-implemented method for training a normalizing flow. The normalizing flow predicts a first density value based on a first input image. The first density value characterizes a likelihood of the first input image to occur. The first density value is predicted based on an intermediate output of a first convolutional layer of the normalizing flow. The intermediate output is determined based on a plurality of weights of the first convolutional layer. The method for training includes: determining a second input image; determining an output, wherein the output is determined by providing the second input image to the normalizing flow and providing an output of the normalizing flow as output; determining a second density value based on the output tensor and on the plurality of weights; determining a natural gradient of the plurality of weights with respect to the second density value; adapting the weights according to the natural gradient.

Abstract: Generally discussed herein are devices, systems, and methods for machine learning (ML) modeling of a system that operates on a multivector object. A method includes receiving, by an ML model, the multivector object as an input that represents a state of the multivector system. The method includes operating, by the ML model and using a Clifford layer that includes neurons that implement a multivector kernel, on the multivector input to generate a multivector output that represents the state of the multivector system responsive to the multivector input.

Abstract: A method performed by an artificial neural network includes determining a conditional probability distribution representing a channel based on a data set of transmit and receive sequences. The method also includes determining a latent representation of the channel based on the conditional probability distribution. The method further includes performing a channel-based function based on the latent representation.

Abstract: Certain aspects provide a method for determining a solution to a combinatorial optimization problem, including: determining a plurality of subgraphs, wherein each subgraph of the plurality of subgraphs corresponds to a combinatorial variable of the plurality of combinatorial variables; determining a combinatorial graph based on the plurality of subgraphs; determining evaluation data comprising a set of vertices in the combinatorial graph and evaluations on the set of vertices; fitting a Gaussian process to the evaluation data; determining an acquisition function for vertices in the combinatorial graph using a predictive mean and a predictive variance from the fitted Gaussian process; optimizing the acquisition function on the combinatorial graph to determine a next vertex to evaluate; evaluating the next vertex; updating the evaluation data with a tuple of the next vertex and its evaluation; and determining a solution to the problem, wherein the solution comprises a vertex of the combinatorial graph.

Abstract: Certain aspects of the present disclosure provide a method for performing quantum convolution, including: receiving input data at a neural network model, wherein the neural network model comprises at least one quantum convolutional layer; performing quantum convolution on the input data using the at least one quantum convolutional layer; generating an output wave function based on the quantum convolution using the at least one quantum convolution layer; generating a marginal probability distribution based on the output wave function; and generating an inference based on the marginal probability distribution.

Abstract: A device for and a computer implemented method of digital signal processing. The method includes providing a first set of data, mapping the first set of data with to a second set of data, and determining an output of the digital signal processing depending on the second set of data. The second set of data is determined depending on a sum of a finite series of terms. At least one term of the series is determined depending on a result of a convolution of the first set of data with a kernel and at least one term of the series is determined depending on the first set of data and independent of the kernel.

Abstract: A computer-implemented method of training a machine learnable function, such as an image classifier or image feature extractor. When applying such machine learnable functions in autonomous driving and similar application areas, generalizability may be important. To improve generalizability, the machine learnable function is rewarded for responding predictably at a layer of the machine learnable function to a set of differences between input observations. This is done by means of a regularization objective included in the objective function used to train the machine learnable function. The regularization objective rewards a mutual statistical dependence between representations of input observations at the given layer, given a difference label indicating a difference between the input observations.

Abstract: A computing device may be configured to intelligently activate gating within a current layer of a neural network that includes two or more filters. The computing device may receive a layer-specific input data that is specific to the current layer of the neural network, generate statistics based on the received layer-specific input data; and use the generated statistics to assign a relevance score to each of the two or more filters. Each assigned relevance score may indicate the relevance of the corresponding filter to the received layer-specific input data. The computing device may determine an activation status of each of the two or more filters in the current layer based on the identified relevance and apply the received layer-specific input data to the activated filters in the two or more filters to generate an output activation for the current layer of the neural network.

Abstract: In one embodiment, a method of simulating an operation of an artificial neural network on a binary neural network processor includes receiving a binary input vector for a layer including a probabilistic binary weight matrix and performing vector-matrix multiplication of the input vector with the probabilistic binary weight matrix, wherein the multiplication results are modified by simulated binary-neural-processing hardware noise, to generate a binary output vector, where the simulation is performed in the forward pass of a training algorithm for a neural network model for the binary-neural-processing hardware.

Abstract: A computer-implemented method for a machine learning system includes receiving a input image, adding an initial phase to each pixel associated with the input image to create a complex number, sending the complex number to an encoder, wherein the encoder is configured to output a complex-valued latent representation to a decoder, utilizing the decoder, decompose the complex-valued latent representation into a complex-valued output including both a real part and an associated phase, computing a reconstruction error between the input image and the real part of the complex-valued output, wherein the reconstruction error is associated with model parameters associated with the system, and updating and outputting the model parameters associated with the system until a convergence threshold is obtained.

Abstract: A processor-implemented method is presented. The method includes receiving an input sequence comprising a group of channel dynamics observations for a wireless communication channel. Each channel dynamics observation may correspond to a timing of a group of timings. The method also includes determining, via a recurrent neural network (RNN), a residual at each of the group of timings based on the group of channel dynamics observations. The method further includes updating Kalman filter (KF) parameters based on the residual and estimating, via the KF, a channel state based on the updated KF parameters.

Abstract: Certain aspects of the present disclosure provide techniques for object positioning using mixture density networks, comprising: receiving radio frequency (RF) signal data collected in a physical space; generating a feature vector encoding the RF signal data by processing the RF signal data using a first neural network; processing the feature vector using a first mixture model to generate a first encoding tensor indicating a set of moving objects in the physical space, a first location tensor indicating a location of each of the moving objects in the physical space, and a first uncertainty tensor indicating uncertainty of the locations of each of the moving objects in the physical space; and outputting at least one location from the first location tensor.

Abstract: Aspects described herein provide techniques for performing federated learning of a machine learning model, comprising: for each respective client of a plurality of clients and for each training round in a plurality of training rounds: generating a subset of model elements for the respective client based on sampling a gate probability distribution for each model element of a set of model elements for a global machine learning model; transmitting to the respective client: the subset of model elements; and a set of gate probabilities based on the sampling, wherein each gate probability of the set of gate probabilities is associated with one model element of the subset of model elements; receiving from each respective client of the plurality of clients a respective set of model updates; and updating the global machine learning model based on the respective set of model updates from each respective client of the plurality of clients.

Abstract: Certain aspects of the present disclosure provide methods, apparatus, and systems for predicting a location of a device in a spatial environment using a machine learning model. An example method generally includes measuring a plurality of signals received from a network entity at a device. A channel state information (CSI) measurement is generated from the measured plurality of signals. Generally, the CSI measurement includes a multipath component. Positions of one or more anchors in a spatial environment are identified based on a machine learning model trained to identify the positions of the one or more anchors based on the CSI measurement. A location of the device is estimated based on the identified positions of the one or more anchors.

Abstract: Certain aspects of the present disclosure provide techniques for wireless channel modeling. A set of input data is received for data transmitted, from a transmitter, as a signal in a wireless channel. A channel model is generated for the wireless channel using a generative adversarial network (GAN). A set of simulated output data is generated by transforming the first set of input data using the channel model.

Abstract: A method of collaboratively training a neural network model, includes receiving a local update from a subset of the multiple users. The local update is related to one or more subsets of a dataset of the neural network model. A local component of the neural network model identifies a subset of the one or more subsets to which a data point belongs. A global update is computed for the neural network model based on the local updates from the subset of the users. The global updates for each portion of the network are aggregated to train the neural network model.

Abstract: A system and computer-implemented method are provided for enabling control of a physical system based on a state of the physical system which is inferred from sensor data. The system and method may iteratively infer the state by, in an iteration, obtaining an initial inference of the state using a mathematical model representing a prior knowledge-based modelling of the state, and by applying a learned model to the initial inference of the state and the sensor measurement, wherein the learned model has been learned to minimize an error between initial inferences provided by the mathematical model and a ground truth and to provide a correction value as output for correcting the initial inference of the state of the mathematical model. Output data may be provided to an output device to enable control of the physical system based on the inferred state.

Abstract: A method performed by a communication device includes generating an initial channel estimate of a channel for a current time step with a Kalman filter based on a first signal received at the communication device. The method also includes inferring, with a neural network, a residual of the initial channel estimate of the current time step. The method further includes updating the initial channel estimate of the current time step based on the residual.