Abstract: Apparatuses, systems, and techniques are presented to generate images representing realistic motion or activity. In at least one embodiment, one or more neural networks are used to select a first neural network to perform a first task based, at least in part, upon a performance estimated by a second neural network.

Abstract: Methods and systems for image registration using an intelligent artificial agent are disclosed. In an intelligent artificial agent based registration method, a current state observation of an artificial agent is determined based on the medical images to be registered and current transformation parameters. Action-values are calculated for a plurality of actions available to the artificial agent based on the current state observation using a machine learning based model, such as a trained deep neural network (DNN). The actions correspond to predetermined adjustments of the transformation parameters. An action having a highest action-value is selected from the plurality of actions and the transformation parameters are adjusted by the predetermined adjustment corresponding to the selected action. The determining, calculating, and selecting steps are repeated for a plurality of iterations, and the medical images are registered using final transformation parameters resulting from the plurality of iterations.

Abstract: Volumetric quantification can be performed for various parameters of an object represented in volumetric data. Multiple views of the object can be generated, and those views provided to a set of neural networks that can generate inferences in parallel. The inferences from the different networks can be used to generate pseudo-labels for the data, for comparison purposes, which enables a co-training loss to be determined for the unlabeled data. The co-training loss can then be used to update the relevant network parameters for the overall data analysis network. If supervised data is also available then the network parameters can further be updated using the supervised loss.

Abstract: Apparatuses, systems, and techniques to collaboratively train one or more machine learning models. Parameter reviewers may be configured to compare sets of machine learning model parameter information in order to generate one or more machine learning models, such as neural networks.

Abstract: Methods and systems for image registration using an intelligent artificial agent are disclosed. In an intelligent artificial agent based registration method, a current state observation of an artificial agent is determined based on the medical images to be registered and current transformation parameters. Action-values are calculated for a plurality of actions available to the artificial agent based on the current state observation using a machine learning based model, such as a trained deep neural network (DNN). The actions correspond to predetermined adjustments of the transformation parameters. An action having a highest action-value is selected from the plurality of actions and the transformation parameters are adjusted by the predetermined adjustment corresponding to the selected action. The determining, calculating, and selecting steps are repeated for a plurality of iterations, and the medical images are registered using final transformation parameters resulting from the plurality of iterations.

Abstract: Apparatuses, systems, and techniques to train a neural network to infer a condition based on an image. In at least one embodiment, a first portion of a neural network is trained to infer a condition from an image using a first dataset, and a second portion of the neural network is trained using a second dataset.

Abstract: The user is to be informed of the reliability of the machine-learned model based on the current input relative to the training data used to train the model or the model itself. In a medical situation, the data for a current patient is compared to the training data used to train a prediction model and/or to a decision function of the prediction model. The comparison indicates the training content relative to the current patient, so provides a user with information on the reliability of the prediction for the current situation. The indication deals with the variation of the data of the current patient from the training data or relative to the prediction model, allowing the user to see how well trained the predication model is relative to the current patient. This indication is in addition to any global confidence output through application of the prediction model to the data of the current patient.

Abstract: Methods and systems for image registration using an intelligent artificial agent are disclosed. In an intelligent artificial agent based registration method, a current state observation of an artificial agent is determined based on the medical images to be registered and current transformation parameters. Action-values are calculated for a plurality of actions available to the artificial agent based on the current state observation using a machine learning based model, such as a trained deep neural network (DNN). The actions correspond to predetermined adjustments of the transformation parameters. An action having a highest action-value is selected from the plurality of actions and the transformation parameters are adjusted by the predetermined adjustment corresponding to the selected action. The determining, calculating, and selecting steps are repeated for a plurality of iterations, and the medical images are registered using final transformation parameters resulting from the plurality of iterations.

Abstract: Apparatuses, systems, and techniques are presented to detect one or more objects in one or more images. In at least one embodiment, one or more neural networks can be used to detect one or more objects in one or more images based, at least in part, on textual descriptions of the one or more objects.

Abstract: Apparatuses, systems, and techniques are presented to select neural networks. In at least one embodiment, one or more first neural networks can be used to select one or more second neural networks, as may be based at least in part upon an inference to be generated by the one or more second neural networks.

Abstract: Apparatuses, systems, and techniques are presented to classify objects in images. In at least one embodiment, one or more neural networks are used to identify one or more objects in one or more full images based, at least in part, on the one or more neural networks having been trained using the one or more full images and one or more portions of the one or more full images.

Abstract: Apparatuses, systems, and techniques are presented to predict annotations for objects in images. In at least one embodiment, one or more neural networks are used to help generate one or more segmentation boundaries of one or more objects within one or more digital images, wherein the one or more neural networks are to transform one or more representations of one or more portions of the one or more objects into one or more lower-dimensional representations of the one or more portions of the one or more objects.

Abstract: Apparatuses, systems, and techniques are presented to predict annotations for objects in images. In at least one embodiment, boundaries of an object within an image can be identified based, at least in part, on a user-generated outline of only a portion of this object or information about a size of this object provided by a user.

Abstract: Apparatuses, systems, and techniques to generate one or more images of an object. In at least one embodiment, a technique includes training one or more neural networks to generate one or more images of an object from at least a first image of the object and a second lower-resolution image of the object, where the training includes a comparison of the one or more generated images of the object with the second lower-resolution image of the object.

Abstract: Apparatuses, systems, and techniques to indicate an extent, to which text corresponds to one or more images. In at least one embodiment, an extent to which text corresponds to one or more images is indicated using one or more neural networks and used to train the one or more neural networks.

Abstract: Methods and systems for image registration using an intelligent artificial agent are disclosed. In an intelligent artificial agent based registration method, a current state observation of an artificial agent is determined based on the medical images to be registered and current transformation parameters. Action-values are calculated for a plurality of actions available to the artificial agent based on the current state observation using a machine learning based model, such as a trained deep neural network (DNN). The actions correspond to predetermined adjustments of the transformation parameters. An action having a highest action-value is selected from the plurality of actions and the transformation parameters are adjusted by the predetermined adjustment corresponding to the selected action. The determining, calculating, and selecting steps are repeated for a plurality of iterations, and the medical images are registered using final transformation parameters resulting from the plurality of iterations.

Abstract: Apparatuses, systems, and techniques to improve federated learning for neural networks. In at least one embodiment, a federated server dynamically selects neural network weights according to one or more learnable aggregation weights indicating a contribution from each of one or more edge devices or clients during federated training according to various characteristics of each edge device or client model and training data.

Abstract: Apparatuses, systems, and techniques to select a neural network using an amount of memory to be used. In at least one embodiment, a processor includes one or more circuits to cause one or more neural networks to be selected from a plurality of neural networks based, at least in part, on an amount of memory to be used by the one oe more neural networks.

Abstract: Methods and systems for artificial intelligence based medical image segmentation are disclosed. In a method for autonomous artificial intelligence based medical image segmentation, a medical image of a patient is received. A current segmentation context is automatically determined based on the medical image and at least one segmentation algorithm is automatically selected from a plurality of segmentation algorithms based on the current segmentation context. A target anatomical structure is segmented in the medical image using the selected at least one segmentation algorithm.

Abstract: Systems and methods are provided for performing medical imaging analysis. Input medical imaging data is received for performing a particular one of a plurality of medical imaging analyses. An output that provides a result of the particular medical imaging analysis on the input medical imaging data is generated using a neural network trained to perform the plurality of medical imaging analyses. The neural network is trained by learning one or more weights associated with the particular medical imaging analysis using one or more weights associated with a different one of the plurality of medical imaging analyses. The generated output is outputted for performing the particular medical imaging analysis.