Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for predicted brain data of a patient. One of the methods includes receiving montage configuration data for a specified montage; receiving raw EEG data captured using the specified montage from a brain of a particular subject; generating, using the montage configuration data and the raw EEG data, EEG connectivity data for the specified montage; using a generative neural network to map the EEG connectivity data to predicted fMRI connectivity data, the generative neural network having been trained using training EEG-fMRI connectivity data pairs, each pair comprising EEG connectivity data of a subject and fMRI connectivity data of the same subject; and taking an action based on the predicted fMRI connectivity data.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for determining anomalous brain data. One of the methods includes obtaining brain data characterizing brain activity of a patient; for each of a plurality of pairs of parcellations comprising a first parcellation and a second parcellation, processing the brain data to generate a correlation between the brain activity of the first and second parcellations; obtaining second connectivity data that characterizes, for each of the plurality of pairs of parcellations, a normal range of correlations between the brain activity of the first and second parcellations; identifying one or more of the plurality of pairs of parcellations for which the correlation between brain activity of the first and second parcellations is outside of the corresponding normal range of correlations; and providing data characterizing the one or more identified pairs of parcellations for display to a user on a graphical interface.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for harmonizing diffusion tensor images. One of the methods includes obtaining a diffusion tensor image; determining a set of RISH features for the diffusion tensor image; processing a model input generated from the set of RISH features using a machine learning model to generate a model output identifying an image transformation from a set of image transformations, wherein each image transformation in the set of image transformations corresponds to a respective different first MRI scanner and represents a transformation that, when applied to first diffusion tensor images captured by the first MRI scanner, harmonizes the first diffusion tensor images with second diffusion tensor images captured by a reference MRI scanner; and processing the diffusion tensor image using the identified image transformation to generate a harmonized diffusion tensor image.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating a mental health prediction for a patient using a centrality ranking of the brain of the patient. One of the methods includes obtaining brain data of a patient, wherein the brain data comprises, for each of a plurality of pairs of parcellations formed from a set of parcellations where each pair comprises a first parcellation and a second parcellation, data characterizing a number of tracts connecting the first parcellation and the second parcellation; determining a network graph from the brain data; generating, for each of a plurality of nodes in the network graph, a measure of centrality of the node; determining a centrality ranking of the plurality of nodes of the network graph according to the respective measures of centrality; generating a mental health prediction for the patient using the determined centrality ranking.

Abstract: A pre-event connectome of a subject brain is accessed, the pre-event connectome defining i) first functional nodes in the subject brain and ii) first edges that represent connections between the first functional nodes before the subject has undergone an event. A post-event connectome of the subject brain is accessed, the post-event connectome defining i) second functional nodes in the subject brain and ii) second edges that represent connections between the second functional nodes after the subject has undergone the event. A connectome-difference map data is generated that records the difference between the pre-event connectome and the post-event connectome. An action is taken based on the connectome-difference map data.

Abstract: Methods, systems, and computer programs encoded on computer storage media, for selecting a model out of a number of models based on subject characteristics. One of the methods includes obtaining present subject connectivity matrix data for a present subject, obtaining present subject data describing the present subject where the present subject data is different from the present subject connectivity matrix data, determining a specific model to apply to the present subject connectivity matrix data based at least in part on the present subject data, determining the specific model using a model trained with fMRI data for brains of a plurality of past subjects and past subject data describing the past subjects, applying the specific model to identify a potential present subject brain condition based at least in part on the present subject connectivity matrix data, and taking an action based on identification of a potential present subject brain condition.

Abstract: Disclosed herein are systems and methods for providing interactive graphical user interfaces (GUIs) for users, such as medical professionals, to glean insight about connectivity data associated with a particular brain. A method can include overlaying nodes representing locations of parcels of a patient's brain on a representation of a brain and displaying the representation of the brain with the overlaid nodes in a GUI. Nodes having connectivity above a first threshold can be represented in a first indicia and nodes having connectivity below a second threshold can be represented in a second indicia. The method can include receiving user input and taking an action based on the user input. The user input can include selecting an area of the representation of the brain for excision. Taking an action based on the input can include calculating an impact of excising the area of the brain on the particular patient.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for performing EEG source localization. One of the methods includes obtaining brain data comprising: EEG data comprising respective channel data corresponding to each of a plurality of electrodes of an EEG sensor, and fMRI data comprising respective voxel data corresponding to each of a plurality of voxels; identifying, in a three-dimensional coordinate system, a respective location for each electrode; generating, using the respective identified locations of each electrode, data representing a location in the three-dimensional coordinate system of each voxel; determining, for each electrode, a region of interest in the three-dimensional coordinate system; and identifying, for each electrode, one or more corresponding parcellations in the brain of the subject, wherein each parcellation that corresponds to an electrode at least partially overlaps with the region of interest of the electrode.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for performing EEG source localization. One of the methods includes obtaining brain data comprising: EEG data comprising respective channel data corresponding to each of a plurality of electrodes of an EEG sensor, and fMRI data comprising respective voxel data corresponding to each of a plurality of voxels; identifying, in a three-dimensional coordinate system, a respective location for each electrode; generating, using the respective identified locations of each electrode, data representing a location in the three-dimensional coordinate system of each voxel; determining, for each electrode, a region of interest in the three-dimensional coordinate system; and identifying, for each electrode, one or more corresponding parcellations in the brain of the subject, wherein each parcellation that corresponds to an electrode at least partially overlaps with the region of interest of the electrode.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for harmonizing diffusion tensor images. One of the methods includes obtaining a diffusion tensor image; determining a set of RISH features for the diffusion tensor image; processing a model input generated from the set of RISH features using a machine learning model to generate a model output identifying an image transformation from a set of image transformations, wherein each image transformation in the set of image transformations corresponds to a respective different first MRI scanner and represents a transformation that, when applied to first diffusion tensor images captured by the first MRI scanner, harmonizes the first diffusion tensor images with second diffusion tensor images captured by a reference MRI scanner; and processing the diffusion tensor image using the identified image transformation to generate a harmonized diffusion tensor image.

Abstract: Disclosed herein are systems and methods for providing interactive graphical user interfaces (GUIs) for users, such as medical professionals, to glean insight about connectivity data associated with a particular brain. A method can include overlaying nodes representing locations of parcels of a patient's brain on a representation of a brain and displaying the representation of the brain with the overlaid nodes in a GUI. Nodes having connectivity above a first threshold can be represented in a first indicia and nodes having connectivity below a second threshold can be represented in a second indicia. The method can include receiving user input and taking an action based on the user input. The user input can include selecting an area of the representation of the brain for excision. Taking an action based on the input can include calculating an impact of excising the area of the brain on the particular patient.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating explainability data that explains a medical condition in a subject. In one aspect, a method comprises: obtaining data identifying a plurality of brain parcels that are predicted to be relevant to the medical condition; receiving fMRI data for a brain of a subject; processing the fMRI data for the brain of the subject to determine a respective activation score for each of the plurality of brain parcels that are predicted to be relevant to the medical condition; determining, for each of the plurality of brain parcels that are predicted to be relevant to the medical condition, a relative activation score for the brain parcel; and taking an action based on the relative activation scores.

Abstract: A pre-event connectome of a subject brain is accessed, the pre-event connectome defining i) first functional nodes in the subject brain and ii) first edges that represent connections between the first functional nodes before the subject has undergone an event. A post-event connectome of the subject brain is accessed, the post-event connectome defining i) second functional nodes in the subject brain and ii) second edges that represent connections between the second functional nodes after the subject has undergone the event. A connectome-difference map data is generated that records the difference between the pre-event connectome and the post-event connectome. An action is taken based on the connectome-difference map data.

Abstract: fMRI data of a subject brain is accessed and may include a plurality of time-sequenced volumetric images of activity in a subject brain. A plurality of emotion vectors are accessed, each emotion vector tagged with a specified emotional state. From the fMRI data and using the emotion vectors, a plurality of fMRI state vectors are determined at various points in time, where each fMRI state vector is a combination of the emotion vectors and represents the state of the subject brain at a particular point in time. Flow data is determined to identify a trajectory, over time, of the subject brain as reflected by the fMRI data, through a state space defined by the emotion vectors, where the flow data is based at least in part on the fMRI vectors at various points in time. From the flow data, data is generated that shows changes, through time, in at least one emotional state of the brain.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing brain data using autoencoder neural networks. One of the methods includes obtaining brain data captured by one or more sensors characterizing brain activity of a patient; processing the brain data to generate modified brain data that characterizes a predicted local effect of a future treatment on the brain of the patient; processing the modified brain data using an autoencoder neural network to generate reconstructed brain data; and determining, using the reconstructed brain data, a predicted global effect of the future treatment on the brain of the patient.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for predicted brain data of a patient. One of the methods includes receiving montage configuration data for a specified montage; receiving raw EEG data captured using the specified montage from a brain of a particular subject; generating, using the montage configuration data and the raw EEG data, EEG connectivity data for the specified montage; using a generative neural network to map the EEG connectivity data to predicted fMRI connectivity data, the generative neural network having been trained using training EEG-fMRI connectivity data pairs, each pair comprising EEG connectivity data of a subject and fMRI connectivity data of the same subject; and taking an action based on the predicted fMRI connectivity data.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating explainability data that explains a medical condition in a subject. In one aspect, a method comprises: obtaining data identifying a plurality of brain parcels that are predicted to be relevant to the medical condition; receiving fMRI data for a brain of a subject; processing the fMRI data for the brain of the subject to determine a respective activation score for each of the plurality of brain parcels that are predicted to be relevant to the medical condition; determining, for each of the plurality of brain parcels that are predicted to be relevant to the medical condition, a relative activation score for the brain parcel; and taking an action based on the relative activation scores.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for harmonizing diffusion tensor images. One of the methods includes obtaining a diffusion tensor image; determining a set of RISH features for the diffusion tensor image; processing a model input generated from the set of RISH features using a machine learning model to generate a model output identifying an image transformation from a set of image transformations, wherein each image transformation in the set of image transformations corresponds to a respective different first MRI scanner and represents a transformation that, when applied to first diffusion tensor images captured by the first MRI scanner, harmonizes the first diffusion tensor images with second diffusion tensor images captured by a reference MRI scanner; and processing the diffusion tensor image using the identified image transformation to generate a harmonized diffusion tensor image.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating a mental health prediction for a patient using a centrality ranking of the brain of the patient. One of the methods includes obtaining brain data of a patient, wherein the brain data comprises, for each of a plurality of pairs of parcellations formed from a set of parcellations where each pair comprises a first parcellation and a second parcellation, data characterizing a number of tracts connecting the first parcellation and the second parcellation; determining a network graph from the brain data; generating, for each of a plurality of nodes in the network graph, a measure of centrality of the node; determining a centrality ranking of the plurality of nodes of the network graph according to the respective measures of centrality; generating a mental health prediction for the patient using the determined centrality ranking.

Abstract: Accessed from memory are i) a first brain image, ii) a second brain image, iii) a difference map, and iv) a connectivity element. A GUI may include: concurrently displaying each of these elements. User input to the GUI is received. A location of the user input is determined. The operations also include responsive to determining that the location of the user input is within the display of the first brain image, modifications are made to the display of the i) second brain image, ii) the difference map, and iii) the connectivity element to highlight elements of the display that correspond to an element of the first brain image that corresponds to the location of the user input.