Abstract: Described herein are systems, methods and instrumentalities associated with automatic assessment of aneurysms. An automatic aneurysm assessment system or apparatus may be configured to obtain, e.g., using a pre-trained artificial neural network, strain values associated one or more locations of a human heart and one or more cardiac phases of the human heart and derive a representation (e.g., a 2D matrix) of the strain values across time and/or space. The system or apparatus may determine, based on the derived representation of the strain values, respective strain patterns associated with the one or more locations of the human heart and further determine whether the one or more locations are aneurysm locations by comparing the automatically determined strain patterns with predetermined normal strain patterns of the heart and determining the presence or risk of aneurysms based on the comparison.

Abstract: Described herein are systems, methods, and instrumentalities associated with generating multi-contrast MRI images associated with an MRI study. The systems, methods, and instrumentalities utilize an artificial neural network (ANN) trained to jointly determine MRI data sampling patterns for the multiple contrasts based on predetermined quality criteria associated with the MRI study and reconstruct MRI images with the multiple contrasts based on under-sampled MRI data acquired using the sampling patterns. The training of the ANN may be conducted with an objective to improve the quality of the whole MRI study rather than individual contrasts. As such, the ANN may learn to allocate resources among the multiple contrasts in a manner that optimizes the performance of the whole MRI study.

Abstract: A method for automated calibration is provided. The method may include obtaining a plurality of interest points based on prior information regarding a device and image data of the device captured by a visual sensor. The method may include identifying at least a portion of the plurality of interest points from the image data of the device. The method may also include determining a transformation relationship between a first coordinate system and a second coordinate system based on information of at least a portion of the identified interest points in the first coordinate system and in the second coordinate system that is applied to the visual sensor or the image data of the device.

Abstract: Described herein are systems, methods, and instrumentalities associated with segmenting and/or determining the shape of an anatomical structure. An artificial neural network (ANN) is used to perform these tasks based on a statistical shape model of the anatomical structure. The ANN is trained by evaluating and backpropagating multiple losses associated with shape estimation and segmentation mask generation. The model obtained using these techniques may be used for different clinical purposes including, for example, motion estimation and motion tracking.

Abstract: The shape and/or location of an organ may change in accordance with changes in the body shape and/or pose of a patient. Described herein are systems, methods, and instrumentalities for automatically determining, using an artificial neural network (ANN), the shape and/or location of the organ based on human models that reflect the body shape and/or pose the patient. The ANN may be trained to learn the spatial relationship between the organ and the body shape or pose of the patient. Then, at an inference time, the ANN may be used to determine the relationship based on a first patient model and a first representation (e.g., a point cloud) of the organ so that given a second patient model thereafter, the ANN may automatically determine the shape and/or location of the organ corresponding to the body shape or pose of the patient indicated by the second patient model.

Abstract: Described herein are neural network-based systems, methods and instrumentalities associated with cardiac assessment. An apparatus as described herein may obtain electrocardiographic imaging (ECGI) information associated with a human heart and magnetic resonance imaging (MRI) information associated with the human heart, and integrate the ECGI and MRI information using a machine-learned model. Using the integrated ECGI and MRI information, the apparatus may predict target ablation sites, estimate electrophysiology (EP) measurements, and/or simulate the electrical system of the human heart.

Abstract: A method for lung nodule evaluation is provided. The method may include obtaining a target image including at least a portion of a lung of a subject. The method may also include segmenting, from the target image, at least one target region each of which corresponds to a lung nodule of the subject. The method may further include generating an evaluation result with respect to the at least one lung nodule based on the at least one target region.

Abstract: In Multiplex MRI image reconstruction, a hardware processor acquires sub-sampled Multiplex MRI data and reconstructs parametric images from the sub-sampled Multiplex MRI data. A machine learning model or deep learning model uses the subsampled Multiplex MRI data as the input and parametric maps calculated from the fully sampled data, or reconstructed fully sample data, as the ground truth. The model learns to reconstruct the parametric maps directly from the subsampled Multiplex MRI data.

Abstract: A system for Magnetic Resonance Imaging (MRI) is provided. The system may obtain at least one training sample each of which includes full MRI data. The system may also obtain a preliminary subsampling model and a preliminary MRI reconstruction model. The system may further generate a subsampling model corresponding to an MRI reconstruction model by jointly training the preliminary subsampling model and the preliminary MRI reconstruction model using the at least one training sample. The subsampling model may be the trained preliminary subsampling model, and the MRI reconstruction model may be at least a portion of the trained preliminary MRI reconstruction model.

Abstract: Automated patient positioning and modelling includes a hardware processor to obtain image data from an imaging sensor, classify the image data, using a first machine learning model, as a patient pose based on one or more pre-defined protocols for patient positioning, provide a confidence score based on the classification of the image data and if the confidence score is less than a pre-determined value, re-classify the image data using a second machine learning model; or if the confidence score is greater than a pre-determined value, identify the image data as corresponding to a patient pose based on one or more pre-defined protocols for patient positioning during a scan procedure.

Abstract: Automatically generating an explanation for a decision prediction from a machine learning algorithm includes using a first processor of a computing device to run the machine learning algorithm using one or more input data; generating a decision prediction output based on the one or more input data; using a second processor to access the decision prediction output of the first processor; generating additional information that identifies one or more causal relationships between the prediction of the first algorithm and the one or more input data; and providing the additional information as the explanation in a user-understandable format on a display of the computing device.

Abstract: The pose and shape of a human body may be recovered based on joint location information associated with the human body. The joint location information may be derived based on an image of the human body or from an output of a human motion capture system. The recovery of the pose and shape of the human body may be performed by a computer-implemented artificial neural network (ANN) trained to perform the recovery task using training datasets that include paired joint location information and human model parameters. The training of the ANN may be conducted in accordance with multiple constraints designed to improve the accuracy of the recovery and by artificially manipulating the training data so that the ANN can learn to recover the pose and shape of the human body even with partially observed joint locations.

Abstract: Systems, methods, and instrumentalities are described herein for constructing a multi-view patient model (e.g., a 3D human mesh model) based on multiple single-view models of the patient. Each of the single-view models may be generated based on images captured by a sensing device and, dependent on the field of the view of the sensing device, may depict some keypoints of the patient's body with a higher accuracy and other keypoints of the patient's body with a lower accuracy. The multi-view patient model may be constructed using respective portions of the single-view models that correspond to accurately depicted keypoints. This way, a comprehensive and accurate depiction of the patient's body shape and pose may be obtained via the multi-view model even if some keypoints of the patient's body are blocked from a specific sensing device.

Abstract: Disclosed herein are systems, methods, and instrumentalities associated with reconstructing magnetic resonance (MR) images based on multi-slice, under-sampled MRI data (e.g., k-space data). The multi-slice MRI data may be acquired using a simultaneous multi-slice (SMS) technique and MRI information associated with multiple MRI slices may be entangled in the multi-slice MRI data. A neural network may be trained and used to disentangle the MRI information and reconstruct MRI images for the different slices. A data consistency component may be used to estimate k-space data based on estimates made by the neural network, from which respective MRI images associated with multiple MRI slices may be obtained by applying a Fourier transform to the k-space data.

Abstract: A three-dimensional (3D) model of a person may be obtained using a pre-trained neural network based on one or more images of the person. Such a model may be subject to estimation bias and/or other types of defects or errors. Described herein are systems, methods, and instrumentalities for refining the 3D model and/or the neural network used to generate the 3D model. The proposed techniques may extract information such as key body locations and/or a body shape from the images and refine the 3D model and/or the neural network using the extracted information. In examples, the 3D model and/or the neural network may be refined by minimizing a difference between the key body locations and/or body shape extracted from the images and corresponding key body locations and/or body shape determined from the 3D model. The refinement may be performed in an iterative and alternating manner.

Abstract: Systems, methods and instrumentalities are described herein for automating a medical environment. The automation may be realized using one or more sensing devices and at least one processing device. The sensing devices may be configured to capture images of the medical environment and provide the images to the processing device. The processing device may determine characteristics of the medical environment based on the images and automate one or more aspects of the operations in the medical environment. These characteristics may include, e.g., people and/or objects present in the images and respective locations of the people and/or objects in the medical environment. The operations that may be automated may include, e.g., maneuvering and/or positioning a medical device based on the location of a patient, determining and/or adjusting the parameters of a medical device, managing a workflow, providing instructions and/or alerts to a patient or a physician, etc.

Abstract: A neural network system implements a model for generating an output image based on a received input image. The model is learned through a training process during which parameters associated with the model are adjusted so as to maximize a difference between a first image predicted using first parameter values of the model and a second image predicted using second parameter values of the model, and to minimize a difference between the second image and a ground truth image. During a first iteration of the training process the first image is predicted and during a second iteration the second image is predicted. The first parameter values are obtained during the first iteration by minimizing a difference between the first image and the ground truth image, and the second parameter values are obtained during the second iteration by maximizing the difference between the first image and the second image.

Abstract: The present disclosure provides a system for image reconstruction. The system may obtain an initial image of a subject. The initial image may be generated based on scan data of the subject that is collected by an imaging device. The system may also generate a gradient image associated with the initial image. The system may further generate a target image of the subject by applying an image reconstruction model based on the initial image and the gradient image. The target image may have a higher image quality than the initial image.

Abstract: A method for image processing may include: obtaining an original image of a first style, the original image being generated by a first imaging device; obtaining a target transformation model; and generating a transferred image of a second style by transferring the first style of the original image using the target transformation model. The second style may be substantially similar to a target style of one or more other images generated by a second imaging device. The second style may be different from the first style.

Abstract: A method for assessing a condition of an organ or tissue of a target object is provided. The method may include: obtaining a target image of the target object; segmenting a target region from the target image, the target region of the target image corresponding to a sub-region of the organ or tissue; determining a morphological characteristic value of the target region in the target image; obtaining a reference standard associated with a sample organ or tissue of a plurality of sample objects, the sample organ or tissue being of a same type as the organ or tissue of the target object; and assessing the condition of the organ or tissue of the target object by comparing the morphological characteristic value of the target region in the target image with the reference standard.