Abstract: Described herein are neural network-based systems, methods and instrumentalities associated with imagery data processing. The neural networks may be pre-trained to learn parameters or models for processing the imagery data and upon deployment the neural networks may automatically perform further optimization of the learned parameters or models based on a small set of online data samples. The online optimization may be facilitated via offline meta-learning so that the optimization may be accomplished quickly in a few optimization steps.

Abstract: Abnormality detection within a defined area includes obtaining a plurality of images of the defined area from image-capture devices. An extent of deviation of one or more types of products from an inference of each of the plurality of images is determined using a trained neural network. A localized dimensional representation is generated in a portion of an input image associated with a first location of the plurality of locations, based on gradients computed from the determined extent of deviation. The generated localized dimensional representation provides a visual indication of an abnormality located in the first location within the defined area. An action associated with the first location is executed based on the generated dimensional representation for proactive control or prevention of occurrence of undesired event in the defined area.

Abstract: Methods and systems for enhancing a distributed medical network. For example, a computer-implemented method includes inputting training data corresponding to each local computer into their corresponding machine learning model; generating a plurality of local losses including generating a local loss for each machine learning model based at least in part on the corresponding training data; generating a plurality of local parameter gradients including generating a local parameter gradient for each machine learning model based at least in part on the corresponding local loss; generating a global parameter update based at least in part on the plurality of local parameter gradients; and updating each machine learning model hosted at each local computer of the plurality of local computers by at least updating their corresponding active parameter set based at least in part on the global parameter update.

Abstract: Systems and methods for ossification center detection (OCD) and bone age assessment (BAA) may be provided. The method may include obtaining a bone age image of a subject. The method may include generating a normalized bone age image by preprocessing the bone age image. The method may include determining, based on the normalized bone age image, positions of a plurality of ossification centers using an ossification center localization (OCL) model. The method may include estimating, based on the normalized bone age image and information related to the positions of the plurality of ossification centers, a bone age of the subject using a bone age assessment (BAA) model.

Abstract: The present disclosure is related to systems and methods for image processing. The method includes obtaining a first image of a first modality. The method includes generating a second image of a second modality by processing, based on a trained machine learning model, the first image. The second modality may be different from the first modality.

Abstract: A system for patient positioning is provided. The system may acquire image data relating to a patient holding a posture and a plurality of patient models. Each patient model may represent a reference patient holding a reference posture, and include at least one reference interest point of the referent patient and a reference representation of the reference posture. The system may also identify at least one interest point of the patient from the image data using an interest point detection model. The system may further determine a representation of the posture of the patient based on a comparison between the at least one interest point of the patient and the at least one reference interest point in each of the plurality of patient models.

Abstract: Systems and methods for generating and tracking shapes of a target may be provided. The method may include obtaining at least one first resolution image corresponding to at least one of a sequence of time frames of a medical scan. The method may include determining, according to a predictive model, one or more shape parameters regarding a shape of a target from the at least one first resolution image. The method may include determining, based on the one or more shape parameters and a shape model, at least one shape of the target from the at least one first resolution image. The method may further include generating a second resolution visual representation of the target by rendering the determined shape of the target.

Abstract: The present disclosure provides systems and methods for image processing. The method may include obtaining an initial image; obtaining an intermediate image corresponding to the initial image, the intermediate image including pixels or voxels associated with at least a portion of a target object in the initial image; obtaining a trained processing model; and generating, based on the initial image and the intermediate image, a target image associated with the target object using the trained processing model.

Abstract: A system for reconstructing magnetic resonance images includes a processor that is configured to obtain, from a magnetic resonance scanner, sub-sampled k-space data; apply an inverse fast fourier transform to the sub-sampled k-space data to generate a preliminary image; and process the preliminary image via a trained cascaded recurrent neural network to reconstruct a magnetic resonance image.

Abstract: Human mesh model recovery may utilize prior knowledge of the hierarchical structural correlation between different parts of a human body. Such structural correlation may be between a root kinematic chain of the human body and a head or limb kinematic chain of the human body. Shape and/or pose parameters relating to the human mesh model may be determined by first determining the parameters associated with the root kinematic chain and then using those parameters to predict the parameters associated with the head or limb kinematic chain. Such a task can be accomplished using a system comprising one or more processors and one or more storage devices storing instructions that, when executed by the one or more processors, cause the one or more processors to implement one or more neural networks trained to perform functions related to the task.

Abstract: A system for image segmentation is provided. The system may obtain a target image including an ROI, and segment a preliminary region representative of the ROI from the target image using a first ROI segmentation model corresponding to a first image resolution. The system may segment a target region representative of the ROI from the preliminary region using a second ROI segmentation model corresponding to a second image resolution. At least one model of the first and second ROI segmentation models may at least include a first convolutional layer and a second convolutional layer downstream to the first convolutional layer. A count of input channels of the first convolutional layer may be greater than a count of output channels of the first convolutional layer, and a count of input channels of the second convolutional layer may be smaller than a count of output channels of the second convolutional layer.

Abstract: Described herein are systems, methods and instrumentalities associated with image segmentation. The systems, methods and instrumentalities have a hierarchical structure for producing a coarse segmentation of an anatomical structure and then refining the coarse segmentation based on a shape prior of the anatomical structure. The coarse segmentation may be generated using a multi-task neural network and based on both a segmentation loss and a regression loss. The refined segmentation may be obtained by deforming the shape prior using one or more of a shape-based model or a learning-based model.

Abstract: A medical system may utilize a modular and extensible sensing device to derive a two-dimensional (2D) or three-dimensional (3D) human model for a patient in real-time based on images of the patient captured by a sensor such as a digital camera. The 2D or 3D human model may be visually presented on one or more devices of the medical system and used to facilitate a healthcare service provided to the patient. In examples, the 2D or 3D human model may be used to improve the speed, accuracy and consistency of patient positioning for a medical procedure. In examples, the 2D or 3D human model may be used to enable unified analysis of the patient's medical conditions by linking different scan images of the patient through the 2D or 3D human model. In examples, the 2D or 3D human model may be used to facilitate surgical navigation, patient monitoring, process automation, and/or the like.

Abstract: Systems, methods and instrumentalities are described herein for automating a medical environment. The automation may be realized using one or more sensing devices and at least one processing device. The sensing devices may be configured to capture images of the medical environment and provide the images to the processing device. The processing device may determine characteristics of the medical environment based on the images and automate one or more aspects of the operations in the medical environment. These characteristics may include, e.g., people and/or objects present in the images and respective locations of the people and/or objects in the medical environment. The operations that may be automated may include, e.g., maneuvering and/or positioning a medical device based on the location of a patient, determining and/or adjusting the parameters of a medical device, managing a workflow, providing instructions and/or alerts to a patient or a physician, etc.

Abstract: Cardiac features captured via an MRI scan may be tracked and analyzed using a system described herein. The system may receive a plurality of MR slices derived via the MRI scan and present the MR slices in a manner that allows a user to navigate through the MR slices. Responsive to the user selecting one of the MR slices, contextual and global cardiac information associated with the selected slice may be determined and displayed. The contextual information may correspond to the selected slice and the global information may encompass information gathered across the plurality of MR slices. A user may have the ability to navigate between the different display areas and evaluate the health of the heart with both local and global perspectives.

Abstract: A bullseyes plot may be generated based on cardiac magnetic resonance imaging (CMRI) to facilitate the diagnosis and treatment of heart diseases. Described herein are systems, methods, and instrumentalities associated with bullseyes plot generation. A plurality of myocardial segments may be obtained for constructing the bullseye plot based on landmark points detected in short-axis and long-axis magnetic resonance (MR) slices of the heart and by arranging the short-axis MR slices sequentially in accordance with the order in which the slices are generated during the CMRI. The sequential order of the short-axis MR slices may be determined utilizing projected locations of the short-axis MR slices on a long-axis MR slice and respective distances of the projected locations to a landmark point of the long-axis MR slice. The myocardium and/or landmark points may be identified in the short-axis and/or long-axis MR slices using artificial neural networks.

Abstract: A system for generating a bullseye plot of a heart of a subject is provided. The system may obtain multiple slice images in a plurality of groups, wherein each group corresponds to one of a plurality of sections of the heart and includes at least one slice image of the corresponding section, and each slice image includes part of the right ventricle, part of the left ventricle, and part of the myocardium. The system may also identify at least one landmark associated with the left ventricle by applying a landmark detection network in each of the slice images. The system may further generate the bullseye plot of the heart based on the at least one landmark identified in each of the multiple slice images, wherein the bullseye plot includes a plurality of sectors, each of which represents an anatomical region of the myocardium in one of the plurality of sections.

Abstract: Described herein are neural network-based systems, methods and instrumentalities associated with estimating the motion of an anatomical structure. The motion estimation may be performed using a feature pyramid and/or a motion pyramid that correspond to multiple image scales. The motion estimation may be performed using neural networks and parameters that are learned via a training process involving a student network and a teacher network pre-pretrained with abilities to apply progressive motion compensation.

Abstract: A system for patient positioning is provided. The system may acquire image data relating to a patient holding a posture and a plurality of patient models. Each patient model may represent a reference patient holding a reference posture, and include at least one reference interest point of the referent patient and a reference representation of the reference posture. The system may also identify at least one interest point of the patient from the image data using an interest point detection model. The system may further determine a representation of the posture of the patient based on a comparison between the at least one interest point of the patient and the at least one reference interest point in each of the plurality of patient models.

Abstract: A method for assessing a condition of an organ or tissue of a target object is provided. The method may include: obtaining a target image of the target object; segmenting a target region from the target image, the target region of the target image corresponding to a sub-region of the organ or tissue; determining a morphological characteristic value of the target region in the target image; obtaining a reference standard associated with a sample organ or tissue of a plurality of sample objects, the sample organ or tissue being of a same type as the organ or tissue of the target object; and assessing the condition of the organ or tissue of the target object by comparing the morphological characteristic value of the target region in the target image with the reference standard.