Abstract: A method for automated calibration is provided. The method may include obtaining a plurality of interest points based on prior information regarding a device and image data of the device captured by a visual sensor. The method may include identifying at least a portion of the plurality of interest points from the image data of the device. The method may also include determining a transformation relationship between a first coordinate system and a second coordinate system based on information of at least a portion of the identified interest points in the first coordinate system and in the second coordinate system that is applied to the visual sensor or the image data of the device.

Abstract: A medical system may utilize a modular and extensible sensing device to derive a two-dimensional (2D) or three-dimensional (3D) human model for a patient in real-time based on images of the patient captured by a sensor such as a digital camera. The 2D or 3D human model may be visually presented on one or more devices of the medical system and used to facilitate a healthcare service provided to the patient. In examples, the 2D or 3D human model may be used to improve the speed, accuracy and consistency of patient positioning for a medical procedure. In examples, the 2D or 3D human model may be used to enable unified analysis of the patient's medical conditions by linking different scan images of the patient through the 2D or 3D human model. In examples, the 2D or 3D human model may be used to facilitate surgical navigation, patient monitoring, process automation, and/or the like.

Abstract: Human mesh model recovery may utilize prior knowledge of the hierarchical structural correlation between different parts of a human body. Such structural correlation may be between a root kinematic chain of the human body and a head or limb kinematic chain of the human body. Shape and/or pose parameters relating to the human mesh model may be determined by first determining the parameters associated with the root kinematic chain and then using those parameters to predict the parameters associated with the head or limb kinematic chain. Such a task can be accomplished using a system comprising one or more processors and one or more storage devices storing instructions that, when executed by the one or more processors, cause the one or more processors to implement one or more neural networks trained to perform functions related to the task.

Abstract: A patient's healthcare experience may be enhanced utilizing a system that automatically recognizes the patient based on one or more images of the patient and generates personalized medical assistance information for the patient based on electronic medical records stored for the patient. Such electronic medical records may comprise imagery data and/or non-imagery associated with a medical procedure performed or to be performed for the patient. As such, the imagery and/or non-imagery data may be incorporated into the personalized medical assistance information to provide positioning and/or other types of diagnostic or treatment guidance to the patient or a service provider.

Abstract: The pose and shape of a human body may be recovered based on joint location information associated with the human body. The joint location information may be derived based on an image of the human body or from an output of a human motion capture system. The recovery of the pose and shape of the human body may be performed by a computer-implemented artificial neural network (ANN) trained to perform the recovery task using training datasets that include paired joint location information and human model parameters. The training of the ANN may be conducted in accordance with multiple constraints designed to improve the accuracy of the recovery and by artificially manipulating the training data so that the ANN can learn to recover the pose and shape of the human body even with partially observed joint locations.

Abstract: Methods and systems for using a patient representation model including a feature extraction model and a parameter determining model. For example, a computer-implemented method includes receiving, by a first feature extraction model, a depth image; generating, by the first feature extraction model, a first feature vector corresponding to the depth image; determining, by a parameter determining model, a plurality of three-dimensional model parameters based at least in part on the first feature vector; receiving a ground truth; determining a deviation between the ground truth and information associated with the plurality of three-dimensional model parameters; changing, based at least in part on the deviation, one or more parameters of the patient representation model; receiving a first patient image; determining a plurality of three-dimensional patient parameters based at least in part on the first patient image; and providing the plurality of three-dimensional patient parameters as medical guidance.

Abstract: Methods and systems for enhancing a distributed medical network. For example, a computer-implemented method includes inputting training data corresponding to each local computer into their corresponding machine learning model; generating a plurality of local losses including generating a local loss for each machine learning model based at least in part on the corresponding training data; generating a plurality of local parameter gradients including generating a local parameter gradient for each machine learning model based at least in part on the corresponding local loss; generating a global parameter update based at least in part on the plurality of local parameter gradients; and updating each machine learning model hosted at each local computer of the plurality of local computers by at least updating their corresponding active parameter set based at least in part on the global parameter update.

Abstract: A system and method for semi-supervised learning of visual recognition networks includes generating an initial set of feature representation training data based on simulated 2D test images of various viewpoints with respect to a target 3D rendering. A feature representation network generates feature representation vectors based on processing of the initial feature representation training data. Keypoint patches are labeled according to a score value based on a series of reference patches of unique viewpoint poses and a test keypoint patch processed through the trained feature representation network. A keypoint detector network learns keypoint detection based on processing of the keypoint detector training data.

Abstract: A method for image processing is provided. The method may include: obtaining an original image of a first style, the original image being generated by a first imaging device; obtaining a target transformation model; and generating a transferred image of a second style by transferring the first style of the original image using the target transformation model. The second style may be substantially similar to a target style of one or more other images generated by a second imaging device. The second style may be different from the first style.

Abstract: A system comprising a first computing apparatus in communication with multiple second computing apparatuses. The first computing apparatus may obtain a plurality of first trained machine learning models for a task from the multiple second computing apparatuses. At least a portion of parameter values of the plurality of first trained machine learning models may be different from each other. The first computing apparatus may also obtain a plurality of training samples. The first computing apparatus may further determine, based on the plurality of training samples, a second trained machine learning model by learning from the plurality of first trained machine learning models.

Abstract: The disclosure relates to a method how to recover an object from a cluttered image. The disclosure also relates to a computer program product and a computer-readable storage medium including instructions which, when the program is executed by a computer, cause the computer to carry out the acts of the mentioned method. Further, the disclosure relates to methods how to train components of a recognition system for recovering an object from such a cluttered image. In addition, the disclosure relates to such a recognition system.

Abstract: A system for physiological motion measurement is provided. The system may acquire a reference image corresponding to a reference motion phase of an ROI and a target image of the ROI corresponding to a target motion phase, wherein the reference motion phase may be different from the target motion phase. The system may identify one or more feature points relating to the ROI from the reference image, and determine a motion field of the feature points from the reference motion phase to the target motion phase using a motion prediction model. An input of the motion prediction model may include at least the reference image and the target image. The system may further determine a physiological condition of the ROI based on the motion field.

Abstract: The present disclosure relates to systems and methods for imaging. The method may include obtaining a real-time representation of a subject. The method may also include determining at least one scanning parameter associated with the subject by automatically processing the representation according to a parameter obtaining model. The method may further include performing a scan on the subject based at least in part on the at least one scanning parameter.

Abstract: Methods and systems for locating one or more target features of a patient. For example, a computer-implemented method includes receiving a first input image; receiving a second input image; generating a first patient representation corresponding to the first input image; generating a second patient representation corresponding to the second input image; determining one or more first features corresponding to the first patient representation in a feature space; determining one or more second features corresponding to the second patient representation in the feature space; joining the one or more first features and the one or more second features into one or more joined features; determining one or more landmarks based at least in part on the one or more joined features; and providing a visual guidance for a medical procedure based at least in part on the information associated with the one or more landmarks.

Abstract: Methods and systems for guiding a patient for a medical examination using a medical apparatus. For example, a computer-implemented method for guiding a patient for a medical examination using a medical apparatus includes: receiving an examination protocol for the medical apparatus; determining a reference position based at least in part on the examination protocol; acquiring a patient position; determining a deviation metric based at least in part on comparing the patient position and the reference position; determining whether the deviation metric is greater than a pre-determined deviation threshold; and if the deviation metric is greater than a pre-determined deviation threshold: generating a positioning guidance based at least in part on the determined deviation metric, the positioning guidance including guidance for positioning the patient relative to the medical apparatus.

Abstract: A system for patient positioning is provided. The system may acquire image data relating to a patient holding a posture and a plurality of patient models. Each patient model may represent a reference patient holding a reference posture, and include at least one reference interest point of the referent patient and a reference representation of the reference posture. The system may also identify at least one interest point of the patient from the image data using an interest point detection model. The system may further determine a representation of the posture of the patient based on a comparison between the at least one interest point of the patient and the at least one reference interest point in each of the plurality of patient models.

Abstract: Methods and systems for using a medical imaging apparatus for acquiring a medical image. For example, a computer-implemented method for using a medical imaging apparatus for acquiring a medical image of a patient includes: determining a first positioning instruction by a first neural network, acquiring a first image based on the first positioning instruction; receiving the first image; identifying one or more first features associated with the acquired first image; determining a first quality assessment based on the identified one or more first features; generating a first feedback based on the first quality assessment; receiving the first feedback by the first neural network; and changing one or more first parameters of the first neural network based on the first feedback.

Abstract: Methods and systems for providing guidance for adjusting a target. For example, a computer-implemented method for providing guidance for adjusting a target includes: receiving, by a neural network, a reference image; receiving, by the neural network, the target image, the target image being related to a position of a target; determining a similarity metric based at least in part on information associated with the reference image and information associated with the target image by the neural network; generating a target attention map corresponding to the target image based at least in part on the similarity metric; outputting the target image and the target attention map; and providing a guidance for adjusting the position of the target based at least in part on the target image and the target attention map.

Abstract: The present disclosure relates to systems and methods for anomaly detection for a medical procedure. The method may include obtaining image data collected by one or more visual sensors via monitoring a medical procedure and a trained machine learning model for anomaly detection. The method may include determining a detection result for the medical procedure based on the image data using the trained machine learning model. The detection result may include whether an anomaly regarding the medical procedure exists. In response to the detection result that the anomaly exists, the method may further include providing feedback relating to the anomaly.

Abstract: A system and method for generating realistic depth images by enhancing simulated images rendered from a 3D model, include a rendering engine configured to render noiseless 2.5D images by rendering various poses with respect to a target 3D CAD model, a noise transfer engine configured to apply realistic noise to the noiseless 2.5D images, and a background transfer engine configured to add pseudo-realistic scenedependent backgrounds to the noiseless 2.5D images. The noise transfer engine is configured to learn noise transfer based on a mapping, by a first generative adversarial network (GAN), of the noiseless 2.5D images to real 2.5D scans generated by a targeted sensor. The background transfer engine is configured to learn background generation based on a processing, by a second GAN, of output data of the first GAN as input data and corresponding real 2.5D scans as target data.