Abstract: Human mesh model recovery may utilize prior knowledge of the hierarchical structural correlation between different parts of a human body. Such structural correlation may be between a root kinematic chain of the human body and a head or limb kinematic chain of the human body. Shape and/or pose parameters relating to the human mesh model may be determined by first determining the parameters associated with the root kinematic chain and then using those parameters to predict the parameters associated with the head or limb kinematic chain. Such a task can be accomplished using a system comprising one or more processors and one or more storage devices storing instructions that, when executed by the one or more processors, cause the one or more processors to implement one or more neural networks trained to perform functions related to the task.

Abstract: A medical system may utilize a modular and extensible sensing device to derive a two-dimensional (2D) or three-dimensional (3D) human model for a patient in real-time based on images of the patient captured by a sensor such as a digital camera. The 2D or 3D human model may be visually presented on one or more devices of the medical system and used to facilitate a healthcare service provided to the patient. In examples, the 2D or 3D human model may be used to improve the speed, accuracy and consistency of patient positioning for a medical procedure. In examples, the 2D or 3D human model may be used to enable unified analysis of the patient's medical conditions by linking different scan images of the patient through the 2D or 3D human model. In examples, the 2D or 3D human model may be used to facilitate surgical navigation, patient monitoring, process automation, and/or the like.

Abstract: Systems, methods and instrumentalities are described herein for automating a medical environment. The automation may be realized using one or more sensing devices and at least one processing device. The sensing devices may be configured to capture images of the medical environment and provide the images to the processing device. The processing device may determine characteristics of the medical environment based on the images and automate one or more aspects of the operations in the medical environment. These characteristics may include, e.g., people and/or objects present in the images and respective locations of the people and/or objects in the medical environment. The operations that may be automated may include, e.g., maneuvering and/or positioning a medical device based on the location of a patient, determining and/or adjusting the parameters of a medical device, managing a workflow, providing instructions and/or alerts to a patient or a physician, etc.

Abstract: A system for patient positioning is provided. The system may acquire image data relating to a patient holding a posture and a plurality of patient models. Each patient model may represent a reference patient holding a reference posture, and include at least one reference interest point of the referent patient and a reference representation of the reference posture. The system may also identify at least one interest point of the patient from the image data using an interest point detection model. The system may further determine a representation of the posture of the patient based on a comparison between the at least one interest point of the patient and the at least one reference interest point in each of the plurality of patient models.

Abstract: Methods and systems for using a patient representation model including a feature extraction model and a parameter determining model. For example, a computer-implemented method includes receiving, by a first feature extraction model, a depth image; generating, by the first feature extraction model, a first feature vector corresponding to the depth image; determining, by a parameter determining model, a plurality of three-dimensional model parameters based at least in part on the first feature vector; receiving a ground truth; determining a deviation between the ground truth and information associated with the plurality of three-dimensional model parameters; changing, based at least in part on the deviation, one or more parameters of the patient representation model; receiving a first patient image; determining a plurality of three-dimensional patient parameters based at least in part on the first patient image; and providing the plurality of three-dimensional patient parameters as medical guidance.

Abstract: Human mesh model recovery may utilize prior knowledge of the hierarchical structural correlation between different parts of a human body. Such structural correlation may be between a root kinematic chain of the human body and a head or limb kinematic chain of the human body. Shape and/or pose parameters relating to the human mesh model may be determined by first determining the parameters associated with the root kinematic chain and then using those parameters to predict the parameters associated with the head or limb kinematic chain. Such a task can be accomplished using a system comprising one or more processors and one or more storage devices storing instructions that, when executed by the one or more processors, cause the one or more processors to implement one or more neural networks trained to perform functions related to the task.

Abstract: An apparatus is configured to receive input image data corresponding to output image data of a first radiology scanner device, translate the input image data into a format corresponding to output image data of a second radiology scanner device and generate an output image corresponding to the translated input image data on a post processing imaging device associated with the first radiology scanner device. Medical images from a new scanner can be translate to look as if they came from a scanner of another vendor.

Abstract: The present embodiments relate to automatically estimating a three-dimensional pose of an object from an image captured using a camera with a structured light sensor. By way of introduction, the present embodiments described below include apparatuses and methods for training a system for and estimating a pose of an object from a test image. Training and test images are sampled to generate local image patches. Features are extracted from the local image patches to generate feature databased used to estimate nearest neighbor poses for each local image patch. The closest nearest neighbor pose to the test image is selected as the estimated three-dimensional pose.

Abstract: Abnormality detection within a defined area includes obtaining a plurality of images of the defined area from image-capture devices. An extent of deviation of one or more types of products from an inference of each of the plurality of images is determined using a trained neural network. A localized dimensional representation is generated in a portion of an input image associated with a first location of the plurality of locations, based on gradients computed from the determined extent of deviation. The generated localized dimensional representation provides a visual indication of an abnormality located in the first location within the defined area. An action associated with the first location is executed based on the generated dimensional representation for proactive control or prevention of occurrence of undesired event in the defined area.

Abstract: Data samples are transmitted from a central server to at least one local server apparatus. The central server receives a set of predictions from the at least one local server apparatus that are based on the transmitted set of data samples. The central server trains a central model based on the received set of predictions. The central model, or a portion of the central model corresponding to a task of interest, can then be sent to the at least one local server apparatus. Neither local data from local sites nor trained models from the local sites are transmitted to the central server. This ensures protection and security of data at the local sites.

Abstract: Healthcare services can be automated utilizing a system that recognizes at least one characteristic of a patient based on images of the patient acquired by an image capturing device. Relying on information extracted from these images, the system may automate multiple aspects of a medical procedure such as patient identification and verification, positioning, diagnosis and/or treatment planning using artificial intelligence or machine learning techniques. By automating these operations, healthcare services can be provided remotely and/or with minimum physical contact between the patient and a medical professional.

Abstract: Methods and systems for providing guidance for adjusting a target. For example, a computer-implemented method for providing guidance for adjusting a target includes: receiving, by a neural network, a reference image; receiving, by the neural network, the target image, the target image being related to a position of a target; determining a similarity metric based at least in part on information associated with the reference image and information associated with the target image by the neural network; generating a target attention map corresponding to the target image based at least in part on the similarity metric; outputting the target image and the target attention map; and providing a guidance for adjusting the position of the target based at least in part on the target image and the target attention map.

Abstract: Systems, methods, and computer-readable media are described for training a neural network to perform keypoint detection and view-invariant keypoint representation generation. A locally learned database of three-dimensional (3D) keypoint landmarks extracted from a sample set of training depth images can be populated with view-invariant keypoint representations of the keypoint landmarks stored in association with corresponding 3D locations of the keypoint landmarks. The populated 3D keypoint landmark database can be used to find 3D keypoints that match 2D keypoints extracted from a test depth image having an unknown pose. A parameter estimation algorithm can be executed on the 3D locations of the matching keypoint landmarks to determine a pose corresponding to the test depth image.

Abstract: The present disclosure generally provides systems and methods for situation awareness. When executing a set of instructions stored in at least one non-transitory storage medium, at least one processor may be configured to cause the system to perform operations including obtaining, from at least one of one or more sensors, environmental data associated with an environment corresponding to a first time point, generating a first static global representation of an environment corresponding to the first time point based at least in part on the environmental data, generating a first dynamic global representation of the environment corresponding to the first time point based at least in part on the environmental data, and estimating, based on the first static global representation and the first dynamic global representation, a target state of the environment at a target time point using a target estimation model.

Abstract: A method for automated calibration is provided. The method may include obtaining a plurality of interest points based on prior information regarding a device and image data of the device captured by a visual sensor. The method may include identifying at least a portion of the plurality of interest points from the image data of the device. The method may also include determining a transformation relationship between a first coordinate system and a second coordinate system based on information of at least a portion of the identified interest points in the first coordinate system and in the second coordinate system that is applied to the visual sensor or the image data of the device.

Abstract: A patient's healthcare experience may be enhanced utilizing a system that automatically recognizes the patient based on one or more images of the patient and generates personalized medical assistance information for the patient based on electronic medical records stored for the patient. Such electronic medical records may comprise imagery data and/or non-imagery associated with a medical procedure performed or to be performed for the patient. As such, the imagery and/or non-imagery data may be incorporated into the personalized medical assistance information to provide positioning and/or other types of diagnostic or treatment guidance to the patient or a service provider.

Abstract: The pose and shape of a human body may be recovered based on joint location information associated with the human body. The joint location information may be derived based on an image of the human body or from an output of a human motion capture system. The recovery of the pose and shape of the human body may be performed by a computer-implemented artificial neural network (ANN) trained to perform the recovery task using training datasets that include paired joint location information and human model parameters. The training of the ANN may be conducted in accordance with multiple constraints designed to improve the accuracy of the recovery and by artificially manipulating the training data so that the ANN can learn to recover the pose and shape of the human body even with partially observed joint locations.

Abstract: A medical system may utilize a modular and extensible sensing device to derive a two-dimensional (2D) or three-dimensional (3D) human model for a patient in real-time based on images of the patient captured by a sensor such as a digital camera. The 2D or 3D human model may be visually presented on one or more devices of the medical system and used to facilitate a healthcare service provided to the patient. In examples, the 2D or 3D human model may be used to improve the speed, accuracy and consistency of patient positioning for a medical procedure. In examples, the 2D or 3D human model may be used to enable unified analysis of the patient's medical conditions by linking different scan images of the patient through the 2D or 3D human model. In examples, the 2D or 3D human model may be used to facilitate surgical navigation, patient monitoring, process automation, and/or the like.

Abstract: Methods and systems for using a patient representation model including a feature extraction model and a parameter determining model. For example, a computer-implemented method includes receiving, by a first feature extraction model, a depth image; generating, by the first feature extraction model, a first feature vector corresponding to the depth image; determining, by a parameter determining model, a plurality of three-dimensional model parameters based at least in part on the first feature vector; receiving a ground truth; determining a deviation between the ground truth and information associated with the plurality of three-dimensional model parameters; changing, based at least in part on the deviation, one or more parameters of the patient representation model; receiving a first patient image; determining a plurality of three-dimensional patient parameters based at least in part on the first patient image; and providing the plurality of three-dimensional patient parameters as medical guidance.

Abstract: Human mesh model recovery may utilize prior knowledge of the hierarchical structural correlation between different parts of a human body. Such structural correlation may be between a root kinematic chain of the human body and a head or limb kinematic chain of the human body. Shape and/or pose parameters relating to the human mesh model may be determined by first determining the parameters associated with the root kinematic chain and then using those parameters to predict the parameters associated with the head or limb kinematic chain. Such a task can be accomplished using a system comprising one or more processors and one or more storage devices storing instructions that, when executed by the one or more processors, cause the one or more processors to implement one or more neural networks trained to perform functions related to the task.