Abstract: The present disclosure provides a computer-implemented method, a device, and a storage medium. The method includes inputting an image into an attention-enhanced high-resolution network (AHRNet) to extract feature maps for generating a first feature map; generating a first probability map which is concatenated with the first feature map to form a concatenated first feature map, and updating the AHRNet using the first segmentation loss; generating a second feature map, and scaling the second feature map to form a third feature map; generating a second probability map which is concatenated with the third feature map to form a concatenated third feature map, and updating the AHRNet using the second segmentation loss; generating a fourth feature map, and scaling the fourth feature map to form a fifth feature map; updating the AHRNet using the third segmentation loss and the regional level set loss; and outputting the third probability map.

Abstract: A method for performing a computer-aided diagnosis (CAD) includes: acquiring a medical image set; generating a three-dimensional (3D) tumor distance map corresponding to the medical image set, each voxel of the tumor distance map representing a distance from the voxel to a nearest boundary of a primary tumor present in the medical image set; and performing neural-network processing of the medical image set to generate a predicted probability map to predict presence and locations of oncology significant lymph nodes (OSLNs) in the medical image set, wherein voxels in the medical image set are stratified and processed according to the tumor distance map.

Abstract: The present disclosure provides a method, a device, and a computer program product using a self-supervised anatomical embedding (SAM) method.

Abstract: A method of harvesting lesion annotations includes conditioning a lesion proposal generator (LPG) based on a first two-dimensional (2D) image set to obtain a conditioned LPG, including adding lesion annotations to the first 2D image set to obtain a revised first 2D image set, forming a three-dimensional (3D) composite image according to the revised first 2D image set, reducing false-positive lesion annotations from the revised first 2D image set according to the 3D composite image to obtain a second-revised first 2D image set, and feeding the second-revised first 2D image set to the LPG to obtain the conditioned LPG, and applying the conditioned LPG to a second 2D image set different than the first 2D image set to harvest lesion annotations.

Abstract: The present disclosure describes a computer-implemented method for processing clinical three-dimensional image. The method includes training a fully supervised segmentation model using a labelled image dataset containing images for a disease at a predefined set of contrast phases or modalities, allow the segmentation model to segment images at the predefined set of contrast phases or modalities; finetuning the fully supervised segmentation model through co-heterogenous training and adversarial domain adaptation (ADA) using an unlabelled image dataset containing clinical multi-phase or multi-modality image data, to allow the segmentation model to segment images at contrast phases or modalities other than the predefined set of contrast phases or modalities; and further finetuning the fully supervised segmentation model using domain-specific pseudo labelling to identify pathological regions missed by the segmentation model.

Abstract: The present disclosure provides a computer-implemented method, a device, and a storage medium. The method includes inputting an image into an attention-enhanced high-resolution network (AHRNet) to extract feature maps for generating a first feature map; generating a first probability map which is concatenated with the first feature map to form a concatenated first feature map, and updating the AHRNet using the first segmentation loss; generating a second feature map, and scaling the second feature map to form a third feature map; generating a second probability map which is concatenated with the third feature map to form a concatenated third feature map, and updating the AHRNet using the second segmentation loss; generating a fourth feature map, and scaling the fourth feature map to form a fifth feature map; updating the AHRNet using the third segmentation loss and the regional level set loss; and outputting the third probability map.

Abstract: The present disclosure provides a method, a device, and a storage medium for prior-guided dual-path network (PDNet). The method includes inputting an image into a split-attention network to extract a feature map at each scale and compressing the feature map to form a compressed feature map of each scale, by an image encoder, inputting the compressed feature map and a three-channel image into a prior encoder to generate an attention enhanced feature map of each scale, and outputting the attention enhanced feature map to a decoder; concatenating, by the decoder, an attention enhanced feature map at a current scale, in combination with up-sampled feature maps and/or down-sampled feature maps from other scales, to form a concatenated feature map of the current scale; and attaching a deconvolutional layer to a highest-level scale SA to segment a lesion and predict a RECIST diameter based on concatenated feature maps.

Abstract: The present disclosure provides a computer-implemented method, a device, and a computer program product for deep lesion tracker. The method includes inputting a search image into a first three-dimensional DenseFPN (feature pyramid network) of an image encoder and inputting a template image into a second three-dimensional DenseFPN of the image encoder to extract image features; encoding anatomy signals of the search image and the template image as Gaussian heatmaps, and inputting the Gaussian heatmap of the template image into a first anatomy signal encoders (ASE) and inputting the Gaussian heatmap of the search image into a second ASE to extract anatomy features; inputting the image features and the anatomy features into a fast cross-correlation layer to generate correspondence maps, and computing a probability map according to the correspondence maps; and performing supervised learning or self-supervised learning to predict a lesion center in the search image.

Abstract: A method for performing a computer-aided diagnosis (CAD) for universal lesion detection includes: receiving a medical image; processing the medical image to predict lesion proposals and generating cropped feature maps corresponding to the lesion proposals; for each lesion proposal, applying a plurality of lesion detection classifiers to generate a plurality of lesion detection scores, the plurality of lesion detection classifiers including a whole-body classifier and one or more organ-specific classifiers; for each lesion proposal, applying an organ-gating classifier to generate a plurality of weighting coefficients corresponding to the plurality of lesion detection classifiers; and for each lesion proposal, performing weight gating on the plurality of lesion detection scores with the plurality of weighting coefficients to generate a comprehensive lesion detection score.

Abstract: The present disclosure provides a computer-implemented method, a device, and a computer program product for deep lesion tracker. The method includes inputting a search image into a first three-dimensional DenseFPN (feature pyramid network) of an image encoder and inputting a template image into a second three-dimensional DenseFPN of the image encoder to extract image features; encoding anatomy signals of the search image and the template image as Gaussian heatmaps, and inputting the Gaussian heatmap of the template image into a first anatomy signal encoders (ASE) and inputting the Gaussian heatmap of the search image into a second ASE to extract anatomy features; inputting the image features and the anatomy features into a fast cross-correlation layer to generate correspondence maps, and computing a probability map according to the correspondence maps; and performing supervised learning or self-supervised learning to predict a lesion center in the search image.

Abstract: The present disclosure provides a method, a device, and a computer program product using a self-supervised anatomical embedding (SAM) method.

Abstract: An image processing method for performing image alignment includes: acquiring a moving image generated by a first imaging modality; acquiring a fixed image generated by a second imaging modality; jointly optimizing a generator model, a register model, and a segmentor model applied to the moving image and the fixed image according to a plurality of cost functions; and applying a spatial transformation corresponding to the optimized register model to the moving image to align the moving image to the fixed image; wherein: the generator model generates a synthesized image from the moving image conditioned on the fixed image; the register model estimates the spatial transformation to align the synthesized image to the fixed image; and the segmentor model estimates segmentation maps of the moving image, the fixed image, and the synthesized image.

Abstract: Systems and methods for characterizing a region of interest (ROI) in a medical image are provided. An exemplary system may include a memory storing instructions and at least one processor communicatively coupled to the memory to execute the instructions which, when executed by the processor, may cause the processor to perform operations. The operations may include detecting one or more candidate ROIs from the medical image using a three-dimensional (3D) machine learning network. The operations may also include determining a key slice for each candidate ROI. The operations may further include selecting a primary ROI from the one or more candidate ROIs based on the respective key slices. In addition, the operations may include classifying the primary ROI into one of a plurality of categories using a texture-based classifier based on the key slice corresponding to the primary ROI.

Abstract: An image processing method for performing image alignment includes: acquiring a moving image generated by a first imaging modality; acquiring a fixed image generated by a second imaging modality; jointly optimizing a generator model, a register model, and a segmentor model applied to the moving image and the fixed image according to a plurality of cost functions; and applying a spatial transformation corresponding to the optimized register model to the moving image to align the moving image to the fixed image; wherein: the generator model generates a synthesized image from the moving image conditioned on the fixed image; the register model estimates the spatial transformation to align the synthesized image to the fixed image; and the segmentor model estimates segmentation maps of the moving image, the fixed image, and the synthesized image.

Abstract: Systems and methods for characterizing a region of interest (ROI) in a medical image are provided. An exemplary system may include a memory storing instructions and at least one processor communicatively coupled to the memory to execute the instructions which, when executed by the processor, may cause the processor to perform operations. The operations may include detecting one or more candidate ROIs from the medical image using a three-dimensional (3D) machine learning network. The operations may also include determining a key slice for each candidate ROI. The operations may further include selecting a primary ROI from the one or more candidate ROIs based on the respective key slices. In addition, the operations may include classifying the primary ROI into one of a plurality of categories using a texture-based classifier based on the key slice corresponding to the primary ROI.

Abstract: The present disclosure describes a computer-implemented method for processing clinical three-dimensional image. The method includes training a fully supervised segmentation model using a labelled image dataset containing images for a disease at a predefined set of contrast phases or modalities, allow the segmentation model to segment images at the predefined set of contrast phases or modalities; finetuning the fully supervised segmentation model through co-heterogenous training and adversarial domain adaptation (ADA) using an unlabelled image dataset containing clinical multi-phase or multi-modality image data, to allow the segmentation model to segment images at contrast phases or modalities other than the predefined set of contrast phases or modalities; and further finetuning the fully supervised segmentation model using domain-specific pseudo labelling to identify pathological regions missed by the segmentation model.

Abstract: A method for performing a computer-aided diagnosis (CAD) includes: acquiring a medical image set; generating a three-dimensional (3D) tumor distance map corresponding to the medical image set, each voxel of the tumor distance map representing a distance from the voxel to a nearest boundary of a primary tumor present in the medical image set; and performing neural-network processing of the medical image set to generate a predicted probability map to predict presence and locations of oncology significant lymph nodes (OSLNs) in the medical image set, wherein voxels in the medical image set are stratified and processed according to the tumor distance map.

Abstract: A method for performing a computer-aided diagnosis (CAD) for universal lesion detection includes: receiving a medical image; processing the medical image to predict lesion proposals and generating cropped feature maps corresponding to the lesion proposals; for each lesion proposal, applying a plurality of lesion detection classifiers to generate a plurality of lesion detection scores, the plurality of lesion detection classifiers including a whole-body classifier and one or more organ-specific classifiers; for each lesion proposal, applying an organ-gating classifier to generate a plurality of weighting coefficients corresponding to the plurality of lesion detection classifiers; and for each lesion proposal, performing weight gating on the plurality of lesion detection scores with the plurality of weighting coefficients to generate a comprehensive lesion detection score.

Abstract: A method of harvesting lesion annotations includes conditioning a lesion proposal generator (LPG) based on a first two-dimensional (2D) image set to obtain a conditioned LPG, including adding lesion annotations to the first 2D image set to obtain a revised first 2D image set, forming a three-dimensional (3D) composite image according to the revised first 2D image set, reducing false-positive lesion annotations from the revised first 2D image set according to the 3D composite image to obtain a second-revised first 2D image set, and feeding the second-revised first 2D image set to the LPG to obtain the conditioned LPG, and applying the conditioned LPG to a second 2D image set different than the first 2D image set to harvest lesion annotations.