Abstract: An image analysis method and an image analysis system are disclosed. The method may include extracting training raw graphic data including at least one first node corresponding to a plurality of histological features of a training tissue slide image, and at least one first edge defined by a relationship between the histological features and generating training graphic data by sampling the first node of the training raw graphic data. The method may also include determining a parameter of a readout function by training a graph neural network (GNN) using the training graphic data and training output data corresponding to the training graphic data, and extracting inference graphic data including at least one second node corresponding to a plurality of histological features of an inference tissue slide image, and at least one second edge decided by a relationship between the histological features of the inference tissue slide image.

Abstract: The present disclosure describes methods, apparatus, and storage medium for node classification and training a node classification model. The method includes obtaining a target node subset and a neighbor node subset corresponding to the target node subset from a sample node set labeled with a target node class, a neighbor node in the neighbor node subset being associated with a target node in the target node subset; extracting a feature subset of the target node subset based on the neighbor node subset by using a node classification model, the feature subset comprising a feature vector of the target node; performing class prediction for the target node subset according to the feature subset, to obtain a predicted class probability subset; and training the node classification model with a target model parameter according to the predicted class probability subset and a target node class subset of the target node subset.

Abstract: Disclosed is a computer-implemented method which encompasses registering a tracked imaging device such as a microscope having a known viewing direction and an atlas to a patient space so that a transformation can be established between the atlas space and the reference system for defining positions in images of an anatomical structure of the patient. Labels are associated with certain constituents of the images and are input into a learning algorithm such as a machine learning algorithm, for example a convolutional neural network, together with the medical images and an anatomical vector and for example also the atlas to train the learning algorithm for automatic segmentation of patient images generated with the tracked imaging device. The trained learning algorithm then allows for efficient segmentation and/or labelling of patient images without having to register the patient images to the atlas each time, thereby saving on computational effort.

Abstract: Systems and methods of automatic orientation detection in fluoroscopic images using deep learning enable local registration for correction of initial CT-to-body registration in Electromagnetic Navigation Bronchoscopy (ENB) systems.

Abstract: A training label image correction method includes performing a segmentation process on an input image (11) of training data (10) by a trained model (1) using the training data to create a determination label image (14), comparing labels of corresponding portions in the determination label image (14) and a training label image (12) with each other, and correcting label areas (13) included in the training label image based on label comparison results.

Abstract: Systems and methods are disclosed for receiving one or more digital images associated with a tissue specimen, detecting one or more image regions from a background of the one or more digital images, determining a prediction, using a machine learning system, of whether at least one first image region of the one or more image regions comprises at least one external contaminant, the machine learning system having been trained using a plurality of training images to predict a presence of external contaminants and/or a location of any external contaminants present in the tissue specimen, and determining, based on the prediction of whether a first image region comprises an external contaminant, whether to process the image region using an processing algorithm.

Abstract: The disclosure relates to devices, systems and methods for image registration and annotation. The devices include computer software products for aligning whole slide digital images on a common grid and transferring annotations from one aligned image to another aligned image on the basis of matching tissue structure. The systems include computer-implemented systems such as work stations and networked computers for accomplishing the tissue-structure based image registration and cross-image annotation. The methods include processes for aligning digital images corresponding to adjacent tissue sections on a common grid based on tissue structure, and transferring annotations from one of the adjacent tissue images to another of the adjacent tissue images.

Abstract: Methods and apparatus are disclosed for interpreting a deep neural network (DNN) using a Semantic Coherence Analysis (SCA)-based interpretation technique. In embodiments, a multi-layered DNN that was trained for one task is analyzed using the SCA technique to select one layer in the DNN that produces salient features for another task. In embodiments, the DNN layers are tested with test samples labeled with a set of concept labels. The output features of a DNN layer are gathered and analyzed according to the concepts. In embodiments, the output is scored with a semantic coherence score, which indicates how well the layer separates the concepts, and one layer is selected from the DNN based on its semantic coherence score. In some embodiments, a support vector machine (SVM) or additional neural network may be added to the selected layer and trained to generate classification results based on the outputs of the selected layer.

Abstract: Embodiments of the present disclosure include a method, device and computer readable medium involving receiving image data to detect tissue lesions, passing the image data through at least one first convoluted neural network, segmenting the image data, fusing the segmented image data, and detecting tissue lesions.

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for synthesizing a realistic image with a new expression of a face in an input image by receiving an input image comprising a face having a first expression; obtaining a target expression for the face; and extracting a texture of the face and a shape of the face. The program and method for generating, based on the extracted texture of the face, a target texture corresponding to the obtained target expression using a first machine learning technique; generating, based on the extracted shape of the face, a target shape corresponding to the obtained target expression using a second machine learning technique; and combining the generated target texture and generated target shape into an output image comprising the face having a second expression corresponding to the obtained target expression.

Abstract: Systems and methods are provided for computer aided phenotyping of fibrosis-related conditions. A digital image indicates presence of collagens in a biological tissue sample. The image is processed to quantify parameters, each parameter describing a feature of the collagens that is expected to be different for different phenotypes of fibrosis. At least some features are tissue level features that describe macroscopic characteristics of the collagens, morphometric level features that describe morphometric characteristics of the collagens, and texture level features that describe an organization of the collagens. At least some of the plurality of parameters are statistics associated with histograms corresponding to distributions of the associated parameters across at least some of the digital image. At least some of the plurality of parameters are combined to obtain one or more composite scores that quantify a phenotype of fibrosis for the biological tissue sample.

Abstract: A system can visually track which items in a store are selected for purchase by a shopper. The system can form a virtual shopping cart by analyzing multiple images, over time, to determine which purchasable items are located with the shopper, such as in a physical shopping cart, in a basket, or held by the shopper. By analyzing multiple images, over time, the system can account for items misidentified in one or more images, or fully or partially obscured in one or more images as the shopper traverses the store. Alternatively, the system can form a virtual shopping cart by analyzing instances in which a purchasable item is removed from a shelf or placed on a shelf. Items removed from, but not returned to, a shelf can be considered to be selected for purchase. The system can include a frictionless checkout that charges the shopper for the selected items.

Abstract: A system and method are disclosed for segmenting a set of two-dimensional CT slices corresponding to a lesion. In an embodiment, for each of at least a subset of the set of CT slices, the system inputs the CT slice into a plurality of branches of a trained segmentation block. Each branch of the segmentation block includes a convolutional neural network (CNN) with filters at a different scale, and produces a plurality of levels of output. The system generates, for each CT slice in the subset, feature maps for each level of output. The system generates a segmentation of each CT slice in the subset based on the feature maps of each level of output. The system aggregates the segmentations of each slice in the subset to generate a three-dimensional segmentation of the lesion. The system provides data representing the three-dimensional segmentation for display.

Abstract: Techniques are provided for improving image data quality, such as in functional imaging follow-up studies, using reconstruction, post-processing, and/or deep-learning enhancement approaches in a way that automatically improves analysis fidelity, such as lesion tracking fidelity. The disclosed approaches may be useful in improving the performance of automatic analysis methods as well as in facilitating reviews performed by clinician.

Abstract: The technology disclosed relates to operating a motion-capture system responsive to available computational resources. In particular, it relates to assessing a level of image acquisition and image-analysis resources available using benchmarking of system components. In response, one or more image acquisition parameters and/or image-analysis parameters are adjusted. Acquisition and/or analysis of image data are then made compliant with the adjusted image acquisition parameters and/or image-analysis parameters. In some implementations, image acquisition parameters include frame resolution and frame capture rate and image-analysis parameters include analysis algorithm and analysis density.

Abstract: A method is used to generate a distortion model for a structured illumination microscopy (SIM) optical system. A sliding window is moved in relation to a plurality of images to define a plurality of sub-tiles. Each sub-tile represents a portion of the corresponding image. Parameters are estimated for each sub-tiles. The parameters include two or more parameters selected from the group consisting of modulation, angle, spacing, phase offset, and phase deviation. A full width at half maximum (FWHM) value associated with each sub-tile is estimated. A distortion model is estimated, based at least in part on a combination of the estimated parameters and FWHM values stored in the predetermined format and an estimated center window parameter. A two-dimensional image may be generated, based at least in part on the estimated distortion model. The two-dimensional image may include representations indicating where distortions occur in the optical system.

Abstract: Devices and methods for capturing vehicle undercarriage images are described. In some instances, a mirror assembly may be used to reflect images of portions of a vehicle undercarriage into a field of view of a camera to be captured, e.g., as a vehicle passes over the mirror assembly. Composite images may be reconstructed from the reflected portions of the vehicle undercarriage, and analysis may be performed on those reconstructed, composite images to identify features in the composite vehicle undercarriage images.

Abstract: Methods, systems and devices for item processing. The systems can include a PASS module that can include features that receive inputs relating to an item for processing and provide those inputs to other components and/or modules of a PASS system and/or of another system. The PASS system can include a variety of modules, including the PASS module, and can collect information and/or inputs from the variety of modules of the PASS system and use that information in item processing. The methods of item processing can use the PASS system and the PASS module to perform a variety of functions including, for example, revenue protection, sorting of items, task management, sampling and data collection, redirecting if enroute items, and personnel management.

Abstract: An example system includes a processor to receive an image with corresponding acquisition information. The processor is to classify the image using the corresponding acquisition information via a deep neural network including integrated acquisition information.

Abstract: The present disclosure is directed to systems and methods for generating investigations of user behavior. In an example embodiment, the system includes a video camera configured to capture video of user activity, a video analytic module to perform real-time video processing of the captured video to generate non-video data from video, and a computer configured to receive the video and the non-video data from the video camera. The computer includes a video analytics module configured to analyze one of video and non-video data to identify occurrences of particular user behavior, and an investigation generation module configured to generate an investigation containing at least one video sequence of the particular user behavior. In some embodiments, the investigation is generated in near real time. The particular user behavior may be defined as an action, an inaction, a movement, a plurality of event occurrences, a temporal event and/or an externally-generated event.