Abstract: Automated systems and methods for determining the variability between derived expression scores for a series of biomarkers between different identified cell clusters in a whole slide image are presented. The variability between derived expression scores may be a derived inter-marker heterogeneity metric.

Abstract: The present invention relates to systems and methods for adaptively optimizing broadband reference spectra for a multi-spectral image or adaptively optimizing reference colors for a bright-field image. The methods and systems of the present invention involve optimization techniques that are based on structures detected in an unmixed channel of the image, and involves detecting and segmenting structures from a channel, updating a reference matrix with signals estimated from the structures, subsequently unmixing the image using the updated reference matrix, and iteratively repeating the process until an optimized reference matrix is achieved.

Abstract: Immune context scores are calculated for tumor tissue samples using continuous scoring functions. Feature metrics for at least one immune cell marker are calculated for a region or regions of interest, the feature metrics including at least a quantitative measure of human CD3 or total lymphocyte counts. A continuous scoring function is then applied to a feature vector including the feature metric and at least one additional metric related to an immunological biomarker, the output of which is an immune context score. The immune context score may then be plotted as a function of a diagnostic or treatment metric, such as a prognostic metric (e.g. overall survival, disease-specific survival, progression-free survival) or a predictive metric (e.g. likelihood of response to a particular treatment course). The immune context score may then be incorporated into diagnostic and/or treatment decisions.

Abstract: The disclosure relates to devices, systems and methods for image registration and annotation. The devices include computer software products for aligning whole slide digital images on a common grid and transferring annotations from one aligned image to another aligned image on the basis of matching tissue structure. The systems include computer-implemented systems such as work stations and networked computers for accomplishing the tissue-structure based image registration and cross-image annotation. The methods include processes for aligning digital images corresponding to adjacent tissue sections on a common grid based on tissue structure, and transferring annotations from one of the adjacent tissue images to another of the adjacent tissue images.

Abstract: A tissue analysis system and method for the spectral deconvolution of a RGB digital image obtained from a stained biological tissue sample, by estimating the stain component images that are obtained from a staining system configuration, where the reference stain vectors are assumed to be sampled from a known color distribution. The prior knowledge of stain variability of the staining system is adopted as initial reference stain vectors and statistical distribution of their variability. Based on the initial reference stain vectors distribution, the tissue analysis system determines both the reference stain vectors and stain component images of the input image. The image is then deconvoluted based on the reference stain vectors and stain component images.

Abstract: A method for identifying biomarker-positive tumor cells is disclosed. The method includes, for example, reading a first digital image and a second digital image into memory, the first and second digital image depicting the same area of a first slide; identifying a plurality of nuclei and positional information of said nuclei by analyzing the light intensities in the first digital image; identifying cell membranes which comprise the biomarker by analyzing the light intensities in the second digital image and by analyzing the positional information of the identified nuclei; and identifying biomarker-positive tumor cells in said area, wherein a biomarker-positive tumor cell is a combination of one identified nucleus and one identified cell membrane that surrounds the identified nucleus.

Abstract: The subject disclosure presents systems and methods for receiving a plurality of assay information along with a query for one or more features of interest, and projecting anatomical information from an anatomical assay onto a staining assay, for example an immunohistochemical (IHC) assay that is commonly registered with the anatomical assay, to locate or determine features appropriate for analysis. The anatomical information may be used to generate a mask that is projected on one or more commonly registered staining assays. A location of the feature of interest in the staining assay may be correlated with the anatomical context provided by the mask, with any features of interest that match the anatomical mask being selected or indicated as appropriate for analysis.

Abstract: The subject disclosure presents systems and computer-implemented methods for assessing a risk of cancer recurrence in a patient based on a holistic integration of large amounts of prognostic information for said patient into a single comparative prognostic dataset. A risk classification system may be trained using the large amounts of information from a cohort of training slides from several patients, along with survival data for said patients. For example, a machine-learning-based binary classifier in the risk classification system may be trained using a set of granular image features computed from a plurality of slides corresponding to several cancer patients whose survival information is known and input into the system. The trained classifier may be used to classify image features from one or more test patients into a low-risk or high-risk group.

Abstract: A computer-based specimen analyzer (10) is configured to detect a level of expression of genes in a cell sample by detecting dots that represent differently stained genes and chromosomes in a cell. The color of the stained genes and the chromosomes is enhanced and filtered to produce a dot mask that defines areas in the image that are genes, chromosomes, or non-genetic material. Metrics are determined for the dots and/or pixels in the image of the cell in areas corresponding to the dots. The metrics are fed to a classifier that separates genes from chromosomes. The results of the classifier are counted to estimate the expression level of genes in the tissue samples.

Abstract: Convolutional neural networks for detecting objects of interest within images of biological specimens are disclosed. Also disclosed are systems and methods of training and using such networks, one method including: obtaining a sample image and at least one of a set of positive points and a set of negative points, wherein each positive point identifies a location of one object of interest within the sample image, and each negative point identifies a location of one object of no-interest within the sample image; obtaining one or more predefined characteristics of objects of interest and/or objects of no-interest, and based on the predefined characteristics, generating a boundary map comprising a positive area around each positive point the set of positive points, and/or a negative area around each negative point in the set of negative points; and training the convolutional neural network using the sample image and the boundary map.

Abstract: The present disclosure relates, among other things, to an image analysis method for identifying objects belonging to a particular objet class in a digital image of a biological sample. The method may include, among other things, analyzing the digital image for automatically or semi-automatically identifying objects in the digital image; analyzing the digital image for identifying, for each object, a first object feature value of a first object feature of said object; analyzing the digital image for computing one or more first context feature values; inputting both the first object feature value of each of the objects in the digital image and the first context feature value of said digital image into a first classifier; and executing the first classifier.

Abstract: Systems and methods described herein relate, among other things, to unmixing more than three stains, while preserving the biological constraints of the biomarkers. Unlimited numbers of markers may be unmixed from a limited-channel image, such as an RGB image, without adding any mathematical complicity to the model. Known co-localization information of different biomarkers within the same tissue section enables defining fixed upper bounds for the number of stains at one pixel. A group sparsity model may be leveraged to explicitly model the fractions of stain contributions from the co-localized biomarkers into one group to yield a least squares solution within the group. A sparse solution may be obtained among the groups to ensure that only a small number of groups with a total number of stains being less than the upper bound are activated.

Abstract: Systems and methods described herein relate, among other things, to unmixing more than three stains, while preserving the biological constraints of the biomarkers. Unlimited numbers of markers may be unmixed from a limited-channel image, such as an RGB image, without adding any mathematical complicity to the model. Known co-localization information of different biomarkers within the same tissue section enables defining fixed upper bounds for the number of stains at one pixel. A group sparsity model may be leveraged to explicitly model the fractions of stain contributions from the co-localized biomarkers into one group to yield a least squares solution within the group. A sparse solution may be obtained among the groups to ensure that only a small number of groups with a total number of stains being less than the upper bound are activated.

Abstract: A computer-based specimen analyzer (10) is configured to detect a level of expression of genes in a cell sample by detecting dots that represent differently stained genes and chromosomes in a cell. The color of the stained genes and the chromosomes is enhanced and filtered to produce a dot mask that defines areas in the image that are genes, chromosomes, or non-genetic material. Metrics are determined for the dots and/or pixels in the image of the cell in areas corresponding to the dots. The metrics are fed to a classifier that separates genes from chromosomes. The results of the classifier are counted to estimate the expression level of genes in the tissue samples.

Abstract: Described herein are computer-implemented methods for analysis of a tissue sample. An example method includes: annotating the whole tumor regions or set of tumorous sub-regions either on a biomarker image or an H&E image (e.g. from an adjacent serial section of the biomarker image); registering at least a portion of the biomarker image to the H&E image; detecting different cellular and regional tissue structures within the registered H&E image; computing a probability map based on the different detected structures within the registered H&E image; deriving nuclear metrics from each of the biomarker and H&E images; deriving probability metrics from the probability map; and classifying tumor nuclei in the biomarker image based on the computed nuclear and probability metrics.

Abstract: The subject disclosure presents systems and methods for improved meso-dissection of biological specimens and tissue slides including importing one or more reference slides with annotations, using inter-marker registration algorithms to automatically map the annotations to an image of a milling slide, and dissecting the annotated tissue from the selected regions in the milling slide for analysis, while concurrently tracking the data and analysis using unique identifiers such as bar codes.

Abstract: The disclosure relates to devices, systems and methods for image registration and annotation. The devices include computer software products for aligning whole slide digital images on a common grid and transferring annotations from one aligned image to another aligned image on the basis of matching tissue structure. The systems include computer-implemented systems such as work stations and networked computers for accomplishing the tissue-structure based image registration and cross-image annotation. The methods include processes for aligning digital images corresponding to adjacent tissue sections on a common grid based on tissue structure, and transferring annotations from one of the adjacent tissue images to another of the adjacent tissue images.

Abstract: The subject disclosure presents systems and computer-implemented methods for assessing a risk of cancer recurrence in a patient based on a holistic integration of large amounts of prognostic information for said patient into a single comparative prognostic dataset. A risk classification system may be trained using the large amounts of information from a cohort of training slides from several patients, along with survival data for said patients. For example, a machine-learning-based binary classifier in the risk classification system may be trained using a set of granular image features computed from a plurality of slides corresponding to several cancer patients whose survival information is known and input into the system. The trained classifier may be used to classify image features from one or more test patients into a low-risk or high-risk group.

Abstract: Methods, systems, and apparatuses for automatically identifying glandular regions and tubule regions in a breast tissue sample are provided. An image of breast tissue is analyzed to detect nuclei and lumen candidates, identify tumor nuclei and true lumen from the candidates, and group tumor nuclei with neighboring tumor nuclei and lumina to define tubule glandular regions and non-tubule glandular regions of the image. Learnt supervised classifiers, such as random forest classifiers, can be applied to identify and classify the tumor nuclei and true lumina. Graph-cut methods can be applied to group the tumor nuclei and lumina and to define the tubule glandular regions and non-tubule glandular regions. The analysis can be applied to whole slide images and can resolve tubule areas with multiple layers of nuclei.

Abstract: The disclosure relates to devices, systems and methods for generating a digital image of a tissue section that is a composite of two or more source digital images of adjacent tissue sections and which may have a real-time adjustable boundary between different source images. The devices include computer software products for a fused-view visualization tool which permits one or more of generating and displaying the composite image and modifying the location of one or more boundaries between source images comprising the composite image. The systems include computer-implemented systems such as work stations and networked computers for analyzing tissue samples using the fused-view visualization tool. The methods include processes for visualization of a tissue sample as a composite image derived from two or more slides of adjacent tissue sections, for example as an interactive composite image wherein the proportion of each source image in the composite image may be altered.