Abstract: Systems and methods are provided for predicting metastasis of a cancer in a subject. A plurality of data elements for the subject's cancer is obtained, including sequence features comprising relative abundance values for gene expression in a cancer biopsy of the subject, optional personal characteristics about the subject, and optional clinical features related to the stage, histopathological grade, diagnosis, symptom, comorbidity, and/or treatment of the cancer in the subject, and/or a temporal element associated therewith. One or more models are applied to the plurality of data elements, determining one or more indications of whether the cancer will metastasize. A clinical report comprising the one or more indications is generated.

Abstract: A system and method are provided for training and using a machine learning model to analyze hematoxylin and eosin (H&E) slide images, where the machine learning model is trained using a training data set comprising a plurality of unmarked H&E images and a plurality of marked H&E images, each marked H&E image being associated with one unmarked H&E image and each marked H&E image including a location of one or more molecules determined by analyzing a multiplex IHC image having at least two IHC stains, each IHC stain having a unique color and a unique target molecule. Predicted molecules and locations identified with the machine learning model result in an immunotherapy response class being assigned to the H&E slide image.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing fundus images using fundus image processing machine learning models. One of the methods includes obtaining a model input comprising one or more fundus images, each fundus image being an image of a fundus of an eye of a patient; processing the model input using a fundus image processing machine learning model, wherein the fundus image processing machine learning model is configured to process the model input comprising the one or more fundus image to generate a model output; and processing the model output to generate health analysis data.

Abstract: A system and method are provided for training and using a machine learning model to analyze hematoxylin and eosin (H&E) slide images, where the machine learning model is trained using a training data set comprising a plurality of unmarked H&E images and a plurality of marked H&E images, each marked H&E image being associated with one unmarked H&E image and each marked H&E image including a location of one or more molecules determined by analyzing a multiplex IHC image having at least two IHC stains, each IHC stain having a unique color and a unique target molecule. Predicted molecules and locations identified with the machine learning model result in an immunotherapy response class being assigned to the H&E slide image.

Abstract: Systems and methods are provided for identifying a diagnosis of a cancer condition for a somatic tumor specimen of a subject. The method receives sequencing information comprising analysis of a plurality of nucleic acids derived from the somatic tumor specimen. The method identifies a plurality of features from the sequencing information, including two or more of RNA, DNA, RNA splicing, viral, and copy number features. The method provides a first subset of features and a second subset of features from the identified plurality of features as inputs to a first classifier and a second classifier, respectively. The method generates, from two or more classifiers, two or more predictions of cancer condition based at least in part on the identified plurality of features. The method combines, at a final classifier, the two or more predictions to identify the diagnosis of the cancer condition for the somatic tumor specimen of the subject.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing fundus images using fundus image processing machine learning models. One of the methods includes obtaining a model input comprising one or more fundus images, each fundus image being an image of a fundus of an eye of a patient; processing the model input using a fundus image processing machine learning model, wherein the fundus image processing machine learning model is configured to process the model input comprising the one or more fundus image to generate a model output; and processing the model output to generate health analysis data.

Abstract: A microscope of the type used by a pathologist to view slides containing biological samples such as tissue or blood is provided with the projection of enhancements to the field of view, such as a heatmap, border, or annotations, substantially in real time as the slide is moved to new locations or changes in magnification or focus occur. The enhancements assist the pathologist in characterizing or classifying the sample, such as being positive for the presence of cancer cells or pathogens.

Abstract: Systems and methods are provided for identifying a diagnosis of a cancer condition for a somatic tumor specimen of a subject. The method receives sequencing information comprising analysis of a plurality of nucleic acids derived from the somatic tumor specimen. The method identifies a plurality of features from the sequencing information, including two or more of RNA, DNA, RNA splicing, viral, and copy number features. The method provides a first subset of features and a second subset of features from the identified plurality of features as inputs to a first classifier and a second classifier, respectively. The method generates, from two or more classifiers, two or more predictions of cancer condition based at least in part on the identified plurality of features. The method combines, at a final classifier, the two or more predictions to identify the diagnosis of the cancer condition for the somatic tumor specimen of the subject.

Abstract: A system and method are provided for training and using a machine learning model to analyze hematoxylin and eosin (H&E) slide images, where the machine learning model is trained using a training data set comprising a plurality of unmarked H&E images and a plurality of marked H&E images, each marked H&E image being associated with one unmarked H&E image and each marked H&E image including a location of one or more molecules determined by analyzing a multiplex IHC image having at least two IHC stains, each IHC stain having a unique color and a unique target molecule. Predicted molecules and locations identified with the machine learning model result in an immunotherapy response class being assigned to the H&E slide image.

Abstract: Systems and methods are provided for predicting metastasis of a cancer in a subject. A plurality of data elements for the subject's cancer is obtained, including sequence features comprising relative abundance values for gene expression in a cancer biopsy of the subject, optional personal characteristics about the subject, and optional clinical features related to the stage, histopathological grade, diagnosis, symptom, comorbidity, and/or treatment of the cancer in the subject, and/or a temporal element associated therewith. One or more models are applied to the plurality of data elements, determining one or more indications of whether the cancer will metastasize. A clinical report comprising the one or more indications is generated.

Abstract: Systems and methods are provided for predicting metastasis of a cancer in a subject. A plurality of data elements for the subject's cancer is obtained, including sequence features comprising relative abundance values for gene expression in a cancer biopsy of the subject, optional personal characteristics about the subject, and optional clinical features related to the stage, histopathological grade, diagnosis, symptom, comorbidity, and/or treatment of the cancer in the subject, and/or a temporal element associated therewith. One or more models are applied to the plurality of data elements, determining one or more indications of whether the cancer will metastasize. A clinical report comprising the one or more indications is generated.

Abstract: A method, system and machine for assisting a pathologist in identifying the presence of tumor cells in lymph node tissue is disclosed. The digital image of lymph node tissue at a first magnification (e.g., 40×) is subdivided into a multitude of rectangular “patches.” A likelihood of malignancy score is then determined for each of the patches. The score is obtained by analyzing pixel data from the patch (e.g., pixel data centered on and including the patch) using a computer system programmed as an ensemble of deep neural network pattern recognizers, each operating on different magnification levels of the patch. A representation or “heatmap” of the slide is generated.

Abstract: Systems and methods are provided for predicting metastasis of a cancer in a subject. A plurality of data elements for the subject's cancer is obtained, including sequence features comprising relative abundance values for gene expression in a cancer biopsy of the subject, optional personal characteristics about the subject, and optional clinical features related to the stage, histopathological grade, diagnosis, symptom, comorbidity, and/or treatment of the cancer in the subject, and/or a temporal element associated therewith. One or more models are applied to the plurality of data elements, determining one or more indications of whether the cancer will metastasize. A clinical report comprising the one or more indications is generated.

Abstract: Systems and methods are provided for predicting metastasis of a cancer in a subject. A plurality of data elements for the subject's cancer is obtained, including sequence features comprising relative abundance values for gene expression in a cancer biopsy of the subject, optional personal characteristics about the subject, and optional clinical features related to the stage, histopathological grade, diagnosis, symptom, comorbidity, and/or treatment of the cancer in the subject, and/or a temporal element associated therewith. One or more models are applied to the plurality of data elements, determining one or more indications of whether the cancer will metastasize. A clinical report comprising the one or more indications is generated.

Abstract: Systems and methods are provided for predicting metastasis of a cancer in a subject. A plurality of data elements for the subject's cancer is obtained, including sequence features comprising relative abundance values for gene expression in a cancer biopsy of the subject, optional personal characteristics about the subject, and optional clinical features related to the stage, histopathological grade, diagnosis, symptom, comorbidity, and/or treatment of the cancer in the subject, and/or a temporal element associated therewith. One or more models are applied to the plurality of data elements, determining one or more indications of whether the cancer will metastasize. A clinical report comprising the one or more indications is generated.

Abstract: Aspects of the disclosure provide for a method for updating business information. A business at a business location and a reference image for the business at the business location may be selected for an update. From a number of more recent images, a comparison image may be selected based on a likelihood that the comparison image captures the business location. Text and visual features reference image may be compared with text and visual features of the comparison image to determine a text similarity score and a features similarity score. A confidence level indicating whether the business in the reference image is in the comparison image may then be determined using the text similarity score and the feature similarity score. According to the confidence level, the business information of the business may be updated.

Abstract: A microscope of the type used by a pathologist to view slides containing biological samples such as tissue or blood is provided with the projection of enhancements to the field of view, such as a heatmap, border, or annotations, substantially in real time as the slide is moved to new locations or changes in magnification or focus occur. The enhancements assist the pathologist in characterizing or classifying the sample, such as being positive for the presence of cancer cells or pathogens.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing fundus images using fundus image processing machine learning models. One of the methods includes obtaining a model input comprising one or more fundus images, each fundus image being an image of a fundus of an eye of a patient; processing the model input using a fundus image processing machine learning model, wherein the fundus image processing machine learning model is configured to process the model input comprising the one or more fundus image to generate a model output; and processing the model output to generate health analysis data.

Abstract: A microscope of the type used by a pathologist to view slides containing biological samples such as tissue or blood is provided with the projection of enhancements to the field of view, such as a heatmap, border, or annotations, substantially in real time as the slide is moved to new locations or changes in magnification or focus occur. The enhancements assist the pathologist in characterizing or classifying the sample, such as being positive for the presence of cancer cells or pathogens.

Abstract: Systems and methods are provided for determining a cancer type of a somatic tissue in a subject. A first plurality of sequence reads is obtained from a plurality of RNA molecules in a biopsy of the subject. A first set of sequence features comprising relative miRNA abundance values of genes is determined from the first plurality of sequence reads. Sequence features are applied to a classification model trained to distinguish between each cancer type in a set of at least 50 cancer types, thus determining the cancer type of the somatic tissue in the subject. The classification model provides an indication that the somatic tissue is or is not a respective cancer type, and the set of cancer types includes at least two cancer types from one or more classes of cancer selected from the group consisting of hematological cancers, squamous cancers, endometrial cancers, sarcoma cancers, and neuroendocrine cancers.