Patents Assigned to Lunit Inc.
  • Publication number: 20220415013
    Abstract: A method for operating a medical imaging device includes obtaining lesion information on at least one lesion detected from a medical image, determining a shape and a position of at least one contour corresponding to the at least one lesion based on the obtained lesion information, determining a position of at least one text region that includes a text indicating the lesion information on the at least one lesion in the medical image, and displaying the at least one contour and the text included in the at least one text region on the medical image, based on the determined shape and position of the at least one contour and the determined position of the at least one text region.
    Type: Application
    Filed: August 25, 2022
    Publication date: December 29, 2022
    Applicant: LUNIT INC.
    Inventors: Dong Geun YOO, Min Chul KIM, Hyo Eun KIM, Hyun Jae LEE, Jae Hwan LEE, Hae Joon KIM
  • Publication number: 20220262513
    Abstract: A method, performed by at least one processor, for training a machine learning model for detecting an abnormal region in a pathological slide image is disclosed. The method including receiving one or more first pathological slide images, determining, from the received one or more first pathological slide images, a normal region based on an abnormality condition indicative of a condition of an abnormal region, generating a first set of training data including the determined normal region, generating the abnormal region by performing image processing corresponding to the abnormality condition with respect to at least partial region in the received one or more first pathological slide images, and generating a second set of training data including the generated abnormal region.
    Type: Application
    Filed: December 14, 2021
    Publication date: August 18, 2022
    Applicant: LUNIT INC.
    Inventors: Donggeun YOO, Jaehong AUM, Minuk MA, Jeong Un RYU
  • Publication number: 20220261988
    Abstract: A method for detecting a region of interest (ROI) in a pathological slide image is provided. The method may include receiving one or more pathological slide images and detecting an ROI in the received one or more pathological slide images. In addition, an information processing system is provided. The information processing system includes a memory storing one or more instructions, and a processor configured to execute the stored one or more instructions to receive one or more pathological slide images and detect an ROI in the received one or more pathological slide images.
    Type: Application
    Filed: December 15, 2021
    Publication date: August 18, 2022
    Applicant: LUNIT INC.
    Inventors: Donggeun YOO, Jaehong AUM, Minuk MA, Jeong Un RYU
  • Publication number: 20220172009
    Abstract: Provided is a method for performing a prediction work on a target image, including dividing the target image into a plurality of sub-images, generating prediction results for a plurality of pixels included in each of the plurality of divided sub-images, applying weights to the prediction results for the plurality of pixels, and merging the prediction results for the plurality of pixels applied with the weights.
    Type: Application
    Filed: February 15, 2022
    Publication date: June 2, 2022
    Applicant: LUNIT INC.
    Inventor: In Wan YOO
  • Patent number: 11334994
    Abstract: A method for interpreting an input image by a computing device operated by at least one processor is provided. The method for interpreting an input image comprises storing an artificial intelligent (AI) model that is trained to classify a lesion detected in the input image as suspicious or non-suspicious and, under a condition of being suspicious, to classify the lesion detected in the input image as malignant or benign-hard representing that the lesion is suspicious but determined to be benign, receiving an analysis target image, by using the AI model, obtaining a classification class of a target lesion detected in the analysis target image and, when the classification class is the suspicious, obtaining at least one of a probability of being suspicious, a probability of being benign-hard, and a probability of malignant for the target lesion, and outputting an interpretation result including at least one probability obtained for the target lesion.
    Type: Grant
    Filed: May 15, 2020
    Date of Patent: May 17, 2022
    Assignee: LUNIT INC.
    Inventors: Hyo-Eun Kim, Hyeonseob Nam
  • Patent number: 11335455
    Abstract: A computing device obtains information about a medical slide image, and determines a dataset type of the medical slide image and a panel of the medical slide image. The computing device assigns to an annotator account, an annotation job defined by at least the medical slide image, the determined dataset type, an annotation task, and a patch that is a partial area of the medical slide image. The annotation task includes the determined panel, and the panel is designated as one of a plurality of panels including a cell panel, a tissue panel, and a structure panel. The dataset type indicates a use of the medical slide image and is designated as one of a plurality of uses including a training use of a medical learning model and a validation use of the machine learning model.
    Type: Grant
    Filed: November 1, 2019
    Date of Patent: May 17, 2022
    Assignee: LUNIT INC.
    Inventors: Kyoung Won Lee, Kyung Hyun Paeng
  • Publication number: 20220145401
    Abstract: A method for predicting responsiveness to therapy for cancer patient is provided, which includes acquiring a pathology slide image of a cancer patient, determining information on a plurality of lymphocytes and information on a plurality of tumor cells included in the pathology slide image, calculating a lymphocyte and tumor cell interaction score based on the information on the plurality of lymphocytes and the information on the plurality of tumor cells, and predicting responsiveness to therapy for the cancer patient by using the interaction score.
    Type: Application
    Filed: November 8, 2021
    Publication date: May 12, 2022
    Applicant: LUNIT INC.
    Inventor: Jeong Hoon LEE
  • Publication number: 20220092448
    Abstract: Provided is a method for training a hint-based machine learning model configured to infer annotation information for target data, including obtaining training data for the machine learning model, wherein the training data includes a plurality of target data items provided with a plurality of annotation information items, and extracting a plurality of pixel groups from the plurality of target data items. The extracted plurality of pixel groups may be included in hint information. In addition, the method includes obtaining, from the plurality of annotation information items, a plurality of annotation classes corresponding to the extracted plurality of pixel groups to include the obtained plurality of annotation classes in the hint information, and training, by using the hint information, the machine learning model to infer the plurality of annotation information items associated with the plurality of target data items.
    Type: Application
    Filed: July 23, 2021
    Publication date: March 24, 2022
    Applicant: LUNIT INC.
    Inventors: In Wan YOO, Donggeun YOO
  • Patent number: 11270203
    Abstract: There is provided is a method and an apparatus for training a neural network capable of improving the performance of the neural network by performing intelligent normalization according to a target task of the neural network. The method according to some embodiments of the present disclosure includes transforming the output data into first normalized data using a first normalization technique, transforming the output data into second normalized data using a second normalization technique and generating target normalized data by aggregating the first normalized data and the second normalized data based on a learnable parameter. At this time, a rate at which the first normalization data is applied in the target normalization data is adjusted by the learnable parameter so that the intelligent normalization according to the target task can be performed, and the performance of the neural network can be improved.
    Type: Grant
    Filed: June 12, 2019
    Date of Patent: March 8, 2022
    Assignee: LUNIT INC.
    Inventors: Hyeon Seob Nam, Hyo Eun Kim
  • Publication number: 20220037024
    Abstract: A method for generating a medical prediction related to a biomarker from medical data is provided, which includes obtaining medical data associated with a patient, determining a region of interest in the medical data, extracting one or more features associated with the medical data based on the region of interest, and generating a medical prediction for the patient based on the extracted one or more features.
    Type: Application
    Filed: October 15, 2021
    Publication date: February 3, 2022
    Applicant: LUNIT INC.
    Inventors: Donggeun YOO, Jeong Hoon LEE, Kyunghyun PAENG
  • Publication number: 20220036971
    Abstract: The present disclosure relates to a method, performed by at least one computing device, for predicting a response to an immune checkpoint inhibitor. The method includes receiving a first pathology slide image, detecting one or more target items in the first pathology slide image, determining at least one of an immune phenotype of at least some regions in the first pathology slide image or information associated with the immune phenotype based on the detection result for the one or more target items, and generating a prediction result as to whether or not a patient associated with the first pathology slide image responds to the immune checkpoint inhibitor, based on the immune phenotype of the at least some regions in the first pathology slide image or the information associated with the immune phenotype.
    Type: Application
    Filed: October 15, 2021
    Publication date: February 3, 2022
    Applicant: LUNIT INC.
    Inventors: Donggeun YOO, Chanyoung OCK, Kyunghyun PAENG
  • Publication number: 20220036558
    Abstract: The present disclosure relates to a method for predicting biomarker expression from a medical image. The method for predicting biomarker expression includes receiving a medical image, and outputting indices of biomarker expression for the at least one lesion included in the medical image by using a first machine learning model.
    Type: Application
    Filed: October 15, 2021
    Publication date: February 3, 2022
    Applicant: LUNIT INC.
    Inventors: Jae Hong AUM, Chanyoung OCK, Donggeun YOO
  • Publication number: 20220036549
    Abstract: The present disclosure relates to a method, performed by at least one computing device, for providing information associated with immune phenotype for pathology slide image. The method may include obtaining information associated with immune phenotype for one or more regions of interest (ROIs) in a pathology slide image, generating, based on the information associated with the immune phenotype for one or more ROIs, an image indicative of the information associated with the immune phenotype, and outputting the image indicative of the information associated with immune phenotype.
    Type: Application
    Filed: October 15, 2021
    Publication date: February 3, 2022
    Applicant: LUNIT Inc.
    Inventors: Donggeun Yoo, Chanyoung Ock, Kyunghyun Paeng
  • Publication number: 20210390679
    Abstract: Provided is a method for providing annotation information for a 3D image, which may include outputting a representative image for the 3D image including a plurality of slices, selecting at least one pixel associated with a target item from among a plurality of pixels included in the representative image, outputting, among the plurality of slices, a slice associated with the selected at least one pixel, and receiving an annotation for a partial region of the output slice.
    Type: Application
    Filed: June 30, 2021
    Publication date: December 16, 2021
    Applicant: LUNIT INC.
    Inventor: Hyunjae LEE
  • Patent number: 11200483
    Abstract: A machine learning method based on weakly supervised learning according to an embodiment of the present invention includes extracting feature maps about a dataset given a first type of information and not given a second type of information by using a convolutional neural network (CNN), updating the CNN by back-propagating a first error value calculated as a result of performing a task corresponding to the first type of information by using a first model, and updating the CNN by back-propagating a second error value calculated as a result of performing the task corresponding to the first type of information by using a second model different from the first model, wherein the second type of information is extracted when the task corresponding to the first type of information is performed using the second model.
    Type: Grant
    Filed: December 13, 2016
    Date of Patent: December 14, 2021
    Assignee: LUNIT INC.
    Inventors: Sang Heum Hwang, Hyo Eun Kim
  • Publication number: 20210366594
    Abstract: A method for refining label information, which is performed by at least one computing device is disclosed. The method includes acquiring a pathology slide image including a plurality of patches, inferring a plurality of label information items for the plurality of patches included in the acquired pathology slide image using a machine learning model, applying the inferred plurality of label information items to the pathology slide image, and providing the pathology slide image applied with the inferred plurality of label information items to an annotator terminal.
    Type: Application
    Filed: November 20, 2020
    Publication date: November 25, 2021
    Applicant: LUNIT INC.
    Inventor: Chunseong PARK
  • Patent number: 11100359
    Abstract: An image analysis method and an image analysis system are disclosed. The method may include extracting training raw graphic data including at least one first node corresponding to a plurality of histological features of a training tissue slide image, and at least one first edge defined by a relationship between the histological features and generating training graphic data by sampling the first node of the training raw graphic data. The method may also include determining a parameter of a readout function by training a graph neural network (GNN) using the training graphic data and training output data corresponding to the training graphic data, and extracting inference graphic data including at least one second node corresponding to a plurality of histological features of an inference tissue slide image, and at least one second edge decided by a relationship between the histological features of the inference tissue slide image.
    Type: Grant
    Filed: November 25, 2019
    Date of Patent: August 24, 2021
    Assignee: Lunit Inc.
    Inventor: Minje Jang
  • Patent number: 11062800
    Abstract: A computing device obtains information about a medical slide image, and determines a dataset type of the medical slide image and a panel of the medical slide image. The computing device assigns to an annotator account, an annotation job defined by at least the medical slide image, the determined dataset type, an annotation task, and a patch that is a partial area of the medical slide image. The annotation task includes the determined panel, and the panel is designated as one of a plurality of panels including a cell panel, a tissue panel, and a structure panel. The dataset type indicates a use of the medical slide image and is designated as one of a plurality of uses including a training use of a medical learning model and a validation use of the machine learning model.
    Type: Grant
    Filed: March 10, 2020
    Date of Patent: July 13, 2021
    Assignee: LUNIT INC.
    Inventors: Kyoung Won Lee, Kyung Hyun Paeng
  • Patent number: 11042789
    Abstract: A normalization method for machine learning and an apparatus thereof are provided. The normalization method according to some embodiments of the present disclosure may calculate a value of a normalization parameter for an input image through a normalization model before inputting the input image to a target model and normalize the input image using the calculated value of the normalization parameter. Because the normalization model is updated based on a prediction loss of the target model, the input image can be normalized to an image suitable for a target task, so that stability of the learning and performance of the target model can be improved.
    Type: Grant
    Filed: August 8, 2019
    Date of Patent: June 22, 2021
    Assignee: LUNIT INC.
    Inventor: Jae Hwan Lee
  • Patent number: 10922628
    Abstract: A machine learning method that may reduce an annotation cost and may improve performance of a target model is provided. Some embodiments of the present disclosure may provide a machine learning method performed by a computing device, including: acquiring a training dataset of a first model including a plurality of data samples to which label information is not given; calculating a miss-prediction probability of the first model on the plurality of data samples; configuring a first data sample group by selecting at least one data sample from the plurality of data samples based on the calculated miss-prediction probability; acquiring first label information on the first data sample group; and performing first learning on the first model by using the first data sample group and the first label information.
    Type: Grant
    Filed: November 15, 2019
    Date of Patent: February 16, 2021
    Assignee: LUNIT INC.
    Inventors: Dong Geun Yoo, Kyung Hyun Paeng, Sung Gyun Park