Patents by Inventor Joseph R. Ledsam
Joseph R. Ledsam has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11954902Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating a final classification output for an image of eye tissue. The image is provided as input to each of one or more segmentation neural networks to obtain one or more segmentation maps of the eye tissue in the image. A respective classification input is generated from each of the segmentation maps. For each of the segmentation maps, the classification input for the segmentation map is provided as input to each of one or more classification neural networks to obtain, for each segmentation map, a respective classification output from each classification neural network. A final classification output for the image is generated from the respective classification outputs for each of the segmentation maps.Type: GrantFiled: December 8, 2020Date of Patent: April 9, 2024Assignee: Google LLCInventors: Jeffrey De Fauw, Joseph R. Ledsam, Bernardino Romera-Paredes, Stanislav Nikolov, Nenad Tomasev, Samuel Blackwell, Harry Askham, Xavier Glorot, Balaji Lakshminarayanan, Trevor Back, Mustafa Suleyman, Pearse A. Keane, Olaf Ronneberger, Julien Robert Michel Cornebise
-
Patent number: 11935232Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating a final progression score characterizing a likelihood that a state of a medical condition affecting eye tissue will progress to a target state in a future interval of time. In one aspect, a method comprises: obtaining: (i) an input image of eye tissue captured using an imaging modality, and (ii) a segmentation map of the eye tissue in the input image into a plurality of tissue types; providing the input image to each of one or more first classification neural networks to obtain a respective first progression score from each first classification neural network; providing the segmentation map to each of one or more second classification neural networks to obtain a respective second progression score from each second classification neural network; and generating the final progression score based on the first and second progression scores.Type: GrantFiled: August 17, 2020Date of Patent: March 19, 2024Assignee: Google LLCInventors: Jason Yim, Reena Kumari Chopra, Terry Spitz, Jim Huibrecht Winkens, Annette Ada Nkechinyere Obika, Trevor Back, Joseph R. Ledsam, Pearse A. Keane, Jeffrey De Fauw
-
3-D convolutional neural networks for organ segmentation in medical images for radiotherapy planning
Patent number: 11676281Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for segmenting a medical image. In one aspect, a method comprises: receiving a medical image that is captured using a medical imaging modality and that depicts a region of tissue in a body; and processing the medical image using a segmentation neural network to generate a segmentation output. The segmentation neural network can include a sequence of multiple encoder blocks and a decoder subnetwork. Training the segmentation neural network can include determining a set of error values for a segmentation channel; identifying the highest error values from the set of error values for the segmentation channel; and determining a segmentation loss based on the highest error values identified for the segmentation channel.Type: GrantFiled: July 20, 2021Date of Patent: June 13, 2023Assignee: Google LLCInventors: Stanislav Nikolov, Samuel Blackwell, Jeffrey De Fauw, Bernardino Romera-Paredes, Clemens Ludwig Meyer, Harry Askham, Cian Hughes, Trevor Back, Joseph R. Ledsam, Olaf Ronneberger -
Publication number: 20220301152Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating a final progression score characterizing a likelihood that a state of a medical condition affecting eye tissue will progress to a target state in a future interval of time. In one aspect, a method comprises: obtaining: (i) an input image of eye tissue captured using an imaging modality, and (ii) a segmentation map of the eye tissue in the input image into a plurality of tissue types; providing the input image to each of one or more first classification neural networks to obtain a respective first progression score from each first classification neural network; providing the segmentation map to each of one or more second classification neural networks to obtain a respective second progression score from each second classification neural network; and generating the final progression score based on the first and second progression scores.Type: ApplicationFiled: August 17, 2020Publication date: September 22, 2022Inventors: Jason Yim, Reena Kumari Chopra, Terry Spitz, Jim Huibrecht Winkens, Annette Ada Nkechinyere Obika, Trevor Back, Joseph R. Ledsam, Pearse A. Keane, Jeffrey De Fauw
-
Patent number: 11302446Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for predicting future adverse health events using neural networks. One of the methods includes receiving electronic health record data for a patient; generating, from the electronic health record data, an input sequence comprising a respective feature representation at each of a plurality of time window time steps, comprising, for each time window time step: determining, for each of the possible numerical features, whether the numerical feature occurred during the time window; and generating, for each of the possible numerical features, one or more presence features that identify whether the numerical feature occurred during the time window; and processing the input sequence using a neural network to generate a neural network output that characterizes a predicted likelihood that an adverse health event will occur to the patient.Type: GrantFiled: November 13, 2019Date of Patent: April 12, 2022Assignee: Google LLCInventors: Nenad Tomasev, Xavier Glorot, Jack William Rae, Michal Zielinski, Anne Mottram, Harry Askham, Andre Saraiva Nobre Dos Santos, Clemens Ludwig Meyer, Suman Ravuri, Ivan Protsyuk, Trevor Back, Joseph R. Ledsam, Shakir Mohamed
-
3-D CONVOLUTIONAL NEURAL NETWORKS FOR ORGAN SEGMENTATION IN MEDICAL IMAGES FOR RADIOTHERAPY PLANNING
Publication number: 20220012891Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for segmenting a medical image. In one aspect, a method comprises: receiving a medical image that is captured using a medical imaging modality and that depicts a region of tissue in a body; and processing the medical image using a segmentation neural network to generate a segmentation output, wherein the segmentation neural network comprises a sequence of multiple encoder blocks, wherein: each encoder block is a residual neural network block comprising one or more two-dimensional convolutional neural network layers, one or more three-dimensional convolutional neural network layers, or both, and each encoder block is configured to process a respective encoder block input to generate a respective encoder block output wherein a spatial resolution of the encoder block output is lower than a spatial resolution of the encoder block input.Type: ApplicationFiled: July 20, 2021Publication date: January 13, 2022Inventors: Stanislav Nikolov, Samuel Blackwell, Jeffrey De Fauw, Bernardino Romera-Paredes, Clemens Ludwig Meyer, Harry Askham, Cian Hughes, Trevor Back, Joseph R. Ledsam, Olaf Ronneberger -
3-D convolutional neural networks for organ segmentation in medical images for radiotherapy planning
Patent number: 11100647Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for segmenting a medical image. In one aspect, a method comprises: receiving a medical image that is captured using a medical imaging modality and that depicts a region of tissue in a body; and processing the medical image using a segmentation neural network to generate a segmentation output, wherein the segmentation neural network comprises a sequence of multiple encoder blocks, wherein: each encoder block is a residual neural network block comprising one or more two-dimensional convolutional neural network layers, one or more three-dimensional convolutional neural network layers, or both, and each encoder block is configured to process a respective encoder block input to generate a respective encoder block output wherein a spatial resolution of the encoder block output is lower than a spatial resolution of the encoder block input.Type: GrantFiled: September 9, 2019Date of Patent: August 24, 2021Assignee: Google LLCInventors: Stanislav Nikolov, Samuel Blackwell, Jeffrey De Fauw, Bernardino Romera-Paredes, Clemens Ludwig Meyer, Harry Askham, Cian Hughes, Trevor Back, Joseph R. Ledsam, Olaf Ronneberger -
Publication number: 20210118198Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating a final classification output for an image of eye tissue. The image is provided as input to each of one or more segmentation neural networks to obtain one or more segmentation maps of the eye tissue in the image. A respective classification input is generated from each of the segmentation maps. For each of the segmentation maps, the classification input for the segmentation map is provided as input to each of one or more classification neural networks to obtain, for each segmentation map, a respective classification output from each classification neural network. A final classification output for the image is generated from the respective classification outputs for each of the segmentation maps.Type: ApplicationFiled: December 8, 2020Publication date: April 22, 2021Inventors: Jeffrey De Fauw, Joseph R. Ledsam, Bernardino Romera-Paredes, Stanislav Nikolov, Nenad Tomasev, Samuel Blackwell, Harry Askham, Xavier Glorot, Balaji Lakshminarayanan, Trevor Back, Mustafa Suleyman, Pearse A. Keane, Olaf Ronneberger, Julien Robert Michel Cornebise
-
Patent number: 10878601Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating a final classification output for an image of eye tissue. The image is provided as input to each of one or more segmentation neural networks to obtain one or more segmentation maps of the eye tissue in the image. A respective classification input is generated from each of the segmentation maps. For each of the segmentation maps, the classification input for the segmentation map is provided as input to each of one or more classification neural networks to obtain, for each segmentation map, a respective classification output from each classification neural network. A final classification output for the image is generated from the respective classification outputs for each of the segmentation maps.Type: GrantFiled: December 28, 2018Date of Patent: December 29, 2020Assignee: Google LLCInventors: Jeffrey De Fauw, Joseph R. Ledsam, Bernardino Romera-Paredes, Stanislav Nikolov, Nenad Tomasev, Samuel Blackwell, Harry Askham, Xavier Glorot, Balaji Lakshminarayanan, Trevor Back, Mustafa Suleyman, Pearse A. Keane, Olaf Ronneberger, Julien Robert Michel Cornebise
-
Publication number: 20200152333Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for predicting future adverse health events using neural networks. One of the methods includes receiving electronic health record data for a patient; generating, from the electronic health record data, an input sequence comprising a respective feature representation at each of a plurality of time window time steps, comprising, for each time window time step: determining, for each of the possible numerical features, whether the numerical feature occurred during the time window; and generating, for each of the possible numerical features, one or more presence features that identify whether the numerical feature occurred during the time window; and processing the input sequence using a neural network to generate a neural network output that characterizes a predicted likelihood that an adverse health event will occur to the patient.Type: ApplicationFiled: November 13, 2019Publication date: May 14, 2020Inventors: Nenad Tomasev, Xavier Glorot, Jack William Rae, Michal Zielinski, Anne Mottram, Harry Askham, Andre Saraiva Nobre Dos Santos, Clemens Ludwig Meyer, Suman Ravuri, Ivan Protsyuk, Trevor Back, Joseph R. Ledsam, Shakir Mohamed
-
3-D CONVOLUTIONAL NEURAL NETWORKS FOR ORGAN SEGMENTATION IN MEDICAL IMAGES FOR RADIOTHERAPY PLANNING
Publication number: 20200082534Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for segmenting a medical image. In one aspect, a method comprises: receiving a medical image that is captured using a medical imaging modality and that depicts a region of tissue in a body; and processing the medical image using a segmentation neural network to generate a segmentation output, wherein the segmentation neural network comprises a sequence of multiple encoder blocks, wherein: each encoder block is a residual neural network block comprising one or more two-dimensional convolutional neural network layers, one or more three-dimensional convolutional neural network layers, or both, and each encoder block is configured to process a respective encoder block input to generate a respective encoder block output wherein a spatial resolution of the encoder block output is lower than a spatial resolution of the encoder block input.Type: ApplicationFiled: September 9, 2019Publication date: March 12, 2020Inventors: Stanislav Nikolov, Samuel Blackwell, Jeffrey De Fauw, Bernardino Romera-Paredes, Clemens Meyer, Harry Askham, Cian Hughes, Trevor Back, Joseph R. Ledsam, Olaf Ronneberger -
Publication number: 20190139270Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating a final classification output for an image of eye tissue. The image is provided as input to each of one or more segmentation neural networks to obtain one or more segmentation maps of the eye tissue in the image. A respective classification input is generated from each of the segmentation maps. For each of the segmentation maps, the classification input for the segmentation map is provided as input to each of one or more classification neural networks to obtain, for each segmentation map, a respective classification output from each classification neural network. A final classification output for the image is generated from the respective classification outputs for each of the segmentation maps.Type: ApplicationFiled: December 28, 2018Publication date: May 9, 2019Inventors: Jeffrey De Fauw, Joseph R. Ledsam, Bernardino Romera-Paredes, Stanislav Nikolov, Nenad Tomasev, Samuel Blackwell, Harry Askham, Xavier Glorot, Balaji Lakshminarayanan, Trevor Back, Mustafa Suleyman, Pearse A. Keane, Olaf Ronneberger, Julien Robert Michel Cornebise
-
Patent number: 10198832Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating a final classification output for an image of eye tissue. The image is provided as input to each of one or more segmentation neural networks to obtain one or more segmentation maps of the eye tissue in the image. A respective classification input is generated from each of the segmentation maps. For each of the segmentation maps, the classification input for the segmentation map is provided as input to each of one or more classification neural networks to obtain, for each segmentation map, a respective classification output from each classification neural network. A final classification output for the image is generated from the respective classification outputs for each of the segmentation maps.Type: GrantFiled: June 28, 2018Date of Patent: February 5, 2019Inventors: Jeffrey De Fauw, Joseph R. Ledsam, Bernardino Romera-Paredes, Stanislav Nikolov, Nenad Tomasev, Samuel Blackwell, Harry Askham, Xavier Glorot, Balaji Lakshminarayanan, Trevor Back, Mustafa Suleyman, Pearse A. Keane, Olaf Ronneberger, Julien Robert Michel Cornebise
-
Publication number: 20190005684Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for generating a final classification output for an image of eye tissue. The image is provided as input to each of one or more segmentation neural networks to obtain one or more segmentation maps of the eye tissue in the image. A respective classification input is generated from each of the segmentation maps. For each of the segmentation maps, the classification input for the segmentation map is provided as input to each of one or more classification neural networks to obtain, for each segmentation map, a respective classification output from each classification neural network. A final classification output for the image is generated from the respective classification outputs for each of the segmentation maps.Type: ApplicationFiled: June 28, 2018Publication date: January 3, 2019Inventors: Jeffrey De Fauw, Joseph R. Ledsam, Bernardino Romera-Paredes, Stanislav Nikolov, Nenad Tomasev, Samuel Blackwell, Harry Askham, Xavier Glorot, Balaji Lakshminarayanan, Trevor Back, Mustafa Suleyman, Pearse A. Keane, Olaf Ronneberger, Julien Robert Michel Cornebise