Patents Assigned to Leica Biosystems Imaging, Inc.
  • Patent number: 11943537
    Abstract: A digital pathology scanning apparatus is configured to initiate a rescan of a portion of a sample responsive to detecting a mechanical vibration during image acquisition that exceeds a predetermined threshold. The digital pathology scanning apparatus includes a plurality of sensors and a processor that analyzes sensor data received during movement of a scanning stage supporting a sample during image acquisition. The processor is configured to identify a mechanical vibration imparted on the scanning stage during image acquisition and determine if the mechanical vibration exceeds a predetermined threshold. If the predetermined threshold is exceeded, the processor is configured to initiate a rescan of the portion of the sample being scanned at the time of the mechanical vibration.
    Type: Grant
    Filed: November 30, 2018
    Date of Patent: March 26, 2024
    Assignee: Leica Biosystems Imaging, Inc.
    Inventors: Nicholas Newberg, Prentash Djelosevic
  • Patent number: 11921125
    Abstract: A slide rack inventory and reinsertion system for use with a digital slide scanning apparatus is provided that determines, prior to scanning of glass slides in a slide rack, a status of each slot in the slide rack as properly occupied, improperly occupied, or empty. The system also determines whether a slide that has been removed from the slide rack for processing has been properly reinserted into the slide rack.
    Type: Grant
    Filed: January 10, 2022
    Date of Patent: March 5, 2024
    Assignee: LEICA BIOSYSTEMS IMAGING, INC.
    Inventors: Nicholas Newberg, Prentash Djelosevic, Aaron Stearrett, Peyman Najmabadi
  • Patent number: 11893732
    Abstract: A computer apparatus and method for identifying and visualizing tumors in a histological image and measuring a tumor margin are provided. A CNN is used to classify pixels in the image according to whether they are determined to relate to non-tumorous tissue, or one or more classes for tumorous tissue. Segmentation is carried out based on the CNN results to generate a mask that marks areas occupied by individual tumors. Summary statistics for each tumor are computed and supplied to a filter which edits the segmentation mask by filtering out tumors deemed to be insignificant. Optionally, the tumors that pass the filter may be ranked according to the summary statistics, for example in order of clinical relevance or by a sensible order of review for a pathologist. A visualization application can then display the histological image having regard to the segmentation mask, summary statistics and/or ranking. Tumor masses extracted by resection are painted with an ink to highlight its surface region.
    Type: Grant
    Filed: May 29, 2020
    Date of Patent: February 6, 2024
    Assignee: LEICA BIOSYSTEMS IMAGING, INC.
    Inventor: Walter Georgescu
  • Patent number: 11747900
    Abstract: Image viewing in digital pathology using eye-tracking. In an embodiment, a position of a user's gaze on a graphical user interface, comprising at least a portion of a digital slide image within a macro view, is repeatedly detected based on an output from an eye-tracking device. After detecting a change of the user's gaze from a first position to a second position on the graphical user interface, a view of the digital slide image within the macro view is automatically panned based on the second position, so as to move a position on the digital slide image that corresponds to the second position on the graphical user interface toward a center of the macro view.
    Type: Grant
    Filed: July 7, 2022
    Date of Patent: September 5, 2023
    Assignee: Leica Biosystems Imaging, Inc.
    Inventors: Allen Olson, Kiran Saligrama
  • Patent number: 11704003
    Abstract: Graphical user interface for managing a workflow of a slide scanning system. In an embodiment, the graphical user interface comprises a graphical representation of a carousel used by the scanning system. The graphical representation of the carousel comprises a graphical representation of each of a plurality of rack slots, configured to receive slide racks. The graphical representation of the carousel indicates a position of the carousel, and the graphical representation of each of the plurality of rack slots indicates a status of the represented rack slot and/or a slide rack within the represented rack slot.
    Type: Grant
    Filed: August 6, 2020
    Date of Patent: July 18, 2023
    Assignee: LEICA BIOSYSTEMS IMAGING, INC.
    Inventors: Timothy Dailey, Peyman Najmabadi, Nicholas Newberg, Paul Georgief, Lance Mikus, Prentash Djelosevic
  • Patent number: 11668725
    Abstract: A digital slide scanning apparatus slide rack carousel allows continuous loading and unloading of slide racks into the carousel while the digital slide scanning apparatus is simultaneously digitizing glass slides. The slide rack carousel includes a base having an interior portion of its upper surface at an angle. The slide rack carousel also includes plural rack spacers extending upward from the base and adjacent rack spacers define a rack slot. Each rack spacer also includes a rack stopper on each side such that adjacent rack spacers have rack stoppers facing each other. The rack stoppers prevent a slide rack from moving further toward the center of the carousel than desired.
    Type: Grant
    Filed: February 16, 2021
    Date of Patent: June 6, 2023
    Assignee: Leica Biosystems Imaging, Inc.
    Inventors: Nicholas Newberg, Prentash Djelosevic
  • Patent number: 11657370
    Abstract: Medical image based collaboration system and methods are provided. A collaboration server 40 creates a medical image based case in response to a request from a requesting system 10 and populates the case with the minimum required information comprising at least a digital medical image and a case number. The collaboration server 40 provides the medical image based case to a consulting system 30 and receives analysis information in response. The collaboration server 40 stores the analysis information in association with the medical image based case and provides the analysis information to the consulting system 30 to complete the medical image based collaboration.
    Type: Grant
    Filed: August 24, 2020
    Date of Patent: May 23, 2023
    Assignee: Leica Biosystems Imaging, Inc.
    Inventors: Dirk Soenksen, Mark Wrenn, Zoya Volynskaya
  • Patent number: 11614363
    Abstract: Color calibration for digital pathology is provided. A standard glass slide is prepared with a specimen having zero or more stains. The specimen is scanned a first time using a hyperspectral imaging system to produce a first digital image having XYZ color values. The specimen is scanned a second time using a digital pathology imaging system to produce a second digital image having RGB color values. The first and second digital images are then registered against each other to align the digital image data. Individual pixels of the first and second images may be combined in the registration process so that the first and second digital images have substantially similar pixel sizes. A lookup table is generated to associate XYZ color values to RGB color values. Once the lookup table has been generated, it can be used to present RGB color on a display using the corresponding XYZ color.
    Type: Grant
    Filed: October 30, 2020
    Date of Patent: March 28, 2023
    Assignee: Leica Biosystems Imaging, Inc.
    Inventor: Allen Olson
  • Patent number: 11604200
    Abstract: A power off delay system and method is configured to delay termination of electrical power to a digital pathology device in a power off condition. If the apparatus includes a UPS, the power off delay system and method delays termination of electrical power when a power switch is turned off and when a catastrophic power failure occurs. During the delay of the termination of electrical power, the digital pathology device is configured to control the scanning stage system and the glass slide conveyor system and the slide rack conveyor system to place each of these systems into a known state and position all glass slides into a known position prior to the termination of electrical power to the digital pathology device. This allows the digital pathology device to resume normal operation upon power up.
    Type: Grant
    Filed: July 20, 2022
    Date of Patent: March 14, 2023
    Assignee: LEICA BIOSYSTEMS IMAGING, INC.
    Inventors: Nicholas Newberg, Benjamin Siehl, Markus Wittmann, Markus Sharpe
  • Patent number: 11597612
    Abstract: A slide rack gripper apparatus is provided that simultaneously conveys a plurality of glass slides in the protection of a slide rack within a digital slide scanning apparatus. The slide rack gripper apparatus conveys the plurality of glass slides from a slide rack carousel to a scanning stage for processing. The slide rack gripper includes a first motor attached to a base configured to drive a finger mount attached to the base along a first linear axis. The slide rack gripper apparatus also includes a second motor attached to the finger mount and configured to drive opposing gripper fingers attached to the finger mount along a second linear axis. The second motor is also configured to drive individual gripper fingers along a third linear axis to move the gripper fingers toward each other and away from each other to grasp or release a slide rack.
    Type: Grant
    Filed: November 30, 2018
    Date of Patent: March 7, 2023
    Assignee: LEICA BIOSYSTEMS IMAGING, INC.
    Inventors: Nicholas Newberg, Prentash Djelosevic, David Rybka
  • Patent number: 11561232
    Abstract: A scanning stage with opposing edges to secure a slide during scanning and guide the slide during unloading. In an embodiment, the system includes a reference edge with a surface facing a first edge of the slide and an opposing edge with a surface facing a second edge of the slide. The opposing edge is controlled by a processor to engage the second edge of the slide and press the first edge of the slide against the reference edge surface. The opposing edge surface is parallel to a side of a slide rack slot into which the slide will be inserted during unloading. The system also includes an assembly having a pull bar configured to pull the glass slide from the scanning stage into the slide rack slot while the first edge of the slide is simultaneously being pressed against the reference edge surface by the opposing edge surface.
    Type: Grant
    Filed: October 4, 2018
    Date of Patent: January 24, 2023
    Assignee: Leica Biosystems Imaging, Inc.
    Inventor: Nicholas Newberg
  • Patent number: 11519925
    Abstract: A digital slide scanning apparatus includes a safety light curtain that operates to disable the motor that rotates the carousel when the presence of an object (e.g., the fingers of an operator) is detected within a predetermined area of the carousel. The light curtain also operates to disable the motor that rotates the carousel when an improperly positioned glass slide or slide rack is detected. The digital slide scanning apparatus also includes a multi-color status indicator for each rack slot that indicates the rack slot location of an improperly positioned glass slide or slide rack.
    Type: Grant
    Filed: January 15, 2021
    Date of Patent: December 6, 2022
    Assignee: Leica Biosystems Imaging, Inc.
    Inventor: Nicholas Newberg
  • Patent number: 11454781
    Abstract: A digital scanning apparatus is provided that includes imaging and focusing sensors and a processor to analyze the image data captured by the imaging and focusing sensors and adjust the focus of the scanning apparatus in real time during a scanning operation. The individual pixels of the imaging sensor are all in the same image plane with respect to the optical path of the digital scanning apparatus. The individual pixels of the focusing sensor are each in a different image plane with respect to the optical path, and one pixel of the focusing sensor is on the same image plane as the image sensor. The processor analyzes image data from the imaging sensor and the focusing sensor and determines a distance and direction to adjust the relative position of an objective lens and a stage of the digital scanning apparatus to achieve optimal focus during the scanning operation.
    Type: Grant
    Filed: October 30, 2020
    Date of Patent: September 27, 2022
    Assignee: Leica Biosystems Imaging, Inc.
    Inventors: Allen Olson, Kiran Saligrama, Yunlu Zou, Peyman Najmabadi
  • Patent number: 11449998
    Abstract: A convolutional neural network (CNN) is applied to identifying tumors in a histological image. The CNN has one channel assigned to each of a plurality of tissue classes that are to be identified, there being at least one class for each of non-tumorous and tumorous tissue types. Multi-stage convolution is performed on image patches extracted from the histological image followed by multi-stage transpose convolution to recover a layer matched in size to the input image patch. The output image patch thus has a one-to-one pixel-to-pixel correspondence with the input image patch such that each pixel in the output image patch has assigned to it one of the multiple available classes. The output image patches are then assembled into a probability map that can be co-rendered with the histological image either alongside it or over it as an overlay. The probability map can then be stored linked to the histological image.
    Type: Grant
    Filed: August 6, 2020
    Date of Patent: September 20, 2022
    Assignee: Leica Biosystems Imaging, Inc.
    Inventors: Walter Georgescu, Allen Olson, Bharat Annaldas, Darragh Lawler, Kevin Shields, Kiran Saligrama, Mark Gregson
  • Patent number: 11446670
    Abstract: A digital slide scanning apparatus slide stage is configured to hold 1×3 and 2×3 glass slides. The slide stage is configured to alter its position by lateral shift or rotation to present the 1×3 or 2×3 sized recess to a slide rack for loading of the slide onto the stage. Also, a removable insert may configure the stage to hold a 1×3 glass slide when present and to hold a 2×3 glass slide when removed. Alternatively, a gripper stage is described herein that includes a fixed arm and a movable arm, each with one or more contact points configured to engage a side surface of the glass slide. Once the glass slide is secured between the contact points of the movable arm and the contact points of the fixed arm, the slide is further processed for scanning.
    Type: Grant
    Filed: August 17, 2018
    Date of Patent: September 20, 2022
    Assignee: Leica Biosystems Imaging, Inc.
    Inventors: Nick Newberg, Prentash Djelosevic
  • Patent number: 11445081
    Abstract: A slide rack determination system for a digital slide scanning apparatus. In an embodiment, a motor drives a slide rack at a known rate toward an engagement surface. The elapsed time until engagement may be used to detect the presence or absence of the slide rack and/or the height of the slide rack. In addition, one or more sensors may detect one or more features of the slide rack, and these feature(s) may be used to determine the presence or absence of a slide rack, whether usage of the slide rack is supported or unsupported by the digital slide scanning apparatus, the orientation of the slide rack, and/or the manufacturer and/or model of the slide rack.
    Type: Grant
    Filed: July 20, 2020
    Date of Patent: September 13, 2022
    Assignee: Leica Biosystems Imaging, Inc.
    Inventors: Nicholas Newberg, Prentash Djelosevic
  • Patent number: 11434082
    Abstract: A stuck slide determination system is provided that determines if a slide (e.g., glass slide), positioned on a scanning stage at the start of the scanning process, gets stuck and does not move along with the scanning stage after the scanning process commences. In an embodiment, the system includes a sensor having a transmitter and receiver that are relatively positioned to detect the presence of the stage or a slide or the absence of the stage or a slide. When the scanning stage begins to move at the start of the scanning process, a processor monitors a signal from the sensor and determines if the slide is improperly positioned after the scanning process has commenced. If the slide is improperly positioned, the processor stops movement of the scanning stage in order to protect the slide from damage.
    Type: Grant
    Filed: May 18, 2020
    Date of Patent: September 6, 2022
    Assignee: Leica Biosystems Imaging, Inc.
    Inventors: Nicholas Newberg, Prentash Djelosevic, Aaron Stearrett, Peyman Najmabadi
  • Patent number: 11422349
    Abstract: A digital slide scanning apparatus that includes a scanning stage, a focusing sensor, an imaging sensor, and at least two processors. A main processor is configured to control the scanning stage to move a sample relative to the focusing sensor and the imaging sensor. The main processor controls the secondary processor to process focus buffers generated by the focusing sensor and image buffers generated by the imaging sensor. The secondary processor access each buffer and processes the data in the buffer to generate an average contrast vector for the buffer. The average contrast vectors for the focus and image buffers are then provided to the main processor for further processing in connection with autofocus and/or generation of a digital slide image.
    Type: Grant
    Filed: November 28, 2018
    Date of Patent: August 23, 2022
    Assignee: Leica Biosystems Imaging, Inc.
    Inventor: Timothy Dailey
  • Patent number: 11422351
    Abstract: Real-time autofocus. In an embodiment, a scanning apparatus includes an imaging sensor, a focusing sensor, an objective lens, and processor(s) configured to analyze image data captured by the imaging and focusing sensors, and move the objective lens. Real-time autofocus during scanning of a sample is achieved by determining a true-Z value for the objective lens for a point on a sample and for each of a plurality of regions on the sample. The true-Z values and/or surfaces calculated therefrom are used to determine a predicted-Z value for an unscanned region of the sample. The objective lens is adjusted to the predicted-Z value at the beginning of the unscanned region. After scanning the region, a true-Z value is determined for the region and compared to the predicted-Z value. A rescan of the region is initiated if the comparison exceeds a predetermined threshold.
    Type: Grant
    Filed: November 25, 2020
    Date of Patent: August 23, 2022
    Assignee: Leica Biosystems Imaging, Inc.
    Inventors: Leng-Chun Chen, Allen Olson, Yunlu Zou, Peyman Najmabadi, Greg Crandall
  • Patent number: 11422350
    Abstract: System for acquiring a digital image of a sample on a microscope slide. In an embodiment, the system comprises a stage configured to support a sample, an objective lens having a single optical axis that is orthogonal to the stage, an imaging sensor, and a focusing sensor. The system further comprises at least one beam splitter optically coupled to the objective lens and configured to receive a field of view corresponding to the optical axis of the objective lens, and simultaneously provide at least a first portion of the field of view to the imaging sensor and at least a second portion of the field of view to the focusing sensor. The focusing sensor may simultaneously acquire image(s) at a plurality of different focal distances and/or simultaneously acquire a pair of mirrored images, each comprising pixels acquired at a plurality of different focal distances.
    Type: Grant
    Filed: March 13, 2020
    Date of Patent: August 23, 2022
    Assignee: Leica Biosystems Imaging, Inc.
    Inventors: Yunlu Zou, Allen Olson, Kiran Saligrama, Ruby Chen, Peyman Najmabadi, Greg Crandall