Method and system for determining area to be scanned in peripheral blood smear for analysis
Disclosed subject matter relates to Peripheral Blood Smear (PBS) that determines an area to be scanned in PBS for analysis. A PBS analysing system captures a focused image at each of plurality of positions in the PBS and determines Quality Indicators (QIs) in focused image. Further, a region is identified in PBS where QIs of focused image satisfy predefined QI threshold limits, as a monolayer region of PBS and determines an initiation point in monolayer region based on cell count value and co-ordinates of each of the plurality of positions located in the monolayer region. Finally, the area to be scanned in monolayer region is determined based on the initiation point and a predefined scan pattern. Determining the area to be scanned yields accurate and faster results.
Latest Sigtuple Technologies Private Limited Patents:
- Method and system for auto focusing a microscopic imaging system
- Method and system for reconstructing a field of view
- METHOD AND SYSTEM FOR AUTO FOCUSING A MICROSCOPIC IMAGING SYSTEM
- Method and system for determining total count of red blood cells in peripheral blood smear
- METHOD AND SYSTEM FOR DETERMINING TOTAL COUNT OF RED BLOOD CELLS IN PERIPHERAL BLOOD SMEAR
This application is the U.S. national stage of PCT Application No. PCT/IB2018/053388, filed May 15, 2018, which claims priority to and the benefit of Indian Application No. 201741014502, filed May 15, 2017, the contents of which are incorporated herein by reference in their entireties.
The following specification particularly describes the invention and the manner in which it is to be performed.
TECHNICAL FIELDThe present subject matter relates generally to a Peripheral Blood Smear (PBS), and more particularly, but not exclusively to a method and a system for determining an area to be scanned in the PBS for analysis.
BACKGROUNDGenerally, Peripheral Blood Smear (PBS) is considered to be a golden standard for detecting several haematological disorders. Analysis of PBS helps in providing a count of different types of cells such as Red Blood Cells (RBCs), White Blood Cells (WBCs), platelets and the like. Also, the analysis of PBS helps in observing morphological abnormalities of the cells. However, an entire area of PBS would not be appropriate for accurately analyzing the cells. Therefore, detecting an area in the PBS that provides a clear visualization of the cells for analysis is of utmost importance.
Former techniques involve manually locating the desirable area in the PBS for analysis. However, manually locating the desirable area in the PBS is a laborious task and also error prone. Therefore, next set of techniques focused on automating the process of locating the desirable area and scanning the cells in the desirable area, with a vision of enhancing reproducibility of results and reducing cost involved in analysis. The existing systems capture images of the PBS and analyze the images to perform automated analysis. However, systems implementing the existing techniques are very limited due to high cost of adoption, thereby negatively affecting availability of the systems for analysis.
Further, the existing techniques perform a two stage scanning process for obtaining the images of the cells from the desired area in the PBS. First stage may comprise utilizing a low magnification lens to locate the objects of interest in the PBS and the second stage may include thorough scanning of the identified locations in the PBS using a high magnification lens. The two stage scanning process for locating and analyzing the cells in the PBS is extremely time consuming, thereby increasing Turn Around Time (TAT) of analysis. Also, some of the existing techniques perform oil immersion based scanning (i.e. slides are prepared with oil immersion techniques to achieve best refraction under high magnification). However, oil immersion adds an extra tedious task to automated scanning process that increases the TAT and also may lead to inaccurate results or damage of lens, if not maintained properly.
Furthermore, the existing techniques are applicable for automatically generated PBS and may not work with manually prepared PBS.
The information disclosed in this background of the disclosure section is only for enhancement of understanding of the general background of the disclosure and should not be taken as an acknowledgement or any form of suggestion that this information forms prior art already known to a person skilled in the art
SUMMARYOne or more shortcomings of the prior art may be overcome, and additional advantages may be provided through the present disclosure. Additional features and advantages may be realized through the techniques of the present disclosure. Other embodiments and aspects of the disclosure are described in detail herein and are considered a part of the claimed disclosure.
Disclosed herein is a method for determining an area to be scanned in a Peripheral Blood Smear (PBS) for analysis. The method includes capturing, by a PBS analyzing system, a focused image at each of a plurality of positions in the PBS. Further, the PBS analyzing system determines Quality Indicators (QIs) in the focused image. The QIs comprise a cell count value, a normalized sharpness value and an average intensity value. Upon determining the QIs, the PBS analyzing system identifies a region in the PBS where the QIs of the focused image satisfy predefined QI threshold limits, as a monolayer region of the PBS. Further, the PBS analyzing system determines an initiation point in the monolayer region based on the cell count value determined in the focused image captured at each of the plurality of positions located in the monolayer region and co-ordinates of each of the plurality of positions located in the monolayer region. Finally, the PBS analyzing system determines the area to be scanned in the monolayer region based on the initiation point and a predefined scan pattern selected for scanning the area.
Further, the present disclosure includes a Peripheral Blood Smear (PBS) analyzing system for determining an area to be scanned in a PBS for analysis. The PBS analyzing system includes a processor and a memory communicatively coupled to the processor. The memory stores the processor-executable instructions, which, on execution, causes the processor to capture a focused image at each of plurality of positions in the PBS. Further, the processor determines Quality Indicators (QIs) in the focused image. The QIs comprise a cell count value, a normalized sharpness value and an average intensity value. Upon determining the QIs, the processor identifies a region in the PBS where the QIs of the focused image satisfy predefined QI threshold limits, as a monolayer region of the PBS. Further, the processor determines an initiation point in the monolayer region based on the cell count value determined in the focused image captured at each of the plurality of positions located in the monolayer region and co-ordinates of each of the plurality of positions located in the monolayer region. Finally, the processor determines the area to be scanned in the monolayer region based on the initiation point and a predefined scan pattern selected for scanning the area.
The foregoing summary is illustrative only and is not intended to be in any way limiting. In addition to the illustrative aspects, embodiments, and features described above, further aspects, embodiments, and features will become apparent by reference to the drawings and the following detailed description.
The accompanying drawings, which are incorporated in and constitute a part of this disclosure, illustrate exemplary embodiments and, together with the description, serve to explain the disclosed principles. In the figures, the left-most digit(s) of a reference number identifies the figure in which the reference number first appears. The same numbers are used throughout the figures to reference like features and components. Some embodiments of system and/or methods in accordance with embodiments of the present subject matter are now described, by way of example only, and with reference to the accompanying figures, in which:
It should be appreciated by those skilled in the art that any block diagrams herein represent conceptual views of illustrative systems embodying the principles of the present subject matter. Similarly, it will be appreciated that any flow charts, flow diagrams, state transition diagrams, pseudo code, and the like represent various processes which may be substantially represented in computer readable medium and executed by a computer or processor, whether or not such computer or processor is explicitly shown.
DETAILED DESCRIPTIONIn the present document, the word “exemplary” is used herein to mean “serving as an example, instance, or illustration.” Any embodiment or implementation of the present subject matter described herein as “exemplary” is not necessarily to be construed as preferred or advantageous over other embodiments.
While the disclosure is susceptible to various modifications and alternative forms, specific embodiment thereof has been shown by way of example in the drawings and will be described in detail below. It should be understood, however that it is not intended to limit the disclosure to the forms disclosed, but on the contrary, the disclosure is to cover all modifications, equivalents, and alternative falling within the scope of the disclosure.
The terms “comprises”, “comprising”, “includes” or any other variations thereof, are intended to cover a non-exclusive inclusion, such that a setup, device or method that includes a list of components or steps does not include only those components or steps but may include other components or steps not expressly listed or inherent to such setup or device or method. In other words, one or more elements in a system or apparatus proceeded by “comprises . . . a” does not, without more constraints, preclude the existence of other elements or additional elements in the system or method.
Disclosed herein are a method and a system for determining an area to be scanned in a Peripheral Blood Smear (PBS) for analysis. A PBS analyzing system initially comprises a calibration phase to determine the area to be scanned in the PBS. Upon determining the area to be scanned, the PBS analyzing system comprises a scanning phase to scan the area. In some embodiments, in the calibration phase, the PBS analyzing system may capture a focused image at each of plurality of positions in the PBS. In some embodiments, the PBS analyzing system may capture the focused image using an image capturing device associated with the PBS analyzing system. Further, the PBS analyzing system may determine Quality Indicators (QIs) in the focused image. As an example, the QIs may include, but not limited to, a cell count value, a normalized sharpness value, an average intensity value, a sharpness value, a density value and Red Blood Cells (RBC) count ratio. Upon determining the QIs, the PBS analyzing system may identify a region in the PBS where the QIs of the focused image satisfy predefined QI threshold limits, as a monolayer region of the PBS. Finally, the PBS analyzing system may determine an initiation point in the monolayer region. In some embodiments, the initiation point may be determined based on the cell count value determined in the focused image captured at each of the plurality of positions located in the monolayer region and co-ordinates of each of the plurality of positions located in the monolayer region. Upon determining the initiation point, the PBS analyzing system may determine the area to be scanned based on the initiation point and a predefined scan pattern. Upon determining the area to be scanned, the PBS analyzing system may scan the area in the predefined scan pattern around the initiation point. In some embodiments, the PBS analyzing system may scan the area until at least one of, exhaustion of the area or desired number of Field Of Views (FOVs) in the area that satisfy analysis criteria of the PBS are attained. In some embodiments, the analysis criteria may be application specific. As an example, if the application demands a Complete Blood Count (CBC) report, then the analysis criteria may be obtaining CBC.
In the present disclosure, determining the area to be scanned within the monolayer region of the PBS, yields accurate and fast results during analysis. Also, scanning the determined area from the initiation point may enable achieving accurate and fast results in less than 120 FOVs. Further, the present disclosure discloses a feature wherein a single high magnification lens is used to identify the area to be scanned and for further scanning the area, thereby reducing enormous amount of time that is spent by the existing techniques in performing a two stage scanning process using two different magnification lenses.
A description of an embodiment with several components in communication with each other does not imply that all such components are required. On the contrary a variety of optional components are described to illustrate the wide variety of possible embodiments of the disclosure.
In the following detailed description of the embodiments of the disclosure, reference is made to the accompanying drawings that form a part hereof, and in which are shown by way of illustration specific embodiments in which the disclosure may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the disclosure, and it is to be understood that other embodiments may be utilized and that changes may be made without departing from the scope of the present disclosure. The following description is, therefore, not to be taken in a limiting sense.
The architecture 100 includes a slide 101, an image capturing device 103 and a Peripheral Blood Smear (PBS) analyzing system 107. In some embodiments, standard size of the slide 101 may be 25 mm×75 mm with minor variations. In some other embodiments, the present disclosure works with slides of variable thickness. Further, the image capturing device 103 may be associated with the PBS analyzing system 107 to capture images of object of interest on the slide 101. As an example, the image capturing device 103 may be a camera, a smart phone, a tablet and the like. Further, the PBS analyzing system 107 may be configured in an automatic slide scanner 120 as shown in the
The automatic slide scanner 120 may include, but not limited to, a slide stage 123, X-axis mechanism 125, Y-axis mechanism 127, a Z-axis mechanism 129, an optics module 131, an illumination unit 132, a motherboard 133 and a camera module 135. The slide stage 123 is a component of the automatic slide scanner 120 that provides a surface for placing the slide 101 to be examined. Further, the X-axis mechanism 125 may enable movement of the slide stage 123 along X-axis, the Y-axis mechanism 127 may enable movement of the slide stage 123 along Y-axis and the Z-axis mechanism 129 may enable movement of the slide stage 123 along Z-axis. The optics module 131 may include an eyepiece and a high magnification lens configured to focus on the slide 101 placed on the slide stage 123. In the present disclosure, the optics module 131 may be in a fixed position, however, the slide stage 123 may move along X-axis, Y-axis and Z-axis, thereby enabling the optics module 131 to focus any desired part of the slide 101 placed on the slide stage 123. Further, the illumination unit 132 may be configured below the optics module 131 as shown in the
Referring back to
In some embodiments, the monolayer region 143 is a region of the PBS 102 where the blood cells are either well separated or barely in contact with one another. The monolayer region 143 may start at the end of the thick region 141 as shown in the
In some embodiments, the feathered edge region 145 is a region of the PBS 102 that lies at end of the PBS 102 as shown in the
Further, the PBS analyzing system 107 may include a processor 109, an Input/Output (I/O) interface 111 and a memory 113. The I/O interface 111 may be configured to receive images captured by the image capturing device 103. The images received from the image capturing device may be stored in the memory 113. In some embodiments, the processor 109 may initially mark plurality of positions starting from a predefined reference point, till end of the PBS 102. As an example, the predefined reference point may be a centre point along the shorter edge of the slide 101. In some embodiments, the processor 109 may separate each of the plurality of positions by a predefined distance till the end of the PBS 102. Further, the processor 109 may capture a focused image at each of plurality of positions in the PBS 102, using the image capturing device 105. In some embodiments, the focused image is an image corresponding to sharpest focus attainable at the corresponding position. In some embodiments, the processor 109 may capture the focused image using a predefined focusing technique. As an example, the predefined focusing technique may be a full z-stack focusing technique.
Further, the processor 109 may determine Quality Indicators (QIs) in the focused image captured at each of the plurality of positions. In some embodiments, the QIs may include, but not limited to, a cell count value, a normalized sharpness value and an average intensity value, a sharpness value, a density value and Red Blood Cells (RBC) count ratio. Upon determining the QIs in the focused image captured at each of the plurality of positions, the processor 109 may compare the QIs with predefined QI threshold limits. The processor 109 may identify a region of the PBS 102 where the QIs of the focused image satisfied the predefined QI threshold limits as the monolayer region 143 of the PBS 102. Further, the processor 109 may determine an initiation point in the monolayer region 143 based on the cell count value determined in the focused image captured at each of the plurality of positions located in the monolayer region 143 and co-ordinates of each of the plurality of positions located in the monolayer region 143. Upon determining the initiation point, the processor 109 may determine the area to be scanned based on the initiation point and a predefined scan pattern. As an example, the predefined scan pattern may include, but not limited to, a spiral scan pattern and a columnar scan pattern.
Upon determining the area to be scanned, the processor 109 may scan the area in the predefined scan pattern around the initiation point. In some embodiments, the initiation point may mark a starting position of the scanning process. In some embodiments, the processor 109 may scan the area until at least one of, exhaustion of the area or desired number of Field Of Views (FOVs) in the area that satisfy analysis criteria of the PBS 102 are attained.
In some implementations, the PBS analyzing system 107 may include data 203 and modules 205. As an example, the data 203 is stored in a memory 113 configured in the PBS analyzing system 107 as shown in the
In some embodiments, the data 203 may be stored in the memory 113 in form of various data structures. Additionally, the data 203 can be organized using data models, such as relational or hierarchical data models. The other data 219 may store data, including temporary data and temporary files, generated by the modules 205 for performing the various functions of the PBS analyzing system 107.
In some embodiments, the data 203 stored in the memory 113 may be processed by the modules 205 of the PBS analyzing system 107. The modules 205 may be stored within the memory 113. In an example, the modules 205 communicatively coupled to the processor 109 configured in the PBS analyzing system 107, may also be present outside the memory 113 as shown in
In some embodiments, the modules 205 may include, for example, a focusing module 231, a graph plotting module 233, a QI determining module 235, an area determining module 237, a scanning module 239 and other modules 241. The other modules 241 may be used to perform various miscellaneous functionalities of the PBS analyzing system 107. It will be appreciated that such aforementioned modules 205 may be represented as a single module or a combination of different modules.
In some embodiments, the focusing module 231 may capture a focused image of a PBS 102 contained on a slide 101, using an image capturing device 103 associated with the PBS analyzing system 107. In some embodiments, the PBS 102 may be either automatically generated PBS 102 using automatic smearers or a manually created PBS 102 using standard operating procedures of laboratories. Initially, the focusing module 231 may move a slide stage 123 holding the slide 101 to a homing Z position 232a as shown in the
Further, at each of the plurality of positions, the focusing module 231 may capture the focused image of the PBS 102 using a predefined focusing technique. As an example, the predefined focusing technique may be a full z-stack focusing technique. In some embodiments, to capture the focused image, the focusing module 231 may initially move the slide stage 123, from the homing Z position, along a Z-axis by selecting focus steps (i.e. varying height of the slide stage 123 by selecting the focus steps). In some embodiments, the focus step is a distance covered by the slide stage 123 (i.e. increase in height of the slide stage 123 from the homing Z position). Each focus step may cover minimum distance or short distance such that, the focusing module 231 does not miss sharpest focus corresponding to each of the plurality of positions. With each focus step, the slide stage 123 moves upwards along Z-axis, thereby increasing sharpness value at each focus step. As the slide stage 123 moves upwards, at one focus step, the sharpness value may drop to a value lower than the sharpness value at previous focus step. The focusing module 231 may identify the previous focus step as the focus step corresponding to sharpest focus (i.e. the focus step corresponding to highest sharpness value for the corresponding position). Further, the focusing module 231 may move the slide stage 123 backward to the focus step corresponding to the sharpest focus and capture the focused image. The focused image and the focus step corresponding to the sharpest focus for each of the plurality of positions may be stored as the focus data 207.
In some embodiments, the graph plotting module 233 may plot a bell-curve graph indicating the focus steps taken for each of the plurality of positions and the corresponding sharpness value at each focus step of the plurality of positions, when the focused image is captured. An exemplary bell-curve graph is as shown in the
Further, the Quality Indicator (QI) determining module 235 may determine QIs in the focused image captured at each of the plurality of positions. In some embodiments, the QIs may include, but not limited to, a cell count value, a normalized sharpness value and an average intensity value, a sharpness value, a density value and Red Blood Cells (RBC) count ratio as illustrated below. The QIs determined for each focused image may be stored as the QI data 211.
Sharpness value: Sharpness value may be defined as magnitude of gradients in the FOV. The QI determining module 235 may determine the sharpness value by computing an L2-norm of an image after applying a Sobel operator on a green channel of the image. Typically, a blur image may be considered to have a lower sharpness value, while a focused image may be considered to have a larger sharpness value. In some embodiments, absolute value of sharpness may not depend only on degree of focus, but also on the number of objects present in the image. Therefore, two equally focused images may have different sharpness values.
-
- Predefined QI threshold limit: Since a low sharpness value indicates a blurred image, or an image with very few visible blood cells, a lower limit may be defined for the sharpness value to accept an image as belonging to a monolayer region 143.
Average Intensity value: The QI determining module 235 may compute an average pixel value of the green channel for every image. An empty area (i.e. region comprising no blood cells or a very sparse region of the slide 101) may have a high average intensity value, since the background would be bright. On the contrary, regions having more blood cells or a dense region may have a low average intensity value, since foreground is darker than the background. The average intensity value may be used as an indicator to estimate sparsity of the blood cells in the FOV.
-
- Predefined QI threshold limit: Since a low average intensity value indicates a dense region, or a region with more visible blood cells, an upper limit may be defined for the average intensity value to accept an image as belonging to a monolayer region 143.
Density value: Density may be defined as ratio of the foreground area (i.e. the area comprising blood cells), to the total area in the FOV. To compute the foreground area, the QI determining module 235 may first apply Otsu's threshold on the green channel of the image. Number of pixels in the foreground corresponding to the Otsu's threshold is taken as the foreground area.
-
- Predefined QI threshold limit: The ratio of foreground area to the total area is a rough indicator of the number of blood cells present in the image. A low value of density indicates very few blood cells. Thus, a lower threshold may be set on the density value. A high density value can indicate clumped cells, but that scenario may be handled by the other QIs.
Cell Count Value/RBC count value: The QI determining module 235 may use the cell count value in combination with the density value to quantify number of RBCs in the FOV. The QI determining module 235 may compute the cell count value as the number of blood cells present in the foreground, having a size within range of sizes of the RBCs. In some embodiments, the range of sizes of the RBCs may be between 3 μm and 10 μm in diameter. The QI determining module 235 may determine the number of blood cells using standard connected components analysis technique with 8-connectivity.
-
- Predefined QI threshold limit: For the image that has passed the predefined QI threshold limit of the density value, the cell count value will be high if the blood cells are well separated. On the contrary, if the blood cells are clumped, then majority of the blood cells would fall beyond the range of the sizes of the RBCs, and may not be counted. Therefore, the monolayer region 143 should have a relatively high RBC count, whereas as sparse region (feather edge region 145) or the clumped region (thick region 141) should have a lower RBC count than the monolayer region 143. Therefore, a low threshold limit may be set for the cell count value.
RBC count ratio: RBC count ratio is an extension of the cell count value, and may be quantified as the percentage of the blood cells in the foreground that are of the size of the RBC. The thick region 141 of the PBS generally have RBCs overlapping with each other, thereby leading to the blood cells having larger size than the size of the RBC. Therefore, an image from the thick region 141 may have a lower value of RBC count ratio.
-
- Predefined QI threshold limit: For the thick region 141 with a high number of blood cells, sufficient well separated RBCs to satisfy the predefined QI threshold limit of the cell count value may be present. However, the majority of the blood cells would still be clumped, and thus the image may not be an acceptable image. In such scenarios, the image can have a high RBC count, but would still have a low RBC count ratio. Therefore, a lower limit is set on the RBC count ratio.
Normalized sharpness value: The QI determining module 235 may determine the normalized sharpness value using the below Equation 1.
Normalized Sharpness value=S*(1−D) Equation 1
In the above Equation 1,
-
- S indicates sharpness value; and
- D indicates density value.
In cases where the cell count value is low, the sharpness and density both tend to be proportionally low, hence normalized sharpness value is computed as a variant of the sharpness value.
-
- Predefined QI threshold limit: A lower limit is set on the normalized sharpness.
In some embodiments, the QI determining module 235 may select predefined number of non-overlapping regions in each focused image. As an example, the predefined number of non-overlapping regions may be 5. The QI determining module 235 may determine the QIs in each of the predefined number of non-overlapping regions in each focused image. When the QIs of at least more than half of the predefined number of non-overlapping regions satisfy the predefined QI threshold limits, the QI determining module 235 may confirm that the position corresponding to the focused image belongs to the monolayer region 143. As an example, when QIs of at least 3 regions out of the 5 non-overlapping regions satisfy the predefined QI threshold limits, the position corresponding to the focused image is said to be belonging to the monolayer region 143. The QI determining module 235 may identify a stretch of the plurality of positions in the PBS 102 corresponding to the focused images whose QIs satisfied the predefined QI threshold limits, as the monolayer region 143.
In some embodiments, the QI determining module 235 may store the following tuple for each focused image captured at each of the plurality of positions in the QI data 211.
-
- (Xi, Yi, Zi, fi, Si, Ii, Qi), wherein i denotes a position value in terms of 1 . . . N
In the above tuple,
-
- Xi, indicates X co-ordinate of the ith position;
- Yi, indicates Y co-ordinate of the ith position;
- Zi, indicates Z co-ordinate of the ith position at which the sharpest focus was attained;
- fi, indicates a FOV flag that indicates whether the FOV of the focused image belongs to the monolayer region. In some embodiments, fi, =1 may denote “Yes” the FOV belongs to the monolayer region and fi, =0 may denote “No” the FOV does not belong to the monolayer region;
- Si, indicates maximum sharpness value at the ith position;
- Ii, indicates average intensity value at the ith position; and
- Qi indicates a sub-tuple comprising the determined QIs at the ith position.
Further, the QI determining module 235 may construct a table comprising Si and Ii of the plurality of positions and store the table in the QI data 211.
Further, the area determining module 237 may determine an area to be scanned in the monolayer region 143. In some embodiments, the area determining module 237 may determine an initiation point in the monolayer region 143 based on the cell count value determined in the focused image captured at each of the plurality of positions located in the monolayer region 143 and co-ordinates of each of the plurality of positions located in the monolayer region 143. In some embodiments, determining the initiation point may include determining a weighted average of “Y” co-ordinate value of each of the plurality of positions present in the monolayer region 143 using the below Equation 2.
In the above Equation 2,
-
- wi indicates the cell count value at the ith position; and
- Yi indicates “Y” co-ordinate value at the ith position.
Further, the area determining module 237 may determine the area to be scanned in the monolayer region 143 based on the initiation point and a predefined scan pattern. To determine the area to be scanned, initially, the area determining module 237 may select the predefined scan pattern for scanning the area. As an example, the predefined scan pattern may include, but not limited to, a spiral scan pattern and a columnar scan pattern. The
The area determining module 237 may store the initiation point, the plurality of X-Y positions and the determined area to be scanned as the scannable area data 213.
Further, the scanning module 239 may scan the area, starting from the initiation point in the predefined scan pattern. An exemplary initiation point 240 is shown in the
Further, the scanning module 239 may perform an iterative curve based focusing for each subsequent position (X-Y position) along the predefined scan pattern. For the current position, a Z co-ordinate corresponding to the sharpest focus in the previous position is considered as a first Z co-ordinate for the current position. Therefore, the scanning module 239 may not begin from the homing Z position for the subsequent positions. Upon determining the first Z co-ordinate for the current position, the scanning module 239 may identify the bell-curve graph matching the average intensity value and the sharpness value determined at the current position. Further, the scanning module 239 may determine a direction for moving along the Z-axis from the first Z co-ordinate.
In some embodiments, the scanning module 239 may select the direction for moving along the Z-axis based on two conditions:
-
- If only one previous Z co-ordinate corresponding to the sharpest focus is determined, then the scanning module 239 may determine the direction of the movement to be upward (i.e. Z co-ordinate value is increased).
- Consider Z co-ordinates corresponding to the sharpest focus of two FOVs, Z1 and Z2 are determined, wherein Z1 corresponds to the most recent FOV. In such scenarios, the direction of the movement along the Z-axis is determined to be upward when Z1>Z2. On the contrary, if Z2>Z1, then the direction of the movement along the Z-axis is determined to be downward.
Upon selecting the direction of the movement, the scanning module 239 may determine step size of the focus steps for the movement along Z-axis, based on adaptive step-size technique. Since, the bell-curve graph corresponding to the current position is already identified, the scanning module 239 would infer that the sharpest focus corresponding to the current position may be proximal to peak of the identified bell-curve graph. Therefore, the scanning module 239 may determine the step size of the focus steps based on the peak of the identified bell-curve graph and width of the identified bell-curve graph. In some embodiments, when the width of the bell-curve graph is broad, the step size may be large. In some embodiments, when the width of the bell-curve graph is narrow, the step size may be small.
Upon determining the step size of the focus steps, the scanning module 239 may move two steps of the determined step size, along the selected direction and check for the following conditions:
-
- If the sharpness value increases in at least one step, the scanning module 239 may continue along the same direction.
- If the sharpness value increases at one step and decreases at another step, the scanning module 239 may still continue along the same direction, by inferring that the sharpness value may have decreased due to occurrence of noise.
- If the sharpness value decreases at each of the two steps, the scanning module 239 may reverse the direction of the movement along Z-axis, from the selected direction, by inferring that the peak of the bell-curve graph has been crossed.
- In some embodiments, even upon reversing the direction of the movement along Z-axis, if the sharpness value does not increase in either directions, the scanning module 239 may have focused an empty region that does not comprise any blood cells. Alternatively, the sharpness value may not increase in either directions when the scanning module 239 focuses at a region comprising a sudden steep variation in thickness of the slide 101. The scanning module 239 may confirm the occurrence of the first case, (i.e. focusing an empty region), when the average intensity of the FOV is higher than the predefined QI threshold limit, and may move to a new FOV. The scanning module 239 may confirm the occurrence of the second case, (i.e. sudden steep variation in thickness), when the average intensity of the FOV is below the predefined QI threshold limit, and may refocus the FOV by performing full z-stack focusing technique.
Further, the scanning module 239 may increase the focus steps based on the determined step-size in the decided direction. At one position, the scanning module 239 may detect that the sharpness value decreased from the sharpness value at previous Z position. In such scenarios, the scanning module 239 may perform a predefined technique such as binary search between the previous Z position and the current Z position to locate the sharpest focus of the current X-Y position. The scanning module 239 may capture the image corresponding to the sharpest focus and move to the subsequent X-Y position along the predefined scan pattern.
In some embodiments, the scanning module 239 may continue to scan the area until at least one of, exhaustion of the area or desired number of FOVs in the area that satisfy analysis criteria of the PBS 102 are attained. In some embodiments, the desired number of FOVs may be user defined. As an example, optimal number of FOVs to be captured may be 120 and minimum number of FOVs to be captured may be 80. However, maximum number of FOVs to be captured, may vary based on requirement of user. The images captured by the image capturing device 103 in the area to be scanned, may be stored as the scanned image data 215.
In some embodiments, while reversing direction of the slide stage 123, the slide stage 123 may not travel to a requested Z position due to backlash. Backlash values have been analysed and pre-generated by experimentation for a range of possible step sizes. While reversing direction of the slide stage 123, the processor 109 may estimate a backlash offset and add the backlash offset to the requested Z position, thereby achieving the required movement.
As illustrated in
The order in which the method 300 is described is not intended to be construed as a limitation, and any number of the described method blocks can be combined in any order to implement the method 300. Additionally, individual blocks may be deleted from the methods without departing from the spirit and scope of the subject matter described herein. Furthermore, the method 300 can be implemented in any suitable hardware, software, firmware, or combination thereof.
At block 301, the method 300 may include capturing, by a processor 109 of the PBS analyzing system 107, a focused image at each of plurality of positions in the PBS 102. In some embodiments, each of the plurality of positions may be marked from a predefined reference point and separate by a predefined distance.
At block 303, the method 300 may include determining, by the processor 109, Quality Indicators (QIs) in the focused image. The QIs may include, but not limited to, a cell count value, a normalized sharpness value, an average intensity value, a sharpness value, a density value and Red Blood Cells (RBC) count ratio. In some embodiments, the processor 109 may determine the QIs in predefined number of non-overlapping regions selected in the focused image.
At block 305, the method 300 may include, identifying, by the processor 109 a region in the PBS 102 where the QIs of the focused image satisfy predefined QI threshold limits, as a monolayer region 143 of the PBS 102.
At block 307, the method 300 may include, determining, by the processor 109, the initiation point in the monolayer region 143 based on the cell count value determined in the focused image captured at each of the plurality of positions located in the monolayer region 143 and co-ordinates of each of the plurality of positions located in the monolayer region 143.
At block 309, the method 300 may include, determining, by the processor 109, the area to be scanned in the monolayer region 143. In some embodiments, the processor 109 may determine the area to be scanned based on the initiation point and a predefined scan pattern selected by the processor 109 to scan the area. Further, upon determining the area to be scanned, the processor 109 may scan the area, starting from the initiation point, in the predefined scan pattern.
In some embodiments,
The processor 402 may be disposed in communication with input devices 411 and output devices 412 via I/O interface 401. The I/O interface 401 may employ communication protocols/methods such as, without limitation, audio, analog, digital, stereo, IEEE-1394, serial bus, Universal Serial Bus (USB), infrared, PS/2, BNC, coaxial, component, composite, Digital Visual Interface (DVI), high-definition multimedia interface (HDMI), Radio Frequency (RF) antennas, S-Video, Video Graphics Array (VGA), IEEE 802.n /b/g/n/x, BLUETOOTH®, cellular (e.g., Code-Division Multiple Access (CDMA), High-Speed Packet Access (HSPA+), Global System For Mobile Communications (GSM), Long-Term Evolution (LTE), WiMax, or the like), etc.
Using the I/O interface 401, computer system 400 may communicate with input devices 411 and output devices 412.
In some embodiments, the processor 402 may be disposed in communication with a communication network 409 via a network interface 403. The network interface 403 may communicate with the communication network 409. The network interface 403 may employ connection protocols including, without limitation, direct connect, Ethernet (e.g., twisted pair 10/100/1000 Base T), Transmission Control Protocol/Internet Protocol (TCP/IP), token ring, IEEE 802.11a/b/g/n/x, etc. Using the network interface 403 and the communication network 409, the computer system 400 may communicate with an image capturing device 410 such as a camera, a smart phone, a tablet and the like. The communication network 409 can be implemented as one of the different types of networks, such as intranet or Local Area Network (LAN), Closed Area Network (CAN) and the like. The communication network 409 may either be a dedicated network or a shared network, which represents an association of the different types of networks that use a variety of protocols, for example, Hypertext Transfer Protocol (HTTP), CAN Protocol, Transmission Control Protocol/Internet Protocol (TCP/IP), Wireless Application Protocol (WAP), etc., to communicate with each other. Further, the communication network 409 may include a variety of network devices, including routers, bridges, servers, computing devices, storage devices, etc. In some embodiments, the processor 402 may be disposed in communication with a memory 405 (e.g., RAM, ROM, etc. not shown in
The memory 405 may store a collection of program or database components, including, without limitation, a user interface 406, an operating system 407, a web browser 408 etc. In some embodiments, the computer system 400 may store user/application data, such as the data, variables, records, etc. as described in this invention. Such databases may be implemented as fault-tolerant, relational, scalable, secure databases such as Oracle or Sybase.
The operating system 407 may facilitate resource management and operation of the computer system 400. Examples of operating systems include, without limitation, APPLE® MACINTOSH® OS X®, UNIX®, UNIX-like system distributions (E.G., BERKELEY SOFTWARE DISTRIBUTION® (BSD), FREEBSD®, NETBSD®, OPENBSD, etc.), LINUX® DISTRIBUTIONS (E.G., RED HAT®, UBUNTU®, KUBUNTU®, etc.), IBM® OS/2®, MICROSOFT® WINDOWS® (XP®, VISTA®/7/8, 10 etc.), APPLE® IOS®, GOOGLE™ ANDROID™, BLACKBERRY® OS, or the like. The User interface 406 may facilitate display, execution, interaction, manipulation, or operation of program components through textual or graphical facilities. For example, user interfaces may provide computer interaction interface elements on a display system operatively connected to the computer system 400, such as cursors, icons, check boxes, menus, scrollers, windows, widgets, etc.
In some embodiments, the computer system 400 may implement the web browser 408 stored program components. The web browser 408 may be a hypertext viewing application, such as MICROSOFT® INTERNET EXPLORER®, GOOGLE™ CHROME″, MOZILLA® FIREFOX®, APPLE® SAFARI®, etc. Secure web browsing may be provided using Secure Hypertext Transport Protocol (HTTPS), Secure Sockets Layer (SSL), Transport Layer Security (TLS), etc. Web browsers 408 may utilize facilities such as AJAX, DHTML, ADOBE® FLASH®, JAVASCRIPT®, JAVA®, Application Programming Interfaces (APIs), etc.
Furthermore, one or more computer-readable storage media may be utilized in implementing embodiments consistent with the present invention. A computer-readable storage medium refers to any type of physical memory on which information or data readable by a processor may be stored. Thus, a computer-readable storage medium may store instructions for execution by one or more processors, including instructions for causing the processor(s) to perform steps or stages consistent with the embodiments described herein. The term “computer-readable medium” should be understood to include tangible items and exclude carrier waves and transient signals, (i.e., non-transitory). Examples include Random Access Memory (RAM), Read-Only Memory (ROM), volatile memory, non-volatile memory, hard drives, Compact Disc (CD) ROMs, Digital Video Disc (DVDs), flash drives, disks, and any other known physical storage media.
Advantages of the Embodiment of the Present Disclosure are Illustrated Herein.
The present disclosure provides a method and a system for determining an area to be scanned in a Peripheral Blood Smear (PBS) for analysis.
The present disclosure determines an area to be scanned within a monolayer region of the PBS, that yields accurate and fast results.
The present disclosure discloses a feature wherein a single high magnification lens is used to identify the area to be scanned and for further scanning the area, thereby reducing enormous amount of time that is spent by the existing techniques in performing a two stage scanning process for locating the objects using low magnification lens and analyzing the located objects of interest using the high magnification lens.
The present disclosure provides a feature wherein first Z position for every subsequent X-Y position while scanning the area would be considered as a Z position corresponding to sharpest focus of a previous position, instead of starting from a homing Z position. This feature helps in reducing the scanning time by helping in achieving images of sharpest focus at a faster rate.
A description of an embodiment with several components in communication with each other does not imply that all such components are required. On the contrary a variety of optional components are described to illustrate the wide variety of possible embodiments of the invention. When a single device or article is described herein, it will be apparent that more than one device/article (whether or not they cooperate) may be used in place of a single device/article. Similarly, where more than one device or article is described herein (whether or not they cooperate), it will be apparent that a single device/article may be used in place of the more than one device or article or a different number of devices/articles may be used instead of the shown number of devices or programs. The functionality and/or the features of a device may be alternatively embodied by one or more other devices which are not explicitly described as having such functionality/features. Thus, other embodiments of the invention need not include the device itself.
The specification has described a method and a system for determining an area to be scanned in a Peripheral Blood Smear (PBS) for analysis. The illustrated steps are set out to explain the exemplary embodiments shown, and it should be anticipated that on-going technological development will change the manner in which particular functions are performed. These examples are presented herein for purposes of illustration, and not limitation. Further, the boundaries of the functional building blocks have been arbitrarily defined herein for the convenience of the description. Alternative boundaries can be defined so long as the specified functions and relationships thereof are appropriately performed. Alternatives (including equivalents, extensions, variations, deviations, etc., of those described herein) will be apparent to persons skilled in the relevant art(s) based on the teachings contained herein. Such alternatives fall within the scope and spirit of the disclosed embodiments. Also, the words “comprising,” “having,” “containing,” and “including,” and other similar forms are intended to be equivalent in meaning and be open-ended in that an item or items following any one of these words is not meant to be an exhaustive listing of such item or items, or meant to be limited to only the listed item or items. It must also be noted that as used herein and in the appended claims, the singular forms “a,” “an,” and “the” include plural references unless the context clearly dictates otherwise.
Finally, the language used in the specification has been principally selected for readability and instructional purposes, and it may not have been selected to delineate or circumscribe the inventive subject matter. It is therefore intended that the scope of the invention be limited not by this detailed description, but rather by any claims that issue on an application based here on. Accordingly, the embodiments of the present invention are intended to be illustrative, but not limiting, of the scope of the invention, which is set forth in the following claims.
REFERRAL NUMERALS
Claims
1. A method for determining an area to be scanned in a Peripheral Blood Smear (PBS) for analysis, the method comprising:
- capturing, by a PBS analysing system, a focused image at each of a plurality of positions in the PBS, wherein the plurality of positions are selected along a horizontal line of axis that extends across length of the PBS starting from a predefined reference point;
- determining, by the PBS analysing system, Quality Indicators (QIs) in the focused image captured at each of the plurality of positions, wherein the QIs comprise a cell count value, a normalized sharpness value and an average intensity value;
- identifying, by the PBS analysing system, a region in the PBS where the QIs of the focused image satisfy predefined QI threshold limits, as a monolayer region of the PBS; and
- determining, by the PBS analysing system, an initiation point in the monolayer region based on the cell count value determined in the focused image captured at each of the plurality of positions located in the monolayer region and co-ordinates of each of the plurality of positions located in the monolayer region; and
- determining, by the PBS analysing system, the area to be scanned in the monolayer region based on the initiation point and a predefined scan pattern selected for scanning the area.
2. The method as claimed in claim 1, wherein each of the plurality of positions are marked on the PBS from the predefined reference point.
3. The method as claimed in claim 2, wherein each of the plurality of positions marked from the predefined reference point are separated by a predefined distance until end of the PBS.
4. The method as claimed in claim 1, wherein the QIs further comprises a sharpness value, a density value and Red Blood Cells (RBC) count ratio.
5. The method as claimed in claim 1 further comprises a Field Of View (FOV) flag associated with each of the plurality of positions that indicates whether FOV corresponding to each of the plurality of positions belongs to the monolayer region.
6. The method as claimed in claim 1, wherein the focused image is captured at each of the plurality of positions using an image capturing device associated with the PBS analysing system.
7. The method as claimed in claim 1, wherein the QIs are determined in predefined number of non-overlapping regions selected in the focused image, wherein the QIs confirm the monolayer region when the QIs of at least more than half of the predefined number of non-overlapping regions satisfy the predefined QI threshold limits.
8. The method as claimed in claim 1, wherein determining the initiation point comprises computing, by the PBS analysing system, a weighted average of “Y” co-ordinate value of each of the plurality of positions present in the monolayer region using a predefined equation mentioned below: Initiation P oint = ∑ i ( w i Y i ) ∑ i w i wherein, wi indicates cell count value and Yi indicates “Y” co-ordinate value.
9. The method as claimed in claim 1 further comprises plotting, by the PBS analysing system, a bell-curve graph indicating focus steps at each of the plurality of positions and corresponding sharpness at each focus step of the plurality of positions, when the focused image is captured.
10. The method as claimed in claim 1 further comprises scanning, by the PBS analysing system, the area in the predefined scan pattern around the initiation point in the area.
11. The method as claimed in claim 10, wherein the predefined scan pattern comprises at least one of a spiral scan pattern and a columnar scan pattern.
12. The method as claimed in claim 10, wherein the scanning is continued until exhaustion of the area.
13. The method as claimed in claim 10, wherein the scanning is continued until desired number of Field Of Views (FOVs) in the area that satisfy analysis criteria of the PBS are attained.
14. A Peripheral Blood Smear (PBS) analysing system for determining an area to be scanned in a PBS for analysis, the PBS analysing system comprising:
- a processor; and
- a memory communicatively coupled to the processor, wherein the memory stores the processor executable instructions, which, on execution, causes the processor to: capture a focused image at each of a plurality of positions in the PBS, wherein the plurality of positions are selected along a horizontal line of axis that extends across length of the PBS starting from a predefined reference point; determine Quality Indicators (QIs) in the focused image captured at each of the plurality of positions, wherein the QIs comprise a cell count value, a normalized sharpness value and an average intensity value; identify a region in the PBS where the QIs of the focused image satisfy predefined QI threshold limits, as a monolayer region of the PBS; determine an initiation point in the monolayer region based on the cell count value determined in the focused image captured at each of the plurality of positions located in the monolayer region and co-ordinates of each of the plurality of positions located in the monolayer region; and determine the area to be scanned in the monolayer region based on the initiation point and a predefined scan pattern selected for scanning the area.
15. The PBS analysing system as claimed in claim 14, wherein the processor marks each of the plurality of positions on the PBS from the predefined reference point.
16. The PBS analysing system as claimed in claim 15, wherein each of the plurality of positions marked from the predefined reference point are separated by a predefined distance until end of the PBS.
17. The PBS analysing system as claimed in claim 14, wherein the QIs further comprises a sharpness value, a density value and Red Blood Cells (RBC) count ratio.
18. The PBS analysing system as claimed in claim 14 further comprises a Field Of View (FOV) flag associated with each of the plurality of positions that indicates whether FOV corresponding to each of the plurality of positions belongs to the monolayer region.
19. The PBS analysing system as claimed in claim 14, wherein the processor captures the focused image at each of the plurality of positions using an image capturing device associated with the PBS analysing system.
20. The PBS analysing system as claimed in claim 14, wherein the processor determines the QIs in predefined number of non-overlapping regions selected in the focused image, wherein the QIs confirm the monolayer region when the QIs of at least more than half of the predefined number of non-overlapping regions satisfy the predefined QI threshold limits.
21. The PBS analysing system as claimed in claim 14, wherein to determine the initiation point, the processor is configured to compute a weighted average of “Y” co-ordinate value of each of the plurality of positions present in the monolayer region using a predefined equation mentioned below: Initiation p oint = ∑ i ( w i Y i ) ∑ i w i wherein, wi indicates cell count value and Yi indicates “Y” co-ordinate value.
22. The PBS analysing system as claimed in claim 14, wherein the processor is further configured to plot a bell-curve graph indicating focus steps at each of the plurality of positions and corresponding sharpness at each focus step of the plurality of positions, when the focused image is captured.
23. The PBS analysing system as claimed in claim 14, wherein the processor is further configured to scan the area in the predefined scan pattern around the initiation point in the area.
24. The PBS analysing system as claimed in claim 23, wherein the predefined scan pattern comprises at least one of a spiral scan pattern and a columnar scan pattern.
25. The PBS analysing system as claimed in claim 23, wherein the processor continues scanning until exhaustion of the area.
26. The PBS analysing system as claimed in claim 23, wherein the processor continues scanning until desired number of Field Of Views (FOVs) in the area that satisfy analysis criteria of the PBS are attained.
4453266 | June 5, 1984 | Bacus |
8345227 | January 1, 2013 | Zahniser |
20040109608 | June 10, 2004 | Love et al. |
20040217270 | November 4, 2004 | Publicover |
20070076190 | April 5, 2007 | Nakaya |
20140356938 | December 4, 2014 | Kendall |
2002281347 | September 2002 | JP |
WO-2013158506 | October 2013 | WO |
- Stanbrough, J. (Jul. 17, 2015). The center of mass. Retrieved Mar. 22, 2021, from http://www.batesville.k12.in.us/physics/apphynet/dynamics/center%20of%20mass/Center_of_Mass_1.html (Year: 2015).
- Machine translation of JP-2002281347-A (Year: 2002).
- International Search Report & Written Opinion for PCT/IB2018/053388 dated Aug. 9, 2018, pp. 1-9.
Type: Grant
Filed: May 15, 2018
Date of Patent: Nov 30, 2021
Patent Publication Number: 20200242757
Assignee: Sigtuple Technologies Private Limited (Karnataka)
Inventors: Shreepad Potadar (Karnataka), Dheeraj Mundhra (Kolkata), Abhishek Shukla (New Delhi), Raghu G (Telangana), Amrutha Muralidharan (Kerala), Deepak Kapoor (Uttar Pradesh), Vijay Muralidharan (Chennai Tamil Nadu), Nivedita Muthusubramanian (Nadu), Bharath Cheluvaraju (Karnataka), Apurv Anand (Karnataka), Tathagato Rai Dastidar (Karnataka), Rohit Kumar Pandey (Karnataka)
Primary Examiner: Vu Le
Assistant Examiner: Courtney Joan Nelson
Application Number: 16/622,110
International Classification: G06T 7/00 (20170101); G06T 7/73 (20170101); C12Q 1/06 (20060101); G01N 1/28 (20060101); G01N 33/80 (20060101); G01N 35/00 (20060101); G06K 9/00 (20060101);