Photorefraction Ocular Screening Device and Methods
A photorefraction ocular screening device for assessing vision and corresponding disorders associated with the human ocular system is provided. More specifically, the present invention provides for a photorefraction ocular screening device employing advanced methods of pupil detection and refractive error analysis. The photorefraction ocular screening device is comprised of an LED arrangement configured with a plurality of irradiation sources serving as visual stimuli, wherein the visual stimuli may be presented in varying illumination patterns to the pupils of an examinee for expanding the range of ocular responses that can be used to determine refractive error.
The present invention relates generally to the field of ocular examination. More particularly, the present invention is directed to a photorefraction ocular screening device employing novel methods of pupil detection and refractive error analysis for assessing vision and corresponding disorders associated with the human ocular system.
BACKGROUNDThe basic function of a photorefractive device is to collect and analyze ocular responses to light stimuli. Light from an external source enters the eye through the pupil and is focused to create a small illuminated spot on the retina. Some of the light from this retinal spot is returned out of the eye through the pupil after interaction with different layers of the retina. The pattern of light exiting the pupil is determined by the optics of the eye and is dominated by an examinee's refractive error (focusing errors of the eye).
Unlike fundus photography, wherein a large area of the retina is illuminated and a camera is focused on the retina to image details of its anatomy, photorefraction does not directly image the retina or any other structures in the posterior segment of the eye. In photorefraction, images are obtained by focusing on the pupil to obtain the light pattern exiting the pupil—i.e., images are analyzed in the pupil plane.
In earlier known methods of photorefraction, typically only eccentric illumination (i.e., lights arranged outside a lens aperture of an ocular screening system) is used. This approach has limitations and can often result in refractive error determinations that are inaccurate or ambiguous, particularly since eyes with different refractive errors can have similar responses under a given illumination. Classic photorefraction using eccentric illumination alone generates a “crescent-like” reflex in the pupil plane, the edges and domains of which must be determined for purposes of correlating the pupil response with a refractive error. When using eccentric or decentered illumination alone, determination of the crescent boundary is a difficult task. In addition, the determination of pupil size and location is often compromised by not having sufficient pupil edge data (due to dark edges) for accurate pupil circle fitting.
Accordingly, there exists a need to provide improved methods of conducting photorefraction-based ocular examinations.
The objectives and advantages of the present invention will become apparent upon consideration of the following detailed description, taken in conjunction with the accompanying drawings, wherein like reference characters refer to like parts throughout, and in which:
The present invention is directed to a photorefraction ocular screening device employing methods for ascertaining an examinee's refractive error. For purposes of clarity, and not by way of limitation, illustrative views and process flows of the methods employed in the present invention are described with references made to the earlier identified drawing figures. Various modifications obvious to one skilled in the art are deemed to be within the spirit and scope of the present invention.
Referring to
Device 100 is preferably configured for mobility, but may also be suitable for stationary applications. Additionally, device 100 may be wirelessly enabled to permit image data collection and analysis to be transmitted to a remote location for printing a report or to permit further assessment of an examinee's ocular response. For example, upon conducting an ocular examination using device 100, image data collected and corresponding results may be wirelessly transmitted and stored in a remote patient database configured for accessibility by authorized medical professionals and institutions.
Device 100 functionality is driven by a plurality of processes configured to assess ocular aspects of an examinee including, but not limited to, presenting attention-getting stimuli to the examinee, controlling an LED arrangement to irradiate pupils of the examinee, locating pupils of the examinee in captured images, displaying captured images to an operator, and analyzing pupil image data for determining refractive error and conducting related assessments. These processes may be performed by processing logic (not shown) under computer program control in device 100, which may be comprised of hardware (e.g., circuitry, dedicated logic, programmable logic, microcode, etc.), software (such as instructions run on a processing device), firmware, or a combination thereof.
Attention-Getting Stimuli
Effective ocular screening of cooperative (adults) and non-cooperative (children or animals) examinees may be achieved through the use of device 100. Device 100 may be configured to present attention-getting stimuli to an examinee. The presentation of attention-getting stimuli may be needed, particularly when screening non-cooperative examinees, in order to attract the examinees' direction of gaze. For proper ocular screening, the direction of gaze needs to be in the direction of lens component 102 coupled to image capture component 104 provided in device 100.
Various types of attention-getting stimuli may be utilized. In one embodiment, an auditory stimulus may be used. The auditory stimulus may be a digitally recorded sound track under computer program control in device 100 and may be presented, for example, via speaker 105. In another embodiment, an unfocussed time-dynamic visual stimulus may be used, minimizing an accommodative response from examinees. The visual stimulus may be presented through the use of colored LEDs provided, for example, by LED array 106.
The visual stimulus may be comprised of an arrangement of differently colored LEDs. The arrangement of colored LEDs preferably have wavelengths below 600 nanometers to avoid contamination of near infrared (NIR) LED stimulus, which preferably have a central wavelength of 850 nanometers and are used for purposes of capturing pupil images to conduct an ocular examination. This configuration allows the visual stimulus to be presented for attention getting purposes, but not to be seen in recorded images. The visible LED stimulus is independent of the NIR LED stimulus and is not used in the data analysis associated with determining refractive error or gaze direction. An optimal arrangement of LED array 106 comprises visible LEDs 106a that are positioned between and are coplanar with NIR LEDs 106b. Light emitted by visible LEDs 106a may pass through holographic diffuser 108, creating diffuse stimuli, and is reflected towards the examinee by beam-splitter 110.
As with the auditory stimulus, visible LEDs 106a may also be under computer program control in device 100. More specifically, control parameters such as the intensity, duration, pattern and cycle time associated with visible LEDs 106a may be under computer program control. With respect to intensity, visible LEDs 106a must be regulated to be bright enough to attract the direction of an examinee, while at the same time being limited in brightness to avoid stimulating pupil constriction. The duration of time in which visible LEDs 106a are turned on before being turned off is measured in milliseconds and may be regulated based on the brightness of visible LEDs 106a perceived by the examinee. Visible LEDs 106a may be arranged in a pattern appearing as three concentric rings. In this arrangement, the three concentric rings would appear to the examinee as centered in the image capture component 104 of device 100. Each of the concentric rings may be comprised of more than one LED color spaced apart in a random pattern. A plurality of pattern combinations may be presented to an examinee in random order. The number of data frames collected prior to making a change to a pattern may also be regulated.
The underlying objective of the control parameters associated with visible LEDs 106a is to present diffuse, random and rapidly changing visible light patterns to an examinee. Such patterns are intended to reduce, and in some cases may inhibit, accommodation of the examinee's eyes at a focal distance that is preferably set at one (1) meter from image capture component 104 of device 100. The focal distance may be determined using range finder 112 of device 100. If the eyes of the examinee are capable of full accommodation to a stimulus presented at the 1 meter distance, they will appear to be emmetropic (i.e., needing no optical correction) to device 100. An advantage of the implementation described herein is that, unlike other implementations, accommodation by hyperopes to the 1 meter distance of image capture component 104 of device 100 is diminished, making refractive error determinations for these examinees more accurate.
Presentation of a visual stimulus need not be limited to the use of visible LEDs 106a arranged in LED array 106. In alternate embodiments, the visual stimulus may be provided by an external irradiation source independent of device 100, an external source coupled to and under computer program control of device 100, or other suitable combinations thereof. Regardless of the attention-getting mechanism employed, an attention-getting stimulus is preferably presented continuously throughout an ocular examination.
NIR LED Stimuli
NIR LED stimuli preferably have a center wavelength of 850 nanometers and are directed at an examinee for purposes of capturing images of the pupil for conducting an ocular examination. In one embodiment, referring to
The arrangement of NIR LEDs 106b in LED array 106 allows for flexibility in the illumination patterns that may be presented to examinee's eyes 200. Using NIR LEDs 106b arranged in LED array 106, three types of illumination are available. The illumination types may include an on-axis (coaxial) illumination from center NIR LED 25, an off-axis (decentered) illumination from any one of NIR LEDs 106b (excluding center NIR LED 25) arranged within a limiting aperture space 204 associated with lens component 102, and an off-axis (decentered) illumination from any one of NIR LEDs 106b arranged outside limiting aperture space 204. NIR LEDs 106b may be characterized in terms of their decentration from the center optical axis (zero being at central NIR LED 25) and their angle in a plane perpendicular to the optical axis. For example, referring to LED array 106 illustrated in
The ocular response of an eye for any given refractive error will depend on the illumination pattern selected. For example, less decentered LEDs offer better resolution for small refractive errors, while more decentered LEDs extend the range of refractive error that can be detected. By comparing the response of an examinee's eyes under different illumination patterns, as described herein, ambiguities commonly associated with refractive error determinations in classical photorefraction may be addressed.
By integrating the use of decentered LEDs within aperture space 204, a broader range of ocular responses are made available. Additionally, with the use of center NIR LED 25, yet a further dimension is enabled, which provides for a co-axial photorefraction response. An exemplary comparison of reflexes associated with different approaches for illuminating a pupil is illustrated in
In the illumination arrangements described herein, all stimuli presented to an examinee consist of coaxial center NIR LED 25 combined with any one of decentered NIR LEDs 106b, decentered NIR LEDs 106b being selected at varying decentration distances from the center optical axis lying within and outside of limiting aperture space 204. In addition to using paired stimuli, the illumination arrangements described herein also comprises presenting a stimulus to an examinee consisting of only coaxial center NIR LED 25. Using center NIR LED 25 in all stimuli illumination arrangements ensures that the pupil is always sufficiently illuminated, allowing it to be acquired and measured reliably. Unlike other known implementations of photorefraction, providing a decentered illumination paired with a coaxial illumination, using the LED irradiation sources in LED array 106, does not result in a reflex having crescents, thereby allowing a crescent's geometry to be omitted from the process for determining refractive error.
When illuminating a pupil for purposes of conducting an ocular examination, specific stimuli need to be selected to ensure good pupil imaging and accurate determination of refractive error. Additionally, the specific stimuli selected must serve to allow for determination of asymmetry (astigmatism or cylinder refractive error) in an eye's refractive power. The foregoing criteria are met through the use of decentered and coaxial LED pairing, wherein illumination patterns selected to serve as stimuli are dependent not only on the distance of NIR LEDs 106b from the center optical axis of lens component 102, but also their orientation with respect to the axis of an examinee's cylinder axis.
Decentricity pairing is illustrated in the charts of
The start of image data collection is carried out using decentricity pairings along the three primary axis-conjugate meridians illustrated in
Since decentricity pairing is also repeated for the 60° and 120° meridians, as illustrated respectively in the charts of
In addition to the decentered stimuli in the three primary axis-conjugate meridians, decentered stimuli at the far corners of LED array 106 may also be utilized. The angles defining the axis and corresponding conjugate lines associated with these decentered stimuli are referred to herein as the supplementary meridians. Decentricity pairing of stimuli in the supplementary meridians may be used to disambiguate the interpretation of ocular reflexes obtained in the three primary axis-conjugate meridians. The supplementary meridians are defined along the axis-conjugate of 36.59°-216.59° and 143.41°-323.41°, as illustrated in
As in the three primary meridians, paired stimuli in the supplementary meridians are identified by a decentration position along the axis line and the corresponding conjugate line for each of the 36.59° and the 143.41° meridians. Decentricity pairings for the 36.59° and the 143.41° meridians are illustrated in the chart of
In addition to the use of paired stimuli in the three primary meridians and the two supplementary meridians, a single coaxial stimulus may also be utilized to obtain an ocular response. The co-axial stimulus is center NIR LED 25, as illustrated in
Image Capture & Pupil Acquisition
Digital image feature detection and filtering is used for pupil acquisition in images captured by image capture component 104. The implementation of digital image feature detection and filtering may be dependent on the sensor resolution of image capture component 104, the distance of an examinee's pupil from image capture component 104, and the field of view determined by the optics of lens component 102 coupled to image capture component 104. Basic physiological constants (e.g., average pupil size) may also enter into the filtering process, along with acceptable pupil diameter maxima and minima.
An exemplary distance relationship between device 100 and the examinee is illustrated in
Using one (1) meter as the focal distance between device 100 and examinee's eyes 200, sensor resolution of image capture component 104 may be set at 752 (horizontal) by 480 (vertical) pixels, as illustrated in
In providing a display image, a copy of raw data received at image capture component 104 may be contrast enhanced and transformed into a standard display format for presentation and feedback to an operator of device 100. For example, the display image may be presented on operator display screen 114 of device 100. The image provided on operator display screen 114 may be overlaid with information such as, for example, an examinee's distance from device 100, quality of focus, progress of the examination, other operator-relevant information or combinations thereof.
There are three distinct phases in process 800 associated with the path intended to provide clinically relevant information. More specifically, processing logic under computer program control in device 100 may execute at steps 804, 806 and 808, a calibration phase, a focus phase and an examination protocol phase, respectively, to acquire pupil image data for refractive error analysis. Raw image data acquired at each of these phases may be made available for display to an operator, at step 814, on operator display screen 114 of device 100.
The intensity of a reflex from a pupil can vary widely among examinees due mainly to refractive error and pupil size. Since the dynamic range of the sensor in image capture component 104 is limited, an optimal exposure time must be found to insure that the reflex of an examinee is both detectable and not saturated. To accomplish this, a calibration process 820 is provided using a range of exposure times (e.g., 6, 12 and 18 milliseconds), which may be selected to sample the range of empirically-derived usable exposure times given a selected lens, sensor and LED illumination. Calibration process 820 may be executed, at step 804, to enable the calibration phase of process 800. The steps comprising calibration process 820 are described with reference to the flowchart illustrated in
Referring to
Various acceptance criteria may be used for the second determination, at step 830, to assess the suitability of detected pupil images for use in determining an optimum exposure time. These include, but are not limited to, a suitable presence of pupils necessary to perform calibration, an acceptable pupil size having a measurable diameter ranging between 1.5 to 10 mm, an acceptable inter-pupil distance between pupil centers, an acceptable examinee distance from device 100, an acceptable pupil saturation level or combinations thereof.
If a determination is made, at step 830, that detected pupils fail to satisfy one or more predefined acceptance criteria, then process 820 may again return to selecting and setting, at step 824, another exposure time for testing. Process 820 may be repeated to ascertain which of the exposure times provides optimal results—i.e., pupils detected without saturation. Saturation may be defined as greater than 10% of the pixels in the pupil have an intensity value greater than 98% of the maximum value associated with the sensor in image capture component 104. When the pupil image desired is detected, the optimal exposure time may be calculated, at step 832.
The optimum sensor exposure time may be set to 75% of the full sensor range. Once pupils are found, a central 25×11 pixel strip is measured for brightness. The brightness measure is taken to be the mean pupil intensity in this strip. Given the mean intensity value, the optimum exposure time is calculated as follows:
When both pupils are included in an examination, the pupil with the brightest mean intensity value may be used in the calculation.
After an optimal exposure time has been calculated, a focus process 840 may be executed, at step 806, to enable the focus phase of process 800. Good focus of the pupil image is necessary for accurately capturing the pupil images. In particular, if the glint from the corneal surface is not well-focused, its position cannot be accurately ascertained and gaze direction may not be measurable. Furthermore, if the glint image is very diffuse and overlaps significantly with the reflex, this will likely result in a poor estimate of refractive error. The steps comprising focus process 840 are described with reference to the flowchart illustrated in
Similar to the calibration phase described in process 820, the focus phase in process 840 assesses the suitability of captured images. Referring to
The first set of acceptance criteria utilized in process 840 may be similar to the acceptance criteria utilized in process 820—i.e., suitable presence of pupils, acceptable pupil size and acceptable inter-pupil distance. If a determination is made, at step 848, that detected pupils fail to satisfy the first set of acceptance criteria, then process 840 may again revert back to process 820 to reinitiate the calibration phase. If the detected pupils satisfy the first set of acceptance criteria, then the detected pupil may then be tested, at step 850, against the second set of acceptance criteria. The second set of acceptance criteria is used to assess the glint and gaze direction. If a determination is made, at step 850, that the pupil images do not yield the presence of the glint or an acceptable gaze direction, then process 840 may acquire, at step 842, a new captured image.
When the determination, at step 850, concludes that the second set of acceptance criteria is satisfied, the calibration and focus phases are complete and process 800 may then proceed with executing, at step 808, examination protocol process 860. In process 860, the criteria for determining image suitability are stricter than in the calibration and focus phases associated, respectively, with process 820 and process 840. In addition to standard image measures, changes in some images measures may be performed to reduce the possibility of blur in the images. Changes in image measures are preferably performed between a current image and a reference image, which is typically the image preceding the current image. The steps comprising examination protocol process 860 are described with reference to the flowchart illustrated in
Referring to
In a preferred embodiment, depending on the criteria failure detected, process 860 may determine whether it is necessary to return to the calibration phase of process 820 or only the focus phase of process 840. Criteria failures resulting in a return to the calibration phase of process 820 may include, but are not limited to, absence of pupils in the current image, unacceptable pupil size(s) in either the current or reference images, unacceptable change in pupil size between current and reference images, unacceptable inter-pupil distance in the current image, unacceptable change in the inter-pupil distance between current and reference images, or unacceptable gaze direction in either the current and reference images. Criteria failures resulting in a return only to the focus phase of process 840 may include, but are not limited to, absence of pupils in the reference image, unacceptable change in pupil position between current and reference images, unacceptable inter-pupil distance in the reference image, unacceptable glint position(s) in either the current and reference images, unacceptable change in glint position(s) between current and reference images, or unacceptable change in gaze direction between current and reference images.
When criteria associated with the determination, at step 868, are satisfied, the acquired image may be stored, at step 870, to be used in the refractive error analysis. After the acquired image is stored, at step 870, an additional determination may be made, at step 872, to identify whether images associated with any of the 23 stimuli LED patterns remain to be captured. Process 860 may be repeated until each of the 23 stimuli LED patterns, and the corresponding acquired image for each, satisfies acceptance criteria and is stored. Once all of the 23 images are acquired and stored, process 800 may then proceed with executing, at step 812, an analysis of the ocular responses associated with each of the saved images for purposes of conducting the refractive error and gaze analyses.
Acquisition of pupil images occurs throughout an ocular examination until all images associated with the examination protocol phase (i.e., presentation of the 23 stimuli and collection of corresponding ocular responses) are successfully captured. As such, a reliable method for detecting pupils must be employed. The method employed by device 100 is described with reference to the flowchart illustrated in
Pupil acquisition process 900 may be comprised of two basic operations, full frame operations (steps 902-908) and pupil candidate operations (steps 910-918). To initiate pupil acquisition process 900, a high resolution image is captured, at step 902, by image capture component 104 upon presenting near-infrared stimuli to an examinee. As previously described, image capture component 104 may be set at 752 (horizontal) by 480 (vertical) pixels, as illustrated in
Once the high-resolution image has been decimated, a pupil filter may be applied, at step 906, using a two-pass procedure configured to enhance pixels likely to be located within the pupils. Each pass may apply an optimized kernel, based on a pupil—non-pupil template, scanning for how well surrounding pixels fit the template. Application of the kernel may be optimized for speed by considering only a limited number of symmetrically-spaced surrounding pixels instead of a whole matrix of possible points. An exemplary optimized pupil filtering kernel is illustrated in
Referring to
Using the pupil filtering kernel template of
After application of the pupil filtering kernel, the resulting enhanced image may be saved, at step 908, into a pupil candidate list. A candidate pupil map may be generated using a combined thresholding and pixel connectedness procedure. The threshold may be empirically determined from the filtered output and may be calculated as follows:
Where a mean background value is representative of the average pixel intensity of an entire filtered output image and where a max output value is representative of the highest intensity in the filtered output image. Pixel-connectedness may be based on a flood fill algorithm, where connected pixels are assigned a candidate identifier. In many cases, multiple candidates will be present in each candidate map.
Upon completing the full frame operations, a transition may then be made to the pupil candidate operations of process 900. The pupil candidate operations are performed on each image stored, at step 908, in the pupil candidate list. A pupil candidate may be retrieved, at step 910, to initiate the pupil candidate operations. For each pupil candidate retrieved, a bounding rectangle encompassing the pupil candidate is provided. Dimensions defining the sides of the bounding rectangle may be determined by the left-most and right-most pixel column numbers of a pupil candidate, and the top-most and bottom-most pixel rows of the pupil candidate. Pupil candidates having bounding rectangles with a width or height that is comprised of less than two (2) pixels are immediately rejected. If a pupil candidate is retained, the center of the bounding rectangle may be adjusted to match the equivalent position in a corresponding high resolution image of the pupil candidate, generating an initial bounding square (65×65 pixels) for identifying, at step 912, a region of interest (ROI) in the high resolution image. All operations from this point forward may be performed on the high resolution version of the ROI sub-image.
The ROI for a pupil candidate may be binarized, at step 914, to identify pupil edge pixels. A dual-method approach comprising a pixel intensity method and a pseudo-gradient method, as illustrated in
In the pixel intensity method of process 1100, identifying pupil pixels within a pupil candidate's ROI is accomplished through binarization. The pupil candidate's ROI undergoes binarization, at step 1104, to aid in distinguishing pupil pixels from non-pupil pixels within the ROI. A threshold value is used during binarization and may be determined from an intensity (i.e., brightness) histogram of the ROI. In the ROI, pupil border intensities will be blended with non-pupil pixels, and non-pupil pixels will be darker than pupil pixels. The count of non-pupil pixels in the low intensity part of the histogram will be higher than that of pupil pixels, as illustrated in the intensity histogram of
To isolate the pupil point distribution, the intensity with the highest point in the distribution of pixel counts in the lowest approximate 40% of the histogram may be found first and recorded as the median intensity (background) for the area around the pupil. Thereafter, the distribution of pupil points at intensities below the median value may be examined and symmetry on the high side of the median value is assumed to build a distribution associated with the non-pupil points only. The distribution of non-pupil points may then be subtracted from the total distribution to isolate the pupil point distribution only. Any negative pixel counts resulting from the subtraction are set to zero pixel counts, as are all intensities equal to or less than the median. The resultant histogram will be a conservative estimate of intensities in the pupil within the ROI.
Using the resultant histogram, an average pupil intensity value is calculated and the threshold may be set to a mid-point value between the non-pupil median intensity value and the average pupil intensity value. This threshold value is used to generate a binary image of the ROI, wherein pupil intensity values below the threshold value are set to zero and pupil intensity values above or equal to the threshold value are set to one. Pupil edges are then detected, at step 1105, by searching all rows and columns in the generated binary image, proceeding outward from a specified center point (cx,cy) until a non-pupil (zero value) pixel is found. While scanning each row/column, if a pupil pixel does not have an adjacent pupil pixel (non-zero value) in the next row/column, then the edge of the pupil is assumed to be found and the scan in that direction is terminated.
After generating a binary map of edge points using the pixel intensity method, the pseudo-gradient method of process 1100 is employed to generate a second binary map of edge points for a pupil candidate. In the pseudo-gradient method, pupil edge pixels are detected using a rate of change in intensity across an image by computing, at step 1106, a pseudo-gradient at each pixel. Referring to the pixel grid illustrated in
The pseudo-gradient calculation is as effective as a standard gradient calculation, which is calculated as follows:
However, using a pseudo-gradient calculation eliminates the need for a computationally expensive square root calculation at each pixel.
After the pseudo-gradient is calculated at each pixel, the resulting image is subject to binarization, at step 1107, using a threshold value. Here, determination of the threshold value for purposes of binarization is dependent on a result yielded by the pupil intensity method, specifically, the number of edge pixels found in the application of the pixel intensity method. The number of edge pixels yielded by the pixel intensity method may be scaled by four (4), an empirically selected value, and assumed to be the maximum number of edge pixels that can be found using the pseudo-gradient method. Scaling is necessary since the pupil edge yielded by a pseudo-gradient method will not be a clean one-pixel-thick edge, as illustrated in
The binary maps yielded by both the pixel intensity and pseudo-gradient methods may be combined, at step 1108, to generate a map of common pupil edge pixels. A filter may then be applied to the map, at step 1110, using a set of predefined criteria to identify undesirable pixel elements. A first determination may be executed, at step 1112, to identify if isolated edge pixel(s) are present. An isolated edge pixel may be a pixel that is not connected to any other edge pixels or it may be a pixel not paired with another edge pixel in its row/column. A second determination may be executed, at step 1114, to identify if internal edge pixel(s) are present. An internal edge pixel may be a pixel that lies between two other pixels in its row/column (e.g., 3 pixels in a row or column). If a determination is made that isolated or internal edge pixels are present, they are removed, at step 1116, and a final pupil edge pixel map is generated, at step 1118.
After the final map is identified, the corresponding pupil edge pixels may be stored, at step 916, and a best-fit circle may be applied, at step 918, using a least squares method. Application of the best-fit circle, using the final pupil edge pixels, identifies the pupil position and size. Various criteria may be used to assess and reject undesirable pupil candidates based on best-fit circle parameters. Pupil candidates may be rejected, for example, if a pupil center is determined to lie outside of the candidate's bounding square, if a pupil diameter is determined to be less than 2 mm or greater than 10 mm, if 12.5% of the filtered edge points are more than ⅓ mm from the circle perimeter, if 50% of the unfiltered edge points are more than ⅓ mm from the circle perimeter, select combinations thereof or any other applicable criteria for determining the suitability of a pupil candidate to undergo refractive error analysis.
Once a pupil candidate has undergone the pupil candidate operations, a determination is made, at step 920 of process 900, whether any pupil candidates remain. If so, the pupil candidate operations returns to the beginning and retrieves, at step 910, the next pupil candidate for binarization and a best-fit circle application. Once all of the pupil candidates have undergone the pupil candidate operations, a refractive error analysis process 1200 may then be executed by processing logic under computer program control in device 100.
Refractive Error Analysis
Refractive error is defined as the optical correction that would provide good vision. In ophthalmology and optometry, optical corrections are almost universally described using three values: a spherical power (sph), a cylindrical power (cyl) and an orientation (axis) for the cylinder. Given an overall refractive state of the eye, the sphere, cylinder and orientation can be used to calculate the refractive error along any meridian of the eye. In photorefraction ocular screening device 100, a reverse method is employed where, given the refractive error along the 0°, 60°, 120° meridians of the eye, these meridional refractive errors can be combined to determine the overall refractive state of the eye. The calculation is comprised of a two-stage process, where intermediate variables A, B and D are determined as follows:
With values for A, B and D, the overall refractive error is determined using:
Once the axis has been calculated, a head-tilt rotation angle may be added to produce the final refractive error.
The pattern of light in a pupil due to the retinal reflection, or reflex, from an eye in response to a NIR LED stimulus is dependent on the refractive state of the eye. In application of NIR LEDs 106b arranged in LED array 106, factors that influence the reflex include the angular position (i.e., the meridians) of NIR LEDs 106b and the perpendicular distance (i.e., the decentration) of NIR LEDs 106b from the central optical axis of image capture component 104. For a given decentration, captured image frames are analyzed to determine the reflexes from patterns of illumination provided along the 0°, 60°, 120° axis lines and, respectively, along their corresponding 180°, 240° and 300° conjugate lines. The results of the two image frames from the axis and conjugate lines along the same meridian may then be combined to determine a refractive power along that meridian.
A process 1200 for determining the refractive power along a meridian is described with reference to the flowchart illustrated in
If the fixation axis (also called the line of sight) is along the axis which goes through the pupil center and the center of the cornea (i.e., the optical axis), the glint will appear to be in the center of the pupil. If the fixation axis deviates from the optical axis, the glint will appear decentered. One can calculate, to a good approximation, the axis of fixation by the simple relation which states that the eye is rotated by approximately 11.5° per millimeter of decentration (numbers may vary in the literature). Because of the eye's anatomy, it is well established that in a normal gaze position, the fixation axis is not along the optical axis, but rather deviates by approximately 2° to 5° horizontally and 1° to 2° vertically.
In determining the fixation axis, the timing of gaze change, duration of fixation and sequential selections of objects towards which the gaze is directed are not of interest. The sole purposes of monitoring gaze direction are to guarantee that an examinee is looking at the visible attention-getting stimulus (i.e. gaze direction is towards the image capture component 104 of photorefraction ocular screening device 100), and to detect abnormalities in the fixation axis in one or both eyes, which may indicate eye-alignment problems (e.g. strabismus). Any captured image frame in which the gaze direction is not directed at image capture component 104 (e.g. the gaze is directed at the device operator's face) is rejected and not further considered. All measurements depend on acquiring pupil images which evidence a gaze direction towards image capture component 104 within a specified tolerance and allowing for abnormalities.
To determine the position of the glint, a 65×65 pixel square may be extracted from around the pupil center. A low pass filter may be applied to this sub-image, wherein the filtered sub-image may then be subtracted from the raw sub-image. The location of the maximum difference resulting from the subtraction of the two images is taken as the center of the glint. Once the center of the glint is identified, new intensity values for pixels surrounding the glint center may then be calculated. A 9×9 surrounding pixel area 1302 may be centered on a glint pixel area 1304, as illustrated in
After removal of the corneal glints, at step 1202, a low-pass filter may be applied, at step 1204, to the pupil region in each image to remove high frequency noise from the reflex data. Once noise is removed from the images, process 1200 may then proceed with executing a rotation, at step 1206, of the pupil images to align stimuli angles with the horizontal meridian. For example, a stimulus decentricity pairing comprising center NIR LED 25 and NIR LED 36, along the axis line of the 60° meridian, is provided by LED array 106, as illustrated in image (a) of
Image ratioing (division) is a technique for feature enhancement using two views of the same object and may be expressed mathematically as:
Where (i,j) are pixel coordinates of input and output images (i.e. pixel by pixel division). Image ratioing is useful for emphasizing the differences between two images, while suppressing similarities. Unlike simple image subtraction, ratioing also cancels out any multiplicative factors (e.g. image sensor gain, exposure time, and magnification due to small distance errors) common to both images.
A unique ratioing approach is implemented by the processing logic under computer program control in device 100. In process 1200, the axis and corresponding conjugate images are used as input images, where the ratio of pixel intensity values for the axis and corresponding conjugate pixel strips is computed, at step 1210. An example of the pupil image ratioing in process 1200 is illustrated in
As illustrated in
In generating the profile slope correlate, the eleven (11) scan lines of the ratio pixel strip may be averaged, as illustrated in
To calculate the PCA coefficient, the PCA mean factor is first subtracted from the image data vector, as follows:
Datai′=Datai−Meani
After the difference is obtained, intermediate sums are computed, as follows:
Having computed the intermediate sums, the coefficient is calculated as follows:
Conversion of a correlate measure to r(θ), a refractive error in a stimulus meridian angle, may be performed via comparison with a set of decentricity calibration curves. There are total of four (4) curves, D1 through D4, one for each unique decentricity. The decentricities associated with each stimulus meridian are illustrated in
where Yi is the aggregate error value; SθD1, SθD2 and SθD3 are the correlate values along one of three primary stimulus meridian θ at decentricities D1, D2 and D3, respectively; SD4 is the average of the correlate values along the 36.59° and 143.41° stimulus meridians at decentricity D4; CiD1, CiD2 and CiD3 are the elements of the calibration curves for decentricities D1, D2 and D3, respectively; and CiD4 are the elements of the calibration curve for decentricity D4. A sample aggregate calibration error curve is illustrated in
While the foregoing detailed description illustrates principle embodiments of the invention, it will be appreciated that various modifications can be made by those skilled in the art without departing from the spirit and scope of the invention described herein. The invention can be practiced by other than the described embodiments, which are presented for purposes of illustration and not by way of limitation, and the present invention is limited only by the claims that follow.
Claims
1-49. (canceled)
50. A photorefraction ocular device, comprising:
- a single housing body;
- an image capture component positioned within the single housing body, the image capture component being configured to capture one or more images of a pupil;
- a lens component coupled to the image capture component;
- a plurality of light sources coupled to the single housing body, the plurality of light sources being positioned to illuminate the pupil;
- a speaker positioned within the single housing body, the speaker being configured to provide audible stimuli;
- an operator display screen coupled to the single housing body, the operator display screen being configured to display the pupil; and
- a processor positioned in the single housing body, the processor including processing logic programmed to locate the pupil, display the one or more images of the pupil on the operator display screen, and analyze the one or more images of the pupil to determine refractive error.
51. The device of claim 50, wherein the single housing body is mobile.
52. The device of claim 50, wherein the device is programmed to wirelessly transfer the one or more images of the pupil to a remote server.
53. The device of claim 50, wherein the plurality of light sources is arranged in a lighting array.
54. The device of claim 53, wherein a center position of said lighting array is aligned with an optical axis of said image capture component.
55. The device of claim 53, wherein said lighting array includes a plurality of irradiation sources.
56. The device of claim 53, wherein the lighting array is arranged in three concentric rings.
57. The device of claim 53, further comprising a diffuser positioned in proximity to said lighting array.
Type: Application
Filed: Jun 30, 2016
Publication Date: Feb 2, 2017
Inventors: Richard Allen Mowrey (Ottawa), Martin Edson Rivers (Kanata), Rejean Joseph Yvon Bruno Munger (Ottawa)
Application Number: 15/198,814