Signal processing method, signal processing apparatus, and image reading apparatus

Abstract

Upon processing a visible light image signal and infrared image signal respectively obtained by illuminating a transparent document with light beams coming from a visible light lamp for mainly emitting visible light and an infrared lamp for mainly emitting infrared light, and photoelectrically converting optical images of the transparent document, a histogram is generated on the basis of the infrared image signal, a threshold value is calculated based on the histogram, and infrared image signal components equal to or smaller than the threshold value are extracted by comparing the calculated threshold value and infrared image signal components. Visible light image signal components corresponding to the extracted infrared image signal components are interpolated using surrounding visible light image signal components.

Description

FIELD OF THE INVENTION

[0001] The present invention relates to a signal processing method, signal processing apparatus, and image reading apparatus and, more particularly, to a signal processing method, signal processing apparatus, and image reading apparatus for correcting any defects formed on a transparent document by dust, scratches, and the like.

BACKGROUND OF THE INVENTION

[0002] FIG. 28 shows a schematic arrangement in a conventional transparent document image reading apparatus. Referring to FIG. 28, a transparent document 142 such as a positive film, negative film, or the like placed on a platen glass 141 is illuminated with light emitted by a transparent document illumination lamp 144 via a diffusion plate 143 set above the document, and light transmitted through the transparent document 142 is guided to a CCD 150 via a mirror 147, inverted-V mirrors 148, and imaging lens 149. The light is converted by the CCD 150 on which a large number of solid-state image sensing elements line up into an electrical signal, thus obtaining an image signal in the main scan direction.

[0003] In this case, image reading in the sub-scan direction is done by mechanically moving the transparent document illumination lamp 144 and mirror 147 in the sub-scan direction with respect to the transparent document 142 while maintaining an identical velocity and phase, and making the inverted-V mirrors 148 track at the half scan velocity in the sub-scan direction so as to maintain a constant optical path length (conjugate relationship) from the transparent document 142 to the CCD 150. In this way, a two-dimensional image is read in combination with the process in the main scan direction.

[0004] The aforementioned transparent document image reading apparatus can read a so-called reflecting document which is described on an opaque material and is illuminated with light so as to process the light reflected by the material. In this case, a reflecting document is placed in place of the transparent document 142, and is illuminated with a direct light beam emitted by a reflecting document illumination lamp 145, which is turned on in place of the transparent document illumination lamp 144, and with a light beam reflected by a reflector 146. The light reflected by the reflecting document is read by the CCD 150, thus forming an image in the main scan direction as in the transparent document.

[0005] Especially, as a color reading method, a 3-line color image reading method is prevalent. That is, the reflecting document illumination lamp 145 uses a lamp having white spectral characteristics, and the CCD 150 uses a 3-line type CCD having R, G, and B color filters. Three colors (R, G, and B) of image information are simultaneously read by a single scan, and R, G, and B color signals on an identical line are superposed by an image processing circuit, thus forming a color image.

[0006] In order to correct any defects on an image due to dust, scratches, and the like on a transparent document in the aforementioned transparent document image reading apparatus, the only effective method is to retouch them using image edit software after the image is read. For this reason, a very long time is required to correct such defects.

[0007] In recent years, as such transparent document image reading apparatus, an image reading apparatus having a so-called dust/scratch removal function of detecting dust present on a transparent document and scratches on a film surface (such detection will be referred to as “dust/scratch detection” hereinafter), and removing the influences of such dust and scratches by an image process has been developed.

[0008] FIG. 29 shows a conventional image reading apparatus 1 having a dust/scratch detection function. The same reference numerals in FIG. 29 denote the same parts as in FIG. 28, and a detailed description thereof will be omitted.

[0009] Referring to FIG. 29, reference numeral 151 denotes an infrared lamp which comprises an LED having an emission intensity peak at a wavelength of about 880 nm.

[0010] FIG. 30 is a block diagram showing the functional arrangement of a dust/scratch remover 2 for implementing dust/scratch removal using image data obtained by the image reading apparatus 1. Referring to FIG. 30, reference numeral 21 denotes an interface (I/F) for inputting image data read by the image reading apparatus 1; 22, an image memory for storing an image read using the transparent document illumination lamp 144 or reflecting document illumination lamp 145 (to be referred to as a “normal image” hereinafter); 23, an infrared image memory for storing an image read using the infrared lamp 151 (to be referred to as an “infrared image” hereinafter); 24, a threshold value holding unit for holding a predetermined threshold value; 25, a dust/scratch detection unit; and 26, a dust/scratch correction unit.

[0011] FIG. 31 shows the spectral intensity distributions of the transparent document illumination lamp 144 and infrared lamp 151, and the characteristics of these lamps are represented by the solid and dot-dash-curves, respectively. FIG. 32 shows the spectral transmittance characteristics of cyan, yellow, and magenta dyes of a general negative/positive film, and the peak wavelength (about 880 nm) of the spectral intensity distribution of the infrared lamp 151. As is apparent from FIG. 32, most light components emitted by the infrared lamp are transmitted through a general color film irrespective of an image on the film since all dyes have very high transmittance at about 880 nm.

[0012] The transparent document reading operation including dust/scratch removal will be explained in detail below with reference to the flow chart shown in FIG. 33.

[0013] In step S10, the reflecting document illumination lamp 145 and infrared lamp 151 in FIG. 29 are turned off, and the transparent document illumination lamp 144 is turned on. At this time, an illumination light beam emitted by the transparent document illumination lamp 144 is uniformly diffused by the diffusion plate 143, and that diffused light beam is transmitted through the transparent document 142. The transmitted light beam passes through the mirror 147, inverted-V mirrors 148, and imaging lens 149, and is projected onto the CCD 150. An image projected onto the CCD 150 is converted into an electrical signal, which is temporarily stored in the image memory 22 via the I/F 21 in FIG. 30.

[0014] In step S20, the reflecting document illumination lamp 145 and transparent document illumination lamp 144 in FIG. 29 are turned off, and the infrared lamp 151 is turned on. An illumination light beam emitted by the infrared lamp 151 with the characteristics shown in FIG. 31 is uniformly diffused by the diffusion plate 143. The diffused light beam is transmitted through the transparent document 142, and passes through the mirror 147, inverted-V mirrors 148, and imaging lens 149. The light is then projected onto the CCD 150. Hence, the illumination light beam emitted by the infrared lamp 151 is transmitted through the transparent document 142 irrespective of an image (exposure) of the transparent document 142 such as a negative film, positive film, or the like, as shown in FIG. 32, and an image of dust, scratch, or like, which physically intercepts the optical path, is projected onto the CCD 150 as a shadow. The infrared image projected onto the CCD 150 is converted into the electrical signal, which is temporarily stored in the infrared image memory 23 via the I/F 21 in FIG. 30.

[0015] In step S30 and subsequent steps, dust/scratch detection and correction are executed. The principle of dust/scratch detection will be described in detail below.

[0016] FIGS. 34A to 34C illustrate the relationship between dust or the like, and the gray levels of images read using the transparent document illumination lamp 144 and infrared lamp 151, which are plotted in the main scan direction. In FIG. 34A, reference numeral 181 denotes a positive film; and 182, dust on the positive film 181. FIG. 34B shows the gray level obtained when a corresponding portion in FIG. 34A is read using the transparent document illumination lamp 144. The gray level assumes a lower value as an image becomes darker. The gray level of the dust portion 182 is low irrespective of an image on the positive film. FIG. 34C shows the gray level obtained when the portion in FIG. 34A is read using the infrared lamp 151. The dust portion 182 has low gray level since no infrared light is transmitted through there, and a portion other than the dust 182 has a nearly constant level 183 since infrared light is transmitted through there. Hence, a threshold value 184 is set at a gray level lower than the level 183, and a defect region 185 formed by dust can be detected by extracting a portion having a gray level equal to or lower than the threshold value 184.

[0017] The threshold value 184 is held in advance in the threshold value holding unit 24. Therefore, the dust/scratch detection unit 25 reads out this threshold value 184 from the threshold value holding unit 24, and compares it with infrared image data in turn in step S30, thus detecting the defect region 185.

[0018] If the infrared image data is smaller than the threshold value 184 (NO in step S30), the influence of dust 182 is eliminated by executing, e.g., an interpolation process of the defect region 185 based on a normal region around it in step S40. The comparison process is executed for all infrared image data, and when any defect region is detected, the corresponding normal image data undergoes interpolation (step S50).

[0019] However, the aforementioned prior art cannot normally detect a defect portion or erroneously detect even a normal portion as a defect portion due to insufficient detection precision. That is, the nearly constant level 183 of infrared rays that have been transmitted through the transparent document largely varies due to light amount errors of the infrared lamp 151, transmission errors depending on the type of color film at the emission wavelength of 880 nm of the infrared lamp 151, and sensitivity errors of the CCD 150 at the emission wavelength of 880 nm. For this reason, if the threshold value 184 is set as a fixed value, the level 183 assumes a value higher than the threshold value 184, and even a normal image portion is detected as a defect portion, or the threshold value 184 defines a gray level much lower than the level 183, and a defect region cannot be accurately detected.

SUMMARY OF THE INVENTION

[0020] The present invention has been made in consideration of the above situation, and has as its object to stably implement appropriate dust/scratch detection irrespective of the characteristics of the infrared lamp, the type of color film, and the sensitivity characteristics of the photoelectric conversion element, when a transparent document is read and a dust/scratch portion is corrected.

[0021] According to the present invention, the foregoing object is attained by providing a signal processing method for processing a visible light image signal and infrared image signal obtained by illuminating a transparent document with light beams respectively coming from a visible light source for mainly emitting visible light and an infrared light source for mainly emitting infrared light, and photoelectrically converting optical images of the transparent document, comprising a generation step of generating a histogram on the basis of the infrared image signal, a calculation step of calculating a threshold value on the basis of the histogram generated in the generation step, an extraction step of comparing the threshold value calculated in the calculation step with infrared image signal components, and extracting infrared image signal components not more than the threshold value, and an interpolation step of executing an interpolation process of the visible light image signal on the basis of the infrared image signal components extracted in the extraction step.

[0022] According to the present invention, the foregoing object is also attained by providing a signal processing apparatus for processing a visible light image signal and infrared image signal obtained by illuminating a transparent document with light beams respectively coming from a visible light source for mainly emitting visible light and an infrared light source for mainly emitting infrared light, and photoelectrically converting optical images of the transparent document, comprising generation means for generating a histogram on the basis of the infrared image signal, calculation means for calculating a threshold value on the basis of the histogram generated by the generation means, extraction means for comparing the threshold value calculated by the calculation means with infrared image signal components, and extracting infrared image signal components not more than the threshold value, and interpolation means for executing an interpolation process of the visible light image signal on the basis of the infrared image signal components extracted by the extraction means.

[0023] Further, the foregoing object is also attained by providing an image reading apparatus capable of reading a transparent document, comprising a visible light source for mainly emitting visible light, an infrared light source for mainly emitting infrared light, a photoelectric converter for converting an optical image into an electrical signal, generation means for generating a histogram on the basis of an infrared image signal obtained via the photoelectric converter by illuminating a transparent document with light emitted by the infrared light source, calculation means for calculating a threshold value on the basis of the histogram generated by the generation means, extraction means for comparing the threshold value calculated by the calculation means with infrared image signal components, and extracting infrared image signal components not more than the threshold value, and interpolation means for executing an interpolation process of a visible light image signal, obtained via the photoelectric converter by illuminating the transparent document with light emitted by the visible light source, on the basis of the infrared image signal components extracted by the extraction means.

[0024] Other features and advantages of the present invention will be apparent from the following description taken in conjunction with the accompanying drawings, in which like reference characters designate the same or similar parts throughout the figures thereof.

BRIEF DESCRIPTION OF THE DRAWINGS

[0025] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention.

[0026] FIG. 1 is a block diagram showing an arrangement of an image reading system according to an embodiment of the present invention;

[0027] FIG. 2 is a flow chart showing a process in a dust/scratch remover according to the embodiment of the present invention;

[0028] FIG. 3 is a flow chart showing a threshold value calculation process according to the first embodiment of the present invention;

[0029] FIGS. 4A to 4C show the relationship between dust on a film, and the gray levels obtained by reading a film using a transparent document illumination lamp and infrared lamp according to the first embodiment of the present invention;

[0030] FIG. 5 shows a histogram of an image read using the infrared lamp according to the first embodiment of the present invention;

[0031] FIGS. 6A to 6C show the relationship between dust on a film, and the gray levels obtained by reading a film using a transparent document illumination lamp and infrared lamp according to the second embodiment of the present invention;

[0032] FIG. 7 shows a histogram of an image read using the infrared lamp according to the second embodiment of the present invention;

[0033] FIGS. 8A to 8C show the relationship between dust on a film, and the gray levels obtained by reading a film using a transparent document illumination lamp and infrared lamp according to the third embodiment of the present invention;

[0034] FIG. 9 shows a histogram of an image read using the infrared lamp according to the third embodiment of the present invention;

[0035] FIGS. 10A to 10C show the relationship between dust on a film, and the gray levels obtained by reading a film using a transparent document illumination lamp and infrared lamp according to the fifth embodiment of the present invention;

[0036] FIG. 11 shows a histogram of an image read using the infrared lamp according to the fifth embodiment of the present invention;

[0037] FIG. 12 shows an image broken up into blocks according to the eighth embodiment of the present invention;

[0038] FIG. 13 is a graph showing the spectral transmittance characteristics of dyes of three colors in a color film of a given type, and the peak wavelength of the spectral intensity distribution of an infrared lamp;

[0039] FIGS. 14A to 14C show the relationship between dust on a film, and the gray levels obtained by reading a film using a transparent document illumination lamp and infrared lamp according to the eighth embodiment of the present invention;

[0040] FIGS. 15A to 15C show the relationship between dust on a film, and the gray levels obtained by reading a film using a transparent document illumination lamp and infrared lamp according to the ninth embodiment of the present invention;

[0041] FIGS. 16A to 16D show the relationship between dust on a film, and the gray levels obtained by reading a film using a transparent document illumination lamp and infrared lamp according to the seventh and eleventh embodiments of the present invention;

[0042] FIG. 17 is a top view when a film holder is set on a platen glass of an image reading apparatus according to the twelfth embodiment of the present invention;

[0043] FIGS. 18A and 18B show a read region that does not include the film holder, and the histogram of an image obtained by reading that region using an infrared lamp;

[0044] FIGS. 19A and 19B show a read region that includes the film holder, and the histogram of an image obtained by reading that region using the infrared lamp;

[0045] FIG. 20 is a flow chart showing the process in a dust/scratch remover according to the twelfth embodiment of the present invention;

[0046] FIG. 21 is a flow chart showing a holder shadow correction process according to the twelfth embodiment of the present invention;

[0047] FIG. 22 is a view for explaining the holder shadow correction process operation according to the twelfth embodiment of the present invention;

[0048] FIG. 23 is a view for explaining the holder shadow correction process operation according to the twelfth embodiment of the present invention;

[0049] FIG. 24 is a view for explaining the holder shadow correction process operation according to the twelfth embodiment of the present invention;

[0050] FIG. 25 is a view for explaining the holder shadow correction process operation according to the twelfth embodiment of the present invention;

[0051] FIG. 26 is a view for explaining the holder shadow correction process operation according to the twelfth embodiment of the present invention;

[0052] FIG. 27 is a view for explaining the holder shadow correction process operation according to the twelfth embodiment of the present invention;

[0053] FIG. 28 is a schematic view showing the arrangement of a conventional image reading apparatus;

[0054] FIG. 29 is a schematic view showing the arrangement of a conventional image reading apparatus that detects a defect region formed by dust or scratch on a transparent document;

[0055] FIG. 30 is a block diagram showing the arrangement of a conventional image reading system;

[0056] FIG. 31 is a graph showing the spectral intensity distributions of a transparent document illumination lamp and infrared lamp;

[0057] FIG. 32 is a graph showing the spectral transmittance characteristics of three different dyes in a general color film, and the peak wavelength of the spectral intensity distribution of an infrared lamp;

[0058] FIG. 33 is a flow chart showing a conventional process in a dust/scratch remover; and

[0059] FIGS. 34A to 34C show the relationship between dust on a film and the gray levels obtained by reading a film using the transparent document illumination lamp and infrared lamp in the prior art.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0060] Preferred embodiments of the present invention will be described in detail in accordance with the accompanying drawings.

[0061] <First Embodiment>

[0062] The first embodiment will be explained below. Note that the arrangement of an image reading apparatus used in the first embodiment is the same as that shown in FIG. 29, and a description thereof will be omitted.

[0063] FIG. 1 is a block diagram showing the functional arrangement of a dust/scratch remover 3 that executes a dust/scratch removal process of an image signal output from the image reading apparatus 1 of the first embodiment. In FIG. 1, a dust/scratch remover 3 is illustrated as an apparatus independent from the image reading apparatus 1, but may be incorporated in the image reading apparatus 1.

[0064] Referring to FIG. 1, reference numeral 21 denotes an interface (I/F) for inputting image data read by the image reading apparatus 1; 22, an image memory for storing an image read using the transparent document illumination lamp 144 or reflecting document illumination lamp 145 (to be referred to as a “normal image” hereinafter); 23, an infrared image memory for storing an image read using the infrared lamp 151 (to be referred to as an “infrared image” hereinafter); 25, a dust/scratch detection unit; and 26, a dust/scratch correction unit. In the first embodiment, the dust/scratch remover 3 also has a histogram generation unit 31 and threshold value determination/save unit 32.

[0065] The transparent document reading operation upon executing dust/scratch removal in the first embodiment will be described in detail below with reference to the flow chart in FIG. 2.

[0066] In step S10, the reflecting document illumination lamp 145 and infrared lamp 151 in FIG. 29 are turned off, and the transparent document illumination lamp 144 is turned on. At this time, an illumination light beam emitted by the transparent document illumination lamp 144 is uniformly diffused by the diffusion plate 143, and that diffused light beam is transmitted through the transparent document 142. The transmitted light beam passes through the mirror 147, inverted-V mirrors 148, and imaging lens 149, and is projected onto the CCD 150. An image projected onto the CCD 150 is converted into an electrical signal, which is temporarily stored in the image memory 22 via the I/F 21 in FIG. 1.

[0067] In step S20, the reflecting document illumination lamp 145 and transparent document illumination lamp 144 in FIG. 29 are turned off, and the infrared lamp 151 is turned on. An illumination light beam emitted by the infrared lamp 151 with the characteristics shown in FIG. 31 is uniformly diffused by the diffusion plate 143. The diffused light beam is transmitted through the transparent document 142, and passes through the mirror 147, inverted-V mirror 148, and imaging lens 149. The light is then projected onto the CCD 150. Hence, the illumination light beam emitted by the infrared lamp 151 is transmitted through the transparent document 142 irrespective of an image (exposure) of the transparent document 142 such as a negative film, positive film, or the like, as shown in FIG. 32, and an image of dust, scratch, or like, which physically intercepts the optical path, is projected onto the CCD 150 as a shadow. The infrared image projected onto the CCD 150 is converted into the electrical signal, which is temporarily stored in the infrared image memory 23 via the I/F 21 in FIG. 1.

[0068] In the first embodiment, a threshold value L2 to be used in step S30 is calculated using the infrared image data temporarily stored in the infrared image memory 23 (step S21). The calculation method will be described in detail below with reference to FIGS. 3 to 5.

[0069] FIG. 3 is a flow chart showing the calculation method of the threshold value L2 in step S21. FIG. 4A shows a state wherein dust 102 is present on a positive film 101, FIG. 4B shows the gray level obtained when a portion in FIG. 4A is read using the transparent document illumination lamp 144 shown in FIG. 29, and FIG. 4C shows the gray level obtained when the portion in FIG. 4A is read using the infrared lamp 151 in FIG. 29.

[0070] The histogram generation unit 31 in FIG. 1 reads out infrared image data from the infrared image memory 23 in step S210, and generates a histogram of the numbers of times of occurrence of gray levels in step S211.

[0071] FIG. 5 shows an example of a histogram generated based on the gray levels of an infrared image read out from the infrared image memory 23. The ordinate plots the frequencies of occurrence for respective pixels, and the abscissa plots the gray level. That is, a higher numerical value indicates brighter image data.

[0072] In step S212, the threshold value determination/save unit 32 calculates an intermediate value of the frequencies of occurrence of the generated histogram to obtain a corresponding gray level L1. Note that the intermediate value of the frequencies of occurrence is a value obtained by equally dividing the total of the frequencies of occurrence, and L1 represents the gray level when the sum of the frequencies of occurrence in ascending or descending order of gray level exceeds the intermediate value of the frequencies of occurrence. In general, since the occupation ratio of dust 102 in the overall image is small, the gray level L1 corresponding to the intermediate value of the frequencies of occurrence nearly equals the intermediate value of the gray levels of an image other than the dust 102. The gray levels of the dust 102 have a distribution, as indicated by 201 in FIG. 5, and are lower than the gray level L1 corresponding to the intermediate value of the frequencies of occurrence.

[0073] Therefore, in the first embodiment the intermediate value of the frequencies of occurrence of histogram data is noted, and a threshold value for detecting dust 102 is set at a gray level L2 a predetermined level &Dgr;L1 lower than this gray level L1 so as to locate it near the maximum value of the gray level distribution 201 of dust 102 (step S213). Note that this predetermined level &Dgr;L1 may be pre-set and stored in the threshold value determination/save unit 32, or the generated histogram and gray level L1 may be displayed on a display, and the user may manually input &Dgr;L1.

[0074] The threshold value determination/save unit 32 saves the threshold value L2 determined in this way, and the flow advances to step S30 in FIG. 2. In step S30, the dust/scratch detection unit 25 reads out the threshold value L2 from the threshold value determination/save unit 32, reads out infrared image data from the infrared image memory 23, and sequentially compares the infrared image data with the threshold value L2, thus detecting a defect region 105.

[0075] If the infrared image data of interest is smaller than the threshold value L2 (YES in step S30), it is determined that the image data falls within the defective region 105 where data is absent due to dust 102, and the influence of dust 102 is eliminated by executing, e.g., an interpolation process of the defect region 105 based on a normal region around it (step S40). On the other hand, if the infrared image data of interest is equal to or larger than the threshold value L2 (NO in step S30), it is determined that the data falls within a region free from any influence of dust or the like. The comparison process is done for all infrared image data (step S50), and if any defect region 105 is detected, an interpolation process is executed.

[0076] As described above, according to the first embodiment, the dust 102 can be nearly accurately detected as the defect region 105 detected using a threshold value level 104, i.e., the threshold value L2.

[0077] <Second Embodiment>

[0078] The second embodiment will be described below.

[0079] In the first embodiment, a histogram of the frequencies of occurrence of gray levels is generated, and the threshold value L2 is obtained by subtracting the predetermined level &Dgr;L1 from the gray level L1 corresponding to the intermediate value of the frequencies of occurrence. However, in the second embodiment, the threshold value is determined using a gray level corresponding to the maximum frequency of occurrence. Since the operations are the same as those in the first embodiment except for the threshold value determination method, a description thereof will be omitted. The threshold value determination operation will be described below with reference to FIGS. 6A to 6C and FIG. 7. The same reference numerals in FIGS. 6A to 6C and FIG. 7 denote common ones to those in FIGS. 4A to 4C and FIG. 5, and a description thereof will be omitted.

[0080] FIG. 6A shows a state wherein dust 102 is present on a positive film 101, FIG. 6B shows the gray level obtained when a portion in FIG. 6A is read using the transparent document illumination lamp 144 shown in FIG. 29, and FIG. 6C shows the gray level obtained when the portion in FIG. 6A is read using the infrared lamp 151 in FIG. 29.

[0081] FIG. 7 shows an example of a histogram generated based on the gray levels of an infrared image read out from the infrared image memory 23 as in the first embodiment. The ordinate plots the frequencies of occurrence for respective pixels, and the abscissa plots the gray level.

[0082] The threshold value determination/save unit 32 obtains a gray level L3 corresponding to the maximum frequency of occurrence from the histogram generated. In the example shown in FIG. 7, the gray level corresponding to the maximum frequency of occurrence is L3, as also indicated by 303 in FIG. 6C. Since the occupation ratio of dust 102 in the overall image is small, the gray level L3 corresponding to the maximum frequency of occurrence nearly equals the average value of the gray levels of an image other than the dust 102. The gray levels of the dust 102 have a distribution, as indicated by 201 in FIG. 7, and are lower than the gray level L3 corresponding to the maximum frequency of occurrence.

[0083] Therefore, the second embodiment obtains the gray level L3 corresponding to the maximum frequency of occurrence of histogram data, and sets a threshold value used to detect dust 102 at a gray level L4 a predetermined level &Dgr;L3 lower than this gray level L3 to locate it near the maximum value of the gray level distribution 201 of dust 102. Note that this predetermined level &Dgr;L3 may be pre-set and stored in the threshold value determination/save unit 32, or the generated histogram and gray level L3 may be displayed on a display, and the user may manually input &Dgr;L3.

[0084] In the second embodiment, the threshold value L4 obtained in this way is used in place of the threshold value L2 in step S30 in FIG. 2.

[0085] As described above, according to the second embodiment, the dust 102 can be nearly accurately detected as a defect region 305 detected using a threshold value level 304, i.e., the threshold value L4.

[0086] <Third Embodiment>

[0087] The third embodiment will be described below.

[0088] The third embodiment is substantially the same as the first and second embodiments, except that the threshold value is determined using a maximum gray level. Since the operations are the same as those in the first or second embodiment except for the threshold value determination method, a description thereof will be omitted. The threshold value determination operation will be described below with reference to FIGS. 8A to 8C and FIG. 9. The same reference numerals in FIGS. 8A to 8C and FIG. 9 denote common ones to those in FIGS. 4A to 4C and FIG. 5, and a description thereof will be omitted.

[0089] FIG. 8A shows a state wherein dust 102 is present on a positive film 101, FIG. 8B shows the gray level obtained when a portion in FIG. 8A is read using the transparent document illumination lamp 144 shown in FIG. 29, and FIG. 8C shows the gray level obtained when the portion in FIG. 8A is read using the infrared lamp 151 in FIG. 29.

[0090] FIG. 9 shows an example of a histogram generated based on the gray levels of an infrared image read out from the infrared image memory 23 as in the first embodiment. The ordinate plots the frequencies of occurrence for respective pixels, and the abscissa plots the gray level.

[0091] The threshold value determination/save unit 32 obtains a maximum gray level L5 from the histogram generated. In the example shown in FIG. 9, the maximum gray level of the entire image data is L5, as also indicated by 503 in FIG. 8C. Since the maximum gray level of the entire image corresponds to a portion where no dust 102 is present, the maximum gray level L5 becomes equal to the maximum gray level of an image other than the dust 102. The gray levels of the dust 102 have a distribution, as indicated by 201 in FIG. 9, and are lower than the maximum gray level L5.

[0092] Therefore, the third embodiment obtains this maximum gray level L5, and sets a threshold value used to detect dust 102 at a gray level L6 a predetermined level &Dgr;L5 lower than this gray level L5 to locate it near the maximum value of the gray level distribution 201 of dust 102. Note that this predetermined level &Dgr;L5 may be pre-set and stored in the threshold value determination/save unit 32, or the generated histogram and gray level L5 may be displayed on a display, and the user may manually input &Dgr;L5.

[0093] In the third embodiment, the threshold value L6 obtained in this way is used in place of the threshold value L2 in step S30 in FIG. 2.

[0094] As described above, according to the third embodiment, the dust 102 can be nearly accurately detected as a defect region 505 detected using a threshold value level 504, i.e., the threshold value L6.

[0095] <Fourth Embodiment>

[0096] The fourth embodiment will be described below.

[0097] The fourth embodiment determines a threshold value using an average gray level unlike in the first to third embodiments. Since the operations are the same as those in the first to third embodiments except for the threshold value determination method, a description thereof will be omitted. The threshold value determination operation will be described below.

[0098] As in the first embodiment, a histogram is generated on the basis of the gray levels of an infrared image read out from the infrared image memory 23. The threshold value determination/save unit 32 obtains an average gray level Lave of the histogram generated. The unit 32 obtains a threshold value Lth1 by subtracting a predetermined value &Dgr;Lave from Lave. This process can be described by:

Lth1=Lave−&Dgr;Lave

[0099] Note that this predetermined level &Dgr;Lave may be pre-set and stored in the threshold value determination/save unit 32, or the generated histogram and average gray level Lave may be displayed on a display, and the user may manually input &Dgr;Lave.

[0100] In the fourth embodiment, the threshold value Lth1 obtained in this way is used in place of the threshold value L2 in step S30 in FIG. 2.

[0101] As described above, according to the fourth embodiment, a dust portion can be nearly accurately detected as a defect region detected using the threshold value Lth1.

[0102] <Fifth Embodiment>

[0103] The fifth embodiment will be described below.

[0104] In the fifth embodiment, the values &Dgr;L1, &Dgr;L3, &Dgr;L5, and &Dgr;Lave used in the first to fourth embodiments are set using a standard deviation calculated from histogram data of an image read using the infrared lamp 151 in FIG. 29. This embodiment will be explained below with reference to FIGS. 10A to 10C and FIG. 11 taking as an example the method of determining a threshold value based on the gray level corresponding to the intermediate value of the frequencies of occurrence in the first embodiment. Note that the same reference numerals in FIGS. 10A to 10C and FIG. 11 denote common ones to those in FIGS. 4A to 4C and FIG. 5, and a description thereof will be omitted.

[0105] As shown in FIG. 11, a standard deviation &sgr; of a histogram generated based on the gray levels of an infrared image read out from the infrared image memory 23 is calculated. In general, since the occupation ratio of dust 102 in the overall image is small, the standard deviation &sgr; becomes nearly equal to that of the gray levels of an image other than the dust 102.

[0106] Then, a threshold value used to detect dust 102 is set at a gray level L7 the standard deviation &sgr;×k (k is an arbitrary positive value) lower than the gray level L1 corresponding to the intermediate value of the frequencies of occurrence so as to be located near the maximum value of the gray level distribution 201 of dust 102. Note that the value k can be appropriately determined depending on the method of one of the first to fourth embodiments used.

[0107] In the fifth embodiment, the threshold value L7 obtained in this way is used in place of the threshold value L2 in step S30 in FIG. 2.

[0108] As described above, according to the fifth embodiment, the dust 102 can be nearly accurately detected as a defect region 705 detected using a threshold value level 704, i.e., the threshold value L7.

[0109] <Sixth Embodiment>

[0110] The sixth embodiment will be described below.

[0111] The sixth embodiment determines a threshold value using the maximum gray level using a method different from that in the third embodiment which determines the threshold value using the maximum gray level L5. Note that a maximum gray level Lmax is the same as the maximum gray level L5 in the third embodiment. Since the operations are the same as those in the first to fifth embodiments except for the threshold value determination method, a description thereof will be omitted. The threshold value determination operation will be described below.

[0112] As in the first embodiment, a histogram is generated on the basis of the gray levels of an infrared image read out from the infrared image memory 23. The threshold value determination/save unit 32 obtains a maximum gray level Lmax of the histogram generated. The unit 32 then multiplies the maximum gray level Lmax by a predetermined coefficient n (<1) to obtain a threshold value Lth2. This process can be described by:

Lth2=Lmax×n

[0113] Note that this coefficient n may be pre-set and stored in the threshold value determination/save unit 32, or the generated histogram and maximum gray level Lmax may be displayed on a display, and the user may manually input the coefficient n.

[0114] In the sixth embodiment, the threshold value Lth2 obtained in this way is used in place of the threshold value L2 in step S30 in FIG. 2.

[0115] As described above, according to the sixth embodiment, a dust portion can be nearly accurately detected as a defect region detected using the threshold value Lth2.

[0116] <Seventh Embodiment>

[0117] The seventh embodiment will be described below.

[0118] The seventh embodiment determines a threshold value using the average and maximum gray levels unlike in the first to sixth embodiments. Note that an average gray level Lave is the same as the average gray level Lave in the fourth embodiment, and a maximum gray level Lmax is the same as the maximum gray level L5 as in the third embodiment. Since the operations are the same as those in the first to sixth embodiments except for the threshold value determination method, a description thereof will be omitted. The threshold value determination operation will be described below.

[0119] As in the first embodiment, a histogram is generated on the basis of the gray levels of an infrared image read out from the infrared image memory 23. The threshold value determination/save unit 32 obtains an average gray level Lave and maximum gray level Lmax of the histogram generated. The unit 32 then obtains a threshold value Lth3 by multiplying the difference between the maximum gray level Lmax and average gray level Lave by a predetermined coefficient n, and subtracting the obtained product from the average gray level Lave. This process can be described by:

Lth3=Lave−(Lmax−Lave)×n

[0120] Note that this coefficient n may be pre-set and stored in the threshold value determination/save unit 32, or the generated histogram, maximum gray level Lmax, and average gray level Lave may be displayed on a display, and the user may manually input the coefficient n.

[0121] In the seventh embodiment, the threshold value Lth3 obtained in this way is used in place of the threshold value L2 in step S30 in FIG. 2.

[0122] As described above, according to the seventh embodiment, a dust portion can be nearly accurately detected as a defect region detected using the threshold value Lth3.

[0123] <Eighth Embodiment>

[0124] The eighth embodiment will be described below.

[0125] In the first to seventh embodiments, a threshold value used to detect dust is set on the basis of histogram data of the entire image read using the infrared lamp 151 in FIG. 29. In the eighth embodiment, the entire image is broken up into blocks each having a predetermined size of M pixels×N pixels, as shown in FIG. 12, histograms are generated for respective blocks, and threshold values used to detect dust are set on the basis of those histograms. Such method of setting threshold values for respective blocks is effective upon reading a color film in which the transmittance of a cyan dye is insufficient.

[0126] FIG. 13 shows the spectral transmittance characteristics of dyes of three colors (yellow, magenta, cyan) in a color film of a given type, and the peak wavelength (about 880 nm) of the spectral intensity distribution of the infrared lamp 151. When an image on the film contains a cyan dye, since the transmittance of cyan at about 880 nm is lower than those of yellow and magenta, the gray levels of the read image of that portion lower, and grayscale data of a film image mixes in an infrared image. In such case, since threshold values are set for respective blocks, determination errors of a defect region can be eliminated.

[0127] The process in the eighth embodiment will be described below with reference to FIGS. 12 to 14C. Note that the same reference numerals in FIGS. 14A to 14C denote common ones to those in FIGS. 4A to 4C, and a description thereof will be omitted.

[0128] FIG. 14A shows a state wherein dust 102 is present on a positive film 101, FIG. 14B shows the gray level obtained when a portion in FIG. 14A is read using the transparent document illumination lamp 144 shown in FIG. 29, and FIG. 14C shows the gray level obtained when the portion in FIG. 14A is read using the infrared lamp 151 in FIG. 29. In the example of the eighth embodiment shown in FIGS. 14A to 14C, a grayscale data component 1001 of a positive image slightly mixes in in addition to dust 102 on the positive film 101.

[0129] Such infrared image is broken up into blocks each having a predetermined size, and histograms are calculated for respective blocks. Since the size of an objective region where the histogram is to be generated is reduced, the influence of the frequencies of occurrence of the grayscale data component 1001 of the positive image becomes larger, as shown in FIG. 14C, and a gray level 1002 corresponding to the central value of the frequencies of occurrence of the histogram becomes L8 which is &Dgr;L6 lower than L1 in the first embodiment.

[0130] Therefore, when a threshold value for dust detection is set by the same method as in the first embodiment, a threshold level 1003 (L9) becomes &Dgr;L1 lower than L8, and the dust 102 can be nearly accurately detected as a defect region 1004 without being influenced by the mixed grayscale data of the positive image, and determination errors of a cyan region can be eliminated.

[0131] In the eighth embodiment, the threshold value L9 obtained in this way is used in place of the threshold value L2 in step S30 in FIG. 2.

[0132] As described above, according to the eighth embodiment, since defect regions due to dust are calculated for respective blocks, even when grayscale data of a film image is in a portion other than dust of an image read using the infrared lamp 151, only the dust portion can be nearly accurately detected.

[0133] When a dust/scratch correction region is determined by combining defect regions detected for respective blocks in the eighth embodiment, and a defect region detected in the first to seventh embodiments, correction with higher accuracy can be achieved.

[0134] <Ninth Embodiment>

[0135] The ninth embodiment will be described below with reference to FIGS. 15A to 15C. Note that the same reference numerals in FIGS. 15A to 15C denote common ones to those in FIGS. 4A to 4C, and a description thereof will be omitted.

[0136] As has been explained in the first to eighth embodiments, since a threshold value for dust detection is set using histogram data of an infrared image read using the infrared lamp 151, only the dust portion can be nearly accurately detected. But this threshold value is set to be lower than the average value of a dust-free portion. Hence, a region to be detected is slightly narrower than a region which is actually influenced by dust.

[0137] Therefore, when a defect region 105 is detected by the method described in, e.g., the first embodiment, the ninth embodiment sets a range 1201 a predetermined size broader than the detected defect region 105 as an actual defect region, as shown in FIG. 15C.

[0138] Also, when the dust position on a read image using the transparent document illumination lamp 144 and that on a read image using the infrared lamp slight deviate from each other, the influence of such deviation can be greatly relaxed by applying the ninth embodiment.

[0139] <Tenth Embodiment>

[0140] The tenth embodiment will be described below with reference to FIGS. 16A to 16C. Note that the same reference numerals in FIGS. 16A to 16C denote common ones to those in FIGS. 4A to 4C, and a description thereof will be omitted.

[0141] The tenth embodiment will explain a method which is effective when the sharpness of dust on a read image using the infrared lamp is lower than that of dust on a read image using the transparent document illumination lamp 144. Such phenomenon may occur due to out of focus, i.e., so-called chromatic aberration of a lens, since the emission main wavelength of the infrared lamp is longer than the visible wavelength range (400 nm to 700 nm) used in an image read using the transparent document illumination lamp 144.

[0142] In such case, as shown in FIG. 16C, the grayscale data of a portion of dust 102 of an image read using the infrared lamp 151 becomes broader than an actual region of dust 102. At this time, when a threshold value L11 used to detect any defect region is set at a level 1302 &Dgr;L7 lower than a gray level 1301 corresponding to the intermediate value of the frequencies of occurrence of histogram data, i.e., L10, a detected defect region 1303 becomes broader than the actual dust region. Hence, in the tenth embodiment, a range 1304 a predetermined size narrower than the detected defect region 1303 is determined as an actual defect region as shown in FIG. 16C, thus allowing appropriate correction.

[0143] <Eleventh Embodiment>

[0144] The eleventh embodiment of the present invention will be described below with reference to FIGS. 16A to 16D.

[0145] The eleventh embodiment will explain a method which is effective when the sharpness of dust on a read image using the infrared lamp 151 is lower than that of dust on a read image using the transparent document illumination lamp 144, as in the tenth embodiment.

[0146] In the eleventh embodiment, when the grayscale data of a portion of dust 102 of an image read using the infrared lamp 151 appears in a region broader than an actual region of dust 102, as shown in FIG. 16C, the image read using the infrared lamp 151 temporarily undergoes edge correction, as shown in FIG. 16D, so as to set its sharpness to be nearly equal to that of dust on an image read using the transparent document illumination lamp 144. After that, since a threshold value used to detect any defect region is set at a level 1306, i.e., L13 which is &Dgr;L8 lower than a gray level 1305 corresponding to the average frequency of occurrence of histogram data, i.e., L12, the dust 102 can be nearly accurately detected as a defect region 1307, which is detected using the threshold level 1306.

[0147] In the eleventh embodiment, the method and amount of edge correction mentioned above are not particularly specified. When the sharpness of dust on an image read using the infrared lamp 151 impairs due to chromatic aberration of a lens, as described above, it is more effective to set the method and amount of edge correction so as to correct MTF deterioration components due to that chromatic aberration.

[0148] <Twelfth Embodiment>

[0149] The twelfth embodiment of the present invention will be described below. The twelfth embodiment will explain a case wherein a film holder is used upon reading a transparent document.

[0150] FIG. 17 is a top view when a film holder used to set a positive or negative film on the platen glass 14 of the image reading apparatus 1 upon reading a transparent document. Referring to FIG. 17, reference numeral 401 denotes a film holder as a whole, which is set at a predetermined position on the platen glass 14. Reference numeral 402 denotes a hole used to check the presence/absence and amount of light coming from the transparent document illumination lamp 144 and infrared lamp 151 using the CCD 150. An area 403 is used to set a sleeve type film 406, and an area 404 is used to set a mount type film 405.

[0151] Upon actually reading a film, the user selects a film region while confirming an image previewed on a display of a PC connected to the image reading apparatus 1, and the selected region is read.

[0152] When the film holder 401 shown in FIG. 17 is used, since the read range can be freely selected on a preview image, the selected range may include the film holder. When dust/scratch detection and correction are done in such case by the method described in the first, second, fourth, fifth, and seventh to eleventh embodiments, data of the film holder 401 mixes in upon calculating the threshold value. As a result, a desired threshold value cannot be obtained, and dust/scratches to be removed may remain.

[0153] When the film and a portion of the film holder 401 around the film are read using the infrared lamp 151, since the portion (to be referred to as a “holder shadow” hereinafter) does not transmit any infrared light, the CCD 150 outputs low gray levels (normally ranging from 0 to 50 in case of 255 gray levels).

[0154] FIG. 18A shows a read region that does not include the film holder 401, and FIG. 18B shows an example of a histogram of an infrared image obtained by reading the region shown in FIG. 18A. FIG. 19A shows a read region that includes the film holder 401, and FIG. 19B shows an example of a histogram of an infrared image obtained by reading the region shown in FIG. 19A. As can be seen from FIG. 19B, since the film holder 401 is present in the read region, the frequencies of occurrence of lower levels are higher than those in FIG. 18B.

[0155] When the method of calculating a threshold value using the standard deviation &sgr; described in the fifth embodiment is applied to the example shown in FIGS. 19A and 19B, if Ta represents a threshold value obtained when the read region does not include the film holder 401, since the standard deviation &sgr; obtained when the film holder 401 is included becomes large, a threshold value Tb is lower than Ta. That is, when the film holder 401 is included, dust/scratches having gray levels between Ta and Tb remain uncorrected.

[0156] The twelfth embodiment will explain a method which can prevent dust/scratches from remaining uncorrected due to a low threshold value of dust/scratch discrimination obtained when the film holder 401 is included in the read region.

[0157] FIG. 20 is a flow chart showing the dust/scratch removal operation in the twelfth embodiment. The difference between FIGS. 20 and 2 is that a holder shadow correction process (step S120) is added between steps S20 and S21. Since other operations are the same as those in FIG. 2, the same step numbers are assigned to them, and a description thereof will be omitted. The holder shadow process in step S120 will be described in detail below with reference to FIGS. 19A to 27.

[0158] Initially, it must be checked if the acquired infrared image includes a holder shadow. FIG. 22 partially shows a scan image with the film holder 401. Referring to FIG. 22, reference symbol D denotes pixels corresponding to a holder shadow; A, pixels printed with a normal document image; and B, pixels at a boundary between holder shadow pixels D and document pixels A. A film shadow appears on one of the four, upper, lower, right, and left sides of an image or a plurality of sides, as shown in FIG. 22. Since the holder shadow has a value lower than a given gray level, as described above, the holder shadow can be discriminated exploiting such nature. Therefore, a threshold value used to identify a holder shadow is set at Tsb in step S121.

[0159] In order to discriminate a holder shadow in an infrared image, the gray level is compared with the threshold value Tsb in turn from a pixel on the right side in step S122, as shown in FIG. 23. This comparison is made from the right side, and if the presence of a holder shadow pixel D is confirmed, the comparison continues until an end portion of holder shadow pixels D, i.e., a boundary pixel B in FIG. 22, appears. If the boundary pixel B appears, it is determined to be a boundary of the holder shadow, and a predetermined number of pixels are replaced by 255 (B′) in case of 255 gray levels, as shown in FIG. 23. The number of pixels to be replaced becomes larger with increasing resolution. For example, in FIG. 22, one pixel is replaced.

[0160] In step S123, the same process is also done from the lower side (FIG. 24). Furthermore, the same process is similarly done from the left and upper sides in steps S124 and S125.

[0161] It is checked in step S126 if a holder shadow is present. This step can be easily implemented by storing the presence/absence of pixels replaced by the value B′ in steps S122 to S125. If a holder shadow is not found, since holder shadow correction need not be made, the flow returns to step S21 in FIG. 20.

[0162] If a holder shadow is found (YES in step S126), the flow advances to step S127, a region B′ replaced by 255, and a holder shadow region D, are replaced by an average value V of the gray levels of the entire read region in turn from the right side, as shown in FIG. 25. In this replace process, if the pixel of interest is a holder shadow pixel D or replaced pixel B′ (level 255), it is replaced by the average value, and the next pixel is checked. If a pixel which is neither the pixel B′ (level 255) nor the holder shadow pixel D is found, the replace process to the average value ends (FIG. 26). Upon completion of the process from the right side, the same process is repeated from the lower, left, and upper sides in steps S128 (FIG. 27), S129, and S130.

[0163] The boundary pixels between the holder shadow pixels D and document image pixels A are replaced by the average value like in the holder shadow pixels D for the following reason. Since the gray level of the boundary between the holder shadow and document image changes not discontinuously but continuously, a boundary portion remains after the dust/scratch process if only holder shadow pixels are replaced, and the processed image has an unwanted false edge.

[0164] As described above, the number of boundary pixels to be replaced increases with increasing resolution. This is because the number of boundary pixels that remain in an image increases with increasing resolution.

[0165] Upon completion of the replace process to the average value, the flow returns to step S21 in FIG. 20.

[0166] As described above, when the holder shadow pixels D and boundary pixels B are replaced by the average value, the standard deviation &sgr; of an image becomes smaller than that obtained when those pixels are not replaced, upon calculating a threshold value using the standard deviation &sgr;. For this reason, a threshold value used in dust/scratch discrimination can be prevented from lowering, and an appropriate threshold value can be obtained. Since those pixels are replaced by the average value, the influence of the presence of the holder shadow can be minimized compared to a case wherein the holder shadow pixels D are completely erased, thus leading to appropriate dust/scratch removal.

[0167] In the twelfth embodiment, a method suitable for the method of calculating the threshold value using the standard deviation &sgr; has been explained. Alternatively, when the holder shadow pixels D and boundary pixels B are not replaced but are removed in steps S127 to S130 in FIG. 21, an appropriate threshold value can be calculated in the threshold value calculation method of the first, second, fourth, and seventh embodiments.

[0168] As described above, according to the twelfth embodiment, even when the read range includes the film holder, appropriate dust/scratch correction can be achieved.

[0169] <Other Embodiment>

[0170] The present invention can be applied to a system constituted by a plurality of devices or to an apparatus comprising a single device.

[0171] Further, the object of the present invention can also be achieved by providing a storage medium storing program codes for performing the aforesaid processes to a computer system or apparatus (e.g., a personal computer), reading the program codes, by a CPU or MPU of the computer system or apparatus, from the storage medium, then executing the program.

[0172] In this case, the program codes read from the storage medium realize the functions according to the embodiments, and the storage medium storing the program codes constitutes the invention.

[0173] Further, the storage medium, such as a floppy disk, a hard disk, an optical disk, a magneto-optical disk, CD-ROM, CD-R, a magnetic tape, a non-volatile type memory card, and ROM can be used for providing the program codes.

[0174] Furthermore, besides aforesaid functions according to the above embodiments are realized by executing the program codes which are read by a computer, the present invention includes a case where an OS (operating system) or the like working on the computer performs a part or entire processes in accordance with designations of the program codes and realizes functions according to the above embodiments.

[0175] Furthermore, the present invention also includes a case where, after the program codes read from the storage medium are written in a function expansion card which is inserted into the computer or in a memory provided in a function expansion unit which is connected to the computer, CPU or the like contained in the function expansion card or unit performs a part or entire process in accordance with designations of the program codes and realizes functions of the above embodiments.

[0176] The present invention is not limited to the above embodiments and various changes and modifications can be made within the spirit and scope of the present invention. Therefore to apprise the public of the scope of the present invention, the following claims are made.

Claims

1. A signal processing method for processing a visible light image signal and infrared image signal obtained by illuminating a transparent document with light beams respectively coming from a visible light source for mainly emitting visible light and an infrared light source for mainly emitting infrared light, and photoelectrically converting optical images of the transparent document, comprising:

a generation step of generating a histogram on the basis of the infrared image signal;

a calculation step of calculating a threshold value on the basis of the histogram generated in the generation step;

an extraction step of comparing the threshold value calculated in the calculation step with infrared image signal components, and extracting infrared image signal components not more than the threshold value; and

an interpolation step of executing an interpolation process of the visible light image signal on the basis of the infrared image signal components extracted in the extraction step.

2. The method according to claim 1, wherein the interpolation step includes the step of interpolating visible light image signal components corresponding to the infrared image signal components extracted in the extraction step using surrounding visible light image signal components.

3. The method according to claim 1, wherein the interpolation step includes the step of interpolating visible light image signal components, which correspond to an image region corresponding to the infrared image signal components extracted in the extraction step, and a region obtained by enlarging the image region by a predetermined size, using surrounding visible light image signal components.

4. The method according to claim 1, wherein the interpolation step includes the step of interpolating visible light image signal components, which correspond to a region obtained by reducing a region corresponding to the infrared image signal components extracted in the extraction step by a predetermined size, using surrounding visible light image signal components.

5. The method according to claim 1, further comprising an edge correction step of performing edge correction of the infrared image signal,

wherein the generation step includes the step of generating the histogram on the basis of the infrared image signal that has undergone edge correction, the extraction step includes the step of extracting infrared image signal components not more than the threshold value by comparing the threshold value calculated in the calculation step with the infrared image signal components that have undergone edge correction, and the interpolation step includes the step of interpolating visible light image signal components corresponding to the infrared image signal components extracted in the extraction step using surrounding visible light image signal components.

6. The method according to claim 5, wherein an edge correction amount in the edge correction step is set in association with the deterioration of the MTF of the visible light source and said infrared light source due to chromatic aberration.

7. The method according to claim 1, wherein the generation step includes the step of generating a histogram of frequencies of occurrence of respective gray levels of the infrared image signal.

8. The method according to claim 7, wherein the calculation step includes the step of calculating the threshold value by subtracting a value given by a predetermined relation from a gray level that represents the infrared image signal.

9. The method according to claim 8, wherein the calculation step further comprises:

a step of calculating a standard deviation; and

a step of determining the value to be subtracted on the basis of the standard deviation.

10. The method according to claim 7, wherein the calculation step comprises:

a step of calculating an intermediate value of the frequencies of occurrence of the histogram; and

a step of calculating the threshold value by subtracting a predetermined value from a gray level corresponding to the intermediate value.

11. The method according to claim 10, wherein the predetermined value is pre-stored.

12. The method according to claim 10, wherein the predetermined value is externally input.

13. The method according to claim 10, wherein the calculation step further comprises:

a step of calculating a standard deviation; and

a step of determining the predetermined value on the basis of the standard deviation.

14. The method according to claim 7, wherein the calculation step comprises:

a step of calculating a maximum frequency of occurrence of the histogram; and

a step of calculating the threshold value by subtracting a predetermined value from a gray level corresponding to the maximum frequency of occurrence of the histogram.

15. The method according to claim 14, wherein the predetermined value is pre-stored.

16. The method according to claim 14, wherein the predetermined value is externally input.

17. The method according to claim 14, wherein the calculation step further comprises:

a step of calculating a standard deviation; and

a step of determining the predetermined value on the basis of the standard deviation.

18. The method according to claim 7, wherein the calculation step comprises:

a step of calculating a maximum gray level of the histogram; and

a step of calculating the threshold value by subtracting a predetermined value from the maximum gray level.

19. The method according to claim 18, wherein the predetermined value is pre-stored.

20. The method according to claim 18, wherein the predetermined value is externally input.

21. The method according to claim 18, wherein the calculation step further comprises:

a step of calculating a standard deviation; and

a step of determining the predetermined value on the basis of the standard deviation.

22. The method according to claim 7, wherein the calculation step comprises:

a step of calculating an average gray level of the histogram; and

a step of calculating the threshold value by subtracting a predetermined value from the average gray level.

23. The method according to claim 22, wherein the predetermined value is pre-stored.

24. The method according to claim 22, wherein the predetermined value is externally input.

25. The method according to claim 22, wherein the calculation step further comprises:

a step of calculating a standard deviation; and

a step of determining the predetermined value on the basis of the standard deviation.

26. The method according to claim 7, wherein the calculation step comprises:

a step of calculating a maximum gray level of the histogram; and

a step of calculating the threshold value by multiplying the maximum gray level by a predetermined value.

27. The method according to claim 26, wherein the predetermined value is pre-stored.

28. The method according to claim 26, wherein the predetermined value is externally input.

29. The method according to claim 7, wherein the calculation step comprises:

a step of calculating a maximum gray level of the histogram;

a step of calculating an average gray level of the histogram; and

a step of calculating the threshold value by subtracting a product, which is obtained by multiplying a difference between the maximum gray level and the average gray level by a predetermined value, from the average gray level.

30. The method according to claim 29, wherein the predetermined value is pre-stored.

31. The method according to claim 29, wherein the predetermined value is externally input.

32. The method according to claim 1, further comprising the segmentation step of segmenting the infrared image signal into a plurality of blocks,

wherein the visible light image signal and infrared image signal are processed for respective blocks.

33. The method according to claim 1, further comprising:

a detection step of detecting signal components corresponding to a holder for holding the transparent document from the infrared image signal components; and

a replacement step of replacing, when the signal components corresponding to the holder are detected in the detection step, the signal components by a predetermined signal value.

34. The method according to claim 33, further comprising a step of calculating an average value of the infrared image signal,

wherein the predetermined signal value replaced in the replacement step is the average value.

35. The method according to claim 1, further comprising:

a detection step of detecting signal components corresponding to a holder for holding the transparent document from the infrared image signal components; and

a step of removing, when the signal components corresponding to the holder are detected in the detection step, the signal components.

36. A signal processing apparatus for processing a visible light image signal and infrared image signal obtained by illuminating a transparent document with light beams respectively coming from a visible light source for mainly emitting visible light and an infrared light source for mainly emitting infrared light, and photoelectrically converting optical images of the transparent document, comprising:

generation means for generating a histogram on the basis of the infrared image signal;

calculation means for calculating a threshold value on the basis of the histogram generated by said generation means;

extraction means for comparing the threshold value calculated by said calculation means with infrared image signal components, and extracting infrared image signal components not more than the threshold value; and

interpolation means for executing an interpolation process of the visible light image signal on the basis of the infrared image signal components extracted by said extraction means.

37. The apparatus according to claim 36, wherein said interpolation means interpolates visible light image signal components corresponding to the infrared image signal components extracted by said extraction means using surrounding visible light image signal components.

38. The apparatus according to claim 36, wherein said interpolation means interpolates visible light image signal components, which correspond to an image region corresponding to the infrared image signal components extracted by said extraction means, and a region obtained by enlarging the image region by a predetermined size, using surrounding visible light image signal components.

39. The apparatus according to claim 36, wherein said interpolation means interpolates visible light image signal components, which correspond to a region obtained by reducing a region corresponding to the infrared image signal components extracted by said extraction means by a predetermined size, using surrounding visible light image signal components.

40. The apparatus according to claim 36, further comprising edge correction means for performing edge correction of the infrared image signal,

wherein said generation means generates the histogram on the basis of the infrared image signal that has undergone edge correction, said extraction means extracts infrared image signal components not more than the threshold value by comparing the threshold value calculated by said calculation means with the infrared image signal components that have undergone edge correction, and said interpolation means interpolates visible light image signal components corresponding to the infrared image signal components extracted by said extraction means using surrounding visible light image signal components.

41. The apparatus according to claim 40, wherein an edge correction amount of said edge correction means is set in association with the deterioration of the MTF of the visible light source and infrared light source due to chromatic aberration.

42. The apparatus according to claim 36, wherein said generation means generates a histogram of frequencies of occurrence of respective gray levels of the infrared image signal.

43. The apparatus according to claim 42, wherein said calculation means calculates the threshold value by subtracting a value given by a predetermined relation from a gray level that represents the infrared image signal.

44. The apparatus according to claim 43, wherein said calculation means further comprises:

means for calculating a standard deviation; and

means for determining the value to be subtracted on the basis of the standard deviation.

45. The apparatus according to claim 42, wherein said calculation means comprises:

means for calculating an intermediate value of the frequencies of occurrence of the histogram; and

means for calculating the threshold value by subtracting a predetermined value from a gray level corresponding to the intermediate value.

46. The apparatus according to claim 45, wherein the predetermined value is pre-stored.

47. The apparatus according to claim 45, wherein the predetermined value is externally input.

48. The apparatus according to claim 45, wherein said calculation means further comprises:

means for calculating a standard deviation; and

means for determining the predetermined value on the basis of the standard deviation.

49. The apparatus according to claim 42, wherein said calculation means comprises:

means for calculating a maximum frequency of occurrence of the histogram; and

means for calculating the threshold value by subtracting a predetermined value from a gray level corresponding to the maximum frequency of occurrence of the histogram.

50. The apparatus according to claim 49, wherein the predetermined value is pre-stored.

51. The apparatus according to claim 49, wherein the predetermined value is externally input.

52. The apparatus according to claim 49, wherein said calculation means further comprises:

means for calculating a standard deviation; and

means for determining the predetermined value on the basis of the standard deviation.

53. The apparatus according to claim 42, wherein said calculation means comprises:

means for calculating a maximum gray level of the histogram; and

means for calculating the threshold value by subtracting a predetermined value from the maximum gray level.

54. The apparatus according to claim 53, wherein the predetermined value is pre-stored.

55. The apparatus according to claim 53, wherein the predetermined value is externally input.

56. The apparatus according to claim 53, wherein said calculation means further comprises:

means for calculating a standard deviation; and

means for determining the predetermined value on the basis of the standard deviation.

57. The apparatus according to claim 42, wherein said calculation means comprises:

means for calculating an average gray level of the histogram; and

means for calculating the threshold value by subtracting a predetermined value from the average gray level.

58. The apparatus according to claim 57, wherein the predetermined value is pre-stored.

59. The apparatus according to claim 57, wherein the predetermined value is externally input.

60. The apparatus according to claim 57, wherein said calculation means further comprises:

means for calculating a standard deviation; and

means for determining the predetermined value on the basis of the standard deviation.

61. The apparatus according to claim 42, wherein said calculation means comprises:

means for calculating a maximum gray level of the histogram; and

means for calculating the threshold value by multiplying the maximum gray level by a predetermined value.

62. The apparatus according to claim 61, wherein the predetermined value is pre-stored.

63. The apparatus according to claim 61, wherein the predetermined value is externally input.

64. The apparatus according to claim 42, wherein said calculation means comprises:

means for calculating a maximum gray level of the histogram;

means for calculating an average gray level of the histogram; and

means for calculating the threshold value by subtracting a product, which is obtained by multiplying a difference between the maximum gray level and the average gray level by a predetermined value, from the average gray level.

65. The apparatus according to claim 64, wherein the predetermined value is pre-stored.

66. The apparatus according to claim 64, wherein the predetermined value is externally input.

67. The apparatus according to claim 36, further comprising segmentation means for segmenting the infrared image signal into a plurality of blocks,

wherein the visible light image signal and infrared image signal are processed for respective blocks.

68. The apparatus according to claim 36, further comprising:

detection means for detecting signal components corresponding to a holder for holding the transparent document from the infrared image signal components; and

replacement means for, when said detection means detects the signal components corresponding to the holder, replacing the signal components by a predetermined signal value.

69. The apparatus according to claim 68, further comprising means for calculating an average value of the infrared image signal,

wherein the predetermined signal value replaced by said replacement means is the average value.

70. The apparatus according to claim 36, further comprising:

detection means for detecting signal components corresponding to a holder for holding the transparent document from the infrared image signal components; and

means for, when said detection means detects the signal components corresponding to the holder, removing the signal components.

71. An image reading apparatus capable of reading a transparent document, comprising:

a visible light source for mainly emitting visible light;

an infrared light source for mainly emitting infrared light;

a photoelectric converter for converting an optical image into an electrical signal;

generation means for generating a histogram on the basis of an infrared image signal obtained via said photoelectric converter by illuminating a transparent document with light emitted by said infrared light source;

calculation means for calculating a threshold value on the basis of the histogram generated by said generation means;

extraction means for comparing the threshold value calculated by said calculation means with infrared image signal components, and extracting infrared image signal components not more than the threshold value; and

interpolation means for executing an interpolation process of a visible light image signal, obtained via said photoelectric converter by illuminating the transparent document with light emitted by said visible light source, on the basis of the infrared image signal components extracted by said extraction means.

72. The apparatus according to claim 71, wherein said interpolation means interpolates visible light image signal components which correspond to the infrared image signal components extracted by said extraction means, and are obtained via said photoelectric converter by illuminating the transparent document with light emitted by said visible light source, using surrounding visible light image signal components.

73. The apparatus according to claim 71, wherein said interpolation means interpolates visible light image signal components, which correspond to an image region corresponding to the infrared image signal components extracted by said extraction means and a region obtained by enlarging the image region by a predetermined size, obtained via said photoelectric converter by illuminating the transparent document with light emitted by said visible light source using surrounding visible light image signal components.

74. The apparatus according to claim 71, wherein said interpolation means interpolates visible light image signal components, which correspond to a region obtained by reducing a region corresponding to the infrared image signal components extracted by said extraction means by a predetermined size, obtained via said photoelectric converter by illuminating the transparent document with light emitted by said visible light source using surrounding visible light image signal components.

75. The apparatus according to claim 71, further comprising edge correction means for performing edge correction of the infrared image signal which is obtained via said photoelectric converter by illuminating the transparent document with light emitted by said infrared light source,

wherein said generation means generates the histogram on the basis of the infrared image signal that has undergone edge correction, said extraction means extracts infrared image signal components not more than the threshold value by comparing the threshold value calculated by said calculation means with the infrared image signal components that have undergone edge correction, and said interpolation means interpolates visible light image signal components corresponding to the infrared image signal components extracted by said extraction means using surrounding visible light image signal components.

76. The apparatus according to claim 75, wherein an edge correction amount of said edge correction means is set in association with the deterioration of the MTF of said visible light source and said infrared light source due to chromatic aberration.

77. The apparatus according to claim 71, wherein said generation means generates a histogram of frequencies of occurrence of respective gray levels of the infrared image signal.

78. The apparatus according to claim 77, wherein said calculation means calculates the threshold value by subtracting a value given by a predetermined relation from a gray level that represents the infrared image signal.

79. The apparatus according to claim 78, wherein said calculation means further comprises:

means for calculating a standard deviation; and

means for determining the value to be subtracted on the basis of the standard deviation.

80. The apparatus according to claim 77, wherein said calculation means comprises:

means for calculating an intermediate value of the frequencies of occurrence of the histogram; and

means for calculating the threshold value by subtracting a predetermined value from a gray level corresponding to the intermediate value.

81. The apparatus according to claim 80, wherein the predetermined value is pre-stored.

82. The apparatus according to claim 80, wherein the predetermined value is externally input.

83. The apparatus according to claim 80, wherein said calculation means further comprises:

means for calculating a standard deviation; and

means for determining the predetermined value on the basis of the standard deviation.

84. The apparatus according to claim 77, wherein said calculation means comprises:

means for calculating a maximum frequency of occurrence of the histogram; and

means for calculating the threshold value by subtracting a predetermined value from a gray level corresponding to the maximum frequency of occurrence of the histogram.

85. The apparatus according to claim 84, wherein the predetermined value is pre-stored.

86. The apparatus according to claim 84, wherein the predetermined value is externally input.

87. The apparatus according to claim 84, wherein said calculation means further comprises:

means for calculating a standard deviation; and

means for determining the predetermined value on the basis of the standard deviation.

88. The apparatus according to claim 77, wherein said calculation means comprises:

means for calculating a maximum gray level of the histogram; and

means for calculating the threshold value by subtracting a predetermined value from the maximum gray level.

89. The apparatus according to claim 88, wherein the predetermined value is pre-stored.

90. The apparatus according to claim 88, wherein the predetermined value is externally input.

91. The apparatus according to claim 88, wherein said calculation means further comprises:

means for calculating a standard deviation; and

means for determining the predetermined value on the basis of the standard deviation.

92. The apparatus according to claim 77, wherein said calculation means comprises:

means for calculating an average gray level of the histogram; and

means for calculating the threshold value by subtracting a predetermined value from the average gray level.

93. The apparatus according to claim 92, wherein the predetermined value is pre-stored.

94. The apparatus according to claim 92, wherein the predetermined value is externally input.

95. The apparatus according to claim 92, wherein said calculation means further comprises:

means for calculating a standard deviation; and

means for determining the predetermined value on the basis of the standard deviation.

96. The apparatus according to claim 77, wherein said calculation means comprises:

means for calculating a maximum gray level of the histogram; and

means for calculating the threshold value by multiplying the maximum gray level by a predetermined value.

97. The apparatus according to claim 96, wherein the predetermined value is pre-stored.

98. The apparatus according to claim 96, wherein the predetermined value is externally input.

99. The apparatus according to claim 77, wherein said calculation means comprises:

means for calculating a maximum gray level of the histogram;

means for calculating an average gray level of the histogram; and

means for calculating the threshold value by subtracting a product, which is obtained by multiplying a difference between the maximum gray level and the average gray level by a predetermined value, from the average gray level.

100. The apparatus according to claim 99, wherein the predetermined value is pre-stored.

101. The apparatus according to claim 99, wherein the predetermined value is externally input.

102. The apparatus according to claim 71, further comprising segmentation means for segmenting the infrared image signal into a plurality of blocks,

wherein the visible light image signal and infrared image signal are processed for respective blocks.

103. The apparatus according to claim 71, further comprising:

detection means for detecting signal components corresponding to a holder for holding the transparent document from the infrared image signal components; and

replacement means for, when said detection means detects the signal components corresponding to the holder, replacing the signal components by a predetermined signal value.

104. The apparatus according to claim 103, further comprising means for calculating an average value of the infrared image signal,

wherein the predetermined signal value replaced by said replacement means is the average value.

105. The apparatus according to claim 71, further comprising:

detection means for detecting signal components corresponding to a holder for holding the transparent document from the infrared image signal components; and

means for, when said detection means detects the signal components corresponding to the holder, removing the signal components.

106. A computer program product comprising a computer usable medium having computer readable program code means embodied in said medium for a signal processing method for processing a visible light image signal and infrared image signal obtained by illuminating a transparent document with light beams respectively coming from a visible light source for mainly emitting visible light and an infrared light source for mainly emitting infrared light, and photoelectrically converting optical images of the transparent document, said product including:

first computer readable program code means for generating a histogram on the basis of the infrared image signal;

second computer readable program code means for calculating a threshold value on the basis of the generated histogram;

third computer readable program code means for comparing the calculated threshold value with infrared image signal components, and extracting infrared image signal components not more than the threshold value; and

fourth computer readable program code means for executing an interpolation process of the visible light image signal on the basis of the extracted infrared image signal components.