Image display apparatus and image display method

Info

Publication number: 20060181543
Type: Application
Filed: Apr 5, 2006
Publication Date: Aug 17, 2006
Applicant: Olympus Corporation (Tokyo)
Inventors: Masaya Katsumata (Sagamihara-shi), Toru Wada (Niiza-shi), Takeyuki Ajito (Hachioji-shi), Yasuhiro Komiya (Hino-shi)
Application Number: 11/397,970

Abstract

When an image of a certain band in a multiband image obtained by a multiband camera capable of capturing at least two bands is displayed with a computer and at least one pixel is specified on the image, a spectrum computing section estimates a spectrum from the signal value of at least one pixel specified in the multiband image and displays the spectrum on a spectrum output screen.

Description

Description

CROSS REFERENCE TO RELATED APPLICATIONS

This is a Continuation Application of PCT Application No. PCT/JP2004/014847, filed Oct. 7, 2004, which was published under PCT Article 21(2) in Japanese.

This application is based upon and claims the benefit of priority from prior Japanese Patent Application No. 2003-348625, filed Oct. 7, 2003, the entire contents of which are incorporated herein by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an image display apparatus and an image display method which display spectral graphs, chromaticity values, and relative values of a plurality of object points from a multiband image captured by a multiband camera.

2. Description of the Related Art

A multiband camera is a camera/that captures in a plurality of bands having more specific wavelength transmission characteristics than those of the R, G, B filters of an ordinary 3-band color camera. As means for switching bands, a wavelength variable filter as disclosed in Jpn. Pat. Appln. KOKAI Publication 2001-99710 may be used, or a rotating filter as disclosed in U.S. Pat. No. 6,549,653 may be used. Although the number of bands differs, depending on the apparatus and purpose, the transmittance characteristic in each band is as shown in FIG. 2 of Jpn. Pat. Appln. KOKAI Publication 2001-99710.

Since there are generally as many captured images as there are bands, there are 16 images in 16 bands, as shown in FIG. 2 of Jpn. Pat. Appln. KOKAI Publication 2001-99710, and there are 10 images in 10 bands with a rotating filter, as shown in FIG. 5B of U.S. Pat. No. 6,549,653.

Multiband image captured by a multiband camera can be displayed in images band by band.

BRIEF SUMMARY OF THE INVENTION

According to a first aspect of the present invention, there is provided an image display apparatus which displays a multiband image obtained by a multiband camera capable of capturing at least two bands, the image display apparatus comprising:

an image display section configured to display an image of a certain band in the multiband image;

a pixel specifying section configured to specify at least one pixel on the image of the certain band displayed on the image display section;

a spectrum estimation section configured to estimate a spectrum from the signal value of the at least one pixel specified by the pixel specifying section in the multiband image; and

a spectrum display section configured to display the spectrum estimated by the spectrum estimation section.

According to a second aspect of the present invention, there is provided an image display apparatus which displays a multiband image obtained by a multiband camera capable of capturing at least two bands, the image display apparatus comprising:

an image display section configured to display an image of a certain band in the multiband image;

a pixel specifying section configured to specify at least two pixels in the image of the certain band displayed on the image display section;

a spectrum computing section configured to determine the spectrum of each of the pixels specified by the pixel specifying section; and

a display section configured to select the spectrum of one specified pixel serving as a reference determined by the spectrum computing section from the pixels specified by the pixel specifying section and display a relative value of the spectrum of another specified pixel determined by the spectrum computing section with respect to the selected spectrum.

According to a third aspect of the present invention, there is provided an image display method which displays a multiband image obtained by a multiband camera capable of capturing at least two bands, the image display method comprising:

displaying an image of a certain band in the multiband image;

specifying at least one pixel on the image of the displayed certain band;

estimating a spectrum from the signal value of the specified at least one pixel in the multiband image; and

displaying the estimated spectrum.

According to a fourth aspect of the present invention, there is provided an image display method which displays a multiband image obtained by a multiband camera capable of capturing at least two bands, the image display method comprising:

displaying an image of a certain band in the multiband image;

specifying at least two pixels in the image of the displayed certain band;

determining the spectrum of each of the specified pixels; and

selecting the determined spectrum of one specified pixel serving as a reference from the specified pixels and displaying a relative value of the determined spectrum of another specified pixel with respect to the selected spectrum.

According to a fifth aspect of the present invention, there is provided an image display apparatus which displays a multiband image obtained by a multiband camera capable of capturing at least two bands, the image display apparatus comprising:

image display means for displaying an image of a certain band in the multiband image;

pixel specifying means for specifying at least one pixel on the image of the certain band displayed on the image display means;

spectrum estimation means for estimating a spectrum from the signal value of the at least one pixel specified by the pixel specifying means in the multiband image; and

spectrum display means for displaying the spectrum estimated by the spectrum estimation means.

According to a sixth aspect of the present invention, there is provided an image display apparatus which displays a multiband image obtained by a multiband camera capable of capturing at least two bands, the image display apparatus comprising:

image display means for displaying an image of a certain band in the multiband image;

pixel specifying means for specifying at least two pixels in the image of the certain band displayed on the image display means;

spectrum computing means for determining the spectrum of each of the pixels specified by the pixel specifying means; and

display means for selecting the spectrum of one specified pixel serving as a reference determined by the spectrum computing means from the pixels specified by the pixel specifying means and displaying a relative value of the spectrum of another specified pixel determined by the spectrum computing means with respect to the selected spectrum.

Advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. Advantages of the invention may be realized and obtained by means of the instrumentalities and combinations particularly pointed out hereinafter.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING

The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments of the invention, and together with the general description given above and the detailed description of the embodiments given below, serve to explain the principles of the invention.

FIG. 1 shows the configuration of an image display apparatus according to a first embodiment of the present invention;

FIG. 2 shows a band image screen;

FIG. 3 shows an interpolation method selection screen;

FIG. 4 shows a spectrum output screen;

FIG. 5 shows the configuration of a modification of the image display apparatus according to the first embodiment;

FIG. 6 shows a band image screen on which a band image is displayed when a color chip is captured;

FIG. 7 shows a reference image screen on which a created reference image is displayed;

FIG. 8 shows a band selection screen;

FIG. 9 shows an interpolation method selection screen in the modification;

FIG. 10 shows the configuration of another modification of the image display apparatus according to the first embodiment;

FIG. 11 is a graph showing the relative values of signal values (luminances) using area 1 as a reference;

FIG. 12 shows the configuration of still another modification of the image display apparatus according to the first embodiment;

FIG. 13 shows a display example in an image display apparatus according to a second embodiment of the present invention;

FIG. 14 shows another display example in the image display apparatus according to the second embodiment;

FIG. 15 shows still another display example in the image display apparatus according to the second embodiment;

FIG. 16 shows that a reference area is specified with a mouse in an image display apparatus according to a third embodiment of the present invention;

FIG. 17 shows a color difference image displayed as a result of the specification; and

FIG. 18 shows another display example in the image display apparatus according to the third embodiment.

DETAILED DESCRIPTION OF THE INVENTION

Hereinafter, referring to the accompanying drawings, the best mode for carrying out the invention will be explained.

First Embodiment

As a first embodiment of the present invention, a method of displaying a single level spectrum in an arbitrary place on an image will be explained.

In an image display apparatus of the first embodiment, a multiband camera 1 is controlled by a computer 11 as shown in FIG. 1. The multiband camera 1 generally incorporates a CCD as an image capturing element, captures images, converts the images into electronic image data, and sends the image data to the computer 11. The captured images are present in the form of a multiband image 12 on a memory managed by the computer 11. The images may be captured as needed. Alternatively, previously captured images may be read from a storage medium, such as a hard disk, and developed as a multiband image 12 on the memory. Therefore, when the processes in the embodiment are carried out, the multiband camera 1 is not necessarily used.

The computer 11 calculates a spectrum from the multiband image 12 at a spectrum computing section 13 and displays a graph on a spectrum output screen 14. In this embodiment, an IBM PC-AT compatible machine is used as the computer 11 and Windows® 2000 is used as the OS. The spectrum output screen 14 is a window screen managed by Windows® 2000 and is displayed on a monitor, such as a CRT.

If the multiband camera 1 has 18 bands, the multiband image 12 is composed of 18 band images. The computer 11 displays an image of the band specified by the user. For example, an image of band 6 is displayed as shown in FIG. 2. While looking at the band image screen 15, the user specifies the place of the spectrum the user wants to display. In the example of FIG. 2, five rectangles have been specified using the drag and drop function (a method of specifying the top right and top left of the rectangular) of a mouse as a pointing device of the computer 1. The number of areas and the shapes of areas may differ, depending on the user. In this case, too, the different numbers and shapes are within the scope of this embodiment.

Then, when the user selects the menu “Spectral display of signal values” (not shown), the computer 11 displays a GUI as shown in FIG. 3, that is, an interpolation method selection screen 16 to prompt the user to select an interpolation method.

If linear interpolation is selected on such an interpolation method selection screen 16, the computer 11 calculates the pixel values in each rectangle at the spectrum computing section 13, that is, calculates the average value of the signal values of the CCD elements of the multiband camera 1. Then, the luminances are plotted band by band and connected with straight lines to form a graph. This graph is displayed as a spectrum output screen 14 as shown in FIG. 4. The ordinate axis of the graph indicates the intensity of the signal. If the output of the CCD element contains 16 bits, the signal intensity (luminance) can take a value in the range from 0 to 65535. The abscissa axis indicates wavelength. In this example, band 1 has a central wavelength of 380 nm and band 2 has a central wavelength of 418 nm. Similarly, luminances are plotted using the central wavelengths of up to band 18. Since the selected interpolation method is linear interpolation in this example, the space between bands is interpolated with a straight line. At the top right of the spectrum output screen 14, an area selection list box 141 is provided. Selecting the area selection list box 141 makes it possible to observe the signal intensity spectrum in each area specified on the band image screen 15, while switching areas as needed.

In addition, when the user selects spline interpolation on the interpolation method selection screen 16 of FIG. 3, the user selects an interpolation interval from 10 nm, 5 nm, and 1 nm and determines an x-coordinate and a y-coordinate in band 1 to band 18 as in linear interpolation and then makes spline correction.

As described above, a signal level spectrum in an arbitrary place on the image can be displayed.

A method of displaying a dispersion spectrum in an arbitrary place on the image will be explained as a modification of the embodiment.

In this case, as shown in FIG. 5, a reference image 17 is added to the same configuration as that of FIG. 1. The spectrum computing section 13 calculates a dispersion spectrum.

Specifically, a dispersion spectrum is displayed in graph form in such a manner that spectral reflectivity is used for an ordinary object and that, when a transmitting object is observed as under a microscope, spectral transmittance is used. Therefore, an image serving as a reference for calculating the reflectivity or transmittance, that is, a reference image 17, is needed. When a reflectivity spectrum is found, the reference image 17 is an image obtained by capturing a standard white plate as an object. When a transmittance spectrum is determined, only an image with illuminating rays from which the object to be observed has been removed is used as the reference image 17.

Specifically, the reference image 17 is captured in such a manner that a capturing subject is replaced with a standard white plate in the same sequence as capturing a multiband image 12. Thus, capturing has to be done once more to capture such a standard white plate, in addition to capturing the multiband image 12. However, if a reference place can be captured together with the multiband image 12, the image to be multiband-captured need solely be captured.

Hereinafter, the method will be explained. FIG. 6 shows a band image screen 15 on which the user-specified band image or a band image set as an initial one of the multiband image 12 obtained by capturing a capturing subject is displayed. In this example, color chips are capturing subjects. If any one of the color chips has a reflectivity of almost 100%, it may be defined as being treated similarly as the standard white plate. In this example, the rectangle at the bottom left of FIG. 6 corresponds to the place. The user specifies the place by a drag and drop operation with the mouse. Alternatively, the computer 11 may recognize the place automatically. In this example, the specified place is shown by a rectangle 151. The computer 11 creates a reference image 17 using the average value of the signal values (luminances) of the rectangle 151. The reference image 17 thus created is displayed on a reference image screen 18 as shown in FIG. 7, thereby prompting the user to acknowledge it.

Since an object whose reflectivity is 100% with respect to a light source is ideal for the reference image 17, a GUI as shown in FIG. 8, that is, a band selection screen 19, is displayed to find a place where the signal value (luminance) is high, one of the mouse positions or a plurality of pixels is defined as an area, and then the signal values (luminances) of the pixels are displayed, which makes it easier to make evaluations of the signal values. Here, the part below “Level” at the middle right of FIG. 8 indicates band numbers 191. In the part, band 1 to band 18 are displayed. Values “(1974, 0)” to the left of “Level” represent the mouse position on the image displayed on the present band image screen 15. Numbers below that represent signal values. For example, in band 1, “176( 1/256)” is displayed, which means that the signal value is 176 in 16-bit data. Since the display of the computer 11 often represents luminance in 256 tones in the range of 0 to 255, the numbers in the parentheses indicate the equivalent value in the 256-tone conversion. In this case, the value is 1.

The spectrum computing section 13 calculates spectral reflectivity/transmittance and displays the results on the spectrum output screen 14. The method will be explained following its procedure. The place of an object whose spectral reflectivity/transmittance spectrums are to be displayed is specified on the multiband image 12 of the object. FIG. 2 shows the way the place is specified. The input method follows the above-described procedure. The image is paired with the reference image 17. The creating method is to create a reference image from a photographic subject as described above or to capture a new image of a reference plate alone.

Next, the reflectivity/transmittance is determined. In this example, since color chips are used, the reflectivity is determined. The reflectivity can be determined using the following equation.

The reflectivity in a specified band of a capturing subject=(the average value of specified areas in the specified band of the capturing subject)/(the average value of specified areas in the specified band of the reference image) Since in the example of FIG. 2, the number of bands is 18, a value is determined band by band. Since there are five specified areas, the reflectivity is determined in each area. For example, suppose area 1 at the bottom left of FIG. 2 is a white plate. When the reference image 17 is created from this place by the above-described method, the reflectivity in area 1 is 1 for all of the bands. Since the signal value must be generally smaller than that of the reference image 17 in the remaining areas, this usually gives 0≦reflectivity≦1.0.

Then, the determined reflectivity is displayed on the spectrum output screen 14 in graph form. In this case, too, the user is allowed to select an interpolation method from a GUI as shown in FIG. 9, that is, on the interpolation method selection screen 20. In the state shown in FIG. 9, linear interpolation has been selected. A method of plotting a graph follows the same procedure as making a graph display of the aforementioned signal level spectrum. That is, the position of the central wavelength of the filter used in each band is determined on the abscissa axis of the graph in FIG. 4 by wavelength conversion and the values of reflectivity are plotted on the ordinate axis. Accordingly, while the ordinate axis indicates signal values in the aforementioned case, plotting is generally done with the maximum value being 1.0 in the case of spectral reflectivity. In linear interpolation, the space between plots is interpolated with a straight line as described above, thereby completing a spectral graph.

Furthermore, when spline interpolation has been selected as the interpolation method on the interpolation method selection screen 20 of FIG. 9, approximation is performed using a spline curve after the user is caused to determine whether to carry out interpolation at intervals of 10 nm, 5 nm, or 1 nm.

Using FIGS. 6 and 7, the way the user creates the reference image 17, while checking the image with the user's own eyes, has been explained. In addition to this, a modification of the method of creating the reference image 17 will be explained.

A reference plate is such that it ideally reflects 100% of illuminating light. Therefore, if there is a place corresponding to the reference plate in a band image displayed on the band image screen 15 of FIG. 6, the luminance of the signal in that place must be higher than the other. Thus, the signal values (luminances) of all of the pixels in a band image as shown in FIG. 6 are checked and the values are arranged in decreasing order of brightness. Then, of them, 30 pixels are used as image information in the position of the reference plate, beginning with the brightest one. From the average value of the signal values of the 30 pixels, the reference image 17 as shown on the reference image screen 18 of FIG. 7 can be created.

As another modification of the embodiment, a method of creating the reference image 17 with an overexposed part removed will be explained. In the case of a band image as displayed on the band image screen 15 of FIG. 6, even if the user thought he or she capture the band image with a suitable exposure time, there is a possibility that a part of the image will be very bright. For example, since the material of the reference plate and the lighting position have been adjusted, the specular reflection part are often removed. In contrast, when a regular reference plate cannot be prepared or when the lighting condition cannot be made proper, it is conceivable that the part of the image to be referred to includes a specular reflection part. In such a case, after the signal values (luminances) of all of the pixels in the band image are checked and then are arranged in decreasing order of brightness, those equal to or higher than a specific luminance are removed. For example, if the maximum value of the signal value is 255, the signal values equal to or larger than 240 out of the arranged pixels are removed because they belong to the specular reflection part. Then, from the remaining pixels, 30 pixels with higher luminance can be used to create the reference image 17 by the same method. Although in the example, the threshold has been set at 240, a similar method holds with other values, depending on the input means for a multiband image 12, the width of the signal value, the capturing object, or the user's specification.

Next, an example of estimating a dispersion spectrum by a spectrum estimation method as disclosed in U.S. Pat. No. 6,549,653 will be explained.

FIG. 10 shows such configuration. The configurations and functions of the multiband camera 1, computer 11, multiband image 12, and spectrum output screen 14 are the same as those in FIG. 1. A dispersion spectrum is estimated at the spectrum computing section 13. The estimation method has been described in U.S. Pat. No. 6,549,653. The file necessary for the estimation is prepared in the form of a characteristic file 21. The spectrum computing section 13 refers to the characteristic file 21.

Next, the procedure will be explained. As heretofore, an image is displayed as shown in FIG. 2, which helps the user to specify a place where the user wants to calculate a spectrum. In FIG. 2, five areas have been specified. Thereafter, when the user has selected a spectral reflectivity/spectral transmittance spectrum display menu, an interpolation method selection screen 20 in FIG. 9 is displayed. Then, when “Estimation” has been selected as the interpolation method, a spectrum is estimated in the five areas previously selected by the method disclosed in U.S. Pat. No. 6,549,653. The result is represented in a graph as shown in FIG. 4. In this case, the ordinate axis indicates reflectivity, which generally takes a value in the range of 0 to 1.0 with the maximum value being 1.0.

In any of the above methods, the area has been specified using a band image screen 15 as shown in FIG. 2. However, if the estimation process is executed at such a high speed that the user does not feel stressed, the user is able to select one pixel or a plurality of pixels with the mouse and the spectrum in that place may be calculated in real time and displayed. Alternatively, for example, area 1 to area 5 may be specified in advance by a mixture of these methods and area 6 may be set in the present mouse position and the spectrum be displayed there.

Furthermore, while the spectrums in a plurality of areas have been compared by displaying a graph for each area as shown in FIG. 4 and changing the selection of areas, the window of FIG. 4 may be created for each area and those areas be arranged in tile form, thereby making it possible to compare them. Alternatively, colors may be changed on an area-by-area basis in a single window and be displayed at the same time. Moreover, when signals values or spectrums of spectral reflectivity/transmittance spectrums are compared relatively, relative values with a certain area as a reference may be displayed as shown in FIG. 11. In FIG. 11, the ordinate axis indicates the relative values of signal values (luminances) using area 1 as a reference and a graph display is made.

Furthermore, as shown in FIG. 12, the configuration of FIG. 5 may be combined with the configuration of FIG. 10, thereby enabling the user to select one of them as needed.

In the above-described method, it is possible to specify a place where the user wants to determine a spectrum in an image and display a graph. Even when there are a plurality of estimation methods, it is possible to select one of them. When a reference image 17 is created, it can be created from the specified area. The above method enables the user to specify the place where the user wants to display a spectrum, while looking at the image and to display the spectrum in the area. Since the user can change areas one after another in which a graph is to be drawn, this produces the effect of enabling the user to distinguish the spectrums in individual areas at a glance.

Second Embodiment

Next, a second embodiment of the present invention will be explained. The second embodiment is such that a specific area is specified on a multiband image captured by a multiband camera 1 and the chromaticity value and chromaticity diagram of the place are displayed.

Since a chromaticity value is estimated from spectral reflectivity/transmittance spectrums, the configuration is the same as in the first embodiment. Specifically, first, the spectrum computing section 13 calculates spectral reflectivity/transmittance spectrums by the method explained in the first embodiment. Thereafter, a chromaticity value is determined by a method described later. The result is displayed on a screen in the same window or in another window as on the spectrum output screen 14. Since a chromaticity value is found from the spectral reflectivity/transmittance spectrums, the configuration of FIG. 1, FIG. 5, FIG. 10, or FIG. 12 can be considered, depending on the estimation method.

Next, a method of displaying the chromaticity values XYZ, xyz, and L*,a*,b* will be explained.

First, the user specifies a part whose color the user wants to measure and estimates the spectral reflectivity/transmittance spectrum in the place. The method is as explained in the first embodiment. As a result, suppose the estimated spectral reflectivity/transmittance spectrum is R(λ). In this embodiment, suppose λ is determined at intervals of 1 nm in the range from 380 nm to 780 nm. If illuminating light is S(λ), XYZ are expressed as follows:
X=KΣS(λ)x(λ)R(λ)
Y=KΣS(λ)y(λ)R(λ)
Z=KΣS(λ)z(λ)R(λ)
K=100/(ΣS(λ)y(λ))
where x(λ), y(λ), and z(λ) are the values of a color matching function in an XYZ color system and λ is in the range from 380 to 780 in Σ. From the XYZ determined here, xyz can be determined using the following equations:
x=X/(X+Y+Z)
y=Y/(X+Y+Z)
z=Z/(X+Y+Z)
Furthermore, if rendering illuminating light is e(λ), when L*,a*,b* are calculated, they are expressed by the following formulas: $\begin{matrix} L^{*} = 116 \cdot {(\frac{Y}{Y_{0}})}^{\frac{1}{3}} - 16 & X_{0} = \sum_{λ = 380}^{780} x (λ) \cdot e (λ) \\ a^{*} = 500 \cdot {(\frac{X}{X_{0}})}^{\frac{1}{3}} - {(\frac{Y}{Y_{0}})}^{\frac{1}{3}} & Y_{0} = \sum_{λ = 380}^{780} y (λ) \cdot e (λ) \\ b^{*} = 200 \cdot {(\frac{Y}{Y_{0}})}^{\frac{1}{3}} - {(\frac{Z}{Z_{0}})}^{\frac{1}{3}} & Z_{0} = \sum_{λ = 380}^{780} z (λ) \cdot e (λ) \end{matrix}$
The values determined from the above formulas are displayed in a window 22 as shown in FIG. 13. On the right side of the window 22, the following are shown: (x, y) is (0.313, 0.329), Y is 99.993, and (L*, a*, b*) is (99.997, 0.000, 0.002) in area 1. Moreover, the values of (x, y) are plotted in a chromaticity diagram 221 on the left side of the window 22. In this example, since two areas have been defined, plotting is done for each of the areas (point 222-1, point 222-2).

Taking the user's convenience into account, those closest to the colors the computer 11 can display are displayed in a bell shape 223, the visible region in the chromaticity diagram 221 (where the bottom right of the bell shape 223 is red, the bottom left is blue, and the top is green). On the other hand, a user who wants to use the gray scale displays a chromaticity diagram in such a manner that the part outside the bell shape is made black, the inside of the bell shape is made gray, and a scale is provided so as to read (x, y) accurately. It is convenient to switch between a window 22 as shown in FIG. 13 and a window 23 as shown in FIG. 14 by specifying the menu at the right click of the mouse. Although not shown here, the user may be caused to select a chromaticity diagram marked with a scale in color display. Moreover, when the user wants to see detailed information on a part of chromaticity diagrams 221, 223, it is convenient to be able to display enlarged views of a part of the chromaticity diagrams 221, 223 as shown in FIG. 15 by selecting the menu at the right click of the mouse.

In the above method, areas have been specified using a band image screen 15 as shown in FIG. 2. However, if the estimation process is executed at such a high speed that the user does not feel stressed, the user is able to select one pixel or a plurality of pixels with the mouse and the chromaticity value and chromaticity diagram of the position may be displayed in real time. Alternatively, for example, area 1 to area 5 may be specified in advance by a mixture of these methods and area 6 may be set in the present mouse position and the chromaticity value and chromaticity diagram be displayed there. Since the spectral reflectivity/transmittance spectrum has been calculated in the middle of the above process, its graph can be displayed in the same window or in another window.

By the above method, it is possible to specify a specific area on an image captured by the multiband camera 1 and display the chromaticity value and chromaticity diagram of the place. When a plurality of areas have been set, plotted positions are displayed simultaneously on the chromaticity diagram to compare them to obtain the difference between them.

Third Embodiment

Next, a third embodiment of the present invention will be explained. The third embodiment is such that a specific area is specified on an image captured by a multiband camera 1 and, using the place as a reference, the color difference from another area.

The configuration of the third embodiment is the same as the second embodiment.

In the third embodiment, a color difference is displayed in the form of an image. First, an area serving as a reference is specified and a chromaticity value is determined. The method of doing this is as explained in the second embodiment. For example, a reference area is specified on the band image screen 15 shown in FIG. 6 and a chromaticity value is determined. Suppose the value is (L₀*, a₀*, b₀*). A color difference ΔE is expressed by the following formula:
ΔE=((L₀*−L₁*)²+(a₀*−a₁*)²+(b₀*−b₁*)²)^1/2
where (L₁*, a₁*, b₁*) is the chromaticity value in the place of an object to be compared.

In the third embodiment, a color difference using area 1 as a reference is obtained for all of the pixels in the screen and the results are represented in the form of an image. Now, let the pixel at the top left be expressed by I₀, similarly I₂, I₃, in that order, and let the pixel at the bottom right be expressed by I_n. If the image has 2048×2048 pixels, then n=4194303. At this time, since a color difference is found for all of the pixels, the color differences at that time are determined to be ΔE₀to ΔE_n. Next, if of them, the maximum color difference value is ΔE_maxand the minimum color difference value is ΔE_min, the pixel value D_iof an i-th pixel on the gray scale displayed in the image can be expressed by the following equation:
D_i=(ΔE_i−ΔE_min)/(ΔE_max−E_min)×255
where 0≦i≦n and the tones which can be displayed on a window image is assumed to be 0 to 255. Therefore, if pixel I_iin the original image window is replaced with pixel value D_i, a color difference with respect to a reference area can be displayed in the form of an image.

FIGS. 16 and 17 show its example. In this example, instead of setting a rectangle as a reference area in advance, an area composed of one pixel at the position of a mouse pointer 24 or several pixels in the vicinity of the position is set as a reference area. FIG. 16 shows the way a reference area is specified using a mouse. As a result, FIG. 17 shows a color difference image.

Next, as a modification of the embodiment, explanation will be given as to a method of giving a different color from that of the original only when the color difference ΔE is smaller than or larger than a specified reference value, that is, the threshold.

The way of determining a reference area and finding a color difference ΔE for all of the pixels in an image is identical to the above-described method. Suppose the color differences found for pixels I₀to I_nare ΔE₀to ΔE_n. Here, it is determined whether the color difference ΔE_iof each pixel is larger or smaller than a reference color difference ΔE_Sserving as the threshold. Suppose, when the color difference of a pixel is smaller than the reference value, the pixel is painted with red ((R, G, B)=(255, 0, 0)) and when the color difference is equal to or larger than the reference value, nothing is done and the original image (pixel) is displayed. The result is shown in FIG. 18. It is seen that the part painted with red (the hatching part) has a color difference smaller than the reference value and is close in color to the reference area. Similarly, giving a color only to a part whose color difference is larger than the threshold makes it possible to check a place whose color difference from the reference area is large.

In this example, too, if the estimation process is executed at such a high speed that the user does not feel stressed, the user is able to select one pixel or a plurality of pixels with the mouse and an image representing color differences may be displayed in real time.

In the above method, a specific area is specified in the image captured by the multiband camera 1 and, using the place as a reference, a color difference from another area can be displayed. Moreover, color differences can be displayed in the form of an image using an area other than the reference area as a pixel unit. This produces the effect of enabling the user to make a comparison between and an evaluation of color differences, while making clear their size and the positions on the image.

As described above, the present invention explained using the embodiments makes it possible to specify a single target area or a plurality of target areas with a GUI for the software that deals with the data of the multiband camera 1 and observe an estimated spectrum in the place as needed. Here, the spectrum may be a signal value (luminance) obtained on the input means side, such as the CCD element of the multi-spectrum camera, or spectral reflectivity or spectral transmittance. The user can not only observe the spectrum in the specified area but also see the relative values of areas in a graph.

Furthermore, after the spectral reflectivity/transmittance spectrums have been found, color measurement values and chromaticity values are determined and these values and a chromaticity diagram can be displayed. In the case of chromaticity values, a relative value is found as a color difference (ΔE) from an area (which may be composed of one pixel) serving as a reference. A color difference smaller or larger than a specified one is given a different color from the gray scale, thereby displaying an image, which enables the user to evaluate a captured image visually. Any data, including estimated spectrums, color measurement values, chromaticity values, and color differences, are observed in real time by specifying the place of the reference area on the image with the mouse, which produces the effect of making it easier for the user to evaluate the images taken by the multiband camera 1.

Additional advantages and modifications will readily occur to those skilled in the art. Therefore, the invention in its broader aspects is not limited to the specific details, representative devices, and illustrated examples shown and described herein. Accordingly, various modifications may be made without departing from the spirit or scope of the general inventive concept as defined by the appended claims and their equivalents.

Claims

1. An image display apparatus which displays a multiband image obtained by a multiband camera capable of capturing at least two bands, the image display apparatus comprising:

an image display section configured to display an image of a certain band in the multiband image;

a pixel specifying section configured to specify at least one pixel on the image of the certain band displayed on the image display section;

a spectrum estimation section configured to estimate a spectrum from the signal value of the at least one pixel specified by the pixel specifying section in the multiband image; and

a spectrum display section configured to display the spectrum estimated by the spectrum estimation section.

2. The image display apparatus according to claim 1, wherein the spectrum is a luminance spectrum of the signal value.

3. The image display apparatus according to claim 1, wherein the spectrum is a dispersion spectrum.

4. The image display apparatus according to claim 3, wherein the spectrum estimation section configured to use a reference image corresponding to the multiband image and estimate a spectrum from the signal value of the at least one pixel corresponding to both of the multiband image and the reference image.

5. The image display apparatus according to claim 4, further comprising a reference image creating section configured to create the reference image from the signal value of the at least one pixel in the multiband image.

6. The image display apparatus according to claim 5, wherein the reference image creating section includes

a pixel selection section configured to receive the designation of the shape and position of a desired area on the image of the certain band displayed on the image display section and select pixels to be used, and

a creating section configured to create the reference image from the values of the pixels to be used selected by the pixel selection section.

7. The image display apparatus according to claim 6, wherein the creating section is configured to create the reference image on the basis of the average value of the values of the pixels to be used selected by the pixel selection section.

8. The image display apparatus according to claim 7, wherein the pixel specifying section

includes a moving section configured to move a pointer to an arbitrary position on the image of the certain band displayed on the image display section, and

automatically specifies the pixel in the position at which the pointer points according to the movement of the pointer by the moving section.

9. The image display apparatus according to claim 6, wherein the pixel specifying section

includes a moving section configured to move a pointer to an arbitrary position on the image of the certain band displayed on the image display section, and

automatically specifies the pixel in the position at which the pointer points according to the movement of the pointer by the moving section.

10. The image display apparatus according to claim 5, wherein the reference image creating section is configured to automatically find the places of pixels whose luminance values are high from all of the pixels in a band in the multiband image, determine the pixel value, and on the basis of the pixel values, create the reference image.

11. The image display apparatus according to claim 10, wherein the reference image creating section, when finding the places of pixels whose luminance values are high, is configured to set a threshold corresponding to the intensity of the luminance, remove the pixels whose luminance values are higher than the threshold because of overexposure, and find the places of the pixels whose luminance values are high from pixels whose luminance values equal to or lower than the threshold.

12. The image display apparatus according to claim 11, wherein the pixel specifying section

includes a moving section configured to move a pointer to an arbitrary position on the image of the certain band displayed on the image display section, and

automatically specifies the pixel in the position at which the pointer points according to the movement of the pointer by the moving section.

13. The image display apparatus according to claim 5, wherein the reference image creating section includes a section configured to provide luminance information on at least one pixel specified in such a manner that the information is recognizable at a glance over all bands.

14. The image display apparatus according to claim 13, wherein the pixel specifying section

includes a moving section configured to move a pointer to an arbitrary position on the image of the certain band displayed on the image display section, and

automatically specifies the pixel in the position at which the pointer points according to the movement of the pointer by the moving section.

15. The image display apparatus according to claim 3, further comprising a chromaticity information computing section configured to find chromaticity information from a dispersion spectrum estimated at the spectrum estimation section.

16. The image display apparatus according to claim 15, wherein the spectrum display section is configured to display the chromaticity value of the chromaticity information found at the chromaticity information computing section in the form of a chromaticity diagram.

17. The image display apparatus according to claim 16, wherein the spectrum display section has the function of enlarging an arbitrary part of the displayed chromaticity diagram.

18. The image display apparatus according to claim 16, wherein the pixel specifying section

includes a moving section configured to move a pointer to an arbitrary position on the image of the certain band displayed on the image display section, and

automatically specifies the pixel in the position at which the pointer points according to the movement of the pointer by the moving section.

19. The image display apparatus according to claim 15, wherein the chromaticity information computing section has the function of acquiring at least two pieces of chromaticity information in one of the same image and different images and compare the pieces of chromaticity information.

20. The image display apparatus according to claim 19, wherein the method of comparing at least two pieces of chromaticity information at the chromaticity information computing section is to compare the chromaticity values.

21. The image display apparatus according to claim 20, wherein the comparison of the chromaticity values is made in such a manner that the chromaticity value of at least one target pixel is used as a reference value and the color difference between another pixel and the reference value is determined, and

the spectrum display section is configured to represent the determined color difference in the form of an image.

22. The image display apparatus according to claim 21, wherein the pixel specifying section

includes a moving section configured to move a pointer to an arbitrary position on the image of the certain band displayed on the image display section, and

automatically specifies the pixel in the position at which the pointer points according to the movement of the pointer by the moving section.

23. The image display apparatus according to claim 20, wherein the pixel specifying section

includes a moving section configured to move a pointer to an arbitrary position on the image of the certain band displayed on the image display section, and

automatically specifies the pixel in the position at which the pointer points according to the movement of the pointer by the moving section.

24. The image display apparatus according to claim 19, wherein the pixel specifying section

includes a moving section configured to move a pointer to an arbitrary position on the image of the certain band displayed on the image display section, and

automatically specifies the pixel in the position at which the pointer points according to the movement of the pointer by the moving section.

25. The image display apparatus according to claim 15, wherein the pixel specifying section

includes a moving section configured to move a pointer to an arbitrary position on the image of the certain band displayed on the image display section, and

automatically specifies the pixel in the position at which the pointer points according to the movement of the pointer by the moving section.

26. The image display apparatus according to claim 1, wherein that the spectrum estimation section is configured to determine a spectrum through the interpolation of luminance data between individual band images in the multiband image.

27. The image display apparatus according to claim 26, wherein the interpolation is linear interpolation.

28. The image display apparatus according to claim 26, wherein the interpolation is a spline curve.

29. The image display apparatus according to claim 1, wherein the pixel specifying section

includes a moving section configured to move a pointer to an arbitrary position on the image of the certain band displayed on the image display section, and

automatically specifies the pixel in the position at which the pointer points according to the movement of the pointer by the moving section.

30. An image display apparatus which displays a multiband image obtained by a multiband camera capable of capturing at least two bands, the image display apparatus comprising:

an image display section configured to display an image of a certain band in the multiband image;

a pixel specifying section configured to specify at least two pixels in the image of the certain band displayed on the image display section;

a spectrum computing section configured to determine the spectrum of each of the pixels specified by the pixel specifying section; and

a display section configured to select the spectrum of one specified pixel serving as a reference determined by the spectrum computing section from the pixels specified by the pixel specifying section and display a relative value of the spectrum of another specified pixel determined by the spectrum computing section with respect to the selected spectrum.

31. An image display method which displays a multiband image obtained by a multiband camera capable of capturing at least two bands, the image display method comprising:

displaying an image of a certain band in the multiband image;

specifying at least one pixel on the image of the displayed certain band;

estimating a spectrum from the signal value of the specified at least one pixel in the multiband image; and

displaying the estimated spectrum.

32. An image display method which displays a multiband image obtained by a multiband camera capable of capturing at least two bands, the image display method comprising:

displaying an image of a certain band in the multiband image;

specifying at least two pixels in the image of the displayed certain band;

determining the spectrum of each of the specified pixels; and

selecting the determined spectrum of one specified pixel serving as a reference from the specified pixels and displaying a relative value of the determined spectrum of another specified pixel with respect to the selected spectrum.

33. An image display apparatus which displays a multiband image obtained by a multiband camera capable of capturing at least two bands, the image display apparatus comprising:

image display means for displaying an image of a certain band in the multiband image;

pixel specifying means for specifying at least one pixel on the image of the certain band displayed on the image display means;

spectrum estimation means for estimating a spectrum from the signal value of the at least one pixel specified by the pixel specifying means in the multiband image; and

spectrum display means for displaying the spectrum estimated by the spectrum estimation means.

34. An image display apparatus which displays a multiband image obtained by a multiband camera capable of capturing at least two bands, the image display apparatus comprising:

image display means for displaying an image of a certain band in the multiband image;

pixel specifying means for specifying at least two pixels in the image of the certain band displayed on the image display means;

spectrum computing means for determining the spectrum of each of the pixels specified by the pixel specifying means; and

display means for selecting the spectrum of one specified pixel serving as a reference determined by the spectrum computing means from the pixels specified by the pixel specifying means and displaying a relative value of the spectrum of another specified pixel determined by the spectrum computing means with respect to the selected spectrum.