Method and apparatus for reading and verifying holograms
A system and method for reading the information stored in holograms and other diffractive objects. The information is read by analyzing the diffraction pattern produced when a laser beam is focused onto a small spot on the object and scanned across the object.
The present application is related to the inventor's U.S. patent application entitled QUANTUM DOT SECURITY DEVICE AND METHOD, filed Dec. 31, 1998 (Attorney Docket No. 640002.506). the disclosure of which is incorporated herein by reference.
TECHNICAL FIELDThis invention relates to holography, and, more particularly, to a hologram reader/verifier.
BACKGROUND OF THE INVENTION Prior art hologram readers have depended on the use of holograms having a special format or special characteristics. Examples of prior art hologram readers are illustrated in
In the hologram reader of
Another type of prior art hologram reader (not shown) does not actually read a hologram but instead compares a wavefront recorded in a hologram to a reference wavefront. Yet another type of prior art hologram reader (not shown) simply compares a single 2-D view of the hologram to a stored 2-D reference image.
-
- U.S. Pat. No. 4,641,017 to Lopata, entitled Fraud Resistant Credit Card System
- U.S. Pat. No. 5,331,443 to Stanisci, entitled Laser Engraved Verification Hologram And Associated Methods
- U.S. Pat. No. 4,761,543 to Hayden et al., entitled, Holographic Security Devices And Systems
- U.S. Pat. No. 4,108,367 to Hannan, entitled Token And Reader For Vending Machines
- U.S. Pat. No. 5,712,731 to Drinkwater et al., entitled Security Device For Security Documents Such As Bank Notes And Credit Cards
- U.S. Pat. No. 5,306,899 to Marom, et al., entitled Authentication System For An Item Having A Holographic Display Using A Holographic Record
- U.S. Pat. No. 4,131,337 to Moraw, et al., entitled Comparison Reader For Holographic Identification Cards
- U.S. Pat. No. 3,905,019 to Aoki, et al., entitled Pattern Recognizing Optical Apparatus
- U.S. Pat. No. 5,666,417 to Liang, et al., entitled Fluorescence Authentication Reader With Coaxial Optics
- U.S. Pat. No. 5,465,243 to Boardman, et al., entitled Optical Recorder And Reader Of Data On Light Sensitive Media
- U.S. Pat. No. RE 035,117 to Rando, et al., entitled Scanner With Coupon Validation
The prior art hologram readers described above and in the above-listed patents are capable of reading holograms only if the holograms are specially adapted for the reader. There is therefore a need for a hologram reader that is capable of reading all kinds of holograms without the need for the holograms to be specially adapted for the reader and is capable of reading variable information from holograms.
BRIEF DESCRIPTION OF THE DRAWINGS
While standard image processing techniques can be used to identify the size, shape and location of each blob 310, it is helpful to take advantage of properties specific to holograms in order to simplify the feature detection and identification task. Unless holograms are blazed, they produce diffraction patterns that are approximately radially symmetric, as are the spots 360 shown in
For a hologram reader to be able to distinguish between different holograms, certain features of the holograms are important. These features include spot location, blob location, blob asymmetry, blob size, blob shape, blob velocity, blob envelope, and stray light, each of which are discussed below.
The location of a blob can usually be defined as the location of its brightness peak. Alternatively, blob location can be defined as center of mass of the intensity distribution. Radial coordinates are appropriate, since the overall pattern will have a large degree of radial symmetry.
Blob asymmetry can be defined as the ratio of intensities of corresponding blobs in the +1 and −1 orders. Each blob pair will have its own asymmetry.
Blob size can be defined as the maximum width of the region covered by a blob. Coverage in turn can be defined as having an intensity greater than some threshold level determined by the peak intensity of the blob and the background brightness.
In most diffraction patterns from holograms used commercially today, blobs are either point-like or line-like. Line-like blobs occur on the arcs shown in
As a hologram is being read by a point of illumination moving across the hologram, the blobs in the diffraction pattern move and change in a piecewise continuous fashion. Blob velocity is the rate-of-change of the blob's location, asymmetry, size and shape in the diffraction pattern with respect to change of location of the illuminated point on the hologram.
In a rainbow hologram, the arc (as seen in
In most holograms, there is stray light in the diffraction pattern. This light forms dim symmetric patterns upon illumination with a normal-incidence beam, but it has no apparent connection with the visible image. Ordinarily these stray diffraction components result from scattered light in the hologram recording apparatus in which the scattered light is recorded as a hologram along with the object light. A common technique of holographers is to illuminate a hologram with laser light and look through it to see an image of the apparatus that was used to record the hologram.
All information recorded in a hologram is extractable via the diffraction pattern produced (e.g.,
The hologram 690 on the card 680 may be transparent, in which case a relief surface of the hologram 690 is preferably coated with a high-refractive index material (not shown) so that the hologram 690 is significantly bright. Suitable high-refractive index materials include titanium oxide or zinc sulfide. If the hologram 690 is transparent, the surface of the card 680 underneath the hologram 690 may be provided with features detectable through the hologram, such as patterns of fluorescent ink, colored ink, fibers, magnetic inks, or optically variable inks.
In operation, the laser beam 650 diffracts from the hologram 690 to form a pattern on the image sensor 620. The image sensor 620 does not sense the entire image in the hologram. Instead, the image sensor 620 senses the pattern of diffracted light from one illuminated spot on the hologram 690. The color-selective filter 662 ensures that the image sensor 620 receives only light of the same color as the illuminating laser beam 650, and therefore receives predominantly diffracted, scattered and reflected light. If the illuminating laser beam 650 is directed at an appropriate angle to the hologram 690, corresponding to the angle between reference and object beams (not shown) used in manufacturing the hologram 690, only positive diffracted orders will fall onto the image sensor 620 placed directly above the hologram. Alternatively, the illuminating laser beam 650 may be directed perpendicularly to the hologram 690, as indicated in
Illumination of fluorescent inks printed on the substrate of the card 680 induces the emission of fluorescent light. This fluorescent light passes through the spectrum-forming optics 615, 635 to the second beamsplitter 605, which directs the fluorescent light onto the time-gated line array sensor 625. The time-gated line array sensor 625 images the spectrum of the fluorescent light. A stop 692 blocks the direct reflection (zero-order diffracted beam) of the illumination laser beam 650 from striking the line array sensor 625.
Fluorescence from different substances has two primary distinguishing features: emission spectrum and temporal behavior. For example, many organic dyes have a very short fluorescence lifetime so that if they are illuminated with a picosecond pulse of excitation light, they emit a brief pulse of fluorescence shorter than a nanosecond. Other fluorescent substances emit fluorescence for hundreds of nanoseconds following excitation. Many materials are fluorescent to some degree, but most have short fluorescence lifetimes; so it is advantageous to use a fluorescent ink with a long fluorescence lifetime, thereby providing the opportunity to exclude background fluorescence by time-gating methods.
In the embodiment illustrated in
One example of a suitable fluorescent material is formed using quantum dots 210, as illustrated in
Examples of labels 400, 410 formed by holograms 450 having an underlying fluorescent material 430 are illustrated in
The fluorescent substance 430 may be a fluorescent ink containing fluorophores. It is advantageous to use a patterned fluorescent substance 430 on the substrate 460 having a distinctive fluorescence spectrum. A suitable fluorescent substance 430 is a fluorescent ink containing fluorophores, such as the ZnS-capped CdSe quantum dots 420 described above. The quantum dots 420 are preferably of specific sizes so that the fluorescence spectra will be relatively narrow. Specific organic dyes such as Rhodamine 6G, which has a distinctive peak fluorescence wavelength, may be used. The fluorescent substance 430 is described in greater detail in co-pending patent application entitled QUANTUM DOT SECURITY DEVICE AND METHOD, filed concurrently herewith, and which is incorporated herein by reference.
The credit card 120 of
Returning to
Components, modules and combinations of components in the optical and electronic subsystems of the reader may be substituted for other equivalent components, modules, and combinations of components may be substituted, with the objectives of sensing the diffracted light pattern from the illuminated spot on the hologram and/or the amount of scattered light from each point on or under the hologram, and/or the amount, timing or spectrum of fluorescence emitted from the hologram or its substrate.
Wavelength-selective filters (not shown) may be inserted in the optical path from the hologram 690 to the image sensor 620 and/or in the optical path from the hologram 690 to the time-gated line array sensor 625. The wavelength-selective filters limit detected light to a desired range of wavelengths. For example, since scattered light and diffracted light are of the same wavelength as the laser diode 650, a filter that is transmissive to the wavelength of the laser diode 650 but reflective or absorptive to other wavelengths may be advantageously inserted between the sensor 620 and beamsplitter 610. Similarly, a filter that is reflective or absorptive to light at the wavelength of the laser diode 650 and transmissive to light in the fluorescence bandwidth of the fluorophores may be inserted between the sensor 625 and beamsplitter 605.
Alternatively, the beamsplitter 610 may be a polarizing beamsplitter and a quarter-wave plate 608 may be inserted between the beamsplitter 610 and the hologram 690 such that laser light is transmitted nearly 100% at the beamsplitter on its way to the hologram 690, and is also nearly 100% reflected on its way to the image sensor 620. In this case, the beamsplitter 610 may be a wavelength-selective polarizing beamsplitter so that most of the fluorescence light is directed to the line array detector 625, as indicated in
The hologram reader shown in
The FPGA in the electronics subsystem 100 is provided to do the image processing. An alternative implementation uses an Artificial Neural Network (ANN). In fact, any image processing means capable of recognizing salient features of a diffraction pattern may be used to distinguish between the diffraction patterns of different holograms and of counterfeit and valid holograms or other diffractive anti-counterfeiting devices known variously as DOVIDs, holograms, stereograms, kineforms, dot-matrix holograms, kinegrams, pixelgrams and so on.
A suitable FPGA that can be used in the electronics subsystem is a model 6216 FPGA available from Xilinx. The FPGA can be programmed to perform almost any desired signal-processing function. For example, the FPGA may be programmed by downloading a configuration file to the FPGA. The configuration file determines the pattern of interconnections among the logic gates on the FPGA. In the case of the Xilinx 6216 FPGA, the FPGA has 128 pins available for input and output, and there are approximately 35,000 logic gates on the FPGA. All of the logic gates can be operated in parallel, synchronously or asynchronously. There are also design tools commercially available for designing the configuration file for the FPGA. A preferred approach in some applications, however, employs evolutionary computation methods to design configuration files. This evolutionary computing approach is within the skills of an individual or team of individuals having ordinary skill in genetic algorithms or genetic programming, FPGA structure and design methods. chip-level electronics and the mathematics of image processing. Alternatively, evolutionary design tools for FPGA configuration files are commercially available from New Light Industries, Ltd., of Spokane, Wash. 99224 under the trade name of “FPGA-Generator”™.
In the preferred embodiment of the invention, an evolutionary technique is used to design FPGA-based algorithms in the electronics subsystem for feature recognition and extraction. In one version, the following steps are carried out:
-
- 1. A target function is defined by visually identifying features in a set of diffraction patterns to produce feature-tagged images.
- 2. A trial function is defined by specifying a matrix to serve as a convolution template.
- 3. A population of templates is generated randomly, and each member of the population is used to produce a set of convolved images of a training set of images
- 4. The convolved images produced by each member of the population are compared to the target set of feature-tagged images to produce a fitness value for the member, such that the fitness represents the degree of correspondence between the produced convolved images and the feature-tagged images.
- 5. Using standard genetic algorithm techniques, the templates are recombined and/or mutated depending on their fitness to evolve an optimum template.
The precise choice of recombination and mutation operators, and the other GA parameters such as recombination rate, mutation rate and size, population size, elitism, etc., can affect the speed at which evolution proceeds. At this time, there is not a known best choice of operators and GA parameters for all classes of problems.
In operation, the reader/verifier of
The electronics subsystem 100 may also build a representation of the scattering and fluorescence information extracted from the credit card 120 to determine validity or invalidity of the credit card 120. The optical read head 110 used in the hologram reader of
A preferred way to build a representation of the diffraction information in the hologram 140 is to detect intensity peaks in the diffraction pattern and generate a list of the locations, sharpness and relative brightness of the peaks. When a series of diffraction patterns are observed at a series of regions across the item, it is advantageous to represent the diffractive properties of the entire item either as a list-of-lists or as a compiled, sorted list.
A simple way to represent the diffraction information is to halve the diffraction pattern and save only the position and intensity data obtained from that portion. A representative image of a complete set of diffraction patterns from a line across a hologram is then constructed by stacking the data, as illustrated in
As mentioned above, an advantage of the hologram reader illustrated in
-
- 1. recording medium;
- 2. reference and object beam angles and positions;
- 3. dot size, shape, spacing, placement, grating angle, and grating period in dot-matrix holograms;
- 4. rainbow (Benton), classical, 2D3D, stereogram, or dot matrix holograms;
- 5. transmissive or reflective:
- 6. reflectivity-enhancing layers;
- 7. color selectivity of recording medium and Bragg grating structure;
- 8. color properties of the recording and reconstruction geometry;
- 9. encoded reference beam or object beam; and
- 10. features and characteristics of a substrate on which the hologram is laminated or hot-stamped.
The hologram reader of
The random data (e.g., in the labels 400, 410 shown in
The printed labels are placed on products, which are distributed via intermediate and final distribution points. The labels may be read at the distribution points by hologram readers that are associated with decryption engines. The hologram readers read the random data from the substrates underneath the holograms and use the random data as a public key to decrypt the character string printed on the label, without determining the private key securely hidden in the encryption engine. If a label has been counterfeited or illegitimately produced, either the character string will not be decryptable or the random data will not be contained in the label manufacturer's database.
The term, “character string” is used here inclusively of any encoded information, including bar codes, optically readable alphanumeric characters, encoded magnetic stripes, magnetically readable alphanumeric characters, optically readable bit strings, icons, and the like.
Information relating to the particular labels passing through each distribution point and their validity or invalidity is collected by a network of computer nodes and analyzed at one or more sites. A central computer node may download information to the distribution sites to alert them to particular counterfeiting threats or to upgrade their decryption engines and/or download upgrades to encryption engines to the label printers.
The anticounterfeit/security system illustrated in
It is to be understood that even though various embodiments and advantages of the present invention have been set forth in the foregoing description, the above disclosure is illustrative only, and changes may be made in detail, and yet remain within the broad principles of the invention. For example, many of the components described above may be implemented using either digital or analog circuitry, or a combination of both, and also, where appropriate, may be realized trough software executing on suitable processing circuitry. Therefore, the present invention is to be limited only by the appended claims.
Claims
1-13. (canceled)
14. A security device comprising an arrangement of light-emitting particles on a surface, said arrangement forming a pattern of varying spectral emission properties corresponding to each of the light emitting particles.
15. The security device of claim 14, wherein said light-emitting particles are selected from the group consisting of fluorophores, quantum dots, fluorescent fibers, and nanometer-sized particles.
16. The security device of claim 14, wherein said light-emitting particles are quantum dots composed of a plurality of layers including at least one layer of a semiconductor material.
17. The security device of claim 16, wherein said semiconductor material is comprised of a first layer of CdSe and a second layer of ZnSe.
18. The security device of claim 14, wherein said arrangement provides a representation of information that is at lest one of random and structured information.
19-20. (canceled)
Type: Application
Filed: Dec 14, 2004
Publication Date: May 12, 2005
Inventor: Stephen McGrew (Spokane, WA)
Application Number: 11/013,280