Color flat panel display sub-pixel arrangements and layouts for sub-pixel rendering with increased modulation transfer function response

- Samsung Electronics

Various embodiments of a sub-pixel octal grouping are disclosed. The octal grouping may comprise three-color sub-pixels with one colored sub-pixel comprising twice the number of positions within the octal sub-pixel grouping as the other two colored sub-pixels. Various embodiments for performing sub-pixel rendering on the sub-pixel groupings are disclosed.

Skip to: Description  ·  Claims  ·  References Cited  · Patent History  ·  Patent History
Description
RELATED APPLICATIONS

This application claims priority to U.S. Provisional Application No. 60/346,738 (“the '738 provisional application”), entitled “ARRANGEMENT OF SUB-PIXELS WITH DOUBLE BLUE STRIPES,” filed on Jan. 7, 2002, which is hereby incorporated herein by reference. This application is also a continuation-in-part of U.S. patent application Ser. No. 10/243,094, entitled “IMPROVED FOUR COLOR ARRANGEMENTS OF EMITTERS FOR SUB-PIXEL RENDERING,” filed on Sep. 13, 2002, now abandoned and published as United States Patent Publication No. 2004/0051724 (“the '724 application”). which is hereby incorporated herein by reference and is commonly owned by the same assignee of this application.

This application is also related to United States Patent Publication No. 2003/0117423 (“the '423 application”) [U.S. patent application Ser. No. 10/278,328,] entitled “IMPROVEMENTS TO COLOR FLAT PANEL DISPLAY SUB-PIXEL ARRANGEMENTS AND LAYOUTS WITH REDUCED BLUE LUMINANCE WELL VISIBILITY,” filed on Oct. 22, 2002; United States Patent Publication No. 2003/0090581 (“the '581 application”) [U.S. patent application Ser. No. 10/278,393,] entitled “COLOR DISPLAY HAVING HORIZONTAL SUB-PIXEL ARRANGEMENTS AND LAYOUTS,” filed on Oct. 22, 2002; and United States Patent Publication No. 2003/0128179 (“the '179 application”) [U.S. patent application Ser. No. 10/278,352,] entitled “IMPROVEMENTS TO COLOR FLAT PANEL DISPLAY SUB-PIXEL ARRANGEMENTS AND LAYOUTS FOR SUB-PIXEL RENDERING WITH SPLIT BLUE SUBPIXELS,” filed on Oct. 22, 2002. which are all hereby incorporated herein by reference and commonly owned by the same assignee of this application.

BACKGROUND

The present application relates to improvements to display layouts, and, more particularly, to improved color pixel arrangements, means of addressing used in displays, and to data format conversion methods for these displays.

Full color perception is produced in the eye by three-color receptor nerve cell types called cones. The three types are sensitive to different wavelengths of light: long, medium, and short (“red”, “green”, and “blue”, respectively). The relative density of the three differs significantly from one another. There are slightly more red receptors than green receptors. There are very few blue receptors compared to red or green receptors.

The human vision system processes the information detected by the eye in several perceptual channels: luminance, chromanance, and motion. Motion is only important for flicker threshold to the imaging system designer. The luminance channel takes the input from only the red and green receptors. In other words, the luminance channel is “color blind”. It processes the information in such a manner that the contrast of edges is enhanced. The chromanance channel does not have edge contrast enhancement. Since the luminance channel uses and enhances every red and green receptor, the resolution of the luminance channel is several times higher than the chromanance channels. Consequently, the blue receptor contribution to luminance perception is negligible. The luminance channel thus acts as a spatial frequency signal band pass filter. Its peak response is at 35 cycles per degree (cycles/°). It limits the response at 0 cycles/° and at 50 cycles/° in the horizontal and vertical axis. This means that the luminance channel can only tell the relative brightness between two areas within the field of view. It cannot tell the absolute brightness. Further, if any detail is finer than 50 cycles/°, it simply blends together. The limit in the horizontal axis is slightly higher than the vertical axis. The limit in the diagonal axes is somewhat lower.

The chromanance channel is further subdivided into two sub-channels, to allow us to see full color. These channels are quite different from the luminance channel, acting as low pass filters. One can always tell what color an object is, no matter how big it is in our field of view. The red/green chromanance sub-channel resolution limit is at 8 cycles/°, while the yellow/blue chromanance sub-channel resolution limit is at 4 cycles/°. Thus, the error introduced by lowering the red/green resolution or the yellow/blue resolution by one octave will be barely noticeable by the most perceptive viewer, if at all, as experiments at Xerox and NASA, Ames Research Center (see, e.g., R. Martin, J. Gille, J. Larimer, Detectability of Reduced Blue Pixel Count in Projection Displays, SID Digest 1993) have demonstrated.

The luminance channel determines image details by analyzing the spatial frequency Fourier transform components. From signal theory, any given signal can be represented as the summation of a series of sine waves of varying amplitude and frequency. The process of teasing out, mathematically, these sine-wave-components of a given signal is called a Fourier Transform. The human vision system responds to these sine-wave-components in the two-dimensional image signal.

Color perception is influenced by a process called “assimilation” or the Von Bezold color blending effect. This is what allows separate color pixels (also known as sub-pixels or emitters) of a display to be perceived as a mixed color. This blending effect happens over a given angular distance in the field of view. Because of the relatively scarce blue receptors, this blending happens over a greater angle for blue than for red or green. This distance is approximately 0.25° for blue, while for red or green it is approximately 0.12°. At a viewing distance of twelve inches, 0.25° subtends 50 mils (1,270μ) on a display. Thus, if the blue pixel pitch is less than half (625μ) of this blending pitch, the colors will blend without loss of picture quality. This blending effect is directly related to the chromanance sub-channel resolution limits described above. Below the resolution limit, one sees separate colors, above the resolution limit, one sees the combined color.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are incorporated in, and constitute a part of this specification illustrate various implementations and embodiments disclosed herein.

FIG. 1A shows an arrangement of four-color pixel elements in an array, in a single plane, for a display device, having a repeat cell consisting of eight sub-pixels.

FIG. 1B shows an arrangement of three-color pixel elements in an array, in a single plane, for a display device, having a repeat cell of consisting of eight sub-pixels generated by selecting and defining four of the eight sub-pixels of FIG. 1A as the same color.

FIG. 1C shows an arrangement of three-color pixel elements in an array, in a single plane, for a display device, having a repeat cell of consisting of eight sub-pixels generated by selecting and defining four of the eight sub-pixels of FIG. 1A as the same color and reducing their widths.

FIG. 2 shows a schematic of an electronic drive arrangement for the arrangement of sub-pixels shown in FIGS. 1A, 1B, and 1C.

FIGS. 3A and 3B illustrate the relative polarities of active matrix dot inversion drive methods for a Liquid Crystal Display using the arrangement of color sub-pixels of FIG. 1C and the drive arrangement of FIG. 2.

FIGS. 4A, 4B, 4C, and 4D illustrate a set of green, blue, and red resample areas separately and overlaid, respectively, for the arrangement of sub-pixels of FIG. 1C.

FIGS. 5A, 5B, 5C, and 5D illustrate the set of green, blue, and red resample areas of FIGS. 4A, 4B, 4C, and 4D respectively, overlaid on the arrangement of sub-pixels of FIG. 1C to show their relative positions.

FIG. 5E illustrates two logical pixels displayed on the arrangement of FIG. 1C, resulting from the sub-pixel rendering operation of the resample areas of FIG. 4D.

FIG. 6A illustrates two logical pixels displayed on the arrangement of FIG. 1C, resulting from the sub-pixel rendering operation of the resample areas of FIG. 6D.

FIGS. 6B, 6C, and 6D illustrate a set of blue and red resample areas separately, and overlaid along with the green resample areas illustrated in FIG. 4A on arrangement of sub-pixels of FIG. 1C, respectively.

FIG. 7A illustrates the set of green, blue, and red resample areas of FIGS. 4A, 4B, and 4C respectively, overlaid show their relative positions.

FIG. 7B illustrates the arrangement of resample areas of FIG. 7A overlaid on the arrangement of sub-pixels of FIG. 1C to show their relative positions.

FIGS. 8A and 8B show other embodiments of the octal subpixel arrangement with various vertical displacements of the subpixels.

FIGS. 9A and 9B show yet other embodiments of the octal subpixel arrangement of various displacements of the split majority subpixel within the subpixel grouping.

FIG. 10 depicts a system incorporating sub-pixel rendering techniques suitable to drive a panel made in accordance with the various embodiments described herein.

FIGS. 11A and 11B depict two particular embodiments of flowcharts to perform software and hardware sub-pixel rendering on a suitable display.

FIG. 12 is one particular embodiment of an implementation of a display made in accordance with several embodiments herein disclosed.

 DETAILED DESCRIPTION

Reference will now be made in detail to implementations and embodiments of the invention, examples of which are illustrated in the accompanying drawings. Wherever possible, the same reference numbers will be used throughout the drawings to refer to the same or like parts.

Sub-Pixel Arrangements

FIG. 1A shows an arrangement of sub-pixel emitters 100 having four color emitters in groupings 110 that is shifted down every other column group by one sub-pixel. This creates a larger rectilinearly repeating cell group 120 of eight sub-pixels. This layout was introduced in the '724 application Also disclosed in the '724 application is the practice of setting a plurality of the sub-pixels within the repeat cell to the same color point, an example of which is illustrated in FIG. 1B, wherein four of the emitters 106 in the eight emitter repeat cell group 120 are set to the same color. For example, these four emitters 106 may be set to be luminance adjusted (i.e. balanced) green in color. For example, the other sub-pixel emitters may be set to be red 104 and blue 102. The luminance balanced green 106 sub-pixels have twice the area, i.e., “real-estate,” per color as the red 104 and blue 102 sub-pixels, but being balanced to have the same luminance as the red 104 sub-pixels, the total green energy is balanced to produce a pleasing white point when all sub-pixels are illuminated fully. The manner of balancing the luminance of the green color sub-pixel was previously disclosed in the '724 application.

In FIG. 1C, the four sub-pixel emitters 106 are reduced in size and aspect ratio compared to the other two sub-pixel emitters 104 and 102. The minority sub-pixels 104 and 102 may also be adjusted in aspect ratio. In this example, the relative size of sub-pixel 106 is adjusted to be one half of that of sub-pixels 104 or 102. As before, the colors may be assigned as desired. It should also be noted that although the repeat octal grouping is shown such that the majority color sub-pixels occupy the second and fourth columns, it also suffices that the majority sub-pixels could occupy the first and the third columns as well.

In another embodiment, the colors are assigned as red 104, blue 102, and non-luminance balanced green 106. Since there are twice as many green 106 as there are of the other two colors, red 104 and blue 102, the result is a pleasing white point when all sub-pixels are illuminated fully.

In this or another color assignment embodiment, the sub-pixel aspect ratios may be adjusted so that the display array 100 consists of square repeat cell groups 120. This will put the majority color sub-pixel emitter 106 on a square grid. It will also put the minority color sub-pixel emitters 102 and 104 on, or nearly on, an idealized “checkerboard”. For an example of another color assignment embodiment, sub-pixels 106 could be assigned the color red and sub-pixels 104 could be assigned the color green in FIGS. 1B and 1C. Under this color assignment, the algorithms for sub-pixel rendering discussed below would work similarly.

Not only may the green or the red sub-pixels occupy the majority colored sub-pixels in octal octal grouping 120, but the blue sub-pixels may also occupy the majority sub-pixels. Such an arrangement was previously disclosed in '738 provisional application. Thus, all three colors—red, green, and blue—may occupy the majority sub-pixel position in this grouping. Additionally, while the colors—red, green and blue—have been used for the purposes of illustrating the present embodiments, it should be appreciated that another suitable choice of three colors—representing a suitable color gamut for a display—may also suffice for the purposes of the present invention.

As shown in FIGS. 1A, 1B and 1C, the subpixels appear to have a substantially rectangular appearance. It should be appreciated that other shapes to the subpixels are also possible and are contemplated within the scope of the present invention. For example, a multitude of other regular or irregular shapes for the subpixels are possible and are desirable if manufacturable. It suffices only that there is an octal grouping of colored subpixels in the fashion herein described that may be addressable for the purposes of subpixel rendering (SPR).

As subpixel shapes may vary under the scope of the present invention, so too may the exact positions of the subpixels be varied under the scope of the present invention. For example, FIGS. 8A and 8B depict a similar octal subpixel grouping wherein one or both of the majority stripes 106 are offset (relatively or otherwise) from the other subpixels 102 and 104. Other vertical offsets are also possible.

Other embodiments of the octal groupings are also possible. FIGS. 9A and 9B depict octal groupings wherein the majority subpixels 106 are interspersed within the checkerboard of subpixels 102 and 104. Other arrangements of majority subpixel placement within such a checkerboard are also possible and are contemplated within the scope of the present invention.

FIGS. 9A and 9B may have column electrodes that zig-zag across the display. Column driver savings should be one third when compared to the RGB stripe system with the same resolution and the number of subpixels are about two thirds of the number of subpixels when compared to the RGB stripe system.

Yet other embodiments of the present invention are possible. For example, the entire octal subpixel groupings may be rotated 90 degrees to reverse the roles of row and column driver connections to the grouping. Such a horizontal arrangement for subpixels is further disclosed in the co-pending application United States Patent Publication No. 2003/0090581 (“the '581 application”) entitled “COLOR DISPLAY HAVING HORIZONTAL SUB-PIXEL ARRANGEMENTS AND LAYOUTS” and is incorporated by reference.

The alternating “checkerboard” of emitters is similar to the red and green “checkerboard” that was disclosed in co-pending and commonly assigned United States Patent Publication No. 2002/0015110 (“the '110 application”) [U.S. patent application Ser. No. 09/916,232] entitled “ARRANGEMENT OF COLOR PIXELS FOR FULL COLOR IMAGING DEVICES WITH SIMPLIFIED ADDRESSING,” filed on Jul. 25, 2001, using sub-pixel rendering such as that described in cop-ending United States Patent Publication No. 2003/0103058 (“the '058 application”) [U.S. patent application Ser. No. 10/150,355] entitled “METHODS AND SYSTEMS FOR SUB-PIXEL RENDERING WITH GAMMA ADJUSTMENT,” filed on May 17, 2002. These co-pending applications are hereby incorporated herein by reference. The methods described in the above co-pending applications may be modified for the embodiments disclosed herein.

FIG. 2 illustrates a schematic for a driver arrangement 200 for the arrangement of color emitter sub-pixels in FIGS. 1A, 1B, and 1C. For convenience, the example given has the same number of sub-pixels illustrated as FIG. 1C. This drive arrangement may be used for a number of display technologies, as the blocks 210 may represent one or several electrical components, which are not shown so as not to obscure the embodiments. In particular, they may represent the capacitive display cell element for passively addressed Liquid Crystal Display (LCD), or ElectroLuminescent (EL) Display. They may represent the gaseous discharge element in a Plasma Display Panel (PDP). They may represent the semiconductor diode element of a passively addressed Inorganic Light Emitting Diode or an Organic Light Emitting Diode Display. They may also represent the transistor, storage capacitor, and capacitive cell element of an Active Matrix Liquid Crystal Display (AMLCD). They may further represent the multi-transistor, storage capacitor, and light emitting element of an Active Matrix Organic Light Emitting Diode Display (AMOLED). The may also represent, in general, the color sub-pixel and its associated electronic elements found in other known or yet to be developed display technologies.

The drive timing and method may be any of those known in the art for N×M drive matrices as those shown. However, there may be modifications needed due to the specific color assignments, particularly any checkerboard across the panel or color alternations within a single column. For example, the technique known in the art as “Multi-Row Addressing” or “Multi-Line Addressing” for passive LCD may be modified such that groupings of rows are restricted to odd and even row combinations. This will reduce potential color crosstalk since, within a column with two alternating color sub-pixels, only one color will be addressed at a time.

Inversion schemes, switching the electrical field polarity across the display cell to provide a time averaged zero net field and ion current across the cell, can be applied to the embodiments disclosed herein. FIGS. 3A and 3B show two “dot inversion” schemes 300 and 310, referred to as “1×1” and “2×1”, respectively, on Active Matrix Liquid Crystal Displays, both of which will perform satisfactorily. The scheme shown on FIG. 3B may perform better when slight imbalances of light transmission occur between positive and negative polarities, especially when the eye is tracking the motion of displayed images moving across the screen. Each of the Figures shows the polarities during half of the display addressing fields. The polarities are reversed for the other half, alternating every field, resulting in a net zero current (zero DC bias), as is well known in the art.

Data Format Conversion

For one embodiment of data format conversion using area resampling techniques, FIGS. 4A, 4B, and 4C illustrate green 406, blue 402, and red 404 resample area arrays for the green, blue, and red color planes, respectively. Note that each color resample area array 406, 402, and 404 consists of resample areas 426, 422, and 424 and that each resample area has an associated resample point 416, 412, and 414, respectively, associated with it. The resample points 416, 412, and 414 match the relative positions of the green 106, blue 102, and red 104 sub-pixel locations respectively, within each color plane; but not necessarily their exact inter-color-plane-phase relationships. It should be appreciated that any number of phase relationships are also possible.

FIG. 4D illustrates one particular inter-color-plane-phase relationship 400. This relationship might be employed to convert the conventional fully converged square grid RGB format which is to be displayed “one-to-one” with the square green 106 sub-pixel grid of FIG. 1C. In this inter-color-plane-phase relationship 400, the green 406, blue 402, and red 404 resample area arrays are substantially positioned such that the red 414 and blue 412 resample points overlap the green 416 sample points. This treats the green sub-pixels 106 as though they lay on top of, or intimately associated with, the red 104 and blue 102 sub-pixel checkerboard.

FIGS. 5A, 5B, and 5C illustrate the green 406, blue 402, and red 404 resample area arrays of FIGS. 4A, 4B, and 4C overlaid on the sub-pixel arrangement 100 of FIG. 1C, respectively, with the inter-color-plane-phase relationship 400 of FIG. 4D. FIG. 5D illustrates the inter-color-plane-phase relationship 400 of FIG. 4D overlaid on the sub-pixel arrangement 100 of FIG. 1C. These Figures are merely illustrative and only serve to provide an understanding of the relationship between the resample points, reconstruction points, resample areas, and sub-pixel locations for this embodiment.

The above referenced '058 patent application describes the method used to convert the incoming data format to that suitable for the display. In such a case, the method proceeds as follows: (1) determining implied sample areas for each data point of incoming three-color pixel data; (2) determining a resample area for each color sub-pixel in the display; (3) forming a set of coefficients for each resample area, the coefficients comprising fractions whose denominators are a function of the resample area and whose numerators are a function of an area of each implied sample area that may partially overlap the resample area; (4) multiplying the incoming pixel data for each implied sample area by the coefficient resulting in a product; and (5) adding each product to obtain luminance values for each resample area.

Examining a “one-to-one” format conversion case for the resample operation illustrated in FIG. 4D and 5D, the green plane conversion is a unity filter. The red and blue color planes use a 3×3 filter coefficient matrix, derived as explained in detail in the '058 application:

0 0.125 0 0.125 0.5 0.125 0 0.125 0

FIG. 5E illustrates the results of turning on two full color incoming data pixels. The two pixels are converted to two clusters of output sub-pixels, called “logical pixels” 500 and 501, turned on at varying amplitudes. One of the logical pixels 500 is centered on or near a red sub-pixel 104. The green sub-pixel 106 is set at 100% illumination. The red sub-pixel 104 is set to 50% illumination, while the four surrounding blue sub-pixels 102 are set to 12.5% each. The result is a white dot visible to the human eye, centered between the red 104 and the green 106 sub-pixels. The other logical pixel 501, centered on or near blue sub-pixel 102, similarly has the green sub-pixel 106 set to 100% and the near by blue sub-pixel 102 set to 50% with the four surrounding red sub-pixels 104 set at 12.5% each.

FIGS. 6B and 6C show an alternative blue color plane resample area array 602 and an alternative red color plane resample area array 604, respectively,—shown herein as box filters ([0.5 0.5])—to replace the blue and red resample area arrays 402 and 404 of FIGS. 4B and 4C, respectively. FIG. 6D illustrates an inter-color-plane-phase relationship 610 using the green resample area array 406 of FIG. 4A, and blue and red resample area arrays 602 and 604. FIG. 6A shows the logical pixels 600 and 601 that result from turning on two input data format pixels using the resample operation of the inter-color-plane-phase relationship 610 (FIG. 6D) from input data with a “one-to-one” pixel to green sub-pixel 106 mapping. These logical pixels 600 and 601 may be in the same relative positions as the two logical pixels 500 and 501 in FIG. 5E. Also, it may be possible to center the green box filter to match substantially an input pixel by adjusting the grid slightly.

Adaptive filtering techniques can also be implemented with the pixel arrangements disclosed herein, as further described below.

Again, the green resample uses a unitary filter. The red and blue color planes use a very simple 1×2 coefficient filter: [0.5 0.5]

An adaptive filter, similar to that disclosed in the co-pending and commonly assigned United States Patent Publication No. 2003/0085906 (“the '906 application”) [U.S. patent application Ser. No. 10/215,843] entitled “METHODS AND SYSTEMS FOR SUB-PIXEL RENDERING WITH ADAPTIVE FILTERING,” filed on Aug. 8, 2002, which is hereby incorporated herein by reference, can be adopted so as not to require a 3×3 sample of input data, which uses a minimum of two lines of memory. The test may be based on a smaller sample of input data, for example 1×3 or 1×2 matrices. The green data is sampled to test for vertical or diagonal lines and then the red and blue data adjacent to the green test point may be changed.

So, an adaptive filter test could be implemented as follows to test to see if a high contrast edge is detected: compare the green data (G) to a min value and a max value—if G<min or G>max, then a register value is set to 1, otherwise the register value is set to 0; compare the register values for three successive green data points to test masks to see if an edge is detected; if detected then take an appropriate action to the red and/or blue data—e.g. apply gamma or apply a new value or different filter coefficient.

The following table is illustrative of this embodiment:

Data (for 3 successive points 0.98 0.05 0.0 Low Test (G < 0.1) 0 1 1 High Test (G > 0.9) 1 0 0 Compare low and NOT high True True True

For the example above, an edge has been detected and there is an array of options and/or actions to take at this point. For example, the gamma correction could be applied to the output of the box filter for red and/or blue; or a new fixed value representing the output required to balance color could be used; or use a new SPR filter.

The test for black lines, dots, edges and diagonal lines are similar in this case, since only three values are examined:

Register Value Binary no. 1. 1 0 1 5 2. 1 1 0 6 3. 0 1 1 3

In the above table, the first row could represent a black pixel with white pixels on either side. The second row could represent an edge of a black line or dot. The third row could represent an edge of a black line in a different location. The binary numbers are used as an encoding for the test.

The test for white lines, dots, edges, and diagonal lines might be as follows:

Register value Binary no. 4. 0 1 0 2 5. 0 0 1 1 6. 1 0 0 4

If the tests are true and the high and low tests are, for example, 240 and 16 (out of 255) respectively, then the output value for these edges using the box filter might be 128+/−4—or some other suitable value. The pattern matching is to the binary numbers shown adjacent to the register values. A simple replacement of 128 raised to an appropriate gamma power could be output to the display. For example, for gamma=2.2, the output value is approximately 186. Even though the input may vary, this is just an edge correction term so a fixed value can be used without noticeable error. Of course, for more precision, a gamma lookup table could likewise be used. It should be appreciated that a different value, but possibly similar, of correction could be used for white and black edges. It should likewise be appreciated that as a result of detecting an edge, the red and/or blue data could be acted on by a different set of filter coefficients—e.g. apply a [1 0] filter (i.e. unity filter) which would effectively turn off sub pixel rendering for that pixel value.

The above tests were primarily for a green test, followed by action on red and blue. Alternatively, the red and blue can be tested separately and actions taken as needed. If one desired to only apply the correction for black and white edges, than all three color data sets can be tested and the result ANDed together.

A further simplification could be made as follows. If only two pixels in a row are tested for edges, then the test above is further simplified. High and low thresholding may still be accomplished. If [0 1] or [1 0] is detected, then a new value could be applied—otherwise the original value could be used.

Yet another simplification could be accomplished as follows (illustrated for the red): subtract the red data value, Rn, from the red value immediately to the left, Rn−1,; if the delta is greater than a predetermined number—say for example 240—then an edge is detected. If an edge is detected, one could substitute a new value, or apply gamma, output the value Rn to the display, or apply new SPR filter coefficients; otherwise, if no edge is detected, output the results of the box filter to the display. As either Rn or Rn−1 may be larger, the absolute value of the delta could be tested. The same simplification could occur for the blue; but the green does not need to be tested or adjusted, if green is the split pixel in the grouping. Alternatively, a different action could be taken for falling edges (i.e. Rn−Rn−1<0) and rising edges (i.e. Rn−Rn−1>0).

The results are logical pixels 600 and 601 that have only three sub-pixels each. For a white dot and using a box filter for red and blue data, the green sub-pixels 106 are set to 100% as before. The nearby red 104, as well as the nearby blue 102, could be all set to 50%. The resample operation of inter-color-plane-phase relationship 610 of FIG. 6D is very simple and inexpensive to implement, while still providing good image quality.

Both of the above data format conversion methods match the human eye by placing the center of logical pixels at the numerically superior green sub-pixels. The green sub-pixels are each seen as the same brightness as the red sub-pixel, even though half as wide. Each green sub-pixel 106 acts as though it were half the brightness of the associated logical pixel at every location, while the rest of the brightness is associated with the nearby red sub-pixel illuminated. Thus, the green serves to provide the bulk of the high resolution luminance modulation, while the red and blue provide lower resolution color modulation, matching the human eye.

FIG. 7A illustrates an alternative inter-color-plane-phase relationship 700 using the green, blue, and red resample area arrays 406, 402 and 404 of FIGS. 4A, 4B, and 4C. Note that inter-color-plane-phase relationship 700 has the same relative phase as color sub-pixel arrangement 100 of FIG. 1C as illustrated in FIG. 7B. Note that the relative phases of the resample points of inter-color-plane-phase relationship 700 is the same as that for inter-color-plane-phase relationship 610 of FIG. 6D. If this inter-color-plane-phase relationship 700 were used for the “one-to-one” data format conversion, the green would again be a unitary filter, while the red and blue would use 3×2 coefficient filter kernel:

0.0625 0.0625 0.375 0.375 0.0625 0.0625

Note that the two columns add up to 0.5 each, similar to the coefficients for the red and blue resample filter operation for the inter-color-plane-phase relationship 610 of FIG. 6D.

This inter-color-plane-phase relationship 700 shown in FIG. 7A is useful for scaling, both up and down, of conventional format data sets. The area resample method of calculation of the fitter coefficients and keeping track of the input and output data buffers was described in the referenced '058 application. However, according to another embodiment, while the red and blue color planes may be area resampled, it may be advantageous to calculate the filter coefficients for the square grid of green sub-pixels 106 using a novel implementation of a bi-cubic interpolation algorithm for scaling up data sets while converting them to be displayed on the arrangement of color sub-pixels 100 of FIG. 1C.

FIG. 10 depicts a system 1000 in which a display as constructed in accordance with the various embodiments disclosed herein is driven by a sub-pixel rendering technique 1004 which may be resident on a physical device 1002. An input image data stream 1008 may be input into the sub-pixel rendering technique 1004 and converted in the manner herein disclosed. An output image data stream 1010 is sent to the display device 1006 in order to drive the various sub-pixels to form an image thereupon. As discussed in several references incorporated herein, the sub-pixel rendering (SPR) technique 1004 may be implemented in either hardware and/or software or a combination thereof. For example, SPR techniques 1004 could be resident as logic (either hardware or software) on the display itself or it could reside on a graphics controller chip or board.

FIGS. 11A and 11B depict two particular flowchart embodiments disclosing sub-pixel rendering in software and hardware respectively. In FIG. 11A, SPR may be accomplished in advance on a PC or other processing system and/or means. From there, the pre-rendered images could be downloaded to a controller/interface and sent along to a drive running the display. In FIG. 11B, image data may be input from many different sources—for example, a notebook PC with DVI output or a desktop with DVI output—to a hardware module doing SPR. From there, the sub-pixel rendered data could be sent ultimately to the display via a controller/interface and a drive. Of course, other hardware and software implementations are possible and that FIGS. 11A and 11B merely describe two possible such implementations.

FIG. 12 shows one particular display embodiment for a 320×320 STN display using the sub-pixel repeat cell as disclosed herein. Although various sub-pixel dimensions are also disclosed in FIG. 12, it should be appreciated that other dimensions would also suffice and that FIG. 12 is merely offered for illustrative purposes for a single embodiment.

While the invention has been described with reference to exemplary embodiments, it will be understood that various changes may be made and equivalents may be substituted for elements thereof without departing from the scope of the invention. In addition, many modifications may be made to adapt a particular situation or material to the teachings without departing from the essential scope thereof. For example, some of the embodiments above may be implemented in other display technologies such as Organic Light Emitting Diode (OLED), ElectroLumenscent (EL), Electrophoretic, Active Matrix Liquid Crystal Display (AMLCD), Passive Matrix Liquid Crystal display (AMLCD), Incandescent, solid state Light Emitting Diode (LED), Plasma Display Panel (PDP), and Iridescent. Therefore, it is intended that the invention not be limited to the particular embodiment disclosed as the best mode contemplated for carrying out this invention, but that the invention will include all embodiments falling within the scope of the appended claims.

Claims

1. A method of converting incoming three-color pixel data of a first format for rendering onto a display panel; said display panel comprising a plurality of a sub-pixel group; said sub-pixel group further comprising eight sub-pixels; wherein each said sub-pixel is one of a first color sub-pixel, a second color sub-pixel and a third color sub-pixel; wherein said sub-pixel group further comprises four sub-pixels of said first color, two sub-pixels of said second color and two sub-pixels of said third color; wherein further said sub-pixels of said second color and said sub-pixels of said third color form substantially a checkerboard pattern; the method comprising:

determining implied sample areas for each data point of said incoming three-color pixel data;
determining a resample area for each color sub-pixel on said display panel;
forming a set of coefficients for each resample area, said coefficients comprising fractions whose denominators are a function of the resample area and whose numerators are a function of an area of each implied sample area that may partially overlap said resample area;
multiplying the incoming pixel data for each implied sample area by a coefficient resulting in a product; and
adding each product to obtain a luminance value for said color sub-pixel on said display panel represented by each resample area.

2. The method as recited in claim 1 wherein a plurality of resample areas for each color sub-pixel in the display forms a resample area array, and wherein the method further comprises:

determining a phase relationship among the resample area arrays for each color sub-pixel.

3. The methods as recited in claim 2 wherein determining a phase relationship further comprises:

positioning resample points for each said color resample areas such that the resample points for said second color and said third color substantially overlay the resample points for said first color.

4. The method as recited in claim 1 wherein said first color is green, and said second and third colors are red and blue respectively;

wherein said set of coefficients for said resample areas for the green color comprises a unity filter; and
wherein said set of coefficents for said resample areas for the red and blue colors are each a 3×3 filter coefficient matrix.

5. The method as recited in claim 1 wherein said unity filter is centered to substantially match an input pixel by adjusting said unity filter with respect to a sub-pixel grid.

6. The method as recited in claim 1 wherein said eight sub-pixels of said sub-pixel group are disposed in two rows of four sub-pixels, and wherein two sub-pixels of said first color, one sub-pixel of said second color and one sub-pixel of said third color are disposed in each of said two rows.

7. The method as recited in claim 1 wherein said eight sub-pixels of said sub-pixel group are disposed in two rows of four sub-pixels, and wherein said checkerboard pattern is formed by one of said sub-pixel of said second color following one of said sub-pixel of said third color in a first row, and one of said sub-pixel of said third color following one of said sub-pixel of said second color in a second row.

8. The method as recited in claim 1 wherein a combined area of said two sub-pixels of said first color is substantially equal to the area of one of said sub-pixel of said second color and said sub-pixel of said third color.

9. The method as recited in claim 1 wherein said eight sub-pixels of said sub-pixel group are disposed in two rows of four sub-pixels, and wherein said sub-pixels of said first color are disposed in columns in said sub-pixel group.

10. The method as recited in claim 9 wherein a first one of said columns of said sub-pixels of said first color is offset from a second one of said columns of said sub-pixels of said first color in said sub-pixel group.

11. The method of claim 1 wherein said display panel is an element of a display system utilizing one of a group of display technologies, said group of technologies comprising passively addressed Liquid Crystal Display (LCD), ElectroLuminescent (EL) Display, Plasma Display, passively addressed Inorganic Light Emitting Diode, Organic Light Emitting Diode Display, Active Matrix Liquid Crystal Display (AMLCD), and Active Matrix Organic Light Emitting Diode Display (AMOLED).

12. A system comprising:

a display panel, said display panel comprising a plurality of a sub-pixel group; said sub-pixel group comprising eight sub-pixels specifying an output data format; said sub-pixel group further comprising four sub-pixels of a first color, two sub-pixels of a second color and two sub-pixels of a third color; said sub-pixels of said second color and said sub-pixels of said third color substantially forming a checkerboard pattern;
means for receiving input image data specified in an input data format different from said output data format; and
means for subpixel rendering said input image data specified in said input data format to said output data format of said plurality of sub-pixel groups on said display panel.

13. The system as recited in claim 12 wherein said means for subpixel rendering input image data further comprises:

means for determining implied sample areas for each data point of said input image data;
means for determining a resample area for each color sub-pixel in the display;
means for forming a set of coefficients for each resample area, said coefficients comprising fractions whose denominators are a function of the resample area and whose numerators are a function of an area of each implied sample area that may partially overlap said resample area;
means for multiplying the input image data for each implied sample area by a coefficient resulting in a product; and
means for adding each product to obtain a luminance value for each resample area.

14. The system as recited in claim 13 wherein a plurality of resample areas for each color sub-pixel in the display forms a resample area array, and wherein the system further comprises:

means for determining a phase relationship among the resample area arrays for each color sub-pixel.

15. The system as recited in claim 14 wherein means for determining a phase relationship further comprises:

means for positioning resample points for each said color resample areas such that the resample points for said second color and said third color substantially overlay the resample points for said first color.

16. The system as recited in claim 13 wherein said first color is green, and said second and third colors are red and blue respectively;

wherein said set of coefficients for said resample areas for the green color comprises a unity filter; and
wherein said set of coefficents for said resample areas for the red and blue colors are each a 3×3 filter coefficient matrix.

17. The system as recited in claim 16 wherein said unity filter is centered to substantially match an input pixel by adjusting said filter with respect to a sub-pixel grid.

18. The system as recited in claim 12 wherein said eight sub-pixels of said sub-pixel group are disposed in two rows of four sub-pixels, and wherein two sub-pixels of said first color, one sub-pixel of said second color and one sub-pixel of said third color are disposed in each of said two rows.

19. The system as recited in claim 12 wherein said eight sub-pixels of said sub-pixel group are disposed in two rows of four sub-pixels, and wherein said checkerboard pattern is formed by one of said sub-pixel of said second color following one of said sub-pixel of said third color in a first row, and one of said sub-pixel of said third color following one of said sub-pixel of said second color in a second row.

20. The system as recited in claim 12 wherein a combined area of said two sub-pixels of said first color is substantially equal to the area of one of said sub-pixel of said second color and said sub-pixel of said third color.

21. The system as recited in claim 12 wherein said eight sub-pixels of said sub-pixel group are disposed in two rows of four sub-pixels, and wherein said sub-pixels of said first color are disposed in columns in said sub-pixel group.

22. The system as recited in claim 21 wherein a first one of said columns of said sub-pixels of said first color is offset from a second one of said columns of said sub-pixels of said first color in said sub-pixel group.

23. The system as recited in claim 12 wherein said system utilizes one of a group of display technologies, said group of technologies comprising passively addressed Liquid Crystal Display (LCD), ElectroLuminescent (EL) Display, Plasma Display, passively addressed Inorganic Light Emitting Diode, Organic Light Emitting Diode Display, Active Matrix Liquid Crystal Display (AMLCD), and Active Matrix Organic Light Emitting Diode Display (AMOLED).

24. A method of rendering input image data specified in a first format comprising first, second and third color data values onto a display panel substantially comprising a sub-pixel repeating group comprising eight sub-pixels of first, second and third colors disposed in two rows; said sub-pixel repeating group further comprising two sub-pixels of said first color, one sub-pixel of said second color and one sub-pixel of said third color disposed in each of said two rows; the method comprising:

determining a plurality of input sample areas for said input image data; each said input sample area representing one input image pixel indicating first, second and third color data values in said input image data;
determining a first color resample area array for said first color sub-pixels on the display panel; said first color resample area array comprising a plurality of first color resample areas each comprising a first color resample point such that one first color resample point represents one first color sub-pixel on the display panel;
for each first color resample point in said first color resample area array, assigning said first color data value of said one input image pixel represented by a corresponding implied sample area to a first luminance value for said first color sub-pixel represented by said first color resample point;
determining a second color resample area array and a third color resample area array for said respective second color and third color sub-pixels on the display panel; each of said second color and third color resample area arrays comprising a plurality of respective second color and third color resample areas each comprising respective second color and third color resample points such that one second color resample point represents one second color sub-pixel on the display panel and one third color resample point represents one third color sub-pixel on the display panel;
computing a set of coefficients for each of said second color resample areas and said third color resample areas, said coefficients comprising fractions whose denominators are a function of the respective resample area and whose numerators are a function of any partial area of each input sample area that may overlap said respective resample area when said respective resample area array overlays said input sample areas; and
producing a second luminance value and a third luminance value for each respective second color sub-pixel and third color sub-pixel on the display panel by multiplying respective ones of said coefficients of a corresponding resample area by respective second color and third color data values of the input image data for each input sample area overlaid by said resample area, and adding the resulting products.

25. The method as recited in claim 24 wherein said first color is green, said second color is red and said third color is blue; said sub-pixel repeating group comprising two green sub-pixels, one blue sub-pixel and one red sub-pixel disposed in each of said two rows.

26. The method as recited in claim 25 wherein a combined area of said two green sub-pixels disposed in each row is substantially equal to the area of one of said blue sub-pixel and said red sub-pixel.

27. The method as recited in claim 24 wherein said first color is green, and wherein said sub-pixel repeating group comprises four green sub-pixels disposed in columns in said sub-pixel repeating group.

28. The method as recited in claim 24 wherein said sub-pixels of said second color and said sub-pixels of said third color form substantially a checkerboard pattern in said two rows such that a sub-pixel of said second color is followed by a sub-pixel of said third color in said first row, and a sub-pixel of said third color is followed by a sub-pixel of said second color in said second row.

29. The method as recited in claim 24 wherein each of said respective second color and third color resample areas overlaps at least two partial rows of input sample areas representing input image pixels in said input image data.

30. The method as recited in claim 24 wherein each of said respective second color and third color resample areas overlaps at most one partial row of input sample areas representing input image pixels in said input image data.

31. The method as recited in claim 24 wherein a plurality of said respective second color and third color resample areas has a diamond shape.

32. The method as recited in claim 24 further comprising determining a phase relationship among said first, second and third resample area arrays.

33. The method as recited in claim 32 wherein determining a phase relationship among said first, second and third resample area arrays comprises positioning said first, second and third color resample points for each respective first, second and third color resample area such that said first, second and third color resample points are substantially coincident.

34. The method as recited in claim 32 wherein determining a phase relationship among said first, second and third resample area arrays comprises positioning said first, second and third color resample points for each respective first, second and third color resample area such that none of said first, second and third color resample points are substantially coincident.

35. The method as recited in claim 24 wherein the step of computing a set of coefficients for each of said second color resample areas and said third color resample areas comprises computing a 3×3 filter coefficient matrix having the values 0 0.125 0 0.125 0.5 0.125 0 0.125 0.

36. The method as recited in claim 24 wherein the step of computing a set of coefficients for each of said second color resample areas and said third color resample areas comprises computing a 3×2 filter coefficient matrix having the values 0.0625 0.0625 0.375 0.375 0.0625 0.0625.

37. The method of claim 24 wherein said display panel is an element of a display system utilizing one of a group of display technologies, said group of technologies comprising passively addressed Liquid Crystal Display (LCD), ElectroLuminescent (EL) Display, Plasma Display, passively addressed Inorganic Light Emitting Diode, Organic Light Emitting Diode Display, Active Matrix Liquid Crystal Display (AMLCD), and Active Matrix Organic Light Emitting Diode Display (AMOLED).

Referenced Cited
U.S. Patent Documents
3971065 July 20, 1976 Bayer
4353062 October 5, 1982 Lorteije et al.
4593978 June 10, 1986 Mourey et al.
4632514 December 30, 1986 Ogawa et al.
4642619 February 10, 1987 Togashi
4651148 March 17, 1987 Takeda et al.
4725828 February 16, 1988 Cowlishaw
4751535 June 14, 1988 Myers
4773737 September 27, 1988 Yokono et al.
4786964 November 22, 1988 Plummer et al.
4792728 December 20, 1988 Chang et al.
4800375 January 24, 1989 Silverstein et al.
4822142 April 18, 1989 Yasui
4853592 August 1, 1989 Strathman
4874986 October 17, 1989 Menn et al.
4886343 December 12, 1989 Johnson
4908609 March 13, 1990 Stroomer
4920409 April 24, 1990 Yamagishi
4946259 August 7, 1990 Matino et al.
4965565 October 23, 1990 Noguchi
4966441 October 30, 1990 Conner
4967264 October 30, 1990 Parulski et al.
5006840 April 9, 1991 Hamada et al.
5052785 October 1, 1991 Takimoto et al.
5113274 May 12, 1992 Takahashi et al.
5132674 July 21, 1992 Bottorf
5144288 September 1, 1992 Hamada et al.
5196924 March 23, 1993 Lumelsky et al.
5233385 August 3, 1993 Sampsell
5311205 May 10, 1994 Hamada et al.
5311337 May 10, 1994 McCartney, Jr.
5315418 May 24, 1994 Sprague et al.
5334996 August 2, 1994 Tanigaki et al.
5339092 August 16, 1994 Johnson et al.
5341153 August 23, 1994 Benzschawel et al.
5398066 March 14, 1995 Martinez-Uriegas et al.
5436747 July 25, 1995 Suzuki
5450216 September 12, 1995 Kasson
5461503 October 24, 1995 Deffontaines et al.
5477240 December 19, 1995 Huebner et al.
5485293 January 16, 1996 Robinder
5535028 July 9, 1996 Bae et al.
5541653 July 30, 1996 Peters et al.
5561460 October 1, 1996 Katoh et al.
5563621 October 8, 1996 Silsby
5579027 November 26, 1996 Sakurai et al.
5648793 July 15, 1997 Chen
5754226 May 19, 1998 Yamada et al.
5773927 June 30, 1998 Zimlich
5792579 August 11, 1998 Phillips
5815101 September 29, 1998 Fonte
5821913 October 13, 1998 Mamiya
5899550 May 4, 1999 Masaki
5917556 June 29, 1999 Katayama
5949496 September 7, 1999 Kim
5973664 October 26, 1999 Badger
5991438 November 23, 1999 Shaked et al.
6002385 December 14, 1999 Silverbrook
6002446 December 14, 1999 Eglit
6005582 December 21, 1999 Gabriel et al.
6008868 December 28, 1999 Silverbrook
6023315 February 8, 2000 Harrold et al.
6034666 March 7, 2000 Kanai et al.
6038031 March 14, 2000 Murphy
6049626 April 11, 2000 Kim
6061533 May 9, 2000 Kajiwara
6064363 May 16, 2000 Kwon
6069670 May 30, 2000 Borer
6072272 June 6, 2000 Rumbaugh
6072445 June 6, 2000 Spitzer et al.
6075905 June 13, 2000 Herman et al.
6097367 August 1, 2000 Kuriwaki et al.
6108122 August 22, 2000 Ulrich et al.
6137560 October 24, 2000 Utsumi et al.
6144352 November 7, 2000 Matsuda et al.
6160535 December 12, 2000 Park
6184903 February 6, 2001 Omori
6188385 February 13, 2001 Hill et al.
6198507 March 6, 2001 Ishigami
6219025 April 17, 2001 Hill et al.
6225967 May 1, 2001 Hebiguchi
6225973 May 1, 2001 Hill et al.
6236390 May 22, 2001 Hitchcock
6239783 May 29, 2001 Hill et al.
6243055 June 5, 2001 Fergason
6243070 June 5, 2001 Hill et al.
6271891 August 7, 2001 Ogawa et al.
6299329 October 9, 2001 Mui et al.
6326981 December 4, 2001 Mori et al.
6327008 December 4, 2001 Fujiyoshi
6340994 January 22, 2002 Margulis et al.
6348929 February 19, 2002 Acharya et al.
6356278 March 12, 2002 Stamm et al.
6360023 March 19, 2002 Betrisey et al.
6377262 April 23, 2002 Hitchcock et al.
6385466 May 7, 2002 Hirai et al.
6392717 May 21, 2002 Kunzman
6393145 May 21, 2002 Betrisey et al.
6396505 May 28, 2002 Lui et al.
6441867 August 27, 2002 Daly
6453067 September 17, 2002 Morgan et al.
6466618 October 15, 2002 Messing et al.
6469766 October 22, 2002 Waterman et al.
6486923 November 26, 2002 Maeshima et al.
6545653 April 8, 2003 Takahara et al.
6545740 April 8, 2003 Werner
6583787 June 24, 2003 Pfister et al.
6593981 July 15, 2003 Haim et al.
6600495 July 29, 2003 Boland et al.
6614414 September 2, 2003 De Haan et al.
6661429 December 9, 2003 Phan
6674430 January 6, 2004 Kaufman et al.
6674436 January 6, 2004 Dresevic et al.
6680761 January 20, 2004 Greene et al.
6681053 January 20, 2004 Zhu
6714206 March 30, 2004 Martin et al.
6738526 May 18, 2004 Betrisey et al.
6750875 June 15, 2004 Keely, Jr. et al.
6781626 August 24, 2004 Wang
6801220 October 5, 2004 Greier et al.
6804407 October 12, 2004 Weldy
6833890 December 21, 2004 Hong et al.
6836300 December 28, 2004 Choo et al.
6842207 January 11, 2005 Nishida et al.
6850294 February 1, 2005 Roh et al.
6856704 February 15, 2005 Gallagher et al.
6867549 March 15, 2005 Cok et al.
6885380 April 26, 2005 Primerano et al.
6888604 May 3, 2005 Rho et al.
6897876 May 24, 2005 Murdoch et al.
6903754 June 7, 2005 Brown Elliott
6928196 August 9, 2005 Bradley et al.
6930676 August 16, 2005 De Haan et al.
6937217 August 30, 2005 Klompenhouwer et al.
6950156 September 27, 2005 Yoshida
6989876 January 24, 2006 Song et al.
7110012 September 19, 2006 Messing et al.
7123277 October 17, 2006 Brown Elliott et al.
7129955 October 31, 2006 Motomura
7167186 January 23, 2007 Credelle et al.
7167275 January 23, 2007 Kukasawa
7184066 February 27, 2007 Elliot et al.
7221381 May 22, 2007 Brown Elliott et al.
20010048764 December 6, 2001 Betrisey et al.
20020015110 February 7, 2002 Brown Elliott
20020030780 March 14, 2002 Nishida et al.
20020054263 May 9, 2002 Kim et al.
20020093476 July 18, 2002 Hill et al.
20020118019 August 29, 2002 Nomura
20020149598 October 17, 2002 Greier et al.
20020186229 December 12, 2002 Brown Elliott
20030034992 February 20, 2003 Brown Elliott et al.
20030071775 April 17, 2003 Ohashi et al.
20030072374 April 17, 2003 Sohm
20030077000 April 24, 2003 Blinn et al.
20030085906 May 8, 2003 Elliott et al.
20030090581 May 15, 2003 Credelle et al.
20030103058 June 5, 2003 Elliott et al.
20030117423 June 26, 2003 Brown Elliott
20030128179 July 10, 2003 Credelle
20030128225 July 10, 2003 Credelle et al.
20030184571 October 2, 2003 Hirayama
20030218614 November 27, 2003 Lavelle et al.
20030218618 November 27, 2003 Phan
20040021804 February 5, 2004 Hong et al.
20040051724 March 18, 2004 Elliott et al.
20040061710 April 1, 2004 Messing et al.
20040075764 April 22, 2004 Law et al.
20040080479 April 29, 2004 Credelle
20040085495 May 6, 2004 Roh et al.
20040095521 May 20, 2004 Song et al.
20040108818 June 10, 2004 Cok et al.
20040114046 June 17, 2004 Lee et al.
20040150651 August 5, 2004 Phan
20040155895 August 12, 2004 Lai
20040169807 September 2, 2004 Rho et al.
20040174380 September 9, 2004 Credelle et al.
20040174389 September 9, 2004 Ben-David et al.
20040179160 September 16, 2004 Rhee et al.
20040189643 September 30, 2004 Frisken et al.
20040196297 October 7, 2004 Elliott et al.
20040213449 October 28, 2004 Safee-Rad et al.
20040239813 December 2, 2004 Klompenhouwer
20040239837 December 2, 2004 Hong et al.
20040247070 December 9, 2004 Ali et al.
20040263528 December 30, 2004 Murdoch et al.
20050001856 January 6, 2005 Sparre et al.
20050007327 January 13, 2005 Elion et al.
20050024380 February 3, 2005 Lin et al.
20050068477 March 31, 2005 Shin et al.
20050083356 April 21, 2005 Roh et al.
20050094871 May 5, 2005 Berns et al.
20050099426 May 12, 2005 Primerano et al.
20050140634 June 30, 2005 Takatori
20050151752 July 14, 2005 Phan
20050162600 July 28, 2005 Rho et al.
20050169551 August 4, 2005 Messing et al.
Foreign Patent Documents
197 46 329 March 1999 DE
199 23 527 November 2000 DE
199 23 527 November 2000 DE
201 09 354 September 2001 DE
0 158 366 October 1985 EP
0 203 005 November 1986 EP
0 322 106 June 1989 EP
0 361 981 April 1990 EP
0 453 033 October 1991 EP
0 0671 650 September 1995 EP
0 793 214 February 1996 EP
0 812 114 December 1997 EP
0 878 969 November 1998 EP
1 083 539 March 2001 EP
1 261 014 November 2002 EP
1 308 923 May 2003 EP
2 133 912 August 1984 GB
2 146 478 April 1985 GB
2 282 928 April 1995 GB
60-107022 June 1985 JP
62 127716 June 1987 JP
02-000826 January 1990 JP
02-000826 January 1990 JP
03-78390 April 1991 JP
03-036239 May 1991 JP
06-102503 April 1994 JP
06-214250 August 1994 JP
11-014978 January 1999 JP
02-983027 November 1999 JP
2004-004822 January 2004 JP
2004 078218 March 2004 JP
WO 00/21067 April 2000 WO
WO 00/42564 July 2000 WO
WO 00/42762 July 2000 WO
WO 00/45365 August 2000 WO
WO 00/67196 November 2000 WO
WO 00/70392 November 2000 WO
WO 01/10112 February 2001 WO
WO 01/29817 April 2001 WO
WO 01/52546 July 2001 WO
WO 02/11112 February 2002 WO
WO 02/059685 August 2002 WO
WO 03/014819 February 2003 WO
WO 03/050605 February 2003 WO
WO 03/034380 April 2003 WO
WO 03/056383 July 2003 WO
WO 2004/017129 February 2004 WO
WO 2004/021323 March 2004 WO
WO 2004/027503 April 2004 WO
WO 2004/086128 October 2004 WO
WO 2005/050296 June 2005 WO
WO 2005/057532 June 2005 WO
Other references
  • Bechtel et al., U.S. Patent Application Publication, Pub. No. US 2002/0190648 A1, Publication Date: Dec. 19, 2002.
  • Booth, Jr., Lawrence A., “Method and Apparatus for Wide Gamut Multicolor Display,” U.S. Patent Application Publication, Publication No. US 2003/0011613 A1, Jan. 16, 2003.
  • “ClearType magnified,” Wired Magazine, Nov. 8, 1999, Microsoft Typography, article posted Nov. 8, 1999, and last updated Jan. 27, 1999, © 1999 Microsoft Corporation, 1 page.
  • Credelle, Thomas L. et al., “P-00: MTF of High-Resolution PenTile Matrix™ Displays,” Eurodisplay 02 Digest, 2002, pp. 1-4.
  • Daly, Scott, “Analysis of Subtriad Addressing Algorithms by Visual System Models,” SID Symp. Digest, Jun. 2001, pp. 1200-1203.
  • Elliott, Candice H. Brown et al., “Color Subpixel Rendering Projectors and Flat Panel Displays,” New Initiatives in Motion Imaging, SMPTE Advanced Motion Imaging Conference, Feb. 27-Mar. 1, 2003, Seattle, Washington, pp. 1-4.
  • Elliott, Candice H. Brown et al., “Co-optimization of Color AMLCD Subpixel Architecture and Rendering Algorithms,” SID Symp. Digest, May 2002, pp. 172-175.
  • Feigenblatt, R.I., “Full-color imaging on amplitude-quantized color mosaic displays,” SPIE, vol. 1075, Digital Image Processing Applications, 1989, pp. 199-204.
  • Hayashi, Kenkichi, “Image Signal Processing Device for Minimizing False Signals at Color Boundaries,”U.S. Patent Application Publication, Publication No. US 2002/0140831 A1, Oct. 3, 2002.
  • Hoelen, Christoph Gerard August et al., “Light Panel with Enlarged Viewing Window,” U.S. Patent Application Publication, Publication No. US 2003/0043567 A1, Mar. 6, 2003.
  • Johnston, Stuart J., “An Easy Read: Microsoft's ClearType,” InformationWeek Online, Redmond, WA, Nov. 12, 1998, 3 pages.
  • Johnston, Stuart J., “Clarifying ClearType,” InformationWeek Online, Redmond, WA, Jan. 4, 1999, 4 pages.
  • “Just Outta Beta,” Wired Magazine, Dec. 1999, Issue 7.12, 3 pages.
  • Klompenhouwer, Michiel A. et al., “Subpixel Image Scaling for Color Matrix Displays,” SID Symp. Digest, May 2002, pp. 176-179.
  • Kusunoki, Toshiaki et al., “Display Device Using Thin Film Cathode and Its Process,” U.S. Patent Application Publication, Publication No. US 2001/0017515 A1, Aug. 30, 2001.
  • Markoff, John, “Microsoft's Cleartype Sets Off Debate on Originality,” The New York Times, Dec. 7, 1998, 5 pages.
  • “Microsoft ClearType,” http://www.microsoft.com/opentype/cleartype, Sep. 26, 2002, 4 pages.
  • Platt, John C., “Optimal Filtering for Patterned Displays,” Microsoft Research, IEEE Signal Processing Letters, 2000, 4 pages.
  • Platt, John, “Technical Overview of ClearType Filtering,” Microsoft Research, http://research.microsoft.com/users/jplatt/cleartype/default.aspx, Sep. 17, 2002, 3 pages.
  • Poor, Alfred, “LCDs: The 800-pound Gorilla,” Information Display, Sep. 2002, pp. 18-21.
  • “Ron Feigenblatt's remarks on Microsoft ClearType™ ,” http://www.geocities.com/SiliconValley/Ridge/6664/ClearType.html, Dec. 5, 1998, Dec. 7, 1998, Dec. 12, 1999, Dec. 26, 1999, Dec. 30, 1999, and Jun. 19, 2000, 30 pages.
  • “Sub-Pixel Font Rendering Technology,” © 2003 Gibson Research Corporation, Laguna Hills, CA, 2 pages.
  • Werner, Ken, “OLEDs, OLEDs, Everywhere . . . ,” Information Display, Sep. 2002, pp. 12-15.
  • Yamazaki, Shunpei, “Semiconductor Device and Manufacturing Method Thereof,” U.S. Patent Application Publication, Publication No. US 2001/0040645 A1, Nov. 15, 2001.
  • Yamazaki, Shunpei et al., “Electro-Optical Device,” U.S. Patent Application Publication, Publication No. US 2002/0017645 A1, Feb. 14, 2002.
  • Choo, Kyo Seop et al., “Data Wire Device of Pentile Matrix Display Device,” U.S. Patent Application Publication, Pub. No. 2003/0071943 A1, Apr. 17, 2003.
  • Goertzen, Kenbe D., “System and Method for Optimizing Image Resolution Using Pixelated Imaging Device,” U.S. Patent Application Publication, Pub. No. 2003/0071826 A1, Apr. 17, 2003.
  • Kunzman, Adam J., “Reduced Color Separation White Enhancement for Sequential Color Displays,” U.S. Patent Application Publication, Pub. No. 2002/0122160 A1, Sep. 5, 2002.
  • Lee, Baek-woon et al., “40.5L: Late-News Paper: TFT-LCD with RGBW Color System,” SID 03 Digest, 2003, pp. 1212-1215.
  • Sun, Xiuhong, “Multispectral Imaging System with Spatial Resolution Enhancement,” U.S. Patent Application Publication, Pub. No. 2002/0012071 A1, Jan. 31, 2002.
  • Adobe Systems, Inc., website, 2002, http://www.adobe.com/products/acrobat/cooltype.html.
  • Betrisey, C., et al., “Displaced Filtering for Patterned Displays,” 2000, Society for Information Display (SID) 00 Digest, pp. 296-299.
  • Carvajal, D., “Big Publishers Looking Into Digital Books,” Apr. 3, 2000, The New York Times, Business/Financial Desk.
  • Elliott, C., “Active Matrix Display Layout Optimization for Sub-pixel Image Rendering,” Sep. 2000, Proceedings of the 1st International Display Manufacturing Conference, pp. 185-189.
  • Elliott, C., “New Pixel Layout for PenTile Matrix,” Jan. 2002, Proceedings of the International Display Manufacturing Conference, pp. 115-117.
  • Elliott, C., “Reducing Pixel Count without Reducing Image Quality,” Dec. 1999, Information Display, vol. 15, pp. 22-25.
  • Gibson Research Corporation, website, “Sub-Pixel Font Rendering Technology, How It Works,” 2002, http://www.grc.com/ctwhat.html.
  • Martin, R., et al., “Detectability of Reduced Blue Pixel Count in Projection Displays,” May 1993, Society for Information Display (SID) 93 Digest, pp. 606-609.
  • Microsoft Corporation, website, 2002, http://www.microsoft.com/reader/ppc/product/cleartype.html.
  • Microsoft Press Release, Nov. 15, 1998, Microsoft Research Announces Screen Display Breakthrough at COMDEX/Fall '98, PR Newswire.
  • Murch, M., “Visual Perception Basics,” 1987, SID, Seminar 2, Tektronix, Inc., Beaverton, Oregon.
  • Okumura, H., et al., “A New Flicker-Reduction Drive Method for High-Resolution LCTVs,” May 1991, Society for Information Display (SID) International Symposium Digest of Technical Papers, pp. 551-554.
  • Wandell, Brian A., Stanford University, “Fundamentals of Vision: Behavior, Neuroscience and Computation,” Jun. 12, 1994, Society for Information Display (SID) Short Course S-2, Fairmont Hotel, San Jose, California.
  • U.S. Patent Application Publication No. US 2002/0015110 A1, Feb. 7, 2002, Brown Elliott.
  • Brown Elliott, C, “Co-Optimization of Color AMLCD Subpixel Architecture and Rendering Algorithms,” SID 2002 Proceedings Paper, May 30, 2002 pp. 172-175.
  • Brown Elliott, C, “Development of the PenTile Matrix™ Color AMLCD Subpixel Architecture and Rendering Algorithms,” SID 2003, Journal Article.
  • Brown Elliott, C, “New Pixel Layout for PenTile Matrix™ Architecture”, IDMC 2002, pp. 115-117.
  • Brown Elliott, C, “Pentile Matirx™ Displays and Drivers” ADEAC Proceedings Paper, Portland OR., Oct. 2005.
  • Brown Elliott, C, “Reducing Pixel Count Without Reducing Image Quality”, Information Display Dec. 1999, vol. 1, pp. 22-25.
  • E-Reader Devices and Software, Jan. 1, 2001, Syllabus, http://www.campus-technology.com/article.asp?id=419.
  • Felgenblatt, Ron, “Remarks on Microsoft ClearType™”, http://www.geocities.com/SiliconValley/Ridge/6664/ClearType.html. Dec. 5, 1998, Dec. 7, 1998, Dec. 12, 1999, Dec. 26, 1999, Dec. 30, 1999 and Jun. 19, 2000, 30 pages.
  • Krantz, John et al., Color Matrix Display Image Quality: The Effects of Luminance . . . SID 90 Digest, pp. 29-32.
  • Messing, Dean et al., Improved Display Resolution of Subsampled Colour Images Using Subpixel Addressing, IEEE ICIP 2002, vol. 1, pp. 625-628.
  • Messing, Dean et al., Subpixel Rendering on Non-Striped Colour Matrix Displays, 2003 International Conf on Image Processing, Sep. 2003, Barcelona, Spain, 4 pages.
  • Poor, Alfred, “LCDs: The 800-pound Gorilla,” Information Display, Sep. 2002, pp. 18-21.
  • Wandell, Brian A., Stanford University, “Fundamentals of Vision: Behavior . . . ,” Jun. 12, 1994, Society for Information Display (SID) Short Course S-2, Fairmont Hotel, San Jose, California.
  • Werner, Ken, “OLEDS, OLEDS, Everywhere . . . ,” Information Display, Sep. 2002, pp. 12-15.
  • USPTO, Non-Final Office Action, dated Mar. 9, 2004 in US Patent No. 6,903,754 (U.S. Appl. No. 09/916,232).
  • USPTO, Non-Final Office Action, dated May 6, 2004 in US Patent No. 6,903,754 (U.S. Appl. No. 09/916,232).
  • Clairvoyante Inc., Response to Non-Final Office Action, dated Sep. 3, 2004 in US Patent No. 6,903,754 (U.S. Appl. No. 09/916,232).
  • USPTO, Final Office Action, dated Jan. 6, 2005 in US Patent No. 6,903,754 (U.S. Appl. No. 09/916,232).
  • Clairvoyante Inc., Response to Final Office Action, dated Jan. 28, 2005 in US Patent No. 6,903,754 (U.S. Appl. No. 09/916,232).
  • USPTO, Non-Final Office Action, dated Feb. 7, 2005 in US Patent Publication No. 2003/0034992 (U.S. Appl. No. 10/051,612).
  • Clairvoyante Inc., Response to Non-Final Office, dated Jul. 7, 2005 in US Patent Publication No. 2003/0034992 (U.S. Appl. No. 10/051,612).
  • USPTO, Final Office Action dated, Aug. 31, 2005 in US Patent Publication No. 2003/0034992 (U.S. Appl. No. 10/051,612).
  • Clairvoyante Inc, Response to Final Office, dated Sep. 19, 2005 In US Patent Publication No. 2003/0034992 (U.S. Appl. No. 10/051,612).
  • USPTO, Non-Final Office Action dated, Dec. 15, 2005 In US Patent Publication No. 2003/0034992 (U.S. Appl. No. 10/051,612).
  • Clairvoyante Inc, Response to Non-Final Office, dated Feb. 8, 2006 In US Patent Publication No. 2003/0034992 (U.S. Appl. No. 10/051,612).
  • USPTO, Notice of Allowance, dated May 4, 2006 in US Patent Publication No. 2003/0034992 (U.S. Appl. No. 10/051,612).
  • USPTO, Non-Final Office Action, dated Jul. 28, 2005 in US Patent Publication No. 2003/0090581 (U.S. Appl. No. 10/278,393).
  • Clairvoyante Inc, Response to Non-Final Office Action, dated Jan. 30, 2006 In US Patent Publication No. 2003/0090581, (U.S. Appl. No. 10/278,393).
  • USPTO, Final Office Action, dated Apr. 18, 2006 In US Patent Publication No. 2003/0090581 (U.S. Appl. No. 10/278,393).
  • USPTO, Non-Final Office Action, dated May 4, 2005 in US Patent Publication No. 2003/0117423, (U.S. Appl. No. 10/278,328).
  • Clairvoyante Inc, Response to Non-Final Office Action, dated Nov. 3, 2005 in US Patent Publication No. 2003/0117423, (U.S. Appl. No. 10/278,328).
  • USPTO, Final Office Action, dated Feb. 17, 2006 in US Patent Publication No. 2003/0117423, (U.S. Appl. No. 10/278,328).
  • USPTO, Interview Summary, dated Mar. 17, 2006 In US Patent Publication No. 2003/0117423, (U.S. Appl. No. 10/278,328).
  • USPTO, Non-Final Office Action, dated Jun. 27, 2005 in US Patent Publication No. 2003/0103058, (U.S. Appl. No. 10/150,355).
  • Clairvoyante Inc, Response to Non-Final Office Action, dated Dec. 22, 2005 In US Patent Publication No. 2003/0103058, (U.S. Appl. No. 10/150,355).
  • USPTO, Final Office Action, dated Mar. 7, 2006 In US Patent Publication No. 2003/0103058, (U.S. Appl. No. 10/150,355).
  • Clairvoyante Inc, Response to Non-Final Office Action, dated Jul. 25, 2006 in US Patent Publication No. 2003/0103058, (U.S. Appl. No. 10/150,355).
  • USPTO, Non-Final Office Action, dated Mar. 24, 2005 In US Patent Publication No. 2003/0085906, (U.S. Appl. No. 10/215,843).
  • Clairvoyante Inc, Response to Non-Final Office Action, dated Sep. 26, 2005 In US Patent Publication No. 2003/0085906, (U.S. Appl. No. 10/215,843).
  • USPTO, Final Office Action, dated Jan. 25, 2006 in US Patent Publication No. 2003/0085906, (U.S. Appl. No. 10/215,843).
  • Clairvoyante Inc, Response to Non-Final Office Action, dated Jun. 26, 2006 in US Patent Publication No. 2003/0085906, (U.S. Appl. No. 10/215,843),
  • USPTO, Notice of Allowance, dated Jul 16, 2006 in US Patent Publication No. 2003/0085906, (U.S. Appl. No. 10/215,843).
  • USPTO, Non-Final Office Action, dated May 17, 2005 In US Patent Publication No. 2004/0051724, (U.S. Appl. No. 10/243,094).
  • Clairvoyante Inc, Response to Non-Final Office Action, dated Nov. 17, 2005 In US Patent Publication No. 2004/0051724, (U.S. Appl. No. 10/243,094).
  • USPTO, Final Office Action, dated Mar. 8, 2006 In US Patent Publication No. 2004/0051724, (U.S. Appl. No. 10/243,094).
  • USPTO, Non-Final Office Action, dated Nov. 16, 2004 in US Patent Publication No. 2003/0128179. (U.S. Appl. No. 10/278,352).
  • Clairvoyante Inc, Response to Non-Final Office Action, dated Apr. 15, 2005 In US Patent Publication No. 2003/0128179, (U.S. Appl. No. 10/278,352).
  • USPTO, Non-Final Office Action, dated Jul. 12, 2005 In US Patent Publication No. 2003/0128179, (U.S. Appl. No. 10/278,352).
  • Clairvoyante Inc, Response to Non-Final Office Action, dated Jan, 12. 2006 In US Patent Publication No. 2003/0128179, (U.S. Appl. No. 10/278,352).
  • USPTO, Non-Final Office Action, dated Oct. 26, 2004 In US Patent Publication No. 2004/0174380 (U.S. Appl. No. 10/379,765).
  • Clairvoyante Inc, Response to Non-Final Office Action, dated Jan. 24, 2005 In US Patent Publication No. 2004/0174380 (U.S. Appl. No. 10/379,765).
  • USPTO, Final Office Action, dated Jun. 2, 2005 in US Patent Publication No. 2004/0174380 (U.S. Appl. No. 10/379,765).
  • USPTO, Non-Final Office Action, dated Nov. 2, 2005 in US Patent Publication No. 2004/0174380 (U.S. Appl. No. 10/379,765).
  • Clairvoyante Inc, Response to Non-Final Office Action, dated Apr. 10, 2006 In US Patent Publication No. 2004/0174380 (U.S. Appl. No. 10/379,765).
  • USPTO, Notice of Allowance, dated Jul. 26, 2006 In US Patent Publication No. 2004/0174380 (U.S. Appl. No. 10/379,765).
  • Michiel A. Klompenhouwer, Gerard de Haan, Subpixel image scaling for color matrix displays, Journal of the Society for Information Display, vol. 11, Issue 1, Mar. 2003, pp. 99-108.
  • PCT International Search Report dated Jun. 3, 2002 for PCT/US02/12610 (U.S. Appl. No. 10/051,612).
  • PCT International Search Report dated Jul. 17, 2003 for PCT/US02/39859 (U.S. Appl. No. 10/278,393).
  • PCT International Search Report dated Jul. 30, 2003 for PCT/US02/39860 (U.S. Appl. No. 10/278,328).
  • PCT International Search Report dated Sep. 30, 2003 for PCT/US02/24994 (U.S. Appl. No. 10/215,843).
  • PCT International Search Report dated Jun. 14, 2004 for PCT/US03/028222 (U.S. Appl. No. 10/243,094).
  • PCT International Search Report dated Jun. 24, 2005 for PCT/US04/34773 (U.S. Appl. No. 10/696,026).
  • USPTO, Notice of Allowance, dated Feb. 7, 2005 in US Patent No. 6,903,754 (U.S. Appl. No. 09/916,232).
  • Clairvoyante Inc, Response to Non-Final Office Action, dated Sep. 18, 2006 in US Patent Publication No. 2003/0090581, (U.S. Appl. No. 10/278,383).
  • USPTO, Non-Final Office Action, dated Nov. 14, 2006 in US Patent Publication No. 2003/0090581, (U.S. Appl. No. 10/278,393).
  • Clairvoyante Inc, Response to Non-Final Office Action, dated May 14, 2007 in US Patent Publication No. 2003/0090581, (U.S. Appl. No. 10/278,393).
  • Clairvoyante Inc, Response to Final Office Action, dated Aug. 16, 2006 in US Patent Publication No. 2003/0117423, (U.S. Appl. No. 10/278,328).
  • USPTO, Non-Final Office Action, dated Nov. 15, 2006 in US Patent Publication No. 2003/0117423, (U.S. Appl. No. 10/278,328).
  • USPTO, Notice of Allowance, dated Nov. 30, 2006 in US Patent Publication No. 2003/0103058, (U.S. Appl. No. 10/150,355).
  • USPTO, Final Office Action, dated Sep. 18, 2006 in US Patent Publication No. 2003/0128179, (U.S. Appl. No. 10/278,352).
  • Clairvoyante Inc, Response to Final Office Action, dated Dec. 6, 2006 in US Patent Publication No. 2003/0128179, (U.S. Appl. No. 10/278,352).
  • USPTO, Non-Final Office Action dated Jan. 28, 2005 in US Patent Publication No. 2005/0088385 (U.S. Appl. No. 10/696,026).
  • Clairvoyante Inc, Response to Non-Final Office Action dated Jul. 27, 2005 in US Patent Publication No. 2005/0088385 (U.S. Appl. No. 10/696,026).
  • USPTO, Non-Final Office Action dated Sep. 16, 2005 in US Patent Publication No. 2005/0088385 (U.S. Appl. No. 10/696,026).
  • Clairvoyante Inc, Response to Non-Final Office Action dated Dec. 15, 2006 in US Patent Publication No. 2005/0088385 (U.S. Appl. No. 10/696,026).
Patent History
Patent number: 7492379
Type: Grant
Filed: Oct 22, 2002
Date of Patent: Feb 17, 2009
Patent Publication Number: 20030128225
Assignee: Samsung Electronics Co., Ltd. (Suwon-si, Gyeonggi-do)
Inventors: Thomas Lloyd Credelle (Morgan Hill, CA), Candice Hellen Brown Elliott (Vallejo, CA), Michael Francis Higgins (Cazadaro, CA)
Primary Examiner: Sumati Lefkowitz
Assistant Examiner: Alexander S. Beck
Attorney: MacPherson Kwok Chen & Heid LLP
Application Number: 10/278,353