Method of Processing Fields of Images and Related Device for Data Lines Similarity Detection
A method for processing image fields is provided. The method includes determining similarities of first data lines of a first plurality of couples of fields among a plurality of fields by detecting similarities of pixels of the first data lines of the first plurality of couples of fields, and generating television image signals relative to the first data lines of a plurality of couples of adjacent fields among the plurality of fields by utilizing the first data lines of the plurality of couples of adjacent fields according to a predetermined rule when a first predetermined pattern is detected from said similarities of said first data lines of the first plurality of couples of fields.
The application claims the benefit of U.S. Provisional Application No. 60/560,621 which was filed on Apr. 9, 2004.
BACKGROUND OF INVENTION1. Field of the Invention
The invention relates to a method for generating TV signals and related apparatus, and more particularly, to a method for generating TV signals according to data lines similarities and related apparatus thereof.
2. Description of the Prior Art
The continuous and dynamic images of movies and television provided to viewers are in reality generated from a combination of gradually changing still images. When the television displays the video, there are two types of systems that have evolved to produce the continuous and dynamic flow of images. The first one is the national television standard committee (NTSC) system. In this system each video field includes 525 rows of data (i.e., 525 horizontal lines) and 60 pictures are displayed each second, i.e. the field rate is 60 Hz. The second system is called the phase alternating line (PAL), wherein each video field includes 625 rows of data and 50 pictures are displayed each second, i.e. the field rate is 50 Hz. For these two traditional television systems, to display 60 fields per second comprising 525 rows of data or to display 50 fields per second comprising 625 rows of data is extremely expensive, thus not suitable to the market. So, interlaced scanning technology was developed. Interlaced scanning scans the even lines for the first video field, then scans the odd lines for the next video field instead of scanning all lines for each field. Hence, for NTSC system with 60 Hz field rate actually 30 frames per second are processed, and for PAL system actually 25 frames per second are processed. However, the flow of dynamic images is still acceptable to the human eye. The images are still perceived as continuous and dynamic. Each frame in the interlaced scanning technology is divided into two parts: odd sequence data that is known as odd field and even sequence data that is known as even field.
However, a movie is displayed at a frame rate of 24 Hz. For NTSC system, as an example, when it is desirable to broadcast the movie to the television the movie's image data must be converted from its normal frequency of 24 Hz to 60 Hz.
Please refer to
Progressive scan is developed later and becomes popular, such as the LCD display or plasma TV. In progressive scan, the whole data lines, instead of only half data lines, of each video field are displayed. Therefore, when the progressive scan (or the double-frequency TV image technique) is utilized to display the field, which only comprise half data, fields should be transformed into frames, which comprise the whole data, so that the progressive scan can be executed correctly. The above-mentioned operation of transforming fields into frames is also called as “de-interlacing” technique. Generally speaking, two odd (even) fields corresponding to the same film frame are the same, but two odd (even) fields corresponding to two film frames are the same only if the two film frames are still. In the prior art, one field can be deinterlaced with the adjacent field to double the display resolution. However, if the original field data are the fields of film data as shown in
Please refer to
In the NTSC system, the frame rate of the progressive scan technique is 60 Hz. Therefore, the progressive TV frame P1 is utilized to generate the progressive TV frames P2 and P3. In other words, the progressive TV frame A′ is displayed in total three times. Similarly, the progressive TV frames P4 are copied to generate the progressive TV frame P5. That is, the progressive TV frame B′ is displayed twice. Similarly, the frame C′ is displayed three times, and the frame D′ is displayed twice.
When the TV data are broadcasted by the TV service provider, other data or information (for example, running text) is added to facilitate advertisements or news. Because of the introducing this additional data or information, two same fields looks different. If two same fields originates from the same film frame, the prior art may wrongly determine the mode of the TV content or wrongly processing the fields results in the running text becoming blurred.
In addition to adding the running text, other information can be added such that the original similarity pattern is influenced. For example, a still text or trademark is added, or the current time text can be added in the corner of the picture. These may cause a misinterpretation of the type of the source image. Please refer to
It is therefore one of primary objectives of the claimed invention to provide a method for generating a TV signal according to data line similarity and the related apparatus thereof. That is, the present invention utilizes the data line as a unit to detect the similarity of each pair of fields, and then utilizes the similarity pattern to determine the type of the source image. Therefore, the present invention utilizes the data line as a unit to process the interlaced TV data to generate the progressive TV data in order to prevent the influence of the similarity pattern from having a negative effect on the added running texts or still texts in order to solve the above-mentioned problem.
According to an exemplary embodiment of the claimed invention, a method for generating image signals according to data lines similarity is disclosed. The method comprises: determining similarities of first data lines by detecting similarities of pixel similarities of the first data lines of a first plurality of pairs of fields among a plurality of fields; and if the similarities of the first data lines comply with a first predetermined similarity pattern, utilizing first data lines of a plurality pairs of successive fields of the plurality of fields according to a predetermined rule in order to generate data of a first data line of a image signal, where the data of the first data line of the image signal correspond to the plurality pairs of successive fields.
These and other objectives of the present invention will no doubt become obvious to those of ordinary skill in the art after reading the following detailed description of the preferred embodiment that is illustrated in the various figures and drawings.
BRIEF DESCRIPTION OF DRAWINGS
The present invention utilizes data lines as a unit (line-based) to detect similarities of specific data lines of each field in an interlaced TV signal. If the similarities of the specific data lines comply with a predetermined similarity pattern, the present invention combines data of the specific data lines of two successive fields to generate a progressive TV signal. On the other hand, if the similarities of the specific data lines do not comply with the predetermined similarity pattern, the present invention directly interpolates the data lines utilizing the current field, to enhance the quality for the progressive TV signal.
Please refer to
In this embodiment, the present invention can detect a similarity pattern of data lines of the interlaced scanning television image signal in the data lines, which are above the n+2 data line or below the s data line in odd fields among the fields F41 to F50, and in the data lines, which are above the n+3 data line or below the s+1 data line in even fields among the fields F41 to F50. The similarity, as mentioned above, indicates that the two fields of the first pair of fields among five successive pairs of fields are similar to each other, wherein each pair of fields contains two fields that are separated by a single field. And if the similarity complies with the similarity pattern, the data line is utilized as a unit to combine the odd field and the even field to generate corresponding data lines of TV frames P41-P50. This allows that the data of the 1 data line to n+1 data line, and data of the data lines below the s+2 data lines are double of the original interlaced TV field so as to have better display quality.
However, because the running text is added in the interlaced TV fields F41-F50, the similarities of the n+2 data lines of the fields F41-F50 to s+1 data lines of the fields F41-F50 do not comply with the specific similarity pattern. Therefore, the present invention directly utilizes neighboring data lines of the current field to generate two data lines of the progressive frames.
As shown in
In this embodiment, if detecting that the similarities of corresponding data lines of fields comply with the specific similarity pattern for several times (for example, the specific similarity pattern of the data lines of the pair of corresponding fields per five fields appears twice), the present invention combines the data of the data lines of the interlaced TV fields into the corresponding data lines of the progressive TV frames according to a predetermined way. Please note that when the data are displayed, if the similarity pattern cannot be detected, the present invention directly utilizes the data lines of the fields to generate progressive TV data instead of utilizing the combined data line.
Please refer to
Please refer to
-
- Step 600: Set N=0;
- Step 610: If all pixels of a target data line of the target field are all detected, step 615 is then performed; otherwise, step 620 is performed;
- Step 615: Determine that the target data line of the target field is similar to the corresponding data line of the corresponding field, and then step 670 is performed;
- Step 620: Determine an undetected pixel of the target data line of the target field as the target pixel and determine a corresponding pixel, which has a position, which corresponds to the target pixel, of the corresponding data line of the corresponding field;
- Step 630: If the gray value of the corresponding pixel is different from the gray value of the target pixel, step 640 is performed; otherwise, step 610 is performed;
- Step 640: Add 1 to N;
- Step 650: If N is larger than the predetermined value K, then step 660 is performed; otherwise, step 610 is performed again;
- Step 660: Determine that the target data line of the target field is not similar to the corresponding data line of the corresponding field;
- Step 670: Finish.
In order to realize the flow of determining the similarity of two data lines, the image processing device can be embodied by software or hardware circuits.
Please refer to
Please note that when the interlaced TV fields comprise still texts, the present invention detectd the line-based similarities in order to generate the progressive TV frames. Please refer to
In another embodiment, the similarity of data lines of successive odd and even fields is detect, and the progressive frames are generated according to the line-based similarity of corresponding fields. Please note that two odd and even fields originated from the same frames contains no exactly corresponding lines. Still, the line-based similarity can be determined in this embodiment. When the degree of similarity of two successive odd and even fields is larger than a predetermined value, the present invention can determine that the two fields come from the same source image. However, because the odd and even field respectively comprises odd data lines and even data lines, the odd and even fields have no directly corresponding data lines (i.e., the odd and even fields have no common data lines or common pixels). Therefore, the present invention cannot compare data lines of two odd fields or two even fields as mentioned above. In this embodiment, the present invention utilizes a zigzag detection to determine the similarity of two data lines of the two successive fields.
Please refer to
Sign(91(k,j)−92(k−1,j)) XOR Sign(92(k+1,j)−91(k,j))=1 equation(1)
Abs(91(k,j)−92(k−1,j))>K3 equation(2)
Abs(92(k+1,j)−91(k,j))>K4 equation(3)
In the above three equations, the values K3 and K4 are two predetermined values, and K3 and K4 can be the same value or different values.
In this embodiment, when the two successive fields correspond to a motion (the two fields are different because of the motion), in the area, which have pixel value variance because of the motion, of the fields, the gray value of the middle pixel is the largest or the smallest. Equation (1) is satisfied. Furthermore, the gray value difference between the middle pixel and other vertically successive pixels is larger than a predetermined value. Equations (2) and (3) are satisfied. Therefore, the present invention determines that the three pixels are not changing smoothly. Moreover, if the number of pixels, which are determined as being not changing smoothly, of the target data line of the target field are larger than a predetermined value, the present invention determines that the two data lines (e.g., the target data line and the corresponding data line) are not similar. On the contrary, if the number of pixels, which are determined as being changing smoothly, of the target data line of the target field, the present invention determines that the two data lines (e.g., the target data line and the corresponding data line) are similar.
Please refer to
-
- Step 1000: Set N as 0;
- Step 1010: If all pixels of the target data line of the target field are all detected, step 1015 is performed; otherwise, step 1020 is performed;
- Step 1015: Determine that the target data line and two data lines of the corresponding field are similar, and then step 1070 is performed;
- Step 1020: Utilize a undetected pixel of the target data line of the target field as the target pixel, respectively utilize an upper data line and a lower data line of the corresponding field as two corresponding data lines, and utilize two pixels having the same horizontal coordinate of the target pixel as a first successive pixel and a second successive pixel;
- Step 1030: If the gray value Uj of the first successive pixel is larger than the gray value Mj, the gray value difference between the gray value Uj and the gray value Mj is larger than a third predetermined value K3, or the gray value Dj of the second successive pixel is larger than the gray value Mj and the gray value difference between the gray value Dj and the gray value Mj is larger than a fourth predetermined value K4, step 1040 is performed; otherwise, step 1010 is performed;
- Step 1040: Add 1 to N;
Step 1050: If N is larger than a fifth predetermined value K5, step 1060 is performed; if N is less than the predetermined value K3, step 1010 is performed;
-
- Step 1060: Determine that the target data line and the two corresponding data lines are similar;
- Step 1070: Finish.
In order to detect the similarities of the data lines of two successive odd and even fields, the image processing apparatus can be achieved by software or hardware circuits.
Please refer to
As mentioned above, if the TV service provider adds the running text, the present invention can utilize data lines as a unit to determine the similarity of the fields. Therefore, the present invention can prevent poor display quality due to the running texts for appearing. Furthermore, the present invention can still perform the interpolation on most of pixels of the TV fields and perform the de-interlacing operation on most of the data lines of the TV fields to compensate the TV display quality. The present invention does not perform any operation on the data lines comprising the running text. This causes the running text to appear as clear rather than blurry. For example, N*1-bit line buffer can be added to a display controller. The line buffer can continuously records the similarities of all data lines of the target field. Therefore, the display controller can selectively perform the de-interlacing operation or the interpolation operation on the pixels according to the data stored in the line buffer. This allows the present invention to avoid the processing of the data lines comprising running texts. Please note that the value N is related to the display quality of the TV frame. For example, in the NTSC system, it comprises 525 data lines; the value N can be 525. In the PAL system, it comprises 625 data lines; the value N can be 625. Please note that the added hardware is limited so that the hardware cost is minimal. Moreover, because the running text is not disposed in the central position of the frames viewers may not observe the running text as much as more centrally located images. The present invention can utilize N*1-bit line buffer to utilize the data lines as a unit to determine the similarities of fields. Until the current image source does not comply with a predetermined similarity pattern, the present invention maintains the current playing mode (e.g., the film mode). Please note that the present invention device, which utilizes the data line as a unit to determine the field similarities, can operate independently or it can operate with other prior art devices that utilize entire fields to determine the field similarities.
Please refer to
Please refer to
-
- Step 1400: Start;
- Step 1410: Analyze the similarities of the data lines of the target field and record the similarities in the N*1-bit data line state recorder;
- Step 1420: De-interlace and scale the main area of the target field with a successive field, which is the area having no running text, according to the similarities stored in the data line state recorder;
- Step 1430: De-interlace and scale the secondary areas of the target field without referring to other fields. This allows the running text clearer;
- Step 1440: Finish.
In summary, the present invention provides a method of utilizing a data line as a unit to generate progressive TV frames according to interlaced TV fields and apparatus thereof. The present invention can more elastically generate the progressive TV frames. Even when a running text is added to the field, the present invention can process other areas that do not contain any running texts. In addition, the present invention can prevent poor editing of the fields due to the interlaced TV fields being derived from film data.
The present invention can first utilize a whole field as a unit to detect whether the similarity pattern exist in order to ensure what the data source of the interlaced TV fields is. And then the present invention utilizes the data line as a unit to detect the similarity so that the present invention can generate a high-quality progressive TV frames. Furthermore, the present invention can detect whether the similarity complies with a predetermined similarity pattern. If the number of the similarities of the data lines of the target field is larger than a predetermined number, the present invention directly utilizes the target field to generate the progressive TV frames.
The present invention also provides a data line similarity detecting device and related methods thereof. The present invention can utilize two fields, which have one field between them, or two successive fields to perform the similarity detection. Of course, the present invention also utilizes one data line as a unit. The present invention similarity detecting device comprises a pixel comparator for comparing the gray values between the target pixel and a corresponding pixel; an accumulator, coupled to the pixel comparator, for accumulating the comparison results outputted by the pixel comparator; and a similarity determiner, coupled to the accumulator, for determining the similarity of the data lines of the target field.
Please note that the present invention data line similarity detecting device shown in
Those skilled in the art will readily observe that numerous modifications and alterations of the device and method may be made while retaining the teachings of the invention. Accordingly, the above disclosure should be construed as limited only by the metes and bounds of the appended claims.
Claims
1. A method of generating a television image signal according to data lines similarity comprising:
- determining similarities of first data lines of a first plurality of couples of fields among a plurality of fields by detecting similarities of pixels of the first data lines of the first plurality of couples of fields; and
- generating data of the television image signal by utilizing the first data lines of the plurality of couples of adjacent fields according to a predetermined rule when a first predetermined pattern is detected from said similarities of said first data lines of the first plurality of couples of fields;
- wherein the data of the television signal is relative to the first data lines of a plurality of couples of adjacent fields among the plurality of fields.
2. The method of claim 1, wherein in the step of detecting similarities, each couple of fields among the plurality of couples of fields comprises two odd fields or two even fields, and in the step of generating the television image signal, each plurality couple of adjacent fields comprises an odd field and an even field.
3. The method of claim 2, wherein in the step of generating the television image signal, the first predetermined pattern indicates that, among a plurality of couples of adjacent fields, in every five successive fields, a first data line of the first field is similar to a first data line of the third field, and the predetermined rule then utilizes the first data lines of a first couple of adjacent fields among the plurality of successive fields to generate two data lines of a frame corresponding to the first couple of adjacent fields in the television image signal, utilizes the first data lines of a second couple of adjacent fields among the plurality of successive fields to generate two data lines of a frame corresponding to the second couple of adjacent fields in the television image signal, and utilizes the first data lines of a fourth couple of adjacent fields among the plurality of successive fields to generate two data lines of a frame corresponding to the fourth couple of adjacent fields in the television image signal.
4. The method of claim 1, wherein in the detecting step, each couple of fields among the plurality of couples of fields comprises one odd field and an adjacent even field; and in the step of generating the television image signal, each couple of adjacent fields among the plurality of adjacent fields comprises an odd field and an even field.
5. The method of claim 4, wherein in the step of generating the television image signal, the first predetermined pattern indicates that among the plurality of successive fields, in every five successive fields, a first data line of the first field is similar to two corresponding data lines of the second field, and a first data line of the fourth field is similar to two corresponding data lines of the fifth field; and the predetermined rule then utilizes first data lines of the first couple of adjacent fields among the plurality of successive fields to generate two data lines of a frame corresponding to the first couple of adjacent fields in the television image signal, utilizes first data lines of the second couple of adjacent fields among the plurality of successive fields to generate two data lines of a frame corresponding to the second couple of adjacent fields in the television image signal, and utilizes first data lines of the fourth couple of adjacent fields among the plurality of successive fields to generate two data lines of a frame corresponding to the fourth couple of adjacent fields in the television image signal.
6. The method of claim 1, wherein the detecting step compares gray level variation between a target pixel of a first data line of a target field and corresponding pixels of corresponding data lines of a corresponding field in order to determine a similarity of the said target pixel of the first data line of the said target field; in which the target pixel and the corresponding pixels are located on a same horizontal coordinate.
7. The method of claim 6 determining the said target pixel of the first data line of the said target field is similar to the corresponding pixels of the said corresponding field when the gray level variation between the target pixel of the first data line of the target field and the corresponding pixels of the corresponding data lines of the corresponding field is less than a first predetermined value.
8. The method of claim 7 wherein the detecting step further comprises:
- in the first data line of the target field, accumulating the amount of pixels of which the gray level variation from the corresponding pixels of the corresponding field is less than a predetermined value; and
- determining the similarity of the first data line of the target field according to the amount of pixels of which the gray level variation is less than the predetermined value.
9. The method of claim 8 determining the first data line of the target field is similar to the first data line of the corresponding field when the amount of pixels of the first data line of the target field that is similar to the corresponding pixels of corresponding data lines of the corresponding field is more than a second predetermined value.
10. The method of claim 6 determining the target pixel is similar to the corresponding pixels of the two corresponding data lines of the corresponding field when the gray level variation between the target pixel of the first data line of the target field and a corresponding pixel of a first corresponding data line of the corresponding field is less than a first predetermined value, and the gray level variation between the target pixel of the first data line of the target field and a corresponding pixel of a second corresponding data line of the corresponding field is less than a second predetermined value.
11. The method of claim 10 wherein the detecting step further comprises:
- in the first data line of the target field, accumulating the amount of pixels which is similar to the corresponding pixels of the two corresponding data lines of the corresponding field in order to get a statistic; and
- determining the similarity of the first data line of the target field according to the statistic.
12. The method of claim 11 determining the first data line of the target field is similar to the two corresponding data lines of the corresponding field when the statistic is greater than a third predetermined value.
13. The method of claim 1 further comprising:
- generating data relative to the first data lines of the plurality of fields in the television image signal according to the first data lines of the plurality of fields when the similarities of the said first data lines do not conform to the first predetermined pattern.
14. The method of claim 13 directly utilizing the target field to generate two adjacent data lines of a frame corresponding to the target field in the television image signal when the similarities of the first data lines do not conform to the first predetermined pattern.
15. The method of claim 1 wherein the plurality of fields is originated from an interlaced scanning television image signal formed from movie image data.
16. The method of claim 1 further comprising:
- detecting similarities of a second plurality of fields;
- wherein the step of detecting similarities of pixels of the first data lines of the first plurality of couples of fields is performed when the similarities of the second plurality of fields conform to a second predetermined pattern.
17. The method of claim 16 wherein the second predetermined pattern indicates that among the second plurality of fields, a first field of every five successive fields is similar to a third field of the five successive fields.
18. The method of claim 16 wherein the second predetermined pattern indicates that among the second plurality of fields, in every five successive fields, a first field is similar to a second field, a second field is similar to a third field, and a fourth field is similar to a fifth field.
19. The method of claim 1 further comprising:
- accumulating the amount of pairs of data lines that are similar to each other in a couple of fields among the first plurality of couples of fields.
20. The method of claim 1 wherein the television image signal is a progressive scan television image signal.
21. A display controller capable of detecting data line similarity comprising:
- a buffer for temporarily storing a plurality of data lines of a target field;
- a data line similarity detector, coupled to the buffer, for detecting a similarity of each data line of the target field;
- a data line state recorder for recording the similarity of each data line of the target field;
- a de-interlacer coupled to the buffer; and
- a scaler coupled to the de-interlacer;
- wherein the de-interlacer selectively de-interlaces the target field according to the content stored in the data line state recorder in order to generate a de-interlaced output, and the scaler generates a scaling output according to the de-interlaced output.
22. The display controller of claim 21, wherein the data line state recorder is 525*5 bits.
23. The display controller of claim 21, wherein the data line state recorder is 625*5 bits.
24. The display controller of claim 21 further comprising a field state flag for storing a field state of the target field.
25. The display controller of claim 24, wherein the field state flag comprises a running text flag, a still text flag, and an image bad editing flag for respectively representing a state of a running text, a state of a still text, and a state of an image bad editing.
26. A method for generating a scaling output according to similarities of data lines, the method comprising:
- analyzing and recording similarities of a plurality of data lines of a target field;
- selectively de-interlacing the target field according to the similarities of the plurality of data lines in order to generate a de-interlaced output; and
- scaling the de-interlaced output to generate the scaling output.
27. The method of claim 26, wherein the selectively de-interlacing step deinterlaces a main area of the target field with reference to an adjacent field, successive to the target field according to the similarities of the data lines.
28. The method of claim 27, wherein the selectively de-interlacing step performs the interpolation with reference to the target field in reponse to the similarities of the data lines.
29. The method of claim 26, wherein the similarities of a plurality of the data lines of the target field are determined by comparing each data line of the target field with each corresponding data line of a successive field.
30. The method of claim 29, wherein the target field and the successive field are respectively an add field and an even field, which are successive to each other in time domain.
31. The method of claim 29, wherein the target field and the successive field are two fields, which have one field between them.
32. The method of claim 31, wherein the target field and the successive field are two odd fields or two even fields.
Type: Application
Filed: Apr 8, 2005
Publication Date: Oct 13, 2005
Inventor: Scott Jen (Hsin-Chu City)
Application Number: 10/907,619