Image transmission system, image transmission apparatus and image transmission method
The image transmission system of the present invention is provided with: a time-division display apparatus sequentially displaying first to N-th (N: an integer of 2 or more) images with a frequency above M×N [Hz] (M: an integer of 1 or more) by time division; a multiplexing unit plane-sequentially multiplexing the first to N-th images in accordance with the order of displaying the first to N-th images on the time-division display apparatus; a transmitting unit sending out the multiplexed images which have been multiplexed by the multiplexing unit to a predetermined image transmission path with a frame frequency of M [Hz]; and a receiving unit receiving the multiplexed images from the transmitting unit via the predetermined image transmission path and sequentially transmitting image data of the multiplexed images to the time-division display apparatus.
Latest NEC CORPORATION Patents:
- ANTENNA APPARATUS, PROCESSING METHOD, AND RECORDING MEDIUM
- RADIO TERMINAL, RADIO ACCESS NETWORK NODE, AND METHODS THEREFOR
- METHODS, DEVICES, AND MEDIUM FOR COMMUNICATION
- INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING METHOD, AND STORAGE MEDIUM
- INFORMATION PROCESSING APPARATUS, CONTROL METHOD, AND PROGRAM
The present invention relates to an image transmission system, an image transmission apparatus and an image transmission method, and in particular to an image transmission system which transmits multiple images to a time-division display apparatus which displays multiple images by a time-division system, using an image transmission path (image interface) of an existing image transmission standard such as the DVI (Digital Visual Interface), an image transmission apparatus and an image transmission method.
BACKGROUND ARTWith the development of recent display techniques, there have been proposed and developed display apparatuses having a function other than a function of displaying a two-dimensional (plane) images. For example, a three-dimensional display which makes it possible to view not a two-dimensional image but a three-dimensional image can be said to be a typical example of such display apparatuses. As one of display apparatuses proposed as the three-dimensional display, there is a time-division three-dimensional display described in Patent Literatures 1 to 3. The principle of the time-division three-dimensional display will be described with reference to
Referring to
Another example of the display apparatuses having a function other than the function of displaying a two-dimensional image will be described. Content to be displayed on a display apparatus includes such content that should not be viewed by others, such as secret information and private data. These days when ubiquitous accompanying the development of information equipment is developing, it is an important to prevent display contents from being viewed by others, even among the public that includes an unspecified large number of people. As a related art to solve this problem, there is described an image display apparatus capable of preventing a display image from being stealthily viewed by others in Patent Literature 4.
Referring to
Image information accumulation memory 202 stores inputted image signal 201 in frames on the basis of frame signal 203. The image signal stored in image information accumulation memory 202 is read twice at a rate twice as fast as the frame cycle. The image signal read first is provided for synthesis circuit 205 as first image signal 204 compressed to one half. The image signal that is read the second time is provided for synthesis circuit 205 as second image signal 207 after having undergone saturation and brightness conversion processing by brightness/saturation conversion circuit 206. Output of synthesis circuit 205 is provided for image display device 208 as a display signal. Accordingly, an image based on first image signal 204 and an image based on second image signal 207 are alternately displayed on image display device 208.
Glasses-shutter timing generation circuit 209 generates glasses-shutter driving signal 210 for driving the shutter of glasses 211 on the basis of frame signal 203. Glasses-shutter driving signal 210 is a timing signal to cause the shutter of glasses 211 to be turned on (light blocking state) during a period while an image based on second image signal 207 is displayed. By the shutter of glasses 211 being driven by this glasses-shutter driving signal 210, only the image based on first image signal 204 (secret image) are presented to a person who wears glasses 211 can view.
A person who does not wear glasses 211 sees a gray image in which the image based on first image signal 204 and the image based on second image signal 207 are merged, due to the temporal integration effect of eyesight (persistence of vision). This gray image is an image quite different from the image based on first image signal 204 (secret image). Thus, the person who does not wear glasses 211 cannot identify the image based on first image signal 204 (secret image).
In the example shown in
In order to prevent flicker, it is required, in the example shown in
Thus, in order to realize a display apparatus utilizing the time integration effect of eyesight, it is required to display a unit image (subframe) constituting a frame, such as the secret image and the right-eye image, with a high-speed frame frequency of 120 Hz or more. To achieve this, it is desirable to, when transmitting these images to a display apparatus from an image transmission source (a PC (Personal Computer) or the like), transmit them with the same frame frequency as the high-speed frame frequency, such as 120 Hz and 180 Hz.
However, in image transmission standards which are currently widely prevalent, such as the DVI, the limit of the frame frequency capable of transmitting an image is practically 60 Hz. Therefore, it is not possible to transmit an image with a frame frequency more than 60 Hz. As measures for transmitting an image with a frame frequency more than 60 Hz, measures of devising a new image transmission system compatible with the high-speed frame frequency as described above and measures of parallelizing existing image transmission paths are conceivable.
However, the former measures have a problem that the versatility is low because of the specialization in high-speed transmission, in addition to the problem of the enormous cost of new development of compatible chips (for a transceiver and a receiver) and cables. The latter measures have a problem in which the wiring of cables is complicated. Therefore, neither measure can be said to be a realistic solution. Thus, it is desirable to transmit an image using only one image transmission path of an existing image transmission standard.
As an example of related art to realize this, the technique described in Patent Literature 5 can be given (
Patent Literature 1: JP05-78017B
Patent Literature 2: JP61-227498A
Patent Literature 3: JP61-87130A
Patent Literature 4: JP63-312788A
Patent Literature 5: JP2006-195018A
SUMMARY OF INVENTION Technical ProblemHowever, in the time-division display apparatus which displays multiple images by a time-division system, as shown in
Therefore, in the case of applying the technique described in Patent Literature 5 to transmit multiple images to a time-division display apparatus, there is a problem, on the time-division display apparatus side, that a frame memory for converting the speed is required, which leads to an increase in the cost.
Thus, the problem to be solved by the present invention is to realize a time-division display at a low cost by, when transmitting multiple images to be displayed on a time-division display apparatus using one image transmission path of an existing image transmission standard and displaying a certain subframe on the time-division display apparatus, absorbing the difference between the frame frequency of the existing image transmission standard and the frame frequency at the time of displaying the subframe on the time-division display apparatus and thereby eliminating the necessity of a frame memory required for speed conversion.
Thus, the object of the present invention is to provide an image transmission system, an image transmission apparatus and an image transmission method to solve the above problem.
Solution to ProblemA first image transmission system of the present invention is provided with:
a time-division display apparatus that sequentially displays first to N-th (N: an integer of 2 or more) images with a frequency above M×N [Hz] (M: an integer of 1 or more) by time division;
a multiplexing unit that plane-sequentially multiplexes the first to N-th images in accordance with the order of displaying the first to N-th images on the time-division display apparatus;
a transmitting unit that sends out the multiplexed images which have been multiplexed by the multiplexing unit to a predetermined image transmission path with a frame frequency of M [Hz]; and
a receiving unit that receives the multiplexed images from the transmitting unit via the predetermined image transmission path and sequentially transmits image data of the multiplexed images to the time-division display apparatus.
A second image transmission system of the present invention is provided with:
a time-division display apparatus that sequentially displays first to N-th (N: an integer of 2 or more) images with a frequency above M×N [Hz] (M: an integer of 1 or more) by time division;
a multiplexing unit that multiplexes the first to N-th images and the N-th image of a frame immediately before the frame which includes the first to N-th images as subframes;
a transmitting unit that sends out the multiplexed images which have been multiplexed by the multiplexing unit to a predetermined image transmission path with a frame frequency of M [Hz];
a receiving unit that receives the multiplexed images from the transmitting unit via the predetermined image transmission path; and
an overdrive operation unit that inputs an image to be displayed on the time-division display apparatus at a predetermined hour, performs overdrive operation by referring to an image displayed on the time-division display apparatus at an hour one subframe earlier than the predetermined time, and sequentially transmits image data obtained by the overdrive operation to the time-division display apparatus.
A first image transmission apparatus of the present invention is:
an image transmission apparatus transmitting first to N-th (N: an integer of 2 or more) images to a time-division display apparatus which sequentially displays the first to N-th images, with a frequency of M×N [Hz] (M: an integer of 1 or more) by time division, the image transmission apparatus comprising:
a multiplexing unit that plane-sequentially multiplexes the first to N-th images in accordance with the order of displaying the first to N-th images on the time-division display apparatus; and
a transmitting unit that transmits the multiplexed images which have been multiplexed by the multiplexing unit to the time-division display apparatus via a predetermined image transmission path with a frame frequency of M [Hz].
A second image transmission apparatus of the present invention is:
an image transmission apparatus transmitting first to N-th (N: an integer of 2 or more) images to a time-division display apparatus which sequentially displays the first to N-th images, with a frequency of M×N [Hz] (M: an integer of 1 or more) by time division, the image transmission apparatus comprising:
a multiplexing unit that multiplexes the first to N-th images and the N-th image of a frame immediately before the frame which includes the first to N-th images as subframes; and
a transmitting unit that transmits the multiplexed images which have been multiplexed by the multiplexing unit to the time-division display apparatus via a predetermined image transmission path with a frame frequency of M [Hz].
A first image transmission method of the present invention is:
a method by an image transmission apparatus transmitting first to N-th (N: an integer of 2 or more) images to a time-division display apparatus which sequentially displays the first to N-th images, with a frequency of M×N [Hz] (M: an integer of 1 or more) by time division, the method comprising:
a multiplexing step of plane-sequentially multiplexing the first to N-th images in accordance with the order of displaying the first to N-th images on the time-division display apparatus; and
a transmission step of transmitting the multiplexed images which have been multiplexed by the multiplexing unit to the time-division display apparatus via a predetermined image transmission path with a frame frequency of M [Hz].
A second image transmission method of the present invention is:
A method by an image transmission apparatus transmitting first to N-th (N: an integer of 2 or more) images to a time-division display apparatus which sequentially displays the first to N-th images, with a frequency of M×N [Hz] (M: an integer of 1 or more) by time division, the method comprising:
a multiplexing step of multiplexing the first to N-th images and the N-th image of a frame immediately before the frame which includes the first to N-th images as subframes; and
a transmission step of transmitting the multiplexed images which have been multiplexed by the multiplexing unit to the time-division display apparatus via a predetermined image transmission path with a frame frequency of M [Hz].
Advantageous Effects of InventionIn the first image transmission system of the present invention, for a time-division display apparatus which sequentially displays first to N-the images with a frequency of M×N [Hz] or more by time division, the first to N-th images are plane-sequentially multiplexed in accordance with the order in which they are displayed on the time-division display apparatus, and the multiplexed image is transmitted with the frame frequency of M [Hz] via a predetermined image transmission path.
In the second image transmission system of the present invention, first to N-th images and the N-th image of an immediately previous frame are multiplexed; the multiplexed image is transmitted with the frame frequency of M [Hz] via a predetermined image transmission path; overdrive operation is performed for this image on the basis of a reference image displayed in an immediately previous subframe; and the operated image data is transferred to a time-division display apparatus similar to the above.
Thus, according to the first and second image transmission systems of the present invention, the time-division display apparatus does not require a frame memory for absorbing the difference between the frame frequency at the time of displaying an image and the frame frequency at the time of transmitting the image, which is specified in an existing image transmission standard. Furthermore, since it is possible to transmit an image using an image transmission path of an existing image transmission standard, an existing transmission apparatus, receiving apparatus, and transmission media such as cables can be used as they are. Thus, an advantage can be obtained in which time-division display can be realized at a low cost.
Furthermore, according to the second image transmission system of the present invention, since it is possible to compensate for the response delay of liquid crystal in the case where a time-division display apparatus is configured by a liquid crystal panel by performing overdrive operation, an advantage can be obtained in which more accurate and higher-image-quality gradation display is enabled.
Exemplary embodiments for practicing the present invention will be described below with the use of drawings.
In the present invention, multiple images are transmitted from an image transmission source to a time-division display apparatus with the use of one image transmission path in accordance with an existing image transmission standard, and the multiple images are displayed by time division on the time-division display apparatus.
Here, as for the kind of the images to be transmitted, images of multiple systems or moving images with a frequency equal to or above the frame frequency specified in an existing image transmission standard (hereinafter referred to as “a high-speed moving image”) are possible.
The images of multiple systems may be images related to one another, such as those for a three-dimensional image, or images unrelated to one another, such as those for multiple TV channels.
The existing image transmission standard may be, for example, the DVI, the HDMI (High-Definition Multimedia Interface) or the DisplayPort or may be the Analog RGB (VGA (Video Graphics Array)). In these image transmission standards, the frame frequency capable of transmitting an image is basically 60 Hz. The HDMI and the DisplayPort, however, are compatible with the frame frequency up to 120 Hz according to the standards as of Jun. 19, 2008.
In the description below and the drawings, it is assumed that multiple images to be transmitted/displayed are images of three systems including first to three images, as shown in
It is also assumed that the DVI is used as the existing image transmission standard, and that the frame frequency at the time of transmitting an image is 60 FPS (frame/second). However, it goes without saying that the present invention is not limited to the DVI, and other existing image transmission standards are also applicable.
As for the order of transmitting image data of the pixels of one image in the DVI, it is assumed that the image data are dot-sequentially transmitted from the upper left to the lower right of the image as shown in
It is also assumed that the time-division display apparatus displays the first to third image of the same frame at 60 FPS, as shown in
The image transmission system in this exemplary embodiment includes image transmission apparatus 1, image processing apparatus 2 and time-division display apparatus 3.
Image transmission apparatus 1 includes multiplexing unit 11 which multiplexes images of three systems (a first image, a second image and a third image) into one large image, and image transmitting unit (transceiver: Tx) 12 which transmits the image data of the multiplexed image to image processing apparatus 2 as a DVI-format signal. It is assumed that the multiplexing method by multiplexing unit 11 is plane-sequential.
Image processing apparatus 2 includes at least image receiving unit (receiver: Rx) 21 which receives the image data of an image from image transmission apparatus 1.
Timing Chart First ExampleImage data received by image receiving unit 21 is immediately transferred to time-division display apparatus 3, and time-division display apparatus 3 plane-sequentially displays the first image, the second image and the third image.
<Multiplexing Method: Plane-Sequential>
The multiplexing method in this exemplary embodiment will be described.
In this exemplary embodiment, multiplexing unit 11 of image transmission apparatus 1 spatially multiplexes the first to third images into one large image (multiplexed image: 800 pixels×1800 lines).
Multiplexing unit 11 may be configured by hardware such as an LSI (Large Scale Integration) and an FPGA (Field Programmable Gate Array) or may be realized by software.
As shown in
As shown in
For example, in the case where the first to third images are displayed in the order of the first image→second image→third image→ . . . and are dot-sequentially or line-sequentially scanned and displayed from the top of each of the images downward in time-division display apparatus 3, the multiplexed image is an image in which the first image, second and third images are arranged in that order from the top as shown in
Thereby, the image data of the first to third images are transmitted in accordance with the display order/scanning order of time-division display apparatus 3.
As described above, it is important to, when plane-sequentially multiplexing the first to third images, arrange/transmit the first to third images in accordance with the display order/scanning order of time-division display apparatus 3. It is sufficient if the display order/scanning order of time-division display apparatus 3 and the transmission order of the DVI are the same. Therefore, it is also possible to multiplex the images not in an image of 800 pixels×1800 lines as shown in
<Example of Time-Division Display Apparatus>
The liquid crystal panel part of time-division display apparatus 3 includes at least multiple scanning lines 31 and multiple signal lines 32 intersecting with one another, scanning line driver 33 for controlling a signal to be inputted to multiple scanning lines 31, signal line driver 34 for controlling a signal to be inputted to multiple signal lines 32, multiple liquid crystal pixels 35 and multiple accumulation capacities 36 which are provided at positions of intersections by scanning lines 31 and multiple signal lines 32 in a matrix shape, liquid crystal pixel 35 and accumulation capacity 36 being parallel connected with each other, and multiple thin film transistors (TFTs) 37 provided to correspond to multiple liquid crystal pixels 35 and multiple accumulation capacities 36. It is assumed that one pixel is constituted by one liquid crystal pixel 35, one accumulation capacity 36 and one TFT 37. An area where an image constituted by liquid crystal pixels 35 is actually displayed is referred to as effective display area 38. In addition to the liquid crystal panel described above, time-division display apparatus 3 is also provided with a backlight (not shown) for illuminating the liquid crystal panel. An optical shutter is used to view an image displayed on time-division display apparatus 3.
On/off of TFT 37 having a switching function is controlled by a scanning signal of scanning line driver 33. When TFTs 37 are turned on, a gradation voltage corresponding to image data is applied to accumulation capacities 36 and liquid crystal pixels 35 by signal line driver 34. This voltage is maintained by accumulation capacities 36 for a predetermined period. The transmittance of liquid crystal pixels 35 is changed by the application of this voltage, and light from the backlight not shown is transmitted through liquid crystal pixels 35. Thereby, an image is displayed. As for the order of scanning line driver 33 selecting one line, it is assumed that line-by-line selection from the top of the screen downward is made. However, selection may be made from the bottom upward or every-other-line selection may be made. At this time, image data can be provided for signal line driver 34 in the order selected by scanning line driver 33.
Time-division display apparatus 3 displays each of the transmitted first to third images once during a one-frame period ( 1/60≈16.7 msec). That is, each subframe is displayed during a period corresponding to one-third of one frame, that is, for 5.6 msec.
In the example in
Thus, the first to third images are displayed by time division.
In the example in
To cope with this, so-called backlight blinking driving is performed in the example in
Furthermore, the example in
However, in the backlight blinking driving shown in
Differences between the configurations in
On/off of TFT 37A is controlled by a scanning signal of scanning line driver 33. When TFT 37A is turned on, gradation voltage corresponding to the image data is accumulated in accumulation capacity 36A by signal line driver 34 first. When scanning (writing) of the whole screen ends, voltage is applied to liquid crystal pixels 35 by TFTs 37B of all the pixels being turned on together to write image data, by writing control circuit 33B, and the whole screen is refreshed with the new image data. After that, TFTs 37B of all the pixels are immediately turned off together by writing control circuit 33B, and the next image data is scanned (written) by scanning line driver 33 and signal line driver 34. During this scanning period, an image before the image of the image data being scanned is always displayed on time-division display apparatus 3. In the example in
In the example in
In the example in
<Dummy-Included Multiplexing Method>
In this exemplary embodiment shown in
As an example,
As shown in
The dummy image parts are discarded from the image data received by image receiving unit 21, and only the image data of the images other than the dummy images are immediately transferred to time-division display apparatus 3. Time-division display apparatus 3 plane-sequentially displays the first image, the second image and the third image. Here, since the dummy images are inserted in the multiplexed image as shown in
In response to the received image data, time-division display apparatus 3 performs scanning in a period corresponding to half of one subframe (that is, performs scanning at double the speed of scanning an image corresponding to one subframe during a one-subframe period), and turns on the backlight after waiting for responses from liquid crystal elements 35. Thereby, backlight blinking driving is enabled with just the configuration in
As described above, in this exemplary embodiment, by transmitting multiple images after plane-sequentially multiplexing them in accordance with the order of displaying the images on time-division display apparatus 3, a frame memory for absorbing the difference between the frame frequency at the time of displaying an image and the frame frequency at the time of transmitting an image, which is specified in an existing image transmission standard, is not required on the time-division display apparatus 3 side, and therefore, it is possible to realize time-division display at a low cost.
Second Exemplary Embodiment Image Transmission System: Second ConfigurationUnlike the first exemplary embodiment, image transmission apparatus 1 multiplexes the third image of a previous frame in addition to the first to third images, into one large image by multiplexing unit 11 and transmits the multiplexed image to image processing apparatus 2 as a DVI-format signal by image transmitting unit 12.
The multiplexing method by multiplexing unit 11 is assumed to be such that a total of three images each of which has been obtained by dot-sequentially multiplexing two temporally adjacent images (a multiplexed image of the third image of a previous frame and the first image of a current frame, a multiplexed image of the first image of the current frame and the second image of the current frame, and a multiplexed image of the second image of the current frame and the third image of the current frame) are further plane-sequentially multiplexed. This multiplexing method will be hereinafter referred to as “four-plane-two-adjacent-dot sequential”.
Image processing apparatus 2 includes image receiving unit 21 and overdrive (OD) operation unit 25. Image processing apparatus 2 may comprise inter-image operation unit 24 which performs mutual operation between two temporally adjacent images from among received four-plane-two-adjacent-dot sequential images.
<Description of Overdrive>
Here, overdrive will be described.
Recently, a flat-type liquid crystal display and a liquid crystal TV prevail, replacing a CRT-system display and TV. However, in liquid crystal, the response of transmittance characteristics to change in voltage is generally slow. Therefore, there is a problem in which various kinds of image quality deterioration are caused, such as generation of movement blur in the case of displaying a moving image with active movement. In particular, when a liquid crystal display system is used for a display apparatus which performs high-speed switching display like time-division display apparatus 3 of the present invention, the frame frequency at the time of displaying an image is higher than a common display apparatus (which does not perform time division), and consequently, the image quality deterioration due to the response delay of liquid crystal is more remarkable.
Overdrive is one of techniques for improving the image quality deterioration due to the response delay of liquid crystal. By comparing one received image (assumed to be a current frame) and an image displayed on a display apparatus temporally one frame before (assumed to be a previous frame), the pixel values (gradation values) of the final image data at the time of displaying the current frame are determined.
More specifically, in overdrive, if the image value of the next frame is larger in comparison with the image value of the current frame, an image value much larger than the image value of the next frame is outputted as the final pixel value of the next frame. On the contrary, if the image value of the next frame is smaller in comparison with the image value of the current frame, an image value much smaller than the image value of the next frame is outputted as the final pixel value of the next frame. For example, if the current frame has 100 gradations, and the next frame has 150 gradations, the final pixel value of the next frame is outputted in 180 gradations. If the pixel value is outputted in 100 gradations→150 gradations just as the original image, the brightness corresponding to 150 gradations cannot be achieved for the next frame because of the response delay of liquid crystal. However, by setting 180 gradations for the next frame, the response of the crystal liquid is quickened, and brightness corresponding to 150 gradations can be obtained.
It is an advantage of overdrive that, not by increasing the response speed of the liquid crystal itself but by adaptively changing the gradations to be displayed according to the gradation difference between frames as described above, the response delay of liquid crystal can be compensated for, and the desired brightness can be substantially obtained.
An overdrive method by OD operation unit 25 of the present invention will be described.
OD operation unit 25 includes overdrive calculation circuit 251 and overdrive LUT (Look Up Table) 252.
To OD operation unit 25, there are inputted the operation-target image data of an operation-target image (for example, a current 1 image), and the reference image data of a reference image (for example, a previous 3 image) which is displayed temporally one subframe before in time-division display apparatus 3.
On the basis of the pixel values (image data) of the inputted operation-target image and the pixel values (image data) of the reference image, overdrive calculation circuit 251 refers to overdrive LUT 252, determines the pixel values of image data after overdrive calculation, and outputs them as overdrive image data. Overdrive LUT 252 is stored in an external ROM or RAM or the like.
In overdrive LUT 252, the pixel values after completion of the overdrive calculation on the basis of the operation-target image data and the reference image data are arranged in a matrix. For example, if the operation-target image data is 1 and the reference image data is 3, then 10 is outputted as overdrive image data.
Data to be stored in overdrive LUT 252 is such a value (pixel value) that, no matter what value the reference image data indicates for operation-target image data of one certain gradation (for example, 0 gradation), the brightness is constant when the operation-target image is displayed on time-division display apparatus 3.
By using such overdrive LUT 252, it is possible to show a display with the same brightness no matter what image the temporally previous subframe shows, and therefore, it is possible to compensate for the response delay of liquid crystal and perform a high-image-quality time division display.
Overdrive LUT 252 does not have to be the 256×256 matrix as shown in
<Multiplexing Method: Four-Plane-Two-Adjacent-Dot Sequential>
The four-plane-two-adjacent-dot sequential multiplexing method by multiplexing unit 11 will be described.
Multiplexing unit 11 multiplexes the first to third images as shown in
That is,
a first sub-image in which the pixels of previous 3 and current 1 at the same positions are dot-sequentially arranged;
a second sub-image in which the pixels of current 1 and current 2 at the same positions are dot-sequentially arranged; and
a third sub-image in which the pixels of current 2 and current 3 at the same positions are dot-sequentially arranged
are plane-sequentially multiplexed.
In
However, it is necessary that plane-sequential multiplexing of the first sub-image, the second sub-image and the third sub-image should be in accordance with the display order of time-division display apparatus 3. The reason is: at OD operation unit 25, the overdrive image of current 1 by the first sub-image, the overdrive image of current 2 by the second sub-image, and the overdrive image of current 3 by the third sub-image are temporally sequentially outputted, and the order corresponds to the display order of time-division display apparatus 3. Therefore, if the order of plane-sequential multiplexing of the sub-images is changed, the display order on time-division display apparatus 3 will be an undesirable order.
Similarly to the case of the plane-sequential multiplexing, the size of a multiplexed image can be changed within a range in which the transmission order is not changed.
Timing Chart First ExampleImage data received by image receiving unit 21 is divided into two images by a controller or the like not shown. At this time, since two temporally adjacent images are dot-sequentially multiplexed in each sub-image, the data of the same pixels of the temporally adjacent two images are received almost at the same time. However, strictly, these pixel data are not received quite at the same time, and therefore memory for causing a delay corresponding to one pixel is required even in the case of dot-sequential multiplexing. Since this delay circuit can be configured by a D flip-flop corresponding to one pixel and is small enough to be ignored in comparison with large-scale memory such as a frame memory, it can be said that memory is essentially not required. This memory is therefore omitted in this exemplary embodiment. The operation of OD operation unit 25 is as described before.
That is,
in the first sub-image, an overdrive image of current 1 (current 1OD) is outputted with current 1 as an operation-target image and previous 3 as a reference image;
in the second sub-image, an overdrive image of current 2 (current 2OD) is outputted with current 2 as an operation-target image and current 1 as a reference image; and
in the third sub-image, an overdrive image of current 3 (current 3OD) is outputted with current 3 as an operation-target image and current 2 as a reference image.
Current 1OD, current 2OD and current 3OD are sequentially transferred to time-division display apparatus 3 immediately, and time-division display apparatus 3 plane-sequentially displays the first image, the second image and the third image.
<Multiplexing Method: Four-Plane-Two-Adjacent-Dot Sequential Including Dummy>
As described in the first exemplary embodiment, dummy images may be inserted in the multiplexed image in
As shown in
As for image data received by image receiving unit 21, dummy image parts are discarded, and only the image data of images other than the dummy images are inputted to OD operation unit 25.
Current 1OD, current 2OD and current 3OD operated by OD operation unit 25 are immediately transferred to time-division display apparatus 3, and time-division display apparatus 3 plane-sequentially displays the first image, the second image and the third image. Here, since the dummy images are inserted in the multiplexed image as shown in
In response to the received image data, time-division display apparatus 3 performs scanning in a period corresponding to the half of one subframe, and turns on the backlight after waiting for responses from liquid crystal pixels 35. Thereby, backlight blinking driving is enabled with the same configuration in
As described above, in this exemplary embodiment, since the response delay of liquid crystal can be compensated for by performing overdrive driving, more accurate and higher-image-quality gradation display is possible in comparison with the first exemplary embodiment. Especially in the case of displaying a moving image, it is possible to display a clear moving image with little blur.
Exemplary EmbodimentAn exemplary embodiment in the present invention will be described.
As for the kind of transmission-target image in the present invention, images of multiple systems or high-speed moving images are possible.
The images of multiple systems may be images related to one another, such as those for a three-dimensional image, or images unrelated to one another, such as those for multiple TV channels.
<Transmission of Four Images of Four Systems which are Unrelated to one Another>
Examples of the images unrelated to one another include the images of three systems as shown in
Time-division display apparatus 3 displays the first to fourth images in one frame by switching them at a high speed in the order of the first image→second image→third image→fourth image. That is, since the first to fourth images are displayed during a one-frame period (16.7 msec), a one-subframe period is 1/60/4≈4.2 msec. Four kinds of optical shutters having different transmission periods are used to separately view the first to fourth images.
That is,
an optical shutter for ch1 gets into a light transmission state in synchronization with the frame of the first image that is being displayed and is in a light blocking state during other periods.
An optical shutter for ch2 gets into a light transmission state in synchronization of the frame of the second image that is being displayed and is in a light blocking state during other periods.
An optical shutter for ch3 gets into a light transmission state in synchronization of the frame of the third image that is being displayed and is in a light blocking state during other periods.
An optical shutter for ch4 gets into a light transmission state in synchronization of the frame of the fourth image that is being displayed and is in a light blocking state during other periods.
Alternatively, it is also possible for the optical shutter side or the time-division display apparatus 3 side to switch the channel to be viewed. An image constituted by the first to fourth moving images overlapped with one another is viewed without the optical shutters. Due to this, multiple persons can share one display and view different images.
In this case, backlight blinking driving is performed to separate the first to fourth images by the optical shutters. As shown in
An exemplary embodiment in the case of transmitting the first to fourth images according to the present invention will be described.
As shown in
In the first exemplary embodiment, image data received by image receiving unit 21 of image processing apparatus 2 is immediately transmitted to time-division display apparatus 3.
In comparison, in the second exemplary embodiment, overdrive is operated for image data received by image receiving unit 21 of image processing apparatus 2 by the means of OD operation unit 25 with a subframe displayed on time-division display apparatus 3 temporally one subframe before as a reference image. That is, the second image is overdriven from the first image; the third image is overdriven from the second image; the fourth image is overdriven from the third image; and the first image is overdriven from the fourth image of the previous frame. By performing overdrive, high-image-quality display without cross talk is realized even in the case of temporally separating images by an optical shutter as in
<Transmission of Right-Eye Image and Left-Eye Image Related to Each Other>
As an example of the images related to one another, a three-dimensional image constituted by a right-eye image and a left-eye image as shown in
It is assumed that time-division display apparatus 3 displays a left-eye image and a right-eye image in that order in one frame, and it displays the left-eye image and the right-eye image by switching them at a high speed. That is, since the left-eye image and the right-eye image are displayed during a one-frame period (16.7 msec), a one-subframe period is 1/60/2=8.3 msec.
As for the optical shutter,
the right-eye shutter gets into a light transmission state and the left-eye shutter gets into a light blocking state, in synchronization with a right-eye image being displayed, and
the left-eye shutter gets into a light transmission state and the right-eye shutter gets into a light blocking state, in synchronization with a left-eye image being displayed.
Thereby, different images temporally enter the right and left eyes to realize three-dimensional display. In this exemplary embodiment also, an optical shutter is used. Therefore, if time-division display apparatus 3 is configured with the use of a liquid crystal panel, it is desirable to perform backlight blinking driving for reduction of cross talk when the optical shutter is mounted.
An exemplary embodiment of transmitting the left-eye image and right-eye image according to the present invention will be described.
As shown in
In the second exemplary embodiment, overdrive is operated for image data received by image receiving unit 21 of image processing apparatus 2 by means of OD operation unit 25 with a subframe displayed on time-division display apparatus 3 temporally one subframe before as a reference image. That is, the right-eye image is overdriven from the left-eye image, and the left-eye image is overdriven from the right-eye image of the previous frame.
According to the above, favorable time-division three-dimensional display is realized which is low-cost because of unnecessity of a memory on the time-division display apparatus 3 side. Alternatively, a high-image-quality time-division three-dimensional display is realized by overdrive.
<Transmission of Secret Image, Reverse Image and Public Image Related to One Another>
As another example of the images related to one another, there are a secret image which can be viewed only by a person who wears an optical shutter, a reverse image to negate the secret image to make it appear to be an image quite unrelated to the secret image, and a public image to be viewed by a person who does not wear the optical shutter.
As shown in
An exemplary embodiment in the case of transmitting the secret image, the reverse image and the public image according to the present invention will be described.
As shown in
In the second exemplary embodiment, overdrive is operated for image data received by image receiving unit 21 of image processing apparatus 2 by means of OD operation unit 25 with a subframe displayed on time-division display apparatus 3 temporally one subframe before as a reference image. That is, the reverse image is overdriven from the secret image, the public image is overdriven from the reverse image, and the secret image is overdriven from the public image of the previous frame.
In the second exemplary embodiment, it is possible to perform various inter-image operations by using inter-image operation unit 24 of image processing apparatus 2, in addition to overdrive. In this exemplary embodiment, for example, it is possible to enhance the contrast of the public image by decreasing the brightness of the secret image and the reverse image to one half and by mixing the public image with the reverse image. It is also possible to make it difficult to view the secret image by performing a predetermined operation on the public image according to the brightness value of the reverse image correlated with the secret image.
According to the above, in the secret, reverse and public images also, favorable time-division display is realized which is low-cost because of unnecessity of a memory on the time-division display apparatus 3 side. Especially, in this exemplary embodiment, it is desirable to accurately display gradations in order to prevent the secret image from being recognized by a person who does not use the optical shutter. Furthermore, according to the second exemplary embodiment, it is possible to compensate for the response delay of liquid crystal pixels 35 and to accurately display desired gradations by performing overdrive operation with a subframe displayed temporally one subframe before as a reference image in time-division display apparatus 3. From this, there is also obtained an advantage in which the secrecy of a secret image can be improved, in this exemplary embodiment.
In the exemplary embodiments described above, a transmission-target image itself may be a still image or may be a moving image. In the case of a still image, the same sixty images (without movement) are transmitted per second. In the case of a moving image, images with different patterns (with movement) are transmitted. Since the transmission speed is 60 FPS, the original image of the moving image is not required to be of 60 FPS, and 30 FPS or 15 FPS is also possible. If the transmission speed is 30 FPS or 15 FPS, the same image is transmitted by the adjacent two or four frames. In images of multiple systems, moving images and still images may be mixed.
<Transmission of High-Speed Moving Images of One System>
Furthermore, in the present invention, a transmission target image may be a high-speed moving image of one system as shown in
An exemplary embodiment in the case of transmitting a high-speed moving image of one system according to the present invention will be described.
Since the frame frequency of a high-speed moving image exceeds 60 Hz (in this example, 180 Hz) as shown in
As described above, favorable high-speed moving image display becomes possible which does not require a memory on the image receiving side. Alternatively, it is possible to realize clear high-speed moving image display without blur due to overdrive.
In the exemplary embodiments described above, the DVI has been described. However, it goes without saying that, in the case of using an image transmission path compatible with the frame frequency up to 120 Hz in the standard, such as an HDMI path and a DisplayPort path, the approach of the present invention is also applicable. A 120 Hz interface makes it possible to transmit a moving image with 240 Hz, a moving image with 360 Hz or more, and the like.
The present invention has been described on the basis of the above exemplary embodiments. The present invention is not limited to the above exemplary embodiments, and it, of course, includes various variations and modifications which can be made by one skilled in the art within the scope of the invention of each claim in the claims.
This application claims (the benefit of) priority based on Japanese Patent Application No. 2008-309638 filed on Dec. 4, 2008, the disclosure of which is hereby incorporated by reference thereto in its entirety.
Claims
1. An image transmission system comprising:
- a time-division display apparatus that sequentially displays first to N-th (N: an integer of 2 or more) images with a frequency above M×N [Hz] (M: an integer of 1 or more) by time division;
- a multiplexing unit that plane-sequentially multiplexes the first to N-th images in accordance with order of displaying the first to N-th images on the time-division display apparatus;
- a transmitting unit that sends out the multiplexed images which have been multiplexed by the multiplexing unit to a predetermined image transmission path with a frame frequency of M [Hz]; and
- a receiving unit that receives the multiplexed images from the transmitting unit via the predetermined image transmission path and sequentially transmits image data of the multiplexed images to the time-division display apparatus, wherein:
- each of the first to N-th images is a subframe included in one frame;
- the time-division display apparatus scans and displays each of the first to N-th images with a speed K times (K: a real number satisfying 1<K) as fast as the speed of displaying and scanning an image corresponding to one subframe during a one-subframe period; and
- the multiplexing unit:
- plane-sequentially multiplexes dummy images with the number of pixels K−1 times as large as that of the first to N-th images, to the first to N-th images, respectively, and
- plane-sequentially multiplexes the first to N-th images to which the dummy images have been multiplexed.
2. The image transmission system according to claim 1, wherein
- each of the first to N-th images is a subframe included in one frame; and
- the time-division display apparatus scans and displays each of the first to N-th images with a speed equal to the speed of displaying and scanning an image corresponding to one subframe during a one-subframe period.
3. The image transmission system according to claim 1, wherein
- the time-division display apparatus comprises a liquid crystal panel that includes;
- multiple scanning lines and multiple signal lines that intersect with one another,
- a scanning line driver that controls a signal inputted to the multiple scanning lines,
- a signal line driver that controls a signal inputted to the multiple signal lines,
- multiple liquid crystal pixels and multiple accumulation capacities that are provided at positions of intersections by the multiple scanning lines and the multiple signal lines in a matrix shape, and
- multiple thin film transistors that are provided corresponding to the multiple liquid crystal pixels and the multiple accumulation capacities, in a manner in which either a drain or a source is connected to the signal line and the other drain or source is connected to the corresponding accumulation capacity and the liquid crystal pixel, and a gate is connected to the scanning line; wherein,
- the scanning line driver controls on/off of the thin film transistors by a scanning signal inputted to the scanning lines; and
- when the thin film transistors are turned on, the signal line driver applies gradation voltage corresponding to image data of the inputted first to N-th images, to the accumulation capacities and the crystal liquid pixels.
4. The image transmission system according to claim 3, wherein
- the time-division display apparatus further comprises a backlight that illuminates the liquid crystal panel,
- turns out the backlight for a Ts1 period shorter than a one-subframe period Ts and applies gradation voltage corresponding to the image data of the first to N-th image data, to the accumulation capacities and the liquid crystal pixels, and
- turns on the backlight for a period equal to or shorter than the period from Ts to Ts1 within a period other than the Ts1.
5. The image transmission system according to claim 1, wherein
- the time-division display apparatus comprises a liquid crystal panel that include;
- writing control signal lines,
- multiple scanning lines and multiple signal lines that intersect with one another,
- a writing control circuit that controls a signal inputted to the writing control signal lines,
- a scanning line driver that controls a signal inputted to the multiple scanning lines,
- a signal line driver that controls the signal inputted to the multiple scanning lines,
- multiple liquid crystal pixels, multiple first accumulation capacities and multiple second accumulation capacities that are provided at positions of intersections by the multiple scanning lines and the multiple signal lines in a matrix shape,
- multiple first thin film transistors that are provided corresponding to the multiple liquid crystal pixels, the multiple first accumulation capacities and the multiple second accumulation capacities in a manner in which either a drain or a source is connected to the signal line and the other drain or source is connected to the corresponding first accumulation capacity, and a gate is connected to the scanning line, and
- multiple second thin film transistors that are provided corresponding to the multiple liquid crystal pixels, the multiple first accumulation capacities and the multiple second accumulation capacities in a manner in which either a drain or a source is connected to the corresponding first accumulation capacity and the other drain or source is connected to the corresponding second accumulation capacity and the liquid crystal pixel, and a gate is connected to the writing control signal line; wherein,
- the scanning line driver controls on/off of the first thin film transistors by a scanning signal inputted to the scanning lines;
- when the first thin film transistors are turned on, the signal line driver applies gradation voltage corresponding to image data of the inputted first to N-th images, to the first accumulation capacities;
- the writing control circuit controls on/off of the second thin film transistors; and
- when the second thin film transistors of the whole liquid panel are turned on, the gradation voltage applied to the first accumulation capacities is transferred to the second accumulation capacities and the liquid crystal pixels.
6. The image transmission system according to claim 1, wherein
- the first to N-th images include a three-dimensional image constituted by at least a right-eye image and a left-eye image;
- the time-division display apparatus sequentially displays the right-eye image and the left-eye image by time division, and
- the image transmission system further comprises an optical shutter constituted by a first shutter corresponding to a right eye and a second shutter corresponding to a left eye, each of which is capable of controlling light transmission/blocking; and
- the optical shutter
- causes the first shutter to be in a light transmission state and the second shutter to be in a light blocking state when the right-eye image is displayed on the time-division display apparatus, and
- causes the second shutter to be in a light transmission state and the first shutter to be in a light blocking state when the left-eye image is displayed on the time-division display apparatus.
7. The image transmission system according to claim 1, wherein
- the second image among the first to N-th images is a reverse image for negating the first image to cause the first image to be an image uncorrelated with the first image;
- the time-division display apparatus sequentially displays at least the first image and the second image for negating the first image by time division, and
- the image transmission system further comprises an optical shutter capable of controlling transmission/blocking of light; and
- the optical shutter
- causes the optical shutter to be in a light transmission state when the first image is displayed on the time-division display apparatus, and
- causes the optical shutter to be in a light blocking state when the second image is displayed on the time-division display apparatus.
8. The image transmission system according to claim 1, wherein the first to N-th images are images to which temporally adjacent first to N-th frames are assigned, respectively, among moving images with a frame frequency of M×N [Hz].
9. The image transmission system according to claim 1, wherein
- the time-division display apparatus sequentially displays the first to N-th images, with a frequency of 120 [Hz] or more; and
- the predetermined image transmission path is a DVI image transmission path, and the frame frequency at the time of transmitting an image is 60 [Hz].
10. The image transmission system according to claim 1, wherein
- the time-division display apparatus sequentially displays the first to N-th images, with a frequency of 120 [Hz] or more; and
- the predetermined image transmission path is an HDMI image transmission path, and the frame frequency at the time of transmitting an image is 60 [Hz] or more and 120 [Hz] or less.
11. The image transmission system according to claim 1, wherein
- the time-division display apparatus sequentially displays the first to N-th images, with a frequency of 120 [Hz] or more; and
- the predetermined image transmission path is a DisplayPort image transmission path, and the frame frequency at the time of transmitting an image is 60 [Hz] or more and 120 [Hz] or less.
12. An image transmission apparatus transmitting first to N-th (N: an integer of 2 or more) images to a time-division display apparatus which sequentially displays the first to N-th images, with a frequency of M×N [Hz] (M: an integer of 1 or more) by time division, the image transmission apparatus comprising:
- a multiplexing unit that plane-sequentially multiplexes the first to N-th images in accordance with the order of displaying the first to N-th images on the time-division display apparatus; and
- a transmitting unit that transmits the multiplexed images which have been multiplexed by the multiplexing unit to the time-division display apparatus via a predetermined image transmission path with a frame frequency of M [Hz], wherein
- each of the first to N-th images is a subframe included in one frame;
- the time-division display apparatus scans and displays each of the first to N-th images with a speed K times (K: a real number satisfying 1<K) as fast as the speed of displaying and scanning an image corresponding to one subframe during a one-subframe period; and
- the multiplexing unit
- plane-sequentially multiplexes dummy images with the number of pixels K−1 times as large as that of the first to N-th images, to the first to N-th images, respectively, and
- plane-sequentially multiplexes the first to N-th images to which the dummy images have been multiplexed.
13. A method by an image transmission apparatus transmitting first to N-th (N: an integer of 2 or more) images to a time-division display apparatus which sequentially displays the first to N-th images, with a frequency of M×N [Hz] (M: an integer of 1 or more) by time division, the method comprising:
- a multiplexing step of plane-sequentially multiplexing the first to N-th images in accordance with the order of displaying the first to N-th images on the time-division display apparatus; and
- a transmission step of transmitting the multiplexed images which have been multiplexed by the multiplexing unit to the time-division display apparatus via a predetermined image transmission path with a frame frequency of M [Hz], wherein
- each of the first to N-th images is a subframe included in one frame;
- the time-division display apparatus scans and displays each of the first to N-th images with a speed K times (K: a real number satisfying 1<K) as fast as the speed of displaying and scanning an image corresponding to one subframe during a one-subframe period; and
- in the multiplexing step
- plane-sequentially multiplexes dummy images with the number of pixels K−1 times as large as that of the first to N-th images, to the first to N-th images, respectively, and
- plane-sequentially multiplexes the first to N-th images to which the dummy images have been multiplexed.
20050259064 | November 24, 2005 | Sugino et al. |
20080036854 | February 14, 2008 | Elliott et al. |
61-087130 | May 1986 | JP |
61-227498 | October 1986 | JP |
62-191824 | August 1987 | JP |
63-312788 | December 1988 | JP |
63312788 | December 1988 | JP |
5-78017 | October 1993 | JP |
7-046631 | February 1995 | JP |
07046631 | February 1995 | JP |
9-163408 | June 1997 | JP |
2723371 | November 1997 | JP |
2003-37823 | February 2003 | JP |
2004-336104 | November 2004 | JP |
2006-195018 | July 2006 | JP |
2006-227312 | August 2006 | JP |
2006227312 | August 2006 | JP |
2007-192919 | August 2007 | JP |
2010-028261 | February 2010 | JP |
WO 20081099737 | August 2008 | WO |
WO 2008/117623 | October 2008 | WO |
- International Search report, PCT/JP2009/069784, Feb. 23, 2010.
- Japanese Official Action—2010-541296—Nov. 26, 2013.
Type: Grant
Filed: Nov 24, 2009
Date of Patent: Nov 3, 2015
Patent Publication Number: 20110222559
Assignee: NEC CORPORATION (Tokyo)
Inventors: Junichirou Ishii (Tokyo), Masao Imai (Tokyo)
Primary Examiner: Kent Chang
Assistant Examiner: Mark Edwards
Application Number: 13/130,208
International Classification: H04N 13/00 (20060101); G09G 3/00 (20060101); G09G 3/36 (20060101); G09G 3/34 (20060101);