PROJECTION PROCESSOR AND ASSOCIATED METHOD
A projection processor includes a receiving circuit and an image processing circuit. The receiving circuit receives an input image. The image processing circuit performs at least one predetermined image processing operation upon the input image to generate an output image, wherein a projection source is generated according to the output image. The projection source is displayed or projected by a projection source component of an electronic device, such that a first cover of a projection display component partially reflects the projection source.
This application claims the benefit of U.S. Provisional Application No. 62/003,260, filed on May 27, 2014, and U.S. Provisional Application No. 62/034,952, filed on Aug. 8, 2014. The entire contents of the related applications are incorporated herein by reference.
TECHNICAL FIELDThe present invention relates to image processing, and more particularly, to a projection processor and associated method.
BACKGROUNDDevices which can provide customers with high-quality visual effects are desirable because of the recent progress in multimedia entertainment systems. In particular, 3D display technology has been receiving more attention because of its superior visual effects and vivid images. For customers, using 3D glasses results in an uncomfortable experience, but holographic display is too expensive to be widely acceptable for most users.
SUMMARYOne of the objectives of the present invention is to provide a projection processor and associated method applied in the projection processor.
According to an embodiment of the present invention, an exemplary projection processor is disclosed. The exemplary projection processor includes a receiving circuit and an image processing circuit. The receiving circuit is arranged to receive an input image. The image processing circuit is arranged to perform at least one predetermined image processing operation upon the input image to generate an output image, wherein a projection source is generated according to the output image. The projection source is displayed or projected by a projection source component of an electronic device, such that a first cover of a projection display component partially reflects the projection source.
According to an embodiment of the present invention, an exemplary projection method employed by a projection processor is disclosed. The exemplary projection method includes: receiving an input image; and performing at least one predetermined image processing operation upon the input image to generate an output image, wherein a projection source is generated according to the output image. The projection source is displayed or projected by a projection source component of an electronic device, such that a first cover of a projection display component partially reflects the projection source.
These and other objectives of the present invention will no doubt become obvious to those of ordinary skill in the art after reading the following detailed description of the preferred embodiment that is illustrated in the various figures and drawings.
Certain terms are used throughout the following description and claims, which refer to particular components. As one skilled in the art will appreciate, electronic equipment manufacturers may refer to a component by different names. This document does not intend to distinguish between components that differ in name but not in function. In the following description and in the claims, the terms “include” and “comprise” are used in an open-ended fashion, and thus should be interpreted to mean “include, but not limited to . . . ”. Also, the term “couple” is intended to mean either an indirect or direct electrical connection. Accordingly, if one device is coupled to another device, that connection may be through a direct electrical connection, or through an indirect electrical connection via other devices and connections.
Refer to
As shown in
In the embodiment of
It should be noted that the projection processor 300 may be a processor installed within the electronic device 101 and may transmit the output image OI via an internal bus of the electronic device 101; however, in other embodiments, the projection processor 300 may be installed within another device external to the electronic device 101 and may transmit the output image OI to the electronic device 101 via wired/wireless transmission. Furthermore, the projection processor 300 can be applied to a 2D image projection application or 3D image projection application, which is not limited in the present invention. These alternative designs should fall within the scope of the present invention.
The image flip engine 401 is arranged to perform an image flip operation. In some embodiments, the image flip engine 401 performs an image flip operation to ensure that an orientation of the projected image PI matches an orientation of the input image II. In some other embodiments, the image flip engine 401 performs an image flip operation to ensure that a user can see the projected image PI shown on or behind the first cover C1 with a correct orientation. The image distortion correction engine 402 is arranged to perform the image distortion correction operation to correct an appearance of the projection source PS. The image segmentation engine 403 is arranged to perform an image segmentation operation and change a background of a segmented image to generate the projection source PS. The image enhancement engine 404 is arranged to perform an image enhancement operation to adjust a brightness of the projection source PS, a brightness of the background or a contrast of the whole image. The notification circuit 405 is arranged to control the electronic device 101 to show a projection notice PN according to the status of at least one of the image flip engine 401, the image distortion correction engine 402, the image segmentation engine 403, the image enhancement engine 404, and the projection display component 100, as the status of the projected image PI or any other factors may result in a poor user experience.
-
- Step 600: Start.
- Step 602: The user may enable the projection display mode.
- Step 604: The image flip engine 401 may check if the projection display component 100 is set correctly. If yes, the flow goes to step 606; otherwise, it goes to step 610.
- Step 606: The image flip engine 401 may check if the orientation of the projected image PI is identical with the input image PI. If yes, the flow goes to step 612; otherwise, it goes to step 608.
- Step 608: The image flip engine 401 performs the image flip operation.
- Step 610: The notification circuit 405 controls the electronic device 101 to show the projection notice PN.
- Step 612: End.
In step 604, if there is an incorrect setting which may cause a fail projection (for example, the optical set OS or the first cover C1 is not attached to the base plate BP), an incorrect setting which may cause the size of the projected image PI too small or too large, or an incorrect setting which may cause that the user can not observe the projected image PI correctly, the notification circuit 405 may control the electronic device 101 (particularly, a projection source component PSC of the electronic device 101) to show the projection notice PN for notifying the user. Provided that the end result is substantially the same, the steps shown in
-
- Step 900: Start.
- Step 902: The user may enable the projection display mode.
- Step 904: The image distortion correction engine 402 may check if the projection display component 100 is set correctly. If yes, the flow goes to step 906; otherwise, the flow goes to step 910.
- Step 906: The image distortion correction engine 402 may check if the optical lens covers all the projection sources or if the optical lens is set to a position parallel with the device. If yes, the flow goes to step 912; otherwise, the flow goes to step 908.
- Step 908: The image distortion correction engine 402 performs the image distortion correction operation.
- Step 910: The notification circuit 405 controls the electronic device 101 to show the projection notice PN.
- Step 912: End.
In step 904, if an incorrect setting that causes a fail projection (for example, the lens included in the optical set OS is set to a position that tilts too much, which makes the projection source PS not able to be projected on the first cover C1 via the lens), or an incorrect setting which means the user cannot observe the projected image PI correctly is detected, the notification circuit 405 may further control the electronic device 101 (e.g. a projection source component PSC or a speaker of the electronic device 101) to display, project or generate the projection notice PN for notifying the user. Provided that the result is substantially the same, the steps shown in
-
- Step 1200: Start.
- Step 1202: The user may enable the projection display mode.
- Step 1204: The image segmentation engine 403 analyzes the content of the projection source PS according to side information generated from a camera, depth sensor or algorithm, etc.
- Step 1206: The image segmentation engine 403 checks if the background is suitable for user observing. If yes, the flow goes to step 1214; otherwise, the flow goes to step 1208.
- Step 1208: The image segmentation engine 403 performs an image segmentation operation.
- Step 1210: The image segmentation engine 403 checks if the image segmentation operation succeeds. If yes, the flow goes to step 1214; otherwise, the flow goes to step 1212.
- Step 1212: The notification circuit 405 controls the electronic device 101 to show the projection notice PN.
- Step 1214: End.
In step 1206, The image segmentation engine 403 checks if the complexity of the background is higher than the threshold value TH1, and checks if the contrast value between the color of the background and the color of the projection source PS is sufficient to determine whether to perform the image segmentation operation. In step 1210, when the image segmentation engine 403 detects a segmentation failure (for example, after the segmentation, the complexity of the background is still higher than the threshold value TH1 which means the user may not observe the projected image PI clearly), the notification circuit 405 controls the electronic device 101 (particularly, a projection source component PSC of the electronic device 101) to display or project the projection notice PN for notifying the user. Provided that the result is substantially the same, the steps shown in
-
- Step 1300: Start.
- Step 1302: The image enhancement engine 404 checks if the brightness of the projection source PS is lower than a threshold value TH3. If yes, the flow goes to step 1304; otherwise, the flow goes to step 1306.
- Step 1304: The image enhancement engine 404 increases the brightness of the projection source PS.
- Step 1306: The image enhancement engine 404 checks if a difference between the brightness of the background and the brightness of the projection source PS is lower than a threshold value TH4. If yes, the flow goes to step 1308; otherwise, the flow goes to step 1310.
- Step 1308: The image enhancement engine 404 increases the contrast by, for example, decreasing the brightness of the background.
- Step 1310: The image enhancement engine 404 checks if a similarity between an ambient light and the color of projection source PS is higher than a threshold value TH5. If yes, the flow goes to step 1312; otherwise, the flow goes to step 1314.
- Step 1312: The notification circuit 405 controls the electronic device 101 to show the projection notice PN.
- Step 1314: End.
In this embodiment, the image enhancement engine 404 may adjust the brightness of the projection source PS and/or the brightness of the background. In step 1310, if the similarity between the color of the ambient light and the color of the projection source PS is higher than the threshold value TH5, the notification circuit 405 controls the electronic device 101 (particularly, a projection source component PSC of the electronic device 101) to display or project the projection notice PN for notifying the user. In this embodiment, the ambient light can be detected by a red/green/blue (RGB) light sensor installed in the electronic device 101. Provided that the result is substantially the same, the steps shown in
In one embodiment, the projection source PS can be divided into four segments on the projection source component PSC of the electronic device 101, so the projected image PI can be seen from four different viewpoints, wherein these four segments is processed by the projection processor 300 in parallel. It should be noted that the number of segments is only for illustrative purpose, not a limitation of the present invention. To have the information of the video view number, in one embodiment, the view number is derived from H.264's Supplemental Enhancement Information (SEI) transmitted from a transmitter.
Those skilled in the art will readily observe that numerous modifications and alterations of the device and method may be made while retaining the teachings of the invention. Accordingly, the above disclosure should be construed as limited only by the metes and bounds of the appended claims.
Claims
1. A projection processor, comprising:
- a receiving circuit, arranged to receive an input image; and
- an image processing circuit, arranged to perform at least one predetermined image processing operation upon the input image to generate an output image, wherein a projection source is generated according to the output image;
- wherein the projection source is displayed or projected by a projection source component of an electronic device, such that a first cover of a projection display component partially reflects the projection source.
2. The projection processor of claim 1, wherein the first cover comprises:
- at least one non-opaque plate, arranged to partially reflects the projection source, such that a projected image is shown on or behind the at least one non-opaque plate.
3. The projection processor of claim 1, wherein the image processing circuit comprises an image flip engine, and the predetermined image processing operation comprises an image flip operation controlled by the image flip engine.
4. The projection processor of claim 3, wherein the image flip engine performs the image flip operation to ensure that an orientation of the projected image matches an orientation of the input image or the projected image is shown on or behind the first cover with a correct orientation.
5. The projection processor of claim 3, wherein the image flip engine performs the image flip operation when an orientation of the projected image is not identical with the input image or the projected image is shown on or behind the first cover with an incorrect orientation.
6. The projection processor of claim 1, wherein the image processing circuit comprises an image distortion correction engine, and the predetermined image processing operation comprises an image distortion correction operation controlled by the image distortion correction engine.
7. The projection processor of claim 6, wherein the image distortion correction engine performs the image distortion correction operation to correct an appearance of the projection source when only a portion of the projection source is projected through a lens.
8. The projection processor of claim 6, wherein the image distortion correction engine performs the image distortion correction operation when the optical lens is not parallel with the electronic device.
9. The projection processor of claim 1, wherein the image processing circuit comprises an image segmentation engine, and the predetermined image processing operation comprises an image segmentation operation controlled by the image segmentation engine.
10. The projection processor of claim 9, wherein the image segmentation engine separates the projection source from a background of the projection source and fills the background with a plain color.
11. The projection processor of claim 9, wherein the image segmentation engine performs the image segmentation operation when a background corresponding to the projection source is not suitable for observing.
12. The projection processor of claim 1, wherein the image processing circuit comprises an image enhancement engine, and the predetermined image processing operation comprises an image enhancement operation controlled by the image enhancement engine.
13. The projection processor of claim 12, wherein the image enhancement engine performs the image enhancement operation when brightness of the projection source is lower than a first threshold or a difference between brightness of background and brightness of the projection source is lower than a second threshold value.
14. A projection method employed by a projection processor, comprising:
- receiving an input image; and
- performing at least one predetermined image processing operation upon the input image to generate an output image, wherein a projection source is generated according to the output image;
- wherein the projection source is displayed or projected by a projection source component of an electronic device, such that a first cover of a projection display component partially reflects the projection source.
15. The projection method of claim 14, wherein the first cover comprises at least one non-opaque plate arranged to partially reflects the projection source, such that a projected image is shown on or behind the at least one non-opaque plate.
16. The projection method of claim 14, wherein the predetermined image processing operation comprises an image flip operation.
17. The projection method of claim 16, wherein the image flip operation comprises:
- flipping the input image to ensure that an orientation of the projected image matches an orientation of the input image or the projected image is shown on or behind the first cover with a correct orientation.
18. The projection method of claim 16, wherein the image flip operation is performed when an orientation of the projected image is not identical with the input image or the projected image is shown on or behind the first cover with an incorrect orientation.
19. The projection method of claim 14, wherein the predetermined image processing operation comprises an image distortion correction operation.
20. The projection method of claim 19, wherein the image distortion correction operation is performed to correct an appearance of the projection source when only a portion of the projection source is projected through a lens.
21. The projection method of claim 19, wherein the image distortion correction operation is performed when the optical lens is not parallel with the electronic device.
22. The projection method of claim 14, wherein the predetermined image processing operation comprises an image segmentation operation.
23. The projection method of claim 22, wherein the image segmentation operation comprising:
- separating the projection source from a background the projection source and fills the background with a plain color.
24. The projection method of claim 22, wherein the image segmentation operation is performed when a background corresponding to the projection source is not suitable for observing.
25. The projection method of claim 14, wherein the predetermined image processing operation comprises an image enhancement operation.
26. The projection method of claim 25, wherein the image enhancement operation is performed when brightness of the projection source is lower than a first threshold or a difference between brightness of background and brightness of the projection source is lower than a second threshold value.
Type: Application
Filed: May 27, 2015
Publication Date: Jun 9, 2016
Inventors: Tsu-Ming Liu (Hsinchu City), Chih-Kai Chang (Taichung City), Chi-Cheng Ju (Hsinchu City), Chih-Ming Wang (Hsinchu County)
Application Number: 14/905,290