DEVICE AND METHOD FOR GENERATING FLOATING IMAGE
A device and a method for generating floating images are provided. An optical imaging module generates a first floating image. A sensing module sends a detection signal to sense first position information of a tested object at a first time point, and generates a feedback signal according to the first position information when the first position information is within a contour range of the first floating image. A signal processing module is electrically connected to the optical imaging module and the sensing module to receive the feedback signal and generate at least one control command and/or at least one feedback command corresponding to the feedback signal. The at least one control command is transmitted to a controller to perform corresponding control on the controller, and the at least one feedback command is transmitted to the optical imaging module, so that the optical imaging module generates a second floating image different from the first floating image.
Latest Industrial Technology Research Institute Patents:
This application claims the priority benefit of U.S. provisional application Ser. No. 63/017,670, filed on Apr. 30, 2020. The entirety of the above-mentioned patent application is hereby incorporated by reference herein and made a part of specification.
BACKGROUND Technical FieldThe disclosure relates to a device and a method for generating floating images.
Description of Related ArtA human machine interface (HMI) is a medium for a user to interact with a device. The HMI may be classified into a contact interface and a non-contact interface according to an interaction mode. When a contact interface is used, the user directly touches a surface of the device to interact with the device. When a non-contact interface is used, the user may interact with the device without directly touching the surface of the device.
The application of the contact interface is quite extensive. After the contact interface is used by the user, it is required to clean the surface from time to time to keep the surface clean, so as to prevent some diseases from contaminating the surface of the contact interface due to the user's contact, which may probably infect other users who touch the contact interface afterwards.
In contrast, when a non-contact interface is used, there is no need to directly touch the surface of the device, which may prevent body fluids from remaining on the surface of the device, thereby reducing the infection resulting from indirect contact. However, the non-contact interface tends to be unintuitive in use and lack effective prompts, which leads to problems such as a poor control experience to the user.
SUMMARYThe disclosure is directed to a device and a method for generating floating images, which are adapted to generate images with a real spatial stereoscopic sense, and generate a corresponding optical image according to a position of a tested object.
An embodiment of the disclosure provides a device for generating floating images. An optical imaging module is used to generate a first floating image. A sensing module sends a detection signal to sense first position information of a tested object at a first time point, and generates a feedback signal according to the first position information when the first position information is within a contour range of the first floating image. A signal processing module is electrically connected to the optical imaging module and the sensing module to receive the feedback signal and generate at least one control command and/or at least one feedback command corresponding to the feedback signal. The at least one control command is transmitted to a controller to perform corresponding control on the controller, and the at least one feedback command is transmitted to the optical imaging module, so that the optical imaging module generates a second floating image that is different from the first floating image.
Another embodiment of the disclosure provides a method for generating floating images, which includes: generating a first floating image; sending a detection signal to sense first position information of a tested object at a first time point, and generating a feedback signal according to the first position information when the first position information is within a contour range of the first floating image; and receiving the feedback signal and generating at least one control command and/or at least one feedback command corresponding to the feedback signal, wherein corresponding control is performed according to the at least one control command, and a second floating image that is different from the first floating image is generated according to the at least one feedback command.
The device and the method for generating floating images according to the embodiments of the disclosure may restore a spatial three-dimensional image, and generate a corresponding optical image according to the position of the tested object. By retaining existing usage habits through intuitive operations, it may help replacing conventional contact or non-contact interfaces.
Following embodiments are provided in collaboration with the accompanying drawings for detailed description, but the provided embodiments are not used to limit a scope of the disclosure. In addition, component sizes in the drawings are drawn for convenience of explanation, and do not represent the actual component sizes. Moreover, although “first”, “second”, etc. are used in the text to describe different components and/or film layers, these components and/or film layers should not be limited to these terms. Rather, these terms are only used to distinguish one component or film layer from another component or film layer. Therefore, a first component or film layer discussed below may be referred to as a second element or film layer without departing from the teachings of the embodiments. To facilitate understanding, similar components are described with the same symbols in the following description.
In the description of the embodiments of the disclosure, different examples may use repeated reference symbols and/or words. These repeated symbols or words are for the purpose of simplification and clarity, and are not used to limit a relationship between the various embodiments and/or the appearance structure. Furthermore, if the following disclosure of the specification describes that a first feature is formed on or above a second feature, it means that it includes an embodiment in which the formed first feature and the second feature are in direct contact, and also includes an embodiment in which an additional feature is formed between the first feature and the second feature, so that the first feature and the second feature may not be in direct contact. To facilitate understanding, similar components are described with the same symbols in the following description.
When a light source illuminates an object, an observer observes reflected light reflected by the object, and accordingly observes the object. In other words, the observer views the object in space through the reflected light reflected from the surface of the object. The reflected light observed by the observer has characteristics of positions, angles, etc., and these characteristics may be described by a plenoptic function P(x, y, z, θ, φ, λ, t), where x, y, z are three-dimensional (3D) coordinates of the observer relative to the object; θ and φ respectively represent a polar angle θ and an azimuth angle φ of the observer relative to the object in spherical coordinates; λ represents a wavelength of the reflected light; and t represents a time when the reflected light is received.
Through a combination of a light field imaging film and a lens, characteristics and a direction of the reflected light entering the observer's eyes are simulated and restored through an algorithm, and an optical method may be used to reconstruct the plenoptic function P(x, y, z, θ, φ, λ, t), i.e., a direction and intensity of the light is reconstructed, thereby reconstructing a 3D image of a virtual object in the real space, so that a same visual effect as observing the real object is produced when the observer observes the reconstructed virtual image from various angles.
The optical imaging module 100A is used to generate a floating image I. The optical imaging module 100A includes a light source 102, a light filter 104 and an optical modulator 106. The light source 102 is electrically connected to the signal processing module 300. The light L generated by the light source 102 sequentially passes through the light filter 104 and the optical modulator 106. When the light L generated by the light source 102 passes through the light filter 104 and the optical modulator 106, a light intensity and transmission direction of the reflected light entering the user's eyes may be restored by reconstructing a plenoptic function of an original object, thereby reconstructing a 3D image of the virtual object in the real space, so that a same visual effect as observing the real object is produced when the observer observes the reconstructed virtual image from various angles.
The light source 102 is used to generate the light L. According to some embodiments, the light L generated by the light source 102 is parallel light. According to some embodiments, if the light L generated by the light source 102 is non-parallel light, a lens may be arranged in front of a light-emitting surface of the light source 102, for example, a Fresnel lens (not shown) is arranged in front of the light-emitting surface of the light source 102 to make the light L to become parallel light. According to some embodiments, the light L generated by the light source 102 may be monochromatic light, multiple monochromatic light, or white light. According to some embodiments, the light source 102 may be a light-emitting diode (LED), a quantum dot (quantum dot), an organic light-emitting diode (OLED) or other similar light sources, but the disclosure is not limited thereto.
As shown in
According to some embodiments, the light filter 104 may also produce the effect of optical field pattern optimization. According to some embodiments, the incident light L may be non-parallel light. If the incident light L is non-parallel light, when the incident light L enters the light filter 104, the incident light L may be reflected to an unexpected region, resulting in unexpected image changes. According to some embodiments, when designing an imaging film serving as the light filter 104, a structure or pattern of the light filter 104 may be adjusted through an algorithm, for example, to change a thickness of some regions of the light filter 104 (for example, to increase the thickness of some regions, such that after the incident light L enters the light filter 104, a part of the incident light at a large angle cannot pass through the light filter 104, and relatively parallel light may pass through the light filter 104). As described above, the light filter 104 may achieve the effect of optical field pattern optimization to optimize the imaging quality.
As shown in
According to some embodiments, a lens 108 may be further disposed between the optical modulator 106 and the floating image I, and the lens 108 may be a single lens or a lens group. The lens 108 may have a focusing effect, so that the light L is more concentrated, and the floating image I becomes clearer or a viewing angle thereof is increased.
As shown in
As shown in
As shown in
As shown in
As shown in
As shown in
As shown in
Referring to
Referring to
Referring to
Referring to
As shown in
According to some embodiments, after
Referring to
According to
The optical imaging module 100B and the optical imaging module 100A shown in
According to some embodiments, the optical modulator 106′ of the optical imaging module 100B may be a microlens array, an optical lens, an optical fiber, an optical grating, or a photonic crystal, but the disclosure is not limited thereto.
As shown in
As shown in
The light L emitted by the light-emitting layer 110a of the light-emitting module 110 is not necessarily parallel light. According to some embodiments, the light L emitted by the light-emitting module 110 may first pass through the collimating lens 150 to become parallel light before passing through the optical modulator 106, so as to achieve an effect of optical field pattern optimization to optimize the imaging quality. According to some embodiments, the collimating lens 150 may be a Fresnel lens.
According to some embodiments, if a distance between the light-emitting module 110 and the optical modulator 106 is equal to a focal length of the optical modulator 106, the collimating lens 150 may be omitted, which avails further reducing a size of the optical imaging module. At this time, the light L emitted by the light-emitting module 110 directly passes through the optical modulator 106 to focus on a specific position and generate the floating image I.
According to some embodiments, the light L emitted from the light-emitting layer 110a may be controlled through the first electrode 110b and the second electrode 110c of the light-emitting module 110, so as to respectively generate a first floating image and a second floating image difference from the first floating image. According to some embodiments, the first electrode 110b and the second electrode 110c may control the light-emitting layer 110a to emit a first light with a first color to form a first floating image, and emit a second light with a color different from the first color to form a second floating image. According to some embodiments, the first electrode 110b and the second electrode 110c may control the light-emitting layer 110a to emit the first light with a first brightness to form the first floating image, and emit the second light with a brightness different from the first brightness to form the second floating image.
As shown in
According to some embodiments, the light-emitting layer 110a may be a light-emitting diode, a quantum dot, an organic light-emitting diode, or other similar light-emitting devices, but the disclosure is not limited thereto. According to some embodiments, the first electrode 110b may be a transparent electrode to reduce the loss of the light L passing through the first electrode. According to some embodiments, the first electrode 110b is a cathode and the second electrode 110c is an anode. According to some embodiments, in addition to metal oxide or alkali metal salt doped with metal, the material of the first electrode 110b may also be further doped with an organic material to improve transparency. For example, the metal oxide includes but is not limited to LiO2 (lithium superoxide) or MoO3 (molybdenum trioxide); the alkali metal salt includes, but is not limited to, LiF (lithium fluoride), LiBO3 (lithium borate), K2SiO3 (potassium silicate)), Cs2CO3 (cesium carbonate), CH3COOM (metal acetates) (M is Li (lithium), Na (sodium), K (potassium), Rb (rubidium) or Cs (cesium)); and metal may be listed but is not limited to Al (aluminum), Ca (calcium), Ag (silver), Cu (copper), Mg (magnesium) or alloys thereof, such as Mg:Ag, Li:Al, etc. According to some embodiments, a material of the second electrode 110c may include metal oxides, such as indium tin oxide (ITO), indium zinc oxide (IZO), aluminum-doped zinc oxide, AZO), zinc oxide (ZnO), or gallium-doped zinc oxide (GZO), but the disclosure is not limited thereto.
Referring to
By controlling the individual light-emitting layers, i.e., the light-emitting layer 112a of the first light-emitting module 112 and the light-emitting layer 114a of the second light-emitting module 114, the optical imaging module 100D may generate different light L1, L2, and accordingly generate different floating images I1 and I2.
As shown in
In the optical imaging module 100E, the display module 130 is used to replace the light-emitting modules 110 and 120. The display module 130 includes a plurality of pixels that may be individually driven, and by controlling lighting states of the individual pixels, a color, brightness, direction and other characteristics of the generated light L may be changed to generate a variable floating image I.
According to some embodiments, the pixels of the display module 130 of the optical imaging module 100E may be composed of liquid crystals, light-emitting diodes, quantum dots, organic light-emitting diodes, or other similar display elements, but the disclosure is not limited thereto.
As shown in
The sensing module 200 includes a sensing module 230 disposed on a side surface 610S of the space 610. As shown in
By using the method shown in
Referring to
Referring to
Referring to
Referring to
Referring to
Referring to
Referring to
Referring to
Referring to
Referring to
In summary, according to the device and the method for generating floating images of the embodiments of the disclosure, interactive floating images with a real spatial stereoscopic sense may be generated. In addition, the floating image device of the embodiment of the disclosure may effectively reduce a module size, may be customized according to a usage environment, and may be more effectively integrated with a usage site.
It will be apparent to those skilled in the art that various modifications and variations can be made to the disclosed embodiments without departing from the scope or spirit of the disclosure. In view of the foregoing, it is intended that the disclosure covers modifications and variations provided they fall within the scope of the following claims and their equivalents.
Claims
1. A device for generating floating images, comprising:
- an optical imaging module, configured to generate a first floating image;
- a sensing module, sending a detection signal to sense first position information of a tested object at a first time point, and generating a feedback signal according to the first position information when the first position information is within a contour range of the first floating image; and
- a signal processing module, electrically connected to the optical imaging module and the sensing module to receive the feedback signal, and generating at least one control command and/or at least one feedback command corresponding to the feedback signal, wherein the at least one control command is transmitted to a controller to perform corresponding control on the controller, and the at least one feedback command is transmitted to the optical imaging module, so that the optical imaging module generates a second floating image that is different from the first floating image.
2. The device as claimed in claim 1, wherein the optical imaging module comprises:
- a light source, electrically connected to the signal processing module, and generating a first light or a second light;
- a light filter receiving the first light or the second light, and performing patterning and optical field pattern optimization on the first light or the second light; and
- an optical modulator, receiving the first light or the second light, focusing the first light or the second light, and generating the first floating image by using the first light, or generating the second floating image by using the second light.
3. The device as claimed in claim 2, wherein the optical modulator is a microlens array, an optical fiber, an optical grating, or a photonic crystal.
4. The device as claimed in claim 2, wherein the light filter is an integrated imaging film recording direction and angle information of light forming the floating image.
5. The device as claimed in claim 1, wherein the optical imaging module comprises:
- a first light-emitting module, electrically connected to the signal processing module, and generating a first light, wherein the first light-emitting module comprises: a light-emitting layer, generating the first light; a first electrode, located on a light-emitting surface of the light-emitting layer; and a second electrode, located on another side of the light-emitting layer opposite to the light-emitting surface, wherein the first electrode and the second electrode control a lighting state of the light-emitting layer; and
- an optical modulator, receiving the first light, and focusing the first light to generate the first floating image.
6. The device as claimed in claim 5, wherein the optical imaging module further comprises:
- a second light-emitting module, electrically connected to the signal processing module and located between the first light-emitting module and the optical modulator to generate a second light, wherein the second light-emitting module comprises: a light-emitting layer, generating the second light; a first electrode, located on a light-emitting surface of the light-emitting layer; and a second electrode, located on another side of the light-emitting layer opposite to the light-emitting surface, wherein the first electrode and the second electrode control a lighting state of the light-emitting layer,
- wherein the optical modulator receives the second light and focuses the second light to generate the second floating image.
7. The device as claimed in claim 1, wherein the optical imaging module comprises:
- a display module, electrically connected to the signal processing module, and comprising a plurality of pixels capable of being individually driven, and generating at least one light by controlling a lighting state of individual pixels of the plurality of pixels; and
- an optical modulator, receiving the at least one light, and focusing the at least one light to generate the floating image corresponding to the at least one light.
8. The device as claimed in claim 1, wherein the sensing module is located on an inner side of a hollow frustum of a housing of the device and faces a surface of the optical imaging module, and the hollow frustum covers above a part of a light-emitting surface of the optical imaging module and surrounds the floating image.
9. The device as claimed in claim 1, wherein the sensing module is located on an outer side of a hollow frustum of a housing of the device, the hollow frustum has an opening, and the sensing module covers the opening.
10. The device as claimed in claim 1, wherein the sensing module is arranged on a light incident surface of the light filter.
11. The device as claimed in claim 1, wherein the optical imaging module is located in a space of an object, and the sensing module is arranged on a side surface of the space and a periphery of the floating image.
12. The device as claimed in claim 1, wherein the second floating image has a different shape, color, image, or brightness from that of the first floating image.
13. A method for generating floating images, comprising:
- generating a first floating image;
- sending a detection signal to sense first position information of a tested object at a first time point, and generating a feedback signal according to the first position information when the first position information is within a contour range of the first floating image; and
- receiving the feedback signal, and generating at least one control command and/or at least one feedback command corresponding to the feedback signal, wherein corresponding control is performed according to the at least one control command, and a second floating image that is different from the first floating image is generated according to the at least one feedback command.
14. The method as claimed in claim 13, further comprising:
- sending a second detection signal to sense second position information of the tested object at a second time point after the first time point, and when the second position information is located outside the contour range of the first floating image, stopping generating the feedback signal and stopping generating the at least one control command and/or the at least one feedback command corresponding to the feedback signal according to the second position information, stopping performing the corresponding control according to the at least one control command, stopping generating the second floating image different from the first floating image according to the at least one feedback command, and resuming generating the first floating image.
15. The method as claimed in claim 13, wherein the second floating image has a different shape, color, image, or brightness from that of the first floating image.
16. The method as claimed in claim 13, wherein the detection signal is an invisible light signal or an ultrasonic signal.
Type: Application
Filed: Apr 21, 2021
Publication Date: Nov 4, 2021
Patent Grant number: 11614837
Applicant: Industrial Technology Research Institute (Hsinchu)
Inventors: Yi-Hsiang Huang (Changhua County), Ping-Chang Jui (Taipei City), Hung Tsou (Hsinchu County), Szu-Wei Wu (Taoyuan City), Han-Sung Chan (New Taipei City)
Application Number: 17/235,940