INPUT DEVICE

Abstract

An input device has a beam splitter that reflects a part of light emitted from a display surface of a display mechanism, a retroreflective material to which the light reflected by the beam splitter is incident and which reflects the incident light toward the beam splitter, a detection mechanism for detecting the user's fingertip in an aerial-image display region in which an aerial image is displayed, and a camera module disposed at a position where the aerial-image display region can be photographed. In the input device, an aerial image is formed in the aerial-image display region by the light transmitted through the beam splitter after being reflected by the retroreflective material. The camera module is disposed on a side where the beam splitter is disposed with respect to the aerial-image display region.

Description

CROSS REFERENCE TO RELATED APPLICATIONS

This is the U.S. national stage of application No. PCT/JP2021/027020, filed on Jul. 19, 2021. Priority under 35 U.S.C. § 119(a) is claimed from PCT/JP2021/020744, filed on May 31, 2021, and priority under 35 U.S.C. § 119(e) is claimed to U.S. Provisional Application No. 63/054,799, filed Jul. 22, 2020, the disclosure of which is also incorporated herein by reference.

TECHNICAL FIELD

The present invention relates to an input device for users to input information such as PINs using their fingertips.

BACKGROUND ART

Conventionally, automated transaction devices such as ATMs (Automated Teller Machines) including an aerial-image display device and a PIN (Personal Identification Number) display and input portion are known (see, Patent Literature 1, for example). In the automatic transaction device described in Patent Literature 1, the aerial-image display device includes an aerial-image forming mechanism and a display portion. The PIN display and input portion includes a PIN display portion and a PIN input portion. On the display portion, a keypad for inputting the PIN is displayed. The aerial-image forming mechanism projects the keypad displayed on the display portion into a space so as to form an aerial image and to display it on the PIN display portion.

In the automatic transaction device in Patent Literature 1, the PIN input portion includes a detection mechanism which detects an operation performed by the user on the aerial image of the keypad displayed in the PIN display portion. The detection mechanism is, for example, an infrared sensor, a camera or the like that detects the position of the user's fingertip in a plane containing the aerial image of the keypad displayed on the PIN display portion. In the automatic transaction device of Patent Literature 1, the PIN is input on the basis of a detection result of the detection mechanism by the user moving his/her fingertip sequentially to a predetermined position of the aerial image of the keypad displayed on the PIN display portion.

CITATION LIST

Patent Literature

[Patent Literature 1] Japanese Unexamined Patent Application Publication 2020-134843

SUMMARY OF THE INVENTION

Problems to Be Solved By the Invention

The inventor of this application has developed an input device for users to input information such as PINs using an aerial image displayed in a space, as in the automatic transaction device described in the Patent Literature 1. The inventor of this application is also examining addition of an information reading function to this input device in order to optically read predetermined information such as bar codes and two-dimensional codes. This input device is preferably capable of optically read predetermined information easily with a simple configuration.

Therefore, an object of the present invention is to provide an input device that can optically read predetermined information easily with a simple configuration in an input device for a user to input PINs and the like by using an aerial image displayed in an aerial-image display region.

Means for Solving the Problem

In order to solve the above problem, an input device of at least an embodiment of the present invention is an input device inputting information using a fingertip of a user, including a display mechanism having a display surface for displaying an image, an aerial-image forming mechanism which forms an aerial image by projecting an image displayed on the display surface into a space, a detection mechanism which detects a fingertip of the user in an aerial-image display region, which is a region in which the aerial image is displayed, and a camera module disposed at a position where the aerial-image display region can be photographed, in which the aerial-image display region serves as an input portion for the user to input information, and the aerial-image forming mechanism includes a beam splitter that reflects a part of light emitted from the display surface and a retroreflective material to which the light reflected by the beam splitter is incident and which reflects the incident light in the same direction as the incident direction toward the beam splitter, in which an aerial image is formed in the aerial-image display region by the light transmitted through the beam splitter after being reflected by the retroreflective material, and the camera module is disposed on a side where the beam splitter is disposed with respect to the aerial-image display region.

In the input device of this aspect, the camera module is disposed on the side where the beam splitter is disposed with respect to the aerial-image display region and is also disposed at a position where the aerial-image display region can be photographed. Therefore, in this aspect, when the user holds a medium or a device on which predetermined information is recorded or displayed to the aerial image displayed in the aerial-image display region, the predetermined information can be photographed by the camera module. In other words, in this aspect, when the user holds the medium or the device on which the predetermined information is recorded or displayed to the aerial image displayed in the aerial-image display region, the predetermined information can be optically read by the camera module. Therefore, in this aspect, the predetermined information can be optically read easily.

In addition, in this aspect, by brightening the aerial image displayed in the aerial-image display region, the camera module can optically read the predetermined information even if the input device does not include lighting that illuminates the medium or the device in which the predetermined information is recorded or displayed. Therefore, in this aspect, the predetermined information can be optically read with a simple configuration. In addition, in this aspect, since the camera module is disposed on the side where the beam splitter is disposed with respect to the aerial-image display region, the space formed between the beam splitter and the aerial-image display region in order to form an aerial image in the aerial-image display region can be effectively used as a space for optically reading the predetermined information by the camera module.

In this aspect, for example, the display mechanism displays a frame for indicating a region to which a photographed portion with the information photographed by the camera module recorded or displayed is held on the display surface, and the aerial-image forming mechanism displays the frame displayed on the display surface as an aerial image in the aerial-image display region. In this case, the user can recognize which part of the aerial-image display region the photographed portion is to be held.

In this aspect, for example, the display mechanism displays on the display surface a guidance to prompt the user to hold the photographed portion to the aerial-image display region in which information photographed by the camera module is recorded or displayed, and the aerial-image forming mechanism displays the guidance displayed on the display surface as an aerial image on the aerial-image display region. In this case, the user can hold the photographed portion in accordance with the guidance displayed in the aerial-image display region.

Effect of the Invention

As described above, in at least an embodiment of the present invention, in an input device for a user to input a PIN or the like using an aerial image displayed in the aerial-image display region, predetermined information can be optically read easily with a simple configuration.

BRIEF DESCRIPTION OF THE DRAWINGS

Embodiments will now be described, by way of example only, with reference to the accompanying drawings which are meant to be exemplary, not limiting, and wherein like elements are numbered alike in several Figures, in which:

FIG. 1 is a schematic diagram for explaining a configuration of an input device according to an embodiment of the present invention.

FIG. 2 is a schematic diagram for explaining a configuration of the input device shown in FIG. 1.

FIG. 3A and FIG. 3B are diagrams illustrating an example of an aerial image displayed in the aerial-image display region shown in FIG. 1.

MODE FOR CARRYING OUT THE INVENTION

In the following, embodiments of the present invention will be explained with reference to the drawings.

Configuration of Input Device

FIG. 1 is a schematic diagram for explaining a configuration of an input device 1 according to an embodiment of the present invention. FIG. 2 is a schematic diagram for explaining a configuration of the input device 1 shown in FIG. 1. FIGS. 3A and FIG. 3B are diagrams illustrating an example of an aerial image displayed in the aerial-image display region R shown in FIG. 1.

The input device 1 in this embodiment is a device inputting information using a user's fingertips and is used by being mounted on, for example, ATMs, authentication devices for credit card and other payments, automatic ticketing machines, vending machines, or higher-level devices such as access control device. In the input device 1 of this embodiment, for example, a PIN is input. Moreover, the input device 1 of this embodiment can optically read predetermined information. The input device 1 has an aerial-image display device 2 which displays an aerial image in a three-dimensional space, a detection mechanism 3 for detecting a position of the user's fingertip in the aerial-image display region R, which is a region in which the aerial image is displayed, a camera module 4 for optically reading predetermined information, and an enclosure 5 in which these configurations are accommodated.

The aerial-image display device 2 has a display mechanism 6 having a display surface 6a for displaying images, and an aerial-image forming mechanism 7 that projects the image displayed on the display surface 6a into a space so as to form an image as an aerial image. The aerial-image forming mechanism 7 has a beam splitter 8 and a retroreflective material 9. In the following explanation, a Y-direction in FIG. 1, which is orthogonal to an up-down direction (vertical direction), is referred to as a left-right direction, and a direction orthogonal to the up-down direction and the left-right direction is referred to as a front-back direction. An X1-direction side in FIG. 1, which is one side in the front-back direction, is assumed to be a “front” side, and an X2-direction side in FIG. 1, which is a side opposite to that, is assumed to be a “rear” side. In this embodiment, a user standing on a front side of the input device 1 inputs predetermined information on the front side of the input device 1.

The display mechanism 6 is, for example, a liquid crystal display or an organic EL display, and the display surface 6a is a display screen. The display surface 6a faces diagonally rearward and upward. The beam splitter 8 is formed having a flat plate shape. The beam splitter 8 is disposed on a rear side of the display mechanism 6. The beam splitter 8 reflects a part of light emitted from the display surface 6a. That is, a surface on one side of the beam splitter 8 is a reflective surface 8a that reflects a part of the light emitted from the display surface 6a. The reflective surface 8a faces diagonally forward and downward.

The retroreflective material 9 is formed having a flat plate shape. The retroreflective material 9 is disposed on a rear side of the display mechanism 6 and is disposed on a lower side of the beam splitter 8. To the retroreflective material 9, the light reflected by the beam splitter 8 is incident. The retroreflective material 9 reflects the incident light in the same direction as an incident direction toward the beam splitter 8. In other words, a surface on one side of the retroreflective material 9 is a retroreflective surface 9a, to which the light reflected by the beam splitter 8 is incident, and also reflects the incident light in the same direction as the incident direction toward the beam splitter 8. A quarter-wavelength plate is attached to the retroreflective surface 9a. The retroreflective surface 9a faces diagonally forward and upward.

A part of the light emitted from the display surface 6a of the display mechanism 6 is reflected by the reflective surface 8a of the beam splitter 8 and enters the retroreflective surface 9a of the retroreflective material 9. The light reflected by the reflective surface 8a is directed diagonally rearward and downward. The light incident to the retroreflective surface 9a is reflected in the same direction as the incident direction of the light to the retroreflective surface 9a. The light reflected by the retroreflective surface 9a goes diagonally forward and upward and passes through the beam splitter 8. The light transmitted through the beam splitter 8 forms an aerial image in the aerial-image display region R. The aerial-image display region R is formed on an upper side of the beam splitter 8. The aerial image formed in the aerial-image display region R is recognized by a user standing in front of the input device 1 as an image slightly inclined downward as it moves toward the front side.

The enclosure 5 has a frame body 11 that surrounds the aerial-image display region R. An inner peripheral side of the frame body 11 is an opening portion 11a that leads to an inside of the enclosure 5. The opening portion 11a is formed having a rectangular or regular-square shape. The aerial-image display region R is formed in the opening portion 11a. The aerial-image display region R serves as an input portion 12 for the user to input information using the fingertips. The user standing in front of the input device 1 inputs the PIN and the like from the upper side of the input portion 12 in the input portion 12.

The detection mechanism 3 detects the position of the user's fingertip in the aerial-image display region R, as described above. In other words, the input portion 12 is included in a detection range of the detection mechanism 3. The detection mechanism 3 is an optical sensor. Specifically, the detection mechanism 3 is an infrared sensor. In addition, the detection mechanism 3 is a line sensor. The detection mechanism 3 is a reflection-type optical sensor including a light emitting portion which emits infrared light and a light receiving portion to which the infrared light emitted from the light emitting portion and reflected by the user's fingertip is incident. The detection mechanism 3 is disposed on the side of the opening portion 11a. The detection mechanism 3 detects the position of the user's fingertip in a plane containing the aerial-image display region R (that is, in the plane containing the input portion 12). The detection mechanism 3 may be a transmission-type optical sensor.

The camera module 4 is fixed inside the enclosure 5. The camera module 4 is disposed at a position where the aerial-image display region R can be photographed. Moreover, the camera module 4 is disposed below the aerial-image display region R. That is, the camera module 4 is disposed at a position where the aerial-image display region R can be photographed from below. As described above, the aerial-image display region R is formed on the upper side of the beam splitter 8, and the beam splitter 8 is disposed on a lower side of the aerial-image display region R. That is, the camera module 4 is disposed on a side where the beam splitter 8 is disposed with respect to the aerial-image display region R.

Moreover, the camera module 4 is disposed on a rear side of the beam splitter 8 and on the further rear side of the aerial-image display region R. In other words, the camera module 4 is disposed at a position where the light transmitted through the beam splitter 8 after being reflected by the retroreflective material 9 is not shielded and is disposed at a position where the aerial-image display region R can be photographed from a diagonally rear and lower side. When viewed from the left-right direction, an optical axis of the camera module 4 is inclined upward as it moves toward the front side.

In this embodiment, predetermined information can be photographed by the camera module 4 by holding a photographing target 15 (see FIG. 1) such as a medium, a device or the like in which the predetermined information is recorded or displayed to the aerial image displayed in the aerial-image display region R from above. In other words, in this embodiment, the predetermined information can be optically read by the camera module 4 by holding the photographing target 15 in which the predetermined information is recorded or displayed to the aerial image displayed in the aerial-image display region R from above.

For example, a mobile device such as a smartphone on which a two-dimensional code is displayed on the screen is the photographing target 15, and by holding this mobile device to the aerial image displayed in the aerial-image display region R from above, the two-dimensional code displayed on the screen of the mobile device can be optically read by the camera module 4. Alternatively, a medium such as a card with a barcode recorded is the photographing target 15, and by holding this medium to the aerial image displayed in the aerial-image display region R from above, the barcode recorded in the medium can be optically read by the camera module 4. In other words, the input device 1 is a code reader that reads two-dimensional codes and bar codes.

In the input device 1, a PIN can be input as described above. When a PIN is to be input in the input device 1, the display mechanism 6 displays the keypad for inputting the PIN on the display surface 6a, and the aerial-image forming mechanism 7 displays the keypad displayed on the display surface 6a as an aerial image in the aerial-image display region R (see FIG. 3A). The user inputs the PIN by using the keypad displayed in the aerial-image display region R. Specifically, the user inputs the PIN by sequentially moving the fingertip to a position of a predetermined key (number) in the keypad displayed in the aerial-image display region R. In other words, the user inputs the PIN by sequentially moving the fingertip on the input portion 12. The PIN input in the input portion 12 is recognized on the basis of a detection result of the detection mechanism 3 (that is, the detection result of the user's fingertip position).

In addition, in the input device 1, information such as two-dimensional codes can be optically read by the camera module 4, as described above. When information is optically read by the camera module 4, the display mechanism 6 displays on the display surface 6a a frame F for indicating a region where a photographed portion 15a in which the information photographed by the camera module 4 is recorded or displayed (for example, a part in a screen of a mobile device in which a two-dimensional code is displayed or a part in a medium in which a bar code is recorded) is held and a guidance G for prompting the user to hold the photographed portion 15a to the aerial-image display region R and displays the frame F, and the aerial-image forming mechanism 7 displays the frame F and the guidance G displayed on the display surface 6a as an aerial image in the aerial-image display region R, for example (see FIG. 3B). The frame F is, for example, a rectangular frame. The guidance G is, for example, a guidance message, operation instructions or an arrow pointing to the frame F.

When the user holds the photographed portion 15a to the frame F displayed in the aerial-image display region R, the information recorded or displayed in the photographed portion 15a is read by the camera module 4. When the information is read by the camera module 4, the parts in the aerial image displayed in the aerial-image display region R that do not interfere with the reading of the information by the camera module 4 shine. In other words, when the information is read by the camera module 4, the aerial image displayed in the aerial-image display region R serves as illumination that illuminates the photographed portion 15a with light.

Main Effect of This Embodiment

As explained above, in this embodiment, the camera module 4 is disposed on the side where the beam splitter 8 is disposed with respect to the aerial-image display region R and is also disposed at a position where it can photograph the aerial-image display region R, and by holding the photographing target 15 on which the predetermined information is recorded or displayed to the aerial image displayed in the aerial-image display region R from the opposite side of the beam splitter 8, the predetermined information can be optically read by the camera module 4. Therefore, in this embodiment, the predetermined information can be optically read easily.

In this embodiment, when the information is optically read by the camera module 4, the aerial image displayed in the aerial-image display region R serves as illumination that illuminates the photographed portion 15a with light. Thus, in this embodiment, the predetermined information can be read optically by the camera module 4 even if the input device 1 does not include the illumination that illuminates the photographed portion 15a with light. Therefore, in this embodiment, the predetermined information can be optically read with a simple configuration. In addition, in this embodiment, since the camera module 4 is disposed on the side where the beam splitter 8 is disposed with respect to the aerial-image display region R, the space formed between the beam splitter 8 and the aerial-image display region R in order to form an aerial image in the aerial-image display region R can be effectively used as a space for optically reading the information by the camera module 4.

In this embodiment, when the information is optically read by the camera module 4, the frame F for indicating a region to which the photographed portion 15a is to be held is displayed as an aerial image in the aerial-image display region R. Thus, in this embodiment, the user can recognize to which part of the aerial-image display region R the photographed portion 15a is to be held. In addition, in this embodiment, since the guidance G for prompting the user to hold the photographed portion 15a to the aerial-image display region R is displayed as an aerial image in the aerial-image display region R, when the information is to be optically read by the camera module 4, the user can hold the photographed portion 15a in accordance with the guidance G displayed in the aerial-image display region R.

Other Embodiments

The embodiment described above is an example of a preferred embodiment of the present invention, but it is not limiting, and various modifications can be made within a range not changing the gist of the present invention.

In the embodiment described above, information other than the PIN may be input in the input device 1. For example, the user's signature (signature) may be input in the input device 1. In this case, for example, the frame in which the signature is to be input is displayed as an aerial image in the aerial-image display region R. In addition, in the embodiment described above, at least either one of the frame F and the guidance G does not have to be displayed in the aerial-image display region R when the information is to be optically read by the camera module 4. Furthermore, in the embodiment described above, the detection mechanism 3 may be a capacitance sensor or a motion sensor. In addition, the detection mechanism 3 may be constituted by two cameras. Moreover, in the embodiment described above, a user standing behind the input device 1 may input predetermined information on the rear surface side of the input device 1. The above description relates to specific examples according to the present invention, and various modifications are possible without departing from the spirit of the present invention. The appended claims are intended to cover such applications within the true scope and spirit of the invention.

DESCRIPTION OF REFERENCE NUMERALS

• • 1 Input device
  • 3 Detection mechanism
  • 4 Camera module
  • 6 Display mechanism
  • 6a Display surface
  • 7 Aerial-image forming mechanism
  • 8 Beam splitter
  • 9 Retroreflective material
  • 12 Input portion
  • 15a Photographed portion
  • F Frame
  • G Guidance
  • R Aerial-image display region

Claims

1. An input device inputting information using a fingertip of a user, the input device comprising:

a display mechanism having a display surface for displaying an image, an aerial-image forming mechanism which forms an aerial image by projecting an image displayed on the display surface into a space, a detection mechanism which detects the fingertip of the user in an aerial-image display region, which is a region in which the aerial image is displayed, and a camera module disposed at a position where the aerial-image display region is photographed, wherein

the aerial-image display region serves as an input portion for the user to input information;

the aerial-image forming mechanism includes a beam splitter that reflects a part of light emitted from the display surface and a retroreflective material to which the light reflected by the beam splitter is incident and which reflects the incident light in the same direction as a direction of the incidence toward the beam splitter;

the aerial image is formed in the aerial-image display region by light transmitted through the beam splitter after being reflected by the retroreflective material; and

the camera module is disposed on a side where the beam splitter is disposed with respect to the aerial-image display region.

2. The input device according to claim 1, wherein

the display mechanism displays, on the display surface, a frame for indicating a region to which a photographed portion, in which information photographed by the camera module is recorded or displayed, is held; and

the aerial-image forming mechanism displays the frame displayed on the display surface as the aerial image in the aerial-image display region.

3. The input device according to claim 1, wherein

the display mechanism displays a guidance on the display surface for prompting the user to hold a photographed portion, in which information photographed by the camera module is recorded or displayed, to the aerial-image display region, and the aerial-image forming mechanism displays the guidance displayed on the display surface as the aerial image in the aerial-image display region.

4. The input device according to claim 2, wherein

the display mechanism displays on the display surface a guidance for prompting the user to hold a photographed portion, in which information photographed by the camera module is recorded or displayed, to the aerial-image display region, and the aerial-image forming mechanism displays the guidance displayed on the display surface as the aerial image in the aerial-image display region.