Apparatus and method for manipulating a touch-sensitive display panel
The present invention enables to easily perform a graphic processing even when a touch panel is used. When a resistance film unit is pressed with a pen or a finger, output voltages associated with the X coordinate and the Y coordinate position are changed and these output voltages are transmitted as the X coordinate data and the Y coordinate data to a touch panel driver. According to the output from the resistance film unit, the touch panel driver generates an event for supply to a GUI handler. The touch panel driver includes a two-point specification detector which detects two point specifications and causes to calculate coordinates of the two points. The GUI handler generates a message corresponding to the GUI according to the event and supplies the message to an application. The GUI handler includes a processing mode modification block which differently interprets the event when a single point is specified and when two points are specified, thereby modifying the graphic processing mode.
Latest Sony Corporation Patents:
- INFORMATION PROCESSING APPARATUS FOR RESPONDING TO FINGER AND HAND OPERATION INPUTS
- Adaptive mode selection for point cloud compression
- Electronic devices, method of transmitting data block, method of determining contents of transmission signal, and transmission/reception system
- Battery pack and electronic device
- Control device and control method for adjustment of vehicle device
Notice: More than one reissue application has been filed for the reissue of U.S. Pat. No. 6,958,749. The reissue applications are application Ser. Nos. 12/412,806 (the present application) and 11/862,943 (the Parent reissue application) filed Sep. 27, 2007, all of which are divisional reissues of U.S. Pat. No. 6,958,749.
BACKGROUND OF THE INVENTION1. Field of the Invention
The present invention relates to a graphic processing apparatus and in particular to an apparatus capable of easily performing graphic processing even when a touch panel is used.
2. Description of the Prior Art
With increase of the computer performance and the technique to reduce the size, various portable computers (personal digital assist, PDA) are now widely used. Most of the conventional PDA employs an interface for performing almost all the operations with a single pen. This is based on the metaphor of a notebook and a pencil.
By the way, a graphic operation is widely performed using a graphic creation software through operation of a keyboard and a mouse. When such a graphic edition operation is to be performed on the aforementioned PDA touch panel using a pen or finger, only one point on the panel can be specified and it is necessary to repeatedly perform a complicated processing. For example, an operation type (such as move) is selected through a menu and a graphic object is moved with the pen. This should be repeated for edition, requiring a complicated process.
Recently, as disclosed in Japanese Patent Publication 9-34625, a technique to simultaneously push two points on the touch panel has been suggested. It is known that this technique is used in the touch panel, in the same way as on a keyboard, for example, an operation combining the Shift key and an alphabet key.
SUMMARY OF THE INVENTIONIt is therefore an object of the present invention to provide an apparatus capable of easily performing a graphic processing on the touch panel using the technique to simultaneously enter two points on the touch panel.
That is, the present invention provides a graphic processing apparatus including: a touch panel; means for deciding whether a single point or two points are specified on the touch panel; means for performing a graphic processing in a first graphic processing mode when the single point is specified; and means for performing a graphic processing in a second graphic processing mode when the two points are specified.
With this configuration, it is possible to select a graphic processing mode according to the number of points specified and accordingly, it is possible to select a predetermined graphic processing with a small number of operation steps. For example, when a single point is specified, a graphic object is moved and a segment is drawn on point basis and when two points are specified, it is possible to perform edition such as enlargement, reduction, and rotation. In this case, the edition types may be identified by the moving state of the specified position. For example, when a first point is fixed and a second point is moved apart from the first point, enlargement or reduction is performed in this direction and rotation is performed around the fixed point.
Moreover, the present invention provides a portable computer including: a frame which can be grasped by a user's hand; a touch panel formed on the upper surface of the frame; detection means for detecting specification of a predetermined area on the touch panel in the vicinity of a region where a user's thumb is positioned when he/she grasps the portable computer; interpretation means for interpreting another point specification on the touch panel in a corresponding interpretation mode according to a detection output from the detection means while the predetermined area is specified; and execution means for executing a predetermined processing according to a result of the interpretation.
With this configuration, it is possible to specify a point on the touch panel with a pen or a finger and to specify a predetermined area on the touch panel using a thumb of the hand grasping the portable computer body. In the conventional example, one hand is used for grasping a portable terminal and the other hand is used to specify a position on the touch panel. In the present invention, the thumb which has not been used conventionally can be used to select a menu and an operation mode.
Furthermore, the present invention provides a coordinate position input apparatus including: a touch panel for outputting a coordinate data of a middle point when two points are simultaneously touched; storage means for retaining coordinate position of the two points detected previously; detection means for detecting a coordinate position of a current middle point; and calculation means for calculating a coordinate of one of the two touch points assumed to be a moving point by subtracting a coordinate position of a previous fixed point from a current middle point coordinate multiplied by 2.
With this configuration, by employing a user interface to assume one of the two touch points fixed, it is possible to easily and correctly calculate a coordinate position even when one of the two touch points is moved.
It should be noted that at least a part of the present invention can be realized as a computer software, and can be implemented as a computer program package (recording medium).
Description will now be directed to a preferred embodiment of the present invention with reference to the attached drawings.
The application 6 includes a database application for managing an individual information, a mail application, a browser, an image creation application, and the like. The application 6 can be selected through a menu and some of the application 6 such as the mail application may be selected by a push button (mechanical component). The application 6 creates a message related to display and supplies the message to the GUI handler 5. Upon reception of this message, the GUI handler 5 creates a display image information and transfers it to the display driver 4. The display driver 4, according to the display data, drives the liquid crystal display unit 7 to display information for the user.
When the resistance film unit 8 is pressed by a pen or a finger, output voltages associated with a coordinate X and coordinate Y are changed and these output voltages are transmitted as X coordinate data and Y coordinate data to the touch panel driver 3. The touch panel driver 3, according to the outputs from the resistance film unit 8, generates an event including information such as a touch panel depression, depression release, finger position, and the like and supplies the event to the GUI handler 5. The GUI handler 5, according to the event, generates a message corresponding to the GUI and supplies it to the application 6.
Thus, an even can be generated when a single point is specified and when two points are specified.
As has been described above, the processing mode can be switched between the move mode and the rotation mode depending oh whether a single point or two points are pressed on the touch panel 2. Thus, a graphic object can easily be operated. It should be noted that the mode can be switched by specifying three positions.
Next, explanation will be given on a modified example of the aforementioned embodiment.
It should be noted that while explanation has been given on the enlarge/reduce button in
Next, explanation will be given on another modified example of the aforementioned embodiment.
Next, explanation will be given on the two-point specification detection and the coordinate data calculation in the aforementioned embodiment.
In
Next, in state S35 (two-point mode), the movement is monitored to determine whether the movement distance is within the threshold value (S36, S37). If within the threshold value, the two-point mode is identified. As has been described above, it is determined in advance which of the touch points is moved for each GUI. As shown in
As has been described above, in this embodiment of the present invention, the graphic processing can easily be performed with a small number of operations even when using a touch panel. Moreover, a user can use his/her thumb for input operation instead of grasping the portable computer. Moreover, even when two points are simultaneously touched, the user interface can be set so that one of the two points is fixed while the other point movement coordinate can easily be calculated. This significantly simplifies a command creation by a coordinate movement.
As has been described above, according to the present invention, it is possible to easily perform a graphic processing even when using a touch panel. Moreover, the thumb of the hand grasping the portable computer body can be used as input means. Moreover, even in the case of a pressure-sensitive (resistance film type) touch panel, it is possible to detect a movement of one of the two points touched, thereby enabling to create a command by two-point touch movement.
Claims
1. A coordinate position input apparatus comprising: a touch panel for outputting a coordinate data of a middle point when two points are simultaneously touched; storage means for retaining coordinate position of the two points detected previously; detection means for detecting a coordinate position of a current middle point; and calculation means for calculating a coordinate of one of the two touch points assumed to be a moving point by subtracting a coordinate position of a previous fixed point from a current middle point coordinate multiplied by 2.
2. The coordinate input apparatus as claimed in claim 1, wherein when a second point is touched while a first point is touched, the touch point of the second point is calculated according to a current middle point coordinate position and a previous first point touch position coordinate position.
3. A hand-held portable computer comprising:
- a touch-sensitive display panel; and
- a processing apparatus, coupled to the touch-sensitive display panel, wherein the processing apparatus: (a) executes a graphical processing application; (b) determines a threshold movement distance value; (c) detects a first point contacted on a surface of the touch-sensitive display panel, wherein the first point corresponds to a graphic object; (d) determines a value of a movement distance of the first point contacted; (e) if the determined value of the movement distance of the first point contacted is less than the threshold movement distance value, executes a first processing mode in the graphical processing application, said first processing mode being executed independent of any detection of any additional point contacted on the surface of the touch-sensitive display; (f) if the determined value of the movement distance of the first point contacted exceeds the threshold movement distance value, determines that a second point is contacted on the surface of the touch-sensitive display panel in addition to the contacted first point, wherein the second point corresponds to the graphic object; and (g) in response to the determination that the second point is contacted in addition to the contacted first point, executes a second, different processing mode in the graphical processing application.
4. The hand-held portable computer of claim 3, wherein the first and second processing modes perform at least one of enlargement, reduction, and rotation.
5. A hand-held portable computer comprising:
- a touch-sensitive display panel; and
- a processing apparatus, coupled to the touch-sensitive display panel, wherein the processing apparatus: (a) executes a graphical processing application; (b) communicates with the touch-sensitive display panel to display a plurality of selection items and a graphic object on the touch panel; (c) determines a threshold movement distance value; (d) detects a first point contacted on a surface of the touch-sensitive display panel that corresponds to one of the plurality of selection items; (e) determines a value of a movement distance of the first point contacted; (f) if the determined value of the movement distance of the first point contacted is less than the threshold movement distance value, executes a first processing mode in the graphical processing application; (g) if the determined value of the movement distance of the first point contacted exceeds the threshold movement distance value, determines that a second point is contacted on the surface of the display panel in addition to the contacted first point, wherein the second point corresponds to a graphic object; and (h) in response to the determination that the second point is contacted in addition to the contacted first point, executes a second, different processing mode in the graphical processing application.
6. A hand-held portable information processing apparatus, comprising:
- a touch-sensitive display panel; and
- a processing apparatus, coupled to the touch-sensitive display panel, wherein the processing apparatus (a) executes a graphical processing application; (b) determines a threshold movement distance value; (c) detects a first point contacted on the surface of the touch-sensitive display panel; (d) determines a value of a movement distance of the first point contacted; (e) if the determined value of the movement distance of the first point contacted is less than the threshold movement distance value, executes a first process in the graphical processing application, wherein the first point corresponds to a graphic object indicative of the first process; (f) if the determined value of the movement distance of the first point contacted exceeds the threshold movement distance value, determines that a second point is contacted on the surface of the touch-sensitive display panel in addition to the contacted first point; and (g) in response to the determination that the second point is contacted in addition to the contacted first point, executes a second, different process in the graphical processing application.
7. The hand-held portable information processing apparatus of claim 6, wherein the first process relates to moving a predetermined object along a trace associated with the detected first point.
8. The hand-held portable information processing apparatus of claim 6, wherein the second process performs at least one of enlargement, reduction, and rotation.
9. The hand-held portable information processing apparatus of claim 6, wherein the first process comprises shifting from a first operation mode to a second operation mode.
10. The hand-held portable information processing apparatus of claim 9, wherein the second process comprises an operation indicated on the touch-sensitive display panel as a result of execution of the first operation mode to a second operation mode.
11. A method of operating a portable information processing apparatus, wherein the portable information processing apparatus includes a touch-sensitive display panel, the method comprising:
- executing a graphical processing application;
- determining a threshold movement distance value;
- detecting a first touch point being contacted on the surface of the touch-sensitive display panel;
- determining a value of a movement distance of the first point contacted;
- if the determined value of the movement distance of the first point contacted is less than the threshold movement distance value, executing a first process in the graphical processing application;
- if the determined value of the movement distance of the first point contacted exceeds the threshold movement distance value, determining that a second touch point is contacted on the surface of the touch-sensitive display panel in addition to the contacted first point, wherein the second touch point corresponds to a graphic object; and
- in response to the determination that the second touch point is contacted in addition to the contacted first touch point, executing a second, different process in the graphical processing application, and wherein execution of the second process is dependent on execution of the first process.
12. The method of claim 11, wherein the first process comprises shifting from a first operation mode to a second operation mode.
13. The method of claim 12, wherein the second process comprises an operation indicated on the display panel as a result of execution of the first operation mode to a second operation mode.
14. The hand-held portable computer of claim 3, wherein the graphic object is rotated around the first point contacted on the surface of the touch-sensitive display panel in the second processing mode.
4703316 | October 27, 1987 | Sherbeck |
4758690 | July 19, 1988 | Kimura |
4914624 | April 3, 1990 | Dunthorn |
5016008 | May 14, 1991 | Gruaz et al. |
5241139 | August 31, 1993 | Gungl et al. |
5345543 | September 6, 1994 | Capps et al. |
5483261 | January 9, 1996 | Yasutake |
5500935 | March 19, 1996 | Moran et al. |
5563632 | October 8, 1996 | Roberts |
5638093 | June 10, 1997 | Takahashi et al. |
5670987 | September 23, 1997 | Doi et al. |
5796406 | August 18, 1998 | Shigematsu et al. |
5821930 | October 13, 1998 | Hansen |
5825352 | October 20, 1998 | Bisset et al. |
5844547 | December 1, 1998 | Minakuchi et al. |
5861886 | January 19, 1999 | Moran et al. |
5880743 | March 9, 1999 | Moran et al. |
5943043 | August 24, 1999 | Furuhata et al. |
6008800 | December 28, 1999 | Pryor |
6034672 | March 7, 2000 | Gaultier et al. |
6255604 | July 3, 2001 | Tokioka et al. |
6323847 | November 27, 2001 | Kaneko et al. |
6347290 | February 12, 2002 | Bartlett |
6392638 | May 21, 2002 | Hanajima et al. |
6400376 | June 4, 2002 | Singh et al. |
6414671 | July 2, 2002 | Gillespie et al. |
6421042 | July 16, 2002 | Omura et al. |
6466198 | October 15, 2002 | Feinstein |
6518960 | February 11, 2003 | Omura et al. |
6597347 | July 22, 2003 | Yasutake |
7345675 | March 18, 2008 | Minakuchi et al. |
07-230352 | August 1995 | JP |
08-054976 | February 1996 | JP |
09-034625 | February 1997 | JP |
09-034626 | February 1997 | JP |
2000-163193 | June 2000 | JP |
- Office Action dated Oct. 30, 2008 for U.S. Appl. No. 11/862,943.
Type: Grant
Filed: Mar 27, 2009
Date of Patent: Jun 4, 2013
Assignee: Sony Corporation (Tokyo)
Inventors: Nobuyuki Matsushita (Kanagawa), Yuji Ayatsuka (Tokyo), Junichi Rekimoto (Kanagawa)
Primary Examiner: M Good Johnson
Application Number: 12/412,806
International Classification: G09G 5/00 (20060101);