INTEGRATED HAPTIC CONTROL APPARATUS AND TOUCH SENSITIVE DISPLAY
The provision of a haptic input with an integrated touch screen input is disclosed. One disclosed embodiment provides a control apparatus for an electronic device. The control apparatus comprises a haptic input mechanism configured to provide haptic feedback responsive to a push input, and an integrated touch sensitive display forming a surface of the haptic input mechanism, wherein the touch sensitive display comprising a touch-sensing mechanism.
Latest Microsoft Patents:
- QUALITY ESTIMATION MODEL FOR PACKET LOSS CONCEALMENT
- RESPONSE-TIME-BASED ORDERING OF FINANCIAL MARKET TRADES
- ROSTER MANAGEMENT ACROSS ORGANIZATIONS
- SYSTEMS AND METHODS FOR DETERMINING SCORES FOR MESSAGES BASED ON ACTIONS OF MESSAGE RECIPIENTS AND A NETWORK GRAPH
- MULTI-MODAL THREE-DIMENSIONAL FACE MODELING AND TRACKING FOR GENERATING EXPRESSIVE AVATARS
This application is a continuation from U.S. Patent Application Ser. No. 12/233,429, entitled “INTEGRATED HAPTIC CONTROL APPARATUS AND TOUCH SENSITIVE DISPLAY”, filed Sep. 18, 2008, the entirety of which is hereby incorporated herein by reference.
BACKGROUNDA variety of control mechanisms may be used to control electronic devices. For example, touch screen inputs allow a user to interact directly with a screen on which commands and/or controls are displayed. Touch screens have been incorporated into an increasing number of electronic devices, which may be due, at least in part, to decreases in manufacturing costs as well as increases in functionality of the touch screen inputs. The touch screen inputs may be configured to provide a variety of layouts having a number of different functions. For example, a touch screen may visually represent and functionally perform actions associated with an application program. Furthermore, a touch screen layout may be quickly adjusted in response to an adjustment of the electronic device, increasing the interactivity and ease of use of the device.
However, touch screen inputs do not provide haptic feedback, such as that provided by directional pads, joysticks and the like. Such haptic feedback may be helpful to enable quick and accurate interaction with a control mechanism, as haptic feedback may allow a user to learn to associate various inputs with specific haptic responses. This may allow the user to operate the control mechanism without visual observation, and to determine the timing of various inputs with more accuracy than with touch screen inputs.
SUMMARYAccordingly, various embodiments related to the provision of haptic feedback with a touch screen input are disclosed. For example, one disclosed embodiment provides a control apparatus for an electronic device. The control apparatus comprises a haptic input mechanism configured to provide haptic feedback responsive to a push input and an integrated touch sensitive display forming a surface of the haptic input mechanism, the touch sensitive display comprising a touch-sensing mechanism.
This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter. Furthermore, the claimed subject matter is not limited to implementations that solve any or all disadvantages noted in any part of this disclosure.
Haptic feedback allows a user of the control apparatus 12 to associate a haptic response with a specific function associated with actuation of the control apparatus 12, allowing for quick and accurate operation. In some examples, the user may operate the control apparatus 12 without visual aid (i.e. direct observation) utilizing haptic feedback as tactile aid.
The control apparatus 12 further comprises an integrated touch sensitive display 16 forming a surface of the haptic input mechanism 14. In one example, as illustrated in
Continuing with
In some configurations, the touch input triggers a first function in the electronic device and the push input triggers a second function in the electronic device. Triggering a function in an electronic device may include sending command signals, implementing commanded actions in an application program executed by the electronic device, activating one or more electronic components, etc.
In one example, the application program is a gaming application program. During operation of the gaming application program, an orbital touch input may control a steering function, while a push input may control a toggle function (e.g. firing of a weapon, actuation of a horn, etc.), a scrolling function, etc. In other examples, the touch and push inputs may trigger the same function.
Returning to
The control apparatus 12 may further include a second display 22 spaced apart from the control apparatus 12. The second display 22 may be used as a primary display to present a game or other interactive content to a user. The second display 22 may be any suitable display, including but not limited to an OLED display, a liquid crystal display (LCD), light emitting diode (LED) display, as well as any of the other displays mentioned above. The second display may be configured to receive data (e.g. image data) from a controller 24, which may comprise a processor and memory containing instructions executable by the processor to perform this and other functions described herein.
It will be appreciated that the second display 22, controller 24, and control apparatus 12, may form a single electronic device sharing a common housing, each component being in electronic communication. For example, the second display 22, controller 24, and control apparatus 12 may be included in a portable electronic device such as a handheld gaming console, portable media player, etc. Likewise, other configurations of these components are possible. For example, each of the electronic components may be separate components having distinct housings, while maintaining electronic communication. Examples of such configurations include, but are not limited to, desktop computing systems, gaming consoles, etc.
Among other functions, the controller 24 may be configured to control the display of indicia on the touch sensitive display 16.
Referring to
In this manner, specific symbols that inform a user of an action invoked by a direction on a directional pad (or other haptic input device) may be displayed for specific application programs used with the control apparatus 12. This may help a user to learn a control layout for the application program more easily than where generic indicia are used to identify actuatable haptic controls, especially where the control apparatus 12 is used to control a wide variety of application programs. In this case, each program may have different actions associated with the haptic input mechanism 14 and the touch sensitive display 16. It may be difficult for the user to keep track of all the actions performed by the control apparatus 12 in many different application programs. Therefore, the displayed indicia and the layout of the displayed indicia may be changed with each application to correspond to the specific actions a particular application program assigns to the control apparatus 12.
As a specific example, referring to
The displayed indicia may be modified in response to any suitable event or occurrence. For example, the displayed indicia may be modified in response to a physical manipulation of the electronic device 10 and/or a change of an application program executed by the electronic device 10. Furthermore, the displayed indicia 28 may be actively updated during a touch or push input. As an example, in a driving video game, the displayed indicia may take the form of a steering wheel that visibly rotates upon input of an orbital touch motion by a user.
Returning to
An exemplary portable electronic device 70 is illustrated in
The multi-directional control mechanism 72 has a plurality of actuatable components 74, each actuatable component configured to provide haptic feedback in response to an input. The portable electronic device 70 also includes a second display 75 configured to display images or objects such as a video game, other audio/video content, etc. While shown in the context of a directional pad, it will be understood that the multi-directional control mechanism 72 may additionally or alternatively include a joystick, one or more buttons, etc. Furthermore, it will be understood that the second display may comprise a haptic feedback mechanism as described herein.
The portable electronic device 70 further comprises a touch sensitive display 76 configured to display one or more indicia 78, forming a surface 79 of the multi-directional control mechanism 72.
The portable electronic device 70 further may include a controller 86 electronically coupled to the multi-directional control mechanism 72 and/or the touch sensitive display 76. Among other functions, the controller 86 may be configured to modify the indicia on the touch sensitive display 76 and modify the functionality of the multi-directional control mechanisms 72 in response to an event such as a physical manipulation of the portable electronic device 70 and/or a change in an application or program executed by the device. In
The touch sensitive display 76 and the multi-directional control mechanism 72 are each configured to receive input from a user, and to provide a control signal to the controller 86 to control an action of an application, such as a game, media player, etc., executed on the portable electronic device. In some applications, the touch sensitive display 76 and the multi-directional control mechanism 72 may be configured to be actuated substantially concurrently and in response to actuation generate a single command signal (i.e. one or ore output signals that are interpreted as a single command by the controller 86), while in other applications the touch sensitive display 76 and multi-directional control mechanism 72 may provide separate control signals even when activated in a temporally overlapping manner (i.e. a plurality of output signals that are interpreted as separate commands by the controller 86).
Continuing with
While
First, at 110, method 100 includes displaying one or more indicia on the touch sensitive display. In one example, each indicium may specify a function of a corresponding actuatable component of the directional pad, as previously discussed. At 112, method 100 further includes receiving a push input via the directional pad. A push input may include depression of the moveable control mechanism, or in other embodiments, an input via a joystick or the like. Next at 114, method 100 includes providing haptic feedback in response to the push input. Such feedback may be a “snap” sensation as a directional actuator on the directional pad is pressed, or may be any other suitable feedback.
Next, as shown at 116, method includes receiving a touch input via a touch sensitive display. Next at 118, the method includes, providing feedback in response to the touch input. Such feedback may be visual and/or aural feedback provided by an application, such as a game or media player, or may be any other suitable feedback.
Next, at 120, the method includes altering the displayed indicia on the touch-sensitive display. The displayed indicia may be altered in response to physical manipulation of the electronic device, at 122. Additionally or alternatively, the displayed indicia may be altered in response to a change in the functionality of the directional pad, at 124. Altering the display indicia may include altering an appearance, location, quantity, and/or functionality of the indicia. Further, the display indicia may be altered in response to a change of an application program associated with the control apparatus. In one example, the indicia may be altered in response to start up of an application. Further still, the displayed indicia may be altered in response to physical manipulation of the device.
Additionally, in some embodiments, the method 100 may include generating a first command signal and a second command signal in response to substantially concurrent touch inputs. Alternatively, in other embodiments, the method 100 may include generating a single command signal in response to substantially concurrent touch and push inputs, as described above. Further still, in other embodiments the method may include, generating a first command signal and a second command signal in response to asynchronous touch and push inputs.
The embodiments described herein may be implemented to enable a user to efficiently and accurately operate an electronic device. Further, the above systems and methods allow for a haptic control apparatus for an electronic device to be adapted such that the control apparatus can display indicia specifically tailored to inform a user the exact function assigned to the directions of a haptic directional control apparatus. This is in contrast to other directional pads, joysticks, etc., that may use static, generic labeling to signify the actuatable directions of the controller.
It will be understood that the embodiments described herein are exemplary in nature, and that these specific embodiments or examples are not to be considered in a limiting sense, because numerous variations are contemplated. Accordingly, the present disclosure includes all novel and non-obvious combinations and sub-combinations of the various systems and methods disclosed herein, as well as any and all equivalents thereof.
Claims
1. A control apparatus comprising:
- a display configured to receive touch input;
- a haptic mechanism underlying the display, the haptic mechanism operable to provide haptic feedback in response to a touch input; and
- a controller configured to: display on the display a first indicia indicative of a first function associated with a first application program, and display on the display a second indicia indicative of a second function associated with a second application program.
2. The control apparatus of claim 1 wherein the haptic mechanism comprises multiple, independently-operable haptic elements.
3. The control apparatus of claim 1 wherein the haptic mechanism comprises a surface area that is substantially equivalent to a surface area of the display.
4. The control apparatus of claim 1, wherein the control apparatus comprises a handheld video game controller.
5. The control apparatus of claim 1, wherein the controller is further configured to change from displaying the first indicia to displaying the second indicia when an application program being controlled changes from the first application program to the second application program.
6. The control apparatus of claim 1, wherein the controller is configured to communicate with an external computing system and wherein the first application program and the second application program are executed by the external computing system.
7. The control apparatus of claim 6, wherein the external computing system comprises a game console.
8. The control apparatus of claim 1, wherein the controller is further configured to modify a displayed indicia in response to a change of a specific function associated with the first application program from a first specific function to a second specific function.
9. A control apparatus comprising:
- a haptic mechanism operable to provide haptic feedback responsive to a touch input;
- an integrated display configured to receive the touch input; and
- a controller configured to: display an indicia on the integrated display, the indicia indicating a specific function associated with an application program, modify a displayed indicia displayed on the integrated display in response to a change of the specific function associated with the application program, receive a user input based on the touch input; and send a command signal to the application program.
10. The control apparatus of claim 9, wherein the control apparatus is further configured to provide a haptic output in response to the touch input.
11. The control apparatus of claim 9, wherein the haptic mechanism comprises multiple, independently operable haptic elements.
12. The control apparatus of claim 9, wherein the control apparatus comprises a handheld video game controller.
13. The control apparatus of claim 9, wherein the application program is a first application program, and wherein the controller is further configured to modify the displayed indicia when an application program being controlled changes from the first application program to a second application program.
14. The control apparatus of claim 9, wherein the controller is configured to communicate with an external computing system and wherein the application program is executed by the external computing system.
15. The control apparatus of claim 14, wherein the external computing system comprises a game console.
16. A method of operating a control apparatus comprising a display configured to receive input and an underlying haptic mechanism, the method comprising:
- displaying an indicia on the display, the indicia indicating a specific function associated with an application program;
- modifying a displayed indicia displayed on the display in response to a change in one or more of an application program controlled by the control apparatus and a specific function associated with the application program controlled by the control apparatus;
- receiving a touch input;
- providing haptic feedback for the touch input; and
- sending a command signal to the application program.
17. The method of claim 16, wherein sending the command signal to the application program comprises sending the command signal to an application program executed on a device remote from the control apparatus.
18. The method of claim 16, wherein sending the command signal to the application program comprises sending the command signal to a video game console.
19. The method of claim 16, wherein the control apparatus comprises multiple independently-operable haptic elements, and wherein providing haptic feedback comprises providing haptic feedback via a selected independently-operable haptic element.
20. The method of claim 16, wherein providing haptic feedback comprises providing feedback from a directional actuator.
Type: Application
Filed: Feb 25, 2014
Publication Date: Jun 26, 2014
Applicant: Microsoft Corporation (Redmond, WA)
Inventor: Paolo Malabuyo (San Mateo, CA)
Application Number: 14/189,715
International Classification: G06F 3/01 (20060101); G06F 3/041 (20060101);