Audio Feedback

Audio feedback techniques are described. In one or more implementations, a signal is received from a pressure sensitive key of an input device and audio feedback is determined, from the signal, which is to be output as corresponding to the pressure sensitive key. The determined audio feedback is then caused to be output.

Skip to: Description  ·  Claims  · Patent History  ·  Patent History
Description
RELATED APPLICATIONS

This application claims priority under 35 U.S.C. Section 119(e) to U.S. Provisional Patent Application No. 61/646,799, filed May 14, 2012, the disclosure of which is hereby incorporated by reference in its entirety, this application also incorporates the following applications by reference in their entirety: U.S. patent application Ser. No. 13/470,633, filed May 14, 2012, Attorney Docket Number 336554.01, and titled “Flexible Hinge and Removable Attachment;” and U.S. patent application Ser. No. 13/471,186, filed May 14, 2012, Attorney Docket Number 336563.01, and titled “Input Device Layers and Nesting.”

BACKGROUND

Mobile computing devices have been developed to increase the functionality that is made available to users in a mobile setting. For example, a user may interact with a mobile phone, tablet computer, or other mobile computing device to check email, surf the web, compose texts, interact with applications, and so on. However, traditional mobile computing devices often employed a virtual keyboard that was accessed using touchscreen functionality of the device. This was generally employed to maximize an amount of display area of the computing device.

Use of the virtual keyboard, however, could be frustrating to a user that desired to provide a significant amount of inputs, such as to enter a significant amount of text to compose a long email, document, and so forth. Thus, conventional mobile computing devices were often perceived to have limited usefulness for such tasks, especially in comparison with ease at which users could enter text using a conventional keyboard, e.g., of a conventional desktop computer. Use of the conventional keyboards, though, with the mobile computing device could decrease the mobility of the mobile computing device and thus could make the mobile computing device less suited for its intended use in mobile settings.

SUMMARY

Audio feedback techniques are described. In one or more implementations, a signal is received from a pressure sensitive key of an input device and audio feedback is determined, from the signal, which is to be output as corresponding to the pressure sensitive key. The determined audio feedback is then caused to be output.

In one or more implementations, a keyboard comprises a plurality of keys, each configured to be selected using one or more fingers of a user's hand and to cause output of audio feedback responsive to the selection, the output of the audio feedback configured to appear to the user as originating from a location of a respective key.

In one or more implementations, a system comprises one or more modules implemented at least partially in hardware and configured to cause output of audio feedback that is determined based on a location at which a key of a keyboard is pressed.

This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.

BRIEF DESCRIPTION OF THE DRAWINGS

The detailed description is described with reference to the accompanying figures. In the figures, the left-most digit(s) of a reference number identifies the figure in which the reference number first appears. The use of the same reference numbers in different instances in the description and the figures may indicate similar or identical items. Entities represented in the figures may be indicative of one or more entities and thus reference may be made interchangeably to single or plural forms of the entities in the discussion.

FIG. 1 is an illustration of an environment in an example implementation that is operable to employ the techniques described herein.

FIG. 2 depicts an example implementation of an input device of FIG. 1 as showing a flexible hinge in greater detail.

FIG. 3 depicts an example implementation showing a perspective view of a connecting portion of FIG. 2 that includes mechanical coupling protrusions and a plurality of communication contacts.

FIG. 4 depicts an example of a cross-sectional view of a pressure sensitive key of a keyboard of the input device of FIG. 2.

FIG. 5 depicts an example of a pressure sensitive key of FIG. 4 as having pressure applied at a first location of a flexible contact layer to cause contact with a corresponding first location of a sensor substrate.

FIG. 6 depicts an example of the pressure sensitive key of FIG. 4 as having pressure applied at a second location of the flexible contact layer to cause contact with a corresponding second location of the sensor substrate.

FIG. 7 depicts an example of the input device and computing device of FIG. 1 as leveraging an audio feedback module.

FIG. 8 depicts an example of FIG. 8 depicts an example implementation showing one of more fingers of a user's hands as interacting with an input device of FIG. 2, thereby initiating output of audio feedback.

FIG. 9 depicts an example of showing presses at different locations of a key that may be used to cause output of different audio feedback.

FIG. 10 is a flow diagram depicting a procedure in an example implementation in which a determination is made as to which audio feedback is to be output responsive to receipt of a signal from a pressure sensitive key.

FIG. 11 illustrates an example system including various components of an example device that can be implemented as any type of computing device as described with reference to FIGS. 1-10 to implement embodiments of the techniques described herein.

DETAILED DESCRIPTION Overview

Input devices used by a mobile device may be difficult to interact with due to compromises made in configuring the input device to support the mobile form factor of the device. For example, pressure sensitive keys may be used as part of an input device to support a relatively thin form factor, such as approximately less than three and a half millimeters. However, pressure sensitive keys may not provide a degree of feedback that is common with conventional mechanical keyboards and therefore may result in missed hits and partial hits to intended keys of the keyboard. In another example, a virtual keyboard that is displayed by a display device of the computing device may have similar difficulties.

Audio feedback techniques are described. These techniques may be used to provide audio feedback responsive to user interaction with an input device. For example, these techniques may be used to output different sounds for different keys, sounds dependent on where a key is pressed, sounds that appear to originate from a key that is being pressed, adjustment based on environment, adjustment based on how hard the key is pressed (e.g., timbre, volume), support themes that are user selectable for different sounds, provide audio feedback to indicate when one or more fingers of the user's hand are positioned at a home row of a keyboard, and so on. Thus, the audio feedback techniques may support a variety of functionality for a variety of different input device, such as pressure sensitive keyboards, virtual keyboards, mechanically switched keyboards, and other input devices, further discussion of which may be found in relation to the following figures.

In the following discussion, an example environment is first described that may employ the techniques described herein. Example procedures are then described which may be performed in the example environment as well as other environments. Consequently, performance of the example procedures is not limited to the example environment and the example environment is not limited to performance of the example procedures.

Example Environment

FIG. 1 is an illustration of an environment 100 in an example implementation that is operable to employ the techniques described herein. The illustrated environment 100 includes an example of a computing device 102 that is physically and communicatively coupled to an input device 104 via a flexible hinge 106. The computing device 102 may be configured in a variety of ways. For example, the computing device 102 may be configured for mobile use, such as a mobile phone, a tablet computer as illustrated, and so on. Thus, the computing device 102 may range from full resource devices with substantial memory and processor resources to a low-resource device with limited memory and/or processing resources. The computing device 102 may also relate to software that causes the computing device 102 to perform one or more operations.

The computing device 102, for instance, is illustrated as including an input/output module 108. The input/output module 108 is representative of functionality relating to processing of inputs and rendering outputs of the computing device 102. A variety of different inputs may be processed by the input/output module 108, such as inputs relating to functions that correspond to keys of the input device 104, keys of a virtual keyboard displayed by the display device 110 to identify gestures and cause operations to be performed that correspond to the gestures that may be recognized through the input device 104 and/or touchscreen functionality of the display device 110, and so forth. Other input devices are also contemplated, such as a mouse, track pad, camera to detect gestures, and so on. Thus, the input/output module 108 may support a variety of different input techniques by recognizing and leveraging a division between types of inputs including key presses, gestures, and so on.

In the illustrated example, the input device 104 is configured as a keyboard having a QWERTY arrangement of keys although other arrangements of keys are also contemplated. Further, other non-conventional configurations are also contemplated, such as a game controller, configuration to mimic a musical instrument, and so forth. Thus, the input device 104 and keys incorporated by the input device 104 may assume a variety of different configurations to support a variety of different functionality.

As previously described, the input device 104 is physically and communicatively coupled to the computing device 102 in this example through use of a flexible hinge 106. The flexible hinge 106 is flexible in that rotational movement supported by the hinge is achieved through flexing (e.g., bending) of the material forming the hinge as opposed to mechanical rotation as supported by a pin, although that embodiment is also contemplated. Further, this flexible rotation may be configured to support movement in one direction (e.g., vertically in the figure) yet restrict movement in other directions, such as lateral movement of the input device 104 in relation to the computing device 102. This may be used to support consistent alignment of the input device 104 in relation to the computing device 102, such as to align sensors used to change power states, application states, and so on.

The flexible hinge 106, for instance, may be formed using one or more layers of fabric and include conductors formed as flexible traces to communicatively couple the input device 104 to the computing device 102 and vice versa. This communication, for instance, may be used to communicate a result of a key press to the computing device 102, receive power from the computing device, perform authentication, provide supplemental power to the computing device 102, and so on. The flexible hinge 106 may be configured in a variety of ways, further discussion of which may be found in relation to the following figure.

FIG. 2 depicts an example implementation 200 of the input device 104 of FIG. 1 as showing the flexible hinge 106 in greater detail. In this example, a connection portion 202 of the input device is shown that is configured to provide a communicative and physical connection between the input device 104 and the computing device 102. In this example, the connection portion 202 has a height and cross section configured to be received in a channel in the housing of the computing device 102, although this arrangement may also be reversed without departing from the spirit and scope thereof.

The connection portion 202 is flexibly connected to a portion of the input device 104 that includes the keys through use of the flexible hinge 106. Thus, when the connection portion 202 is physically connected to the computing device the combination of the connection portion 202 and the flexible hinge 106 supports movement of the input device 104 in relation to the computing device 102 that is similar to a hinge of a book.

For example, rotational movement may be supported by the flexible hinge 106 such that the input device 104 may be placed against the display device 110 of the computing device 102 and thereby act as a cover. The input device 104 may also be rotated so as to be disposed against a back of the computing device 102, e.g., against a rear housing of the computing device 102 that is disposed opposite the display device 110 on the computing device 102.

Naturally, a variety of other orientations are also supported. For instance, the computing device 102 and input device 104 may assume an arrangement such that both are laid flat against a surface as shown in FIG. 1. In another instance, a typing arrangement may be supported in which the input device 104 is laid flat against a surface and the computing device 102 is disposed at an angle to permit viewing of the display device 110, e.g., such as through use of a kickstand disposed on a rear surface of the computing device 102. Other instances are also contemplated, such as a tripod arrangement, meeting arrangement, presentation arrangement, and so forth.

The connecting portion 202 is illustrated in this example as including magnetic coupling devices 204, 206, mechanical coupling protrusions 208, 210, and a plurality of communication contacts 212. The magnetic coupling devices 204, 206 are configured to magnetically couple to complementary magnetic coupling devices of the computing device 102 through use of one or more magnets. In this way, the input device 104 may be physically secured to the computing device 102 through use of magnetic attraction.

The connecting portion 202 also includes mechanical coupling protrusions 208, 210 to form a mechanical physical connection between the input device 104 and the computing device 102. The mechanical coupling protrusions 208, 210 are shown in greater detail in the following figure.

FIG. 3 depicts an example implementation 300 shown a perspective view of the connecting portion 202 of FIG. 2 that includes the mechanical coupling protrusions 208, 210 and the plurality of communication contacts 212. As illustrated, the mechanical coupling protrusions 208, 210 are configured to extend away from a surface of the connecting portion 202, which in this case is perpendicular although other angles are also contemplated.

The mechanical coupling protrusions 208, 210 are configured to be received within complimentary cavities within the channel of the computing device 102. When so received, the mechanical coupling protrusions 208, 210 promote a mechanical binding between the devices when forces are applied that are not aligned with an axis that is defined as correspond to the height of the protrusions and the depth of the cavity.

For example, when a force is applied that does coincide with the longitudinal axis described previously that follows the height of the protrusions and the depth of the cavities, a user overcomes the force applied by the magnets solely to separate the input device 104 from the computing device 102. However, at other angles the mechanical coupling protrusion 208, 210 are configured to mechanically bind within the cavities, thereby creating a force to resist removal of the input device 104 from the computing device 102 in addition to the magnetic force of the magnetic coupling devices 204, 206. In this way, the mechanical coupling protrusions 208, 210 may bias the removal of the input device 104 from the computing device 102 to mimic tearing a page from a book and restrict other attempts to separate the devices.

The connecting portion 202 is also illustrated as including a plurality of communication contacts 212. The plurality of communication contacts 212 is configured to contact corresponding communication contacts of the computing device 102 to form a communicative coupling between the devices. The communication contacts 212 may be configured in a variety of ways, such as through formation using a plurality of spring loaded pins that are configured to provide a consistent communication contact between the input device 104 and the computing device 102. Therefore, the communication contact may be configured to remain during minor movement of jostling of the devices. A variety of other examples are also contemplated, including placement of the pins on the computing device 102 and contacts on the input device 104.

FIG. 4 depicts an example of a cross-sectional view of a pressure sensitive key 400 of a keyboard of the input device 104 of FIG. 2. The pressure sensitive key 400 in this example is illustrated as being formed using a flexible contact layer 402 (e.g., Mylar) that is spaced apart from the sensor substrate 404 using a spacer layer 406, 408, which may be formed as another layer of Mylar or other bendable material, formed on the sensor substrate 404, and so on. In this example, the flexible contact layer 402 does not contact the sensor substrate 404 absent application of pressure against the flexible contact layer 402.

The flexible contact layer 402 in this example includes a force sensitive ink 410 disposed on a surface of the flexible contact layer 402 that is configured to contact the sensor substrate 404. The force sensitive ink 410 is configured such that an amount of resistance of the ink varies directly in relation to an amount of pressure applied. The force sensitive ink 410, for instance, may be configured with a relatively rough surface that is compressed against the sensor substrate 404 upon an application of pressure against the flexible contact layer 402. The greater the amount of pressure, the more the force sensitive ink 410 is compressed, thereby increasing conductivity and decreasing resistance of the force sensitive ink 410. Other conductors may also be disposed on the flexible contact layer 402 without departing from the spirit and scope therefore, including other types of pressure sensitive and non-pressure sensitive conductors.

The sensor substrate 404 includes one or more conductors 412 disposed thereon that are configured to be contacted by the force sensitive ink 410 of the flexible contact layer 402. When contacted, an analog signal may be generated for processing by the input device 104 and/or the computing device 102, e.g., to recognize whether the signal is likely intended by a user to provide an input for the computing device 102. A variety of different types of conductors 412 may be disposed on the sensor substrate 404, such as formed from a variety of conductive materials (e.g., silver, copper), disposed in a variety of different configurations such as inter-digitated trace fingers, and so on.

FIG. 5 depicts an example 500 of the pressure sensitive key 400 of FIG. 4 as having pressure applied at a first location of the flexible contact layer 402 to cause contact of the force sensitive ink 410 with a corresponding first location of the sensor substrate 404. The pressure is illustrated through use of an arrow in FIG. 5 and may be applied in a variety of ways, such as by a finger of a user's hand, stylus, pen, and so on. In this example, the first location at which pressure is applied as indicated by the arrow is located generally near a center region of the flexible contact layer 402 that is disposed between the spacer layers 406, 408. Due to this location, the flexible contact layer 402 may be considered generally flexible and thus responsive to the pressure.

This flexibility permits a relatively large area of the flexible contact layer 402, and thus the force sensitive ink 410, to contact the conductors 412 of the sensor substrate 404. Thus, a relatively strong signal may be generated. Further, because the flexibility of the flexible contact layer 402 is relatively high at this location, a relatively large amount of the force may be transferred through the flexible contact layer 402, thereby applying this pressure to the force sensitive ink 410. As previously described, this increase in pressure may cause a corresponding increase in conductivity of the force sensitive ink and decrease in resistance of the ink. Thus, the relatively high amount of flexibility of the flexible contact layer at the first location may cause a relatively stronger signal to be generated in comparison with other locations of the flexible contact layer 402 that are located closer to an edge of the key, an example of which is described in relation to the following figure.

FIG. 6 depicts an example 600 of the pressure sensitive key 400 of FIG. 4 as having pressure applied at a second location of the flexible contact layer 402 to cause contact with a corresponding second location of the sensor substrate 404. In this example, the second location of FIG. 6 at which pressure is applied is located closer to an edge of the pressure sensitive key (e.g., closer to an edge of the spacer layer 406) than the first location of FIG. 5. Due to this location, the flexible contact layer 402 has reduced flexibility when compared with the first location and thus less responsive to pressure.

This reduced flexibility may cause a reduction in an area of the flexible contact layer 402, and thus the force sensitive ink 410, that contacts the conductors 412 of the sensor substrate 404. Thus, a signal produced at the second location may be weaker than a signal produced at the first location of FIG. 5.

Further, because the flexibility of the flexible contact layer 402 is relatively low at this location, a relatively low amount of the force may be transferred through the flexible contact layer 402, thereby reducing the amount of pressure transmitted to the force sensitive ink 410. As previously described, this decrease in pressure may cause a corresponding decrease in conductivity of the force sensitive ink and increase in resistance of the ink in comparison with the first location of FIG. 5. Thus, the reduced flexibility of the flexible contact layer 402 at the second location in comparison with the first location may cause a relatively weaker signal to be generated. Further, this situation may be exacerbated by a partial hit in which a smaller portion of the user's finger is able to apply pressure at the second location of FIG. 6 in comparison with the first location of FIG. 5.

However, as previously described techniques may be employed to provide feedback and thus promote consistency of the contact of the flexible contact layer 402 with the sensor substrate 404 as well as other features, further discussion of which may be found in relation to the following section.

Example Audio Feedback

FIG. 7 depicts an example 700 of the input device 104 and computing device 102 as leveraging an audio feedback module 702. The audio feedback module 702 is representative of functionality to provide audio feedback responsive to user interface with a device, e.g., the computing device 102 and/or the input device 104. Although the audio feedback module 702 is illustrated as part of the input device, the functionality of the audio feedback module 702 may be implemented in a variety of ways. For example, the audio feedback module 702 may be implemented exclusively on the input device 104 itself, such as to perform processing and output of the audio feedback, such as through the use of an amplifier and one or more speakers.

In another example, functionality of the audio feedback module 702 may be implemented in part by both the input device 104 and the computing device 102. For instance, audio feedback module 702 functionality of the input device 104 may be used to detect and determine audio feedback that is to be output and then cause the computing device 102 to perform this output. This may be performed through interaction with an operating system, directly to an amplifier and speakers 704, 706 of the computing device 102 (thereby reducing latency), and so on.

In a further example, the functionality of the audio feedback module 702 may be substantially implemented by the computing device 102, e.g., as part of the input/output module 108. For instance, audio feedback module 702 functionality of the input/output module 108 may receive a signal from the input device 104. The signal may then be processed to determine audio feedback that is to be output, which may then be performed by the computing device 102 itself. Thus, the audio feedback module 702 may be implemented in a variety of different ways to provide the functionality described herein and therefore the following discussion is not to be taken as limited to any particular said implementation unless stated otherwise.

The audio feedback module 702 may leverage audio data 708 to provide a wide variety of feedback. For example, the audio data 708 may support themes (e.g., collections of sounds) that are user selectable, e.g., via a menu in a user interface. These themes may also be selected automatically based on an input device attached to the computing device, based on applications that are being executed by the computing device 102, and so forth. For instance, a first set of sounds may be utilized as audio feedback for a word processing application while a second set of sounds may be utilized as audio feedback for a video game. In another example, sounds may be associated with a key and/or group of keys. Therefore, when a key is pressed a sound from a set of sounds may be selected, e.g., via round robin, random, by pressure, and so on. In another example, sounds may be associated with key groups, e.g., letters, numbers, modifier keys (shift, control), navigation keys (arrows, page up, page down), function keys, and so on.

Audio feedback may be output in a variety of ways. In the illustrated example, speaker 704, 706 are disposed within a housing of the computing device 102, although other examples are also contemplated as previously described, such as incorporated as part of the input device 104. Further, the audio feedback module 702 may be configured to support a variety of different techniques regarding how this output is performed.

The audio feedback module 702, for instance, may leverage techniques such that audio feedback appears to be output from a location at which interaction with a device occurred. The audio feedback module 702, for instance, may be configured to leverage the speakers 704, 706 to give an impression to a user of the input device 104 that the feedback occurred at a particular key that was pressed by the user. This may include use of stereophonic techniques, head transfer function models, and so on that may give an indication of origination of the audio feedback that is different from where the output actually occurs.

This may include alteration of a left to right and even up or down appearance of a point of origination of the audio feedback to a user such that that point appears to correspond to a location at which the input occurred. Further, this may also be based on a likely location of a user. This location, for instance, may be modeled statically based on a likely head position of a user when typing. The location may also be determined dynamically, such as through use of one or more sensors, e.g., a forward facing image capture device, microphone, and so on.

The audio feedback module 702 may be configured to provide a wide range of audio feedback based on the audio data 708. In the illustrated example, for instance, the audio feedback module 702 may be configured to provide audio feedback that is dependent on which key of a keyboard is pressed. The audio data 708, for instance, may be configured to model a keystroke of individual keys of a keyboard. The audio feedback module 702 may then determine which key was pressed and provide audio feedback that corresponds to that key. A variety of other examples are also contemplated, such as feedback for alphabetic and/or numeric keys being different from feedback for non-alphanumeric keys, e.g., a carriage return or “enter” key. A variety of other examples are also contemplated, further instances of which may be found in relation to the following discussion of the next figure.

FIG. 8 depicts an example implementation 800 showing one of more fingers of a user's hands as interacting with the input device 104, thereby initiating output of audio feedback. In this example, left and right hands 802, 804 of a user are shown as being positioned to press keys of the input device 104. Although not shown, the input device 104 may be communicatively coupled to the computing device 102 as previously described and shown in relation to FIG. 1.

As previously described, conventional input devices configured to mobile use may provide insufficient feedback and thus may make it increasingly difficult for a user to interact with the device. Accordingly, audio feedback techniques may be leveraged to aid this interaction. For example, an audio feedback technique may be supported by the audio feedback module 702 to aid a user in locating a home row of keys of a keyboard. This may include output of sounds that get increasingly more harmonious the closer a user's fingers are initially located to the home row. This feedback may cease once the home row is located, after a defined period of time, responsive to removal of the user's fingers from a surface of the input device 104, and so on.

In another example, an output of audio feedback may be adjusted based on an environment in which the input device 104 is located. For instance, the input device 104 and/or computing device 102 may leverage one or more sensors (e.g., a microphone) to determine an ambient noise level of an environment and adjust a volume or other characteristic of the audio feedback accordingly, such as to be just above the ambient noise level. This determination may be performed automatically such that the audio feedback does not intrude upon the user's experience, such as when changing from a noisy to a quiet environment and vice versa.

In a further example, the output of the audio feedback may be adjusted based on an amount of pressure that is detected for a press of the key. This may be performed using the pressure sensitive keys described earlier, a contact area for a capacitive touchscreen, and so on. Further, the adjusting may be performed in a variety of ways, which may include adjusting volume, timbre, or other audio characteristics of the audio feedback. A variety of other examples are also contemplated which may be used to aid a user in locating key of the input device, an example of which is described as follows.

FIG. 9 depicts an example implementation 900 showing keys of the input device 104 of FIG. 1 in greater detail. In the illustrated example, a flexible surface of the input device 104 is shown that includes indications of keys for the letters “u,” “i,” “o,” “j,” “k,” and “l.” The indications may be formed using embossing, printing, laser cutting, and so forth.

First and second key presses 902, 904 are shown through circles that are illustrated in phantom for the same key, which is the “i” key in the illustrated example. In this example, the first key press 902 is positioned proximal to a center of the key while a second key press 904 is positioned proximal to an edge of the key. As described in relation not FIGS. 4-6, however, in some instances this may cause a decrease in an ability to detect the press of the key.

The audio feedback module 702 may therefore be configured to provide audio feedback that is dependent on where a key is pressed. This may include an output of audio feedback that mimics a regular key press as performed for a mechanical keyboard for the first key press 902 and therefore readily informs the user that the press was “good.” However, for the second key press 904 the audio feedback may be configured to indicate a miss hit of the key. Thus, even if a user is unable to “feel” the edge of the key (e.g., for a virtual keyboard) the audio feedback may indicate a potential miss hit of the key. The user may then readily correct where the key is subsequently pressed, thereby promoting an efficient user experience. A variety of other examples are also contemplated.

Example Procedure

The following discussion describes audio feedback techniques that may be implemented utilizing the previously described systems and devices. Aspects of each of the procedures may be implemented in hardware, firmware, or software, or a combination thereof. The procedures are shown as a set of blocks that specify operations performed by one or more devices and are not necessarily limited to the orders shown for performing the operations by the respective blocks. In portions of the following discussion, reference will be made to FIGS. 1-9.

FIG. 10 depicts a procedure 1000 in an example implementation in which a determination is made as to which audio feedback is to be output responsive to receipt of a signal from a pressure sensitive key. A signal is received from a pressure sensitive key of an input device (block 1002). Although a pressure sensitive key is described in this example, other input techniques are also contemplated, such as virtual keyboards, track pads, and so forth.

Audio feedback is determined, from the signal, which is to be output as corresponding to the pressure sensitive key (block 1004). As previously described, the audio feedback may be determined based on a variety of factors. These factors may be used to output different sounds for different keys, sounds dependent on where a key is pressed, sounds that appear to originate from a key that is being pressed, adjustment based on environment, adjustment based on how hard the key is pressed (e.g., timbre, volume), support themes that are user selectable for different sounds, provide audio feedback to indicate when one or more fingers of the user's hand are positioned at a home row of a keyboard, and so on.

The determined audio feedback is then caused to be output (block 1006). This may include the input device 104 causing speakers 704, 706 of the computing device 102 to output the sounds, output by the input device 104 itself, and so forth as previously described in relation to FIG. 7.

Example System and Device

FIG. 11 illustrates an example system generally at 1100 that includes an example computing device 1102 that is representative of one or more computing systems and/or devices that may implement the various techniques described herein. The computing device 1102 may, for example, be configured to assume a mobile configuration through use of a housing formed and size to be grasped and carried by one or more hands of a user, illustrated examples of which include a mobile phone, mobile game and music device, and tablet computer although other examples are also contemplated.

The example computing device 1102 as illustrated includes a processing system 1104, one or more computer-readable media 1106, and one or more I/O interface 1108 that are communicatively coupled, one to another. Although not shown, the computing device 1102 may further include a system bus or other data and command transfer system that couples the various components, one to another. A system bus can include any one or combination of different bus structures, such as a memory bus or memory controller, a peripheral bus, a universal serial bus, and/or a processor or local bus that utilizes any of a variety of bus architectures. A variety of other examples are also contemplated, such as control and data lines.

The processing system 1104 is representative of functionality to perform one or more operations using hardware. Accordingly, the processing system 1104 is illustrated as including hardware element 1110 that may be configured as processors, functional blocks, and so forth. This may include implementation in hardware as an application specific integrated circuit or other logic device formed using one or more semiconductors. The hardware elements 1110 are not limited by the materials from which they are formed or the processing mechanisms employed therein. For example, processors may be comprised of semiconductor(s) and/or transistors (e.g., electronic integrated circuits (ICs)). In such a context, processor-executable instructions may be electronically-executable instructions.

The computer-readable storage media 1106 is illustrated as including memory/storage 1112. The memory/storage 1112 represents memory/storage capacity associated with one or more computer-readable media. The memory/storage component 1112 may include volatile media (such as random access memory (RAM)) and/or nonvolatile media (such as read only memory (ROM), Flash memory, optical disks, magnetic disks, and so forth). The memory/storage component 1112 may include fixed media (e.g., RAM, ROM, a fixed hard drive, and so on) as well as removable media (e.g., Flash memory, a removable hard drive, an optical disc, and so forth). The computer-readable media 1106 may be configured in a variety of other ways as further described below.

Input/output interface(s) 1108 are representative of functionality to allow a user to enter commands and information to computing device 1102, and also allow information to be presented to the user and/or other components or devices using various input/output devices. Examples of input devices include a keyboard, a cursor control device (e.g., a mouse), a microphone, a scanner, touch functionality (e.g., capacitive or other sensors that are configured to detect physical touch), a camera (e.g., which may employ visible or non-visible wavelengths such as infrared frequencies to recognize movement as gestures that do not involve touch), and so forth. Examples of output devices include a display device (e.g., a monitor or projector), speakers, a printer, a network card, tactile-response device, and so forth. Thus, the computing device 1102 may be configured in a variety of ways to support user interaction.

The computing device 1102 is further illustrated as being communicatively and physically coupled to an input device 1114 that is physically and communicatively removable from the computing device 1102. In this way, a variety of different input devices may be coupled to the computing device 1102 having a wide variety of configurations to support a wide variety of functionality. In this example, the input device 1114 includes one or more keys 1116, which may be configured as pressure sensitive keys, mechanically switched keys, and so forth.

The input device 1114 is further illustrated as include one or more modules 1118 that may be configured to support a variety of functionality. The one or more modules 1118, for instance, may be configured to process analog and/or digital signals received from the keys 1116 to determine whether a keystroke was intended, determine whether an input is indicative of resting pressure, support authentication of the input device 1114 for operation with the computing device 1102, and so on.

Various techniques may be described herein in the general context of software, hardware elements, or program modules. Generally, such modules include routines, programs, objects, elements, components, data structures, and so forth that perform particular tasks or implement particular abstract data types. The terms “module,” “functionality,” and “component” as used herein generally represent software, firmware, hardware, or a combination thereof. The features of the techniques described herein are platform-independent, meaning that the techniques may be implemented on a variety of commercial computing platforms having a variety of processors.

An implementation of the described modules and techniques may be stored on or transmitted across some form of computer-readable media. The computer-readable media may include a variety of media that may be accessed by the computing device 1102. By way of example, and not limitation, computer-readable media may include “computer-readable storage media” and “computer-readable signal media.”

“Computer-readable storage media” may refer to media and/or devices that enable persistent and/or non-transitory storage of information in contrast to mere signal transmission, carrier waves, or signals per se. Thus, computer-readable storage media refers to non-signal bearing media. The computer-readable storage media includes hardware such as volatile and non-volatile, removable and non-removable media and/or storage devices implemented in a method or technology suitable for storage of information such as computer readable instructions, data structures, program modules, logic elements/circuits, or other data. Examples of computer-readable storage media may include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, hard disks, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or other storage device, tangible media, or article of manufacture suitable to store the desired information and which may be accessed by a computer.

“Computer-readable signal media” may refer to a signal-bearing medium that is configured to transmit instructions to the hardware of the computing device 1102, such as via a network. Signal media typically may embody computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as carrier waves, data signals, or other transport mechanism. Signal media also include any information delivery media. The term “modulated data signal” means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media include wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared, and other wireless media.

As previously described, hardware elements 1110 and computer-readable media 1106 are representative of modules, programmable device logic and/or fixed device logic implemented in a hardware form that may be employed in some embodiments to implement at least some aspects of the techniques described herein, such as to perform one or more instructions. Hardware may include components of an integrated circuit or on-chip system, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), a complex programmable logic device (CPLD), and other implementations in silicon or other hardware. In this context, hardware may operate as a processing device that performs program tasks defined by instructions and/or logic embodied by the hardware as well as a hardware utilized to store instructions for execution, e.g., the computer-readable storage media described previously.

Combinations of the foregoing may also be employed to implement various techniques described herein. Accordingly, software, hardware, or executable modules may be implemented as one or more instructions and/or logic embodied on some form of computer-readable storage media and/or by one or more hardware elements 1110. The computing device 1102 may be configured to implement particular instructions and/or functions corresponding to the software and/or hardware modules. Accordingly, implementation of a module that is executable by the computing device 1102 as software may be achieved at least partially in hardware, e.g., through use of computer-readable storage media and/or hardware elements 1110 of the processing system 1104. The instructions and/or functions may be executable/operable by one or more articles of manufacture (for example, one or more computing devices 1102 and/or processing systems 1104) to implement techniques, modules, and examples described herein.

CONCLUSION

Although the example implementations have been described in language specific to structural features and/or methodological acts, it is to be understood that the implementations defined in the appended claims is not necessarily limited to the specific features or acts described. Rather, the specific features and acts are disclosed as example forms of implementing the claimed features.

Claims

1. A method comprising:

receiving a signal from a pressure sensitive key of an input device;
determining audio feedback, from the signal, that is to be output as corresponding to the pressure sensitive key; and
causing output of the determined audio feedback.

2. A method as described in claim 1, wherein the input device includes a plurality of said pressure sensitive keys and the determining is performed such that audio feedback that is determined as corresponding to a first said key is different than audio feedback that is determined as corresponding to a second said key.

3. A method as described in claim 2, wherein the first said key corresponds to a letter or number and the second said key does not.

4. A method as described in claim 1, wherein the determining is based at least in part on an amount of pressure indicated by the signal to select a volume or timbre for the audio feedback.

5. A method as described in claim 1, wherein the causing of the output of the determined audio feedback is performed such that sound of the determined audio feedback appears to originate from a location of the pressure sensitive key on the input device to a user that pressed the pressure sensitive key.

6. A method as described in claim 5, wherein the causing takes into account a likely position of the user with respect to the pressure sensitive key.

7. A method as described in claim 6, wherein the likely position of the user is detected dynamically using one or more sensors.

8. A method as described in claim 1, wherein the determining is performed such that audio feedback is based at least in part on which part of the pressure sensitive key is pressed.

9. A method as described in claim 8, wherein audio feedback that is determined for a press that is proximal to a center of the pressure sensitive key is different than audio feedback that is determined for a press that is proximal to an edge of the pressure sensitive key.

10. A method as described in claim 1, wherein the determining is based at least in part on an environment in which the input device is located.

11. A method as described in claim 10, wherein the determining is based on a detected ambient noise level in the environment.

12. A method as described in claim 1, wherein the determining is based at least in part on characteristics of an application that is executed on a computing device that is communicatively coupled to the input device.

13. A system comprising one or more modules implemented at least partially in hardware and configured to cause output of audio feedback that is determined based on a location at which a key of a keyboard is pressed.

14. A system as described in claim 13, wherein the keyboard is a pressure sensitive keyboard.

15. A system as described in claim 13, wherein the one or more modules are configured to determine audio feedback for a press at a first location of the key that is different than audio feedback that is determined for a press at a second location of the key that is different than the first location of the key.

16. A system as described in claim 13, wherein the one or more modules are configured to further provide audio feedback that is indicative of location of one or more fingers of a user's hand on a home row of a keyboard that includes a plurality of said keys.

17. A keyboard comprising a plurality of keys, each configured to be selected using one or more fingers of a user's hand and to cause output of audio feedback responsive to the selection, the output of the audio feedback configured to appear to the user as originating from a location of a respective said key.

18. A keyboard as described in claim 17, wherein the output of the audio feedback is performed using a plurality of audio output devices that are not positioned at the location of the respective said key.

19. A keyboard as described in claim 17, wherein the output of the audio feedback is caused to be performed by a computing device that is communicatively coupled to the keyboard.

20. A keyboard as described in claim 17, wherein the output of the audio feedback is modeled according to a head transfer function.

Patent History
Publication number: 20130300590
Type: Application
Filed: Jun 18, 2012
Publication Date: Nov 14, 2013
Inventors: Paul Henry Dietz (Redmond, WA), Moshe R. Lutz (Bellevue, WA)
Application Number: 13/525,614
Classifications
Current U.S. Class: Pressure Sensitive Actuation (341/34)
International Classification: H03M 11/00 (20060101);