Talking multi-surface keyboard
An advanced portable keyboard comprising of a method of providing an interface for receiving contact information indicative of points of contact between parts of an operator's hand and one or a plurality of touch-sensitive pads built on the front surface, one or a plurality of back surfaces, and edges, interacting with one or a plurality of computers or computer-driven appliances. A mechanism mapping a plurality of interface elements onto touch-sensitive pads and static keys, each element corresponding to a key on a computer keyboard, each element being associated with one of the fingers of the operator, each element is mapped recurrently and dynamically, and activated by respective finger. A mechanism to read and/or pronounces letters, words, errors, actions, transcribe voice to text, and to switch touch pads into mouse pads at different operational modes, thus, providing faster speed, healthier posture, and greater efficiency.
This application claims the benefit of PPA Ser. No. 61/789,573 filed 2013 Mar. 15 by the present inventors, which is incorporated by reference.
BACKGROUND Prior ArtThe following is a tabulation of some prior art that presently appear relevant:
Smart phones are being increasingly used for sending text messages either through text messaging, email, or alternative methods. However, in most cases the texting interface is either limited to a miniaturized keyboard or a soft keyboard. In either case users are limited to using two thumbs when entering text. This limitation decreases typing speed significantly.
There are many different forms of computer keyboards for computers and computer-driven appliances, including those with static hard keys, static soft keys, and dynamically mapped soft keys on a touch-sensitive surface.
When using either of the keyboards with mechanical keys or with static soft keys, our fingers have to conform to the position of the keys; keys are not customizable to the posture of our fingers. Different operators have different hand sizes and hand postures. Keyboards with static keys can't be customized to individuals' needs. These types of keyboards put stress on the wrists of the operator.
Computer keyboards with dynamically mapped soft keys provide operators the flexibility to keep their wrists straight. Patent US20130275907 A1 to Hannes Lau and Christian Sax, 2011 Oct. 14 references such keyboards. However, these keyboards with dynamically mapped keys use a flat keyboard, which force the hands of the operator to rest on the palm side of the wrists, as if using a conventional flat keyboard. This limitation squeezes the median nerve which may lead to developing Carpal Tunnel Syndrome.
Another form of computer keyboard in patent US20070036603 A1 to Marek Swoboda, 2004 Sep. 22, describes a keyboard with keys on the back surface. Additional mechanical keys are built on the left and right edges of the keyboard. Both soft keys and mechanical keys are statically mounted or assigned on the back surface and on left and right edges. Keys on the back of the keyboard are visible through the top transparent surface. Operator looks through the device to see and then manually activate the keys. This limitation prevents proper use of the top surface. For example, a display screen can't be efficiently used to show entered text or display a running program. Activating keys mounted on the left and right edges are not as comfortable as if they were mounted and activated on the front surface.
I have found that keyboards with keys on the back where the back and the front surfaces are parallel with each other are harder to use than if the two surfaces were in an angle. I will discuss this in more detail later.
On the other hand, keyboards with dynamically mapped invisible soft keys can't be used without an external monitor. Operators need to see what they type and be able to correct typos and grammatical errors. Further improvements are required.
AdvantagesAccordingly, several advantages of one or more aspects are as follows:
Mobility and portability allows operators to stand, walk, or do other activities while, typing on the keyboard, and, a sound module or other notification methods alert operators when detecting typos or other errors, or, transcribing voice to text and computer commands. Faster speeds, greater efficiency, and healthier body and finger posture is achieved when keys are dynamically mapped onto the back of an embodiment, and a limited number of keys assign on the front of the embodiment, where thumbs activate the front keys and other 8 finger activate the back keys.
These and other advantages will become apparent from the ensuing description and accompanying drawings.
SUMMARYIn accordance with one embodiment, a portable keyboard for a computer or a mobile device provides increased speed, functionality, and mobility. Use of dynamically mapped keys on back, front, and edges of an exemplary embodiment provides healthier posture for the hands and fingers of the operator. Sound and other media are incorporated to notify the operator and to transcribe voice into text and computer commands for greater efficiency.
The embodiments of the invention is described by way of example only, with reference to the accompanying drawings in which, one or more embodiments are illustrated with the same reference numerals referring to the same pieces of an embodiment throughout the drawings, it is understood that the invention is not limited to the embodiments depicted in the drawings herein, but rather it is defined by the claims appended hereto and equivalent structures:
The touch screen is capable of detecting at least the touch of two thumbs simultaneously and to display a plurality of icons, a plurality of running program windows, as well as text boxes and a plurality of programmable soft keys.
Both touch pads are capable of detecting different ranges of pressure levels. Each pressure range describes a specific action, for example, tapping with a finger, touching or resting on the touchpad, sliding or moving a finger or a plurality of fingers on a touch pad, squeezing a touch pad with the palm of one hand, pressing harder on a touch pad with a finger, etc.
Most computer keyboards have standard alphanumeric keys including home keys A, S, D, F, J, K, L, ;, other alpha keys adjacent to the home keys, numeric keys, punctuation keys including mathematical operators, and a set of special keys including function keys. An example of special keys is Tab, Caps, Shift, Ctrl, Command, Alt, Scroll, Delete, etc. Recent computer keyboards, in addition to these keys include additional keys to activate and control programs running on the host computer. For example a computer keyboard may have keys to open a web browser, a menu, and start and stop keys for playing music, etc. The adjacent keys of a home key are activated by the same finger that activates the home key. For example as shown in
The first embodiment provides at least: a housing, a non-volatile storage media, a volatile storage media, a source of rechargeable power to provide electricity when operating wirelessly, a method to communicate with the local and/or remote hosts, a first program to customize and build new computer layouts, a second program for choosing and activating a keyboard layout, a third program for obtaining the initial contact position of fingers when rested on the pads and the contact position of fingers when extended and retracted, a fourth program for detecting normal operation and activities performed by the hand of the operator, for remapping the interface elements on the touch pads as fingers move or shift from the initial position, and a fifth program to activate a sound module and/or other methods of notifying operator when typos, grammatical or other errors are detected, to transcribe voice into text and computer commands, and an electronic module to run those programs, generate codes, display information on the touch screen, and transmit generated codes through a wired, wireless, or both mediums to a locally attached host, and/or to one or a plurality of remote hosts. Other methods of notification include future and currently available including notification methods through vibration and notification through tactile sensation as described at: http://www.ncbi.nlm.nih.gov/pmc/articies/PMC3100092/.
The non-volatile storage media holds the programs and information pertaining to all available keyboard layouts and customized keyboard layouts. These programs are responsible for providing at least BIOS support and to initialize and operate the embodiment.
The keys of keyboard layouts are divided into a plurality of interface groups. The elements of each interface group are comprised of one home key and none, one, or a plurality of adjacent keys. The elements of each interface group are assigned to and activated by one of the fingers of the operator. For example, in
Also as shown in
Holding two mechanical keys labeled Space for 3 seconds or longer prompts operator to choose one of the programs. Operator may call the first program to customize a layout. As part of the customization, operator may customize each key of a selected keyboard, the functions of touch pads 102, 106, 116 and 121 (
An operator, at the first use of the keyboard calls up the second program and chooses and activates one of the available keyboard layouts or one of the customized layouts. Operator should also call the third program at least once to customize the keyboard to the hands and fingers.
When the third program is called, operator is prompted to follow a series if instruction to detect and register the contact points of each finger at resting position on the touch pads, as well as the contact points of each finger when extending or retracting to tap on other areas on the touch pads, as if typing on the adjacent keys of a keyboard.
For example, when the operator is prompted to rest at 8 fingers on the two touch pads, the third program detects and registers the contact point of the left index finger at resting position and maps the F key to that position. Then through a sequence of prompts, the operator taps on different areas of the left touch pad by extending or retracting the left index finger as if typing on the adjacent keys R, V, T, G, and B on a QWERTY keyboard. The center of all contact points or the coordinates of contact points between the left Middle finger and the touch pad are grouped together as elements of the F interface group.
As shown in
Once all contact points or coordinates of all fingers are registered, the third program maps each of the contact points to a key. The third program also calculates the distance between each adjacent key and the home key, and the distance between same adjacent key and the next home key. For example, as shown in
The fourth program is the main program that runs automatically ail the time to detect activities performed by the hands of the operator and to generate codes relative to each activity on a touch pad or a touch screen. For example, when the operator taps on the mapped location of key D with the left Middle finger, a character code representing letter d is generated. If the operator was pressing and holding the Shift key with right Pinky finger while performing the same action, a character code representing letter D is generated.
As the operator's hands move, the position of the home keys also shift and move. Fourth program recurrently detects the new location of the home keys by reading the contact points of the active fingers whenever they are at resting position. The new position of the home keys are dynamically remapped on the touch pads, With the information pertaining to adjacent keys and their distances from two home keys available, the coordinates of the adjacent keys are adjusted based on the coordinates of the new home keys. Therefore there is no need to detect the position of the adjacent keys.
For example, in
Let's say that the left hand of the operator moved and shifted forward. In this example in Fi the contact point of the left Middle finger 602 moved forward slightly more than the left index finger 603. The fourth program detects the new contact points of the left Middle finger 605 and left Index finger 604 and remaps D and F keys on the left touch pad accordingly. It also calculates and updates the coordinate of the E key 601 and maps it at the location 606 which is 12 mm from the new position of the D home key and 16 mm from the F neighbor home key.
Operator's left and right thumbs activate the mechanical keys located under the front touch screen, and any soft programmable key mapped on the touch screen.
The fifth program, at operators request, reads every letter or word, and notifies the operator with distinct sounds when typos, grammatical errors, or other errors, are detected. The program may use other forms of notification, for example vibration or displaying a message on the touch screen. The program may at operators request record and transcribe voice into text and computer commands, letting the operator only correct errors made during the transcribing process.
There are different modes of operation include Extended Mode, Arrows Mode, Multi-Mice Mode, etc, Other modes of operation may be achieved by creating new customized layouts. The operator may activate any of these modes one at a time by either pressing the mode key 111 in
In Texting Mode, as shown in
However in Numeric Mode as shown in
Table 2 shows interface groups and associated elements in Numeric Mode. In this mode of operation one or both of the touch pads on back surfaces may be mapped with the same interface groups. For example, interface group 5 with elements 8, 5, and 2 may be associated with the left Middle finger, right Middle finger, or both.
Extended Mode provides access to different symbols, functions keys, numbers, and special keys. Table 3 shows interface groups and associated elements in Extended Mode. For example, the interface group D in Texting Mode becomes interface group 3 in Extended Mode. Function keys F3, F13, and digit 3 key become the elements of interface group 3.
Each thumb is assigned to activate at least two mechanical keys located on the front surface under the touch screen. For example, right thumb can activate the two far most right mechanical keys which are map d to digit 0 key and F10 Function key.
In Multi-Mice Mode, both touch pads located on the back of the embodiment become mouse pads. In this mode, one or a plurality of fingers of each hand may control the movements of an independent mouse or perform other activities. For example, by sliding the Index finger of left hand on the left touch pad, operator can move the pointer of the 1st mouse and perform another action by tapping with same finger on the touch pad. Similarly, the Index finger of the right hand may perform the same action as the left Index finger, but to control a 2nd mouse. Additionally, when using 2 fingers, 3 fingers, or even 4 fingers simultaneously, operator may perform one of the common actions of a typical mouse, or simplify and facilitate a process which otherwise may require several steps to accomplish. For example, in a drawing program, by using two index fingers, the operator may grab the two ends of a line, move and stretch it to fit in a new location, which otherwise, the same function would require moving each end of the line one step at a time. In another example, operator may rotate, zoom, and perform other actions on an object simultaneously by using more fingers of one or both hands.
Table 4 shows an example of the functions to be assigned to each finger. As stated earlier, by combining functions of a plurality of fingers, a new function may be achieved. These new functions may extend the functions of currently available computer programs and the programs to become available in the future due to the capabilities of this or other embodiments.
In Arrows Mode, tapping with the right index finger at its resting position will move the cursor or the selected object to the left, tapping with the right Ring finger at its resting position will move the cursor or the selected object to the right, an tapping with the right Middle finger above or below its resting position will move the cursor or the selected object up or down accordingly. Same functions may be achieved by the fingers of the left hand.
Functions of the touch pads located on the left and the right edges of the embodiment may vary when selecting different layouts or different modes of operation. In
An operator may hold the first embodiment in the air, lay it on a desk, or dock it on a docking station during the operation. As shown in
When an embodiment is docked into the second embodiment, all the ports of the docking station become available to the docked embodiment and the recharging process begins. Operator may use the docked embodiment while charging.
Detailed Description FIGS. 8 and 9—Third EmbodimentAnother example of the invention is described in the third embodiment, A new smart phone may be built with a touch-sensitive pad on the back.
In
The third embodiment operates like a smart cell phone but with added features and capabilities of the first embodiment.
Detailed Description FIG. 10—Fourth EmbodimentThe fourth embodiment as shown in
The same set of volatile and non-volatile storage media, voice module, power source, electronic circuitry, and programs available on the first embodiment is built onto the fourth embodiment. Therefore, all functions and capabilities of the first embodiment, except for the functions of the front touch screen, are available on the fourth embodiment.
Operation Fourth EmbodimentThe fourth embodiment operates like the first embodiment but without a front touch screen as shown in
The fifth embodiment provides a touch pad and communication medium. It is attached to a mobile device or other portable devices.
Operator attaches the fifth embodiment to the back of a mobile device or a smart phone and connects it to the host through a wired medium, for example a USE cable. Operator runs same set of programs to configure and customize this embodiment. Operation of the fifth embodiment is similar to the operation of the third embodiment.
Detailed Description FIG. 12—Sixth EmbodimentThe sixth embodiment provides two mouse-like portable units, one to be operated with the left hand and the other with the right hand, each labeled accordingly for each hand. Each unit has a plurality of touch pads. An example of such a unit that is operable with the right hand is shown in
In this example using only one of the units, the operator rests the right hand on the cup of the unit, and rests fingers on the touch pad. Operator runs the same set of the program on the host computer to customize and configure both units.
The mouse pointer is moved either by moving or sliding the device or switching the touch pad into a mouse pad. Operator may call the first, second or the third program by pressing and holding on the touch pad located on the cup for more than 3 seconds. Once configured, operator can use the touch pads to enter text or perform other keyboard functions, or, by moving or sliding each unit, perform the functions of a computer mouse. Since there are two units, each operated by one hand, operator may perform advanced mouse functions with two mice.
All embodiments may use wired, wireless, or both technologies currently available or available in the future to communicate with the local or remote hosts. All embodiments may use any source of power including solar power, magnetic power, or batteries, host power, or other power sources currently not available in the market.
Detailed Description FIGS. 13 and 14—Seventh EmbodimentThe seventh embodiment is an example of a mobile device with extended touch pads.
Other example of an extended touch pad is shown in
Dynamic soft key 1403, as an example, is on touch pad 1402, which is used with the right hand, and dynamic soft key 1406, as an example, is on touch pad 1407, which is used with the left hand of the operator.
Seventh embodiment provides larder typing surface for the operator's fingers.
Detailed Description FIG. 15—Eighth EmbodimentThe eighth embodiment as shown in
The ninth embodiment as shown in
The tenth embodiment as shown in
Embodiments seven, eight, nine and ten are examples of more ergonomically designed mobile devices. They provide larger surface for fingers or ergonomic sides for easy interaction. There are no additional functions or operation besides what is available with other embodiments.
CONCLUSION, RAMIFICATION, AND SCOPEOne or more embodiments provide the following benefits individually or collectively:
Mobility and portability provides operators the choice to stand, walk, lie in the bed, or do other activities while typing on the keyboard. With invisible keys on the back of a portable device, which dynamically conform to the fingers of the operators, all the fingers of the operator become active. Hence, increased typing speed, greater efficiency, and healthier posture of fingers, wrists, hands and the body of the operator is achieved.
Versatile and customizable layouts meet the needs of different operators, including operators with less than 10 active fingers. Sound module adds another attribute by detecting and notifying errors and transcribing voice to text and computer commands. Each embodiment, in addition to the functions of an advanced computer keyboard, can activate a plurality of instances of a computer mouse, controlling the actions of several mice in one application program. This enhanced capability provides support for future programs requiring such capability.
Claims
1. A portable data processing device comprising:
- a. a plurality of surfaces,
- b. detecting means for receiving contact information indicative of points of contact between fingers and said surfaces, and
- c. mapping onto said surfaces a plurality of computer keys, each key assigned to one of said point of contacts and activated by the associated finger.
2. Data processing device according to claim 1, wherein said device is attached to a portable device.
3. A method of providing error notification, pronunciation, and voice transcription interface for any of the preceding claims.
4. A method of providing docking support for claims 1 and 2.
Type: Application
Filed: Mar 15, 2014
Publication Date: Sep 17, 2015
Inventor: Hovsep Giragossian (San Jose, CA)
Application Number: 14/214,710