Efficient method and apparatus for text entry based on trigger sequences
Languages based in whole or in part on ideographic characters such as Chinese, Japanese, and Korean, are often are entered in a computerized text-entry system in a two-phase process. In the first phase, symbols from a first pre-conversion set are entered, then in the second phase, these pre-conversion symbols are converted into a second set of post-conversion symbols. This invention teaches a method and apparatus for the automatic conversion of pre-conversion symbols into post-conversion symbols without requiring an explicit conversion signal to be input by the user. It accomplishes this goal though the design of trigger sequences of keystrokes which are substantially functionally equivalent to an explicit conversion signal input by the user. An apparatus constructed according to the trigger sequence method is particularly well adapted for use on reduced keyboards, and in conjunction with predictive text-entry methods. Explicit constructions are shown for Chinese, Japanese, and Korean.
Latest Eatoni Ergonomics, Inc. Patents:
- TELEPHONE KEYPAD BASED ON TRIPODS
- Method and apparatus for discoverable input of symbols on a reduced keypad
- Touch-typable devices based on ambiguous codes and methods to design such devices
- Touch-typable devices based on ambiguous codes and methods to design such devices
- Display screen with graphical user interface
U.S. Pat. No. 6,219,731 Apr. 17, 2001, PCT/US99/29,346, Method and apparatus for improved multi-tap text input, PCT/US01/30,264, EPO 01983089.2-2212-US0130264, Method and apparatus for accelerated entry of symbols on a reduced keypad. U.S. provisional Ser. 60/111,665, PCT/US99/29,343, WIPO WO 00/35091. Touch-typable devices based on ambiguous codes and methods to design such devices.
BACKGROUND OF INVENTIONText entry is a labor-intensive process. As is well known, when computers are used for entry of languages which depend in whole or in part on ideographic characters, part of the labor is pressing a “convert” key to cause pre-conversion symbols which have been previously input into post-conversion ideographic characters. If it were possible to assign each of the ideographic characters to a separate key, there would be no need for pre-conversion symbols or a conversion process. The need for these arises because the number of keys on a practical text entry device is small compared to the potentially tens of thousands of ideographic characters which must be input. The large set of ideographic characters is input by representing them as sequences of pre-conversion symbols drawn from a smaller set, and then performing conversions of the sequences to the desired ideographic characters. The problem of a reduced number of keys compared to the number of characters to be input is exacerbated in the case of small handheld devices such as mobile telephones. On these devices, the number of keys may be smaller even than the number of pre-conversion symbols. The result is that the user is required to perform multiple keystrokes to input each pre-conversion character a keystroke to cause conversion, and then further keystrokes to specify which of the post-conversion characters is intended to be input. The resulting number of keystrokes can be quite high, even for short samples of text.
Predictive text methods have been employed to reduce the number of keystrokes required to enter pre-conversion symbols or post-conversion symbols, or both. Some of these methods such as those described in U.S. Pat. No. 6,219,731 Apr. 17, 2001, PCT/US99/29,346 method and apparatus for improved multi-tap text input, PCT/US01/30,264, EPO 01983089.2-2212-US0130264, Method and apparatus for accelerated entry of symbols on a reduced keypad, U.S. provisional Ser. No. 60/111,665, PCT/US99/29,343, WIPO WO 00/35091, Touch-typable devices based on ambiguous codes and methods to design such devices, all of which are hereby incorporated by reference, perform predictions on a symbol-by-symbol basis, or based on contexts composed of whole words or parts of words. Most prior art systems, such as those described in Davis, J. R. Let your fingers do the spelling: Implicit disambiguation of words spelled with the telephone keypad, Avios Journal 9 (1991), 57-66, perform predictions on dictionaries of whole words.
The availability of these predictive designs as well as their commercial success show that there is a strongly felt industrial need for text-entry mechanisms which reduce the labor involved in text entry as well as possible. A heretofore un-addressed need is to reduce not only the number of keystrokes involved in input of pre-conversion and post-conversion symbols, but also the keystrokes involved in performing the conversion function which relates the pre- and post-conversion symbols. The present invention substantially eliminate conversion keystrokes. Surprisingly, it does so in a way that maintains the advantages of predictive text methods as applied to pre-conversion symbols, post-conversion symbols, or both. Further advantages accrue to its parsimonious demands for computer memory and processing power, making it suitable for implementation in small and/or handheld devices.
SUMMARY OF INVENTIONIn order to particularly point out and distinctly claim the subject matter for which patent protection is hereby sought, we will define some terms to be used in the disclosure of the invention, and its best modes of operation. The sequence of these definitions also serves as a systematic introduction to the subject matter of the invention.
Printable and non-printable symbols. A printable symbol is a symbol which is displayed as text in normal writing. For instance, the letter a in English is a printable symbol. In the following it will be useful to also consider non-printable symbols. For example, the delete button may be said to generate the non-printable “delete” symbol. This terminology is consistent with most standard encoding systems for computerized entry of text. Note: For the sake of readability, the terms “letter” and “alphabet” may be used interchangeably with the term “symbol” and “set of symbols” respectively unless a distinction between these terms is explicitly drawn.
Display. A printable symbol may be displayed in the course of text entry. By display we mean “presentation to the senses of the user.” In typical applications of the present invention, the display would be visual, and for the sake of concreteness in this disclosure, visual display is assumed. However, the display might be an auditory display in the case of interactive voice response systems, tactile in the case of text input systems for the blind, etc.
Keys and Keystrokes. Typical text-entry systems use mechanical keys to input symbols. For the sake of concreteness, we will define a keystroke to be an atomic act of a user with the intent of inputting a symbol (printable or non-printable) using a text-entry device to express that intent. We will further define the physical means used to express the intent as a key. The physical form of both key and keystroke depends on the input device. In the case of an auditory system, the keystroke could be, for instance, spoken or signaled by a hand clap. In the case of a touch-pad system the key could be a swipe of the pad. In the case of a system based on quantum mechanics, the key could be manifest by a user-intended change in the vibrational state of a particle. The intent to input a symbol could be expressed by doing nothing at all for a certain length of time. In short, the physical manifestation of the intent to input a symbol is not a limitation on the scope of this invention.
Symbol input. In the case of familiar unambiguous typewriter keyboards, such as the Qwerty keyboard, the relationship between keystroke sequences and symbol sequence input is quite straightforward, each keystroke on a symbol key inputs a symbol. In the case of ambiguous keyboards, the relationship is more complex. Several keystrokes may be required to input a single symbol and keystrokes may be required for proper text input which in themselves do not display symbols at all or do not display symbols which appear in the output text. For instance, when using the “multi-tap” input method on a telephone keypad, three keystrokes on the 2 key are required to enter the letter c. Multi-tap keypads often have a time-out kill button, the purpose of which is to facilitate the entry of consecutive letters from the same key. Pressing the time-out kill button does not enter a printable symbol by itself, rather it serves to separate the input of distinct printable symbol.
A printable symbol will be said to be input when a keystroke sequence is entered which includes the keystrokes required to define and display the symbol given the hardware and software of the text input system, as well as a keystroke which terminates the input of the symbol, e.g. by beginning the input of a next symbol, or causing conversion, or causing termination or transmission of the entire entered text. The keystroke which terminates symbol input may be identical to a keystroke which serves to define and/or display the symbol, or the keystroke which terminates input of the symbol may serve no other function but symbol input termination. For instance, in a standard multi-tap system for a telephone keypad, one keystroke sequence to input the printable sequence ba . . . begins 22T2 . . . where each 2 represents a keystroke on the 2 key, and T represents a keystroke on the time-out kill key. Once the keystroke sequence 22 is entered, the letter b is displayed. However, the letter b cannot yet be said to be definitively input since another keystroke on 2 would change the display to the letter c. It is only after the non-printing symbol T is entered that the letter b can said to be input. Another keystroke sequence for inputting the printable sequence ba . . . in a multi-tap system begins 22W2 . . . where each 2 represents a keystroke on the 2 key, and W represents the user waiting until a time-out period has expired.
If the backspace key B were pressed after the keystroke sequence 22, then the letter b would be said to input at the moment the keystroke on the backspace key is made, since that keystroke terminates the input of the symbol, and even though the letter b would be substantially simultaneously erased by the same keystroke, and in fact might not be displayed at all in some implementations. The situation is clarified when we consider the backspace key as generating a symbol-input-end symbol in addition to an erase symbol, and a move-cursor symbol. More generally, input means display in conjunction with the generation of a symbol-input-end symbol which applies to the displayed symbol, either following or substantially simultaneously with the display. The distinction between display and input is particularly important for the appreciation of the predictive systems with conversion which are shown and described in the present disclosure.
Pre-conversion, post-conversion, and non-conversion symbols. Natural languages based in whole or in part on ideographic characters such as Chinese, Japanese, and Korean may be input into a computer in a two-phase process, each phase involving a set of symbols to be called pre-conversion and post-conversion symbols respectively. In the first phase, symbols from a pre-conversion set of symbols are input, and in a second phase these symbols are converted into the post-conversion ideographic characters. Well-known pre-conversion symbol sets for Chinese include Hanyu Pinyin (Latin letters with tone marks), other Romanizations schemes, or Zhuyin (also known as Bopomofo. In the case of Japanese, the ideographic Kanji symbols are entered by first entering strings of pre-conversion symbols typically composed of Latin letters or Hiragana, and then converted to Kanji in a second conversion phase. In the case of Korean, the pre-conversion symbols are typically Latin letters or Jamo, and the ideographic Hanja are produced in a second conversion phase. Text entry for some languages may involve symbols which are neither pre-conversion nor post-conversion symbols. For example, punctuation symbols are not typically entered with the intent of being converted to other symbols, nor are they typically the result of a conversion process. Symbols which are not converted into other symbols will be called non-conversion symbols.
Note that the characterization of a symbol as a pre-, post- or non-conversion symbol is not intrinsic to the symbol, but rather depends on the text-entry device. For instance, though in typical devices punctuation symbols are non-conversion symbols, they could be pre-conversion symbols in a device which e.g. replaces the sequence :-) with a pictorial representation of a smiling face when the punctuation sequence is entered.
cHiragana, cLatin, and cJamo symbols. Appreciation of this invention as a whole hinges on the appreciation of the distinction between display and input. Similarly, appreciation of several aspects of embodiments of the invention hinges on appreciation of the distinction between symbols meant to appear in output text as such, and symbols which may be otherwise the same, but are meant to be converted to still other symbols. cHiragana are symbols used in the preferred embodiment as applied to Japanese. According to the invention, to each Hiragana there is a corresponding cHiragana. Hiragana are distinguished from cHiragana in the preferred embodiment in that Hiragana are meant to be represented directly in output text, and are thus non-converting symbols, whereas cHiragana are pre-conversion symbols meant to be converted during the course of text entry to post-conversion Kanji symbols. In typical implementations of this invention, the cHiragana have display characteristics which mark them as distinct from Hiragana. In the same way, cLatin letters are Latin letters entered with the intent of being converted, and are marked in the display so as to distinguish them from Latin letters, and cJamo are pre-conversion symbols entered with the intent of being converted and marked distinctively from non-converting Jamo.
Trigger sequences. A central inventive step of the present invention is the creation of trigger sequences of keystrokes. Trigger sequences are sequences of keystrokes which when entered by a user cause a conversion event to take place, and serve at the same time to in-put pre-conversion and/or non-conversion symbols. By dually representing both pre-conversion symbol input and entry of a conversion signal, trigger sequences reduce the number of keystrokes required to enter text, eliminating the need for an dedicated convert keystroke as is the case for prior-art systems. According to the teachings of this invention, the conventional pre-conversion symbols may be augmented with auxiliary symbols such that suitable trigger sequences may be formed. Intuitively, an ideal trigger sequence is a sequence of keystrokes such that conversion should occur if and only if the trigger sequence is entered. That is, it should ideally be sufficient to enter a trigger sequence to cause conversion, and conversion should be a necessary consequence of entering a trigger sequence.
For this substantial identity between trigger sequences and conversion to hold, the trigger sequences should be carefully designed to reflect as well as possible the nature of conversion as it is practiced in the language. Depending on the language, the trigger sequences may be more or less complicated. We will see also that the set of pre-conversion and post-conversion symbols may have to be tailored to allow trigger sequences to be well defined. We will describe in detail the construction of trigger sequences for Chinese, Japanese, and Korean. Upon learning the details of these constructions and the general principles elucidated in the present disclosure, a person skilled in the art should have no difficulty constructing trigger sequences for other languages.
More formally, a trigger sequence comprises a sequence of at least two keystrokes such that a first of the keystrokes causes the display of a pre-conversion symbol, and a second of the keystrokes generates a symbol-in-put-end symbol and substantially simultaneously triggers conversion of at least the last pre-conversion symbol in-put.
Trigger sequences are of particular utility in the design of text-entry systems for reduced keyboards such as telephone keypads. On such reduced keyboards, the reduction in the number of keys is compensated for by increasing the number of keystrokes needed to input each symbol. Various software methods have been devised to predict the next symbol or symbols intended by the user and thus reduce the number of keystrokes. The present invention teaches another method to reduce keystrokes. It reduces or eliminates the need for keystrokes whose sole purpose is to cause conversion. It teaches a specific design strategy applicable to many languages to reduce conversion keystrokes while allowing further keystroke reduction by means of predictive software systems. Especially when used in conjunction with predictive software, the present invention can dramatically reduce the number of keystrokes required to input text in languages with conversion.
As will be developed in more detail below, in the case of Chinese, a trigger sequence may be preferably embodied as comprising a keystroke causing a tone mark to be displayed and a keystroke on any key generating a symbol-in-put-end symbol inputting the tone mark.
As will be developed in more detail below, in the case of Japanese, trigger sequences may be preferably embodied as falling into two classes. Elements of the first preferred class are characterized in that the first keystroke of the trigger sequence displays a cHiragana, and the second key of the trigger sequence generates a symbol-input-end symbol which applies to the displayed cHiragana, provided that the second keystroke is on a key to which no cHiragana has been assigned.
Elements of the second preferred class are characterized in that the first keystroke of the trigger sequence displays a cHiragana, and the second keystroke of the trigger sequence generates a symbol-input-end symbol which applies to the displayed cHiragana, and also causes a non-conversion symbol to be displayed, and a third keystroke which causes the displayed non-conversion symbol to be input.
Note that further classes could be also be defined, such as a class in which the two symbols input by the second keystroke in trigger sequences of the second preferred class are entered with two different keystrokes. Also note that these trigger sequence classes are defined in terms of cHiragana as the pre-conversion symbols. If other pre-conversion symbols are chosen, such as cLatin symbols, then trigger sequences could be defined in a similar way.
As will be developed in more detail below, in the case of Korean, trigger sequences may be preferably embodied as falling into two classes. Elements of the first preferred class are characterized in that the first keystroke of the trigger sequence displays a cJamo, and the second keystroke of the trigger sequence generates a symbol-in-put-end symbol which applies to the displayed cJamo, provided that the second keystroke is on a key to which no cJamo has been assigned.
Elements of the second preferred class are characterized in that the first keystroke of the trigger sequence displays a cJamo, and the second keystroke of the trigger sequence generates a symbol-input-end symbol which applies to the displayed cJamo, and also causes a non-conversion symbol to be displayed, and a third keystroke which causes the displayed non-conversion symbol to be input.
Note that further classes could be also be defined, such as a class in which the two symbols input by the second keystroke in trigger sequences of the second preferred class are entered with two different keystrokes. Also note that these trigger sequence classes are defined in terms of cJamo as the pre-conversion symbols. If other pre-conversion symbols are chosen, such as cLatin symbols, then trigger sequences could be defined in a similar way.
Ambiguous keyboards. An ambiguous keyboard is a keyboard designed such that several printable symbols are assigned to at least one key, and no hardware means, such as a shift key, are proto disambiguate the various printable symbols assigned to the same key.
Predictive text systems. Software which determines as a function of context which member of a set of printable symbols assigned to a given key of an ambiguous keyboard will be displayed or input in response to a keystroke.
Multi-tap. Multi-tap is a prior-art text-entry method for ambiguous keypads in which the several symbols on a given key are distinguished for input by multiple presses on the key, and in which the various symbols always appear in the same order as the key is pressed multiple times.
Next keys. A keystroke on a Next key advances in the symbol displayed as the result of a keystroke on a key with multiple symbols are assigned. Next key advance is distinguished from multi-tap advance in that in a multi-tap system the displayed symbol is advanced by repeated keystrokes on the same key which displayed the first symbol, whereas in a Next-key system, the key which advances the display is distinct from the key which displayed the symbol to be advanced. Some Next-key systems are equipped with several Next keys, each of which may advance the display of a different class of symbols.
Variable order vs. fixed order. If there is more than one symbol assigned to a key, some mechanism should be supplied to select the symbol from the key to display at any given time. If a system causes the symbols to always be displayed in the same order, such that there exists at least one symbol which cannot be displayed before some other symbol is displayed, then the system is said to be a fixed-order system. Otherwise, it is a variable-order system. Predictive text systems are variable-order systems, while the standard multi-tap system is a fixed-order system. Hybrid variable/fixed order systems are possible in which a subset of the symbols assigned to the same key are presented in a fixed order, and another subset is presented in a variable order.
OBJECTS OF THE INVENTIONAn object of the invention is to permit automatic conversion from sequences of pre-conversion symbols to sequences of post-conversion symbols, automatic in the sense of not requiring the user to generate an explicit conversion signal, for instance by pressing a “convert” key, as is done in prior-art systems. This automatic conversion is of particular utility in the entry of languages such as Chinese, Japanese, or Korean, which use ideographic characters in whole or in part.
A further object of the invention is to permit automatic conversion from sequences of pre-conversion symbols to post-conversion symbols even when predictive mechanisms are used to input either the pre-conversion symbols or post-conversion symbols, or both. This is of particular utility when text is input with reduced keyboards such as a telephone keypad.
A further object of the invention is to provide a method for defining trigger sequences.
A further object of the invention of the invention is to define trigger sequences for Chinese.
A further object of the invention of the invention is to define trigger sequences for Japanese.
A further object of the invention of the invention is to define trigger sequences for Korean.
A further object of the invention is to introduce novel assignments of Hiragana to keys of a keyboard based on the Iroha ordering.
A further object of the invention is to provide a predictive text-entry method for Chinese with automatic conversion based on trigger sequences and tone marks predicted in a variable order such that correction of errors by the user is facilitated.
A further object of the invention is to provide for error-correction mechanisms for text entry with trigger sequences.
A further object of the invention is to provide a mechanism for text entry with conversion such that the conversion mechanism can be implemented with minimal computer memory requirements.
A further object of the invention is to permit highly effective client-server architectures for conversion whereby the memory and processing requirements of the client are vastly reduced.
Other systems, methods, features, and advantages of the present invention will be or become apparent to one with skill in the art upon examination of the following drawings and detailed description. It is intended that all such additional systems, methods, features, and advantages be included within this description, be within the scope of the present invention, and be protected by the accompanying claims.
The aspects and advantages of the present invention will become readily appreciated in the following detailed description which is best read in reference to the accompanying drawings comprising:
The Method of Trigger Sequences. A trigger sequence is a subsequence of keystrokes which minimally has the attribute of triggering conversion substantially if and only if a conversion is intended by the user. It is in addition desirable that: 1) It is intuitive for a native speaker of the language that conversion would take place when the trigger sequence is input.
2) Triggering may be performed even when a predictive mechanism is used to predict the symbol the user intends to enter, for either or both of the pre-conversion or post-conversion symbols.
3) In the case of error-free input of pre-conversion symbols, when a trigger sequence is entered, there are always at least enough not-yet-converted pre-conversion symbols entered to define at least one post-conversion symbol. The conversion which is triggered by entry of the trigger sequence will convert the at least enough not-yet-converted pre-conversion symbols to at least one post-conversion symbol, and may convert more pre-conversion symbols to more post-conversion symbols as well.
4) The trigger sequences be identifiable by a computer with a simple algorithm.
5) Triggering is robust, in that small errors in text entry do not unduly propagate to large errors in the output text.
6) Trigger sequences may be incorporated into predictive mechanisms with minimal memory storage costs.
According to the teachings of this invention, trigger sequences may be discovered by a systematic method, as is explained in reference to
In the case of Japanese, typical conventional pre-conversion symbols may be either of 1) Latin letters or 2) Hiragana. Using either of these sets of pre-conversion symbols alone, high quality trigger sequences are difficult to form. As will become clear below, if one of the symbol sets, say the Hiragana, is used for non-conversion symbols, and the other (Latin in this example) s used as pre-conversion symbols then robust and useful trigger sequences can be formed simply. The preferred embodiment of the present invention to Japanese benefits from a further inventive step to augment these symbol sets as will be more fully described below. Typical post-conversion symbols for Japanese are Kanji.
In the case of Korean, typical prior-art pre-conversion symbols are Latin letters or Jamo. Typical post-conversion symbols are Hanja. As in the case of Japanese, the Jamo are preferably augmented with a corresponding set of cJamo, as will be described more fully below. In the next step of the method, 101, the characteristics of the text-entry system should be fully defined and specified. The keystroke sequences required to enter text depend on the characteristics of the text-entry system. Characteristics which should be defined include the number of keys, the assignment of symbols to keys, whether the system is predictive or not, the linguistic database in the case of a predictive-text system, the method of advancing symbols in the case of ambiguous assignments of symbols to keys, etc. All of these characteristics influence the set of sequences of keystrokes which correspond to sequences of text in the language. In the next step, 102, the set of keystroke sequences which correspond to the set of possible text to be entered is determined. The set of sequences depends on both the pre- and post-conversion symbol sets selected to represent the language in step 100, and the text-entry method selected in step 101. The set of keystroke sequences could be determined deductively from a formal description of the language, the set of symbols used to represent the language, and the text-entry method, or it could be induced from a large corpus of text in the language. In the case of a deductive approach, an explicit model of input of the language is developed, and the required trigger sequences are deduced from the model. In the case of an inductive approach, a body of text is collected and the corresponding keystroke sequences analyzed. The goal is to construct an input-output map so that when the keystroke sequences are input, the text is recovered as output. Methods for doing this are well known in the art, and include but are not limited to statistical techniques such as genetic algorithms, genetic programming, simulated annealing, and artificial neural networks. As will be appreciated by one skilled in the art, the statistical techniques are applied by defining a rating function which takes the set of training data, the set of keystroke sequences derived from the language and a candidate set of trigger sequences, and scores the set of trigger sequences according to how well they produce conversions which correspond to the conversions the user would intend. The best candidate solutions are then modified to form new candidate solutions which are then scored in the same manner, in an iterative fashion. Typically, with continued iteration of the process, trigger sequences of increasingly high quality will be found. Once these keystroke sequences have been effectively determined and described, then at step 103, one should, for each pre-conversion symbol generated by the keystroke sequences of step 102, find a subsequence of keystrokes such that one of the keystrokes displays the pre-conversion symbol and another keystroke generates a symbol-input-end symbol but not a pre-conversion symbol intended to be converted to the same post-conversion symbol as the first one.
It may be that no satisfactory set of sequences can be found which fulfill both criteria sufficiently well, in which case the method returns, in step 104, to step 100 to redefine the symbol sets and text-entry method characteristics, as required. If a set of sequences can be found which meet the criteria set forth in step 103, then this set of keystroke sequences are adopted as trigger sequences for the language.
Basic Operations Turning now to
According, the text entry method based on trigger sequences receives 200 a keystroke sequence entered by the user and received by the mechanism. The mechanism 201 to recognize trigger sequences in the input keystroke sequence examines the input keystroke sequence to determine if a trigger sequence has been received. If so, then the conversion mechanism 202 is triggered. The conversion mechanism converts selected pre-conversion symbols into post-conversion symbols inasmuch as is possible or desired according to other aspects of the invention. If any conversion is possible, the conversion includes processing of at least any pre-conversion symbols displayed as result of an element of the trigger sequence.
As will be developed in more detail below, relative to a simple but effective model of Chinese, a very simple set of trigger sequences may be defined. In this case, the trigger sequences are comprised of the last keystroke causing a tone mark to be displayed, followed by a keystroke generating a symbol-input-end symbol (possibly among other symbols generated by the same keystroke). An overview of the basic operations of this text-entry system for Chinese are described in reference to
As will be developed in more detail below, relative to a simple but effective model of Japanese, a simple set of trigger sequences may be defined. In this case, there are two different classes of trigger sequences. The first class contains trigger sequences which are at least two keystrokes in length and are comprised of a keystroke causing a cHiragana to be displayed followed by a keystroke on a key which generates a symbol-input-end symbol but which cannot generate a cHiragana symbol. Note that the trigger sequence for Japanese allows strings of cHiragana to be input without necessarily causing conversion. Strings of cHiragana may be input without conversion, since a keystroke on a key to which a cHiragana is associated will not trigger a conversion by trigger sequences of the first class. Compare this to the case of Chinese. In Chinese, strings of tone marks are not encountered in sequences generated according to the model of Chinese, so no such restriction is required. By contrast, for Japanese, conversion is often desired once a contiguous sequence of cHiragana has been input, and the sequence of cHiragana is terminated by input of a non-cHiragana. The second class of trigger sequences for Japanese handles this case. The second class contains trigger sequences which are at least two keystrokes in length and comprised of a keystroke causing a cHiragana symbol to be input followed by a keystroke or keystrokes causing a non-conversion symbol to be input. In summary, the first class of trigger sequences will cause conversion in cases such as input of a punctuation symbol, an end-message symbol, or some other symbol which indicates that the input of a contiguous sequence of cHiragana is definitively terminated. The second class of sequences allows for input of contiguous sequences of cHiragana interspersed with input of sequences of other symbols such as Hiragana symbols. In practice, for typical Japanese sentences, the second class of trigger sequences will be invoked more often than the first class.
Note that in some implementations a single keystroke could, a) terminate the input the previously displayed cHiragana, b) display a non-conversion symbol, and c) terminate the input of the non-conversion symbol. In such an implementation, the second and third keystrokes of the trigger sequences in the second class could correspond to the same physical act of stroking a key. In typical implementations especially those involving predictive software, the second and third keystrokes in the definition of the second class of trigger sequences will indeed correspond to two distinct physical keystrokes. Note also that a more elaborate system might allow for input of many different symbol types, such as all of cHiragana, Hiragana, cLatin, Latin, Katakana, punctuation symbols, etc. In these cases, more classes of trigger sequences might have to be defined. Extension of the teachings of this invention to such cases will be well within the grasp of a person skilled in the art who has read and understood the present disclosure. Similarly, it should be clear that a text-entry system for Chinese could involve several Latin-based symbol sets, with, for example, one set for the entry of languages based on Latin letters, and another Latin-based set of symbols for conversion to Hanzi.
Referring to
As will be developed in more detail below, relative to a simple but effective model of Korean, a simple set of trigger sequences may be defined. The model of Korean could a priori be based either on the model of Chinese or the model of Japanese, as presented above. Modeling Korean text entry on Japanese is preferred since a) in Korean entry of ideographic Hanja is often done without the use of tone marks, and b) the usual symbols used in Korean for representing sounds of Hanja, that is, the Jamo, are also used for entering Hangul, in the same way that Hiragana in Japanese have the dual role of being used both for entering Kanji, and to be represented qua Hiragana in the output text. To distinguish the dual roles of the Korean Jamo, we define a set of related cJamo, analogously with the construction of the set of cHiragana for Japanese. The cJamo are entered with the intent of being converted to Hanja, while the Jamo are entered with the intent of forming Hangul. The person skilled in the art will appreciate that the pair Latin/cLatin could also be used for Korean in the same way that the pair Latin/cLatin can be used for Japanese. Indeed any dual representation of the phonetic structure of Korean would be a basis for Korean text entry according to the teachings of this invention.
Thus in the Korean case, as in the Japanese case, there are two different classes of trigger sequences. The first class contains trigger sequences which are at least two keystrokes in length and are comprised of a keystroke causing a cJamo to be displayed followed by a keystroke on a key which generates a symbol-input-end symbol but which cannot generated a cJamo symbol.
The second class contains trigger sequences which are at least three keystrokes in length and comprised of a keystroke causing a cJamo symbol to be input, followed by a keystroke causing a non-conversion symbol to be additionally displayed, further followed by a keystroke generating a symbol-input-end symbol. Referring to
It will be appreciated that the mechanisms described flow charts of
It will also be appreciated that for the sake of clarity of presentation, flow-chart logical nodes representing null operations have been omitted.
Text-entry system classification. Turning now to
1) Systems evident to one skilled in the art,
2) Systems evident to one skilled in the art in view of GUTOWITZ (U.S. Pat. No. 6,219,731) or the Avios Article.
3) Novel systems with drawbacks.
4) Novel systems in which the drawbacks have been substantially eliminated.
The first column of the table describes an aspect of the design of a text-entry system, and the second and third columns give two major options for embodying the design aspect. In view of the definitions given above, and the non-limiting examples given below, the entries of the table are readily interpretable by one skilled in the art.
The design aspect considered are: 1) Pre-conversion: whether the pre-conversion symbols are presented in a variable or fixed order. 2) Pre-conversion advance: whether the presentation of multiple pre-conversion symbols on the same key are scrolled using a dedicated Next key or using multi-tap. 3) Tone mark: whether the tone mark is included in the variable ordering of other pre-conversion symbols, or always appears in a fixed order in relationship to the other pre-conversion symbols. That is, and this will be more fully described below, the tone mark assigned to a key may always be displayed after all of the pre-conversion symbols have been displayed in the scroll order, even if the other pre-conversion symbols are presented in a variable order. 4) Conversion: whether conversion occurs when a trigger sequence is entered, or when a tone mark is input (for systems which use tone marks as a pre-conversion symbol). Note that most prior-art systems perform conversion only upon a keystroke on a dedicated conversion key. 5) Post-conversion symbols. whether post-conversion symbols are presented in a variable or fixed order, independently of whether pre-conversion symbols are presented in a variable or fixed order. 6) Post-conversion advance. Whether post-conversion symbols are scrolled using a Next key or multi-tap, independently of the advance method used for the pre-conversion symbols. Note that in the case of both pre- and post-conversion symbols, the Next key could be implemented in a variety of hardware, such as a scroll wheel, a touch pad, etc. Similarly, a multi-tap method could be implemented as multiple actuations of various kinds of input mechanisms. 7) Predictive method: symbol-based or word-based. There are two broad classes of predictive text entry systems. In each case, a selection as to which symbol or symbols to display is based on context. A word-based system typically depends on a dictionary of known words to decide which word or symbol to display, while a symbol-based system does not. While most non-limiting examples presented in this disclosure assume a symbol-based approach, this is for clarity and conciseness of presentation, and should not be seen as a limitation of the invention to symbol-based systems. Trigger sequences work well for both symbol-based, word-based, as well as any hybrid systems.
In reference now to
Non-inventive application of the prior art to the telephone keypad.
Turning now to
A person skilled in the art wishing to apply the prior art for Chinese text entry to a telephone keypad would proceed to implement the set of aspects of the prior art text-entry systems as shown in
This system is operative to enter text, provided that the tone mark is placed at the end of the fixed order, after the letters. In this system, conversion occurs as soon as the tone mark is displayed, and yet a letter after the tone mark may have be been intended. The intended letter could not be entered since conversion would already have occurred. This restriction means that the number of keystrokes to enter a tone mark will always be high. Except for the tone mark 1 assigned to the key 801, at least four keystrokes would be required to enter each tone mark. In view of the teachings of Gutowitz (U.S. provisional Ser. 60/111,665, PCT/US99/29,343, WIPO WO 00/35091, and related patent documents), this difficulty could be overcome by the addition of a shift key such that e.g. the tone mark is entered by applying the shift key substantially simultaneously with the keystroke on the appropriate letter/tone mark key.
An additional drawback of this system is that error correction is difficult. In the event that a user who intends to enter a letter presses the letter key too many times, causing a tone mark to be entered and conversion to occur, the user must delete the displayed post-conversion symbol and start over again.
In view of the teachings of GUTOWITZ (U.S. Pat. No. 6,219,731) it would be evident to one skilled in the art to replace multi-tap advance with Next-key advance for either or both of pre-conversion or post-conversion symbols. This however, would not eliminate the stated drawbacks of this system.
Further in view of the teachings of GUTOWITZ '731 it would be obvious to one skilled in the art to use a predictive system to produce a variable order for either or both of the pre-conversion or post-conversion symbols. Non-obviously, as long as the tone mark were not predicted, and remained at the end of the order of the pre-conversion symbols, the complete system would be operative to enter text. The drawbacks cited would still remain, however.
In summary thus far, and in reference to
In summary and in reference to
In summary and in reference to
In reference to
Preferred embodiment for Chinese. We now present further details on the application of the invention to text entry for Chinese. To apply the trigger sequence method to Chinese, we follow the steps shown in
According to the teachings of this invention, trigger sequences may be discovered by a systematic method, as is explained in reference to
In the next step of the method, 101, the characteristics of the text-entry system are fully defined. These characteristics of the preferred embodiment have already been summarized in
To make the following description concrete but without the intent of limitation, we will consider that the tone marks are represented by the digits 1 through 5, and are entered at the end of each Pinyin syllable. This usage follows conventional practice. Note that in an alternate convention, tone marks are displayed as diacritics on the Latin letters to which they apply, not as numbers. It will be appreciated that this display convention does not alter the construction of the text-entry system, and the tone mark could be entered in any way. To simplify the specification of keystroke sequences, we will assume that a) only sequences of valid Pinyin are entered by the user, each followed by a tone mark, b) to each valid Pinyin syllable entered, there corresponds at least one Hanzi in the set of post-conversion symbols. In practical applications, mechanisms would be set up to deal with variant keystroke sequences, such as those containing pre-conversion sequences which are not valid Pinyin sequences. This may imply more complicated trigger sequences than are needed for this ideal text-entry system, described for the sake of pointing out features and applications of the invention.
At step 103, one should, for each pre-conversion symbol generated by the keystroke sequences of step 102, find a subsequence of keystrokes such that a) one of the keystrokes in the subsequence displays the given pre-conversion symbol and b) another keystroke in the subsequence i) generates a symbol-input-end symbol which applies to the given pre-conversion symbol, and ii) does not additionally display any pre-conversion symbols which follow the given pre-conversion symbol in any sequence of pre-conversion symbols which correspond to a post-conversion symbol.
In the present non-limiting example of Chinese, a set of keystrokes which meet these criteria are comprised of the last keystroke causing a tone mark to be displayed, followed by a keystroke on any other key but the Next key 812, as only 812 does not generate a symbol-input-end symbol which applies to a pre-conversion symbol. Where no such trigger sequences to be found, the method would return, in step 104, to step 100.
The operation of this system may be more fully appreciated though the consideration of some non-limiting examples. Turning now to
A second non-limiting example will help reinforce understanding of how trigger sequences can be used to seamlessly integrate predictive mechanisms on both pre-conversion and post-conversion symbols. This non-limiting example includes the operation of predictive mechanisms on both sets of symbols, and uses both pre-conversion and post-conversion Next keys to allow the user to correct errors in prediction, if any. For this second non-limiting example, we refer to
To put these two non-limiting examples in context and thus perfect understanding, we turn now to
An alternate embodiment for Chinese will now be described to show how the present invention can be implemented if multi-tap rather than Next key advance is used for pre-conversion symbols, a Next key is used for post-conversion symbol advance, and a fixed order is used for both pre-conversion and post-conversion symbols. With both this alternate embodiment and the preferred embodiment in mind, a person skilled in the art would be able to make and use systems with any of the aspects implemented according to any of the options of
To see a non-limiting example of this alternate embodiment in operation, we turn to
Application of the preferred embodiment to Japanese. Japanese is normally written in three distinct sets of symbols: Hiragana, Katakana, and Kanji. Often, additional symbols such as Latin letters and punctuation symbols are also provided in a text-entry system for Japanese. Typically, the Kanji are input by first inputting the Hiragana corresponding to the pronunciation of the Kanji, and then converting the Hiragana to Kanji, by offering the user a choice of the (possibly many) Kanji whose pronunciation is given by the Hiragana. When Hiragana are used for both conversion and non-conversion, there are no short, simple patterns relating Hiragana which are intended for conversion to those which are not intended to be converted. In prior-art conversion systems for Japanese, sophisticated software systems are often employed to attempt to distinguish the functional roles of Hiragana-to-be-converted and Hiragana-not-to-be-converted. These systems are demanding of computing power and memory, and even with state-of-the-art software, many conversion errors will be generated by such software. In typical applications of this invention to handheld devices, very limited computing power is available, making it in-feasible to use sophisticated conversion software. These drawbacks of prior-art conversion systems are substantially eliminated by the present invention. The preferred embodiment for Japanese of the present invention involves an additional inventive step: to recognize that in prior-art systems Hiragana play two distinct roles, and it is advantageous to split these roles into two distinct symbol sets. In the present disclosure, Hiragana-not-to-be-converted will be referred to simply as Hiragana, whereas Hiragana-to-be-converted will be referred to as Kanji-Hiragana or cHiragana. The set of cHiragana includes a symbol corresponding to each Hiragana symbol which would normally be used in a prior-art system to enter the pronunciation of a Kanji. When displayed to the user, the cHiragana symbols are marked in some way which distinguishes them from the corresponding Hiragana symbols. In a visual display, the distinction could be via some characteristic of the font in which the symbols are displayed such as color, shape, alignment, style, background, underlining, etc. In an auditory display, the distinction between Hiragana and cHiragana could be marked by, e.g., a difference in pitch. It will be appreciated that other display modes would allow for still other differences between Hiragana and cHiragana to be encoded. A visual distinction could also be made by providing a sub-display to distinctively separate the cHiragana from the Hiragana as they are entered. Less preferably, Katakana symbols could be paired with Hiragana symbols to form a converting/non-converting symbol set. An alternate embodiment would use an auxiliary display to show a symbol or marking (e.g. the letter k) when a cHiragana is displayed in the main display, and a different symbol or marking when a Hiragana is displayed in the main display. If Latin and corresponding cLatin letters were used instead of Hiragana and cHiragana, then the distinction between Latin and cLatin could be marked also by a difference in case. As Japanese is normally written with two symbol sets, Hiragana and Katakana, which represent the same phonetic values, and yet are visually distinct and represent different text-entry functions, the addition of yet another symbol set which is visually distinct and represents a still other text-entry function is intuitive to the Japanese. Note that in the present discussion we will focus on the roles of the basic Hiragana, their corresponding cHiragana, and Kanji. Input of additional symbol sets such as Hiragana with diacritics, Katakana, Latin letters, and punctuation may be supported in practical implementations of this invention, according to its teachings.
On prior-art telephone keypads for Japanese, Hiragana are assigned to keys in an order which obeys a modern standard. The essence of this arrangement is shown in
In the application of the preferred embodiment to Japanese, each of the keys of
Trigger sequences for Japanese. In the case of Chinese, and according to a standard method of entering Pinyin, there is one type of pre-conversion symbol which always appears at the end of a sequence of pre-conversion symbols which correspond to a given post-conversion Hanzi. This fact allows us to define a small set of trigger sequences which correspond well to intended conversions. As soon as a tone mark is input, a complete unit of pre-conversion symbols has been entered, permitting conversion to the intended post-conversion symbol, and a simple trigger sequence is sufficient to recognize this event. The case of Japanese is rather more subtle, as most pre-conversion cHiragana may appear at the beginning middle, or end of a sequence corresponding to some Kanji. For instance, the cHiragana pronounced RI appears at the beginning of the sequence RICHI, in the middle of the sequence SHIRIZOKU, and at the end of the sequence SATORI, each of these three cHiragana sequences corresponding to a Kanji. To account for this phenomenon, the preferred trigger sequences cause triggering which is delayed until it is unambiguously clear that sufficiently many pre-conversion symbols have been input to completely define the post-conversion symbols intended to be input by the user. When the user turns attention to the entry of a non-conversion symbol, terminates text input, or otherwise turns away from entering a sequence of cHiragana, we are assured that the user considers the intended post-conversion symbols to be fully defined by the contiguous sequence of pre-conversion symbols just entered. It is at this point that conversion can preferably be triggered. From the user's point of view, this means that sequences of cHiragana spanning several post-conversion symbols may be entered before a conversion is triggered. By contrast, in the preferred embodiment for Chinese, triggering occurs after a sequence of pre-conversion symbols defining a single post-conversion symbol is entered.
In the case of Japanese, a simple set of trigger sequences contains two different classes of trigger sequences. In the first class, the first keystroke displays a cHiragana, and a second keystroke genera symbol-input-end symbol applying to the displayed cHiragana, causing it to be input. For a keystroke sequence to be a trigger sequence in the first class, the second keystroke must be on a key to which no cHiragana have been assigned. This assures that the second keystroke could not be intended to further complete a subsequence of cHiragana which follow in sequence in in any sequence corresponding to the cHiragana input by the second keystroke. For example, if the first keystroke displayed the cHiragana RI, and the second keystroke does not display any cHiragana, then the system can verify that no sequence such as RICHI is intended, and that RI must be the last cHiragana in a sequence corresponding to a Kanji, such as SATORI. Thus, conversion can be safely triggered without risk of displaying Kanji whose pronunciation has not yet been fully entered. A person skilled in the art would appreciate that an alternate embodiment would attempt to convert earlier, before the full pronunciation is entered, as in typical word-completion systems. However, such systems are difficult to use and are not preferred. There are some cases in which the second keystroke does in fact display a cHiragana, and yet the system can still verify that no further cHiragana are being input which might, in conjunction with other cHiragana already input, correspond to a Kanji intended for input. This is a case, for instance, where the second keystroke is on a key to which both cHiragana and non-conversion symbols have been assigned, and yet the user indicates, by inputting one of the non-conversion symbols on the key rather than one of the cHiragana on the key, that a complete sequence of cHiragana has been entered. For the non-conversion symbol to be input, a symbol-input-symbol applying to the non-conversion symbol must be generated. Thus, an element of the second classes is characterized in that the first keystroke displays a cHiragana, and the second keystroke generates a symbol-input-end symbol which applies to the displayed cHiragana and also displays a non-conversion symbol and a third keystroke causing said displayed non-conversion symbol to be input.
It should be evident to one skilled in the art that the two symbols entered by the second keystroke could in fact be entered using separate keystrokes, and, conversely, still other symbols might additionally be entered by the keystrokes in the trigger sequence.
It will be appreciated that the first class is very similar in operation to the trigger sequences used above in the application of the preferred embodiment to Chinese. Use of the second class of sequences is described by non-limiting example in reference to
Turning then to
Multiple Next keys for pre-conversion symbols. We have already seen how multiple Next keys can be implemented to advance the symbol displayed without inputting a symbol, and where the type of symbol advanced depends on which of the multiple Next keys is activated. In the examples above, a Next key was assigned to pre-conversion symbols and another Next key was assigned to post-conversion symbols. Similarly, a separate Next key can be used for pre-conversion symbols and non-conversion symbols. This is useful when both pre- and non-conversion symbols are assigned to the same key, as is the case of the preferred embodiment as it is applied to Chinese, Japanese, and Korean. In the case of Japanese, for instance, cHiragana and Hiragana are assigned to the same keys, in a preferred embodiment. Also in a preferred embodiment, both the cHiragana and the Hiragana appear mixed in the same order when a single Next key is used to advance over both symbol sets. Preferably, when one Next key is used for Hiragana and a separate Next key is used for cHiragana, a keystroke on the Hiragana Next key presents the next Hiragana available in the fixed or variable order and a keystroke on the cHiragana Next presents the next cHiragana in the fixed or variable order. A similar effect can be achieved by implementing a symbol set selection key which allows the user to select the set of symbols to which one or more Next keys apply. For instance, a single Next key combined with a symbol set select key could be used to advance either pre- non- or post-conversion symbols, depending on the setting selected. An advantage of the multiple Next key approach taught here is that no additional keystrokes are required on a symbol set select key. A following example will illustrate the use of a separate Next key for pre- and non-conversion symbols.
The person skilled in the art will appreciate that the method can be extended further, including, for instance, a Next key for Hiragana, another one for Katakana, still another for cHiragana, another for punctuation, another for digits, etc., if representatives of each of these classes of symbols are assigned to the same key or keys.
The Iroha keypad assignments. The main advantage of the keypad labeling of
Both of these drawbacks can be reduced by means of a novel assignment of Hiragana to keys of the keypad herein disclosed. The arrangement is based on a well-known poem, commonly given the name Iroha. It is written using all of the Hiragana syllables (excluding syllables involving diacritics, and the symbol representing the N sound) exactly once. The order of the syllables in the poem was once used as a dictionary order, but fallen out of use for this purpose in modern times. It is first disclosed here that the Iroha ordering has surprising advantages for use in conjunction with text entry on a reduced keyboard, and patent rights for such use are hereby claimed. Using the Iroha arrangement means assigning Hiragana to keys in substantially the Iroha order, so that if all symbols are represented on the keys, the poem can be read from the keys. Following the common usage of keypad labeling, a limited subset of the Hiragana from the order may actually appear on the label, so as to not over clutter the keypad with symbols. The advantages for text entry of the Iroha arrangement include: 1) The number of symbols per key can be better balanced between keys than in the prior-art arrangement. The details of the assignment can be varied more readily than with the standard arrangement. In particular, the partition of the order can be done following word boundaries in the poem, balancing the symbol assignment across keys without unduly impairing the ability of users to memorize the assignment.
2) For the same reasons, the assignment can be optimized according the method of GUTOWITZ (wiredraws) in order to reduce the number of keystrokes required to enter text.
3) The number of keys to which Hiragana can be memorably assigned is variable. The standard ordering rigidly implies a fixed number of keys, one per linguistic group of Hiragana symbols, while the Iroha ordering can be flexibly and memorably partitioned, e.g., according to word boundaries, and one or more words can be made to correspond to each key.
Referring to
To appreciate how a keypad labeled in a substantially Iroha ordering can be used to enter Japanese text, we turn to
Preferred Embodiment for Korean.
Input of Korean using the preferred embodiment is very similar to input of Japanese. Korean is typically entered using Jamo which correspond for present purposes to Hiragana in that they are used to specify the pronunciation of the post-conversion Hanja which correspond in turn to Japanese Kanji. While Kanji are essential for writing good Japanese, Hanja can often be dispensed with in writing good Korean. Nonetheless, Korean and Japanese are similar in that in prior-art text entry system the Jamo and Hiragana play the role of both pre-conversion symbols and non-conversion symbols. This makes Korean and Japanese similar from the point of view of implementing and using the preferred embodiment. One skilled in the art will appreciate that a difference between Jamo and Hiragana is that Jamo are typically converted to Hangul upon entry, the Hangul being packages of Jamo arranged spatially in a particular way to visually represent syllables. The Jamo-Hangul conversion is independent of the Jamo-Hanja conversion and is carried out by algorithms well known to those skilled in the art. Thus the Jamo-Hangul conversion will be ignored in the following, for the sake of clarity of presentation. Jamo-Hangul conversion could also be implemented in the preferred embodiment, operating on pre-conversion symbols or non-conversion symbols, or both.
According the teachings of this inventions, a text-entry system for Korean comprises non-conversion symbols comprised of Jamo, pre-conversion symbols comprised of cJamo, and post-conversion symbols comprised of Hanja, a mechanism to display the symbols, and a mechanism to recognize trigger sequences. There are at least two classes of trigger sequences. In the first class, trigger sequences comprise a first keystroke which displays a cJamo, and a second keystroke which generates a symbol-input-end symbols which applies to the displayed cJamo. If the second keystroke is on a key to which no cJamo have been assigned, then conversion is trigger when these keystrokes are entered. Trigger sequences in the second class are characterized in that the first keystroke causes the display of a cJamo, and the second keystroke generates a symbol-input-end symbol which applies to the displayed cJamo and also displays a non-conversion symbol, such as a Jamo and a third keystroke which generates a symbol-input-end symbol which applies to the displayed non-conversion symbol causing it to be input.
In order to present a non-limiting example of text input for Korean using the preferred embodiment we need to choose an assignment of Jamo and cJamo to the keys of a text-input device.
Turing then to
Note that this non-limiting example is presented to particularly point out features of the invention. It will be appreciated that many aspects of the example could be changed and yet remain within the scope of the invention. For instance, either the non-conversion or pre-conversion symbols could be Latin letters or some other symbol set. A prediction system on pre- or post-conversion symbols was not required, an algorithm to package Jamo into Hangul could have be simultaneously operative with the operations of the invention, the assignment of Jamo and cJamo to keys could have been different, etc.
Remote conversion. Predictive systems for post-conversion symbols seek to reduce the keystrokes required for the user to input desired post-conversion symbols. Even with a good predictive system for post-conversion symbols, it may be necessary for the user to occasionally adjust predictions, for instance using a C-Next key as has been shown in several non-limiting examples. The computational requirements for a good post-conversion predictive system may be quite high. A further inventive step according to the teachings of this invention is to substantially eliminate the need for post-conversion keystrokes, and to substantially eliminate the computation requirements in the user's input device. The key insight is that by inputting information distinguishing pre-conversion from non-conversion symbols, e.g. cHiragana from (non-conversion) Hiragana, the user has substantially increased the likelihood that a fully automatic conversion system of sufficient power produce effectively error-free conversion. For example in the case of Japanese, prior-art conversion systems must decide, for each Hiragana entered if a) the Hiragana is meant to be part of the pronunciation of a Kanji or to be represented in the text as a Hiragana, and b) if the entered Hiragana is mean to be converted to a Kanji, which Kanji symbol is meant? The ambiguity due to these combined decisions limits the effectiveness of even the powerful and resource-demanding conversion systems. By distinguishing cHiragana from Hiragana at the time of input, the user creates an input sequence which is much easier to disambiguation. Therefore, we claim a system in which an output stream of non-converted or partially converted symbols, comprised, e.g. in the case under discussion, of cHiragana and Hiragana, and potentially other symbols as well. The user does not attempt to convert all of the cHiragana, but instead relies on a remote server to do the processing. As the remote server is not under the same cost and size constraints as the (typically handheld) input terminal, the remote server can be an arbitrarily powerful computer running arbitrarily sophisticated software. Therefore, the remote server can operate on the input stream to process conversions. The substantially fully converted input stream can than be passed on for further processing, such as sent to the target recipient of a message.
The operation of this system may be appreciated more fully by reference to
Error correction and implied trigger sequences The trigger sequence method is presented above in an idealized context in which text is always correctly entered by the user, and thus correct trigger sequences are entered whenever conversion would normally be desired. In practice, this may not be the case, and some mechanism could be proto correct for errors and omissions by the user. For instance, in Chinese, if the user should have entered a Pinyin sequence such as shang1wen4 but omitted the tone mark 1, writing instead shangwen4, it might still be possible for error-correcting software to reliably supply the missing tone mark, using string-matching algorithms well-known to those skilled in the art. This is due to the fact that the sequence shangwen4 would not occur in ideal text entry using this text-entry system, and shang1wen4 may well be the most likely ideal sequence which is similar to the actually entered sequence. The error-correction software matches the ideal sequence which contains a defined trigger sequence to the actually entered sequence and thus provides an implied trigger sequence effective to trigger conversion to the mechanism effective to recognize and process trigger sequences. Depending on the computing resources available in the device in which the text-entry system is implemented, error-correcting mechanisms may be arbitrarily sophisticated and powerful.
It should be emphasized that the above-descried embodiments of the present invention, particularly any “preferred” embodiments, are merely possible examples of implementations, merely set forth for a clear understanding of the principles of the invention. Many variations and modifications may be made to the above-described embodiments of the invention without departing substantially from the spirit and principles of the invention. All such modifications and variations are intended to be included herein with the scope of the disclosure and the present invention and protected by the appended claims.
Claims
1. A text-entry system based on trigger sequences comprising: such that at least one fixed sequence of keystrokes corresponds to more than one sequence of said pre-conversion symbols, and each post-conversion symbol of said set of post-conversion symbols being set in a correspondence to at least one pre-conversion symbol, wherein said set of said pre-conversion symbols is disjoint from said set said of post-conversion symbols such that no sequence of pre-conversion symbols is equal to any sequence of post-conversion symbols; wherein m and n are integers, m≧1, n≧1, and m≧n; wherein each trigger sequence of keystrokes has two parts:
- 1) a plurality of keys,
- 2) a plurality of printable symbols, said plurality of printable symbols comprising a set of pre-conversion symbols, a set of post-conversion symbols and a set of non-conversion symbols, such that at least one of said plurality of keys is assigned more than one pre-conversion symbols of said set of pre-conversion symbols, and
- 3) a plurality of non-printable symbols, each of which is generated by a keystroke on any one of said plurality of keys, including at least one key of said plurality of keys also having at least one of said pre-conversion symbols or at least one of said non-conversion symbols assigned to it, the plurality of non-printable symbols including a plurality of non-printable symbol-input-end symbols, wherein each non-printable symbol-input-end symbol generated by said at least one key is always generated if and only if one of said at least one of said pre-conversion symbols or said at least one of said non-conversion symbols assigned to said at least one key is displayed in response to a same keystroke which generates said non-printable symbol-input-end symbol;
- 4) a display to display said plurality of printable symbols,
- 5) a first mechanism to display said plurality of printable symbols in response to keystrokes, and
- 6) a second mechanism to recognize, upon generation of a non-printable symbol-input-end symbol of said plurality of non-printable symbol-input-end symbols, trigger sequences of keystrokes and thereby trigger conversion of m pre-conversion symbols displayed on said display to n post-conversion symbols intended for display on said display,
- a) a first part comprising only keystrokes that are minimally required to display said m pre-conversion symbols, said m pre-conversion symbols corresponding to said n post-conversion symbols intended for display on said display, wherein said first part does not comprise a keystroke indicating an end to the entry of keystrokes corresponding to said m pre-conversion symbols, in addition to the minimally required keystrokes to display said m pre-conversion symbols; and
- b) a second part including a keystroke on said at least one key, said keystroke triggering conversion of said m pre-conversion symbols into said n post-conversion symbols and at the same time displaying said n post-conversion symbols intended for display together with a pre-conversion symbol or a non-conversion symbol assigned to said at least one key.
2. The text-entry system of claim 1 further characterized in that:
- 1) said set of pre-conversion symbols comprises tone marks and symbols selected from a set of Latin symbols and Bopomofo symbols,
- 2) said set of post-conversion symbols comprises Hanzi, and
- said m pre-conversion symbols comprise a tone mark.
3. The text-entry system of claim 1 further characterized in that:
- 1) said pre-conversion symbols comprise cHiragana,
- 2) said post-conversion symbols comprise Kanji, and
- 3) said non-conversion symbols comprise Hiragana.
4. The text-entry system of claim 1 further comprising a third mechanism to convert said m pre-conversion symbols to said n post-conversion symbols upon recognition of a trigger sequence of said set of trigger sequences by said second mechanism.
5. The text-entry system of claim 4 further characterized in that said third mechanism is physically remote from said first mechanism.
6. The text-entry system of claim 1 further comprising a predictive text mechanism operating to select said m pre-conversion symbols for display, said m pre-conversion symbols for display being the most likely m pre-conversion symbols for display based on the first part of a trigger sequence.
7. The text-entry system of claim 1 further comprising at least one Next key for incrementing symbols in an ordered list containing more than one element, said Next key characterized in that a keystroke on said Next key does not generate a symbol-input-end symbol.
8. The text-entry system of claim 1 further comprising a multi-tap mechanism for incrementing symbols in an ordered list containing more than one element.
9. The text entry system of claim 2 further characterized in that each time one of said tone marks is displayed, it is only displayed after a plurality of said Latin symbols have been displayed but not input.
10. The text-entry system of claim 1 further comprising:
- a first Next key applying to a plurality of said pre-conversion symbols such that a keystroke on said first Next key advances said pre-conversion symbols in an order, and
- a second Next key applying to a plurality of non-conversion symbols such that a keystroke on said second Next said key advances said non-conversion symbols in an order,
- said first Next key characterized in that a keystroke on said first Next key does not generate a symbol-input-end symbol,
- and said second Next key characterized in that a keystroke on said second Next key does not generate a symbol-input-end symbol.
11. The text-entry system of claim 3 further characterized in that a plurality of said pre-conversion symbols are assigned to said keys in a substantially Iroha ordering.
12. The text-entry system of claim 1 further comprising an assignment of cHiragana to said plurality of keys in a substantially Iroha ordering.
13. The text-entry system of claim 1 further comprising a word-based predictive mechanism.
14. The text-entry system of claim 13 further comprising a word-completion mechanism.
15. The text-entry system of claim 2 further characterized in that said tone mark appears in said order after any of said Latin symbols in said order.
3833765 | September 1974 | Hilborn et al. |
3929216 | December 1975 | Einbinder |
4058795 | November 15, 1977 | Balm |
4360892 | November 23, 1982 | Endfield |
4447692 | May 8, 1984 | Mierzwinski |
4475013 | October 2, 1984 | Lee et al. |
4522518 | June 11, 1985 | Schmidt |
4555193 | November 26, 1985 | Stone |
4608457 | August 26, 1986 | Fowler et al. |
4615629 | October 7, 1986 | Power |
4650927 | March 17, 1987 | James |
4674112 | June 16, 1987 | Kondraske et al. |
4677659 | June 30, 1987 | Dargan |
4679951 | July 14, 1987 | King et al. |
4680572 | July 14, 1987 | Meguire et al. |
4715736 | December 29, 1987 | McGunnigle |
4737980 | April 12, 1988 | Curtin et al. |
4754474 | June 28, 1988 | Feinson |
4775255 | October 4, 1988 | Langley |
4791556 | December 13, 1988 | Vilkaitis |
4817129 | March 28, 1989 | Riskin |
4836700 | June 6, 1989 | Jensen |
4866759 | September 12, 1989 | Riskin |
5003503 | March 26, 1991 | Lapeyre |
5031206 | July 9, 1991 | Riskin |
5040479 | August 20, 1991 | Thrash |
5087910 | February 11, 1992 | Guyot-sionnest |
5097425 | March 17, 1992 | Baker et al. |
5128672 | July 7, 1992 | Kaehler |
5175803 | December 29, 1992 | Yeh |
5200988 | April 6, 1993 | Riskin |
5210689 | May 11, 1993 | Baker et al. |
5255310 | October 19, 1993 | Kim et al. |
5288158 | February 22, 1994 | Matias |
5297041 | March 22, 1994 | Kushler et al. |
5305238 | April 19, 1994 | Starr et al. |
5332322 | July 26, 1994 | Gambaro |
5339358 | August 16, 1994 | Danish et al. |
5367298 | November 22, 1994 | Axthelm |
5392338 | February 21, 1995 | Danish et al. |
D357011 | April 4, 1995 | Paull et al. |
D357476 | April 18, 1995 | Paull et al. |
5410333 | April 25, 1995 | Conway |
5432510 | July 11, 1995 | Matthews |
D362432 | September 19, 1995 | Paull et al. |
5458425 | October 17, 1995 | Torok |
5469160 | November 21, 1995 | Yang et al. |
5473346 | December 5, 1995 | Pollack |
5479536 | December 26, 1995 | Comerford |
5487616 | January 30, 1996 | Ichbiah |
5497151 | March 5, 1996 | Dombroski |
5507021 | April 9, 1996 | Siegle |
5515305 | May 7, 1996 | Register et al. |
5535119 | July 9, 1996 | Ito et al. |
5535421 | July 9, 1996 | Weinreich |
5543818 | August 6, 1996 | Scott |
5559512 | September 24, 1996 | Jainski et al. |
5574482 | November 12, 1996 | Niemeier |
5575576 | November 19, 1996 | Roysden |
5581243 | December 3, 1996 | Ouellette et al. |
5625354 | April 29, 1997 | Lerman |
5627566 | May 6, 1997 | Litschel |
5659769 | August 19, 1997 | Kida et al. |
5661476 | August 26, 1997 | Wang et al. |
5661505 | August 26, 1997 | Livits |
5661605 | August 26, 1997 | Conway |
5664896 | September 9, 1997 | Blumberg |
5675329 | October 7, 1997 | Barker et al. |
5675819 | October 7, 1997 | Schuetze |
5724449 | March 3, 1998 | Comerford |
5724457 | March 3, 1998 | Fukushima |
5734749 | March 31, 1998 | Yamada et al. |
5745056 | April 28, 1998 | Takahashi et al. |
5748177 | May 5, 1998 | Baker et al. |
5748512 | May 5, 1998 | Vargas |
5790103 | August 4, 1998 | Willner |
5793312 | August 11, 1998 | Tsubai |
5797098 | August 18, 1998 | Schroeder et al. |
5809415 | September 15, 1998 | Rossmann |
5818437 | October 6, 1998 | Grover et al. |
5828991 | October 27, 1998 | Skiena et al. |
5847697 | December 8, 1998 | Sugimoto |
5859599 | January 12, 1999 | Shiga |
5861821 | January 19, 1999 | Kato et al. |
5880685 | March 9, 1999 | Weeks |
5896321 | April 20, 1999 | Miller et al. |
5903630 | May 11, 1999 | Collins |
5911485 | June 15, 1999 | Rossmann |
5936555 | August 10, 1999 | Zagnoev |
5936557 | August 10, 1999 | Liddle |
5945928 | August 31, 1999 | Kushler et al. |
5950809 | September 14, 1999 | Andre |
5952942 | September 14, 1999 | Balakrishnan et al. |
5953541 | September 14, 1999 | King et al. |
5959629 | September 28, 1999 | Masui |
5963671 | October 5, 1999 | Comerford et al. |
5982303 | November 9, 1999 | Smith |
5982351 | November 9, 1999 | White et al. |
5984548 | November 16, 1999 | Willner et al. |
5990890 | November 23, 1999 | Etheredge |
5993089 | November 30, 1999 | Burrell, IV |
6004049 | December 21, 1999 | Knox |
6005495 | December 21, 1999 | Connolly et al. |
6005498 | December 21, 1999 | Yang et al. |
6011554 | January 4, 2000 | King et al. |
6037942 | March 14, 2000 | Millington |
6043761 | March 28, 2000 | Burrell, IV |
6047196 | April 4, 2000 | Makela |
6047300 | April 4, 2000 | Walfish et al. |
6054941 | April 25, 2000 | Chen |
6088220 | July 11, 2000 | Katz |
6121960 | September 19, 2000 | Carroll et al. |
6130628 | October 10, 2000 | Schneider-Hufschmidt et al. |
6150962 | November 21, 2000 | Rossmann |
6160536 | December 12, 2000 | Forest |
6172625 | January 9, 2001 | Jin et al. |
6181328 | January 30, 2001 | Shieh et al. |
6184803 | February 6, 2001 | Burrell, IV |
6219731 | April 17, 2001 | Gutowitz |
6232892 | May 15, 2001 | Burrell, IV |
6232956 | May 15, 2001 | Mailman |
D443615 | June 12, 2001 | Kirchner |
6243460 | June 5, 2001 | Bhagavatula |
6262716 | July 17, 2001 | Raasch |
6271835 | August 7, 2001 | Hoeksma |
6286064 | September 4, 2001 | King et al. |
6295052 | September 25, 2001 | Kato et al. |
6295509 | September 25, 2001 | Driskell |
6307548 | October 23, 2001 | Flinchem et al. |
6307549 | October 23, 2001 | King et al. |
6356258 | March 12, 2002 | Kato et al. |
6359572 | March 19, 2002 | Vale |
6405060 | June 11, 2002 | Schroeder et al. |
6492977 | December 10, 2002 | Marshall |
6587675 | July 1, 2003 | Riddiford |
6636162 | October 21, 2003 | Kushler et al. |
6646573 | November 11, 2003 | Kushler et al. |
6661404 | December 9, 2003 | Sirola et al. |
6703963 | March 9, 2004 | Higginson |
6734881 | May 11, 2004 | Will |
6765504 | July 20, 2004 | Ouyang |
6771191 | August 3, 2004 | Motoe |
6885317 | April 26, 2005 | Gutowitz |
6900794 | May 31, 2005 | San |
6903723 | June 7, 2005 | Forest |
7440889 | October 21, 2008 | Skiena et al. |
7761175 | July 20, 2010 | Gutowitz et al. |
RE43082 | January 10, 2012 | Gutowitz |
20010011271 | August 2, 2001 | Takahashi et al. |
20010040550 | November 15, 2001 | Vance et al. |
20020044814 | April 18, 2002 | King et al. |
20020196163 | December 26, 2002 | Bradford et al. |
20030006956 | January 9, 2003 | Wu et al. |
20040165924 | August 26, 2004 | Griffin |
20040247362 | December 9, 2004 | King et al. |
20060190256 | August 24, 2006 | Stephanick et al. |
760655 | May 2003 | AU |
2005325740 | August 2006 | AU |
2353862 | November 2007 | CA |
2354155 | October 2010 | CA |
1218233 | September 2005 | CN |
3235752 | March 1984 | DE |
28533 | May 1981 | EP |
66991 | May 1981 | EP |
279555 | August 1988 | EP |
319193 | June 1989 | EP |
364112 | April 1990 | EP |
201294 | July 1991 | EP |
213022 | September 1991 | EP |
457077 | November 1991 | EP |
595114 | May 1994 | EP |
651315 | May 1995 | EP |
544123 | April 1997 | EP |
779759 | June 1997 | EP |
2299884 | October 1996 | GB |
2343414 | May 2000 | GB |
9128134 | May 1997 | JP |
10177446 | June 1998 | JP |
10207601 | August 1998 | JP |
10207608 | August 1998 | JP |
11272403 | October 1999 | JP |
WO 85/01596 | April 1985 | WO |
WO 89/02369 | March 1989 | WO |
WO 91/03782 | March 1991 | WO |
WO 92/12491 | July 1992 | WO |
WO 94/06139 | March 1994 | WO |
WO 95/18405 | July 1995 | WO |
WO 96/02394 | February 1996 | WO |
WO 96/27947 | September 1996 | WO |
WO 96/30822 | October 1996 | WO |
WO 97/05541 | February 1997 | WO |
WO 97/30386 | August 1997 | WO |
WO 98/08688 | March 1998 | WO |
WO 98/09270 | March 1998 | WO |
WO 98/16055 | April 1998 | WO |
WO 98/33110 | July 1998 | WO |
WO 98/33111 | July 1998 | WO |
WO 99/15951 | April 1999 | WO |
WO 99/30222 | June 1999 | WO |
WO 00/08547 | February 2000 | WO |
WO 00/35091 | June 2000 | WO |
WO-0034880 | June 2000 | WO |
WO 2005/026897 | March 2005 | WO |
2006080927 | August 2006 | WO |
WO-2008034112 | March 2008 | WO |
2001/4509 | September 2002 | ZA |
- Dick Penn; “User Interface Design Principles”; Sep. 2001, Postive Interaction Inc. http//positiveinteraction.com/carleton/2001Principles.ppt.
- D.S. Blough; “Pigeon perception of letters of the alphabet”; Science Oct. 22, 1982; 218(4570) 397-8 (abstract).
- Dedre Gentner; “Structure-Mapping: A Theoretical Framework for Analogy”; Cognitive Science 7, pp. 155-170 (1983).
- Ronald Ferguson (2000); “Modeling Orientation Effects in Symmetry Detection”; Proc. 22nd Cog. Sci. Soc. Erlbaum, Pub.
- Pedro Felzenszwalb; “Representation and Detection of Deformable Shapes”; to appear in the IEEE Transactions of Pattern Analysis and Machine Intelligence.
- Scott Berkun; “The Myth of Discoverability”; Essays on web design interaction, usability experience architecture, etc.; No. 26, www.ulweb.com/issues/issue26.htm (undated).
- A. Chris Long et al; “Visual Similarity of Pen Gestures”; to appear in Proceedings of Human Factors in Computing Systems (SIGGHI '00).
- Robert Goldstone; “Similarity”; in R.A. Wilson & F.C. Keil (eds.) MIT encyclopedia of the cognitive sciences. (pp. 763-765), Cambridge, MA.
- Eric Weisstein; “Affine Transformation”; from MathWorld—A Wolfram Web Resource. Http//mathworld.wolfram.com/AffineTransformation.html.
- Robert Goldstone and J. Yun Son; “Similarity”; The Cambridge Handbook of Thinking and Reasoning; Eds: Keith Holyoak, Robert Morrison, Cambridge University Press, In Press.
- D.Blough; “The Perception of Similarity”; in Avian Visual Cognition; E: Robert G. Cook. http//www.pigeon.psy.tufts.edu/avc/toc.htm (Sep. 2001).
- Erich Goldmeier; “Similarity in Visually Perceived Forms”; Psychology Issues vol. VIII/No. 1, Monograph 29, International Universities Press (1972).
- Jean Mark Gowron; “Groups, Modular Arithmetic, and Cryptography”; Linguistics; San Diego State University ; www.rohan.sdsu.edu/-gawron; Jul. 24, 2004.
- J.P. Davis; “Let your fingers do the spelling”; disambiguating words spelled with the telephone keypad, Avros Journal; 9:53-66; Mar. 1991.
- “U.S. Appl. No. 09/856,863, Notice of Allowance mailed Nov. 30, 2004”, 4 pgs.
- “U.S. Appl. No. 09/856,863, Preiiminary Amendment mailed May 24, 2001”, 143 pgs.
- “U.S. Appl. No. 11/814,769, Final Office Action mailed Dec. 22, 2010”, 10 pgs.
- “U.S. Appl. No. 11/814,769, Non Final Office Action mailed Jul. 9, 2010”, 9 pgs
- “U.S. Appl. No. 11/814,769, Response filed Apr. 13, 2011 to Final Office Action mailed Dec. 22, 2010”, 17 pgs.
- “U.S. Appl. No. 11/814,769, Response filed Oct. 6, 2010 to Non Final Office Action mailed Jul. 9, 2010”, 16 pgs.
- “U.S. Appl. No. 11/814,769, Appeal Brief filed Sep. 30, 2011”, 29 pgs.
- “U.S. Appl. No. 11/814,769, Examiner's Answer mailed Dec. 6, 2011 to Appeal Brief filed Sep. 30, 2011”, 12 pgs.
- “International Application Serial No. PCT/USO4/29115, Search Report mailed Oct. 14, 2005”, 1 pg.
- “International Application Serial No. PCT/USO4/29115, Written Opinion mailed Oct. 14, 2005”, 4 pgs.
- Gutowitz, Howard Andrew, “Efficient Merger of Telephone Keypad and Typewriter Keyboard Conventions”, U.S. Appl. No. 60/844,592, (filed Sep. 14, 2006), 93 pgs.
- Gutowitz, Howard Andrew, et al., “Keypads Row Similar to a Telephone Keypad”, U.S. Appl. No. 60/905,054, (filed Mar. 5, 2007), 55 pgs.
- Gutowitz, Howard Andrew, et al., “Row Similar Extensions of Telephone Keypads”, U.S. Appl. No. 60/932,449, (filed May 31, 2007), 73 pgs.
- Gutowitz, Howard Andrew, et al., “Row Similar Extensions of Telephone Keypads”, U.S. Appl. No. 60/958,775. (filed Jul. 9, 2007), 105 pgs.
- Gutowitz, Howard Andrew, et al,, “Row Similar Extensions of Telephone Keypads”, U.S. Appl. No. 60/962,267, (filed Jul. 27, 2007), 95 pgs.
- Gutowitz, Howard Andrew, “Keyboard Comprising Swipe-Switches Performing Keyboard Actions”, U.S. Appl. No. 61/270,843, (filed Jul. 14, 2009), 67 pgs.
- Gutowitz, Howard Andrew, “Method and Apparatus for Accelerated Entry of Symbols on a Reduced Keyboard”, U.S. Appl. No. 60/277,293, (filed Mar. 20, 2001). 44 pgs.
- Gutowitz, Howard Andrew, “Apparatus for Message Triage”, U.S. Appl. No. 61/587,152, (filed Jan. 17, 2012), 32 pgs.
- “Nokia User's Guide”, Nokia Corporation, Finland, No. 6, 1996, 100 pgs.
- Belongie, Serge, et al,, “Shape Matching and Object Recognition Using Shape Contexts”, IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, No. 24, Apr. 2002, pp. 509-522.
Type: Grant
Filed: Sep 11, 2003
Date of Patent: Jun 12, 2012
Patent Publication Number: 20050060448
Assignee: Eatoni Ergonomics, Inc. (Brooklyn, NY)
Inventor: Howard Andrew Gutowitz (New York, NY)
Primary Examiner: Tanh Nguyen
Application Number: 10/605,157
International Classification: G06F 3/023 (20060101); G06F 3/02 (20060101); H03K 17/94 (20060101); H03M 11/00 (20060101);