Abstract: In a figure recognizing system according to the invention comprising a scanning section, a detecting section, thesauruses, a similarity computing section, a storage register for storing detected information from the detecting section and a recognizing section for recognizing the final letter information, threshold table means in which letter combinations and corresponding threshold levels are stored as pairs, a category judgement section for receiving the output of the similarity computing section, obtaining a similarity difference from the maximum and next maximum similarity values and comparing the similarity difference thus obtained and a corresponding threshold level in the threshold table means to judge the category of said letter, format table means where a predetermined category series is stored, and format judging means for comparing the category supplied from the detecting section and category judgement section connected thereto and the category series supplied from the format table means.