SYSTEM AND METHOD FOR REAL TIME TRANSLATION
A system and method for real time translation of scanned documents includes a multifunction peripheral having intelligent controller including a processor and associated memory. A scan engine generates an electronic image of a tangible document and a touchscreen user interface receives a user scan instruction. The scan operation generates a scan file and a generated image of the document is displayed on the touchscreen. A user selects an area of the generated image via the touchscreen. An optical character recognition operation generates a character based file which is then translated from a source language to a target language. The resultant translation is then displayed on the touchscreen.
This application claims the benefit of U.S. Provisional Application No. 62/410,520, filed Oct. 20, 2016, which is incorporated herein by reference.
TECHNICAL FIELDThis application relates generally to a multifunction peripheral with integrated machine translation. The application relates more particularly to translation of specified areas of a scanned document selected from a preview image displayed on a device touchscreen.
BACKGROUNDDocument processing devices include printers, copiers, scanners and e-mail gateways. More recently, devices employing two or more of these functions are found in office environments. These devices are referred to as multifunction peripherals (MFPs) or multifunction devices (MFDs). As used herein, MFPs are understood to comprise printers, alone or in combination with other of the afore-noted functions. It is further understood that any suitable document processing device can be used.
MFPs are becoming increasingly capable and increasingly complex. User control and interaction is typically made via a touchscreen working in concert with an intelligent controller comprised of an on board computer system.
MFPs may have integrated scanners that will take a physical document and generate a corresponding electronic image scan file. Many MFPs have an ability to convert a scan file to various file formats, such as portable document format (PDF), Joint Photographic Experts Group (JPEG), Graphical Image Format (GIF), tagged information file format (TIFF), bitmap (BMP), Portable Network Graphics (PNG), or the like.
SUMMARYIn accordance with an example embodiment of the subject application, a system and method for real time translation of scanned documents includes a multifunction peripheral having an intelligent controller including a processor and associated memory. A scan engine generates an electronic image of a tangible document and a touchscreen user interface receives a user scan instruction. The scan operation generates a scan file which provides an image of the document on the touchscreen. A user selects an area of the generated image via the touchscreen. An optical character recognition operation generates a character based file which is then translated from source language to a target language. The resultant translation is then displayed on the touchscreen.
Various embodiments will become better understood with regard to the following description, appended claims and accompanying drawings wherein:
The systems and methods disclosed herein are described in detail by way of examples and with reference to the figures. It will be appreciated that modifications to disclosed and described examples, arrangements, configurations, components, elements, apparatuses, devices methods, systems, etc. can suitably be made and may be desired for a specific application. In this disclosure, any identification of specific techniques, arrangements, etc. are either related to a specific example presented or are merely a general description of such a technique, arrangement, etc. Identifications of specific details or examples are not intended to be, and should not be, construed as mandatory or limiting unless specifically designated as such.
Once a file has been scanned on an MFP into an electronic format as noted above, it is possible to run an application on a computer or workstation which is able to extract character information from graphical files in a process called optical character recognition (OCR). A user loads an image file and the application generates a character inclusive file that can be printed or edited with a standard word processing application. Characters may be encoded in any suitable format such as ASCII, EBCDIC, ISO 8859, Unicode, JIS or the like. Characters may include phonetic characters, such as used in western Europe or the Americas, or ideographs, such as used in Asian countries.
Another application may take a character encoded file and perform a machine translation between languages. This can also be done online, such as by use of GOOGLE translate, which is a service instantly translates words, phrases, and web pages between English and over 100 other languages.
From the forgoing, if one desires to scan a document for translation, it can be a time consuming process. First, a scan has to be made, such as by an MFP. A resulting scan file must be captured and loaded into an OCR program for conversion. The resultant OCR file must be then loaded into a machine translation application for conversion. If a printout is then desired, the machine translated file must be brought to or sent to an MFP for printing. In such an instance, the entire translated document will be printed, unless user determines which page or pages are needed and manually selects only these pages for printing.
This process is a time consuming and labor intensive mechanism for securing a printout of a machine translation to a scanned document. In addition, it requires more processing power than may be required if only a portion of a scanned document is desired for translation as there is generally no mechanism to translate only a portion of a page. This can lead to problems, such as when a document includes multiple languages, since translation programs need to identify a source file language and a target file language to work. In some instances, a document may contain quotes or excerpts in one language and a text body in another language. A user may only need to translated selected portions of a document. Example embodiments herein provide for real time scanning of documents with machine translation of document portions selected by a user working from a preview image displayed on a device touchscreen. The translated portion is suitably superimposed on the preview image and a user may print the resultant, hybridized page. This may be all be completed in a single operation.
In accordance with the subject application,
Interface rendering 116, with added reference to
Next, with added reference to
With added reference to
Turning now to
Processor 602 is also in data communication with a storage interface 608 for reading or writing to a storage 616, suitably comprised of a hard disk, optical disk, solid-state disk, cloud-based storage, or any other suitable data storage as will be appreciated by one of ordinary skill in the art.
Processor 602 is also in data communication with a network interface 610 which provides an interface to a network interface controller (NIC) 614, which in turn provides a data path to any suitable wired or physical network connection 620, or to a wireless data connection via wireless network interface 618. Example wireless connections include cellular, Wi-Fi, Bluetooth, NFC, wireless universal serial bus (wireless USB), satellite, and the like. Example wired interfaces include Ethernet, USB, IEEE 1394 (FireWire), Lightning, telephone line, or the like.
Processor 602 can also be in data communication with any suitable user input/output (I/O) interface 619 which provides data communication with user peripherals, such as displays, keyboards, mice, track balls, touchscreens, or the like.
Also in data communication with data bus 612 is a document processor interface 622 suitable for data communication with NFP functional units 650. In the illustrate example, these units include copy hardware 640, scan hardware 642, print hardware 644 and fax hardware 546 which together comprise MFP functional hardware 650. Hardware monitors suitably provide device event data, working in concert with suitable monitoring systems. By way of further example, monitoring systems may include page counters, sensor output, such as consumable level sensors, temperature sensors, power quality sensors, device error sensors, door open sensors, and the like. It will be understood that functional units are suitably comprised of intelligent units, including any suitable hardware or software platform.
Referring next to
Next, a user may choose to print a document form displayed, hybrid image at block 744, or perform any other desire action such as saving, e-mailing or faxing the image. Processing then ends at block 752.
While certain embodiments have been described, these embodiments have been presented by way of example only, and are not intended to limit the scope of the inventions. Indeed, the novel embodiments described herein may be embodied in a variety of other forms; furthermore, various omissions, substitutions and changes in the form of the embodiments described herein may be made without departing from the spirit of the inventions. The accompanying claims and their equivalents are intended to cover such forms or modifications as would fall within the spirit and scope of the inventions.
Claims
1. A multifunction peripheral comprising:
- an intelligent controller including a processor and associated memory;
- a scan engine configured to generate an electronic image; and
- a touchscreen user interface configured to receive a scan instruction from an associated user,
- wherein the controller is configured to engage the scan engine to scan a tangible document to generate a scan file,
- wherein the controller is further configured to generate an image of the document on the touchscreen from the scan file,
- wherein the controller is further configured to receive a user selected area of a generated image via the touchscreen,
- wherein the controller is further configured to complete an optical character recognition operation on the user selected area to generate a character based file,
- wherein the controller is further configured to process an electronic translation of the character based file from source language to a target language, and
- wherein the controller is further configured to display the electronic translation on the touchscreen.
2. The multifunction peripheral of claim 1 wherein the controller is further configured to process the electronic translation in accordance with a user identified source language and a user identified target language received via the touchscreen.
3. The multifunction peripheral of claim 1 wherein the controller is further configured to generated an updated image of the document on the touchscreen wherein the selected area is replaced with the electronic translation.
4. The multifunction peripheral of claim 1 wherein the controller is further configured to generate an updated scan file wherein an image area of the scan file corresponding to the user selected area is replaced with an image of the electronic translation.
5. The multifunction peripheral of claim 4 wherein the controller is further configured to generate a printout of the updated scan file in accordance with user input received via the touchscreen.
6. The multifunction peripheral of claim 4 wherein the controller is further configured to send the updated scan file to a user supplied destination address.
7. The multifunction peripheral of claim 1 wherein the controller is further configured to receive a user selected area comprising the entire image of the document on the touchscreen in accordance with double tap input received via the touchscreen.
8. A method comprising:
- receiving a scan instruction from a user via a touchscreen;
- engaging a scan engine of a multifunction peripheral to scan a tangible document to generate a scan file responsive to the received scan instruction;
- generating an image of the document on the touchscreen from the scan file;
- receiving a user selected area of a generated image via the touchscreen;
- completing an optical character recognition operation on the user selected area to generate a character based file;
- processing an electronic translation of the character based file from a source language to a target language; and
- displaying the electronic translation on the touchscreen.
9. The method of claim 8 further comprising processing the electronic translation in accordance with a user identified source language and a user identified target language received via the touchscreen.
10. The method of claim 8 further comprising generating an updated image of the document on the touchscreen wherein the selected area is replaced with the electronic translation.
11. The method of claim 8 further comprising generating an updated scan file wherein an image area of the scan file corresponding to the user selected area is replaced with an image of the electronic translation.
12. The method of claim 11 further comprising generating a printout of the updated scan file in accordance with user input received via the touchscreen.
13. The method of claim 11 further comprising sending the updated scan file to a user supplied destination address.
14. The method of claim 8 further comprising receiving a user selected area comprising the entire image of the document on the touchscreen in accordance with double tap input received via the touchscreen.
15. A system comprising:
- a scanner configured to generate an electronic scan file corresponding to an image inclusive of written characters on a tangible document; and
- a processor configured to generate a document image of the tangible document on a touchscreen display from the scan file,
- wherein the processor is further configured to receive a user selected area on the document image,
- wherein the processor is further configured to perform an optical character recognition operation on the scan file to generate a source language file including encoded characters corresponding to the written characters,
- wherein the processor is further configured to translate encoded characters in the source file to translated encoded characters in a target language file, and
- wherein the processor is further configured to generate an image of translated encoded characters corresponding to the user selected area on the touchscreen display.
16. The system of claim 15 wherein the processor is further configured to identify the source language from the source language file.
17. The system of claim 15 wherein the processor is further configured to translate the source file to a target language selected by an associated user via the touchscreen.
18. The system of claim 17 wherein the processor is further configured to superimpose the image of translated encoded characters on the user selected area of the document image.
19. The system of claim 18 wherein the processor is further configured to initiate a printout of the document image that includes the superimposed image.
20. The system of claim 15 wherein the processor is further configured to identify the source language in accordance with a user language selection received via the touchscreen.
Type: Application
Filed: Aug 31, 2017
Publication Date: Apr 26, 2018
Inventor: Marianne KODIMER (Huntington Beach, CA)
Application Number: 15/692,707