Abstract: Methods, apparatuses, and embodiments related to interactively predicting fields in a form. A computer system received an image of a form. A user moves a cursor to a first field of the form, and the computer system automatically displays a predicted location of the field, including a bounding box that represents a boundary of the field. The computer system further predicts the field name/label based on text in the document. The user clicks on the field to indicate that he wants to digitize the field. When needed, the user interactively modifies the size of the bounding box that represents the extent of the field, changes the name/label of the field. Once finalized, the user can cause the field information (e.g., the bounding box coordinate, the bounding box location, the name/label of the field, etc.) to be written to a database.

Abstract: Disclosed are a method and apparatus for determining a given variation of a form used by a filled in instance of that type of form from amongst a number of form templates. The given instance is aligned to each of the variants or form templates. The result of the alignment includes a series of key points that did not match up well (“bad” key points). The bad key points are taken from the form templates. Then, a set of pixel patches from around each of the bad key points of the form templates are extracted. The pixel patches are individually compared to corresponding pixel patches of the instance. The comparison generates a match score. The form template having the greatest match score is the correct form template.

Abstract: Disclosed are a method and apparatus for identifying versions of a form. In an example, clients of a medical company fill out many forms, and many of these forms have multiple versions. The medical company operates in 10 states, and each state has a different version of a client intake form, as well as of an insurance identification form. In order to automatically extract information from a particular filled out form, it may be helpful to identify a particular form template, as well as the version of the form template, of which the filled out form is an instance. A computer system evaluates images of filled out forms, and identifies various form templates and versions of form templates based on the images.

Abstract: Introduced here is a machine learning related technique for supplying an observed model additional training data based upon previously received training data. To determine textual content of a character string based on a digital image that includes a handwritten version of the character string a substantial amount of training data is used. The character string can include one or more characters, and the characters can include any of letters, numerals, punctuation marks, symbols, spaces, etc. Disclosed herein is a technique to determine variations between different images of matching known character strings and substitute those variations into the images in order to create more images with the same known character string.

Abstract: Methods, apparatuses, and embodiments related to aligning an image of a table of a form with an image of a table of a template of the form. Automatically extracting data entered in fields of a table of a form by a user can be aided by matching the form with a template of the form. The form template can have a digitized representation that identifies locations of fields of the form, and that identifies labels of the fields. Matching the form with the form template can enable locations and labels of fields of the form to be identified based on the digitized representation. However, matching the form with the form template may require matching the table of the form with the table of the form template, and matching two tables can be challenging. For example, the tables can be rotated, warped, scaled, etc. relative to each other.

Abstract: Methods, apparatuses, and embodiments related to analyzing the content of digital images. A computer extracts multiple sets of visual features, which can be keypoints, based on an image of a selected object. Each of the multiple sets of visual features is extracted by a different visual feature extractor. The computer further extracts a visual word count vector based on the image of the selected object. An image query is executed based on the extracted visual features and the extracted visual word count vector to identify one or more candidate template objects of which the selected object may be an instance. When multiple candidate template objects are identified, a matching algorithm compares the selected object with the candidate template objects to determine a particular candidate template of which the selected object is an instance.

Abstract: Disclosed are a method and apparatus for storing and/or digitizing documents that preserves the confidentiality of the documents. The technology includes a process, referred to herein as “shredding”, that extracts portions of a digitized document, such as a scanned document or an image file, to create “shreds.” A shred can be, for example, a field of a form, a portion of a photo, etc. In some embodiments where the source document includes confidential information, each individual shred does not include the confidential information and, with information of only one shred, a person cannot obtain the confidential information. As a result, while the source document needs to be stored in a secure fashion to prevent disclosure of the confidential information, the shreds can be stored in a non-secure fashion without risking disclosure of the confidential information.

Abstract: Methods, apparatuses, and embodiments related to interactively predicting fields in a form. A computer system received an image of a form. A user moves a cursor to a first field of the form, and the computer system automatically displays a predicted location of the field, including a bounding box that represents a boundary of the field. The computer system further predicts the field name/label based on text in the document. The user clicks on the field to indicate that he wants to digitize the field. When needed, the user interactively modifies the size of the bounding box that represents the extent of the field, changes the name/label of the field. Once finalized, the user can cause the field information (e.g., the bounding box coordinate, the bounding box location, the name/label of the field, etc.) to be written to a database.

Abstract: Methods, apparatuses, and embodiments related to interactively predicting fields in a form. A computer system received an image of a form. A user moves a cursor to a first field of the form, and the computer system automatically displays a predicted location of the field, including a bounding box that represents a boundary of the field. The computer system further predicts the field name/label based on text in the document. The user clicks on the field to indicate that he wants to digitize the field. When needed, the user interactively modifies the size of the bounding box that represents the extent of the field, changes the name/label of the field. Once finalized, the user can cause the field information (e.g., the bounding box coordinate, the bounding box location, the name/label of the field, etc.) to be written to a database.

Abstract: Methods, apparatuses, and embodiments related to analyzing the content of digital images. A computer extracts multiple sets of visual features, which can be keypoints, based on an image of a selected object. Each of the multiple sets of visual features is extracted by a different visual feature extractor. The computer further extracts a visual word count vector based on the image of the selected object. An image query is executed based on the extracted visual features and the extracted visual word count vector to identify one or more candidate template objects of which the selected object may be an instance. When multiple candidate template objects are identified, a matching algorithm compares the selected object with the candidate template objects to determine a particular candidate template of which the selected object is an instance.