Patents by Inventor Jan W. Amtrup

Jan W. Amtrup has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10380237
    Abstract: Systems, methods, and computer program products for smart, automated capture of textual information using optical sensors of a mobile device, and selective provision of such textual information to a user interface for facilitating performance of downstream workflows are disclosed. The capture and provision is context-aware, and determines context of the optical input, and optionally invokes a contextually-appropriate workflow based thereon. The techniques also provide capability to normalize, correct, and/or validate the captured optical input and provide the corrected, normalized, validated, etc. information to the contextually-appropriate workflow. As a result, the overall process of capturing information from optical input using a mobile device, invoking an appropriate workflow, and providing captured information to the workflow is significantly simplified and improved in terms of accuracy of data transfer/entry, speed and efficiency of workflows, and user experience.
    Type: Grant
    Filed: August 8, 2017
    Date of Patent: August 13, 2019
    Assignee: KOFAX, INC.
    Inventors: Anthony Macciola, Jan W. Amtrup
  • Publication number: 20190171900
    Abstract: Techniques for binarization and extraction of information from image data are disclosed. The inventive concepts include independently binarizing portions of the image data on the basis of individual features, e.g. per connected component, and using multiple different binarization thresholds to obtain the best possible binarization result for each portion of the image data. Determining the quality of each binarization result may be based on attempted recognition and/or extraction of information therefrom. Independently binarized portions may be assembled into a contiguous result. In one embodiment, a method includes: identifying a region of interest within a digital image; generating a plurality of binarized images based on the region of interest using different binarization thresholds; subjecting the region of interest within a digital image to a plurality of thresholding and extraction iterations; and extracting data from some or all of the plurality of binarized images.
    Type: Application
    Filed: February 4, 2019
    Publication date: June 6, 2019
    Inventors: Christopher W. Thrasher, Alexander Shustorovich, Stephen Michael Thompson, Jan W. Amtrup, Anthony Macciola
  • Publication number: 20190164313
    Abstract: Computer-implemented methods for detecting objects within digital image data based on color transitions include: receiving or capturing a digital image depicting an object; sampling color information from a first plurality of pixels of the digital image; optionally sampling color information from a second plurality of pixels of the digital image; generating or receiving a representative background color profile based on the color information sampled from the first plurality of pixels; generating or receiving a representative foreground color profile based on the color information sampled from the second plurality of pixels and/or the first plurality of pixels; assigning each pixel a label; binarizing the digital image based on the labels; detecting contour(s) within the binarized digital image; and defining edge(s) of the object based on the detected contour(s). Corresponding systems and computer program products configured to perform the inventive methods are also described.
    Type: Application
    Filed: November 30, 2018
    Publication date: May 30, 2019
    Inventors: Jiyong Ma, Stephen M. Thompson, Jan W. Amtrup
  • Publication number: 20190164010
    Abstract: Computerized techniques for real-time object detection from video data include: defining an analysis profile comprising an initial number of analysis cycles dedicated to each of a plurality of detectors, each detector being independently configured to detect objects according to a unique set of analysis parameters; receiving a plurality of frames of digital video data, the digital video data depicting an object; analyzing the plurality of frames using the plurality of detectors and in accordance with the analysis profile, wherein analyzing the plurality of frames produces an analysis result for each of the plurality of detectors; determining a confidence score for each of the analysis results; and updating the analysis profile by adjusting the number of analysis cycles dedicated to at least one of the plurality of detectors based on the confidence scores. Corresponding systems and computer program products are also disclosed.
    Type: Application
    Filed: November 30, 2018
    Publication date: May 30, 2019
    Inventors: Jiyong Ma, Stephen M. Thompson, Jan W. Amtrup
  • Patent number: 10242285
    Abstract: Techniques for improved binarization and extraction of information from digital image data are disclosed in accordance with various embodiments. The inventive concepts include independently binarizing portions of the image data on the basis of individual features, e.g. per connected component, and using multiple different binarization thresholds to obtain the best possible binarization result for each portion of the image data independently binarized. Determining the quality of each binarization result may be based on attempted recognition and/or extraction of information therefrom. Independently binarized portions may be assembled into a contiguous result. In one embodiment, a method includes: identifying a region of interest within a digital image; generating a plurality of binarized images based on the region of interest using different binarization thresholds; and extracting data from some or all of the plurality of binarized images. Corresponding systems and computer program products are also disclosed.
    Type: Grant
    Filed: July 19, 2016
    Date of Patent: March 26, 2019
    Assignee: KOFAX, INC.
    Inventors: Christopher W. Thrasher, Alexander Shustorovich, Stephen Michael Thompson, Jan W. Amtrup, Anthony Macciola
  • Publication number: 20190087942
    Abstract: A method of detecting an object depicted in a digital image includes: detecting a plurality of identifying features of the object, wherein the plurality of identifying features are located internally with respect to the object; projecting a location of region(s) of interest of the object based on the plurality of identifying features, where each region of interest depicts content; building and/or selecting an extraction model configured to extract the content based at least in part on: the location of the region(s) of interest, the of identifying feature(s), or both; and extracting the some or all of the content from the digital image using the extraction model. Corresponding system and computer program product embodiments are disclosed. The inventive concepts enable reliable extraction of data from digital images where portions of an object are obscured/missing, and/or depicted on a complex background.
    Type: Application
    Filed: November 16, 2018
    Publication date: March 21, 2019
    Inventors: Jiyong Ma, Stephen M. Thompson, Jan W. Amtrup
  • Patent number: 10235446
    Abstract: According to one embodiment, a computer-implemented method for cleaning up a data set having a possible incorrect label includes: selecting a plurality of training documents; estimating a quality of an organization of a plurality of categories; and determining whether the quality of the organization is greater than a predetermined quality threshold. Corresponding system and computer program product embodiments are also presented. Other aspects and advantages of the present invention will become apparent from the following detailed description, which, when taken in conjunction with the drawings, illustrate by way of example the principles of the invention.
    Type: Grant
    Filed: August 1, 2017
    Date of Patent: March 19, 2019
    Assignee: KOFAX, INC.
    Inventors: Mauritius A. R. Schmidtler, Jan W. Amtrup, Stephen Michael Thompson, Anthony Sarah
  • Publication number: 20190034456
    Abstract: In various embodiments, methods, systems, and computer program products for processing digital images captured by a mobile device are disclosed. The exemplary image processing techniques are coupled with inbound and outbound communications protocols and workflows configured to facilitate closed-loop processing, such that a method includes initiating a workflow; providing one or more of case information and raw data to the workflow; processing one or more of the case information and the raw data to generate a processing result; storing at least some of the case information in association with the processing result, wherein the associated case information acts as an identifier of the processing result; transmitting at least the processing result and the identifier; receiving, in response to the transmitting, a reply comprising the identifier; and retrieving at least the processing result using the identifier.
    Type: Application
    Filed: August 1, 2018
    Publication date: January 31, 2019
    Inventors: Anthony Macciola, Jan W. Amtrup
  • Publication number: 20190035061
    Abstract: Systems, computer program products, and techniques for detecting and/or reconstructing objects depicted in digital image data within a three-dimensional space are disclosed, according to various exemplary embodiments. The inventive concepts uniquely utilize internal features to accomplish reconstruction, thereby avoiding reliance on reconstructing objects based on information derived from location of edges. The inventive concepts thus provide an improvement over conventional object reconstruction since objects may be detected and/or reconstructed even when edges are obscured or not depicted in the digital image data. In one aspect, reconstructing an object depicted in a digital image includes using a processor to: detect a plurality of identifying features of the object, where the identifying features are located internally with respect to the object; and reconstruct the digital image of the object within a three dimensional coordinate space based at least in part on some or all of the identifying features.
    Type: Application
    Filed: October 3, 2018
    Publication date: January 31, 2019
    Inventors: Jiyong Ma, Stephen Michael Thompson, Jan W. Amtrup
  • Patent number: 10146803
    Abstract: A method includes receiving user input defining a workflow comprising one or more activities and one or more rules; receiving user input defining a user interface (UI) configured to facilitate a user performing the workflow at least in part using a processor of a mobile device; and generating a mobile software application based on the workflow and the UI. In another embodiment, a method includes: instantiating a mobile application on a mobile device; launching a workflow within the mobile application, the workflow comprising one or more activities and one or more rules; rendering one or more user interfaces based at least in part on the workflow; displaying at least one of the user interfaces on a display of the mobile device; receiving user input via at least one of the user interfaces; and modifying the workflow based at least partially on user input. Systems and computer program products are also disclosed.
    Type: Grant
    Filed: August 18, 2015
    Date of Patent: December 4, 2018
    Assignee: KOFAX, INC
    Inventors: Steven Kilby, Anthony Macciola, Jan W. Amtrup, Bruce Orcutt
  • Patent number: 10146795
    Abstract: In various embodiments, methods, systems, and computer program products for processing digital images captured by a mobile device are disclosed. The exemplary image processing techniques are coupled with inbound and outbound communications protocols and workflows configured to facilitate closed-loop processing, such that a method includes initiating a workflow; providing one or more of case information and raw data to the workflow; processing one or more of the case information and the raw data to generate a processing result; storing at least some of the case information in association with the processing result, wherein the associated case information acts as an identifier of the processing result; transmitting at least the processing result and the identifier; receiving, in response to the transmitting, a reply comprising the identifier; and retrieving at least the processing result using the identifier.
    Type: Grant
    Filed: July 20, 2015
    Date of Patent: December 4, 2018
    Assignee: KOFAX, INC.
    Inventors: Anthony Macciola, Jan W. Amtrup
  • Patent number: 10140510
    Abstract: Computer program products for discriminating hand and machine print from each other, and from signatures, are disclosed and include program code readable and/or executable by a processor to: receive an image, determine a color depth of the image; reducing the color depth of non-bi-tonal images to generate a bi-tonal representation of the image; identify a set of one or more graphical line candidates in either the bi-tonal image or the bi-tonal representation, the graphical line candidates including true graphical lines and/or false positives; discriminate any of the true graphical lines from any of the false positives; remove the true graphical lines from the bi-tonal image or the bi-tonal representation without removing the false positives to generate a component map comprising connected components and excluding graphical lines; identify one or more of the connected components in the component map; and output and/or display and indicator of each of the connected components.
    Type: Grant
    Filed: March 2, 2018
    Date of Patent: November 27, 2018
    Assignee: KOFAX, INC.
    Inventors: Alexander Shustorovich, Christopher W. Thrasher, Anthony Macciola, Jan W. Amtrup
  • Patent number: 10140511
    Abstract: According to one embodiment, a computer-implemented method is configured for building a classification and/or data extraction knowledge base using an electronic form. The method includes: receiving an electronic form having associated therewith a plurality of metadata labels, each metadata label corresponding to at least one element of interest represented within the electronic form; parsing the plurality of metadata labels to determine characteristic features of the element(s) of interest; building a representation of the electronic form based on the plurality of metadata labels; generating a plurality of permutations of the representation of the electronic form by applying a predetermined set of variations to the representation; and training either a classification model, an extraction model, or both using: the representation of the electronic form, and the plurality of permutations of the representation of the electronic form. Corresponding systems and computer program products are also disclosed.
    Type: Grant
    Filed: December 30, 2016
    Date of Patent: November 27, 2018
    Assignee: KOFAX, INC.
    Inventors: Anthony Macciola, Jan W. Amtrup, Stephen Michael Thompson
  • Patent number: 10127441
    Abstract: In one embodiment, a system includes: a processor; and logic in and/or executable by the processor to cause the processor to: generate a first feature vector based on a digital image captured by a mobile device; compare the first feature vector to a plurality of reference feature matrices; classify an object depicted in the digital image as a member of a particular object class based at least in part on the comparison; determine one or more object features of the object based at least in part on the particular object class; and detect one or more additional objects belonging to the particular object class based on the determined object feature(s). The one or more additional objects are depicted either in the digital image or another digital image received by the mobile device. Corresponding computer program products are also disclosed.
    Type: Grant
    Filed: December 20, 2016
    Date of Patent: November 13, 2018
    Assignee: KOFAX, INC.
    Inventors: Jan W. Amtrup, Anthony Macciola, Steve Thompson, Jiyong Ma, Alexander Shustorovich, Christopher W. Thrasher
  • Patent number: 10127636
    Abstract: Systems, computer program products, and techniques for reconstructing objects depicted in digital image data within a three-dimensional space are disclosed, according to various exemplary embodiments. The inventive concepts uniquely utilize internal features to accomplish reconstruction, thereby avoiding reliance on reconstructing objects based on information derived from location of edges. The inventive concepts thus provide an improvement over conventional object reconstruction since objects may be reconstructed even when edges are obscured or not depicted in the digital image data.
    Type: Grant
    Filed: August 11, 2016
    Date of Patent: November 13, 2018
    Assignee: KOFAX, INC.
    Inventors: Jiyong Ma, Stephen Michael Thompson, Jan W. Amtrup
  • Patent number: 10108860
    Abstract: According to one embodiment, a system includes a processor and logic in and/or executable by the processor to cause the processor to: initiate a capture operation using an image capture component of the mobile device, the capture operation comprising; capturing video data; and estimating a plurality of motion vectors corresponding to motion of the image capture component during the capture operation; detect a document depicted in the video data; track a position of the detected document throughout the video data; select a plurality of images using the image capture component of the mobile device, wherein the selection is based at least in part on: the tracked position of the detected document; and the estimated motion vectors; and generate a composite image based on at least some of the selected plurality of images.
    Type: Grant
    Filed: December 23, 2016
    Date of Patent: October 23, 2018
    Assignee: KOFAX, INC.
    Inventors: Jiyong Ma, Anthony Macciola, Jan W. Amtrup
  • Patent number: 10049268
    Abstract: A method includes: displaying a digital image on a first portion of a display of a mobile device; receiving user feedback via the display of the mobile device; analyzing the user feedback to determine a meaning of the user feedback; based on the determined meaning of the user feedback, analyzing a portion of the digital image corresponding to either the point of interest or the region of interest to detect one or more connected components depicted within the portion of the digital image; classifying each detected connected component depicted within the portion of the digital image; estimating an identity of each detected connected component based on the classification of the detected connected component; and one or more of: displaying the identity of each detected connected component on a second portion of the display of the mobile device; and providing the identity of each detected connected component to a workflow.
    Type: Grant
    Filed: March 2, 2016
    Date of Patent: August 14, 2018
    Assignee: KOFAX, INC.
    Inventors: Anthony Macciola, Alexander Shustorovich, Christopher W. Thrasher, Jan W. Amtrup
  • Publication number: 20180189695
    Abstract: Computer program products for performing workflows using a mobile device, without requiring tactile input from the user. The workflow is thus “touchless” and may utilize input preferably including optical data and/or audio data. Tactile input may be optionally provided in some embodiments, but the workflow is configured to be performed without any tactile input. Accordingly, in one embodiment, a computer program product includes a computer readable medium having computer readable and/or executable program instructions embodied therewith, the program instructions being configured to cause a processor to: invoke a mobile application using a mobile device; receive auditory input via the mobile device; and perform a business workflow via the mobile application based on the auditory input. Corresponding systems and computer program product embodiments configured for touchless mobile workflows are also described.
    Type: Application
    Filed: March 2, 2018
    Publication date: July 5, 2018
    Inventors: Anthony Macciola, Jan W. Amtrup, Jiyong Ma
  • Publication number: 20180189558
    Abstract: Computer program products for discriminating hand and machine print from each other, and from signatures, are disclosed and include program code readable and/or executable by a processor to: receive an image, determine a color depth of the image; reducing the color depth of non-bi-tonal images to generate a bi-tonal representation of the image; identify a set of one or more graphical line candidates in either the bi-tonal image or the bi-tonal representation, the graphical line candidates including true graphical lines and/or false positives; discriminate any of the true graphical lines from any of the false positives; remove the true graphical lines from the bi-tonal image or the bi-tonal representation without removing the false positives to generate a component map comprising connected components and excluding graphical lines; identify one or more of the connected components in the component map; and output and/or display and indicator of each of the connected components.
    Type: Application
    Filed: March 2, 2018
    Publication date: July 5, 2018
    Inventors: Alexander Shustorovich, Christopher W. Thrasher, Anthony Macciola, Jan W. Amtrup
  • Patent number: 9996741
    Abstract: In one embodiment, a method includes receiving a digital image captured by a mobile device; and using a processor of the mobile device: generating a first representation of the digital image, the first representation being characterized by a reduced resolution; generating a first feature vector based on the first representation; comparing the first feature vector to a plurality of reference feature matrices; classifying an object depicted in the digital image as a member of a particular object class based at least in part on the comparing; and determining one or more object features of the object based at least in part on the particular object class. Corresponding systems and computer program products are also disclosed.
    Type: Grant
    Filed: May 17, 2016
    Date of Patent: June 12, 2018
    Assignee: KOFAX, INC.
    Inventors: Jan W. Amtrup, Anthony Macciola, Steve Thompson, Jiyong Ma, Alexander Shustorovich, Christopher W. Thrasher