Patents by Inventor Jan W. Amtrup

Jan W. Amtrup has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11967164
    Abstract: Systems, methods and computer program products for detecting objects using a multi-detector are disclosed, according to various embodiments. In one aspect, a computer-implemented method includes defining analysis profiles, where each analysis profile: corresponds to one of a plurality of detectors, and comprises: a unique set of analysis parameters and/or a unique detection algorithm. The method further includes analyzing image data in accordance with the analysis profiles; selecting an optimum analysis result based on confidence scores associated with different analysis results; and detecting objects within the optimum analysis result. According to additional aspects, the analysis parameters may define different subregions of a digital image to be analyzed; a composite analysis result may be generated based on analysis of the different subregions by different detectors; and the optimum analysis result may be based on the composite analysis result.
    Type: Grant
    Filed: April 13, 2023
    Date of Patent: April 23, 2024
    Assignee: KOFAX, INC.
    Inventors: Jiyong Ma, Stephen M. Thompson, Jan W. Amtrup
  • Publication number: 20240048658
    Abstract: A computer program product for detecting an object depicted in a digital image includes: a computer readable storage medium; and program instructions configured to cause a processor to perform a method comprising: detecting a plurality of identifying features of the object, wherein the plurality of identifying features are located internally with respect to the object; projecting a location of region(s) of interest of the object based on the plurality of identifying features, where each region of interest depicts content; building and/or selecting an extraction model configured to extract the content based at least in part on: the location of the region(s) of interest, the of identifying feature(s), or both; and extracting the some or all of the content from the digital image using the extraction model. The inventive concepts enable reliable extraction of data from digital images where portions of an object are obscured/missing, and/or depicted on a complex background.
    Type: Application
    Filed: October 6, 2023
    Publication date: February 8, 2024
    Inventors: Jiyong Ma, Stephen M. Thompson, Jan W. Amtrup
  • Publication number: 20240046180
    Abstract: According to one aspect, a computer-implemented method of discovering processes for robotic process automation (RPA) includes: recording a plurality of event streams, each event stream corresponding to a human user interacting with a computing device to perform one or more tasks; concatenating the event streams; segmenting some or all of the concatenated event streams to generate one or more application traces performed by the user interacting with the computing device, each application trace corresponding to one of the one or more tasks performed by the user; clustering the traces according to a task type; identifying, from among some or all of the clustered traces, one or more candidate processes for robotic automation; prioritizing the candidate processes; and selecting at least one of the prioritized candidate processes for robotic automation. Corresponding systems and computer program products are also described.
    Type: Application
    Filed: October 10, 2023
    Publication date: February 8, 2024
    Inventors: Jiyong Ma, Stephen Michael Thompson, Jan W. Amtrup
  • Patent number: 11836662
    Abstract: According to one aspect, a computer-implemented method of discovering processes for robotic process automation (RPA) includes: recording a plurality of event streams, each event stream corresponding to a human user interacting with a computing device to perform one or more tasks; concatenating the event streams; segmenting some or all of the concatenated event streams to generate one or more individual traces performed by the user interacting with the computing device, each trace corresponding to a particular task; clustering the traces according to a task type; identifying, from among some or all of the clustered traces, one or more candidate processes for robotic automation; prioritizing the candidate processes; and selecting at least one of the prioritized candidate processes for robotic automation. Further aspects building upon the above include generating RPA models to perform tasks determined to be processes for RPA. Corresponding systems and computer program products are also described.
    Type: Grant
    Filed: February 17, 2022
    Date of Patent: December 5, 2023
    Assignee: KOFAX, INC.
    Inventors: Jiyong Ma, Stephen Michael Thompson, Jan W. Amtrup
  • Patent number: 11818303
    Abstract: A computer-implemented method of detecting an object depicted in a digital image includes: detecting a plurality of identifying features of the object, wherein the plurality of identifying features are located internally with respect to the object; projecting a location of region(s) of interest of the object based on the plurality of identifying features, where each region of interest depicts content; building and/or selecting an extraction model configured to extract the content based at least in part on: the location of the region(s) of interest, the of identifying feature(s), or both; and extracting the some or all of the content from the digital image using the extraction model. Corresponding system and computer program product embodiments are disclosed. The inventive concepts enable reliable extraction of data from digital images where portions of an object are obscured/missing, and/or depicted on a complex background.
    Type: Grant
    Filed: August 27, 2020
    Date of Patent: November 14, 2023
    Assignee: KOFAX, INC.
    Inventors: Jiyong Ma, Stephen M. Thompson, Jan W. Amtrup
  • Publication number: 20230252810
    Abstract: Systems, methods and computer program products for detecting objects using a multi-detector are disclosed, according to various embodiments. In one aspect, a computer-implemented method includes defining analysis profiles, where each analysis profile: corresponds to one of a plurality of detectors, and comprises: a unique set of analysis parameters and/or a unique detection algorithm. The method further includes analyzing image data in accordance with the analysis profiles; selecting an optimum analysis result based on confidence scores associated with different analysis results; and detecting objects within the optimum analysis result. According to additional aspects, the analysis parameters may define different subregions of a digital image to be analyzed; a composite analysis result may be generated based on analysis of the different subregions by different detectors; and the optimum analysis result may be based on the composite analysis result.
    Type: Application
    Filed: April 13, 2023
    Publication date: August 10, 2023
    Inventors: Jiyong Ma, Stephen M. Thompson, Jan W. Amtrup
  • Patent number: 11694456
    Abstract: Systems, methods and computer program products for detecting objects using a multi-detector are disclosed, according to various embodiments. In one aspect, a computer-implemented method includes defining an analysis profile comprising an initial number of analysis cycles dedicated to each of a plurality of detectors, where each detector is independently configured to detect objects according to a unique set of analysis parameters and/or a unique detector algorithm. The method also includes: receiving digital video data that depicts at least one object; analyzing the digital video data using some or all of the detectors in accordance with the analysis profile, where the analyzing produces an analysis result for each detector used in the analysis. Further, the method includes updating the analysis profile by adjusting the number of analysis cycles dedicated to at least one of the detectors based on the analysis results.
    Type: Grant
    Filed: June 15, 2021
    Date of Patent: July 4, 2023
    Assignee: KOFAX, INC.
    Inventors: Jiyong Ma, Stephen M. Thompson, Jan W. Amtrup
  • Publication number: 20230206664
    Abstract: Computer-implemented methods for detecting objects within digital image data based on color transitions include: receiving or capturing a digital image depicting an object; sampling color information from a first plurality of pixels of the digital image, wherein each of the first plurality of pixels is located in a background region of the digital image; assigning each pixel a label of either foreground or background using an adaptive label learning process; binarizing the digital image based on the labels assigned to each pixel; detecting contour(s) within the binarized digital image; and defining edge(s) of the object based on the detected contour(s). Corresponding systems and computer program products configured to perform the inventive methods are also described.
    Type: Application
    Filed: February 27, 2023
    Publication date: June 29, 2023
    Inventors: Jiyong Ma, Stephen M. Thompson, Jan W. Amtrup
  • Patent number: 11640721
    Abstract: According to an exemplary embodiment, a method for pre-cropping digital image data includes: dividing the digital image into segments; computing a color value distance between corresponding pixels of neighboring segments of the digital image; comparing the color value distance(s) against a minimum color distance threshold; clustering neighboring segments having a color value distance less than or equal to the minimum color distance threshold; computing a connected structure based on the clustered segments; computing a polygon bounding the connected structure; comparing a fraction of segments included in the connected structure and the polygon, relative to a total number of segments in the digital image, to a minimum included segment threshold; and in response to determining the fraction of segments in the connected structure and the polygon, relative to the total number of segments meets or exceeds a minimum included segment threshold, cropping the digital image based on edges of the polygon.
    Type: Grant
    Filed: August 28, 2020
    Date of Patent: May 2, 2023
    Assignee: KOFAX, INC.
    Inventors: Jiyong Ma, Stephen M. Thompson, Jan W. Amtrup
  • Patent number: 11620733
    Abstract: A method of detecting an object depicted in a digital image includes: detecting a plurality of identifying features of the object, wherein the plurality of identifying features are located internally with respect to the object; projecting a location of region(s) of interest of the object based on the plurality of identifying features, where each region of interest depicts content; building and/or selecting an extraction model configured to extract the content based at least in part on: the location of the region(s) of interest, the of identifying feature(s), or both; and extracting the some or all of the content from the digital image using the extraction model. Corresponding system and computer program product embodiments are disclosed. The inventive concepts enable reliable extraction of data from digital images where portions of an object are obscured/missing, and/or depicted on a complex background.
    Type: Grant
    Filed: August 27, 2020
    Date of Patent: April 4, 2023
    Assignee: KOFAX, INC.
    Inventors: Jiyong Ma, Stephen M. Thompson, Jan W. Amtrup
  • Patent number: 11593585
    Abstract: Computer-implemented methods for detecting objects within digital image data based on color transitions include: receiving or capturing a digital image depicting an object; sampling color information from a first plurality of pixels of the digital image, wherein each of the first plurality of pixels is located in a background region of the digital image; optionally sampling color information from a second plurality of pixels of the digital image, wherein each of the second plurality of pixels is located in a foreground region of the digital image; assigning each pixel a label of either foreground or background using an adaptive label learning process; binarizing the digital image based on the labels assigned to each pixel; detecting contour(s) within the binarized digital image; and defining edge(s) of the object based on the detected contour(s). Corresponding systems and computer program products configured to perform the inventive methods are also described.
    Type: Grant
    Filed: August 28, 2020
    Date of Patent: February 28, 2023
    Assignee: KOFAX, INC.
    Inventors: Jiyong Ma, Stephen M. Thompson, Jan W. Amtrup
  • Patent number: 11481878
    Abstract: Systems, computer program products, and techniques for detecting and/or reconstructing objects depicted in digital image data within a three-dimensional space are disclosed. The concepts utilize internal features for detection and reconstruction, avoiding reliance on information derived from location of edges. The inventive concepts provide an improvement over conventional techniques since objects may be detected and/or reconstructed even when edges are obscured or not depicted in the digital image data. In one aspect, detecting a document depicted in a digital image includes: detecting a plurality of identifying features of the document, wherein the plurality of identifying features are located internally with respect to the object; projecting a location of one or more edges of the document based at least in part on the plurality of identifying features; and outputting the projected location of the one or more edges of the document to a display of a computer, and/or a memory.
    Type: Grant
    Filed: August 19, 2020
    Date of Patent: October 25, 2022
    Assignee: KOFAX, INC.
    Inventors: Jiyong Ma, Stephen Michael Thompson, Jan W. Amtrup
  • Publication number: 20220171988
    Abstract: According to one aspect, a computer-implemented method of discovering processes for robotic process automation (RPA) includes: recording a plurality of event streams, each event stream corresponding to a human user interacting with a computing device to perform one or more tasks; concatenating the event streams; segmenting some or all of the concatenated event streams to generate one or more individual traces performed by the user interacting with the computing device, each trace corresponding to a particular task; clustering the traces according to a task type; identifying, from among some or all of the clustered traces, one or more candidate processes for robotic automation; prioritizing the candidate processes; and selecting at least one of the prioritized candidate processes for robotic automation. Further aspects building upon the above include generating RPA models to perform tasks determined to be processes for RPA. Corresponding systems and computer program products are also described.
    Type: Application
    Filed: February 17, 2022
    Publication date: June 2, 2022
    Inventors: Jiyong Ma, Stephen Michael Thompson, Jan W. Amtrup
  • Patent number: 11321772
    Abstract: A method includes: receiving or capturing an image comprising an identity document (ID) using a mobile device; classifying the ID; analyzing the ID based at least in part on the ID classification; determining at least some identifying information from the ID; at least one of building an ID profile and updating the ID profile, based at least in part on the analysis; providing at least one of the ID and the ID classification to a loan application workflow and/or a new financial account workflow; and driving at least a portion of the workflow based at least in part on the ID and the ID classification. Corresponding systems and computer program products are also disclosed.
    Type: Grant
    Filed: December 29, 2016
    Date of Patent: May 3, 2022
    Assignee: KOFAX, INC.
    Inventors: Jan W. Amtrup, Steven Kilby, Anthony Macciola
  • Patent number: 11281936
    Abstract: According to one aspect, a computer-implemented method of discovering processes for robotic process automation (RPA) includes: recording a plurality of event streams, each event stream corresponding to a human user interacting with a computing device to perform one or more tasks; concatenating the event streams; segmenting some or all of the concatenated event streams to generate one or more individual traces performed by the user interacting with the computing device, each trace corresponding to a particular task; clustering the traces according to a task type; identifying, from among some or all of the clustered traces, one or more candidate processes for robotic automation; prioritizing the candidate processes; and selecting at least one of the prioritized candidate processes for robotic automation. Further aspects building upon the above include generating RPA models to perform tasks determined to be processes for RPA. Corresponding systems and computer program products are also described.
    Type: Grant
    Filed: April 17, 2019
    Date of Patent: March 22, 2022
    Assignee: KOFAX, INC.
    Inventors: Jiyong Ma, Stephen Michael Thompson, Jan W. Amtrup
  • Publication number: 20210383163
    Abstract: Systems, methods and computer program products for detecting objects using a multi-detector are disclosed, according to various embodiments. In one aspect, a computer-implemented method includes defining an analysis profile comprising an initial number of analysis cycles dedicated to each of a plurality of detectors, where each detector is independently configured to detect objects according to a unique set of analysis parameters and/or a unique detector algorithm. The method also includes: receiving digital video data that depicts at least one object; analyzing the digital video data using some or all of the detectors in accordance with the analysis profile, where the analyzing produces an analysis result for each detector used in the analysis. Further, the method includes updating the analysis profile by adjusting the number of analysis cycles dedicated to at least one of the detectors based on the analysis results.
    Type: Application
    Filed: June 15, 2021
    Publication date: December 9, 2021
    Inventors: Jiyong Ma, Stephen M. Thompson, Jan W. Amtrup
  • Publication number: 20210383150
    Abstract: Techniques for binarization and extraction of information from image data are disclosed. The inventive concepts include independently binarizing portions of the image data on the basis of individual features, e.g. per connected component, and using multiple different binarization thresholds to obtain the best possible binarization result for each portion of the image data. Determining the quality of each binarization result may be based on attempted recognition and/or extraction of information therefrom. Independently binarized portions may be assembled into a contiguous result. In one embodiment, a method includes: identifying a region of interest within a digital image; generating a plurality of binarized images based on the region of interest using different binarization thresholds; and extracting data from some or all of the plurality of binarized images. The extracted data includes connected components that overlap and/or are obscured by unique background.
    Type: Application
    Filed: June 15, 2021
    Publication date: December 9, 2021
    Inventors: Christopher W. Thrasher, Alexander Shustorovich, Stephen Michael Thompson, Jan W. Amtrup, Anthony Macciola
  • Patent number: 11062163
    Abstract: Techniques for binarization and extraction of information from image data are disclosed. The inventive concepts include independently binarizing portions of the image data on the basis of individual features, e.g. per connected component, and using multiple different binarization thresholds to obtain the best possible binarization result for each portion of the image data. Determining the quality of each binarization result may be based on attempted recognition and/or extraction of information therefrom. Independently binarized portions may be assembled into a contiguous result. In one embodiment, a method includes: identifying a region of interest within a digital image; generating a plurality of binarized images based on the region of interest using different binarization thresholds; subjecting the region of interest within a digital image to a plurality of thresholding and extraction iterations; and extracting data from some or all of the plurality of binarized images.
    Type: Grant
    Filed: February 4, 2019
    Date of Patent: July 13, 2021
    Assignee: KOFAX, INC.
    Inventors: Christopher W. Thrasher, Alexander Shustorovich, Stephen Michael Thompson, Jan W. Amtrup, Anthony Macciola
  • Patent number: 11062176
    Abstract: Computerized techniques for real-time object detection from video data include: defining an analysis profile comprising an initial number of analysis cycles dedicated to each of a plurality of detectors, each detector being independently configured to detect objects according to a unique set of analysis parameters; receiving a plurality of frames of digital video data, the digital video data depicting an object; analyzing the plurality of frames using the plurality of detectors and in accordance with the analysis profile, wherein analyzing the plurality of frames produces an analysis result for each of the plurality of detectors; determining a confidence score for each of the analysis results; and updating the analysis profile by adjusting the number of analysis cycles dedicated to at least one of the plurality of detectors based on the confidence scores. Corresponding systems and computer program products are also disclosed.
    Type: Grant
    Filed: November 30, 2018
    Date of Patent: July 13, 2021
    Assignee: KOFAX, INC.
    Inventors: Jiyong Ma, Stephen M. Thompson, Jan W. Amtrup
  • Publication number: 20210027431
    Abstract: A computer-implemented method of detecting an object depicted in a digital image includes: detecting a plurality of identifying features of the object, wherein the plurality of identifying features are located internally with respect to the object; projecting a location of region(s) of interest of the object based on the plurality of identifying features, where each region of interest depicts content; building and/or selecting an extraction model configured to extract the content based at least in part on: the location of the region(s) of interest, the of identifying feature(s), or both; and extracting the some or all of the content from the digital image using the extraction model. Corresponding system and computer program product embodiments are disclosed. The inventive concepts enable reliable extraction of data from digital images where portions of an object are obscured/missing, and/or depicted on a complex background.
    Type: Application
    Filed: August 27, 2020
    Publication date: January 28, 2021
    Inventors: Jiyong Ma, Stephen M. Thompson, Jan W. Amtrup