Abstract: Certain aspects of the present disclosure provide techniques for rendering visual artifacts in virtual worlds using machine learning models. An example method generally includes identifying, based on a machine learning model and a streaming natural language input, an intent associated with the streaming natural language input; generating, based on the identified intent associated with the streaming natural language input, one or more virtual objects for rendering in a virtual environment displayed on one or more displays of an electronic device; and rendering the generated one or more virtual objects in the virtual environment.

Abstract: A method, computer program product, and system are provided. A first natural language text is received via a user interface. A generative pretrained transformer machine learning model processes the first natural language text and a context to identify a first intent. The processing is based in part on a syntax determined from a set of natural language completion paradigms. The generative transformer machine learning model maps the first set of parameters to a first query. The mapping is associated with a first confidence. The generative transformer machine learning model processes the first set of parameters and the first query to generate a set of execution steps. The processing is performed when the first confidence satisfies a threshold. The set of execution steps is parsed into a query object that is forwarded to a reporting service.

Abstract: Techniques are disclosed for performing optical character recognition (OCR) by assessing and improving quality of electronic documents to perform the OCR. For example a method for identifying information in an electronic document includes obtaining a reference image of the electronic document, distorting the reference image by adjusting different sets of one or more parameters associated with a quality of the reference image to generate a plurality of distorted images, analyzing each distorted image to detect the adjusted set of parameters and corresponding adjusted values, determining an accuracy of detection of the set of parameters and the adjusted values, and training a model based at least on the plurality of distorted images and the accuracy of the detection, wherein the trained model determines at least a first technique for adjusting a set of parameters in a second image to prepare the second image for optical character recognition.

Abstract: The present disclosure relates to simulating the capture of images. In some embodiments, a document and a camera are simulated using a three-dimensional modeling engine. In certain embodiments, a plurality of images are captured of the simulated document from a perspective of the simulated camera, each of the plurality of images being captured under a different set of simulated circumstances within the three-dimensional modeling engine. In some embodiments, a model is trained based at least on the plurality of images which determines at least a first technique for adjusting a set of parameters in a separate image to prepare the separate image for optical character recognition (OCR).

Abstract: Systems of the present disclosure allow fields and labels to be identified in a digital image of a form without performing OCR. A digital image of a form can be partitioned into image segments using computer-vision image-segmentation techniques. Features for each image segment can be extracted using computer-vision feature-detection methods. The features extracted from an image segment can be included in an input instance for a machine-learning model. The machine-learning model can assign a classification to the input instance. The classification can associate the input instance with a field type or a label type.

Abstract: The disclosed embodiments provide a system that describes a semi-structured document for the purpose of acquiring a set of data elements from the semi-structured document. During operation, the system obtains a physics model of a semi-structured document, wherein the physics model includes a set of relationships represented by physical objects that describe relative positions of a set of data elements in the semi-structured document. Next, the system applies the physics model to a representation of the semi-structured document to automatically extract a set of data from the representation. The system then provides the extracted set of data for use with one or more applications without requiring manual input of the data into the one or more applications.

Abstract: The present disclosure relates to simulating the capture of images. In some embodiments, a document and a camera are simulated using a three-dimensional modeling engine. In certain embodiments, a plurality of images are captured of the simulated document from a perspective of the simulated camera, each of the plurality of images being captured under a different set of simulated circumstances within the three-dimensional modeling engine. In some embodiments, a model is trained based at least on the plurality of images which determines at least a first technique for adjusting a set of parameters in a separate image to prepare the separate image for optical character recognition (OCR).

Abstract: The present disclosure relates to simulating the capture of images. In some embodiments, a document and a camera are simulated using a three-dimensional modeling engine. In certain embodiments, a plurality of images are captured of the simulated document from a perspective of the simulated camera, each of the plurality of images being captured under a different set of simulated circumstances within the three-dimensional modeling engine. In some embodiments, a model is trained based at least on the plurality of images which determines at least a first technique for adjusting a set of parameters in a separate image to prepare the separate image for optical character recognition (OCR).

Abstract: Techniques are disclosed for performing optical character recognition (OCR) by assessing and improving quality of electronic documents to perform the OCR. For example a method for identifying information in an electronic document includes obtaining a reference image of the electronic document, distorting the reference image by adjusting different sets of one or more parameters associated with a quality of the reference image to generate a plurality of distorted images, analyzing each distorted image to detect the adjusted set of parameters and corresponding adjusted values, determining an accuracy of detection of the set of parameters and the adjusted values, and training a model based at least on the plurality of distorted images and the accuracy of the detection, wherein the trained model determines at least a first technique for adjusting a set of parameters in a second image to prepare the second image for optical character recognition.

Abstract: Techniques are disclosed to identify a form document in an image using a digital fingerprint of the form document. To do so, the image is evaluated to detect features of the image. For each feature, a pixel is plotted in a second image. The second image is the digital fingerprint of the form. To identify the form corresponding to the digital fingerprint, the digital fingerprint may be compared to digital fingerprints of known forms.

Abstract: Techniques are disclosed for performing optical character recognition (OCR) by assessing and improving quality of electronic documents to perform the OCR. For example a method for identifying information in an electronic document includes obtaining a reference image of the electronic document, distorting the reference image by adjusting different sets of one or more parameters associated with a quality of the reference image to generate a plurality of distorted images, analyzing each distorted image to detect the adjusted set of parameters and corresponding adjusted values, determining an accuracy of detection of the set of parameters and the adjusted values, and training a model based at least on the plurality of distorted images and the accuracy of the detection, wherein the trained model determines at least a first technique for adjusting a set of parameters in a second image to prepare the second image for optical character recognition.

Abstract: Methods, non-transitory computer-readable storage mediums and systems for classifying features including labels or fields in digital images of forms and identifying any unclassified features utilizing a bitmap approach are provided. Each spatial template includes a set of features and a set of bitmaps, each bitmap indicating a spatial relationship between each feature and respective remaining features in each spatial template. The operations include selecting a spatial template from the spatial templates, classifying each extracted feature as one of features in the spatial template. The operations include generating at least one bitmap representing a spatial relationship for each unclassified feature in relation to classified features, comparing the at least one bitmap with each of a set of bitmaps in the selected spatial template, and identifying the at least one unclassified feature as one of features in the spatial template based on a result of the comparison.

Abstract: Techniques are disclosed to identify a form document in an image using a digital fingerprint of the form document. To do so, the image is evaluated to detect features of the image. For each feature, a pixel is plotted in a second image. The second image is the digital fingerprint of the form. To identify the form corresponding to the digital fingerprint, the digital fingerprint may be compared to digital fingerprints of known forms.

Abstract: Techniques are disclosed for performing optical character recognition (OCR) by assessing and improving quality of electronic documents to perform the OCR. For example a method for identifying information in an electronic document includes obtaining a reference image of the electronic document, distorting the reference image by adjusting different sets of one or more parameters associated with a quality of the reference image to generate a plurality of distorted images, analyzing each distorted image to detect the adjusted set of parameters and corresponding adjusted values, determining an accuracy of detection of the set of parameters and the adjusted values, and training a model based at least on the plurality of distorted images and the accuracy of the detection, wherein the trained model determines at least a first technique for adjusting a set of parameters in a second image to prepare the second image for optical character recognition.

Abstract: The present disclosure relates to simulating the capture of images. In some embodiments, a document and a camera are simulated using a three-dimensional modeling engine. In certain embodiments, a plurality of images are captured of the simulated document from a perspective of the simulated camera, each of the plurality of images being captured under a different set of simulated circumstances within the three-dimensional modeling engine. In some embodiments, a model is trained based at least on the plurality of images which determines at least a first technique for adjusting a set of parameters in a separate image to prepare the separate image for optical character recognition (OCR).

Abstract: Techniques are disclosed to identify a form document in an image using a digital fingerprint of the form document. To do so, the image is evaluated to detect features of the image and determine a polygon bounding each feature. For each polygon, pixels are plotted in a second image based on coordinates of a center of the polygon. The second image is the digital fingerprint of the form. To identify the form corresponding to the digital fingerprint, the digital fingerprint may be compared to digital fingerprints of known forms.

Abstract: The disclosed embodiments provide a system that describes a semi-structured document for the purpose of acquiring a set of data elements from the semi-structured document. During operation, the system obtains a physics model of a semi-structured document, wherein the physics model includes a set of relationships represented by physical objects that describe relative positions of a set of data elements in the semi-structured document. Next, the system applies the physics model to a representation of the semi-structured document to automatically extract a set of data from the representation. The system then provides the extracted set of data for use with one or more applications without requiring manual input of the data into the one or more applications.

Abstract: Techniques are disclosed for performing optical character recognition (OCR) by assessing and improving quality of electronic documents to perform the OCR. For example a method for identifying information in an electronic document includes obtaining a reference image of the electronic document, distorting the reference image by adjusting different sets of one or more parameters associated with a quality of the reference image to generate a plurality of distorted images, analyzing each distorted image to detect the adjusted set of parameters and corresponding adjusted values, determining an accuracy of detection of the set of parameters and the adjusted values, and training a model based at least on the plurality of distorted images and the accuracy of the detection, wherein the trained model determines at least a first technique for adjusting a set of parameters in a second image to prepare the second image for optical character recognition.

Abstract: Techniques are disclosed to identify a form document in an image using a digital fingerprint of the form document. To do so, the image is evaluated to detect features of the image and generate a boundary around each feature. For each boundary, dimensions of the boundary may be stored in a color channel of a pixel in a second image. Thus, the color of the pixel represents the size of the boundary. The second image is the digital fingerprint of the form. To identify the form corresponding to the digital fingerprint, the digital fingerprint may be compared to digital fingerprints of known forms.

Abstract: Systems of the present disclosure allow fields and labels to be identified in a digital image of a form without performing OCR. A digital image of a form can be partitioned into image segments using computer-vision image-segmentation techniques. Features for each image segment can be extracted using computer-vision feature-detection methods. The features extracted from an image segment can be included in an input instance for a machine-learning model. The machine-learning model can assign a classification to the input instance. The classification can associate the input instance with a field type or a label type.