Abstract: Embodiments described herein provide a method for obtaining information on product inventory and placement in a retail setting. An image including unannotated image data indicative of the retail setting is received. One or more shelves in the retail setting are determined from the unannotated image data, and the image is segmented into one or more sub-images corresponding to the one or more detected shelves. For each sub-image corresponding to a respective detected shelf, a product name is then and a number of appearances of the product name are detected using text recognition on the respective sub-image. Product inventory information and first placement information are derived based at least in part on the detected number of appearances and a shelf level corresponding to the sub-image.

Abstract: Machine learning based models recognize objects in images. Specific features of the object are extracted from the image using machine learning based models. The specific features extracted from the image assist deep learning based models in identifying subtypes of a type of object. The system recognizes the objects and collections of objects and determines whether the arrangement of objects violates any predetermined policies. For example, a policy may specify relative positions of different types of objects, height above ground at which certain types of objects are placed, or an expected number of certain types of objects in a collection.

Abstract: A system is provided for object localization in image data. The system includes an object localization framework comprising a plurality of object localization processes. The system is configured to receive an image comprising unannotated image data having at least one object in the image, access a first object localization process of the plurality of object localization processes, determine first bounding box information for the image using the first object localization process, wherein the first bounding box information comprises at least one first bounding box annotating at least a first portion of the at least one object in the image, and receive first feedback regarding the first bounding box information determined by the first object localization process. The system is further configured to persist the image with the first bounding box information or access a second object localization process based on the first feedback.

Abstract: A system is provided for referral object processing for textual annotations. The system comprises a memory storing machine executable code and one or more processors coupled to the memory and configurable to execute the machine executable code to cause the one or more processors to parse a document to identify a reference identifier to an external object, the external object associated with information not contained in the document, retrieve the external object using the reference identifier, extract the information associated with the external object based on at least one data pattern detected in the external object, convert the extracted information into textual annotations associated with the reference identifier in the document, and enter the textual annotations to a corpus of content for the document so that the extracted information is associated with the reference in the document for the system.

Abstract: The system and methods of the disclosed subject matter provide a hybrid machine learning approach for recommending items that a consumer should be shown as a next best offer. The recommendation may be based on the consumer's previous behavior, other consumers' previous behavior, and the consumer's profile. The system and methods may cluster an input dataset using an unsupervised clustering engine. The dataset output from the unsupervised clustering engine may be subsequently provided to the input of a supervised machine learning engine to generate a rules-based model. The system and methods may use the rules-based model to subsequently cluster new user data and generate recommendations based on the user's assigned cluster.

Abstract: Embodiments described herein transforms a complex and usually unstructured table to a relational table based on the header pattern. Specifically, the original complex table is expanded into a single dimensional relational database format, in which each cell corresponds to one or more corresponding categories or subcategories from the original header. The transformed one-dimensional relational table is then populated with the corresponding cell values from the original table. In this way, data from the original complex and unstructured data table can be stored at a relational database.

Abstract: Embodiments described herein provide a mechanism that translates a natural language question to a database query format that may be applied to a data table to generate an answer to the natural language question. The system may identify key terms from a natural language question and classify the key terms as variable names or operation names. The natural language question is than translated into a format of question template containing variable names and operation names. In this way, the system may map the template question to a database query which can be applied to operate on a relational database to identify a cell value that represents an answer to the natural language question.

Abstract: Embodiments described herein automatically classifies numerical expressions from a textual document and designates a context to understand each numerical expression. Specifically, numerical expressions from a textual context are classified as nominal or cardinal. For cardinal numerical expressions that carry a quantitative meaning, inference terms are determined from the textual context to associate with the cardinal numerical expressions. The numerical expressions are then translated to a format of a numerical value and stored with metadata indicating the unit scale or the meaning of the numerical value.

Abstract: Embodiments described herein provide a method for obtaining information on product inventory and placement in a retail setting. An image including unannotated image data indicative of the retail setting is received. One or more shelves in the retail setting are determined from the unannotated image data, and the image is segmented into one or more sub-images corresponding to the one or more detected shelves. For each sub-image corresponding to a respective detected shelf, a product name is then and a number of appearances of the product name are detected using text recognition on the respective sub-image. Product inventory information and first placement information are derived based at least in part on the detected number of appearances and a shelf level corresponding to the sub-image.

Abstract: A system is provided for object localization in image data. The system includes an object localization framework comprising a plurality of object localization processes. The system is configured to receive an image comprising unannotated image data having at least one object in the image, access a first object localization process of the plurality of object localization processes, determine first bounding box information for the image using the first object localization process, wherein the first bounding box information comprises at least one first bounding box annotating at least a first portion of the at least one object in the image, and receive first feedback regarding the first bounding box information determined by the first object localization process. The system is further configured to persist the image with the first bounding box information or access a second object localization process based on the first feedback.

Abstract: Generating distractors for text-based MCT items. An MCT item stem is received. The stem is transmitted to a QA system and a plurality of candidate answers related to the stem is received from the QA system. Incorrect answers in the plurality of candidate answers are identified. Textual features are extracted from the stem. A set of semantic criteria associated with the extracted textual features is generated. Based on the generated semantic criteria, a subset of the incorrect candidate answers is selected.

Abstract: The system and methods of the disclosed subject matter provide a hybrid machine learning approach for recommending items that a consumer should be shown as a next best offer. The recommendation may be based on the consumer's previous behavior, other consumers' previous behavior, and the consumer's profile. The system and methods may cluster an input dataset using an unsupervised clustering engine. The dataset output from the unsupervised clustering engine may be subsequently provided to the input of a supervised machine learning engine to generate a rules-based model. The system and methods may use the rules-based model to subsequently cluster new user data and generate recommendations based on the user's assigned cluster.

Abstract: Aspects extend to methods, systems, and computer program products for forecasting eye condition progression for eye patients. When a patient visits an eye practitioner, the patient (or when appropriate their guardian) may be interested in the current eye condition as well as a prediction of eye condition progression in the future and/or as the patient ages. Aspects of the invention can be used to predict the progress of an eye condition for a patient (e.g., a child) at a number of different post-examination times after an examination. Predicting the progress of an eye condition for a patient over time can be used to assist the eye practitioner in tailoring a treatment plan and/or tailoring a subsequent examination schedule for the patient.

Abstract: A computer-implemented method for language generation of a flow diagram, which receives a flow diagram. A plurality of geometric shapes within the flow diagram is identified. A plurality of text elements within the flow diagram is identified. The plurality of text elements and corresponding geometric shapes are associated. The association between the plurality of geometric shapes are identified. A diagram matrix based on the associations between the plurality of geometric shapes is generated. A linear language representation of the diagram matrix is generated.

Abstract: Generating distractors for text-based MCT items. An MCT item stem is received. The stem is transmitted to a QA system and a plurality of candidate answers related to the stem is received from the QA system. Incorrect answers in the plurality of candidate answers are identified. Textual features are extracted from the stem. A set of semantic criteria associated with the extracted textual features is generated. Based on the generated semantic criteria, a subset of the incorrect candidate answers is selected.

Abstract: A method for analyzing data of a networked computing environment, the method includes a computer processor analyzing a plurality of data of a networked computing environment aggregated during a first time interval, where the data includes messages that include message IDs. The method further includes identifying a frequency value of occurrences of a message ID within the plurality of data during the first time interval. The method further includes determining whether the frequency value of the occurrences of the message ID during the first time interval correlates to an anomaly that occurs within the networked computing environment. The method further includes responding to determining that the frequency value of the occurrences of message ID within the first time interval correlates to the anomaly by determining a first response to the anomaly. The method further includes initiating the first response to one or more elements of the networked computing environment.

Abstract: Aspects extend to methods, systems, and computer program products for providing personalized surgery recommendations for eye patients. Surgery types, and surgery parameters can be recommended for a patient based on predicted post-operative UCVA for the patient if the surgery types and surgery parameters were to be used. Predicting post-operative UCVA can be handled as a regression problem based on patient demography and pre-operative examination details. In an additional aspect, surgery parameters are automatically determined and/or optimized for improved post-operative UCVA by including surgery parameters in a regression model.

Abstract: Generating distractors for text-based MCT items. An MCT item stem is received. The stem is transmitted to a QA system and a plurality of candidate answers related to the stem is received from the QA system. Incorrect answers in the plurality of candidate answers are identified. Textual features are extracted from the stem. A set of semantic criteria associated with the extracted textual features is generated. Based on the generated semantic criteria, a subset of the incorrect candidate answers is selected.

Abstract: A computer-implemented method for language generation of a flow diagram, which receives a flow diagram. A plurality of geometric shapes within the flow diagram is identified. A plurality of text elements within the flow diagram is identified. The plurality of text elements and corresponding geometric shapes are associated. The association between the plurality of geometric shapes are identified. A diagram matrix based on the associations between the plurality of geometric shapes is generated. A linear language representation of the diagram matrix is generated.

Abstract: A computer-implemented method for language generation of a flow diagram, which receives a flow diagram. A plurality of geometric shapes within the flow diagram is identified. A plurality of text elements within the flow diagram is identified. The plurality of text elements and corresponding geometric shapes are associated. The association between the plurality of geometric shapes are identified. A diagram matrix based on the associations between the plurality of geometric shapes is generated. A linear language representation of the diagram matrix is generated.