Abstract: Revising data management indices by defining a plurality of data entity buckets, assigning bucket hash values to each data record according to the plurality of data entity buckets, generating a record index including data record bucket membership data, determining a combined record score for each data record according to the bucket membership data, revising data record relationship indices of a data management system according to the combined record score of a data record, and responding to a user query according to the record index including the revised record relationships.

Abstract: One or more trained embedding generation artificial intelligence models are executed to generate a plurality of record attribute embeddings. The plurality of record attribute embeddings represents a plurality of attributes of data of a plurality of records. Grouping of the plurality of record attribute embeddings is performed. The grouping of a record attribute embedding includes grouping attribute values of the record attribute embedding into one or more groups of attribute values. The performing grouping provides a plurality of groups of attribute values for the plurality of record attribute embeddings. Selected records are compared to provide a set of matched records. The comparing, based on a group of attribute values, includes comparing records that include one or more attribute values grouped in the group of attribute values providing a subset of matched records of the set of matched records. The set of matched records is stored in an accessible computer location.

Abstract: A system for searching and/or linking corresponding electronic data records includes: choosing, for a target electronic data record, a group of candidate electronic data record(s) for comparison; selecting a first set of one or more attributes for comparison between the target record and the group of candidate record(s), and choosing a threshold for the comparisons. The system further includes comparing attribute(s) of the target electronic data record to attribute(s) of the group of candidate records; and scoring the comparison of the attribute(s) of the target electronic data record to the attribute(s) of the candidate records. The system further can include configuring a sieve to apply to electronic records, wherein the sieve has a second set of attribute(s) and a corresponding threshold for each of the second set of attribute(s), and applying the sieve to one or more electronic data records to identify records.

Abstract: An approach for accessing multi-attribute data records of a master data management system. The method comprises: enhancing the master data management system with one or more search engines for enabling data record access. A request of data may be received at the master data management system. A set of one or more of the multiple attributes, referenced in the received request, may be identified. A combination of one or more of the search engines of the master data management system, whose performances for searching values of at least part of the set of attributes fulfil a current selection rule may be selected. And, the request may be processed using the combination of search engines. At least part of the results of the processing may be provided, and the selection rule may be updated based on user operations on the provided results, the updated selection rule becoming the current selection rule.

Abstract: A method, a structure, and a computer system for mapping data fields. The exemplary embodiments may include, based on determining that a first data set and a second data set contain homogenous data, mapping at least one column of the first data set to at least one column of the second data set based on comparing at least one of relative column position and unique value sets. Based on determining that the first data set and the second data set contain heterogeneous data, the exemplary embodiments may include mapping the at least one column of the first data set to the at least one column of the second data set based on a difference between distribution signatures of unique value sets within each of the first data set and the second data set being less than a threshold.

Abstract: A computer-implemented method increases the efficiency of matching records from two sources. The method includes identifying a first source and a second source wherein each of the sources include one or more records and each record includes one or more attributes. The method further includes determining, based on a corpus, the one or more attributes and generating, based on the attributes, a set of feature vectors which vectors represent the one or more attributes. The method includes comparing each record in the first source against each record in the second source. The method further includes generating, in response to the comparing, a link confidence. The method also includes linking, in response to the link confidence being above a linking threshold, the associated records. The method includes determining a first feature vector of the set of feature vectors used in the linking, and outputting a set of results.

Abstract: Computer system for performing biometric matching in a way that balances accuracy level required in the biometric matching against computing resources (for example, processor cycles) that will be needed to match authentication requesters with profiles of authorized users. In some embodiments, this is achieved by controlling the number of clusters and/or the number of clusters to be searched pursuant to an authentication request.

Abstract: The disclosure provides various methods for separating and recovering free fatty acids crude oil containing free fatty acids using certain ion-exchange resins to reduce the amount of free fatty acids in the crude oil to 3% or less such that the resultant oil is useable in downstream chemical processes. After separation and removal of the free fatty acids form the crude oil, the ion-exchange resin is reusable in further free fatty acid separation reactions.

Abstract: Methods, computer program products and/or systems are provided that perform the following operations: obtaining payload attribute fields; determining potential matching fields from the payload attribute fields; determining a matching function for each of the potential matching fields; determining an attribute score for each of the potential matching fields based on the matching function; obtaining a score list for a reference data set; determining a correlation of the attribute score for each of the potential matching fields with the reference data set score list; selecting new matching fields from the potential matching fields based at least in part on the correlation; determining an optimal weight for each of the selected new matching fields; selecting attribute fields for matching from the selected new matching fields based on a threshold rate for false positives and false negatives; and providing the attribute fields for matching and the associated optimal weight for the attribute fields.

Abstract: A method for receiving an additional dataset including a plurality of additional data records; determining a record type using classifiers and an internal domain knowledge corpus; dividing the plurality of additional data records into a plurality of indexing groups; assigning the given additional data record to a match set based on completeness and similarity of natures of attributes of the given additional data record; and assigning the given additional data record to and a comparison group based on completeness and similarity of natures of attributes of the given additional data record.

Abstract: A method is disclosed for a database system that includes a set of data blocks comprising records having attributes. The set of data blocks are instances of at least one block type. The block type is defined by a subset of one or more attributes of the attributes. An instance of the block type comprises records having one distinct group of values of the subset of attributes. The method includes detecting that a subset of one or more data blocks of the block type, of the set of data blocks, reached a first maximum number of records. The method includes determining an additional attribute of the attributes to define a new block type by the combination of the additional attribute and the subset of attributes that define the block type. The method includes creating one or more data blocks which are instances of the new block type.

Abstract: Configuring a data management system by receiving user interaction data associated with search results associated with a first system configuration, identifying a usage pattern in the user interaction data using a first machine learning model, and altering the first system configuration according to the usage pattern.

Abstract: Computer system for performing biometric matching in a way that balances accuracy level required in the biometric matching against computing resources (for example, processor cycles) that will be needed to match authentication requesters with profiles of authorized users. In some embodiments, this is achieved by controlling the number of clusters and/or the number of clusters to be searched pursuant to an authentication request.

Abstract: An approach is provided for providing optimized identification of duplicate data in a networked computing environment. An aggregate feature vector is created that is specific to an attribute of the data (e.g., a field that holds specific informational content). The aggregate feature vector has a set of dimensions that each define a specific comparison function used to test for similarity between data entries in the attribute. Each dimension in the aggregate feature vector is assigned an effectiveness, and a cost is computed for each dimension. Based on these two, a subset of dimensions is selected to form an optimized feature vector. This optimized feature vector can then be used to analyze a dataset to find matching data.

Abstract: A method, a structure, and a computer system for mapping data fields. The exemplary embodiments may include, based on determining that a first data set and a second data set contain homogenous data, mapping at least one column of the first data set to at least one column of the second data set based on comparing at least one of relative column position and unique value sets. Based on determining that the first data set and the second data set contain heterogeneous data, the exemplary embodiments may include mapping the at least one column of the first data set to the at least one column of the second data set based on a difference between distribution signatures of unique value sets within each of the first data set and the second data set being less than a threshold.

Abstract: A method, a structure, and a computer system for event-based record matching. The exemplary embodiments may include extracting one or more events from a first record and a second record, as well as calculating an event-based score based on comparing the one or more events extracted from the first record with the one or more events extracted from the second record. The exemplary embodiments may further include matching the first record to the second record based on the event-based score exceeding a threshold.

Abstract: An approach is provided for providing optimized identification of duplicate data in a networked computing environment. An aggregate feature vector is created that is specific to an attribute of the data (e.g., a field that holds specific informational content). The aggregate feature vector has a set of dimensions that each define a specific comparison function used to test for similarity between data entries in the attribute. Each dimension in the aggregate feature vector is assigned an effectiveness, and a cost is computed for each dimension. Based on these two, a subset of dimensions is selected to form an optimized feature vector. This optimized feature vector can then be used to analyze a dataset to find matching data.

Abstract: The disclosure provides various methods for separating and recovering free fatty acids crude oil containing free fatty acids using certain ion-exchange resins to reduce the amount of free fatty acids in the crude oil to 3% or less such that the resultant oil is useable in downstream chemical processes. After separation and removal of the free fatty acids form the crude oil, the ion-exchange resin is reusable in further free fatty acid separation reactions.

Abstract: A method for receiving an additional dataset including a plurality of additional data records; determining a record type using classifiers and an internal domain knowledge corpus; dividing the plurality of additional data records into a plurality of indexing groups; assigning the given additional data record to a match set based on completeness and similarity of natures of attributes of the given additional data record; and assigning the given additional data record to and a comparison group based on completeness and similarity of natures of attributes of the given additional data record.

Abstract: Configuring a data management system by receiving user interaction data associated with search results associated with a first system configuration, identifying a usage pattern in the user interaction data using a first machine learning model, and altering the first system configuration according to the usage pattern.