Abstract: Systems and methods are described for batch materialization of an incremental change data capture (CDC) changeset with full row changes. The primary keys are extracted from the incremental CDC changeset and an indication of the extracted primary keys are broadcast to a plurality of executors. The primary keys may be added to Bloom filter or a plurality of Bloom filters that are broadcast to the executors. Each executor filters a baseline data table based on the extracted primary keys to generate a baseline match dataframe with all primary keys matching the extracted primary keys, and a baseline unmatched dataframe with all primary keys not matching the extracted primary keys. Each executor receives full row changes from a partitioned incremental CDC changeset and combines the changes with the baseline unmatched dataframe to produce a final changed baseline data table.

Abstract: One embodiment provides a method for identifying similar objects by performing document attribute comparisons, the method including: receiving a reference document, wherein the reference document corresponds to an object and comprises a plurality of attributes of the object; receiving a request for a similarity comparison, wherein the request provides an indication of similarity attributes to be used in the similarity comparison; comparing the reference document to each of a plurality of documents corresponding to other objects; generating a document similarity score for each of the plurality of documents, wherein the document similarity score is generated based upon an aggregation of similarity attribute scores calculated for each of the similarity attributes; and providing at least one of the plurality of documents with an indication of a similarity. Other aspects are described and claimed.

Abstract: One embodiment provides a method for identifying similar objects by performing document attribute comparisons, the method including: receiving a reference document, wherein the reference document corresponds to an object and comprises a plurality of attributes of the object; receiving a request for a similarity comparison, wherein the request provides an indication of similarity attributes to be used in the similarity comparison; comparing the reference document to each of a plurality of documents corresponding to other objects; generating a document similarity score for each of the plurality of documents, wherein the document similarity score is generated based upon an aggregation of similarity attribute scores calculated for each of the similarity attributes; and providing at least one of the plurality of documents with an indication of a similarity. Other aspects are described and claimed.

Abstract: Certain aspects of the present disclosure provide techniques for efficient data parity. Embodiments include receiving, by a first data consuming component, from a publication service, a plurality of database change records indicating changes to an underlying data source. Embodiments include updating, by the first data consuming component, a secondary data store based on the plurality of database change records. Embodiments include selecting a sample subset of the plurality of database change records based on one or more conditions. Embodiments include, for each respective database change record in the sample subset that has already been consumed by a second data consuming component that updated a primary data store based on one or more database change records: comparing the respective database change record to first data from the primary data store that corresponds to the respective database change record and making a parity determination based on the comparing.

Abstract: One embodiment provides a method for identifying similar objects by performing document attribute comparisons, the method including: receiving a reference document, wherein the reference document corresponds to an object and comprises a plurality of attributes of the object; receiving a request for a similarity comparison, wherein the request provides an indication of similarity attributes to be used in the similarity comparison; comparing the reference document to each of a plurality of documents corresponding to other objects; generating a document similarity score for each of the plurality of documents, wherein the document similarity score is generated based upon an aggregation of similarity attribute scores calculated for each of the similarity attributes; and providing at least one of the plurality of documents with an indication of a similarity. Other aspects are described and claimed.