Abstract: A method of optimizing transmission of requests for updated content from external data sources includes: storing a data object containing initial content received from at least one of the external data sources and associated with an expiry time; storing a set of optimization parameters; obtaining an instruction to request updated content corresponding to the data object; in response to obtaining the instruction, determining, based on the optimization parameters and the expiry time, whether to request updated content from the external data sources; when the determination is affirmative, transmitting at least one update request to at least one of the external data sources based on the initial content and the optimization parameters; and in response to transmitting the at least one update request, receiving and storing respective sets of updated content from the external data sources.

Abstract: Systems and methods for processing tokenization requests to facilitate safe storage of tokens. An epoch is identified as a current epoch based on a current system time of a node. A seed value is computed by the node based on a start time of the epoch and a secret. A plurality of ephemeral tokens is generated by a randomization service of the node for a set of sensitive data based on the seed value. Each ephemeral token of the plurality of ephemeral tokens has a usable life defined by the epoch. Each sensitive data instance in the set of sensitive data is associated with a particular ephemeral token of the plurality of ephemeral tokens to create a mapping structure in a main memory of the node. A tokenization service of the node is configured to process tokenization requests using the mapping structure.

Abstract: Database queries are processed by a first client storing cached data. The first client and a second client host a probabilistic model yielding validity values associating with the cached data indicating a probability that the cached data stored coincides with corresponding original data. The first client randomly selects queries at the time the respective query is received from one of the plurality of clients. For each of the queries randomly selected, a first piece of the cached data stored at the first client and matching the randomly selected query is retrieved, and a first piece of the original data matching the randomly selected query from the at least one original data source is retrieved. The probabilistic model is adapted using a machine learning algorithm based on the retrieved first piece of the cached data and the retrieved first piece of the original data and made available to the second client.

Abstract: Systems and methods for tokenization in a cloud-based environment. The disclosed systems and methods may perform operations including receiving input to be tokenized; obtaining a keyed hash function from a key management system; using the keyed hash function to generate a storage token for the input; creating an encrypted database entry linking the generated token to the received input; setting an expiry for the storage token; and when the storage token is received before the expiry, providing the linked input in response.

Abstract: Systems and methods of integrating message content into a target processing device configured to process input data having a predefined data structure. A messaging server is configured to receive a message from a messaging client device executing a messaging application. An orchestrator device is configured to integrate at least a part of the message content into a target data processing device, receive the part of the message content from the messaging server, and transmit a file derived from the part of the message content to a file processing device. The processing device is configured to transform each received file into a description file comprising a set of predefined keys. The orchestrator device is configured to derive an input file having the predefined data structure from the description file and transmit the input file to the target data processing device for processing of the input file by the target processing device.

Abstract: A first-to-second correlation engine determines correlations between first objects from a first object feed, and second objects from a second object storage, and generates first correlation messages indicative of the correlations for a first-to-second object direction and a second-to-first object direction. A second-to-first correlation engine determines respective correlations between the second objects from a second object feed and the first objects from a first object storage, and generates second correlation messages indicative of the respective correlations for the second-to-first object direction and the first-to-second object direction. A first-to-second correlation storage engine receives the first and second correlation messages for the first-to-second object direction and updates first-to-second correlation storage based on the received messages.

Abstract: A method of controlling generation of search results based on a plurality of search inputs includes, at a server: receiving an interim query containing a subset of interim search inputs; generating, based on the subset of interim search inputs: a subset of predicted search inputs; and a confidence level associated with the subset of predicted search inputs; when the confidence level exceeds a threshold, initiating a search operation to generate predicted search results based on a set of initial inputs including (i) the subset of interim search inputs and (ii) the subset of predicted search inputs; when the confidence level does not exceed the threshold, awaiting an additional query without initiating the search operation; and transmitting a search response based on at least one of the interim query and the additional query.

Abstract: A data aggregation system for aggregation of data from at least two data sources includes: a data aggregation unit configured to determine a data aggregation action to be executed by the system, in response to a message received by at least one data source device, each message comprising data; a consistency checking unit configured to check the consistency of each message received from a data source device using one or more consistency rules and determine an action to be executed by said data aggregation unit depending on the consistency checking; and an accuracy metric determination unit configured to determine an accuracy metric for the executed action based on feedback values received from a set of at least one user device, said data aggregation unit comprising a rule updating unit configured to update said consistency rules based on the accuracy metrics determined for the executed actions.

Abstract: The present invention relates to a method and a system for maintaining consistency of data between data-sets stored in a master database of a master computing node and corresponding data-sets stored in a replication database of at least one replication computing node. Each time an updated version of a stored data set is received, the master computing node is configured for updating a corresponding data-set stored in the master database and transmitting replication data relating to the updated data-set version to the at least one replication computing node for replication. The replication data comprising a bit-vector storing data values extracted from data fields of the data-set classified as volatile data fields. The data values stored in the bit-vector representing the changes in the data-set to be replicated in the at least one replication node.

Abstract: Method and system of automatically extracting information of a predefined type from a document is provided. The method comprises using an object detection algorithm to identify at least one segment of the document that is likely to comprise the information of the predefined type. The method further comprises building at least one bounding box corresponding to the at least one segment and if the bounding box is likely to comprise the information of the predefined type extracting the information comprised by the bounding box from the at least one bounding box.

Abstract: Methods of evaluating and deploying machine learning models for anomaly detection of a monitored system and related systems. Candidate machine learning algorithms are configured for anomaly detection of the monitored system. For each combination of candidate machine learning algorithm with type of anomalous activity, training and cross-validation sets are drawn from a benchmarking dataset. Using each of the training and cross-validation sets, a machine-learning model is trained and validated using the cross-validation set with average precision as a performance metric. A mean average precision value is then computed across these average precision performance metrics. A ranking value is computed for each candidate machine learning algorithm, and a machine learning algorithm is selected from the candidate machine learning algorithms based upon the computed ranking values.

Abstract: A device, system and method for training machine learning models using messages associated with provider objects is provided. One or more computing devices: receives messages associated with provider objects representing items provided by provider systems, the messages having more than one format; stores harmonized objects corresponding to the messages, the harmonized objects generated using mappings of harmonized data of the harmonized objects to message data of the messages, the harmonized objects having common formats for a harmonized object type; extracts, from the harmonized objects, for a given machine learning model, given machine learning training data; generates, for the given machine learning model, using the given machine learning training data, at least one machine learning classifier; and provides the at least one machine learning classifier to the given machine learning model at one or more servers configured to implement the given machine learning model on received provider objects.

Abstract: Methods, systems, and computer program products for software-defined database replication for a plurality of databases. Labels are applied to each of the plurality of databases and linking rules including conditions relating to the labels are used to define database replication links.

Abstract: A system and a method for handling and storing data records are provided. A software application is configured to process user requests and accordingly generate a master data record that is associated with at least one user and/or a user application. The software application further generates a partition token, which is used by a routing module to route the user request for storing a master data record to the master storage partition associated with the partition identifier indicated in the generated partition token.

Abstract: A synchronized data management system, connected to at least one user device through a network, includes: a server to receive requests from the user device and a common storage database comprising a master storage unit configured to store data; and an auxiliary storage unit configured to store updated data. The synchronized data management system is configured to: transmit a subset of data stored in the master storage unit to a given user device in response to an update request received by the server from the user device; store an update made to the subset of data and received from the user device in the auxiliary storage unit; and store the update made to the subset of data to the master storage unit in response to one or more validation requests received from a set of selected user devices, the set of selected user devices comprising at least one user device.

Abstract: Search requests are processed in a distributed database environment which includes a frontend module, one or more clients, a cache, a live data source, and multiple data records. Each data record includes at least one stable data piece stored in the cache and at least one volatile data piece. The frontend module receives a search request from a client and retrieves from the cache a set of data records. Each stable data piece in the set of data records corresponds to search criteria indicated in the search request. Current volatile data pieces, which correspond to the stable data pieces of the retrieved set of data records, are retrieved by the frontend module from the live data source for the retrieved set of data records. A completed set of data records is generated by combining the stable data pieces and the current volatile data pieces, and returned to the requesting client.

Abstract: A method of browser-based target data extraction includes: storing a browser application and a browser extension, the browser extension containing a predefined network identifier of a server; at a controller of the client computing device interconnected with the memory, executing the browser application to retrieve a web page containing target data; at the controller, responsive to retrieving the web page, executing the browser extension simultaneously with the browser application for: capturing a portion of the web page containing the target data; responsive to capturing the portion, automatically generating an overlay interface including the target data; controlling a display of the client computing device to present the overlay with the web page; receiving an operator command at the overlay via an input assembly of the client computing device; and when the operator command is a confirmation command, transmitting the target data to the server using the predefined network identifier.

Abstract: A computer-implemented method and system of testing and maintaining outage resilience of server resources of a server infrastructure by means of a hybrid simulation is presented. The server infrastructure comprises a plurality of servers executing a plurality of applications and the method comprises measuring a processor utilization for each of the servers of the server infrastructure, determining a resilience ratio of the server infrastructure by simulating the outage of at least one of the servers based on the measured processor utilization, and in response to the resilience ratio of the server infrastructure falls below a resilience threshold, initiating an assignment of additional resources for executing at least one of the plurality of applications to the server infrastructure.

Abstract: A server: receives from at least one provider system, at least one provider object that includes provider object data representing at least one item provided by the provider system(s); generates an intermediation object, corresponding to the at least one provider object, including an intermediation object identifier that identifies the intermediation object and intermediation object data populated with at least a subset of the provider object data, the intermediation object and the intermediation object identifier omitting: the provider object data, and any provider object identifier in an original form; and provides the intermediation object, in place of the at least one provider object, to a client device that requested the at least one item, the intermediation object provided. The intermediation object identifier may enable the server to intermediate between the client device and the provider system(s) without storing the provider object and/or any provider object identifier.

Abstract: A method for legacy-based access to non-legacy data includes: receiving, at an intermediation server, a non-legacy data object containing non-legacy content; generating a legacy data object containing the non-legacy content, for storage in a repository; storing, in association with the legacy data object, a non-legacy distribution channel indicator; adjusting a legacy processing mechanism at the repository according to the non-legacy distribution channel indicator; receiving from a client subsystem, via a legacy interface, a request for the non-legacy content; and in response to the request, retrieving and sending the legacy data object containing the non-legacy content, via the legacy interface.