Abstract: A continuous query identified by an archived relation of an application may be received. A physical query plan may be generated for the continuous query and/or a child operator plan may be identified. A buffer operator may be inserted between the child operator and its parent operator and/or the event information from the child operator may be stored in the buffer operator. A query operator may be identified in the physical query plan. It may be determined that the query operator identified in the physical query plan is a same type as a second query operator in a second continuous query concurrently executing. Further, a combined query plan may be generated based at least in part on the query operator identified in the physical query plan being the same type as the second query operator in the second continuous query.

Abstract: Techniques for triggering pipeline execution based on data change (transaction commit) are described. The pipelines can be used for data ingestion or other specified tasks. These tasks can be operational across account, organization, cloud region, and cloud provider boundaries. The tasks can be triggered by commit post-processing. Gates in the tasks can be set up to reference change data capture information. If the gate is satisfied, tasks can be executed to set up data pipelines.

Abstract: Techniques for change data capture (CDC) log augmentation are described. In some examples, a user configures CDC log augmentation by indicating which data should be included in a CDC log, and the database, when generating a CDC log associated with this configuration, can obtain the associated data and augment the CDC log by inserting this data into it. The augmented data can include one or more fields from a record in a separate database table, where the record can be identified based on the changed record represented by the CDC log.

Abstract: A method of generating a delta instructions record for updating a source database in-place, comprising obtaining a plurality of source data items contained in a plurality of cells of a plurality of tables organized in tuples and columns, creating a column oriented source stream serializing the source data items by concatenating a source data item of each cell of each column to a preceding source data item of a cell preceding the respective cell in the respective column, obtaining a plurality of target data items contained tables of a target database comprising data item(s) changed compared to the source database, creating a column oriented target stream serializing the plurality of target data items, delta instructions for applying changes detected between the source database and the target database by comparing between the source stream and the target stream, and outputting the delta instructions record to device(s) for updating their source database.

Abstract: Described herein are a system, apparatus, device, method, and/or computer program product embodiments and/or combinations and sub-combinations thereof for managing alerts and subscriptions in a cloud collaborative system. In one embodiment, a modification notice identifying a change to a field of a record is obtained, and the change is compared with a criterion specified in a subscription for a user. If the change satisfies the criterion, an alert is generated based on the modification notice. An alert GUI is transmitted to a user device to display alerts for the user. The user may access an expanded view of the record through the alert in the alert GUI. The user may also publish the alert to a chat session involving other users of the cloud collaborative system.

Abstract: A selection device includes a storage unit and a selection unit. The storage unit stores the write time and the read time of each of a plurality of nodes. The selection unit selects a first response condition in response to a data write request on the basis of the write time of each of the plurality of nodes such that the response time for the data write request becomes shorter than a requirement value of the write time and the number of nodes in which writing has been completed increases. The selection unit selects a second response condition in response to a data read request on the basis of the first response condition and the read time of each of the plurality of nodes such that the response time for the data read request becomes shorter than a requirement value of the read time.

Abstract: Systems and methods for configuring data stream filtering are disclosed. In one embodiment, a method for data stream processing comprises receiving an incoming dataset stream at a data stream processing environment, wherein the dataset stream comprises a data stream; configuring with a streaming data filter configuration tool, one or more filter parameters for a data filter that receives the data stream; computing with the streaming data filter configuration tool, one or more filter statistics estimates based on the filter parameters, wherein the filter statistics estimates are computed from sample elements of a representative sample of the data stream retrieved from a representative sample data store; outputting to a workstation user interface the filter statistics estimates; and configuring the data filter to apply the filter parameters to the data stream in response to an instruction from the workstation user interface.

Abstract: The disclosed technology is generally directed to the compression of inverted indexes. In one example of the technology, an inverted index that includes a plurality of posting lists and metadata is provided. The inverted index indicates compression settings that are associated with the plurality of posting lists. At periodic scheduled times, a regeneration is performed on the inverted index. The regeneration includes decompressing the inverted index. The decompressing uses the compression settings indicated by the inverted index. The regeneration further includes determining compression settings to use during a next periodic scheduled time of the plurality of periodic scheduled times, such that at least a first posting list of the plurality of posting lists uses a different compression setting than a second posting list of the plurality of posting lists.

Abstract: Embodiments of the present disclosure provide a data gathering and query method for collecting ongoing updates to large, unstructured or semi-structured databases. The method comprises gathering a plurality of events defined in a database syntax that is not structured and aggregating the plurality of events into one or more part files. Each of the one or more part files store a subset of the plurality of events in a columnar format, and each of the one or more part files comprises a header file that includes metadata corresponding to a subset of the plurality of events stored in the part file and is separate from the subset of events stored in the part file. The method further comprises uploading the one or more part files to a cloud storage repository configured to store the one or more part files so that they can be queried by a query server based on the header files.

Abstract: This application discloses a data replication method and apparatus, a computer device, and a storage medium, and belongs to the field of database technologies. The method includes: adding, when a commitment operation of a transaction is detected, historical state data of the transaction to a data queue; adding at least one piece of historical state data in the data queue to a transmission buffer; and replicating, when a first preset condition is met, the at least one piece of historical state data in the transmission buffer to a cluster device. In this application, a node device does not need to convert an original historical state data format into a log format, and the cluster device does not need to parse a log into an original data format for storage, thereby avoiding a cumbersome log replay procedure, and improving the efficiency of the data replication process.

Abstract: Methods, systems, and computer-readable media for linking multiple data entities. The method collects a snapshot of data from one or more data sources and converts it into a canonical representation of records expressing relationships between data elements in the records. The method next cleans the records to generate output data of entities by grouping chunks of records using a machine learning model. The method next ingests the output data of entities to generate a versioned data store of the entities and optimizes versioned data store for real-time data lookup. The method then receives a request for data pertaining to a real-world entity and presenting relevant data from the versioned data store of entities.

Abstract: Systems, methods, and computer-program products are described for determining current location information which includes determining whether an object is moving by comparing the current location information with previous location information. Future location information is calculated and a point of interest is filtered using the future location information. A media asset is then matched to the filtered point of interest and a current score is determined for the matched media asset. Determining a current score includes determining a window in which the matched media asset is geographically relevant to the future location information, and updating the matched media asset score when the future location information changes. An ordered playlist is dynamically generated according to the future location information by repeatedly prioritizing and sequencing matched media assets according to the current score for each matched media asset, and matched media assets are played or displayed in the ordered playlist.

Abstract: A computer-implemented system for updating a counter value in a data structure. The system may include a memory storing instructions and at least one processor configured to execute the instructions to perform a process. The process may include receiving information relating to an event, and determining, for the event, a counter identifier value for the counter identifier field of the data structure. The data structure may include one or more entries. Each of the one or more entries may include the counter identifier field and a counter value field. The process may also include identifying, in the data structure, an entry that comprises a counter identifier value identical to the determined counter identifier value. The process may further include increasing a counter value in the counter value field of the identified entry.

Abstract: Methods and apparatuses are described for capturing and maintaining a timeline of data changes in a relational database system. A server identifies changed records from relational database tables. The server analyzes the changed records to determine a maximum timestamp for each primary key and extracts the changed records associated with each primary key where a timestamp is equal to or greater than the maximum timestamp for the primary key. The server generates timestamp ranges for each primary key, each comprising an effective date and an expiration date. The server determines whether each key-date combination already exists in a historical record table. The server updates an expiration date of an existing record in the historical record table using the effective date and inserts a new record for the timestamp range using the captured records.

Abstract: Aspects described herein may relate to methods, systems, and apparatuses for generating synthetic data based on time series predictions and plural machine learning models. Generating the synthetic data may include receiving one or more data records that include transaction data of a user, categorizing and/or segmenting the one or more data records, determining a first predicted time step based on the categorizing and/or segmenting, and performing an iterative process that determines further predicted time steps. The first predicted time step may be determined using one model of a plurality of machine learning models. The iterative process may determine the further predicted time steps using the plural machine learning models. Based on iterations of the iterative process, potential time series may be determined. The synthetic time series may be determined from the potential time series. The synthetic time series may be used by additional processes, such as additional machine-learning processes.

Abstract: Updates to projected data subsets may be ordered using conditional operations. When updates to a data set are received, a determination is made according to a schema for a projected subset of the data set as to whether the update is to be propagated to the projected subset of the data set. If the update is to be propagated, a comparison of a version identifier for the update may be made with a version identifier for the subset to determine whether performance of the update is consistent with an ordering of updates performed to the first data set. If the comparison indicates the performance of the update is consistent, then the update may be performed to the projected subset. If not, then the update may not be performed.

Abstract: A method for indexing data in a storage engine includes: obtaining a target transaction, the target transaction indicating a process of indexing data; determining target data in a first storage engine according to the target transaction, the target data being comprised in at least one first index table; determining, according to the first index table, at least one second index table configured in a second storage engine, the second index table being obtained by adding row numbers based on the first index table, the row numbers indicating row data in the target data, and the second storage engine supporting execution of the target transaction; and determining, according to a data index condition in the first storage engine, index data from the second index table, the index data being comprised in the target data.

Abstract: A system for data object replication includes at least one hardware processor and at least one memory storing instructions. The instructions cause the at least one hardware processor to perform operations including decoding a replication request to obtain a data object. Object dependencies associated with the data object and a plurality of additional data objects are determined. A replication sequence of the data object and the plurality of additional data objects is determined based on the object dependencies. A replication of the data object and at least one of the plurality of additional data objects is performed according to the replication sequence. A notification of a successful completion of the replication is generated.

Abstract: One or more techniques and/or computing devices are provided for non-disruptively establishing a synchronous replication relationship between a primary volume and a secondary volume and/or for resynchronizing the primary volume and the secondary volume. For example, a baseline snapshot and one or more incremental snapshots of the primary volume are used to construct and incrementally update the secondary volume with data from the primary volume. A dirty region log is used to track modifications to the primary volume. A splitter object is used to split client write requests to the primary volume and to the secondary volume. A synchronous transfer engine session is initiated to processing incoming client write requests using the dirty region log. A cutover scanner is used to transfer dirty data from the primary volume to the secondary volume. In this way, a synchronous replication relationship is established between the primary volume and the secondary volume.

Abstract: Methods, computer program products, computer systems, and the like are disclosed that provide for scalable deduplication in an efficient and effective manner. For example, such methods, computer program products, and computer systems can include determining, at a source site, whether metadata has been received from a target site, and, in response to a determination that the metadata has been received at the source site, retrieving the at least one unit of the source data from the source data store using the metadata and sending, from the source site, the at least one unit of source data to the target site.