Abstract: Event processing techniques for updating a database in real time based on events in a continuous event stream are disclosed. The techniques can update the database to incorporate information from thousands of received events per second. The events can include metrics measuring milestones for an organizational process defined by a user. Moreover, multiple streams can include metrics from many tenants concurrently. The techniques include receiving a plurality of events corresponding to a time interval and identifying that two events share a value of a key attribute. The techniques then include causing to be generated an in-memory combined database record comprising a combination of first and second attribute information from the two events and the value of the key attribute. In response to a trigger signal, the techniques include transmitting a single message, based at least in part on the combined database record, to update the database.

Abstract: Provided are a computer program product, system, and method for switching serialization techniques for handling concurrent write requests to a shared file. A first node serializes write requests from client nodes to write to the shared file. The first node determines whether to switch to a second node to manage write quests to the shared file based on a pattern of write requests to the shared file. The client nodes are notified to direct write requests to the shared file to the second node in response to determining to switch to the second node. The second node processes write requests to the shared file to serialize writes to the shared file after the client nodes are notified to submit the write requests to the shared file to the second node.

Abstract: The present disclosure relates to fault repair methods for a database system. In one example method, when working normally, a master node backs up, to a global buffer pool (GBP) node by using a data transmission protocol with a low latency and a high throughput (for example, a remote direct memory access (RDMA) protocol), a modified page generated because of transaction modification. When the master node is faulty, a standby node does not need to replay all remaining replay logs that are not replayed, but only needs to replay redo logs corresponding to a page that does not exist on the GBP node and pages that are not sequentially arranged and obtain the pages.

Abstract: A system for propagating an identity state change set about shared identities may include a plurality of systems of record (SORs), and a management server cooperating with the plurality of SORs and configured to: detect discrete Create-Retrieve-Update-Delete (CRUD) operations on a given SOR related to at least one shared identity to generate an identity state change set corresponding to a current state of the at least one shared identity; transact the identity state change set, with associated metadata, to a distributed immutable long-term storage as a current transaction; propagate the identity state change set and associated metadata to replicate a current state of the at least one shared identity as of the current transaction to at least one domain cache instance, and; synchronize the current state of the at least one shared identity across the plurality of SORs from the at least one domain cache instance.

Abstract: This application discloses a method used to remove a target blockchain node group of a first tenant from a channel. In the method, an execution node of a second tenant receives configuration information of the target blockchain node group of the first tenant which is sent by a management node, obtains channel configuration information of the channel from a consensus organization, and generates channel adjustment information based on the channel configuration information and the configuration information of the target blockchain node group. The execution node of the second tenant sends the channel adjustment information to the consensus organization, and the consensus organization generates a block including the channel adjustment information. A blockchain node group of the second tenant obtains the block from the consensus organization, and adds the block to a blockchain stored in the second tenant.

Abstract: Secure distributed storage and transmission of electronic content is provided over at least one communication network. At least one data file is received and parsed into a plurality of segments, wherein each one of the segments has a respective size. Thereafter, each of the plurality of segments is divided into a plurality of slices, wherein each one of the slices has a respective size. A plurality of data chunks are encoded, each data chunk comprising a portion of at least two of the slices, wherein no portion comprises an entire slice. The data chunks are packaged with at least metadata, and each of the packages is assigned to respective remote storage nodes. Each of the packages is transmitted to the respectively assigned remote storage node.

Abstract: A method includes receiving an input data from a host to schedule a meeting. The input data may include invitees to the meeting and a time/date associated with the meeting. A first and a second set of invitees from the invitees are determined. The first set of invitees is identified to start a pre-meeting meeting prior to the meeting scheduled at the time/date. The second set of invitees is identified to start the meeting at the time/date. It is appreciated that the pre-meeting meeting and the meeting are merged into a single meeting at a predetermined threshold of time.

Abstract: Techniques are provided for dependency aware parallel splitting of operations. For example, a first operation and a second operation may be replicated in parallel from a first device to a second device if the operations only target a single common inode that is an access control list inode referenced by the operations. An operation that dereferences the access control list inode can be replicated in parallel with other operations if the operation does not have the potential to delete the access control list inode from the second device. In another example, operations may be replicated to the second device in parallel if the operations only affect a single common parent directory inode and where timestamps are only moved forward in time at the second device.

Abstract: A method and system for streaming data from portable storage devices. Specifically, the disclosed method and system implement iterative data streaming from a portable storage device for remote storage operations, while requiring zero over-provisioning storage space for buffering incoming write operations to the portable storage device.

Abstract: A memory system for maintaining data consistency and an operation method thereof are provided. The operation method includes: receiving a first data in a first cache of a first memory from a processor; reading the first data from the first cache and writing the first data as a redo log into a log buffer of the first memory; writing the redo log from the log buffer into a memory controller of the processor; performing an in-memory copy in a second memory to copy a second data as an undo log, wherein the second data is an old version of the first data; and writing the redo log from the memory controller into the second memory for covering the second data by the redo log as a third data, wherein the redo log, the third data and the first data are the same.

Abstract: A system and method providing cross-ontology multi-master replication is described. In a first embodiment a method for cross-ontology multi-master replication comprising the steps of: storing a database change comprising a property value, the property value having an exporting site property type as defined in an exporting site ontology for an exporting site; using an ontology map to map the exporting site property type to an importing site property type defined by an importing site ontology for an importing site; transforming the property value to an intermediate property value based on the importing site property type; transforming the intermediate property value to a first round-trip value based on the exporting site property type; and determining whether to export the database change to the importing site based at least in part on a comparison between the property value and the first round-trip value.

Abstract: Application-level data in a storage system are evaluated. For example, a backup analysis tool retrieves a backup object stored in the storage system. The backup analysis tool reconstructs an application object from the backup object. The backup analysis tool accesses the first application object according to a native application format associated with the first object.

Abstract: An embodiment of the present invention is directed to an innovative approach to installing, upgrading and downgrading the package irrespective of the kernel version during system boot time after an operating system (OS) patching kernel update.

Abstract: In accordance with an embodiment, described herein is a system and method for heterogeneous database replication from a remote server, for example a remote database server. A capture process can be registered as a replication slave to the remote server, and configured to receive transaction event data from that server. Transaction log events associated with a modification to the database at the remote server can be processed, and output as change data, in a canonical format output, for use with one or more heterogeneous targets, for example a target database server or message queue. The process enables capture of transaction log events associated with database transactions at a remote server that may be located on a different computer or network, or within an access-restricted environment such as a cloud environment, without the need to create additional copies of its transaction logs.

Abstract: A system including first computer memory storing a full data set representable in rows and columns, a second computer memory storing executable instructions, and processors configured to execute the instructions to cause presentation of data of the full data set on a display including columns of data each having data fields, receive user input identifying a column of the data set, determine items to modify in information in the data fields of the identified column, generate and cause display of an indication of a proposed change action to modify the determined items, and in response to a user input indicating a selection of the indication of the proposed change action, update the presentation of the data based on the change action to modify information displayed in the data fields of the identified column of the data, and store a log of the change action.

Abstract: A method, apparatus and product for identifying data drifts.

Abstract: The invention concerns a storage method for storing, on data servers (3, 4), data file (5, 61 to 64) slices (51 to 58) from the execution of a plurality of processes (65 to 68) of one or more applications (83, 85), comprising: distributing the stored data file (5, 61 to 64) slices (51 to 58) over different data servers (3, 4), characterized in that: this distribution is carried out in such a way that the data file (5, 61 to 64) slices (51 to 58) likely to be subsequently accessed simultaneously by different application (83, 85) processes (65 to 68) are stored on different data servers (3, 4) so as to reduce the subsequent access, to each of all or part of these data servers (3, 4) by too many application (83, 85) processes (65 to 68) simultaneously, and in that: the determination of the data file (5, 61 to 64) slices (51 to 58) likely to be subsequently accessed simultaneously by different application (83, 85) processes (65 to 68) has been carried out, during a prior phase of executing these application (83,

Abstract: A method can include initiating one or more transactions in response to a request associated with a first tenant in a multi-tenant computing system. The multi-tenant computing system can store a table of system master data. A determination can be made as to whether the first tenant has a table of customized master data that can include customized data values absent from the table of system master data. Based on the determination, one or more of the table of system master data and the table of customized master data can be used to respond to the request. A response to the request can be provided. Related systems and articles of manufacture, including computer program products, are also provided.

Abstract: Systems and methods for data recovery, backup and catalog generation are described. In part, the disclosure relates to a computer-implemented method for generating a data catalog includes creating a current backup archive; obtaining access to a Master File Table (MFT), or other index table such as an Inode Table, of the current backup archive and a MFT, or other index table such as an Inode Table, of a previous backup archive; comparing each entry in the MFT, or Inode Table, of the current backup to each entry of the MFT, or Inode Table, of the previous backup to identify one or more differences in the current backup archive; and saving one or more of the differences into the data catalog of the current backup archive.

Abstract: Example distributed storage systems, replication managers, and methods provide versioning validation for data transfers between heterogeneous data stores. A first object data store includes a versioned data object with a plurality of sequential versions corresponding to the versioned data object. A versioned write request message is sent to a second object data store and a response is received. The versioning-enabled status of the second object data store is determined from the response message and, if the versioning enabled status is invalid, any residual object versions in the second object data store are deleted based on a delete request.

Abstract: In general, the invention relates to a method for performing backup operations. The method includes generating a full backup of a user asset at a first point in time, generating an incremental backup after the full backup is generated, applying the incremental backup to the full backup to generate a second full backup, obtaining a distinct data files subset associated with the second full backup, and deleting the distinct data files subset from the second full backup to obtain a third full backup.

Abstract: Systems, methods, and devices for tracking a series of changes to database data are disclosed. A method includes executing a transaction to modify data in a micro-partition of a table of a database by generating a new micro-partition that embodies the transaction. The method includes associating transaction data with the new micro-partition, wherein the transaction data comprises a timestamp when the transaction was fully executed, and further includes associating modification data with the new micro-partition that comprises an indication of one or more rows of the table that were modified by the transaction. The method includes joining the transaction data with the modification data to generate joined data and querying the joined data to determine a listing of intermediate modifications made to the table between a first timestamp and a second timestamp.

Abstract: A method, computer program product, and computing system for identifying one or more metadata pages stored in a storage array, thus defining a primary set of metadata pages. An alternative set of metadata pages may be generated from the primary set of metadata pages. A log of changes associated with the primary set of metadata pages may be generated. A copy of at least a portion of the primary set of metadata pages may be generated based upon, at least in part, the alternative set of metadata pages and the log of changes associated with the primary set of metadata pages. The alternative set of metadata pages may lag behind in time from the primary set of metadata pages by a predefined amount of time.

Abstract: There are provided systems and methods for determining data validity during data processing for multiple processing stacks. During processing requests with a service provider, each request may go through a data flow that invokes multiple processing stacks, where the data is transmitted over a network to different data processing nodes. For example, a distributed computing architecture may invoke multiple disparate nodes to process data, which may become corrupted during data transmission and processing. To ensure data validity, a framework may be provided that provided data translators for each processing stack to covert data handled in a processing format for that stack into a base data format utilized by the framework. The framework may utilize checksums or other hash values of the data in the base data format to determine if the data has been altered at different processing nodes or stacks.

Abstract: A computer system that includes an active system service processor, a standby system service processor having a memory, and a unit, in which the active system service processor includes a first control unit configured to acquire log information indicating a log of the unit to cause the memory to store the information, and to output a read instruction for reading the log information to the standby system service processor according to an operation of instructing to read the log information, and the standby system service processor includes a second control unit configured to read the log information from the memory according to the read instruction, and to execute processing related to the read log information.

Abstract: Systems, methods, and devices for tracking a series of changes to database data are disclosed. A method includes executing a transaction to modify data in a micro-partition of a table of a database by generating a new micro-partition that embodies the transaction. The method includes associating transaction data with the new micro-partition, wherein the transaction data comprises a timestamp when the transaction was fully executed, and further includes associating modification data with the new micro-partition that comprises an indication of one or more rows of the table that were modified by the transaction. The method includes joining the transaction data with the modification data to generate joined data and querying the joined data to determine a listing of intermediate modifications made to the table between a first timestamp and a second timestamp.

Abstract: A bi-directional data synchronization system and method is provided to facilitate data communication and synchronization between a remote client device and an application server. In one embodiment, a method in a client device executing a mobile application where the client device is in communication with the application server over a network connection having unreliable network connectivity includes storing in a first table at the client device data associated with at least one data bucket designated to the client device, the data associated with the data bucket being a subset of data associated with the mobile application; in response to the network connection not being established, storing in a second table at the client device changes to the data in the first table as a result of the executing; and in response to the network connection being established, performing synchronization of data with the application server.

Abstract: Notification system using a blockchain system. A method of the disclosure includes determining, by a node of a blockchain system, that a notification is available for an application of a computing device. The application is associated with a service platform. The method also includes updating a ledger of the blockchain system to indicate that the notification for the application is available.

Abstract: A geospatial mapping system can access a geospatial layer data set for a first geographic area defined by a first presentation level, and provide the geospatial layer data set for the first geographic area to a client device to present a visual rendering of the first geographic area. The geospatial mapping system can receive a request to utilize an advanced feature set on a subset of geospatial artifacts located within the first geographic area, and promote, to the geospatial layer data set, an additional geospatial artifact data set for the subset of geospatial artifacts, yielding an updated geospatial layer data set for the first geographic area. The geospatial mapping system can provide the updated geospatial layer data set to the client device to provide the advanced feature set for interacting with the subset of geospatial artifacts located within the first geographic area.

Abstract: Systems and methods can implement a review process to evaluate changes to target code as part of development cycles for a continuous integration, continuous deployment pipeline for software-based products. The system can aggregate data and determine if the target code has been modified preliminarily and then intelligently determine where further review is needed before the changes are permanently implemented. To do this, a changeset including the preliminarily changed target code can be obtained from the aggregated data. The changeset can be tested with a prediction model based on feature data that characterizes aspects of a coding process carried out to generate the preliminary modification. The prediction model can provide an activation recommendation for the preliminary modification based on a plurality of risk factors determined from the testing. The prediction model can be trained, continuously, with training data that includes a plurality of data artifacts resulting from a code build processes.

Abstract: Using one or more processors, generating a materialized view over a share object, the share object, including data associated with a first account. Using the one or more processors, merging the materialized view and the share object. Using the one or more processors, updating the data associated with the first account subsequent to generating the materialized view. Using the one or more processors, generating a refreshed materialized view with respect to the share object in response to detecting the updated data. Using the one or more processors, sharing the refreshed materialized view to a second account in response to a request from the second account.

Abstract: Disclosed herein are a method and system for collecting cyber threat intelligence (CTI) data. The system includes a management server that determines agent configuration values associated with an OSINT providing source, an agent that receives the agent configuration values from the management server, performs a data collection task for collecting the CTI data based on the agent configuration values, and transmits the CTI data and data collection status information to the management server, a threat information database where which the CTI data is logged, and a system database where the data collection status information is logged.

Abstract: Techniques for cross-ACL multi-master replication are provided. The techniques allow a replication site in a multi-master replication system implementing an asynchronous replication protocol and an access control policy to appropriately apply received data change updates to data maintained at the site even where a data change update is missing information because of the implemented access control policy.

Abstract: As described herein, a system, method, and computer program are provided for splitting and distributing a privileged software system into dependent components in order to deliver better security. In use, a privilege system is separated into n components of at least three components, wherein each of the n components runs on a separate machine, and a number up to t components may be controlled in an adversarial manner without compromising the privilege system, t components being at least two components and less than the n components. A power of a privilege is distributed among the n components. Additionally, one or more actions are performed within the privileged system.

Abstract: Inventive systems, techniques, and program products for copy-on-read, particularly in the context of disaster recovery (DR), are described. The inventive concepts include: a primary system for copy-on-read processing and disaster recovery, the primary system comprising: a primary storage volume available at a primary system, the primary storage volume storing one or more data portions; a record of regions of the primary storage volume, wherein a given region of the primary storage volume is marked when a given data portion stored on the primary storage volume is sent to a disaster recovery system; and a record monitoring component configured to determine whether one or more later writes to marked region(s) of the primary storage volume should be immediately replicated to the disaster recovery system, wherein the later writes occur after replicating the given data portion stored on the primary storage volume to the disaster recovery system.

Abstract: Service data updated in a data update event is acquired by a service application executed by a computer-implemented system. The service data is stored in a local database of the service application. An event version corresponding to the data update event is generated by the service application. The service data and the event version are encapsulated into an event object by the service application. The event object is transmitted to a peer-end service application for synchronizing corresponding service data in a peer-end database of the peer-end service application.

Abstract: An example method of reproducing a test case in a continuous integration environment includes detecting a test failure in a continuous integration environment. The continuous integration environment includes a plurality of stages for running a test on an application. The method also includes in response to detecting the failure, generating a snapshot while the test is running. The snapshot specifies a stage of the plurality of stages and a state of the application at which the failure occurred. The method further includes uploading the snapshot to a repository. At a later point in time, the snapshot may be restored to a computing device.

Abstract: Aspects of the present disclosure provide for operations of a key-value store (KVS) that uses journaling with storage of data (e.g., key data or value data of a key-value pair) in different types of data storage objects (e.g., data storage formats) selected based on one or more criteria.

Abstract: A method and system for updating nodes in a hierarchical data structure is described. The system receives an update to a first node representing a record in a hierarchical data structure. The system determines at least one other node that needs updating based on the update to the first node. The system compares the number of nodes that need updating based upon the update to the first node to a maximum number to determine whether the number of nodes that need updating is less than, equal to and greater than the maximum number. The system performs a synchronous update of the nodes that need updating in response to a determination that the number of nodes is less than or equal to the maximum number and an asynchronous update of the nodes that need updating in response to a determination that the number of nodes is greater than the maximum number.

Abstract: A system includes reception of a first script conforming to a first programming language, identification of a first declaration of a first variable in the first script, determination of a first datatype based on the first declaration, determination of a first initial value corresponding to the first datatype based on a second programming language, and generation of a first portion of a second script conforming to the second programming language, the first portion of the second script to initialize the first variable with the first initial value.

Abstract: Guaranteed message sequencing between a first and second database is described. An example method includes maintaining first state information associated with the first database at the first database, where second state information associated with the first database is maintained at the second database. The client sends, to the second database, a message describing changed rows between the first database and the second database since a last synchronization and the first state information. The client subsequently receives, from the second database, status of the last synchronization, where the status is determined by the second database based on the first state information and the second state information.

Abstract: At a data stream management service, a first set of metadata indicating that a first isolated read channel has been associated with a first data stream is stored. The first isolated read channel has an associated read performance limit setting. A second set of metadata indicating that a second isolated read channel, with its own performance limit setting, has been associated with a data stream is also stored. Based on determining that the difference between a metric of read operations associated with the first channel and the read performance limit setting of the first channel meets a first criterion, the service initiates a throttling operation for reads associated with the first channel. The throttling decision is made independently of read metrics of the second channel.

Abstract: A database system may receive a write request that specifies a modification to be made to a particular data record stored by the database system. A log record representing the modification to be made to the particular data record may be sent to a storage service of the database system. An indication (e.g., log record or other indication) that indicates a cached version of the particular data record stored in a read replica's cache is stale may be sent to a read replica. For a subsequent read of the particular data record received by the read replica, the read replica may request the particular data record from the storage service.

Abstract: A computing system may include a computing device configured to build modules of script code into bundles, and a bundler application executable to perform operations comprising: obtaining one or more of the modules of script code that are designated for bundling with one another; organizing the modules of script code into one or more chunks; for each respective chunk of the one or more chunks: (i) determining whether the respective chunk is to be assigned a deterministic chunk identifier or a non-deterministic chunk identifier, and (ii) assigning the respective chunk a chunk identifier as determined, where deterministic chunk identifiers are usable for referencing by additional modules of script code both within and not within in the respective chunk, and where the deterministic chunk identifiers are independent of characteristics of the computing device; and writing the one or more chunks to a bundle.

Abstract: A system and method of backing up an online database to a storage device is provided wherein the online database is actively changed by one or more applications. The backed up online database is then subsequently restored. The online database is backed up by copying the online database to the storage device, and during the copying of the online database, writing changes that are made to the online database to a change log for the portion of the online database that has already been copied to the storage device, and not writing changes that are made to the online database to the change log for the portion of the online database that has not yet been copied to the storage device. The online database is then restored by loading the backed up online database to a restore database, and applying the changes in the change log to the restore database.

Abstract: The disclosed technology is generally directed to virtual machines. In one example of the technology, a network change from a first virtual network having a first customer Internet Protocol (IP) address to a second virtual network having a second customer IP address is configured for a first virtual machine. The configuring includes controlling the following actions. The second virtual network is provided. At least one networking artifact is associated with a first user that is associated with the first virtual machine. The at least one networking artifact includes the second virtual network. A directory service is updated to map the second customer IP address to a first physical IP address. The first physical IP address is a physical IP address of the first virtual network.

Abstract: Embodiments are directed to a method of identifying changed files in incremental block based backups, by obtaining changed data blocks of a file from a change block tracking (CBT) driver, wherein the file has an associated master file table (MFT) record and a parent MFT record number used in a file system, and constructing a complete file path of the file by traversing from the changed MFT record to the root directory using respective parent MFT record numbers by iteratively parsing each record by extracting the file name and parent MFT record number and appending the file name to a previous MFT record file name.

Abstract: A fleet node management system may include a metadata store, a plurality of fleet nodes, and one or more metadata mutation devices. The metadata store may be configured to store dynamic metadata. The plurality of fleet nodes may be configured to determine, based on a gossip protocol, whether to continue performance of a function that uses a local version of the metadata. The one or more metadata mutation devices may be configured to determine, based on a global state of the fleet nodes, whether to modify the dynamic metadata for the fleet nodes.

Abstract: Systems and methods are provided for creating a sandbox for an original tenant at a point in time, the original tenant having original tenant data stored in an immutable storage associated with an original tenant identifier, the original tenant data as of the sandbox creation point in time being a virtual snapshot of the original tenant data accessible by a sandbox tenant, where the sandbox tenant data can be changed without changing the original tenant data, and the original tenant data can be changed without changing the sandbox tenant data. A sandbox tenant is created by associating a sandbox tenant identifier with the virtual snapshot of the original tenant data and with sandbox tenant data created by the sandbox tenant subsequent to the sandbox creation point in time. In some implementations, the original tenant is an original sandbox tenant, and the sandbox tenant is at least one new sandbox tenant.

Abstract: A method for synchronizing a file system (FS) and a remote file system (RFS) includes monitoring the FS for FS events, generating FS event records, receiving RFS event records of RFS events, generating file system operations (FSOs) based on the FS and RFS event records, and communicating the FSOs to the FS and RFS to synchronize them. A method for generating the FSOs includes accessing a plurality of FS and/or RFS event records, processing the accessed records to generate processed event records, generating the FSOs based on the processed event records, and outputting the FSOs to cause synchronization of the FS and RFS. Systems are also described. The invention facilitates event-based, steady-state synchronization of local and remote file systems.