Abstract: Application-level data in a storage system are evaluated. For example, a backup analysis tool retrieves a backup object stored in the storage system. The backup analysis tool reconstructs an application object from the backup object. The backup analysis tool accesses the first application object according to a native application format associated with the first object.

Abstract: In accordance with an embodiment, described herein is a system and method for heterogeneous database replication from a remote server, for example a remote database server. A capture process can be registered as a replication slave to the remote server, and configured to receive transaction event data from that server. Transaction log events associated with a modification to the database at the remote server can be processed, and output as change data, in a canonical format output, for use with one or more heterogeneous targets, for example a target database server or message queue. The process enables capture of transaction log events associated with database transactions at a remote server that may be located on a different computer or network, or within an access-restricted environment such as a cloud environment, without the need to create additional copies of its transaction logs.

Abstract: A system including first computer memory storing a full data set representable in rows and columns, a second computer memory storing executable instructions, and processors configured to execute the instructions to cause presentation of data of the full data set on a display including columns of data each having data fields, receive user input identifying a column of the data set, determine items to modify in information in the data fields of the identified column, generate and cause display of an indication of a proposed change action to modify the determined items, and in response to a user input indicating a selection of the indication of the proposed change action, update the presentation of the data based on the change action to modify information displayed in the data fields of the identified column of the data, and store a log of the change action.

Abstract: An embodiment of the present invention is directed to an innovative approach to installing, upgrading and downgrading the package irrespective of the kernel version during system boot time after an operating system (OS) patching kernel update.

Abstract: A method, apparatus and product for identifying data drifts.

Abstract: The invention concerns a storage method for storing, on data servers (3, 4), data file (5, 61 to 64) slices (51 to 58) from the execution of a plurality of processes (65 to 68) of one or more applications (83, 85), comprising: distributing the stored data file (5, 61 to 64) slices (51 to 58) over different data servers (3, 4), characterized in that: this distribution is carried out in such a way that the data file (5, 61 to 64) slices (51 to 58) likely to be subsequently accessed simultaneously by different application (83, 85) processes (65 to 68) are stored on different data servers (3, 4) so as to reduce the subsequent access, to each of all or part of these data servers (3, 4) by too many application (83, 85) processes (65 to 68) simultaneously, and in that: the determination of the data file (5, 61 to 64) slices (51 to 58) likely to be subsequently accessed simultaneously by different application (83, 85) processes (65 to 68) has been carried out, during a prior phase of executing these application (83,

Abstract: A method can include initiating one or more transactions in response to a request associated with a first tenant in a multi-tenant computing system. The multi-tenant computing system can store a table of system master data. A determination can be made as to whether the first tenant has a table of customized master data that can include customized data values absent from the table of system master data. Based on the determination, one or more of the table of system master data and the table of customized master data can be used to respond to the request. A response to the request can be provided. Related systems and articles of manufacture, including computer program products, are also provided.

Abstract: Systems and methods for data recovery, backup and catalog generation are described. In part, the disclosure relates to a computer-implemented method for generating a data catalog includes creating a current backup archive; obtaining access to a Master File Table (MFT), or other index table such as an Inode Table, of the current backup archive and a MFT, or other index table such as an Inode Table, of a previous backup archive; comparing each entry in the MFT, or Inode Table, of the current backup to each entry of the MFT, or Inode Table, of the previous backup to identify one or more differences in the current backup archive; and saving one or more of the differences into the data catalog of the current backup archive.

Abstract: Example distributed storage systems, replication managers, and methods provide versioning validation for data transfers between heterogeneous data stores. A first object data store includes a versioned data object with a plurality of sequential versions corresponding to the versioned data object. A versioned write request message is sent to a second object data store and a response is received. The versioning-enabled status of the second object data store is determined from the response message and, if the versioning enabled status is invalid, any residual object versions in the second object data store are deleted based on a delete request.

Abstract: In general, the invention relates to a method for performing backup operations. The method includes generating a full backup of a user asset at a first point in time, generating an incremental backup after the full backup is generated, applying the incremental backup to the full backup to generate a second full backup, obtaining a distinct data files subset associated with the second full backup, and deleting the distinct data files subset from the second full backup to obtain a third full backup.

Abstract: Systems, methods, and devices for tracking a series of changes to database data are disclosed. A method includes executing a transaction to modify data in a micro-partition of a table of a database by generating a new micro-partition that embodies the transaction. The method includes associating transaction data with the new micro-partition, wherein the transaction data comprises a timestamp when the transaction was fully executed, and further includes associating modification data with the new micro-partition that comprises an indication of one or more rows of the table that were modified by the transaction. The method includes joining the transaction data with the modification data to generate joined data and querying the joined data to determine a listing of intermediate modifications made to the table between a first timestamp and a second timestamp.

Abstract: A method, computer program product, and computing system for identifying one or more metadata pages stored in a storage array, thus defining a primary set of metadata pages. An alternative set of metadata pages may be generated from the primary set of metadata pages. A log of changes associated with the primary set of metadata pages may be generated. A copy of at least a portion of the primary set of metadata pages may be generated based upon, at least in part, the alternative set of metadata pages and the log of changes associated with the primary set of metadata pages. The alternative set of metadata pages may lag behind in time from the primary set of metadata pages by a predefined amount of time.

Abstract: There are provided systems and methods for determining data validity during data processing for multiple processing stacks. During processing requests with a service provider, each request may go through a data flow that invokes multiple processing stacks, where the data is transmitted over a network to different data processing nodes. For example, a distributed computing architecture may invoke multiple disparate nodes to process data, which may become corrupted during data transmission and processing. To ensure data validity, a framework may be provided that provided data translators for each processing stack to covert data handled in a processing format for that stack into a base data format utilized by the framework. The framework may utilize checksums or other hash values of the data in the base data format to determine if the data has been altered at different processing nodes or stacks.

Abstract: A computer system that includes an active system service processor, a standby system service processor having a memory, and a unit, in which the active system service processor includes a first control unit configured to acquire log information indicating a log of the unit to cause the memory to store the information, and to output a read instruction for reading the log information to the standby system service processor according to an operation of instructing to read the log information, and the standby system service processor includes a second control unit configured to read the log information from the memory according to the read instruction, and to execute processing related to the read log information.

Abstract: Systems, methods, and devices for tracking a series of changes to database data are disclosed. A method includes executing a transaction to modify data in a micro-partition of a table of a database by generating a new micro-partition that embodies the transaction. The method includes associating transaction data with the new micro-partition, wherein the transaction data comprises a timestamp when the transaction was fully executed, and further includes associating modification data with the new micro-partition that comprises an indication of one or more rows of the table that were modified by the transaction. The method includes joining the transaction data with the modification data to generate joined data and querying the joined data to determine a listing of intermediate modifications made to the table between a first timestamp and a second timestamp.

Abstract: A bi-directional data synchronization system and method is provided to facilitate data communication and synchronization between a remote client device and an application server. In one embodiment, a method in a client device executing a mobile application where the client device is in communication with the application server over a network connection having unreliable network connectivity includes storing in a first table at the client device data associated with at least one data bucket designated to the client device, the data associated with the data bucket being a subset of data associated with the mobile application; in response to the network connection not being established, storing in a second table at the client device changes to the data in the first table as a result of the executing; and in response to the network connection being established, performing synchronization of data with the application server.

Abstract: Notification system using a blockchain system. A method of the disclosure includes determining, by a node of a blockchain system, that a notification is available for an application of a computing device. The application is associated with a service platform. The method also includes updating a ledger of the blockchain system to indicate that the notification for the application is available.

Abstract: A geospatial mapping system can access a geospatial layer data set for a first geographic area defined by a first presentation level, and provide the geospatial layer data set for the first geographic area to a client device to present a visual rendering of the first geographic area. The geospatial mapping system can receive a request to utilize an advanced feature set on a subset of geospatial artifacts located within the first geographic area, and promote, to the geospatial layer data set, an additional geospatial artifact data set for the subset of geospatial artifacts, yielding an updated geospatial layer data set for the first geographic area. The geospatial mapping system can provide the updated geospatial layer data set to the client device to provide the advanced feature set for interacting with the subset of geospatial artifacts located within the first geographic area.

Abstract: Systems and methods can implement a review process to evaluate changes to target code as part of development cycles for a continuous integration, continuous deployment pipeline for software-based products. The system can aggregate data and determine if the target code has been modified preliminarily and then intelligently determine where further review is needed before the changes are permanently implemented. To do this, a changeset including the preliminarily changed target code can be obtained from the aggregated data. The changeset can be tested with a prediction model based on feature data that characterizes aspects of a coding process carried out to generate the preliminary modification. The prediction model can provide an activation recommendation for the preliminary modification based on a plurality of risk factors determined from the testing. The prediction model can be trained, continuously, with training data that includes a plurality of data artifacts resulting from a code build processes.

Abstract: Using one or more processors, generating a materialized view over a share object, the share object, including data associated with a first account. Using the one or more processors, merging the materialized view and the share object. Using the one or more processors, updating the data associated with the first account subsequent to generating the materialized view. Using the one or more processors, generating a refreshed materialized view with respect to the share object in response to detecting the updated data. Using the one or more processors, sharing the refreshed materialized view to a second account in response to a request from the second account.

Abstract: Disclosed herein are a method and system for collecting cyber threat intelligence (CTI) data. The system includes a management server that determines agent configuration values associated with an OSINT providing source, an agent that receives the agent configuration values from the management server, performs a data collection task for collecting the CTI data based on the agent configuration values, and transmits the CTI data and data collection status information to the management server, a threat information database where which the CTI data is logged, and a system database where the data collection status information is logged.

Abstract: As described herein, a system, method, and computer program are provided for splitting and distributing a privileged software system into dependent components in order to deliver better security. In use, a privilege system is separated into n components of at least three components, wherein each of the n components runs on a separate machine, and a number up to t components may be controlled in an adversarial manner without compromising the privilege system, t components being at least two components and less than the n components. A power of a privilege is distributed among the n components. Additionally, one or more actions are performed within the privileged system.

Abstract: Techniques for cross-ACL multi-master replication are provided. The techniques allow a replication site in a multi-master replication system implementing an asynchronous replication protocol and an access control policy to appropriately apply received data change updates to data maintained at the site even where a data change update is missing information because of the implemented access control policy.

Abstract: Inventive systems, techniques, and program products for copy-on-read, particularly in the context of disaster recovery (DR), are described. The inventive concepts include: a primary system for copy-on-read processing and disaster recovery, the primary system comprising: a primary storage volume available at a primary system, the primary storage volume storing one or more data portions; a record of regions of the primary storage volume, wherein a given region of the primary storage volume is marked when a given data portion stored on the primary storage volume is sent to a disaster recovery system; and a record monitoring component configured to determine whether one or more later writes to marked region(s) of the primary storage volume should be immediately replicated to the disaster recovery system, wherein the later writes occur after replicating the given data portion stored on the primary storage volume to the disaster recovery system.

Abstract: An example method of reproducing a test case in a continuous integration environment includes detecting a test failure in a continuous integration environment. The continuous integration environment includes a plurality of stages for running a test on an application. The method also includes in response to detecting the failure, generating a snapshot while the test is running. The snapshot specifies a stage of the plurality of stages and a state of the application at which the failure occurred. The method further includes uploading the snapshot to a repository. At a later point in time, the snapshot may be restored to a computing device.

Abstract: Service data updated in a data update event is acquired by a service application executed by a computer-implemented system. The service data is stored in a local database of the service application. An event version corresponding to the data update event is generated by the service application. The service data and the event version are encapsulated into an event object by the service application. The event object is transmitted to a peer-end service application for synchronizing corresponding service data in a peer-end database of the peer-end service application.

Abstract: Aspects of the present disclosure provide for operations of a key-value store (KVS) that uses journaling with storage of data (e.g., key data or value data of a key-value pair) in different types of data storage objects (e.g., data storage formats) selected based on one or more criteria.

Abstract: A method and system for updating nodes in a hierarchical data structure is described. The system receives an update to a first node representing a record in a hierarchical data structure. The system determines at least one other node that needs updating based on the update to the first node. The system compares the number of nodes that need updating based upon the update to the first node to a maximum number to determine whether the number of nodes that need updating is less than, equal to and greater than the maximum number. The system performs a synchronous update of the nodes that need updating in response to a determination that the number of nodes is less than or equal to the maximum number and an asynchronous update of the nodes that need updating in response to a determination that the number of nodes is greater than the maximum number.

Abstract: A system includes reception of a first script conforming to a first programming language, identification of a first declaration of a first variable in the first script, determination of a first datatype based on the first declaration, determination of a first initial value corresponding to the first datatype based on a second programming language, and generation of a first portion of a second script conforming to the second programming language, the first portion of the second script to initialize the first variable with the first initial value.

Abstract: Guaranteed message sequencing between a first and second database is described. An example method includes maintaining first state information associated with the first database at the first database, where second state information associated with the first database is maintained at the second database. The client sends, to the second database, a message describing changed rows between the first database and the second database since a last synchronization and the first state information. The client subsequently receives, from the second database, status of the last synchronization, where the status is determined by the second database based on the first state information and the second state information.

Abstract: At a data stream management service, a first set of metadata indicating that a first isolated read channel has been associated with a first data stream is stored. The first isolated read channel has an associated read performance limit setting. A second set of metadata indicating that a second isolated read channel, with its own performance limit setting, has been associated with a data stream is also stored. Based on determining that the difference between a metric of read operations associated with the first channel and the read performance limit setting of the first channel meets a first criterion, the service initiates a throttling operation for reads associated with the first channel. The throttling decision is made independently of read metrics of the second channel.

Abstract: A database system may receive a write request that specifies a modification to be made to a particular data record stored by the database system. A log record representing the modification to be made to the particular data record may be sent to a storage service of the database system. An indication (e.g., log record or other indication) that indicates a cached version of the particular data record stored in a read replica's cache is stale may be sent to a read replica. For a subsequent read of the particular data record received by the read replica, the read replica may request the particular data record from the storage service.

Abstract: A computing system may include a computing device configured to build modules of script code into bundles, and a bundler application executable to perform operations comprising: obtaining one or more of the modules of script code that are designated for bundling with one another; organizing the modules of script code into one or more chunks; for each respective chunk of the one or more chunks: (i) determining whether the respective chunk is to be assigned a deterministic chunk identifier or a non-deterministic chunk identifier, and (ii) assigning the respective chunk a chunk identifier as determined, where deterministic chunk identifiers are usable for referencing by additional modules of script code both within and not within in the respective chunk, and where the deterministic chunk identifiers are independent of characteristics of the computing device; and writing the one or more chunks to a bundle.

Abstract: A system and method of backing up an online database to a storage device is provided wherein the online database is actively changed by one or more applications. The backed up online database is then subsequently restored. The online database is backed up by copying the online database to the storage device, and during the copying of the online database, writing changes that are made to the online database to a change log for the portion of the online database that has already been copied to the storage device, and not writing changes that are made to the online database to the change log for the portion of the online database that has not yet been copied to the storage device. The online database is then restored by loading the backed up online database to a restore database, and applying the changes in the change log to the restore database.

Abstract: The disclosed technology is generally directed to virtual machines. In one example of the technology, a network change from a first virtual network having a first customer Internet Protocol (IP) address to a second virtual network having a second customer IP address is configured for a first virtual machine. The configuring includes controlling the following actions. The second virtual network is provided. At least one networking artifact is associated with a first user that is associated with the first virtual machine. The at least one networking artifact includes the second virtual network. A directory service is updated to map the second customer IP address to a first physical IP address. The first physical IP address is a physical IP address of the first virtual network.

Abstract: Embodiments are directed to a method of identifying changed files in incremental block based backups, by obtaining changed data blocks of a file from a change block tracking (CBT) driver, wherein the file has an associated master file table (MFT) record and a parent MFT record number used in a file system, and constructing a complete file path of the file by traversing from the changed MFT record to the root directory using respective parent MFT record numbers by iteratively parsing each record by extracting the file name and parent MFT record number and appending the file name to a previous MFT record file name.

Abstract: A fleet node management system may include a metadata store, a plurality of fleet nodes, and one or more metadata mutation devices. The metadata store may be configured to store dynamic metadata. The plurality of fleet nodes may be configured to determine, based on a gossip protocol, whether to continue performance of a function that uses a local version of the metadata. The one or more metadata mutation devices may be configured to determine, based on a global state of the fleet nodes, whether to modify the dynamic metadata for the fleet nodes.

Abstract: Systems and methods are provided for creating a sandbox for an original tenant at a point in time, the original tenant having original tenant data stored in an immutable storage associated with an original tenant identifier, the original tenant data as of the sandbox creation point in time being a virtual snapshot of the original tenant data accessible by a sandbox tenant, where the sandbox tenant data can be changed without changing the original tenant data, and the original tenant data can be changed without changing the sandbox tenant data. A sandbox tenant is created by associating a sandbox tenant identifier with the virtual snapshot of the original tenant data and with sandbox tenant data created by the sandbox tenant subsequent to the sandbox creation point in time. In some implementations, the original tenant is an original sandbox tenant, and the sandbox tenant is at least one new sandbox tenant.

Abstract: A method for synchronizing a file system (FS) and a remote file system (RFS) includes monitoring the FS for FS events, generating FS event records, receiving RFS event records of RFS events, generating file system operations (FSOs) based on the FS and RFS event records, and communicating the FSOs to the FS and RFS to synchronize them. A method for generating the FSOs includes accessing a plurality of FS and/or RFS event records, processing the accessed records to generate processed event records, generating the FSOs based on the processed event records, and outputting the FSOs to cause synchronization of the FS and RFS. Systems are also described. The invention facilitates event-based, steady-state synchronization of local and remote file systems.

Abstract: A geospatial mapping system can access a geospatial layer data set for a first geographic area defined by a first presentation level, and provide the geospatial layer data set for the first geographic area to a client device to present a visual rendering of the first geographic area. The geospatial mapping system can receive a request to utilize an advanced feature set on a subset of geospatial artifacts located within the first geographic area, and promote, to the geospatial layer data set, an additional geospatial artifact data set for the subset of geospatial artifacts, yielding an updated geospatial layer data set for the first geographic area. The geospatial mapping system can provide the updated geospatial layer data set to the client device to provide the advanced feature set for interacting with the subset of geospatial artifacts located within the first geographic area.

Abstract: An apparatus is configured to initiate distributed computations across a plurality of data processing clusters associated with respective data zones, to utilize local processing results of at least a subset of the distributed computations from respective ones of the data processing clusters to generate global processing results, and to update at least one distributed ledger maintained by one or more of the plurality of data processing clusters to incorporate one or more blocks each characterizing at least a portion of the distributed computations. Each of at least a subset of the data processing clusters is configured to process data from a data source of the corresponding data zone using one or more local computations of that data processing cluster to generate at least a portion of the local processing results.

Abstract: A system for storing and transmitting data in a highly compact format comprising reference codes to data chunklets contained in a library, wherein the data are retrieved after transmission or storage by re-constructing the data from the chunklets in the library using the reference codes. One version of the system contains proprietary libraries which act as a form of data security. Another version of the system contains a standardized version of the library encoded onto the firmware of a broad range of computing devices, allowing optimized storage and transmission of data between two such devices equipped with the system.

Abstract: A replication chain comprising one or more replication nodes of a multi-tenant stream management system is assigned to store data records of a partition of a particular data stream. A data record of the partition is received at a selected replication node of the replication chain. In a sequential order, a respective replica of the data record is stored at each replication node of the chain. An acknowledgement of a successful storage of the data record is provided after the replications are completed.

Abstract: The present disclosure relates to techniques for analysis of data from multiple different data sources to determine similarity amongst the datasets. Determining a similarity between datasets may be useful for downstream processing of those datasets for different uses. A graphical interface may be provided to display detailed results including: a similarity prediction, data similarity prediction, column order similarity prediction, document type similarity prediction, prediction of overlapping or related columns, orphaned column prediction (e.g., a left orphaned column or a right orphaned column). Detecting similarities may be useful for leveraging prior data transformations generated for the datasets that are analyzed.

Abstract: Disclosed embodiments relate to generating an update package for updating software on an Electronic Control Unit (ECU) in a vehicle. Operations may include accessing a plurality of attributes of a software update to be stored on the ECU in the vehicle; accessing a corresponding plurality of attributes of current software stored on the ECU in the vehicle; comparing the plurality of attributes with the corresponding plurality of attributes; generating a delta file representing differences between the plurality of attributes and the corresponding plurality of attributes determined in the comparison; and providing the delta file to the ECU, wherein the delta file is configured to be processed by startup code in the ECU that enables the delta file to execute in the ECU in the vehicle.

Abstract: Various embodiments are directed to systems and methods for creating an archive of a set of logical storage units stored on at least one storage medium. A first plurality of LSU descriptors may be generated. Each LSU descriptor may describe a current version of one of the set of LSUs at about the time of the generating. A first archive may be read to produce a first archive plurality of LSU descriptors. Each of the first archive plurality of LSU descriptors may describe a version of one of the set of LSUs when the first archive was created. The first archive plurality of LSU descriptors may be compared with the first plurality of LSU descriptors to identify a first LSU from the set of LSUs that has an associated LSU descriptor that does not match a corresponding LSU descriptor from the first archive plurality of LSU descriptors.

Abstract: A method for data replication between two file systems is disclosed. A base file relationship between the current generation of files and the last replicated generation may be constructed based on the generation-to-generation base file relationships of the intervening generations. The base file relationship between the current generation of files and the last replicated generation may be utilized in the replication of the current generation of files to the replica file system to reduce the amount of data that needs to be transferred while the files on the replica file system are more than one generation behind the current generation due to network outage or other issues.

Abstract: An automated repartitioning agent (ARA) of a storage service determines a repartitioning plan for a storage object. The plan identifies a source set of partitions whose keys are to be distributed among a target number of partitions. The ARA generates a data structure representing the source set, with entries indicating the key sets of corresponding partitions. The ARA implements repartitioning iterations until the keys of the source set have been redistributed. In each iteration, the ARA compares the key set of a selected entry of the data structure with a target key set and performs repartitioning actions based on the result. The repartitioning action may include splitting the selected entry's partition, merging the selected entry's partition with another partition, or designating the selected entry's partition as acceptable.

Abstract: In embodiments of synchronizing linked assets from unsynchronized file folders, files are organized in folders of a file system, where the folders include a synchronized folder and an unsynchronized folder, the synchronized folder having been selected for synchronization of the files contained in the synchronized folder, and the unsynchronized folder containing linked assets. The files contained in the synchronized folder are synchronized with a network-based memory system that stores an instantiation of the files. A synchronization service can determine that a file contained in the synchronized folder references to one or more of the linked assets contained in the unsynchronized folder. The synchronization service can then synchronize a linked asset from the unsynchronized folder automatically based on criteria associated with the file contained in the synchronized folder.

Abstract: A system for storing and transmitting data in a highly compact format comprising reference codes to data chunklets contained in a library, wherein the data are retrieved after transmission or storage by re-constructing the data from the chunklets in the library using the reference codes. One version of the system contains proprietary libraries which act as a form of data security. Another version of the system contains a standardized version of the library encoded onto the firmware of a broad range of computing devices, allowing optimized storage and transmission of data between two such devices equipped with the system.