Abstract: In general, the invention relates to a method for performing backup operations. The method includes generating a full backup of a user asset at a first point in time, generating an incremental backup after the full backup is generated, applying the incremental backup to the full backup to generate a second full backup, obtaining a distinct data files subset associated with the second full backup, and deleting the distinct data files subset from the second full backup to obtain a third full backup.

Abstract: Systems, methods, and devices for tracking a series of changes to database data are disclosed. A method includes executing a transaction to modify data in a micro-partition of a table of a database by generating a new micro-partition that embodies the transaction. The method includes associating transaction data with the new micro-partition, wherein the transaction data comprises a timestamp when the transaction was fully executed, and further includes associating modification data with the new micro-partition that comprises an indication of one or more rows of the table that were modified by the transaction. The method includes joining the transaction data with the modification data to generate joined data and querying the joined data to determine a listing of intermediate modifications made to the table between a first timestamp and a second timestamp.

Abstract: A method, computer program product, and computing system for identifying one or more metadata pages stored in a storage array, thus defining a primary set of metadata pages. An alternative set of metadata pages may be generated from the primary set of metadata pages. A log of changes associated with the primary set of metadata pages may be generated. A copy of at least a portion of the primary set of metadata pages may be generated based upon, at least in part, the alternative set of metadata pages and the log of changes associated with the primary set of metadata pages. The alternative set of metadata pages may lag behind in time from the primary set of metadata pages by a predefined amount of time.

Abstract: There are provided systems and methods for determining data validity during data processing for multiple processing stacks. During processing requests with a service provider, each request may go through a data flow that invokes multiple processing stacks, where the data is transmitted over a network to different data processing nodes. For example, a distributed computing architecture may invoke multiple disparate nodes to process data, which may become corrupted during data transmission and processing. To ensure data validity, a framework may be provided that provided data translators for each processing stack to covert data handled in a processing format for that stack into a base data format utilized by the framework. The framework may utilize checksums or other hash values of the data in the base data format to determine if the data has been altered at different processing nodes or stacks.

Abstract: A computer system that includes an active system service processor, a standby system service processor having a memory, and a unit, in which the active system service processor includes a first control unit configured to acquire log information indicating a log of the unit to cause the memory to store the information, and to output a read instruction for reading the log information to the standby system service processor according to an operation of instructing to read the log information, and the standby system service processor includes a second control unit configured to read the log information from the memory according to the read instruction, and to execute processing related to the read log information.

Abstract: Notification system using a blockchain system. A method of the disclosure includes determining, by a node of a blockchain system, that a notification is available for an application of a computing device. The application is associated with a service platform. The method also includes updating a ledger of the blockchain system to indicate that the notification for the application is available.

Abstract: A bi-directional data synchronization system and method is provided to facilitate data communication and synchronization between a remote client device and an application server. In one embodiment, a method in a client device executing a mobile application where the client device is in communication with the application server over a network connection having unreliable network connectivity includes storing in a first table at the client device data associated with at least one data bucket designated to the client device, the data associated with the data bucket being a subset of data associated with the mobile application; in response to the network connection not being established, storing in a second table at the client device changes to the data in the first table as a result of the executing; and in response to the network connection being established, performing synchronization of data with the application server.

Abstract: Systems, methods, and devices for tracking a series of changes to database data are disclosed. A method includes executing a transaction to modify data in a micro-partition of a table of a database by generating a new micro-partition that embodies the transaction. The method includes associating transaction data with the new micro-partition, wherein the transaction data comprises a timestamp when the transaction was fully executed, and further includes associating modification data with the new micro-partition that comprises an indication of one or more rows of the table that were modified by the transaction. The method includes joining the transaction data with the modification data to generate joined data and querying the joined data to determine a listing of intermediate modifications made to the table between a first timestamp and a second timestamp.

Abstract: A geospatial mapping system can access a geospatial layer data set for a first geographic area defined by a first presentation level, and provide the geospatial layer data set for the first geographic area to a client device to present a visual rendering of the first geographic area. The geospatial mapping system can receive a request to utilize an advanced feature set on a subset of geospatial artifacts located within the first geographic area, and promote, to the geospatial layer data set, an additional geospatial artifact data set for the subset of geospatial artifacts, yielding an updated geospatial layer data set for the first geographic area. The geospatial mapping system can provide the updated geospatial layer data set to the client device to provide the advanced feature set for interacting with the subset of geospatial artifacts located within the first geographic area.

Abstract: Systems and methods can implement a review process to evaluate changes to target code as part of development cycles for a continuous integration, continuous deployment pipeline for software-based products. The system can aggregate data and determine if the target code has been modified preliminarily and then intelligently determine where further review is needed before the changes are permanently implemented. To do this, a changeset including the preliminarily changed target code can be obtained from the aggregated data. The changeset can be tested with a prediction model based on feature data that characterizes aspects of a coding process carried out to generate the preliminary modification. The prediction model can provide an activation recommendation for the preliminary modification based on a plurality of risk factors determined from the testing. The prediction model can be trained, continuously, with training data that includes a plurality of data artifacts resulting from a code build processes.

Abstract: Using one or more processors, generating a materialized view over a share object, the share object, including data associated with a first account. Using the one or more processors, merging the materialized view and the share object. Using the one or more processors, updating the data associated with the first account subsequent to generating the materialized view. Using the one or more processors, generating a refreshed materialized view with respect to the share object in response to detecting the updated data. Using the one or more processors, sharing the refreshed materialized view to a second account in response to a request from the second account.

Abstract: Disclosed herein are a method and system for collecting cyber threat intelligence (CTI) data. The system includes a management server that determines agent configuration values associated with an OSINT providing source, an agent that receives the agent configuration values from the management server, performs a data collection task for collecting the CTI data based on the agent configuration values, and transmits the CTI data and data collection status information to the management server, a threat information database where which the CTI data is logged, and a system database where the data collection status information is logged.

Abstract: As described herein, a system, method, and computer program are provided for splitting and distributing a privileged software system into dependent components in order to deliver better security. In use, a privilege system is separated into n components of at least three components, wherein each of the n components runs on a separate machine, and a number up to t components may be controlled in an adversarial manner without compromising the privilege system, t components being at least two components and less than the n components. A power of a privilege is distributed among the n components. Additionally, one or more actions are performed within the privileged system.

Abstract: Techniques for cross-ACL multi-master replication are provided. The techniques allow a replication site in a multi-master replication system implementing an asynchronous replication protocol and an access control policy to appropriately apply received data change updates to data maintained at the site even where a data change update is missing information because of the implemented access control policy.

Abstract: Inventive systems, techniques, and program products for copy-on-read, particularly in the context of disaster recovery (DR), are described. The inventive concepts include: a primary system for copy-on-read processing and disaster recovery, the primary system comprising: a primary storage volume available at a primary system, the primary storage volume storing one or more data portions; a record of regions of the primary storage volume, wherein a given region of the primary storage volume is marked when a given data portion stored on the primary storage volume is sent to a disaster recovery system; and a record monitoring component configured to determine whether one or more later writes to marked region(s) of the primary storage volume should be immediately replicated to the disaster recovery system, wherein the later writes occur after replicating the given data portion stored on the primary storage volume to the disaster recovery system.

Abstract: Service data updated in a data update event is acquired by a service application executed by a computer-implemented system. The service data is stored in a local database of the service application. An event version corresponding to the data update event is generated by the service application. The service data and the event version are encapsulated into an event object by the service application. The event object is transmitted to a peer-end service application for synchronizing corresponding service data in a peer-end database of the peer-end service application.

Abstract: An example method of reproducing a test case in a continuous integration environment includes detecting a test failure in a continuous integration environment. The continuous integration environment includes a plurality of stages for running a test on an application. The method also includes in response to detecting the failure, generating a snapshot while the test is running. The snapshot specifies a stage of the plurality of stages and a state of the application at which the failure occurred. The method further includes uploading the snapshot to a repository. At a later point in time, the snapshot may be restored to a computing device.

Abstract: Aspects of the present disclosure provide for operations of a key-value store (KVS) that uses journaling with storage of data (e.g., key data or value data of a key-value pair) in different types of data storage objects (e.g., data storage formats) selected based on one or more criteria.

Abstract: A method and system for updating nodes in a hierarchical data structure is described. The system receives an update to a first node representing a record in a hierarchical data structure. The system determines at least one other node that needs updating based on the update to the first node. The system compares the number of nodes that need updating based upon the update to the first node to a maximum number to determine whether the number of nodes that need updating is less than, equal to and greater than the maximum number. The system performs a synchronous update of the nodes that need updating in response to a determination that the number of nodes is less than or equal to the maximum number and an asynchronous update of the nodes that need updating in response to a determination that the number of nodes is greater than the maximum number.

Abstract: A system includes reception of a first script conforming to a first programming language, identification of a first declaration of a first variable in the first script, determination of a first datatype based on the first declaration, determination of a first initial value corresponding to the first datatype based on a second programming language, and generation of a first portion of a second script conforming to the second programming language, the first portion of the second script to initialize the first variable with the first initial value.

Abstract: Guaranteed message sequencing between a first and second database is described. An example method includes maintaining first state information associated with the first database at the first database, where second state information associated with the first database is maintained at the second database. The client sends, to the second database, a message describing changed rows between the first database and the second database since a last synchronization and the first state information. The client subsequently receives, from the second database, status of the last synchronization, where the status is determined by the second database based on the first state information and the second state information.

Abstract: At a data stream management service, a first set of metadata indicating that a first isolated read channel has been associated with a first data stream is stored. The first isolated read channel has an associated read performance limit setting. A second set of metadata indicating that a second isolated read channel, with its own performance limit setting, has been associated with a data stream is also stored. Based on determining that the difference between a metric of read operations associated with the first channel and the read performance limit setting of the first channel meets a first criterion, the service initiates a throttling operation for reads associated with the first channel. The throttling decision is made independently of read metrics of the second channel.

Abstract: A database system may receive a write request that specifies a modification to be made to a particular data record stored by the database system. A log record representing the modification to be made to the particular data record may be sent to a storage service of the database system. An indication (e.g., log record or other indication) that indicates a cached version of the particular data record stored in a read replica's cache is stale may be sent to a read replica. For a subsequent read of the particular data record received by the read replica, the read replica may request the particular data record from the storage service.

Abstract: A computing system may include a computing device configured to build modules of script code into bundles, and a bundler application executable to perform operations comprising: obtaining one or more of the modules of script code that are designated for bundling with one another; organizing the modules of script code into one or more chunks; for each respective chunk of the one or more chunks: (i) determining whether the respective chunk is to be assigned a deterministic chunk identifier or a non-deterministic chunk identifier, and (ii) assigning the respective chunk a chunk identifier as determined, where deterministic chunk identifiers are usable for referencing by additional modules of script code both within and not within in the respective chunk, and where the deterministic chunk identifiers are independent of characteristics of the computing device; and writing the one or more chunks to a bundle.

Abstract: The disclosed technology is generally directed to virtual machines. In one example of the technology, a network change from a first virtual network having a first customer Internet Protocol (IP) address to a second virtual network having a second customer IP address is configured for a first virtual machine. The configuring includes controlling the following actions. The second virtual network is provided. At least one networking artifact is associated with a first user that is associated with the first virtual machine. The at least one networking artifact includes the second virtual network. A directory service is updated to map the second customer IP address to a first physical IP address. The first physical IP address is a physical IP address of the first virtual network.

Abstract: A system and method of backing up an online database to a storage device is provided wherein the online database is actively changed by one or more applications. The backed up online database is then subsequently restored. The online database is backed up by copying the online database to the storage device, and during the copying of the online database, writing changes that are made to the online database to a change log for the portion of the online database that has already been copied to the storage device, and not writing changes that are made to the online database to the change log for the portion of the online database that has not yet been copied to the storage device. The online database is then restored by loading the backed up online database to a restore database, and applying the changes in the change log to the restore database.

Abstract: Embodiments are directed to a method of identifying changed files in incremental block based backups, by obtaining changed data blocks of a file from a change block tracking (CBT) driver, wherein the file has an associated master file table (MFT) record and a parent MFT record number used in a file system, and constructing a complete file path of the file by traversing from the changed MFT record to the root directory using respective parent MFT record numbers by iteratively parsing each record by extracting the file name and parent MFT record number and appending the file name to a previous MFT record file name.

Abstract: A fleet node management system may include a metadata store, a plurality of fleet nodes, and one or more metadata mutation devices. The metadata store may be configured to store dynamic metadata. The plurality of fleet nodes may be configured to determine, based on a gossip protocol, whether to continue performance of a function that uses a local version of the metadata. The one or more metadata mutation devices may be configured to determine, based on a global state of the fleet nodes, whether to modify the dynamic metadata for the fleet nodes.

Abstract: Systems and methods are provided for creating a sandbox for an original tenant at a point in time, the original tenant having original tenant data stored in an immutable storage associated with an original tenant identifier, the original tenant data as of the sandbox creation point in time being a virtual snapshot of the original tenant data accessible by a sandbox tenant, where the sandbox tenant data can be changed without changing the original tenant data, and the original tenant data can be changed without changing the sandbox tenant data. A sandbox tenant is created by associating a sandbox tenant identifier with the virtual snapshot of the original tenant data and with sandbox tenant data created by the sandbox tenant subsequent to the sandbox creation point in time. In some implementations, the original tenant is an original sandbox tenant, and the sandbox tenant is at least one new sandbox tenant.

Abstract: A method for synchronizing a file system (FS) and a remote file system (RFS) includes monitoring the FS for FS events, generating FS event records, receiving RFS event records of RFS events, generating file system operations (FSOs) based on the FS and RFS event records, and communicating the FSOs to the FS and RFS to synchronize them. A method for generating the FSOs includes accessing a plurality of FS and/or RFS event records, processing the accessed records to generate processed event records, generating the FSOs based on the processed event records, and outputting the FSOs to cause synchronization of the FS and RFS. Systems are also described. The invention facilitates event-based, steady-state synchronization of local and remote file systems.

Abstract: A geospatial mapping system can access a geospatial layer data set for a first geographic area defined by a first presentation level, and provide the geospatial layer data set for the first geographic area to a client device to present a visual rendering of the first geographic area. The geospatial mapping system can receive a request to utilize an advanced feature set on a subset of geospatial artifacts located within the first geographic area, and promote, to the geospatial layer data set, an additional geospatial artifact data set for the subset of geospatial artifacts, yielding an updated geospatial layer data set for the first geographic area. The geospatial mapping system can provide the updated geospatial layer data set to the client device to provide the advanced feature set for interacting with the subset of geospatial artifacts located within the first geographic area.

Abstract: An apparatus is configured to initiate distributed computations across a plurality of data processing clusters associated with respective data zones, to utilize local processing results of at least a subset of the distributed computations from respective ones of the data processing clusters to generate global processing results, and to update at least one distributed ledger maintained by one or more of the plurality of data processing clusters to incorporate one or more blocks each characterizing at least a portion of the distributed computations. Each of at least a subset of the data processing clusters is configured to process data from a data source of the corresponding data zone using one or more local computations of that data processing cluster to generate at least a portion of the local processing results.

Abstract: A system for storing and transmitting data in a highly compact format comprising reference codes to data chunklets contained in a library, wherein the data are retrieved after transmission or storage by re-constructing the data from the chunklets in the library using the reference codes. One version of the system contains proprietary libraries which act as a form of data security. Another version of the system contains a standardized version of the library encoded onto the firmware of a broad range of computing devices, allowing optimized storage and transmission of data between two such devices equipped with the system.

Abstract: A replication chain comprising one or more replication nodes of a multi-tenant stream management system is assigned to store data records of a partition of a particular data stream. A data record of the partition is received at a selected replication node of the replication chain. In a sequential order, a respective replica of the data record is stored at each replication node of the chain. An acknowledgement of a successful storage of the data record is provided after the replications are completed.

Abstract: The present disclosure relates to techniques for analysis of data from multiple different data sources to determine similarity amongst the datasets. Determining a similarity between datasets may be useful for downstream processing of those datasets for different uses. A graphical interface may be provided to display detailed results including: a similarity prediction, data similarity prediction, column order similarity prediction, document type similarity prediction, prediction of overlapping or related columns, orphaned column prediction (e.g., a left orphaned column or a right orphaned column). Detecting similarities may be useful for leveraging prior data transformations generated for the datasets that are analyzed.

Abstract: Disclosed embodiments relate to generating an update package for updating software on an Electronic Control Unit (ECU) in a vehicle. Operations may include accessing a plurality of attributes of a software update to be stored on the ECU in the vehicle; accessing a corresponding plurality of attributes of current software stored on the ECU in the vehicle; comparing the plurality of attributes with the corresponding plurality of attributes; generating a delta file representing differences between the plurality of attributes and the corresponding plurality of attributes determined in the comparison; and providing the delta file to the ECU, wherein the delta file is configured to be processed by startup code in the ECU that enables the delta file to execute in the ECU in the vehicle.

Abstract: Various embodiments are directed to systems and methods for creating an archive of a set of logical storage units stored on at least one storage medium. A first plurality of LSU descriptors may be generated. Each LSU descriptor may describe a current version of one of the set of LSUs at about the time of the generating. A first archive may be read to produce a first archive plurality of LSU descriptors. Each of the first archive plurality of LSU descriptors may describe a version of one of the set of LSUs when the first archive was created. The first archive plurality of LSU descriptors may be compared with the first plurality of LSU descriptors to identify a first LSU from the set of LSUs that has an associated LSU descriptor that does not match a corresponding LSU descriptor from the first archive plurality of LSU descriptors.

Abstract: A method for data replication between two file systems is disclosed. A base file relationship between the current generation of files and the last replicated generation may be constructed based on the generation-to-generation base file relationships of the intervening generations. The base file relationship between the current generation of files and the last replicated generation may be utilized in the replication of the current generation of files to the replica file system to reduce the amount of data that needs to be transferred while the files on the replica file system are more than one generation behind the current generation due to network outage or other issues.

Abstract: An automated repartitioning agent (ARA) of a storage service determines a repartitioning plan for a storage object. The plan identifies a source set of partitions whose keys are to be distributed among a target number of partitions. The ARA generates a data structure representing the source set, with entries indicating the key sets of corresponding partitions. The ARA implements repartitioning iterations until the keys of the source set have been redistributed. In each iteration, the ARA compares the key set of a selected entry of the data structure with a target key set and performs repartitioning actions based on the result. The repartitioning action may include splitting the selected entry's partition, merging the selected entry's partition with another partition, or designating the selected entry's partition as acceptable.

Abstract: In embodiments of synchronizing linked assets from unsynchronized file folders, files are organized in folders of a file system, where the folders include a synchronized folder and an unsynchronized folder, the synchronized folder having been selected for synchronization of the files contained in the synchronized folder, and the unsynchronized folder containing linked assets. The files contained in the synchronized folder are synchronized with a network-based memory system that stores an instantiation of the files. A synchronization service can determine that a file contained in the synchronized folder references to one or more of the linked assets contained in the unsynchronized folder. The synchronization service can then synchronize a linked asset from the unsynchronized folder automatically based on criteria associated with the file contained in the synchronized folder.

Abstract: A system for storing and transmitting data in a highly compact format comprising reference codes to data chunklets contained in a library, wherein the data are retrieved after transmission or storage by re-constructing the data from the chunklets in the library using the reference codes. One version of the system contains proprietary libraries which act as a form of data security. Another version of the system contains a standardized version of the library encoded onto the firmware of a broad range of computing devices, allowing optimized storage and transmission of data between two such devices equipped with the system.

Abstract: A computer-implemented method for providing tenant aware, variable length, deduplication of data stored on a non-transitory computer readable storage medium. The method is performed at least in part by circuitry and the data comprises a plurality of data items. Each of the plurality of data items is associated with a particular tenant of a group of tenants that store data on the storage medium.

Abstract: A method, article of manufacture, and apparatus for protecting data. In some embodiments, this includes taking a snapshot of a virtual machine, parsing the virtual machine to determine a header section and a file system, indexing the virtual machine based on the parsing, storing the index in a storage device, and storing the snapshot in a deduplicated data storage device.

Abstract: A method and system for synchronizing documents in a distributed server-client environment. The system includes a synchronization server, a distributor client, a user client, and/or a network connecting the server and the clients. The method includes the steps of wrapping synchronization information such as document ID and version number in a synchronized document, storing the synchronized document and the synchronization information in a synchronization server, and comparing the local version with the version stored in the sync server if a latest version is to open, and if the local version is not the latest version, accessing the latest version document by receiving the document from the synchronized server.

Abstract: A control method executed by a control device, the control method including identifying a specified time period based on execution history information on previous jobs related to the plurality of systems, the specified time period being a period prior to execution start timing of a first job, update processing for a data storage area from which the first job refers to data is not executed during the specified time period, performing control so that evaluation timing of an amount of the data that the first job refers to from the data storage area is included in the identified time period, determining a specified system among from the plurality of systems based on the amount of the data evaluated at the evaluation timing, and causing the specified system to execute the first job.

Abstract: A method, article of manufacture, and apparatus for protecting data. In some embodiments, this includes taking a snapshot of a virtual machine, parsing the virtual machine to determine a header section and a file system, indexing the virtual machine based on the parsing, storing the index in a storage device, and storing the snapshot in a deduplicated data storage device.

Abstract: A method is provided for execution by one or more processing modules of a dispersed storage network (DSN). The method begins by the DSN receiving a request to update one or more data segments of a data object and continues with the DSN determining whether one or more encoded data slices (EDSs) of a plurality of EDSs associated with the one or more data segments of the data object are eligible for partial updating. The DSN then executes a partial updating process for the eligible EDS while excluding any EDSs eligible for the partial updating that would be unaffected during the partial updating process.

Abstract: Methods and systems relating to a file distribution scheme in a computer network are disclosed that distributes files in an efficient manner that reduces, among other things, network traffic. In an embodiment of the invention, a method for updating a file is disclosed. In such a method, unique chunks in a first version of a digital file are identified. For a second version of the digital file, chunks that are the same as in the first version are identified. Recompilation information is generated and stored for these identified chunks. Also, for the second version of the digital file, chunks in the second version that are different from chunks in the first version are identified. Recompilation information is generated and stored for these identified chunks. With this information, the second version of the digital file is completely defined and can be efficiently stored.

Abstract: A network element (NE) comprising a memory configured to store a digest log for a conference, a receiver coupled to the memory and configured to receive a first message from a first of a plurality of service proxies of the conference, wherein the first message comprises a signature profile of a first of a plurality of participants of the conference associated with the first service proxy, a processor coupled to the receiver and the memory and configured to track a state of the conference by updating the digest log according to the first message, and a transmitter coupled to the processor and configured to send a plurality of second messages to indicate the digest log update to the service proxies without a transmission request from the service proxies.

Abstract: A method and system for automatically enforcing a hybrid branching strategy include receiving a changeset designated for a branch. In response to receiving the changeset, the system may automatically determine whether a merge conflict associated with the changeset exists between the branch and an associated protected branch, and the system may automatically determine whether the changeset is up to date. Upon determining that no merge conflict exists, the system automatically initiates execution of a continuous integration testing pipeline. The continuous integration testing pipeline includes a series of tests applied to the changeset. If the changeset passes the series of tests, the system automatically merges the changeset with the associated protected branch.