Abstract: Verified snapshots are generated by obtaining, from one of a plurality of first nodes, a difference between a common data at a first time point and the common data at a second time point that is different from the first time point, generating a first snapshot of the common data at the first time point based on the difference, obtaining a hash of the common data at the first time point from one of the plurality of first nodes, and verifying the first snapshot at the first time point with the hash of the common data at the first time point.

Abstract: Configuration data characterizing configuration information of at least one application process executing on a target system is received. The configuration data includes at least one first table and at least one second table upon which the first table depends. The receiving is performed prior to transmission of the configuration data to the target system for application of the configuration data to the target system. At least one validation definition including a header and table elements specifying a dependency of the first table on the second table is determined using the configuration data. Whether to validate the configuration data to ensure consistency within the target system is determined using the at least one validation definition. The determining whether to validate includes determining to validate the configuration data in response to determining that the second table has been modified. Related apparatus, systems, techniques and articles are also described.

Abstract: Content management systems that utilize external content libraries are described herein. According to some embodiments, an example system includes a content management system configured to create web content that includes at least one asset that resides on an external system that is remote to the system, the web content having a reference to the at least one asset, an external content library connector system exposing connectors that are accessible to both the content management system and a dynamic experience delivery system, and the dynamic experience delivery system configured to invoke the external content library connector system to obtain the at least one asset based on the reference using one or more of the connectors and publish the web content with the at least one asset included therein.

Abstract: A method and apparatus for executing a distributed computing task are provided. The method can include: parsing an expression of the distributed computing task to obtain an operator keyword; and executing, by using an operator corresponding to the operator keyword, the distributed computing task based on an input parameter of the operator, the input parameter of the operator including at least one of: a distributed stored distributed dataset including at least one data element, a distributed stored distributed key-value pair set including at least one key-value pair, and a value of the key-value pair in the distributed key-value pair set being a distributed dataset or a distributed key-value pair set.

Abstract: A method includes obtaining information associated with a database model, where the information includes configuration parameters of a database defined by the database model. The method also includes obtaining information defining data objects associated with an application, where the data objects are to be used by the application to access the database. The method further includes identifying one or more discrepancies between at least one of the data objects and the configuration parameters of the database. In addition, the method includes modifying the at least one data object to conform the application to a current configuration of the database.

Abstract: Trace processing in a database system is facilitated by obtaining database trace data collected from database tracing a database system, and data analyzing, by one or more processors, the database trace data to determine one or more field-related rules to, in part, reduce impact on system performance of database tracing in the database system. Trace processing is further facilitated by applying the one or more field-related rules to a database trace in the database system to adjust trace fields of the database trace according to the one or more field-related rules, thereby reducing impact on system performance of the database trace in the database system.

Abstract: Processing a database query for sets of data includes assigning a unique identifier from an integer space to each entity within data and creating one or more sets of entities each pertaining to a corresponding entity within the data. A representation is then generated on disk for each set of entities, wherein each representation encompasses and is suited for a range of the unique identifiers of entities within a corresponding set and indicates a presence of an entity within that corresponding set. Finally, a query is processed based on the representation for each set of entities to retrieve data satisfying the query, wherein the representation provides a constant time for association and dissociation operations that are append-only operations with deferred merge and automatic filtering of deleted and duplicate entities at query time.

Abstract: In certain embodiments, multi-modal-based generation of settlement instructions may be facilitated. In some embodiments, a portfolio of a live environment may be emulated in a projected environment. A target portfolio may be generated in the projected environment based on the emulated portfolio. Partial synchronization between the target portfolio of the projected environment and the portfolio of the live environment may be performed such that a first subset of changes to the portfolio of the live environment are reflected in the target portfolio of the projected environment. Subsequent to the partial synchronization, the target portfolio of the projected environment may be updated such that the update of the target portfolio accounts for the first subset of changes. Subsequent to the update of the target portfolio, settlement instructions may be generated based on differences between the target portfolio of the projected environment and the portfolio of the live environment.

Abstract: Batch processing of undo log records may be performed for rolling back a database transaction. When a rollback operation for a database transaction is performed, undo log records from an undo log to rollback the database transaction are divided into different groups of undo log records. Different requests for the different undo log records are sent to a storage system to be performed. If a conflict is detected for an undo log record in a group, an indication of the conflicting undo log record may be provided to indicate the conflict. The group of undo log records may be resent with a request to reapply the undo log records in the group. When all groups have been identified as successfully completed, then the rollback operation may be considered completed.

Abstract: A method and software tool for identifying relationships between columns of one or more data tables are disclosed. In the disclosed method, a relationship indicator is computed for each of a plurality of column pairs, each column pair comprising respective first and second columns selected from the one or more data tables. The relationship indicator comprises a measure of a relationship (e.g. indicating a strength or likelihood of a relationship) between data of the first column and data of the second column. Relationships between columns of the data tables are then identified in dependence on the computed relationship indicators. The identified relationships may be used to create and execute data queries.

Abstract: Zero block elimination (ZBE) and statistical accounting for reduction in storage space used in a memory component of a file system due to ZBE can be managed. During a write operation, in response to eliminating a zero block from the write operation, a data management component (DMC) can associate a zero extent with a sparse region that represents a block in the memory component where the zero block was to have been written, unless a zero extent is already associated with that block. DMC can determine a number of zero blocks eliminated from write operations due to ZBE based on the number of zero extents associated with files stored in the memory component, to facilitate determining an amount of reduction of use of storage space in the memory component, or a data reduction ratio, storage efficiency ratio, or zero reduction ratio associated with the memory component, due to ZBE.

Abstract: Techniques for handling highly amortized metadata page updates in storage clusters with delta log-based architectures. In response to performance of a transaction commit operation, bulk metadata pages are written in a transactional area of persistent memory in association with a unique transaction identifier. Further, raw delta updates to metadata pages and, for each bulk metadata page, a specialized flag, are written to a metadata delta log in association with the unique transaction ID. The specialized flag provides an indication that all delta updates that have occurred previous to the writing of a bulk metadata page are no longer relevant and should be dropped. The raw delta updates to metadata pages and specialized flags are updated in a volatile memory structure. The bulk metadata pages are flushed from the transactional buffer area directly to a metadata store of a storage array in a manner that bypasses the metadata delta log.

Abstract: A synchronized data management system, connected to at least one user device through a network, includes: a server to receive requests from the user device and a common storage database comprising a master storage unit configured to store data; and an auxiliary storage unit configured to store updated data. The synchronized data management system is configured to: transmit a subset of data stored in the master storage unit to a given user device in response to an update request received by the server from the user device; store an update made to the subset of data and received from the user device in the auxiliary storage unit; and store the update made to the subset of data to the master storage unit in response to one or more validation requests received from a set of selected user devices, the set of selected user devices comprising at least one user device.

Abstract: A program storing computer-readable instructions therein for instructing a computer to perform analytical steps for generating a spatial hierarchy identifier that corresponds to a spatial hierarchy used on a server, the program includes a recording medium readable by the computer; and the computer instructions stored on said recording medium instructing the computer to perform the processes including identifying a position using a position indication system, and generating an identifier within the computer and independent of the server, wherein the identifier identifies first regions within the first spatial hierarchy on the server corresponding to the position.

Abstract: A computer-implemented method is provided for managing and sharing picture files. In one embodiment of the present invention, the method comprises providing a server platform and providing a datastore on the server platform for maintaining full resolution copies of the files shared between a plurality of sharing clients. A synchronization engine is provided on the server platform and is configured to send real-time updates to a plurality of sharing clients when at least one of the sharing clients updates or changes one of said files. A web interface may also be provided that allows a user to access files in the datastore through the use of a web browser.

Abstract: Functional verification of a new database feature is provided. A set of SQL query seeds are evolved using information contained in a knowledge map that was generated based on a real SQL query workload of an entity corresponding to a database. Real SQL queries are identified in the database that are similar to the evolved set of sample SQL query seeds. A new feature to be implemented in the database is injected into the real SQL queries that are similar to the evolved set of sample SQL query seeds. Multiple runtime access paths are generated for each of the real SQL queries injected with the new feature for output cross validation. Each of the real SQL queries injected with the new feature is run in a test environment using each of the multiple runtime access paths corresponding to a real SQL query injected with the new feature for functional verification.

Abstract: In general, the invention relates to a method for managing data. The method includes obtaining, by a data management system, a derived data request from a client, and in response to the derived data request: obtaining a plurality of data sets based on the derived data request, identifying a plurality of metadata, wherein each metadata of the plurality of metadata is associated with a data set of the plurality of data sets, performing a metadata analysis on the plurality of metadata, making a determination, based on the metadata analysis, that derived data may be generated, performing a derived metadata operation on the plurality of metadata to obtain derived data, performing a derived data operation on the data sets to obtain derived data, associating the derived metadata with the derived data, and providing the derived metadata and the derived data to the client.

Abstract: Systems and method for database record synchronization are disclosed herein. An example apparatus includes a request receiver to receive a request including a first record. The first record is stored in a first database. The example apparatus includes a database searcher to search a second database for a second record based on the request. The example apparatus includes a record parser to generate a first parsed record based on the first record and a second parsed record based on the second record, perform a comparison of the first parsed record and the second parsed record, and identify a difference between first data in the first parsed record and second data in the second parsed record. The example apparatus includes a communicator to transmit a transaction message to the second database to modify the second data based on the first data.

Abstract: A computer-implemented method is provided for managing and sharing picture files. In one embodiment of the present invention, the method comprises providing a server platform and providing a datastore on the server platform for maintaining full resolution copies of the files shared between a plurality of sharing clients. A synchronization engine is provided on the server platform and is configured to send real-time updates to a plurality of sharing clients when at least one of the sharing clients updates or changes one of said files. A web interface may also be provided that allows a user to access files in the datastore through the use of a web browser.

Abstract: A method is used in managing deduplication of data in storage systems. A candidate data object is identified for deduplicating a data object by evaluating digests stored in a current digest segment to determine whether another digest matching a digest associated with the data block is stored in the current digest segment. The current digest segment includes a set of digests associated with a set of data blocks previously received for deduplication. Based on the evaluation, a deduplicating technique is applied to the data object. The current digest segment is stored in an index table. A previous digest segment associated with a digest stored in the index table matches the digest associated with the data block is replaced by the current digest segment.