Abstract: A system and method for on-demand data cleansing is disclosed. The system includes a processor and a volatile memory including a data object having a plurality of data fields, each field having a tag and a value. The system also includes a cleansing module stored in the volatile memory and executed by the processor. The cleansing module includes a library having a plurality of tag-operation pairs. The cleansing module is configured to receive a pointer locating the data object within volatile memory, and further configured to, for each data field, look up the tag of the data field among the library tags, and execute the operation paired with the matching library tag on the value of the field, modifying the value of the data field while it is stored in volatile memory. The cleansing module is configured to execute the operation in near real-time, and at runtime.

Abstract: Embodiments disclosed are directed to an immutable database with a bitemporal ledger for storing transactions in timelines for maintaining a record of all events and resources within the system. The bitemporal ledger may store a sequence of transactions which include a plurality of transactions previously received by the data processing system in a temporal sequence up to a current time. A new transaction is received and may be appended to the sequence of transactions based on temporal metadata associated with the transaction are received, The temporal metadata may include a valid-from time and a created-at time.

Abstract: A system and method for defining a relational schema for a non-relational database are disclosed. In one embodiment, the system identifies a non-relational database; obtains a data structure of the non-relational database; determines a relational schema type; generates a relational schema based on the determined schema type; determines whether the relational schema includes a plurality of relational tables; and responsive to determining that the relational schema includes a plurality of relational tables, defines a relation between at least two of the relational tables in the relational schema.

Abstract: A system and method process data transformation between disparate legacy systems of providers by maintaining databases of schema, rules and work flows applicable to the providers and allowing administrators to interactively customize data transformations from unique versions of data sets in one data type and format to other unique versions in other data types and formats in an automated manner, based on schema, rules and workflows. The process is controlled though an interactive user interface.

Abstract: A method for creating a link between hyperledger blocks by a block link server. The method comprises receiving by a block link server executing on a computer system a first link creation message from a first network element, the first link creation message comprising first block information comprising a first hyperledger identifier and a first block identifier, both associated with a first hyperledger, receiving by the block link server a second link creation message, comprising second block information comprising a second hyperledger identifier and a second block identifier, both associated with a second hyperledger, storing by the block link server a link data structure comprising the first block information and the second block information, and sending by the block link server a link identifier of the link data structure to the first network element.

Abstract: Techniques are disclosed relating to compressing database keys. A computer system may receive a request to write a database record to a storage medium. The database record may include a database key and a corresponding data value. The computer system may compress the database key by replacing a portion of the database key with particular data that identifies a location of a reference database key and an amount of similarity determined between the database key and the reference database key. The computer system may write the database record to the storage medium. The database record may include the compressed database key and the corresponding data value.

Abstract: According to one embodiment, a method, computer system, and computer program product for provisioning a tag schema. The embodiment may include determining data types for tag-keys within an existing ecosystem of tags. Each tag of the existing ecosystem comprises a tag-key and a tag-value. The embodiment may include performing pairwise clustering of the tags within the ecosystem. The embodiment may include identifying a main tag-key within each cluster of tags. The embodiment may include grouping the clusters into a broader category. The embodiment may include providing a tag schema recommendation for the ecosystem based on the grouped clusters.

Abstract: As described herein, a portion of machine data of a message may be analyzed to infer, using an inference model, a sourcetype of the message. The portion of machine data may be generated by one or more components in an information technology environment. Based on the inference, a set of extraction rules associated with the sourcetype may be selected. Each extraction rule may define criteria for identifying a sub-portion of text from the portion of machine data of the message to produce a value. The set of extraction rules may be applied to the portion of machine data of the message to produce a result set that indicates a number of values identified using the set of extraction rules. Based on the result set, at least one action may be performed on one or more of inference data associated with the inference model and one or more messages.

Abstract: A technology related to a method and apparatus for providing a relation note using correlation is disclosed. The method for providing the relation note, which is performed by a relation note providing server interworking with a user terminal, comprises the steps of: receiving one or more generated notes from the user terminal; updating, according to a configurable reference, correlation between notes indicating a relation between the one or more notes; and providing the one or more notes to the user terminal on the basis of the correlation between the notes. Therefore, the method may provide a user interface which is intelligent and smart to enable a plurality of notes to be more effectively identified and managed on the basis of the correlation.

Abstract: In some embodiments, a processor may generate a request associated with a transaction, collect an anchor associated with the request, and transition the transaction into a collection of two or more hashes; the processor may submit the transaction to an ordering service. In some embodiments, a processor may receive a request associated with a transaction, identify that a first preimage associated with a first hash is known to a first shard, and generate a first identification tag associated with the transaction. In some embodiments, a processor may receive a request associated with a transaction, assign a first shard a first task, and identify that a first preimage associated with a first hash is known to the first shard; the processor may perform the task.

Abstract: A system and method for managing files on multiple storage devices, such as USB sticks. The system includes a hub that has multiple input ports for multiple storage devices, wherein has a unique code visually presented next to the respective port. The system can assign a barcode label to each storage device which can be printed and pasted on the respective memory device. The system further scans the files on each of the multiple storage devices to generate a master index based on the unique identification code for each storage device.

Abstract: Using container-centric managed access, an administrator is enabled to define a set of future grants for each object that will be created in the future in a container managed by the administrator. When a user creates a database object, the system checks the future grants to determine if any apply to the user, the database object, or the combination. Any applicable future grants are applied to the database object before the user is allowed to modify it. As a result, the administrator is enabled to control the privileges associated with the database object even before the database object is created, while restricting individual object owners from managing privileges on their owned objects.

Abstract: Embodiments described herein facilitate enhancement of data model acceleration, including generating data model summaries and performing searches in an accelerated manner. In one implementation, a set of events are indexed, each of the events having a corresponding index time representing a time at which the event was indexed in an indexer. Index time parameters including an index earliest time indicating a first index time at which to begin generating a data model summary and an index latest time indicating a second index time at which to complete generating the data model summary are obtained. Thereafter, a data model summary is generated. Such a data model summary summarizes events having corresponding index times between the index earliest time and the index latest time. The data model summary is provided to a remote data store that is separate from the indexer at which at least a portion of the events were indexed.

Abstract: A request for one or more files is received. It is determined that the requested one or more files have been archived at an archival storage tier. Access to a first portion of the one or more requested files stored at the archival storage tier is requested. Access is provided to the first portion in response to the request. Based at least in part on a metric associated with a utilization of the first portion, it is determined when to request access to a second portion of the one or more requested files stored at the archival storage tier.

Abstract: The present disclosure is related to systems and methods of merging tenant shadow systems of record into a master system of record. First tenant record objects of a first tenant system of record can be accessed. A master record object for a master system of record can be generated using the corresponding first tenant record object. A second tenant record object of a second tenant system of record can be accessed. Whether the second tenant record object is to be merged into the corresponding master record object can be determined. When determined to merge, the second tenant record object can be merged into the corresponding master record object. When determined to not merge, a new master record can be generated.

Abstract: The described implementations relate to an access control framework for a database system. One implementation can receive, from a user, a request for data that identifies a resource, such as a view that obtains data from a database. The implementation can check the identity of the user to identify user roles associated with the user. The implementation can identify an access policy that is associated with the resource, and a rule that is associated with the access policy and applies to the user roles associated with the user. The rule can be applied to the request for data using attributes of the access policy. For example, if the request for data is a query on a view, the query can be rewritten to apply the rule.

Abstract: Systems, methods, and computer-readable media provide techniques for on-demand access to object data hosted in distributed object storage. A query is received for the distributed object storage database, wherein the distributed object storage database includes first object data stored in a first data center at a first geographical location, and second object data stored in a second data center at a second geographical location. It is determined that the query is for at least a portion of the first object data stored by the first data center. The query is transmitted to a first computing device in the first data center. Results are received from the first computing device for the query, and the results are provided in response to the received query.

Abstract: Embodiments for granular replication of data with high efficiency. A defined metadata element embodied as a tag is assigned to each file. Tag filtering is used to direct the data to the proper location. Files with different tags can be selected for transfer. Embodiments can be used with a defined backup system file replication process, such as present in the Data Domain File System. By using snapshots, incoming new data is continued to be ingested while the replication is in process and maintaining data consistency at the same time. This is achieved by performing operations on B+ Tree snapshots in conjunction with tag filtering on keys present in the leaf pages of these structures. This method efficiently makes a single pass walk of a B+ Tree in contrast with previous methods that look up files one-by-one via their pathname.

Abstract: Disclosed herein is a system for storing a record of operations performed on a plurality of databases in which data in each database is a duplicate of a portion of data in each other database of the plurality of databases. The system comprises a plurality of servers, each server comprising a database of the plurality of databases, and a blockchain of a first distributed ledger, the blockchain of the first distributed ledger comprising one or more records of operations performed on the database, and at least one miner. Each miner comprises a blockchain of a second distributed ledger, the blockchain of the second distributed ledger comprising a record of data indicative of one or more records stored on the first distributed ledger.

Abstract: Disclosed are various embodiments for generating relevant notifications of content generated by third party data sources. In some embodiments, a system comprises a computing device and machine readable instructions. The computing device includes a processor and a memory. The machine-readable instructions can be stored in the memory that, when executed by the processor, cause the computing device to receive content from a third party data source based at least in part on a keyword topic. An embedding for the content is generated. The system can classify a portion of the content as associated with the keyword topic. Organizations can be identified from the portions of the content. The system can generate a list from the organizations identified in the content and transmit a notification to a client device regarding the content.