Abstract: In some aspects, the disclosure is directed to methods and systems for secure and authenticated tracking of entity possession via a lightweight centralized or distributed ledger. Ownership records of different entities may be recorded on an immutable ledger such that provenance of the entities is verifiable and a user cannot create or counterfeit an entity. In some implementations, the system may store metadata of entities in a separate database that may store records for each entity and correspond to the respective entity's virtual identifier, enabling the ledger records to contain much less data, saving memory resources and the energy that is required to maintain the ledger. In some implementations, distributed incremental values may be provided to members of an ownership or possession chain of an entity, which may encourage compliance, reporting of ownership transfer, and encourage additional transfers.

Abstract: Embodiments of the present disclosure provide techniques for efficiently and accurately performing propagation of search-head specific configuration customizations across multiple individual configuration files of search heads of a cluster for a consistent user experience. The cluster of search heads may be synchronized such that the search heads operate to receive the configuration or knowledge object customizations from one or more clients from a central or lead search head. To reduce the amount of data that is transferred during propagation, the list of configuration or knowledge object customizations maintained in each search head is filtered from the list of the lead search head until a divergence point is determined. Once determined and communicated to the lead search head, the lead search head sends the configuration and knowledge object customization data that is absent from the internal list of the member search head.

Abstract: Described are a system, method, and computer program product for efficiently joining time-series data tables. The method includes loading a first table and a second table into a memory and generating a set of first key-value pairs based on a set of first time-series records and a set of second key-value pairs based on a set of second time-series records. The method also includes sorting the set of first key-value pairs and the set of second key-value pairs. The method further includes interleaving the set of first key-value pairs with the set of second key-value pairs and sequentially matching the sets of time-series records to form a joined table. The method further includes, in response to matching each respective second time-series record with the respective first time-series record, removing the respective second time-series record from the at least one memory.

Abstract: A network device communication system can configure network devices, such as a first database in a multi-tenant deployment and a second database in a private deployment, to send and receive sequence messages, such as replication data, over a channel comprising a plurality of private network nodes. The first database can create a link specifying the data share and the second database. The second database selects the link and a secure area in the private deployment is created into which data is replicated and shared with further accounts in a computationally secure and efficient manner.

Abstract: An embodiment includes receiving a request to delete a specified document from a primary shard of a sharded database. The embodiment also includes inserting a soft-deletion document to a soft-deletion shard, wherein the soft-deletion document identifies the specified document, which remains in the primary shard. The embodiment also includes receiving a query from a client application, wherein the specified document satisfies the query. The embodiment also includes blocking the specified document from being returned in response to the query while the soft-deletion document associated with the specified document remains in the soft-deletion shard.

Abstract: New, more efficient and robust data storage devices, systems and techniques are provided. In some aspects of the invention, a new form of data storage device is provided, incorporating data storage cells, and a read/write device connected with an auxiliary structure. The auxiliary structure elaborates on the simpler data written in the data storage cells to generate more complex, complete and meaningful data. In some embodiments, the physical arrangement, or other attributes, of structural storage device elements serve as a patterned reference device for data enhancement and supplementation. In some embodiments, the data enhancement and supplementation results from one or more chemical and/or physical reactions, in a sequence of such reactions, between writeable domains, auxiliary structure or the simpler data.

Abstract: In a data read method a plurality of tuples meeting a read condition are determined in a case that the data read request is received and according to a read condition carried in the data read request. Global transaction statuses of a plurality of global transactions corresponding to the plurality of tuples are obtained. Global commit times of the plurality of global transactions according to the global transaction statuses of the plurality of global transactions are obtained. Then a target tuple from the plurality of tuples is determined based on the global commit times of the plurality of global transactions, the target tuple being visible relative to the data read request.

Abstract: Generating datasets using approximate baselines including receiving, by a source storage system, an instruction to create, on a target storage system, a current snapshot for a source dataset stored on the source storage system, wherein no snapshots for the source dataset exist on the target storage system; selecting, as a baseline dataset, a similar dataset from a plurality of datasets on the source storage system with an existing snapshot on the target storage system, wherein the similar dataset comprises at least a portion of the source dataset; instructing the target storage system to generate a baseline snapshot for the source dataset using a copy of the existing snapshot of the baseline dataset; and transferring, from the source storage system to the target storage system, only a difference between the baseline dataset and the source dataset.

Abstract: Distributed database systems including compute nodes and page servers are described herein that enable compute nodes to pushdown certain query processing compute tasks to the page servers to take advantage of otherwise idle compute resources at the page servers, and to reduce the quantity of data that moves between compute nodes and page servers. A distributed database system includes a page server and a compute node, wherein the page server is configured to maintain multiple versions of stored data objects. The compute node is configured to receive a query and generate a transaction context (TC) and modified table schemas (MTS) scoped to the query, and pushdown the query, TC and MTS to the page server that is configured to determine which data objects at the page server satisfy the query, and for each such object, which version of the object should be returned based on the TC.

Abstract: Each of a plurality of servers includes a shared information storage region for storing information to be shared with other servers. The servers operate so as to match data of the shared information storage regions with each other. A first server manages a first local database. A second server generates query information for accessing the first local database, and stores the query information in the shared information storage region of the second server. The first server acquires the query information from the shared information storage region of the first server, and stores the result with respect to the query information in the shared information storage region of the first server. The second server acquires the result from the shared information storage region of the second server.

Abstract: The present disclosure generally relates to determining credits for projects. In an example, a computer-implemented method includes: receiving a request from a requester for credit for participation in a project for production of a hardware or a software product; requesting verification from a creditor that the requester participated in the project by using an artificial intelligence (AI) determination engine to determine if the request includes enough data regarding the project and the creditor to proceed with processing the request; in response to verification of credit from the creditor, acknowledging the credit in a credit handling system comprising a hardware storage retrieval device configured to allow access to the acknowledgment of credit by users other than the requester and the creditor; and in response to the creditor not verifying the request, informing the requestor that the request has been denied.

Abstract: Disclosed is a data fabric service system that can be implemented in a distributed computer network, such as a data intake and query system. The data index and query system can receive a search query and define a search scheme for applying the search query on distributed data storage systems including internal data storage and external data storage. The data index and query system may provide a portion of the search scheme to a search service of the data fabric service system, which can cause worker nodes of the data fabric service system to perform various functions—including applying the search query to the external data storage based on the portion of the search scheme in order to obtain search results.

Abstract: An apparatus includes N audio receivers positioned in a pre-defined geometry with respect to P audio sources to receive P audio signals from the P audio sources; N data sets coupled to the N audio receivers to sample the received P audio signals into N data streams; a plurality of storage devices coupled to the N data sets to store the N data streams; and a post processor coupled to the plurality of storage devices to generate output signals corresponding to reconstituted P audio signals using a wavefront demultiplexing transformation, wherein N and P are positive integers and N?P. The post processor has inputs receiving data retrieved from the plurality of storage devices and outputs providing the output signals.

Abstract: A computing system for managing and mapping source data and target data associated with a data transformation analyzes data quality testing data. Source data and target data include the data elements, data structures, and storage mechanisms for data associated with a data transformation. The computing system analyzes the data quality testing data for validation of the associated data transformation. The computing system identifies source data for input to the data transformation and target data for the result of the data transformation. The computing system stores identifiers associated with the source data and target data and records validated data lineage information for the data transformation. Based on a configuration, the computing system generates a data lineage map indicating the relationships between the source data and the target data associated with a number of data transformations that occur within the computing system.

Abstract: Described herein are techniques for improving transfer of metadata from a metadata database to a database stored in a data system, such as a data warehouse. The metadata may be written into the metadata database with a version stamp, which is monotonic increasing register value, and a partition identifier, which can be generated using attribute values of the metadata. A plurality of readers can scan the metadata database based on version stamp and partition identifier values to export the metadata to a cloud storage location. From the cloud storage location, the exported data can be auto ingested into the database, which includes a journal and snapshot table.

Abstract: Operations in a query plan generated for a query may be scaled when performed at a query engine. The performance of an operation in the query plan may be monitored to detect a scaling event. A performance distribution for the operation may be determined among a modified number of processing resources. The operation may then continue performing at the modified number of processing resources according to the determined performance distribution.

Abstract: A data querying system is disclosed that provides improved computer functionality that enables efficient permissioning and querying of specific portions of a data table, such that users (e.g., based on user roles or user attributes) are only allowed access to specific portions (e.g., particular data items/rows, and particular data items attributes/columns) of the data. The system advantageously provides efficient and improved querying and permissioning of specific portions of a data table through replication of the data table, or portions of the data table, and does not require permissioning of each individual cell of the data table. Further, the data table replication, querying, and permissioning techniques of the present disclosure, according to various implementations, advantageously integrate with a wide variety of data table query or search services to provide improved functionality, efficiency, and data permissioning.

Abstract: A system for improving task scheduling on a cloud data platform is provided. A task is received, from a user of a cloud data platform, for execution on a dataset of a cloud data platform using a plurality of resources. A task graph is generated, and metadata related to the dataset is accessed for use in execution of the task. A predicted resource profile is generated by applying a first machine learning scheme to the task graph and the metadata of the dataset. Assignment data is generated to execute processes of the task on the plurality of resources. The assignment data generated by applying a second machine learning scheme to current state data of a current computational state of the plurality of resources and the predicted resource profile generated by the first machine learning scheme.

Abstract: Example systems and methods for cloning catalog objects are described. In one implementation, a method includes creating a copy of a catalog object without copying a data associated with the catalog object by only coping metadata associated with the object. The method further includes modifying, by one or more processors, the data associated with the catalog object independently of the copy of the catalog object.

Abstract: A multi-tenant system comprises a monolithic database storing global records, each including global fields common for all tenants; a custom field database storing custom records, each including custom fields for a tenant; a custom field record service processing a custom record storage request by instructing the custom field database to store custom field values of the custom record for the tenant, and processing a custom record fetch request by instructing the custom field database to retrieve the custom field values; a monolithic application configured to receive a record storage or fetch request, configured to partition the record storage request into the global record storage request and the custom record storage request, configured to send the custom record storage request to the custom field record service, configured to partition the record fetch request into the global record fetch request and the custom record fetch request, and configured to send the custom record fetch request to the custom field r