Abstract: Systems and methods are described for monitoring indexing nodes, populating and maintaining a resource catalog with relevant information, receiving requests for indexing node availability or assignments, identifying indexing nodes that are available to process data, and/or communicating information relating to available indexing nodes. The system can maintain the resource catalog based on communications with each of the containerized indexing nodes. The system can receive, from a partition manager of a data intake and query system, a request for a containerized indexing node that the partition manager can assign to process data received by the partition manager. The system can identify an available containerized indexing node to process the data. The system can communicate, to the partition manager, an indexing node identifier associated with the available containerized indexing node.

Abstract: System and methods are provided for sharding at the content level and routing content requests. Each point of presence (PoP) can initially identify the PoP that should serve content by using hashing. A PoP can encode a domain name with the identified PoP in metadata and redirect the client computing device. A client computing device transmits a DNS query for the encoded domain name. A DNS server receives the encoded domain name and decrypts and decodes the domain name label. The DNS server uses the decrypted and decoded metadata to make a further routing decision. The DNS server sends, to the client computing device, a DNS reply with the Internet Protocol (IP) address of the selected PoP. The client computing device requests content from the PoP identified by the provided IP address.

Abstract: The present disclosure provides systems, methods, and computer program products for providing efficient embedding table storage and lookup in machine-learning models.

Abstract: A system and method for faster access for compressed time series data. A set of blocks are generated based on a table stored in a database of the data platform. The table stores data associated with multiple sources of data provided as consecutive values, each block containing index vectors having a range of the consecutive values. A block index is generated for each block having a field start vector representing a starting position of the block relative to the range of consecutive values, and a starting value vector representing a value of the block at the starting position. The field start vector of the block index is accessed to obtain the starting position of a field corresponding to a first block and to the range of the consecutive values of the first block. The starting value vector is then determined from the block index to determine an end and a length of the field of the first block.

Abstract: This specification provides data processing methods, apparatuses and devices. In embodiments of the specification, table data includes a state identifier for indicating whether a target table is in a use state or an idle state. Therefore, after an occupying-table request is received, the table data can be obtained, and the state of the target table can be determined from the state identifier in the table data. If the target table is in the idle state, the table data is locked; after the state identifier is updated to the use state, the table data is released; and occupying-table data of the target table is generated to respond to the occupying-table request.

Abstract: A computer-implemented method for creating standalone objects may comprise: creating a dossier incorporating at least one dataset; creating a derived object using the at least one dataset; storing the derived object in memory, such that the derived object is a standalone object, independent of the dossier; and utilizing the derived object to generate and provide analytics information to a user via a display.

Abstract: A method of distributed smart contract deployment in a multi-tenant environment implemented by a computing device. The method including receiving a smart contract source, converting the smart contract source to a smart contract code for a tenant of the multi-tenant environment, the smart contract code to manage blockchain data transaction validation, and installing the smart contract code at the tenant to enforce logic of the smart contract source at the tenant in the multi-tenant environment.

Abstract: Methods and apparatus for generating waveforms for application in a quantum computing device. In one aspect, a system comprises a batch generator that receives experiment data sets defining respective experiments, each experiment data set comprising a set of waveforms defined by respective waveform data; determines unique waveforms; generates a corresponding set of respective waveform data that includes the respective waveform data for each unique waveform; generates, for each of the experiments, a waveform list that references the respective waveform data in the set of respective waveform data that corresponds to the waveforms in the set; and batch instructions that are executable by waveform generator hardware and that cause the waveform generator hardware to process each waveform list by selecting each referenced waveform data in the waveform list; and generate, in response to the selected waveform data, a waveform that is suitable for application in a quantum computing device.

Abstract: A computer includes a processor and a memory storing instructions executable by the processor to receive a time series of vectors from a sensor, determine a weighted moving mean of the vectors, determine an inverse covariance matrix of the vectors, receive a current vector from the sensor, determine a squared Mahalanobis distance between the current vector and the weighted moving mean, and output an indicator of an anomaly with the sensor in response to the squared Mahalanobis distance exceeding a threshold. The squared Mahalanobis distance is determined by using the inverse covariance matrix.

Abstract: Systems, methods, and software can be used for anomaly detection. In some aspect, a number of training events are obtained. A data structure represented by a decision tree is generated based on the number of training events. A to-be-scored event is obtained and a traversed path is determined for the to-be-scored event. An anomaly score is computed based on the traversed path and the to-be-scored event is determined to be an anomalous or normal event based on the anomaly score.

Abstract: A database server is communicatively coupled to a database storing multiple data records which are accessible by a number of data access systems communicatively coupled to the database server in order to claim exclusive access to a data record for a specifiable time period by one of the data access systems. The database server stores associations of the data records with the data access systems defining which data access system is generally allowed to access to which data record and an exclusive access times inventory defining which of the data access systems with allowed access has already been granted exclusive access to which data record for which time periods.

Abstract: Embodiments of the present disclosure provide systems, methods, and computer storage media for optimizing computing resources generally associated with cloud-based media services. Instead of decoding digital assets on-premises to stream to a remote client device, an encoded asset can be streamed to the remote client device. A codebook employable for decoding the encoded asset can be embedded into the stream transmitted to the remote client device, so that the remote client device can extract the embedded codebook, and employ the extracted codebook to decode the encoded asset locally. In this way, not only are processing resources associated with on-premises decoding eliminated, but on-premises storage of codebooks can be significantly reduced, while expensive bandwidth is freed up by virtue of transmitting a smaller quantity of data from the cloud to the remote client device.

Abstract: Systems and methods are provided to aggregate and analyze data from a plurality of data sources. The system may obtain data from a plurality of data sources. The system may also transform data from each of the plurality of data sources into a format that is compatible for combining the data from the plurality of data sources. The system uses a data harmonization module to organize, classify, analyze and thus relate previously unrelated data stored in multiple databases and/or associated with different organizations. The system can generate and publish master data of a plurality of business entities.

Abstract: In one aspect, the present disclosure proposes methods, devices and systems and devices for providing a new structured data pertaining to blockchain transactions to implement a new data structure. This new data structure is provided to implement a distributed database. In another aspect, a new distributed data management system (DBMS) is provided, that can manage data associated with the new data structure. However, unlike a conventional DBMS for traditional databases, the present disclosure provides a blockchain DBMS that is configured to managed data associated with one or more blockchain transactions, said data being stored in the new data structure. In another aspect, the present disclosure provides a method for generating or providing one or more blockchain transactions for implementing one or more standard database commands that are received for accessing or manipulating a database, where the data is stored on the new data structure.

Abstract: Embodiments include generating data models that may give semantic meaning for unstructured or structured data that may include data generated and/or received by search engines, including a time series engine. A method includes generating a data model for data stored in a repository. Generating the data model includes generating an initial query string, executing the initial query string on the data, generating an initial result set based on the initial query string being executed on the data, determining one or more candidate fields from one or results of the initial result set, generating a candidate data model based on the one or more candidate fields, iteratively modifying the candidate data model until the candidate data model models the data, and using the candidate data model as the data model.

Abstract: Provided is a data query method, applied to a heterogeneous acceleration platform. The data query method includes: determining operators in a database management system, and accomplishing, in a parallel processor, functions corresponding to the operators (S101); if an SQL query statement is received, converting, by using a CPU, the where clause in the SQL query statement into a data structure including a binary tree and a linked list (S102); controlling the CPU to generate an operation code stream of the data structure according to node information (S103); and performing, by using the parallel processor, a screening operation corresponding to the operation code stream on records in the database management system to obtain a query result conforming to the where clause (S104).

Abstract: Representations of sets of descriptors of reference objects are stored in a repository, with individual descriptors including information about entities identified in the reference objects. In response to a request to extract content from a particular data object, a reference object which satisfies a similarity criterion with respect to the particular data object is identified from the repository using the descriptors. A structural comparison of the particular data object and the reference object is performed to determine an entity related to another entity identified in the particular data object.

Abstract: Systems and methods for determining the answers to user queries regarding content, and presenting options for the user to view the answers. Searches are conducted to determine the answer to a query and, once the answer is found, various options are presented to the user, allowing the user the choice to view the answer in multiple different ways.

Abstract: A database system is operable to determine a plurality of queries for execution. Query data for each query of the plurality of queries is determined, where the query data for the each query indicates a memory usage estimate, an internal runtime estimate, and an external runtime estimate. Query initiation data is generated by determining whether to initiate execution of one query of the plurality of queries at a first temporal period occurring after initiating execution of a subset of the plurality of queries and occurs before the execution of the subset of the plurality of queries is complete, based on the query data of the one query. Execution of the one query is initiated when the query initiation data indicates a determination to initiate execution of the one query in the first temporal period.

Abstract: Methods, computer program products, and systems are presented. The methods include, for instance: collecting real time system statistics on a system environment in a remote platform running a remote data source amongst a plurality of remote data sources of a virtual database. Real time data source statistics on one or more data source objects from the remote data source of the virtual database is also gathered. A global catalog of the virtual database is updated with the real time system statistics and the real time data source statistics. An access plan to process a query to the virtual database is optimized based on the real time system statistics and the real time data source statistics and a response is produced based on the access plan, with improved performance and reduced cost.

Abstract: The subject technology provides embodiments for enabling derivation of predicates not only from other predicates but also from metadata such as expression properties. In examples, predicates are derived, avoiding unwanted impact on cardinality estimation. In other examples, predicates are derived, avoiding artificial runtime errors and providing a way to avoid security issues with secure views.

Abstract: A node of a database system is operable to receive a plurality of data blocks. Based on backlog detection data, at least one feedback data block is generated to be sent to the set of source nodes. Feedback relay node selection data selecting at least one of the plurality of nodes in the database system for facilitating routing of the at least one feedback data block from the node to at least one of the set of source nodes via a prioritized feedback communication mechanism is generated. The at least one feedback data block is sent to the at least one of the plurality of nodes selected in the feedback relay node selection data. The at least one of the plurality of nodes facilitates routing of the at least one feedback data block from the node via the prioritized feedback communication mechanism.

Abstract: A computing system is operable to generate a plurality of lines of coding blocks that includes a plurality of data blocks and a plurality of parity blocks. Each of the plurality of lines of coding blocks includes a corresponding subset of data blocks a corresponding subset of parity blocks. A set of segments of a segment group are generated to collectively include the plurality of lines of coding blocks. Different coding blocks of each of the plurality of lines of coding blocks are included within different ones of the set of segments, and the plurality of parity blocks are dispersed across all of the set of segments. The set of segments are stored via a plurality of nodes sets, where different segments of the set of segments are stored via memory resources of different node sets of the plurality of node sets.

Abstract: In accordance with an embodiment, described herein is a system and method for providing cross-microservice query processing. The system provides an object service framework that supports the use of microservices that may be loosely-coupled but related in some way, for example in that they interoperate together or require access to each other's data in order to process queries. Each microservice can be developed, deployed and evolve independently, and interact with the other microservices through contracts or interfaces that are defined as public APIs and are then exposed via the framework. The object service framework can be used, for example to provide a cross-microservice layer that automatically transforms queries that join objects in different microservices into a single database query that is optimized for use with the database.

Abstract: A system, program product, and method for enhancing automatic multidimensional query processing. The method includes executing a database query including semi-joining a plurality of dimension tables with a fact table. The method also includes identifying for extraction one or more data values from each dimension table of the plurality of dimension tables. The data values from each dimension table of the plurality of dimension tables are associated with a respective record identification (RID), thereby defining one or more RIDs. The method further includes generating a plurality of RID lists. Each RID list of the plurality of RID lists includes a collection of the one or more RIDs for the respective dimension table. The method also includes merging the plurality of RID lists, sorting, subject to the merging, the plurality of RIDs as a function of data location, and fetching the data values from the fact table.

Abstract: An analytics system is operable to receive a first plurality of query requests from a plurality of requesting entities. Query pricing scheme data is automatically generated based on the first plurality of query requests. A second plurality of query requests are received from the plurality of requesting entities. Query cost data is automatically generated for each of the second plurality of query requests by utilizing the query pricing scheme data. The query cost data for each of the second plurality of query requests is transmitted to a corresponding one of the plurality of requesting entities.

Abstract: Computer implemented methods for executing a database query in a database using an electronic computing device are presented, the method including: causing the electronic computing device to provide at least one data structure including at least one object having at least two properties of different data types; identifying a property of the at least one data structure that includes the smallest unique values in terms of type of data stored in that particular property; executing the database query, including any limiting parameters, configured to retrieve only data from the property including the smallest unique values that arc retrievable for a record; retrieving a predefined number of results of the executed database query; and for each set of predefined number of retrieved results, executing a new database access thread that is configured to retrieve data that are present in the records identified with the smallest unique values.

Abstract: A computing or storage system constructs a table in memory, and constructs a summary table that summarizes the table. The summary table is for determining whether there is likely an entry for a value in the table. The summary table has buckets pointed to by address fields of values. The first bucket in the summary table is split into a second bucket and a third bucket. Prior to the split, the first bucket is pointed to by a first address field of a first value. After the split, the second bucket and the third bucket are pointed to by the first address field plus one extra bit derived from a remainder of the first value.

Abstract: A method for configuring the operation of the software of a data as a service (DAAS) system during run time is described. The configuring includes at least one of configuring ingestion of a vendor dataset to produce an ingested dataset and which analysis operations to perform on the vendor dataset to produce an analyzed dataset, and the configuring also includes at least one of how to search the vendor dataset based on a search query from a customer to allow the customer to locate a new record from the vendor dataset and how to match records in the vendor dataset with a match query from the customer to provide an updated record to the customer.

Abstract: A source table organized into a set of batch units is accessed. The source table comprises a column of data corresponding to a semi-structured data type. One or more indexing transformations for an object in the column are generated. The generating of the one or more indexing transformation includes converting the object to one or more stored data types. A pruning index is generated for the source table based in part on the one or more indexing transformations. The pruning index comprises a set of filters that index distinct values in each column of the source table, and each filter corresponds to a batch unit in the set of batch units. The pruning index is stored in a database with an association with the source table.

Abstract: A calculation engine of a database management system is described that determines a multiprovider includes a first data source and a second data source that each require different approaches for operation optimization. The calculation engine can split the multiprovider into a first node corresponding to a first operation compatible with the first data source and a second node corresponding to a second operation compatible with the second data source. The calculation engine can perform the first operation at the first data source to produce a first result and perform the second operation at the second data source to produce a second result. The calculation engine can then merge the first result and the second result according to a third operation, and perform such third operation at the first data source.

Abstract: A method, system and computer program product for aggregate query optimization. A dataset with plurality of values divided into dimensions and measurements is received. Pre-calculated values obtained by aggregates of measurements' values respective of plurality of combinations of dimensions' values are calculated and stored for one or more aggregate measurements of interest. Responsive to an input received of a first set of one or more dimensions and a second set of one or more aggregate measurements of interest, an aggregate result value of a respective member of the second set is calculated and outputted by retrieval of the pre-calculated value therefor respective of members of the first set.

Abstract: A system and method process data transformation between disparate legacy systems of providers by maintaining databases of schema, rules and work flows applicable to the providers and allowing administrators to interactively customize data transformations from unique versions of data sets in one data type and format to other unique versions in other data types and formats in an automated manner, based on schema, rules and workflows. The process is controlled though an interactive user interface.

Abstract: A streaming ingest platform can improve latency and expense issues related to uploading data into a cloud data system. The streaming ingest platform can organize the data to be ingested into per-table chunks and per-account blobs. This data may be committed and may be made available for query processing before it is ingested into the target source tables. This significantly improves latency issues. The streaming ingest platform can also accommodate uploading data from various sources with different processing and communication capabilities, such as Internet of Things (IOT) devices.

Abstract: Methods, systems, and computer-readable media are disclosed herein for improved state identification and prediction in computerized queries. In an aspects, a neural network model is trained via word embedding, using a plurality of workflows having a plurality of steps as input training data. The model may be searched using a string to locate and identify semantic matches as potential results, where the potential results correspond to a specific step and/or a particular workflow. Markov chaining may also be performed, using the potential results, in order to predict one or more additional results, where the additional results correspond to a specific succeeding step within a particular workflow, in some aspects. The results and predicted steps may be displayed.

Abstract: Embodiments provide for intelligent auto filing of documents to enterprise content management workspaces. One embodiment of a method includes receiving a document to auto file to a workspace of a content management system; detecting an indicator of an entity from the text of a document, the indicator of the entity corresponding to a value of a workspace attribute; determining a result set of candidate records based on querying a set of workspace data for workspaces with the workspace attribute value corresponding to the indicator; detecting mentions in the document text that match attribute values from the candidate records; generating a score for each candidate record based on the mentions detected in the text that match the attribute values from the candidate record; linking the document to an entity based on the scores for the candidate record; and automatically storing the document to a workspace based on the linking.

Abstract: A computer-implemented method, a computer program product, and a computer system for measuring relevance of datasets to data science models. One or more servers implement steps: extract keywords in each data science model; determine first relative frequencies of the respective keywords in each data science model, for each source group in the data science models; extract keywords in each dataset; determine second relative frequencies of the respective keywords in each dataset, for each source group in the datasets; determine weights of the keywords; calculate first aggregated relevant scores of the respective keywords in each data science model, based on the first relative frequencies and the weights; calculate second aggregated relevant scores of the respective keywords in each dataset, based on the second relative frequencies and the weights. One or more servers calculate similarity between vectors of the first and second aggregated relevant scores, based on a similarity measure between vectors.

Abstract: Methods and apparatuses are described in which unstructured computer text is analyzed for generation of an enforcement action database. A computing device receives a digital document comprising a corpus of unstructured text and converts each sentence into tokens. The computing device identifies entities in the tokens and classifies each sentence as relevant or not relevant to an enforcement action. For each relevant sentence, the computing device generates a record in a first data structure and generates a record in a second data structure. The computing device maps the records in the first data structure to the records in the second data structure based upon an enforcement attribute to generate a third data structure. The computing device aggregates the records in the third data structure based upon a name of the entity and a type of the entity in the sentence to determine an aggregated first enforcement attribute for each entity.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for processing local search results. In one aspect, a method determines a first local document in a set of local documents for search results is eligible for a demotion operation. The determination is based at least in part on a proximity measure based on the location of the user device and a location specified for the first local document. In response to the determination, for each other local documents in the set of local documents, a proximity measure location of the user device and the location specified for the other local document is determined. The first local document is demoted in its ranking when at least one of the proximity measures indicates a respective other local document has a specified location that is within a threshold distance of the location of the user device.

Abstract: In some examples, a networked computing system comprises a backup node cluster of a backup service in communication with a host database node cluster of a host, a host database at least initially undiscovered by the backup node cluster, one or more processors coupled with memory storing instructions that, when executed, perform operations comprising at least installing a backup agent on at least one node of the host database node cluster, registering the host at the backup service, based on the host registration, triggering a host database discovery process to discover the undiscovered database automatically, the discovery process including a discovery call, in response to the discovery call, receiving metadata relating to the discovered database, and communicating with the discovered database.

Abstract: A method for generating an executable application to transform and load data into a structured dataset includes receiving a metadata file that specifies values for parameters for structuring data feeds, received from a networked data source, into a structured database. The metadata file specifies logical rules for transforming the data feeds. The values of the parameters and the logical rules for transforming the plurality of the data feeds are validated to ensure logical consistency for each data feed. Data rules are generated that specify standards for transforming each data feed in accordance with the validated values of the parameters and logical rules. The executable application is generated that is configured to receive source data comprising a data feed from one or more data sources and transform the source data into structured data that satisfies the one or more standards for the structured data record in compliance with the data rules.

Abstract: A dynamic code generation process with configurable connections and variables for extraction, transformation, and load (ETL) processing and validation is disclosed. A code generator loads an input requirement document and a configuration file, and generates workflows, database objects, and parameters. Database code is deployed in a database, ETL code is deployed in an ETL repository, and server code is deployed in an ETL server. A code validator reads the ETL code from the ETL repository and the database code from the database, and performs in-built stage unit testing. The code validator performs a quality check, metadata validation, definition comparisons, and outputs validation results.

Abstract: A computer-implemented method can comprise establishing programmatic connections to a digitally stored first database comprising over one million records, each of the records comprising columns; reading a configuration file that specifies tables in the database; for each particular table, forming and submitting a plurality of queries to the database, each of the queries specifying data aggregation operations, and in response thereto, receiving result sets of records of the database; calculating metadata metrics that characterize columns of the records in the result sets and storing the metadata metrics in tables for string column statistics, numeric column statistics, date column statistics, based upon a particular data type among different data types of the columns; generating presentation instructions which when rendered cause displaying one or more graphical visualizations in a graphical user interface.

Abstract: Embodiments are directed to managing data visualizations. A primary visualization that is associated with a data model may be provided such that the primary visualization may be displayed in a display panel. Insight items may be generated based on the primary visualization and the data model such that the insight items may correspond to one or more visualizations that may share one or more portions of the data model and such that the insight items may be displayed in an insight panel. In response to an insight item being selected from the insight panel, additional actions may be performed, including: generating a visualization based on the insight item that is displayed in the display panel instead of the primary visualization; and generating a scratch item that includes a thumbnail view of the primary visualization such that the thumbnail view is displayed in a scratch panel.

Abstract: In certain embodiments, multi-modal-based generation of settlement instructions may be facilitated. In some embodiments, a portfolio of a live environment may be emulated in a projected environment. A target portfolio may be generated in the projected environment based on the emulated portfolio. Partial synchronization between the target portfolio of the projected environment and the portfolio of the live environment may be performed such that a first subset of changes to the portfolio of the live environment are reflected in the target portfolio of the projected environment. Subsequent to the partial synchronization, the target portfolio of the projected environment may be updated such that the update of the target portfolio accounts for the first subset of changes. Subsequent to the update of the target portfolio, settlement instructions may be generated based on differences between the target portfolio of the projected environment and the portfolio of the live environment.

Abstract: The present disclosure relates to a method for data synchronization between a source database system and target database system, wherein execution of a database transaction of the source database system is complete if a processing step followed by an application step of the database transaction is performed. For each identified database transaction, a processing step and/or application step may be performed.

Abstract: A method is provided for resharding a sharded database sharded according to a first shard key. The method includes: receiving, by a processor an instruction to reshard the sharded database; receiving, at the processor, a new shard key to be used in a resharding process to reshard the sharded database; determining, by the processor, whether a duration of unavailability of the sharded database during the resharding process is less than a predetermined amount of time; and automatically performing, by the processor, the resharding process according to the new shard key to produce a resharded database, if the duration of unavailability is less than the predetermined amount of time. The method may be performed without users noticing a significant interruption to read/write operations from/to the database.

Abstract: A first data management system, which may be associated with a content management system (CMS), may receive an identifier for a content item. A content item may be an example of a picture, a blog post, an article, a video, an audio segment (e.g., a podcast) or other type of text or multimedia content. The first data management system may be configured to generate an object corresponding to the content item. The content object may be transmitted to a model corresponding to a second data management system. The model may be configured to identify relationships between data stored at the second data management system. The model may identify one or more data objects that are associated with the received content object, and return the data objects to the first data management system.

Abstract: Recognizing unknown data objects may be implemented for data objects stored in a data store. Data objects that are identified as unknown may be accessed to retrieve a portion of the data object. Different representations of the data object may be generated for recognizing different data schemas. An analysis of the representations may be performed to identify a data schema for the unknown data object. The data schema may be stored in a metadata store for the unknown data object.

Abstract: Systems and methods for pattern-based multi-stage deterministic data classification that may reduce processing and memory overhead while providing more accurate data classifications.