Abstract: A method for reconciling data includes separating a first table into a plurality of first chunks, each first chunk including a plurality of first rows, and second table into a plurality of second chunks, each second chunk including a plurality of second rows. Each second chunk corresponds a first chunk. For each first chunk, the method includes: computing a first hash based on the first chunk and a second hash based on a second chunk corresponding to the first chunk; comparing the first hash with the second hash; in response to the first hash being different from the second hash, retrieving the plurality of first rows and the plurality of second rows and comparing the plurality of first rows to the plurality of second rows; in response to the first rows being different from the second rows, generating executable code configured to reconcile the first table with the second table.

Abstract: Systems and methods described herein relate to automatic index recommendations for improved database query performance. Candidate indexes are identified. The candidate indexes are associated with a database query that is classified as a slow query. A feature vector is generated for each candidate index to represent statement features and statistical features associated with the candidate index. The feature vectors are provided to one or more machine learning models to obtain an index recommendation value for each candidate index. An index recommendation is presented at a user device. The index recommendation identifies a first index of the candidate indexes based at least partially on the index recommendation value obtained for the first index. User input indicative of a user selection of the first index is received. A database schema is updated to include the first index in response to the user input.

Abstract: A computer-implemented method, including receiving, by a processor set, a query including a query string for a system catalog; identifying, by the processor set, a default index structure of the system catalog; executing, by the processor set, the query based on the default index structure of each index in the system catalog; ranking, by the processor set, a performance of each execution of the query by each index; mapping, by the processor set, a query pattern to a corresponding index of the system catalog; selecting, by the processor set, the index to perform the query using a machine learning (ML) model trained with a knowledge base that includes the ranking and the mapping; executing, by the processor set, the query on the selected index; and in response to executing the query on the selected index, returning, by the processor set, a result of the query.

Abstract: Systems and methods are disclosed for acquiring data from avionics servers, flight management systems, or connected flight management system cloud services. In some embodiments, a method for acquiring data from avionics servers, flight management systems, or connected flight management system cloud services may include: receiving a dataset request from an input device; generating a plurality of sub-requests for a plurality of partial datasets from the avionics server; transmitting the plurality of sub-requests to a plurality of instances of the avionics server; generating identifications for each of the plurality of partial datasets; assembling the plurality of partial datasets into a single dataset; and transmitting the single dataset to the input device.

Abstract: A method includes receiving instructions to perform order-dependent DataFrame operation on data. In response to receiving the instructions, the framework analyzes the instructions to identify the order-dependent DataFrame operation, and generates an executable query corresponding to the identified order-dependent DataFrame operation. The framework executes the generated executable query on the data stored in the first database in the cloud data platform, creates a row position column that generates for each row a unique integer identifier, reproducible across multiple sessions and/or queries for the same underlying data to make the data accessible via positional indexing, and assigns each row of the first database a unique row index value based on the row position column and the row position column order.

Abstract: An agricultural application is provided herein that includes a nozzle assembly positioned along a boom assembly and configured to selectively dispense an agricultural product therefrom. One or more sensors can be operably coupled with the boom assembly and can be configured to capture data associated with one or more application variables. A computing system can be communicatively coupled to the one or more sensors and to a display. The computing system can be configured to receive the data associated with the one or more application variables; convert the one or more application variables to a scaled integer to determine a spray quality index; generate a geo-located application map of the scaled integer; and present the geo-located application map on the display.

Abstract: This application provides a device recommendation method and an electronic device, and relates to the terminal field. The method includes: receiving, by a first device, a first operation of enabling a first service by a user; in response to the first operation, separately obtaining, by the first device from N electronic devices, device parameters associated with the first service, where the N electronic devices and the first device are located in a same communication network; predicting, by the first device according to the device parameters, quality of service of executing the first service by each electronic device of the N electronic devices; and displaying, by the first device, a device list according to the quality of service of executing the first service by each electronic device in the N electronic devices, where the device list includes a device identifier of at least one electronic device in the N electronic devices.

Abstract: Disclosed is a system to provide information associated with a user device from a server to the user device without disclosing the association to the server. Data structures, created at the server, contain information such as information about restaurants, mechanics, medical conditions, etc. The server creates bundles including two or more data structures containing disparate information, and a unique identifier for each bundle. The server creates a table of contents indicating the unique identifier of a bundle and the information contained in the bundle and sends the table of contents to the device. The server receives the unique identifier of the bundle and provides the bundle having the unique identifier to the device. While the bundle contains the information associated with the user device, because the bundle contains disparate information. the server does not know which information is associated with the user device.

Abstract: A system and method for providing fine-grained access control in a search engine. Access control predicates associated with a search query, including fixed-width and/or variable-width tokens, are received from the search engine, and are formatted in a machine-readable binary format to generate a single byte array. A pre-sorted memory index structure associated with the single byte array is generated, by sorting the access control predicates according to their token width. The pre-sorted memory index structure is merge joined with an uninverted terms index that includes a sorted list of all terms in a field associated with the search query, and a document index mapping the document identifier (ID) to a term ordinal for a specific field.

Abstract: Aspects include receiving a search request, comparing at least one term of the search request to a plurality of metadata items, wherein each metadata item of the plurality of metadata items is associated with a respective asset of a plurality of assets, generating a plurality of scores, wherein each score of the plurality of scores is associated with a respective asset included in the plurality of assets, and wherein a value of each score of the plurality of scores is based on an identification of a user, selecting at least one asset of the plurality of assets in accordance with the plurality of scores and in accordance with at least one threshold, providing the at least one asset to a communications device that is associated with the user, and providing at least a portion of a metadata item included in the plurality of metadata items to the communications device.

Abstract: Systems and methods for platform independent secure customer data migration from one data storage to another data storage. A synchronization server includes a translation layer and an authentication layer. The translation layer encodes data from one data storage access language and schema to another distinct data storage access language and schema. Before the full transition to the second data storage, the translation layer also encodes, updates and inserts data into the first data storage. Existing references to the first data storage as well as new references to the second data storage are supported using an authentication layer. After a request for secure customer data, a determination is made which data storage is accessed from an obtained authentication factor. When the second data storage is accessed, the translation layer is employed to encode the first data storage object references to the corresponding second data storage object.

Abstract: A method involves receiving a plurality of security rules from a remote management platform at an endpoint detection and response (EDR) module at a user device. The EDR module subscribes to one or more event types at the user device. The EDR module receives a notification of an event corresponding to one of the subscribed event types. Upon determining that the event is associated with a file stored at the user device, the EDR module instantiates an event tracer tree that is associated with the file. The EDR module generates a file hash value for the file using the event tracer tree. Upon determining that the file hash value satisfies a security rule, the EDR module quarantines the file and reports that the file has been quarantined.

Abstract: Concepts and technologies disclosed herein are directed to increasing misspelling, typographical, and partial search tolerance for search terms. A system can obtain media content metadata associated with media content. The system can identify a plurality of names within the media content metadata and remove a plurality of stop words from the media content metadata. The system can determine a plurality of unigrams and a plurality of bigrams from the media content metadata. The system can determine a plurality of misspellings of the media content metadata. The system can compile the plurality of names, the plurality of stop words, the plurality of unigrams, the plurality of bigrams, and the plurality of misspellings as results. The system can determine a plurality of incorrect search strings based upon the results and can create a dictionary including the plurality of incorrect search strings mapped to a plurality of correct search strings.

Abstract: A facility for the identifying contents of a data object is described. The facility identifies in the data object two or more constituent portions. For each of the constituent portions identified in the data object, the facility: identifies a type of data items occurring within the constituent portion; on the basis of the identified data item type, selects a deidentification operation; and causes the selected deidentification operation to be performed on the data items of the constituent portion, such that these data items are modified to make the data items less identifiable with a person, and/or less-harmfully identifiable with a person. After the causing, the facility assembles the constituent portions containing the modified data items into a modified version of the data object.

Abstract: Provided is a method of determining an advertisement target according to an advertisement request, the method includes: obtaining usage history information from a plurality of devices, obtaining features of the plurality of devices, based on the usage history information, and generating feature vectors for the obtained features; determining labels for the plurality of devices, based on the advertisement request and the obtained features; generating an advertisement target inference model, based on the determined labels and the feature vectors; and determining at least one advertisement target device among the plurality of devices by applying the generated advertisement target inference model to the plurality of devices.

Abstract: Data dividers with partition identifiers are described for use in data analytics for streaming data. A continuous flow of data items received by a network-based data analytics service may be discretized into data buckets based on a time window associated with each of the data buckets receiving the data items from the data stream Data dividers may be generated based on a number of partitions determined to be necessary to implement parallel processing of the data items and each partition may include the data items to be processed as well as a single data divider ordered at the end of the partition such that the data divider is the last item to be processed. In this way, the network-based data analytics service may determine that all of the data items for a given data bucket have been processed once all of the data dividers have been processed.

Abstract: A remote access method obtains a remote access function instruction including a first item parameter value, a first interface parameter value, a first cmdlist parameter value, and a first keylist parameter value. An access mode to a remote computer is determined according to the first item parameter value. A login type of the remote computer is determined according to the first interface parameter value and the access mode. After the remote computer is logged into, data is retrieved from the remote computer according to the first cmdlist parameter value. The data is processed according to the first keylist parameter value. The method improves access efficiency to remote computers.

Abstract: Methods, computer program products, and systems are presented. The methods include, for instance: collecting real time system statistics on a system environment in a remote platform running a remote data source amongst a plurality of remote data sources of a virtual database. Real time data source statistics on one or more data source objects from the remote data source of the virtual database is also gathered. A global catalog of the virtual database is updated with the real time system statistics and the real time data source statistics. An access plan to process a query to the virtual database is optimized based on the real time system statistics and the real time data source statistics and a response is produced based on the access plan, with improved performance and reduced cost.

Abstract: In a computer-implemented method for handling of an index update, time series data is received at an ingestion node of a time series data monitoring system. An index update is determined based on the time series data. The index update is stored to an index database of the time series data monitoring system. The index update is forward to a plurality of query nodes of the time series data monitoring system.

Abstract: A system and method for efficient query processing using a real index of a queried table are described. In one embodiment, the real index is used in an offset query type in order to reduce the number of rows that are sorted and thereby increases efficiency for processing offset query types. In another embodiment, the real index is used in a set operation query type where existing systems utilize a table scan and thereby increases efficiency of set operation query types.

Abstract: A workflow presentation receives electronic object from multiple sources, such as electronic messaging systems and document management systems. The system develops a hypergraph representation of the objects in which the objects appear, individually or in clusters, as edges along various rails of the hypergraph. Each rail represents a workstream to provide a visual representation of the electronic objects that are associated with one or more workstreams of a project.

Abstract: Systems and methods include presenting search results from multiple sources by grouping the results from some of the multiple sources, ranking each of the multiple sources and groups of sources, and not presenting duplicate results 5 from lower ranked sources. In this way, the user is provided with search results that are distinct as opposed to presenting the same result multiple times when it is available from different sources.

Abstract: A system and method for providing fine-grained access control in a search engine. Access control predicates associated with a search query, including fixed-width and/or variable-width tokens, are received from the search engine, and are formatted in a machine-readable binary format to generate a single byte array. A pre-sorted memory index structure associated with the single byte array is generated, by sorting the access control predicates according to their token width. The pre-sorted memory index structure is merge joined with an uninverted terms index that includes a sorted list of all terms in a field associated with the search query, and a document index mapping each document identifier (ID) to a term ordinal for a specific field.

Abstract: Methods, systems, and apparatus, including computer-readable media, for a hierarchical multi-tenant data access platforms. In some implementations, the a server system stores data collected through a multi-tenant data access platform configured to collect data for each of multiple tenant organizations and to selectively make the collected data available according to policies associated with the respective tenant organizations. The server system receives a request associated with a user, and the server system generates and provides a response according to the organization hierarchy data and policy data for the unit of the organization that has data that would be used in generating the response to the request.

Abstract: In the general, the subject matter of the present disclosure relates to a data analysis tool that helps consumers, such as data scientists and engineers, understand datasets better. The disclosed data analysis framework/tool surfaces metrics to data consumers to visually inspect and understand large datasets more efficiently. In addition to the pre-computed and pre-collected metrics on given datasets or tables, the disclosed data analysis tool may also provide a way to detect various anomalies associated with the datasets.

Abstract: The subject technology receives a statement to perform an operation to add a new column into a table. The subject technology generates a schema hash value for a new schema version associated with a new schema version value. The subject technology stores a mapping of the schema hash value to the new schema version value for the table in a metadata database. The subject technology stores a new schema entry based on the schema hash value, the new schema version value, and the new column for the table in the metadata database. The subject technology performs an operation to add the new column to the table.

Abstract: A system and method for efficiently maintaining metadata stored among a plurality of solid-state storage devices. A data storage subsystem supports multiple mapping tables. Records within a mapping table are arranged in multiple levels. Each level stores at least pairs of a key value and a physical pointer value. The levels are sorted by time. New records are inserted in a created new highest (youngest) level. No edits are performed in-place. A data storage controller determines both a cost of searching a given table exceeds a threshold and an amount of memory used to flatten levels exceeds a threshold. In response, the controller incrementally flattens selected levels within the table based on key ranges. After flattening the records in the selected levels within the key range, the records may be removed from the selected levels. The process repeats with another different key range.

Abstract: A query processing system operates by determining a query pricing scheme; receiving a query request from a requesting entity that indicates access to a subset of a plurality of records in a database system; generating query cost data based on the subset of the plurality of records by utilizing the query pricing scheme; and transmitting the query cost data to the requesting entity.

Abstract: A data model for managing custom fields for tasks in projects. The custom fields can be defined and shared across an organization, and are always unique. Each type of custom field is an object that is subclass of a generic object. Other objects define attributes of the custom fields and assign values to the attributes. The data model allows the custom fields to be preserved and managed across multiple projects and users.

Abstract: This application provides a search apparatus, including a global dispatcher, a global arbiter, and N search engines. The N search engines can access a first search table. The global dispatcher is configured to: determine that a first search keyword is corresponding to the first search table and dispatch the first search keyword to the N search engines. Each search engine is configured to: search, according to a first search algorithm, one subtable to determine whether an entry that matches the first search keyword exists; and output a search result to the global arbiter. The global arbiter is configured to arbitrate the search result output by each search engine, to obtain a search result corresponding to the first search table.

Abstract: Aspects include receiving a notification that a value of a data element stored in a source storage location in a source format has been changed to an updated value. The change is replicated to a plurality of target storage locations. The replicating includes, for each of the plurality of target storage locations, determining a target format of the data element in the target storage location. The target format is one of a plurality of different formats, including the source format. Each of the different formats provide a different level of data protection for the data element. In response to determining that the target format is not the same as the source format, the updated value of the data element is converted into the target format, and the updated value of the data element is stored in the target format at the target storage location.

Abstract: Some embodiments provide a novel method of performing health monitoring for resources associated with a global server load balancing (GSLB) system. This system is implemented by several domain name system (DNS) servers that perform DNS services for resources located at several geographically separate sites. The method identifies several different groupings of the resources. It then assigns the health monitoring of the different resource groups to different DNS servers. The method then configures each particular DNS server (1) to send health monitoring messages to the particular group of resources assigned to the particular DNS server, (2) to generate data by analyzing responses to the sent health monitoring messages, and (3) to distribute the generated data to the other DNS servers. The method in some embodiments is performed by a set of one or more controllers.

Abstract: A network device may receive data, may extract primary patterns from a plurality of domain names included in the data, may process the primary patterns, with a hash model, to generate hash keys for the primary patterns, wherein a hash key includes a hash value associated with a wildcard character, and may store the plurality of domain names in a hash table. The network device may extract a particular primary pattern from a particular domain name included in a search request, may determine potential matching patterns based on the particular primary pattern, and may process the potential matching patterns, with the hash model, to generate potential matching hash keys for the potential matching patterns, wherein a hash key includes a hash value associated with a wildcard character. The network device may search, based on the potential matching hash keys, the hash table to identify a matching domain name.

Abstract: A system and method is described for database split generation in a massively parallel or distributed database environment including a plurality of databases and a data warehouse layer providing data summarization and querying functionality. A database table accessor of the system obtains, from an associated client application, a query for data in a table of the data warehouse layer, wherein the query includes a user preference. The system obtains table data representative of properties of the table, and determines a splits generator in accordance with one or more of the user preference or the properties of the table. The system generates, by the selected splits generator, table splits dividing the user query into a plurality of query splits, and outputs the plurality of query splits to an associated plurality of mappers for execution by the associated plurality of mappers of each of the plurality of query splits against the table.

Abstract: A database structure and a system that uses the structure to facilitate efficient context enrichment of low-level events occurring in a distributed computing system. In one aspect, the database structure comprises a table accessible to a distributed storage system. The table comprises a plurality of rows. Each row represents a corresponding process creation event of a particular process at a particular host at a particular time and assigned a particular event identifier. Each row comprises a row key identifying the particular host, the particular process, the particular time, and the particular event identifier of the process creation event corresponding to the row. The particular time and the particular event identifier are stored as part of the row key in a bitwise one's complement format. The row key structure facilitates efficient identification of a process creation event where only hostname and the process identifier of the process creation event are known.

Abstract: Disclosed is a method performed by a database management system (DBMS) according to an exemplary embodiment of the present disclosure. The method may create a database index structure for pointing a data storage location based on monitoring result information depending on a monitoring algorithm in the database management system. The database index structure may at least partially include a sub index structure of a first level and a sub index structure of a second level which is lower than the first level, the second level sub index structure may include a plurality of columns, a first column among the plurality of columns of the second level sub index structure may include key values, a second column among the plurality of columns of the second level sub index structure may include ROWID values corresponding to rows of a data block, and a third column among the plurality of columns of the second level sub index structure may include optimized index values set based on the monitoring result information.

Abstract: Methods, systems, and computer-readable media for a bulk ingestion interface for a distributed data storage system are described. A bulk ingestion interface may allow bulk data to be ingested into a distributed data storage system using compute resources separate from respective compute resources of the distributed data storage system used to perform access requests to datasets stored on one or more resource hosts of the distributed data storage system.

Abstract: A controller is provided to manage searching a storage system. A search query including a search term is received. The controller generates a set of tasks associated with conducting a search of the storage system for any objects in the storage system having the search term. These tasks are pushed onto a message queue. A set of workers are allocated to retrieve and process the tasks. A worker processes a task in parallel with another worker processing another task.

Abstract: Disclosed is a computer-implemented method to adjust partition keys. The method includes identifying a target table that is a target of a query, the target table including a set of initial partitions. The method also includes determining a set of common queries, wherein each of the common queries are configured to retrieve data from the target table. The method further includes identifying a plurality of core ranges. The method includes merging the core ranges into a new set of partitions. The method further includes setting, in response to the merging, updated partition keys. Further aspects of the present disclosure are directed to systems and computer program products containing functionality consistent with the method described above.

Abstract: Apparatus, methods, and computer-readable media facilitating reduction and incremental modeling through set theory prime factorization are disclosed herein. An example method includes identifying one or more topics associated with content of a social media message. The example method also includes mapping each of the one or more topics to a respective set key to generate a set list associated with the social media message. Additionally, the example method includes recording the set list associated with the social media message in memory.

Abstract: A database management system and a method for redundant storage of time-series data in a distributed data storage system with a plurality of storage media is disclosed. The method comprises dividing the time-series data into a plurality of data blocks, storing the plurality of data blocks on ones of the plurality of storage media, and redundantly storing a subset of time series data, which is contiguous in time to one of the plurality of data blocks, on the same one of the plurality of storage media as the contiguous one of the plurality of data blocks.

Abstract: In response to a query to a database, the identity of a slave machine which stores the requested data is resolved, and the query is parsed to identify one or more shards at the slave machine. Each shard corresponds to a partition of the requested data stored at the slave, and rows inside of the shard are respectively assigned a fixed-size local ID. Tasks corresponding to each shard are placed into a thread pool, and the threads are processed using the respective local IDs to obtain the requested data.

Abstract: A system and method for managing permissions of users for a column-oriented data structure, including: generating a column oriented data structure in response to receiving a request to generate the data structure from a first user device associated with a first user account, wherein the data structure comprises a plurality of columns, wherein each column is of single data type and is assigned metadata associated with the single data type; associating the first user account with a first set of permissions associated with the generated data structure; and, associating a second user account with a second set of permissions, wherein the first set of permissions comprises at least one additional permission with respect to the second set of permissions.

Abstract: A distributed computing environment data store management system includes a computer-based system for identifying a subset of element records in a data store associated with the elements of a distributed computing environment, receiving at least one user-defined data element from a user interface. Using the user-defined data element, the system adds the user-defined data element to each of the subset of element records, and stores each of the subset of element records and their associated user-defined data in the database.

Abstract: A method for fetching a content from a web server to a client device is disclosed, using tunnel devices serving as intermediate devices. The client device accesses an acceleration server to receive a list of available tunnel devices. The requested content is partitioned into slices, and the client device sends a request for the slices to the available tunnel devices. The tunnel devices in turn fetch the slices from the data server, and send the slices to the client device, where the content is reconstructed from the received slices. A client device may also serve as a tunnel device, serving as an intermediate device to other client devices. Similarly, a tunnel device may also serve as a client device for fetching content from a data server. The selection of tunnel devices to be used by a client device may be in the acceleration server, in the client device, or in both.

Abstract: By analyzing execution of a set of transactions by an application, a set of actual code execution paths of the application are determined. From the set of actual code execution paths, a set of predicted execution paths of the application are predicted using an execution prediction model. The set of predicted execution paths includes the set of actual code execution paths. By determining that paths in the set of predicted execution paths have above a threshold similarity to each other, a cluster of predicted execution paths is identified. The cluster of predicted execution paths is recommended, using a recommendation model, for implementation as a single execution path in a revised version of the application.

Abstract: Embodiments of the present disclosure disclose a method and apparatus for processing information. A specific implementation of the method includes: acquiring a search result set related to a search statement inputted by a user; parsing the search statement to generate a first syntax tree, and parsing a search result in the search result set to generate a second syntax tree set; calculating a similarity between the search statement and the search result in the search result set using a pre-trained semantic matching model on the basis of the first syntax tree and the second syntax tree set, the semantic matching model being used to determine the similarity between the syntax trees; and sorting the search result in the search result set on the basis of the similarity between the search statement and the search result in the search result set, and pushing the sorted search result set to the user.

Abstract: Media content platforms are configured to received search queries and present results to those search queries. Media guidance applications may be configured to access content from multiple content platforms or sources. When a user provides a search query to a media guidance application configured to access multiple content sources, the inventions described herein present search results from multiple sources by grouping the results from some of the multiple sources, ranking each of the multiple sources and groups of sources, and not presenting duplicate results from lower ranked sources. In this way, the user is provided with search results that are distinct as opposed to presenting the same result multiple times when it is available from different sources.

Abstract: Aspects of the invention are configured to perform an operation comprising receiving a query specifying an AND condition and an OR condition, determining, based on an AND index structure, a set of documents, of a plurality of documents in a corpus, satisfying the AND condition of the query, computing a query similarity score for a first document in the set of documents, wherein the query similarity score is based on a first hash value computed for the OR condition of the query, a weight value for the OR condition, and a second hash value for the first document specified in an OR index, and returning an indication of the first document and the query similarity score as responsive to the query.

Abstract: A non-transitory computer-readable recording medium recording an indexed data generation program causing a computer to execute processing of generating ledger sheet output format data from ledger sheet data including a ledger sheet having a plurality of columns; generating index information for words, characters, or numerical values, the index information including positional information capable of specifying attributes of the plurality of columns and a positional relationship in the ledger sheet data between pieces of data corresponding to the plurality of columns included in the ledger sheet output format data; and outputting an output file including the index information and the ledger sheet output format data.