Abstract: A system stores associates a database query with a name and stores versions of the database query. The system allows applications to execute a specific version of the database query by specifying the name of the database query and a version identifier. For example, the database query may be exposed as an endpoint of a REST API and invoked using calls to the REST API. This allows the applications to be designed without including the query definition within the code of the application. Continuous delivery of database query is performed by creating a new version of the database query that are tested using applications in a test environment. Once the new version of a database query meets test criteria, the new version of the database query is executed by applications running in production environment by sending API requests that identify the query name and the new version.

Abstract: Dashboard loading using a filtering query from a cloud-based data warehouse cache, including determining that a filtered result for a first filtering query is stored in a cache of a cloud-based data warehouse; sending, in response to the filtered result being stored in the cache, to the cloud-based data warehouse, a request for the filtered result from the cache; and providing, based on the filtered result for the first filtering query, one or more dashboard visualizations.

Abstract: Systems and methods are disclosed for processing and executing queries against one or more dataset. As part of processing the query, the system determines whether the query is susceptible to a significantly imbalanced partition. In the event, the query is susceptible to an imbalanced partition, the system monitors the query and determines whether to perform a multi-partitioning determination to avoid a significantly imbalanced partition.

Abstract: An encrypted search uses hash vectorization (HV) models, which are secure, one-way hash indices that are produced by a compression process, such as a modeling phase of Lempel-Ziv (LZ) parsing. Each HV model includes a hash filter and a chain vector. The hash filter is a Boolean quotient filter similar to Bloom filters, and allows for the quick elimination of negative query assessments. The hash filter is followed by a chain vector, which provides spatial modeling of hashed elements throughout the compressed and encrypted data, thereby providing increased levels of accuracy, efficiency, and query expressiveness as compared with known techniques.

Abstract: In order to improve the integrating of datasets, improved systems and methods for matching records from a first dataset and a second dataset are provided. Records from the first dataset and the second dataset that are associated with the same individuals are identified. The records are identified using a combination of Euclidean distance, Leviathan distance, and the application of one or more rules. Once the records that are associated with the same individuals are identified, the records can be combined in an integrated dataset.

Abstract: One example method includes receiving a data stream that comprises data in a form of multi-dimensional data structures. The data stream may be received in real time as it is generated. Metadata about the data may be generated and stored. Further, portions of the data may be selected and cached, and the cached data analyzed in real time. Based on the analyzing, various insights may be generated concerning the data that was analyzed.

Abstract: An inquiry system is provided in which an inquiry unit of a user of a machine and/or a device makes inquiries related to the machine and/or the device to inquiry a plurality of center systems of suppliers, and includes: a relay device which connects the inquiry unit and the inquiry center systems; and a storage unit which stores first and second identification information related to the machine and/or the device, the inquiry unit includes: an acquisition unit which acquires the first identification information; and a first communication unit which transmits the first identification information acquired to the relay device, the relay device includes: a second communication unit which communicates between the inquiry unit and the inquiry center systems; and a selection unit which selects, based on the first and second identification information, the inquiry center system and the second communication unit connects the inquiry unit and the inquiry center system.

Abstract: Systems and methods are described for modifying input and output (I/O) to an object storage service by implementing one or more owner-specified functions to I/O requests. A function can implement a data manipulation, such as filtering out sensitive data before reading or writing the data. The functions can be applied prior to implementing a request method (e.g., GET or PUT) specified within the I/O request, such that the data to which the method is applied may not match the object specified within the request. For example, a user may request to obtain (e.g., GET) a data set. The data set may be passed to a function that filters sensitive data to the data set, and the GET request method may then be applied to the output of the function. In this manner, owners of objects on an object storage service are provided with greater control of objects stored or retrieved from the service.

Abstract: A system including one or more processors and one or more non-transitory media storing computer instructions configured to run on the one or more processors and perform: identifying a first sub-population of case individuals from a gross population of the case individuals; presenting first test content to a first test sub-population of the case individuals, the first test content is selected according to a first statistical model; measuring a first test sub-population average feedback metric based on first test content feedback provided from the first test sub-population of the case individuals; determining that the first test sub-population average feedback metric exceeds a first control population average feedback metric of a first control population of the case individuals; and determining that a probability value for a difference between the first test sub-population average feedback metric and the first control population average feedback metric is less than a predetermined significance level value.

Abstract: A method, system, and processor-readable storage medium are directed towards generating a report derived from data, such as event data, stored on a plurality of distributed nodes. In one embodiment the analysis is generated using a “divide and conquer” algorithm, such that each distributed node analyzes locally stored event data while an aggregating node combines these analysis results to generate the report. In one embodiment, each distributed node also transmits a list of event data references associated with the analysis result to the aggregating node. The aggregating node may then generate a global ordered list of data references based on the list of event data references received from each distributed node. Subsequently, in response to a user selection of a range of global event data, the report may dynamically retrieve event data from one or more distributed nodes for display according to the global order.

Abstract: Methods, systems, and computer storage media for processing search queries using relevance-based search refinement are provided. In response to a search query, search result items are displayed on a search interface along with selectable guidance attributes. The guidance attributes are an identified ranked set of characteristics of items based on historical user interactions of users interacting with the search result items provided in response to the search query. Upon selection of a guidance attribute, a guidance-attribute control having embedded selectable values is displayed. A selection of an embedded value is received to cause execution of an embedded-value search operation. A first embedded-value search operation is executed to identify a subset of the items using the selected value.

Abstract: An embodiment of the present invention is directed to implementing a data usage analytics engine for database systems. An embodiment of the present invention is directed to implementing a Data Usage Analysis engine that receives queries (e.g., SQL queries), tables (e.g., Internal Catalog tables) and/or other data formats as input. An embodiment of the present invention may then parse the queries and identify various data usage patterns. This may include details concerning what tables are used, how much data is queried at what intervals, frequency of querying along what attributes are used in the queries and/or other usage details in various levels of granularity.

Abstract: Systems, devices, media, and methods are presented for assembling a database for query generation. The database is assembled by receiving a query history log, the query history log including target queries and a mapping between each of the target queries and associated subqueries for each of the target queries, selecting one or more of the associated subqueries for a first target query based on a conditional probability exceeding a threshold for the associated subqueries of the first target query compared to the matching associated subqueries of the other target queries, and including the first target query and the selected one or more associated subqueries for the first target query in the in-memory data structure store for query generation.

Abstract: An associative memory array includes a plurality of associative memory cells arranged in rows and columns where each first cell in a first row and in a first column has access to a content of a second cell in a second row in an adjacent column.

Abstract: Systems, methods, and computer-readable storage media for using bots. One method includes receiving, from a user device, an input indicative of a selection of a bot, and retrieving data associated with a user of the user device. Further, the method includes identifying a selection of bot options based on analyzing the user data, and presenting, via the user device, the selection of bot options. Further, the method includes receiving, from the user device, a selection of an option from the selection of bot options, and retrieving user payment information and shipping information based on the user data and populate one or more fields associated with the selection of the option. Further, the method includes presenting, via the user device, a confirmation page to confirm the populated one or more fields.

Abstract: A computer device receives a stream of event data which event data has the data about the event itself and a device or user identifier. One or the events is stored for different identifiers to be used as state. Two or more different scripts are run and the information about at least one event is shared by at least two different scripts.

Abstract: An event detection system is configured to access a repository that contains a collection of media content. The media content may for example include images, videos, audio clips, and the like, wherein the media content comprises features that include: tags (e.g., hashtags or other similar mechanisms to label and sort content); captions that comprises one or more words or phrases; continuous numerical values; geolocation data (e.g., geo-hash, check-in data, coordinates); as well as temporal data (e.g., timestamps).

Abstract: Methods and systems described herein may retrieve a data lineage associated with a first computing system comprising a plurality of services and data elements. The data lineage may indicate a plurality of interrelationships between the plurality of services and data elements. Based on the data lineage, a visualization of the first computing system may be generated. Based on the one or more interrelationships between a first data element and the plurality of services and data elements, one or more services and data elements affected by the change to the first data element may be identified. Based on the one or more services and data elements affected by the change to the first data element, the visualization of the first computing system may be updated to indicate the impact to the first computing system.

Abstract: A processor-implemented method for synchronizing and reconciling data stream in real-time between an edge node and a cloud node is provided. The method includes (i) generating classified data by classifying data of the data stream that is obtained from a plurality of edge nodes in real-time to synchronize in a location at a plurality of cloud nodes, (ii) synchronizing the classified data in the plurality of cloud nodes by detecting a first location and a type of database in the plurality of cloud nodes and storing the classified data in the first location in the plurality of cloud, (iii) replicating the classified data in a plurality of second locations in the plurality of cloud nodes, and (iv) receiving, from the plurality of edge nodes, a request signal for synchronizing the classified data from the plurality of cloud nodes to the plurality of edge nodes when the first location in the plurality of cloud nodes fails to transfer the classified data during a transaction.

Abstract: A centralized database management system performs data synchronization with lower bandwidth consumption and higher efficiency. The system manages data synchronization and data reconciliation across multiple databases managed by multiple DBMS across different client servers. The system generates and sends instructions that encode each data table into an invertible bloom filter and identifies differences between the two databases by performing a subtraction operation on the two invertible bloom filters. The system may generate a third invertible bloom filter comprising information associated with differences between the two data tables. The system may send instructions to the source and the destination databases, where a first and a second invertible bloom filters are encoded for the source and the destination databases, respectively. The system may decode the third invertible bloom filter, identify the different elements, and generate instructions to the source and/or the destination database.

Abstract: Offline building of a projected data subset may be performed. A request to create a data set that is a projected subset of data from a source data set may be received. A data store separate from the data store storing the source data set may store a copy of the source data set that is used to replicate items to the projected subset of data according to a schema for the projected data subset. Updates made to the source data set may also be replicated to the projected data subset according to the schema. Conflicts between replicated items and replicated updates to the projected data set may be resolved by comparing a version identifier for the replicated update and replicated item to determine what to store in the projected data subset.

Abstract: Disclosed are an input/output proxy method and apparatus for a mimic Redis database. Through a pseudo server module, it is ensured that the interface of the Redis database is consistent with the external interface of the native Redis, so that it is convenient to implant the Redis database into arbitrary Redis application scenarios; the isolation of the modules inside is realized by independent processes, thus facilitating independent development, maintenance and expansion; and the synchronization function is integrated into the input/output proxy to achieve resource reuse; for the synchronization function, the random credit attenuation mechanism is cleverly utilized to ensure the synchronization function while taking into account the saving of resources.

Abstract: In response to identifying an update operation for a system table of a DBMS, a row that corresponds to the update operation is identified using a partial image of the update operation. A before image that corresponds to the row is gathered and a new before image of the row that reflects the update operation is generated by overlaying the before image with the partial image. In response to identifying a delete operation that relates to the system table, a row of the system table that corresponds to the delete operation is identified using an identifier of the delete operation. A before image that corresponds to this row is gathered. A new before image of the row of the system table that reflects the delete operation is generated by applying the delete operation to this before image.

Abstract: Updates to a hierarchical data structure may be selectively replicated to other replicas of the hierarchical data structure. An update for a hierarchical data structure may be received and committed to the hierarchical data structure. A determination as to whether any other replicas of the hierarchical data structure have permission to receive the update may be made. For those replicas of the hierarchical data structure with permission to receive the update, the update may be provided to the replicas and committed to the replicas. Different types of replication techniques may be implemented, such as pull-based replication techniques or push-based replication techniques. Replication permissions for objects of the hierarchical data structure may be individually defined, in some embodiments.

Abstract: A system for data object replication includes at least one hardware processor and at least one memory storing instructions. The instructions cause the at least one hardware processor to perform operations including decoding a replication request to obtain a data object. Object dependencies associated with the data object and a plurality of additional data objects are determined. A replication sequence of the data object and the plurality of additional data objects is determined based on the object dependencies. A replication of the data object and at least one of the plurality of additional data objects is performed according to the replication sequence. A notification of a successful completion of the replication is generated.

Abstract: Provided is a method of synchronizing a distributed object store including a plurality of data stores, the method including bringing a first data store of the data stores online after having been offline, choosing a second data store of the data stores, the second data store being online while the first data store was offline, reading, by the first data store, an entry from a catch-up log, and performing a data modification operation corresponding to the entry on the first data store to synchronize the plurality of data stores.

Abstract: One or more techniques and/or computing devices are provided for non-disruptively establishing a synchronous replication relationship between a primary volume and a secondary volume and/or for resynchronizing the primary volume and the secondary volume. For example, a baseline snapshot and one or more incremental snapshots of the primary volume are used to construct and incrementally update the secondary volume with data from the primary volume. A dirty region log is used to track modifications to the primary volume. A splitter object is used to split client write requests to the primary volume and to the secondary volume. A synchronous transfer engine session is initiated to processing incoming client write requests using the dirty region log. A cutover scanner is used to transfer dirty data from the primary volume to the secondary volume. In this way, a synchronous replication relationship is established between the primary volume and the secondary volume.

Abstract: Methods, systems, and computer-readable storage media for receiving, by a messaging system, a message having a key, the key indicating a tenant of a set of tenants, providing, by the messaging system, the message in a partition of a messaging queue, reading, by a service instance, the message from the partition, the service instance being in a set of services instances, each service instance executing a service of a service-based application, and in response to the message, updating, by the service instance, at least a portion of data stored within a database system, the portion of data being associated with the tenant, the database system storing data of each tenant of the set of tenants.

Abstract: For a given cross-data-store transaction request at a storage service, a coordinator transmits respective voting transition requests to a plurality of log-based transaction managers (LTMs) configured for the respective data stores to which writes are directed in the transaction. The LTMs transmit responses to the coordinator based on data-store-specific conflict detection performed using contents of the voting transition requests and respective data-store-specific state transition logs. The coordinator determines a termination status of the cross-data-store transaction based on the LTMs' responses, and provides an indication of the termination status to the LTMs.

Abstract: Techniques for query execution against relational databases using connection pooling are described. According to some embodiments, a query processing service is disclosed that enables users to execute queries against target relational databases implemented by a relational database service. The service receives query requests originated by a client application at a web service endpoint and identifies a connection to a particular target database. In some examples, the query request is a Hyper Text Transfer Protocol (HTTP) message comprising a query to be executed by a target database instance within the provider network. The service transmits the query for execution at the target database via the connection and obtains a query result based on the execution of the query. The service transforms the query result into a format suitable for the client and transmits a query response to the client.

Abstract: Systems and methods for indexing data include formulating an objective function to index a dataset, a portion of the dataset including supervision information. A data property component of the objective function is determined, which utilizes a property of the dataset to group data of the dataset. A supervised component of the objective function is determined, which utilizes the supervision information to group data of the dataset. The objective function is optimized using a processor based upon the data property component and the supervised component to partition a node into a plurality of child nodes.

Abstract: Some embodiments provide a non-transitory machine-readable medium that stores a program. The program receives a plurality of documents. The program further uses a visual model to generate a vector representation for each document in the plurality of documents. The program also clusters the plurality of documents into a set of clusters based on the vector representations of the plurality of documents. The program further determines a sample set of documents from the plurality of documents based on the set of clusters.

Abstract: Aspects of the present invention disclose a method, computer program product, and system for governing a set of information assets using an information governance system. The method includes one or more processors applying one or more high-level classification assignment rules to one or more information assets of the set of information assets. Furthermore, the method includes one or more processors applying one or more high-level classification propagation rules to the one or more information assets provided with the high-level classification assignments for propagating the respective high-level classification assignments upwards within a containment hierarchy formed by the set of information assets to one or more superordinate information assets of the set of information assets.

Abstract: Techniques are discussed for preparing and executing scanning plans for particular types of information, including personally identifiable information. A user indicates one or more datastores to be scanned for the particular type of information. A scanner determines scan objectives for the scanning plan and classifiers for use in scans conducted according to the scanning plan. The scanner estimates scan performance metrics and scan quality metrics. The scanner presents estimated results for the scanning plan based on the selected classifiers, scan objectives, estimate scan performance metrics, and estimated scan quality metrics. The user can modify the set of scan objectives or select between alternative sets of scan objectives. The scanning plan may be performed iteratively and the results of previous scan may be used to adjust classifiers or scan objectives to be used in subsequent scans.

Abstract: A method for executing a query may include generating a partition value identifier for a partitioned table. The partitioned table may include a main fragment including a main dictionary storing a first value and a main value identifier corresponding to the first value and a delta fragment including a delta dictionary storing a second value and a delta value identifier corresponding to the second value. The partition value identifier may be set based at least in part on the first value and the second value. The generated partition value identifier and a corresponding one of the main value identifier and the delta value identified may be maintained as part of a mapping. A query to group data stored in the partitioned table may be received. The query may be executed by at least using the mapping.

Abstract: A method for shuffle-less reclustering of clustered tables includes receiving a first and second group of clustered data blocks sorted by a clustering key value. A range of clustering key values of one or more the data blocks in the second group overlaps with the range of clustering key values of a data block in the first group. The method also includes generating split points for partitioning the first and second groups of clustered data blocks into a third group. The method also includes partitioning using the split points, the first and second groups into the third group. Each data block in the third group includes a range of clustering key values that do not overlap with any other data block in the third group. Each split point defines an upper limit or lower limit for the range of clustering key values a data block in the third group.

Abstract: A method, apparatus, and computer-readable medium for quantitatively grouping a set of persons into a plurality of groups of three or more persons using computational clustering, the method including storing a set of data objects corresponding to the set of persons, storing a plurality of attributes corresponding to each data object in the set of data objects, generating a plurality of multidimensional objects by encoding each data object in the set of data objects as a multidimensional object based at least in part on two or more attributes corresponding to that data object, each multidimensional object corresponding to a data object in the set of data objects, and generating the plurality of groups of three or more data objects based at least in part on applying a clustering algorithm to the plurality of multidimensional objects.

Abstract: A method comprises storing a plurality of entity profiles; applying a predetermined first set of rules to a plurality of attribute-value pairs of the plurality of entity profiles; identifying a first set of entity profiles that satisfy the predetermined first set of rules; identifying a second set of entity profiles that satisfy the predetermined second set of rules; and updating a first attribute-value pair of the first and second sets of entity profiles by adding a first label to the first attribute-value pair responsive to determining the first set of entity profiles and the second set of entity profiles share a common entity profile.

Abstract: Provided is an information provision system that can provide workers with useful information for combining tables, so that even workers with little specialized knowledge can smoothly proceed with the task of combining multiple tables. An input unit 81 receives input of multiple tables. An identification unit 82 identifies a pair of columns that are in a combinable relationship, identifies that a pair of tables to which the individual columns forming the pair belong is the pair of tables to be combined, and identifies a combine method of the tables to be combined. An output unit 83 outputs the pair of tables to be combined, the pair of columns in a combinable relationship, and the combine method of the tables to be combined.

Abstract: A method and system obtaining positioning data from an object traveling on a plurality of routes; mapping the data into a plurality of points on a digital map; identifying points that are unmatched to the stored route trajectory; obtaining candidate transition points from the unmatched points; aggregating the candidate transition points by applying a clustering algorithm; selecting a first cluster of points and a plurality of second clusters of points, determining a confidence level that the first cluster of points are transition points indicating a transition between the routes, classifying the first cluster of points as a first plurality of traveling points having a first direction in response to the confidence being below a threshold confidence and automatically adjusting the stored route trajectory to indicate that the first cluster of points are on the route trajectory.

Abstract: A system comprises an input interface to receive input indicating a question, a communication module to establish a communication link with an access network, wherein the communication link provides connectivity to one or more packet data networks (PDNs) via the access network, and a computer coupled to the input interface and the communication module, the computer including a processor and a memory, the memory storing instructions executable by the processor to execute an information retrieval procedure including accessing an open-domain context search space of the one or more PDNs and retrieving, from among a plurality of contexts of the open-domain context search space, a plurality of candidate contexts for answering the question using a question-answering model for open-domain question answering, identify a set of non-answering contexts among the plurality of candidate contexts, wherein each of the set of non-answering contexts is a respective context for which the question-answering model predicts the qu

Abstract: Systems and methods provides for dialog management in real-time rather than turn taking. An example method included generating first candidate responses to triggering event. The triggering event may be receipt of a live stream chunk for the dialog or receipt of a backend response to a previous backend request for a dialog schema. The method also includes updating a list of candidate responses that are accepted or pending with at least on of the first candidate responses, and determining, for the triggering event, whether the list of candidate responses includes a candidate response that has a confidence score that meets a triggering threshold. The method also includes waiting for a next triggering event without providing a candidate response when the list does not include a candidate response that has a confidence score that meets the triggering threshold.

Abstract: A query request may be received via a communication interface. Records may be retrieved from a database system based on the query request. The records may correspond with document portions selected from documents. A subset of the records may be determined by applying textual analysis of the document portions based on the query request. A response message to the original request may be generated and sent via a communication interface. The response message may include an answer to the query in natural language generated based on the first subset of the records.

Abstract: Methods and systems are provided for generating automatic program recommendations based on user interactions. In some embodiments, control circuitry processes verbal data received during an interaction between a user of a user device and a person with whom the user is interacting. The control circuitry analyzes the verbal data to automatically identify a media asset referred to during the interaction by at least one of the user and the person with whom the user is interacting. The control circuitry adds the identified media asset to a list of media assets associated with the user of the user device. The list of media assets is transmitted to a second user device of the user.

Abstract: Some embodiments may obtain a natural language question, determine a context of the natural language question, and generate a first vector based on the natural language question using encoder neural network layers. Some embodiments may access a data table comprising column names, generate vectors based on the column names, and determine attention scores based on the vectors. Some embodiments may update the vectors based on the attention scores, generating a second vector based on the natural language question, determine a set of strings comprising a name of the column names and a database language operator based on the vectors. Some embodiments may determine a values based on the determined database language operator, the name, using a transformer neural network model. Some embodiments may generate a query based on the set of strings and the values.

Abstract: A system and method provide a trained model that uses vectorized word embeddings that are averaged or summed to form representations for sentences and phrases. The representations are processed in a Siamese neural network including multiple LSTM stages to find semantically related matches in catalogs for non-catalog queries. The model is trained using catalog data and randomized data using a contrastive loss function to generate similarity metrics for catalog-non-catalog pairs.

Abstract: Implementations of the present disclosure are directed to providing remote access to electronic documents stored in a server system using a virtual secure room, and include actions of authenticating a user at least partially based on credentials the user, at least partially in response to authenticating the user, providing a secure connection between a computing device of the user and the server system, transmitting at least one electronic document for display to the user on the computing device, monitoring the user, while the at least one electronic document is displayed to the user on the computing device, and selectively closing the secure connection in response to one or more of at least one activity and at least one state of the user.

Abstract: A system to quantify aggregate alignment of segmented text with an evaluator population, with a data processing system comprising memory and one or more processors, can segment a first extended text object into one or more evaluation text objects associated with a population reference, identify one or more text frame objects corresponding to the evaluation text objects, the text frame objects being associated with a second extended text object, generate, based on the text frame objects, one or more context identifier objects corresponding to the evaluation text objects, and generate a condensed text object including one or more of the evaluation text objects, the evaluation text objects being positioned in the condensed text object in response to output of a first machine learning model trained with input including at least one of the first extended text objects, the evaluation text objects, the context identifier objects, and the text frame objects.

Abstract: Embodiments may provide a document system that receives a responsiveness call from a user through the task/queue framework regarding a machine call document. Theses responsiveness calls may be used to refining the scoring algorithm used by the document system of to generate a desired confidence score for the document system.

Abstract: In some embodiments, techniques for searching comprise providing receiving a request for a local search, determining a current location associated with a document currently being viewed, determining a search restriction specification associated with the current location associated with the document currently being viewed, wherein the search restriction specification relates to a specification of a set of pages to be searched, obtaining local search results by performing a search, wherein the local search results are limited to members of the set of pages to be searched in accordance with the search restriction specification, and presenting the local search results.