Abstract: A facility is described for automatically selecting document properties to be included in an index on a corpus of documents. In some cases, the facility performs this automatic selection by subjecting the documents of the corpus to an inference model. In some cases, the facility performs this automatic selection by submitting to a large language model a prompt automatically constructed to include, for each of one or more example documents, (1) the example document's contents, and (2) a list of properties of the sample document that should be indexed.

Abstract: A system and method generate a dynamic and query adaptive Bloom filter for optimal joining of tables such as large tables in distributed data processing systems. A Bloom filter is dynamically constructed and tuned based on historical query patterns including frequency and selectivity. Metrics are collected from execution of an Adaptive Query Execution (AQE) based execution plan and execution of a Bloom filter-based execution plan generated from the constructed and tuned Bloom filter. A score measuring performance of the execution plans is generated from the metrics of each of the execution plans. The execution plan with a greater score is selected to optimally join the tables. The method implements the system.

Abstract: A system can, based on a retrieval-augmented generation (RAG) process ingesting data, query a search system to identify at least one first portion of the data that has at least one third generation identifier that is greater than second generation identifiers in a checkpoint; create second chunks from the at least one first portion of the data; in response to second chunks being duplicates of first chunks, based on hash values, store first identifiers of the second chunks; remove the stored chunk identifiers from second identifiers of chunks that correspond to chunks that existed in a RAG system prior to the ingesting, to produce stale chunk identifiers; remove, from the RAG system, third chunks that are identified by the stale chunk identifiers, and, in response to the second chunks being determined to be unique relative to the first chunks, store the second chunks in the RAG system.

Abstract: Methods, systems, and devices for data management are described. A first application in a destination computing environment of a data management system (DMS) may determine that a bulk-push criterion is satisfied for a second application in a source computing environment of the DMS. The first application may transmit, to an asynchronous metadata service, a request indicating the second application for which the bulk-push criterion is satisfied. The request may be configured to cause the asynchronous metadata service to query a database in the source computing environment, identify a latest version of one or more rows that include metadata associated with the second application, and generate data records indicating the latest version of the one or more rows that include the metadata associated with the second application. The first application may receive the data records via an asynchronous data stream between the first application and the second application.

Abstract: According to some embodiments, systems and methods are provided including a memory storing processor-executable code; and a processing unit to execute the processor-executable program code to cause the system to: receive a request for a sequence, the sequence including two or more components; identify one or more possible sequences based on the request; build a sequence based on the identified one or more possible sequences, wherein building the sequence includes adding an extension to the sequence; validate the built sequence; and store the validated sequence. Numerous other aspects are provided.

Abstract: A method of detecting anomalies in data, includes receiving a dataset with a plurality of multidimensional data points (MDDPs) wherein a portion of the plurality of MDDPs are labeled and wherein other MDDPs of the plurality of MDDPs are unlabeled; based on a neighborhood size k of the plurality of MDDPs, computing a neighborhood radius ox for each MDDP in a reference dataset computed for the plurality of MDDPs; and generating a locally adaptive similarity (LAS) kernel of a newly arrived MDDP (NAMDDP) based on the neighborhood radius ox. The method additionally includes applying a random walk model to the LAS kernel to determine a probability of the NAMDDP being an anomaly; and if the NAMDDP is an anomaly, outputting data associated with an alarm or notification responsive to the detection of the anomaly.

Abstract: A technique of managing space-accounting updates includes receiving a set of updates to space-accounting metadata of a specified volume, performing a lookup for the specified volume in a volume table that maps volumes to respective delta records, the lookup identifying a delta record that stores a set of space-accounting changes for the specified volume, and writing to the delta record to account for the set of updates.

Abstract: A computer-implemented method for generating a summary of a graph database comprising a set of RDF tuples including obtaining the graph database and generating a summary having a set of probabilistic filters. Each probabilistic filter of the set determines if at least one RDF tuple existing in the graph database corresponds to a respective basic graph pattern of the probabilistic filter with a possibility of false positive.

Abstract: Examples provide record retention to content items in a content management system. The system identifies a content item stored in a content items database and displays a user interface (UI) that includes a list for a categorization criterion. User input is received from the UI indicating a user selection for the first categorization criterion. A retention mapping schedule maps the criterion options to retention labels of a retention schedule. A retention label for the content item is determined based on the first user selection and the retention mapping schedule, the retention label being defined in the retention schedule and having an expiration duration defining how long content items marked with the retention label are retained. The retention label is stored as metadata for the content item, and the content item is deleted after an expiration duration of the content item has elapsed.

Abstract: A mechanism is described for facilitating misuse index for explainable artificial intelligence in computing environments, according to one embodiment. A method of embodiments, as described herein, includes mapping training data with inference uses in a machine learning environment, where the training data is used for training a machine learning model. The method may further include detecting, based on one or more policy/parameter thresholds, one or more discrepancies between the training data and the inference uses, classifying the one or more discrepancies as one or more misuses, and creating a misuse index listing the one or more misuses.

Abstract: Synchronizing loosely coupled systems where a source system determines a source evaluation of a validation function based on a data record sent to a target system and the source system receives from the target system a target evaluation of the validation function based on the data record. The source system compares the source evaluation to the target evaluation and, in response to a mismatch, the source system executes a predefined action for synchronizing the data record at the target system with the data record at the source system. The predefined action may comprise the source system resending the data record to the target system.

Abstract: Systems and methods for neuroscience-based prompt strategy generation may create more effective prompts, leading to more successful and user-friendly interactions with large language models (LLMs). The systems and methods may consider factors including, but not limited to, evolutionary category needs, strongest emotional memories, usage context, brand guidelines, and/or photographic details. The system may include a plurality of modules that may work together to effectuate neuroscience-based prompt strategy. These modules include an analytics engine, a contextualized prompt generation module, an images generator module, and a governance module.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for improved forecasting of the distribution of digital components that may be provided over a network as a response to an electronic request for certain types of content. In some aspects, a method includes receiving a request comprising distribution parameters for a given digital campaign. Futurized queries are obtained from historical serving logs of a serving system that is configured to provide existing digital components using serving code. Each digital campaign of multiple digital campaigns is assigned to one of multiple matching computers. Each assigned matching computer identifies one or more of the futurized queries that match the digital campaign assigned to the matching computer. Matching data indicating the one or more futurized queries can be stored in a file system. A queue entry for each instance of matching data is added to a queue.

Abstract: An apparatus, computer-implemented method and computer program are disclosed for organization and analysis of high-scale low-signal (HSLS) data. The method may comprise providing one or more raw datasets representing CDRs and processing the raw datasets to generate an object-relational model comprising a plurality of objects, each object having an object type and properties of the respective object type. The method may also comprise receiving at least a first query comprising, for at least one object type of the object-relational model, at least a first property relating to a first investigation and applying the at least first query to the stored object-relational model to generate a first subset of the CDRs. Responsive to selection of an analysis command, the method may comprise performing a predetermined type of analysis associated with the analysis command on the first subset of CDRs to produce a resultant subset of the CDRs.

Abstract: A system and a method are disclosed that calculate the center of a geographic region. A set of topological/geographical points is received. A set of clusters is determined. A weight for each cluster is computed. The highest weighted cluster is selected. The geographic region center is calculated using the selected cluster. The geographical points can include a key for each point and be filtered by an indicated key before calculating the center of a geographic location.

Abstract: Various systems and methods are described herein for an improved spreadsheet application that allows a user to generate, manipulate, and replicate data visualizations (e.g., sparklines, graphs, charts, etc.) using functions without importing data into cells of the application. For example, data is stored in one or more remote or local data stores accessible to the improved spreadsheet application. A user enters a function into a cell of the improved spreadsheet application. The improved spreadsheet application generates a query using the function, the query identifying a portion of a dataset to retrieve from the data store(s). The improved spreadsheet application then transmits the query to the data store(s) and retrieves the requested data. A renderer of the improved spreadsheet application then renders a sparkline using the retrieved data. The improved spreadsheet application displays the rendered sparkline in the cell in which the function was entered, or at another designated location.

Abstract: A data storage system for use with a multi-threaded processing system receives concurrent requests to store data to a common data store, and efficiently and securely swaps an active data store for a new data store while avoiding conflicts arising from multiple threads attempting to swap a same data store and minimizing reliance on operations that re-attempt actions upon failure of an attempted action, thereby improving performance of the data storage system and also the multi-threaded processing system.

Abstract: In one embodiment, a method includes obtaining datasets from one or more applications. The datasets comprise functional data and control data related to a plurality of events. The method also includes defining a functional table using the functional data and defining a control table using the control data. The method further includes joining the functional table and the control table to generate an entitlement table. In another embodiment, a method includes receiving a request from a user to access sensitive data related to an event. The method also includes identifying a role of the user and identifying a role-based entitlement of the user based on the role of the user. The method also includes determining, using the role-based entitlement of the user, a user entitlement. The method further includes generating a secured view associated with the user entitlement and communicating the secured view to the user.

Abstract: A method for data storage includes specifying a plurality of File Systems (FSs) for use by multiple clients, including assigning to the FSs both respective global identifiers and respective client-specific names. The plurality of FSs is managed using the global identifiers, and files are stored for the clients in the FSs using the client-specific names.

Abstract: Systems and methods for performing data governance as a service is disclosed and may include onboarding a database to a governance as a service system, the database including at least one data set, executing, via the data governance as a service system, at least one core capability, wherein the at least one core capability is applicable to the at least one data set, determining data governance metadata for the at least one data set, wherein the data governance metadata is a subset of a data set metadata, applying at least one policy rule of the core capability to the data governance metadata, determining a violation based on applying the at least one policy rule, generating a first alert based on the violation, and transmitting the first alert to a designated system.