Abstract: User interfaces are provided for improved data optimization. A model user interface can be used to generate models based on a historical data file based on modeling details and filters specified by a user. The user can save the models and apply the models to optimize a data file. The user can specify optimization details and see visualizations of the results.

Abstract: A computer-implemented method for targeted sweep of a key-value data storage is provided. The method comprises before a write transaction to a database having a key value store commits, and before each of one or more write commands of the write transaction are persisted to the key value store, writing an entry for each of the one or more write commands to an end of a targeted sweep queue, the entry comprising metadata including: data identifying a cell to which the write command relates, a start timestamp of the write transaction, and information identifying a type of the write transaction.

Abstract: A model management system provides a centralized repository for storing and accessing models. The model management system receives an input to store a model object in a first model state generated based on a first set of known variables. The model management system generates a first file including a first set of functions defining the first model state and associates the first file with a model key identifying the model object. The model management system receives an input to store the model object in a second model state having been generated based on the first model state and a second set of known variables. The model management system generates a second file including a second set of functions defining the second model state and associates the second file with the model key. The model management system identifies available versions of the model object based on the model key.

Abstract: The present disclosure relates to methods and systems for querying data in a data repository. According to a first aspect, this disclosure describes a method of querying a database, comprising: receiving, at a computing device, a plurality of keywords; determining, by the computer device, a plurality of datasets relating to the keywords; identifying, by the computer device, metadata for the plurality of datasets indicating a relationship between the datasets by examining an ontology associated with the datasets; providing, by the computer device, one or more suggested database queries in natural language form, the one or more suggested database queries constructed based on the plurality of keywords and the metadata; receiving, by the computing device, a selection of the one or more suggested database queries; and constructing, by the computer device, an object view for the plurality of datasets based on the selected query and the metadata.

Abstract: Computing systems methods, and non-transitory storage media are provided for obtaining information regarding an incident, generating a representation of the information, augmenting the representation with additional contextual information, determining a response to address the incident, and implementing the response or transmitting the determined response to a separate computing system that implements the response.

Abstract: Systems and methods are disclosed herein for reducing a risk of associating with a client that may engage in illegal activity. A system accesses data associated with an entity for a given context, applies a plurality of AI models to the data based on the context to generate a plurality of AI assessments. Data for showing risk factors, assessments of the risk factors, and data for evaluating risk factors can be transmitted for rendering in a user interface in a display device. Analyst feedback can be received and used to update the AI models.

Abstract: A system with an interactive user interface for users to view and interact with sanitized log data received from a plurality of hosts, such as those associated with various services of an organization. The system may receive from hosts log files and/or metadata that have been filtered by agents executing on the respective hosts to remove or anonymize any sensitive or confidential information prior to transmission to the system. In some embodiments the system does further filtering of the sanitized data. Received sanitized data is parsed, indexed, and/or otherwise processed for optimal searching, and stored in a log pipeline. The system causes display of an electronic visualization interface.

Abstract: Various systems and methods are provided that display various geographic maps and depth graphs in an interactive user interface in substantially real-time in response to input from a user in order to determine information related to measured data points, depth levels, and geological layers and provide the determined information to the user in the interactive user interface. For example, a computing device may be configured to retrieve data from one or more databases and generate one or more interactive user interfaces. The one or more interactive user interfaces may display the retrieved data in a geographic map, a heat map, a cross-plot graph, or one or more depth graphs. The user interface may be interactive in that a user may manipulate any of the graphs to identify trends or current or future issues.

Abstract: A computing system accesses one or more data sources to determine maintenance optimization data associated with an asset within a set of assets. The maintenance optimization data may include one or more of: upcoming maintenance events for the asset, such as may be predicted based on analysis of historical maintenance information of the asset, a time series of predicted value of the asset over a time period around the upcoming maintenance event, such as within a few days or hours of the maintenance event, and/or a recommended window of time to initiate and/or perform upcoming maintenance events, which may be based on a combination of the expected upcoming maintenance events, and the time series of predicted value of the particular asset, for example.

Abstract: A system is described for controlling access to resources using an object model. Users can specify use cases for accessing resources. The user may be granted access if the user satisfies qualifications required for accessing the resource, selected a use case permissible for accessing the resource, and satisfies qualifications required for the use case. Use cases, qualifications, resources, and/or links between them can be implemented using an object model. The system can be used in addition to authentication and authorization.

Abstract: An apparatus, computer-implemented method and computer program are disclosed for synchronising dataset updates. For example, the method may comprise providing a first code branch associated with a plurality of code sets which, when executed, produce respective time-series datasets for provision to a downstream process linked to the first code branch. The method may also comprise generating a second code branch, based on the first code branch, the second code branch executing the plurality of code sets as part of an updating process and, if successful, storing respective time-series datasets to respective memory locations associated with the second code branch. Another part of the method may comprise determining if all code sets executed by the second code branch have successfully committed. Responsive to a positive determination, one or more pointers, e.g.

Abstract: Whether a logical query plan to derive a target dataset from one or more source datasets is available is determined. Responsive to determining that the logical query plan is not available for the transformation code in the first programming language, relationships between the source columns of the one or more source datasets and the respective target columns of the target dataset are inferred. Target column metadata for a target column of the target dataset is generated. The target column metadata reflects the inferred relationships between the source columns of the one or more source datasets and the respective target columns. The target column metadata for the target column of the target dataset is stored.

Abstract: A computer-implemented method is disclosed. The method comprises managing, by a processor, a connected entity graph of nodes and edges, each node of the nodes representing an entity having an entity type of a plurality of entity types, at least one node of the nodes having an entity type of an electronic note, each edge of the edges representing a relationship between two entities; receiving a request for a search specifying a beginning entity, a linking parameter, and a filter on the linking parameter, the linking parameter specifying a property of an intermediary entity linking a source entity and a target entity during the search, the filter constraining a value of the property; searching the connected entity graph based on the request; causing a display of a search result.

Abstract: A batching module that prepares a plurality of blocked expressions for batch evaluation. The plurality of blocked expressions comprises a plurality of expressions in a blocked state. The batching module divides the plurality of blocked expressions into one or more partitions. For each particular partition of the one or more partitions, a single batch processing call is dispatched to an application server to perform a batch evaluation.

Abstract: A database system comprised of a decoupled compute layer and storage layer is implemented to store, build, and maintain a canonical dataset, a temporary buffer, and an edits dataset. The canonical dataset is a set of batch updated data. The data is appended in chunks to the canonical dataset such that the canonical dataset becomes a historical dataset over time. The buffer is a write ahead log that contains the most recent chunks of data and provides atomicity and durability for the database system. The edits dataset is the set of data that contains edits such as cell mutations, row appends and/or row deletions. The database system enables users to make cell or row-level edits to tables and observe those edits in analytical systems or downstream builds with minimal latency.

Abstract: A pipeline task verification method and system is disclosed, and may use one or more processors. The method may comprise providing a data processing pipeline specification, wherein the data processing pipeline specification defines a plurality of data elements of a data processing pipeline. The method may further comprise identifying from the data processing pipeline specification one or more tasks defining a relationship between a first data element and a second data element. The method may further comprise receiving for a given task one or more data processing elements intended to receive the first data element and to produce the second data element. The method may further comprise verifying that the received one or more data processing elements receive the first data element and produce the second data element according to the defined relationship.

Abstract: Methods and apparatuses related to federated search of multiple sources with conflict resolution are disclosed. A method may comprise obtaining a set of data ontologies (e.g., types, properties, and links) associated with a plurality of heterogeneous data sources; receiving a selection of a graph comprising a plurality of graph nodes connected by one or more graph edges; and transforming the graph into one or more search queries across the plurality of heterogeneous data sources. A method may comprise obtaining a first data object as a result of executing a first search query across a plurality of heterogeneous data sources; resolving, based on one or more resolution rules, at least the first data object with a repository data object; deduplicating data associated with at least the first data object and the repository data object prior to storing the deduplicated data in a repository that has a particular data model.

Abstract: Systems and methods for analyzing data stored using a data model. The system can receive a user selection of a first object type indicating to perform filtering operations on a first set of data objects, generate a list of object types linked to the first object type based on an ontology, receives a user selection of a second object type, generate a list of properties of the second object type based on an ontology, receive a user selection of a first property from the list of properties, perform a data query determining values associated with the first property, receive a user selection of a first value, and displays information of a subset of data objects being a portion of the first set of data objects that are linked to data objects in the second set of data objects that have a first property value of the first value.

Abstract: Various systems and methods are described herein for an improved spreadsheet application that allows a user to generate, manipulate, and replicate data visualizations (e.g., sparklines, graphs, charts, etc.) using functions without importing data into cells of the application. For example, data is stored in one or more remote or local data stores accessible to the improved spreadsheet application. A user enters a function into a cell of the improved spreadsheet application. The improved spreadsheet application generates a query using the function, the query identifying a portion of a dataset to retrieve from the data store(s). The improved spreadsheet application then transmits the query to the data store(s) and retrieves the requested data. A renderer of the improved spreadsheet application then renders a sparkline using the retrieved data. The improved spreadsheet application displays the rendered sparkline in the cell in which the function was entered, or at another designated location.