Abstract: Systems and methods are provided for data migration. The system may comprise one or more processors and a memory storing instructions that, when executed by the one or more processors, cause the system to migrate at least one first table of a first database schema to at least one second table of a second database schema, determine a query for modifying the first table during the migration, modify the second table based at least in part on the query, and update a mutation table to describe the modification, wherein the mutation table at least describes the modification.

Abstract: Systems and methods are provided for enhanced alert generation based on real-time manipulation of datasets. An example method includes accessing datasets including a plurality of rows each indicating a plurality of values. Occurrences of alert definitions are monitored via applying the alert definitions to the datasets, the alert definitions specifying expressions utilizing one or more of the values, with an occurrence of an alert definition indicating satisfaction of the specified expression and causing an associated alert to be generated for evaluation. Presentation of an interactive user interface associated with customizing alert definitions is caused. The interactive user interface presents a first visual portion, the first visual portion enabling specification of an expression for a customized alert definition.

Abstract: Systems and methods are provided for database or data file backup. The system may comprise one or more processors and a memory storing instructions that, when executed by the one or more processors, cause the system to identify a list of data files required for restoring the database or data files, create a backup comprising copies of a subset of the data files that are created or modified after a preceding backup, and back up the database, wherein the backup includes an identification to the preceding backup.

Abstract: A database system comprised of a decoupled compute layer and storage layer is implemented to store, build, and maintain a canonical dataset, a temporary buffer, and projection datasets. The canonical dataset is a set of batch updated data. The data is appended in chunks to the canonical dataset such that the canonical dataset becomes a historical dataset over time. The buffer is a write ahead log that contains the most recent chunks of data and provides atomicity and durability for the database system. The projection datasets are indexes of the canonical dataset and/or the buffer that may have single or multiple column sort-orders and/or particular data formats. The writes to the canonical dataset, projection datasets, and buffer may be asynchronous and therefore the database system is advantageously less resource constrained.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media for data synchronization are provided. One of the methods includes: receiving, from a client device displaying a spreadsheet interface, a query for data; identifying, from one or more datasets in a data store, a plurality of data items responsive to the query; sending, to the client device, a plurality of data entries for display in a plurality of cells of the spreadsheet interface, wherein the data entries correspond to the identified data items; receiving, from the client device, information associated with one or more changes to one or more of the data entries, wherein the one or more changes are created based on one or more user inputs in the spreadsheet interface; and updating, in the data store based on the one or more changes, one or more of the data items corresponding to the one or more changed data entries.

Abstract: Systems and methods are provided for providing an interface for conducting an investigation concerning at least one suspected unauthorized entry to an environment. A set of tabbed sub-interfaces for accessing information related to the environment can be provided in a first region of the interface. An interactive map of the environment can be provided in a second region of the interface, wherein the interactive map identifies locations within the environment that are associated with access control readers, and wherein the interactive map identifies locations within the environment that are associated with respective cameras that capture visual data describing those locations.

Abstract: Methods and systems for structuring, storing and displaying time series data in a user interface. One system includes processors executing instructions to determine, from time series data from a first sensor, a first subset of time series data for the first batch from the first start time and the first end time, determine, from the time series data from the first sensor, a second subset of time series data for the second batch from the second start time and the second end time, generate a time series user interface comprising a chart, the chart including a first plot for the first subset of time series data and a second plot for the second subset of time series data, the first plot being aligned to the second plot, and cause presentation of the time series user interface.

Abstract: Computer-implemented systems and methods are disclosed for indexing and aggregating proxy server data. In accordance with some embodiments, the systems comprise a memory device configured to store a set of instructions, and one or more processors configured to execute the set of instructions to receive a plurality of log lines of proxy server data comprising a plurality of data components and index one or more of the plurality of data components for the plurality of log lines. The processors also generate a plurality of log data records, each including the one or more indexed data components, and generate a summarized data record by aggregating one or more log data records having at least one matching indexed data component.

Abstract: Systems and methods are provided for adaptive data replication. A first data object is stored. One or more first network characteristics of a communication network are detected. A first replication mode is triggered (e.g., a single-master replication mode) based on the one or more first network characteristics of the communication network. The single-master replication may be configured to facilitate real-time synchronizations (e.g., for critical updates). One or more second network characteristics of the communication network are detected. A second replication mode (e.g., a multi-master replication mode) is triggered based on the one or more second network characteristics. The second replication may be configured to facilitate a delayed synchronization (e.g., for non-critical updates) of the first data object and the second data object using the second update file.

Abstract: Computer implemented systems and methods are disclosed for annotating and linking electronic documents. In accordance with some embodiments, annotations assigned to source electronic documents are received and snippets are generated from the received annotations. The generated snippets are aggregated into clusters, which are used to generate an electronic document. Links between the snippets and their respective source documents may be generated and embedded in the generated electronic document.

Abstract: Systems and methods are provided for improved graphical user interface configuration. The system allows an administrator to rapidly and deploy create customized pages based on configuration files. Versioning and branching of the configuration files allows rapid development of the customized pages. The configurations for dynamic content cause such content to be retrieved and presented on pages. Short configuration sections cause large sections of a markup page to be generated without manual page programming.

Abstract: Systems, methods, and non-transitory computer readable media may provide a view of geospatial information. A user's selection of a location may be obtained. Characteristic information describing characteristics of the location may be obtained. Activities information describing activities of the location may be obtained. An interface (e.g., user interface, API) enabling presentation of a geospatial view of the activities of the location with respect to the characteristics of the location may be provided.

Abstract: A logical query plan to derive a target dataset from one or more source datasets is identified. The logical query plan defines source columns of the one or more source datasets and respective target columns of the target dataset. The logical query plan is parsed to derive relationships between the source columns of the one or more source datasets and the respective target columns of the target dataset. Target column metadata is generated for a target column of the target dataset. The target column metadata reflects a derived relationship between one or more source columns and the target column and existing source column metadata of each of the one or more source columns. The target column metadata is stored for the target column of the target dataset.

Abstract: Systems and methods are presented for data quality monitoring. Data quality monitors may be created and configured to identify objects with specified data quality issues and/or property values. Objects identified by a data quality monitor can be presented to users for confirmation and resolution. Properties used by the data quality monitor to match objects may also be displayed to users.

Abstract: A workbook management system provides a master branch of a data pipeline comprising a pointer(s) to a snapshot(s) of an initial dataset(s), a first logic, and a pointer(s) to a snapshot(s) of a first derived dataset(s) resulting from applying the first logic to the initial dataset(s). Responsive to user input requesting a test branch corresponding to the master branch, the system creates the test branch comprising the pointer(s) to the snapshot(s) of the initial dataset(s) and a copy of the first logic. The system receives a request to modify the test branch comprising at least one change to the copy of the first logic, and modifies the test branch independently of the master branch to include second logic reflecting the at least one change to the copy of the first logic, the pointer(s) to the snapshot(s) of the initial dataset(s), and a pointer(s) to snapshot(s) of a second derived dataset(s) resulting from applying the second logic to the initial dataset(s).

Abstract: Systems and methods are provided for obtaining and providing one or more resources for an investigation to be conducted remotely from a server. Resources needed to conduct an investigation may include one or more portions of a database and/or one or more functionalities of a data analysis platform. Based on the investigation to be conducted (e.g., type of investigation, location of investigation, personnel involved, etc.), a computing system may obtain different amounts/types of resources from the server. The investigation may be conducted via a web application that runs on the computing system. The web application may access the resources obtained from the server. The results of the investigation may be sent by the computing system to the server. The computing system may receive updates from the server. The computing system may act as a server for other remote systems that are conducting investigations.

Abstract: Systems and methods are provided for monitoring and logging all activity occurring in a system. The logged activity may include keystroke entries input into the system, user and/or application interactions with the system, access restriction conflicts, and the like. The logged activity may be stored in at least two datastores, at least one of which is an immutable, append-only datastore. Storage of the logged activity in the immutable, append-only datastore is performed using hash algorithms. Attempts at manipulating or at hiding malicious or unauthorized activity can be recognized due to all activity being captured in the immutable, append-only datastore.

Abstract: In an embodiment, a data processing method comprises accessing a computer memory comprising a shareable cell-based computation notebook comprising: notebook metadata specifying a kernel for execution, and a computational cell comprising cell metadata, a source code reference, and an output reference, wherein the cell metadata identifies a particular version of source code of a function that defines an input dataset, a transformation, and one or more variables that are to be associated with output data that is to be generated as a result of executing the particular version of the source code; updating the source code reference to identify a first storage location that is to contain the particular version of the source code of the function; and updating the output reference to identify a second storage location that is to contain the output data that is to be generated as a result of executing the particular version of the source code identified in the cell metadata using the kernel specified in the notebook me

Abstract: Computer-implemented techniques for data extraction are described. The techniques include a method and system for retrieving an extraction job specification, wherein the extraction job specification comprises a source repository identifier that identifies a source repository comprising a plurality of data records; a data recipient identifier that identifies a data recipient; and a schedule that indicates a timing of when to retrieve the plurality of data records. The method and system further include retrieving the plurality of data records from the source repository based on the schedule, creating an extraction transaction from the plurality of data records, wherein the extraction transaction comprises a subset of the plurality of data records and metadata, and sending the extraction transaction to the data recipient.

Abstract: Systems and methods are provided for determining a request to validate data, the request specifying validation criteria; generating a graph for validating the data, the graph including at least one node-based connected component that evaluates the data, the node-based connected component being constructed to represent the validation criteria; validating the data using the generated graph, wherein the data being validated is evaluated by the node-based connected component; and providing information describing the validated data.