Abstract: Data analysis system with highly dynamic and interactive data analysis user interfaces which enable data analysts to quickly and efficiently explore large volume data sources. The system enables the user to investigate large volumes of data over many different paths of analysis while maintaining detailed and retraceable steps taken by the user over the course of an investigation, as captured via the user's queries and user interaction with the user interfaces provided by the data analysis system. Data analysis paths may involve exploration of high volume data sets. The data analyst may pursue a data analysis path that involves, among other things, applying filters, joining to other tables in a database, viewing interactive data visualizations, and so on. The data analysis system enables a user to refresh or insert a node in a workflow. The data analysis system further provides data editing, reporting, enrichment, expression language, and charting functionality.

Abstract: Example embodiments relate to a policy service employed to perform operations to: generate and maintain a data-set that comprises at least a column and a row that intersect at a cell; assign an access policy to a row or column of the data-set, wherein the access policy is defined by one or more access credentials required to receive access the cell that intersect with the row or column; receive a request to read the data-set from a user account, wherein the user account has an associated credential; filter the cell that intersects with the row or column of the data-set based on the access policy and the credential of the user account, in response to receiving the request from the user account; and provide the user account with access to the filtered data-set.

Abstract: The systems and methods described herein provide highly dynamic and interactive data analysis user interfaces which enable data analysts to quickly and efficiently explore large volume data sources. The data analysis system enables the user to investigate large volumes of data over many different paths of analysis while maintaining detailed and retraceable steps taken by the user over the course of an investigation, as captured via the user's queries and user interaction with the user interfaces provided by the data analysis system. Data analysis paths may involve exploration of high volume data sets, such as Internet proxy data, which may include trillions of rows of data. The data analyst may pursue a data analysis path that involves, among other things, applying filters, joining to other tables in a database, viewing interactive data visualizations, and so on. The data analysis system enables a user to refresh or insert a node in a workflow.

Abstract: Example embodiments relate to a policy service employed to perform operations to: generate and maintain a data-set that comprises at least a column and a row that intersect at a cell; assign an access policy to a row or column of the data-set, wherein the access policy is defined by one or more access credentials required to receive access the cell that intersect with the row or column; receive a request to read the data-set from a user account, wherein the user account has an associated credential; filter the cell that intersects with the row or column of the data-set based on the access policy and the credential of the user account, in response to receiving the request from the user account; and provide the user account with access to the filtered data-set.

Abstract: A system and methods for determining computer resource allocation, the system having a network communication interface configured to receive a query from a device, the query indicating a request to perform a processing operation on a portion of one or more data set. The system may also include data storage for data including historical information related to processing of data sets by back-end computer resources, and hardware processors configured to determine one or more scores associated with a query and based at least in part on the historical information. The system may determine a particular back-end computer resource with a highest score, provide a compute request to the particular back-end computer resource to perform a processing operation on a portion of one or more data sets, and store processing information related to the processing of the compute request by the particular back-end computer resource as historical information.

Abstract: Systems and methods provide a first group of computation modules configured to provide back-end compute resources for a first type of computation module by back-end compute resources. Systems and methods provide a second group of computation modules that are configured to provide back-end compute resources for a second type of computation module wherein the first and second type of computation modules are of different types. In some examples, methods and systems identify the type of computation module needed by each of a plurality of queries associated with different types of client applications based on computation module type data associated with each query and route each of the plurality of queries to an appropriate computation module within the first or second computation modules based on the computation module type data.

Abstract: A system and methods for queuing processing jobs. The system is configured to receive a processing job associated with a user; score the processing job; apply one or more bounds; add the processing job to a queue; order the queue based on scores of processing jobs in the queue; and sample processing jobs from the queue for dispatch for processing. Sampling the jobs from the queues can comprise updating scores, updating application of bounds, and updating ordering of the queue; reading a batch of processing jobs from a top of the queue; attempting to dispatch the processing jobs of the batch for processing; removing from the queue any dispatched processing jobs; increasing the batch size by a constant factor; determining whether a maximum batch size is reached, or all processing jobs in the queue were in the batch.

Abstract: Systems and methods provide a first group of computation modules configured to provide back-end compute resources for a first type of computation module by back-end compute resources. Systems and methods provide a second group of computation modules that are configured to provide back-end compute resources for a second type of computation module wherein the first and second type of computation modules are of different types. In some examples, methods and systems identify the type of computation module needed by each of a plurality of queries associated with different types of client applications based on computation module type data associated with each query and route each of the plurality of queries to an appropriate computation module within the first or second computation modules based on the computation module type data. Related methods are also disclosed.

Abstract: Systems and methods provide a first group of computation modules configured to provide back-end compute resources for a first type of computation module by back-end compute resources. Systems and methods provide a second group of computation modules that are configured to provide back-end compute resources for a second type of computation module wherein the first and second type of computation modules are of different types. In some examples, methods and systems identify the type of computation module needed by each of a plurality of queries associated with different types of client applications based on computation module type data associated with each query and route each of the plurality of queries to an appropriate computation module within the first or second computation modules based on the computation module type data. Related methods are also disclosed.

Abstract: Example embodiments relate to a policy service employed to perform operations to: generate and maintain a data-set that comprises at least a column and a row that intersect at a cell; assign an access policy to a row or column of the data-set, wherein the access policy is defined by one or more access credentials required to receive access the cell that intersect with the row or column; receive a request to read the data-set from a user account, wherein the user account has an associated credential; filter the cell that intersects with the row or column of the data-set based on the access policy and the credential of the user account, in response to receiving the request from the user account; and provide the user account with access to the filtered data-set.

Abstract: Various systems and methods are provided that allow reviewers to review and potentially flag processed communication data in order to spot potential malfeasance or illegal activity. Certain systems and methods includes modules for removing duplicate data from the communication data files, generating thread data for email data files, generating lexicon tag data for the data files, removing blacklisted data that meets blacklisted criteria, or generating group association data.

Abstract: Example embodiments relate to a policy service employed to perform operations to: generate and maintain a data-set that comprises at least a column and a row that intersect at a cell; assign an access policy to a row or column of the data-set, wherein the access policy is defined by one or more access credentials required to receive access the cell that intersect with the row or column; receive a request to read the data-set from a user account, wherein the user account has an associated credential; filter the cell that intersects with the row or column of the data-set based on the access policy and the credential of the user account, in response to receiving the request from the user account; and provide the user account with access to the filtered data-set.

Abstract: Systems and methods provide a first group of computation modules configured to provide back-end compute resources for a first type of computation module by back-end compute resources. Systems and methods provide a second group of computation modules that are configured to provide back-end compute resources for a second type of computation module wherein the first and second type of computation modules are of different types. In some examples, methods and systems identify the type of computation module needed by each of a plurality of queries associated with different types of client applications based on computation module type data associated with each query and route each of the plurality of queries to an appropriate computation module within the first or second computation modules based on the computation module type data. Related methods are also disclosed.

Abstract: Discussed herein are embodiments of methods and systems which allow engineers or administrators to create modular plugins which represent the logic for various fault detection tests that can be performed on data pipelines and shared among different software deployments. In some cases, the modular plugins each define a particular test to be executed against data received from the pipeline in addition to one or more configuration points. The configuration points represent configurable arguments, such as variables and/or functions, referenced by the instructions which implement the tests and that can be set according to the specific operation environment of the monitored pipeline.

Abstract: A digestive profiling system comprises a breath analysis device comprising an inlet arranged to receive a breath sample from a user, a gas sensor arranged to generate a gas measurement of an amount of gas in the breath sample, and a first communication interface arranged to transmit a plurality of gas measurements generated by the gas sensor. The system further comprises a remote user interface device. The remote user interface device comprises a second communication interface arranged to receive the gas measurements generated by the gas sensor, a storage module arranged to store the received gas measurements, and a display arranged to display information to the user based on the stored gas measurements. The remote user interface device is remote from the breath analysis device.

Abstract: A system and methods for determining computer resource allocation, the system having a network communication interface configured to receive a query from a device, the query indicating a request to perform a processing operation on a portion of one or more data set. The system may also include data storage for data including historical information related to processing of data sets by back-end computer resources, and hardware processors configured to determine one or more scores associated with a query and based at least in part on the historical information. The system may determine a particular back-end computer resource with a highest score, provide a compute request to the particular back-end computer resource to perform a processing operation on a portion of one or more data sets, and store processing information related to the processing of the compute request by the particular back-end computer resource as historical information.

Abstract: A system and methods for determining computer resource allocation, the system having a network communication interface configured to receive a query from a device, the query indicating a request to perform a processing operation on a portion of one or more data set. The system may also include data storage for data including historical information related to processing of data sets by back-end computer resources, and hardware processors configured to determine one or more scores associated with a query and based at least in part on the historical information. The system may determine a particular back-end computer resource with a highest score, provide a compute request to the particular back-end computer resource to perform a processing operation on a portion of one or more data sets, and store processing information related to the processing of the compute request by the particular back-end computer resource as historical information.

Abstract: A system and methods for determining computer resource allocation, the system having a network communication interface configured to receive a query from a device, the query indicating a request to perform a processing operation on a portion of one or more data set. The system may also include data storage for data including historical information related to processing of data sets by back-end computer resources, and hardware processors configured to determine one or more scores associated with a query and based at least in part on the historical information. The system may determine a particular back-end computer resource with a highest score, provide a compute request to the particular back-end computer resource to perform a processing operation on a portion of one or more data sets, and store processing information related to the processing of the compute request by the particular back-end computer resource as historical information.