Abstract: Techniques for imposing a common build system for disparate software products are described. In an embodiment, a first virtualization environment and second visualization environment are generated for a first software product and a second software product respectively. The virtualization environments include one or more script files identifying steps to take to build an executable package for the first software product and the second software product respectively. An API endpoint is defined for an output of the first virtualization environment. When a first generic build command is received through a first user interface associated with the first software product, the first generic build command is translated into a first software specific build command. The first virtualization environment then executes the first software build command using the one or more script files.

Abstract: Data transformation in a distributed system of applications and data repositories is described. The subsystems for the overall framework are distributed, thereby allowing for customization to require only isolated changes to one or more subsystems. In one embodiment, a source code repository is used to receive and store source code. A build subsystem can retrieve source code from the source code repository and build it, using one or more criteria. By building the source code, the build subsystem can generate an artifact, which is executable code, such as a JAR or SQL file. Likewise, by building the source code, the build subsystem can generate one or more job specifications for executing the executable code. In one embodiment, the artifact and job specification may be used to launch an application server in a cluster. The application server can then receive data transformation instructions and execute the data transformation instructions.

Abstract: Systems and methods for simplified frontend processing and visualization of large datasets are provided. In example embodiments, a plurality of data objects are accessed. One or more of data objects from among the plurality of data objects are grouped into a first group. A group identifier that identifies data objects included in the first group is created. A visualization comprising a first node that represents the first group is generated. The first node is linked to the group identifier. The visualization is presented on a user interface of the user device. User input indication a user-specified action and the group identifier is received. The user-specified action is performed with the data objects identified by the group identifier.

Abstract: Systems and methods for providing full data provenance visualization for versioned datasets. A method includes receiving selection of a versioned dataset that is within a data pipeline system. The method also includes determining the full data provenance of the selected versioned dataset. The full data provenance may comprise a set of versioned datasets. The method further includes providing for display of a visualization of the full data provenance of the selected versioned dataset. The visualization comprises a graph. The graph comprises a compound node for the selected versioned dataset and for each versioned dataset in the set of versioned datasets. The graph further comprises edges connecting the compounds nodes. Each edge represents a derivation dependency between versions of the versioned datasets represented by the compound nodes connected by the edge.

Abstract: A catalog system automatically detects changes to configuration file at a service application. Based on the changes to the configuration file(s), the catalog system stores mapping data that identifies a resource item type that can be processed by the service application and one or more user actions that are available for processing resource items of the resource item type. The techniques thus provide for dynamic interaction with service applications.

Abstract: Systems and methods are provided for analyzing entity performance. In accordance with one implementation, a method is provided that includes receiving data associated with a geographic region and transforming the received data into an object model. The method also includes analyzing the object model to associate the received data with a plurality of entities and to associate the received data with a plurality of sub-geographic regions of the geographic region. The method also includes applying a prediction model to the plurality of sub-geographic regions using the object model to determine a predicted performance for at least one entity of the plurality of entities. Further, the method includes determining actual performance for the at least one entity and providing a user interface that includes information associated with the predicted performance, the actual performance, or a combination of the predicted performance and the actual performance.

Abstract: Embodiments of the present disclosure relate to a data analysis system that may automatically generate memory-efficient clustered data structures, automatically analyze those clustered data structures, and provide results of the automated analysis in an optimized way to an analyst. The automated analysis of the clustered data structures (also referred to herein as data clusters) may include an automated application of various criteria or rules so as to generate a compact, human-readable analysis of the data clusters. The human-readable analyses (also referred to herein as “summaries” or “conclusions”) of the data clusters may be organized into an interactive user interface so as to enable an analyst to quickly navigate among information associated with various data clusters and efficiently evaluate those data clusters in the context of, for example, a fraud investigation. Embodiments of the present disclosure also relate to automated scoring of the clustered data structures.

Abstract: Systems and methods are disclosed for data management and visualization. In accordance with one implementation, a method is provided that includes, for example, receiving data from one or more sources, the data being associated with a plurality of locations. The method also includes receiving, based on input from a user, a selection of a set of metrics for scoring each of the plurality of locations and a weight to assign to each metric. In addition, the method includes calculating an overall score for each of the plurality of locations based on the received data, the selected set of metrics, and the weight assigned to each metric.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for network risk assessment. One of the methods includes obtaining information describing network traffic between a plurality of network devices within a network. A network topology of the network is determined based on the information describing network traffic, with the network topology including nodes connected by an edge to one or more other nodes, and with each node being associated with one or more network devices. Indications of user access rights of users are associated to respective nodes included in the network topology. User interface data associated with the network topology is generated.

Abstract: Various systems and methods are provided that display schematics and data associated with the various physical components in the schematics in an interactive user interface. For example, a computing device links data stored in one or more databases with schematics displayed in one or more interactive user interfaces. The computing device parses a digital image that depicts a schematic and identifies text visible in the digital image. Based on the identified text, the computing device recognizes representations of one or more physical components in the schematic and links the representations to data regarding the physical component in one or more databases, such as specification data, historical sensor data of the component, etc. The computing device modifies the digital image such that it becomes interactive and visible in a user interface in a manner that allows the user to select a physical component and view data associated with the selection.

Abstract: Computer-implemented systems and methods are disclosed for providing proactive validations of transformation scripts. In one implementation, a method is provided that includes associating, with at least one processor, the transformation script with ontology parameters. The method also includes initiating a debugging operation of the transformation script having at least one condition and importing, from a data source, at least one data item for transformation. The method further includes determining, as part of the debugging operation, whether the at least one condition that uses the at least one data item is valid based on the ontology parameters and notifying a user, on a display device, of a result associated with the determination.

Abstract: Computer implemented systems and methods are disclosed for structuring data from unstructured electronic data files. In accordance with some embodiments, an electronic data file including unstructured content associated with a legal process return is received and the unstructured content parsed. The unstructured content is parsed to identify one or more objects and properties based on a database ontology that are processed to generate an object model. A data report may be generated based on the identified objects and properties.

Abstract: Techniques related to a domain-specific language for dataset transformations are disclosed. A server computer may process a table definition composed in a domain-specific language. The table definition may include a sequence of one or more dataset transformations to be performed on one or more source tables to generate a target table. The sequence may include a customized transformation. A source dataset may be provided as input to an implementation of the customized transformation. An output dataset may be generated as a result of executing the implementation. An intermediate table may be generated based on performing at least one dataset transformation on a particular source table. A supplemental portion for the intermediate table may be generated based on performing the at least one dataset transformation on an appended portion of the particular source table. The target table may be generated based on combining the supplemental portion with the intermediate table.

Abstract: Embodiments of the present disclosure relate to a data analysis system that may automatically generate memory-efficient clustered data structures, automatically analyze those clustered data structures, and provide results of the automated analysis in an optimized way to an analyst. The automated analysis of the clustered data structures (also referred to herein as data clusters) may include an automated application of various criteria or rules so as to generate a compact, human-readable analysis of the data clusters. The human-readable analyzes (also referred to herein as “summaries” or “conclusions”) of the data clusters may be organized into an interactive user interface so as to enable an analyst to quickly navigate among information associated with various data clusters and efficiently evaluate those data clusters in the context of, for example, a fraud investigation. Embodiments of the present disclosure also relate to automated scoring of the clustered data structures.

Abstract: A batching module that prepares a plurality of blocked expressions for batch evaluation. The plurality of blocked expressions comprises a plurality of expressions in a blocked state. The batching module divides the plurality of blocked expressions into one or more partitions. For each particular partition of the one or more partitions, a single batch processing call is dispatched to an application server to perform a batch evaluation.

Abstract: An interactive data object map system is disclosed in which large amounts of geographical, geospatial, and other types of data, geodata, objects, features, and/or metadata are efficiently presented to a user on a map interface. The interactive data object map system allows for rapid and deep analysis of various objects, features, and/or metadata by the user. A layer ontology may be displayed to the user. In various embodiments, when the user rolls a selection cursor over an object/feature an outline of the object/feature is displayed. Selection of an object/feature may cause display of metadata associated with that object/feature. The interactive data object map system may automatically generate feature/object lists and/or histograms based on selections made by the user. The user may perform geosearches, generate heatmaps, and/or perform keyword searches, among other actions.

Abstract: A history preserving data pipeline computer system and method. In one aspect, the history preserving data pipeline system provides immutable and versioned datasets. Because datasets are immutable and versioned, the system makes it possible to determine the data in a dataset at a point in time in the past, even if that data is no longer in the current version of the dataset.

Abstract: Computer implemented systems and methods are disclosed for importing data from electronic data files. In accordance with some embodiments, source electronic data files are received at a data importation system and managed by the data importation system. The data importation system may load detector/transformer plugins and determined whether any of the load detector/transformer plugins apply to the received source electronic data files. The data importation system may also generate transformed data using a transformer corresponding to a detector that applies to the source electronic data files. The data importation system may import the transformed data into at least one of a data analysis system and a database.

Abstract: Systems and methods are provided for facilitating the transformation of data from a tabular data set organized according to a data schema to an object based data set organized according to data ontology. The data schema and the data ontology may be used to generate a custom coding language suitable for facilitating the creation of a transform script. Error checking, type checking, autocomplete, and preview tools may be provided to permit the verification of the transform script as it is created.

Abstract: A tactical security system can be used to secure a room. For example, such a security system may be contained in a housing sized for shipment to a location for placement in a room in order to secure the room. Various components may be included in the housing, such as a storage device configured to store data received from one or more audio or video recording devices; an access controller configured to interface with a badge reader associated with one or more access points to the room in order to selectively control access to the room; a switch configured to couple the one or more audio or video recording devices with the storage device and to couple the badge reader with the access controller; and/or a power supply configured to supply power to the devices in the housing.