Abstract: A system for generating an environment for an operation using a set of assets includes processor(s) configured to obtain data associated with task(s) to be performed by a set of assets, wherein: 1) the set of assets comprises semi-autonomous drones and 2) the data associated with the task(s) comprises other drone flight plan(s); determine a discretized representation of the geographic location, wherein the discretized representation comprises discrete elements each corresponding to a volume associated with the geographic location; annotate the discretized representation with the other drone flight plan(s) to create an annotated representation; determine a first flight plan of one drone, wherein the first flight plan is determined based on the annotated representation; and communicate information pertaining to the first flight plan to at least one other asset.

Abstract: A method of determining and displaying metadata that represents provenance of columns in a data store comprises receiving query data expressed in a human-readable language and describing one or more transformations of data tables of a distributed database system or columns of the data tables; parsing the query data to create a data structure for unresolved transforms in which the data tables are not matched with the columns; based in part upon table schema metadata describing the columns of the data tables, creating an additional data structure for resolved transforms, the additional data structure matching the data tables with the columns and specifying inputs and outputs of each transformation of the one or more transformations; based on information in the additional data structure, creating and causing display of a visual graph of the columns of the data tables and relationships between the columns, relating to the one or more transformations.

Abstract: A system for planning an operation includes a communication interface and processor(s). The processor(s) is/are configured to: receive an indication that the drone is part of a set of assets, wherein the set of assets are tasked with performing element(s) of task(s), and the set of assets comprises a plurality of drones; communicate information pertaining to the element(s), wherein: 1) the information pertaining to the element(s) is communicated with at least one other drone; 2) the information pertaining to the element(s) is based at least in part on information obtained by sensor(s) of the set of assets; and 3) the information pertaining to the element(s) is used in connection with determining a plan to perform the task(s); and communicate information pertaining to the plan to perform the task(s), wherein the information pertaining to the plan to perform the task(s) is communicated with at least one other drone.

Abstract: A system generating an environment for an operation using a set of assets includes processor(s) configured to: obtain data associated with task(s) to be performed by a set of assets, wherein: 1) the set of assets comprises semi-autonomous drones and 2) the data associated with the task(s) comprises parameter(s) pertaining to a geographic location in which at least one asset is to perform the task(s); determine a discretized representation of the geographic location, wherein the discretized representation comprises discrete elements each corresponding to a volume associated with the geographic location; annotate the discretized representation to create an annotated representation with the parameter(s) pertaining to the geographic location with a subset of the discrete elements based on a determination that the parameter(s) pertain to the geographic location; determine a plan to perform the task(s), wherein the plan is based on the annotated representation; and cause the task(s) to be performed.

Abstract: A system comprises an interface and a processor. The interface is configured to provide a request to join a publish group from a client or a point to point communication link of a lattice mesh; and receive a group key or a host public key. The processor is configured to determine whether a message has been received; in response to the message having been received, determine whether the message is to be sent on; in response to the message being determined not to be sent on, decode the message using the group key or the host public key; determine whether to store the message in a backfill database; in response to determining to store the message in the backfill database, store the message in the backfill database.

Abstract: A system generating an environment for an operation using a set of assets includes processor(s) configured to: obtain data associated with task(s) to be performed by a set of assets, wherein: 1) the set of assets comprises semi-autonomous drones and 2) the data associated with the task(s) comprises parameter(s) pertaining to a geographic location in which at least one asset is to perform the task(s); determine a discretized representation of the geographic location, wherein the discretized representation comprises discrete elements each corresponding to a volume associated with the geographic location; annotate the discretized representation to create an annotated representation with the parameter(s) pertaining to the geographic location with a subset of the discrete elements based on a determination that the parameter(s) pertain to the geographic location; determine a plan to perform the task(s), wherein the plan is based on the annotated representation; and cause the task(s) to be performed.

Abstract: A method comprises creating metadata identifying columns of tables and column operations of one or more data transforms of the columns in a data pipeline and including links to code segments in human-readable form corresponding to the one or more data transforms; executing a build job that effects the one or more data transforms on one or more datasets to generate one or more derived datasets; causing, after the executing, a presentation of a graphical user interface (GUI) including a graphical representation of the one or more data transforms based on the metadata, wherein the method is performed by one or more processors.

Abstract: A computer-implemented method comprises obtaining a first build task for building first source code in a first programming language of a plurality of programming languages; retrieving, by the processor, the first source code based on the first build task; building the first source code into one or more artifacts and one or more job specifications; storing the one or more artifacts in a cache shared across a cluster; and initializing an application module on the cluster based on the first programming language, the application module configured to receive a job specification of the one or more job specifications and execute a data transformation job using a reference to a location in the cache.

Abstract: A method and system for serving assets is disclosed, comprising receiving an asset request to serve an asset, wherein the asset request originates at an application, and wherein the asset request comprises an advertisement of an asset to be served and a request for the network address of an asset server configured to serve the requested asset. The method further comprises causing a service discovery server to identify an asset server configured to serve the requested asset, and causing the requested asset to be served to the application.

Abstract: A method comprises creating metadata identifying columns of tables and column operations of one or more data transforms of the columns in a data pipeline and including links to code segments in human-readable form corresponding to the one or more data transforms; executing a build job that effects the one or more data transforms on one or more datasets to generate one or more derived datasets; causing, after the executing, a presentation of a graphical user interface (GUI) including a graphical representation of the one or more data transforms based on the metadata, wherein the method is performed by one or more processors.

Abstract: A system comprises an interface and a processor. The interface is configured to provide a request to join a publish group from a client or a point to point communication link of a lattice mesh; and receive a group key or a host public key. The processor is configured to determine whether a message has been received; in response to the message having been received, determine whether the message is to be sent on; in response to the message being determined not to be sent on, decode the message using the group key or the host public key; determine whether to store the message in a backfill database; in response to determining to store the mssage in the backfill database, store the message in the backfill database.

Abstract: A system comprises an interface and a processor. The interface is configured to provide a request to join a publish group from a client or a point to point communication link of a lattice mesh; and receive a group key or a host public key. The processor is configured to determine whether a message has been received; in response to the message having been received, determine whether the message is to be sent on; in response to the message being determined not to be sent on, decode the message using the group key or the host public key; determine whether to store the message in a backfill database; in response to determining to store the message in the backfill database, store the message in the backfill database.

Abstract: Techniques for propagation of deletion operations among a plurality of related datasets are described herein.

Abstract: A computer-implemented method comprises obtaining a first build task for building first source code in a first programming language of a plurality of programming languages; retrieving, by the processor, the first source code based on the first build task; building the first source code into one or more artifacts and one or more job specifications; storing the one or more artifacts in a cache shared across a cluster; and initializing an application module on the cluster based on the first programming language, the application module configured to receive a job specification of the one or more job specifications and execute a data transformation job using a reference to a location in the cache.

Abstract: A system for planning an operation includes a communication interface and processor(s). The processor(s) is/are configured to: receive an indication that the drone is part of a set of assets, wherein the set of assets are tasked with performing element(s) of task(s), and the set of assets comprises a plurality of drones; communicate information pertaining to the element(s), wherein: 1) the information pertaining to the element(s) is communicated with at least one other drone; 2) the information pertaining to the element(s) is based at least in part on information obtained by sensor(s) of the set of assets; and 3) the information pertaining to the element(s) is used in connection with determining a plan to perform the task(s); and communicate information pertaining to the plan to perform the task(s), wherein the information pertaining to the plan to perform the task(s) is communicated with at least one other drone.

Abstract: A method and system for serving assets is disclosed, comprising receiving an asset request to serve an asset, wherein the asset request originates at an application, and wherein the asset request comprises an advertisement of an asset to be served and a request for the network address of an asset server configured to serve the requested asset. The method further comprises causing a service discovery server to identify an asset server configured to serve the requested asset, and causing the requested asset to be served to the application.

Abstract: A system for generating an environment for an operation using a set of assets includes processor(s) configured to obtain data associated with task(s) to be performed by a set of assets, wherein: 1) the set of assets comprises semi-autonomous drones and 2) the data associated with the task(s) comprises other drone flight plan(s); determine a discretized representation of the geographic location, wherein the discretized representation comprises discrete elements each corresponding to a volume associated with the geographic location; annotate the discretized representation with the other drone flight plan(s) to create an annotated representation; determine a first flight plan of one drone, wherein the first flight plan is determined based on the annotated representation; and communicate information pertaining to the first flight plan to at least one other asset.

Abstract: A system for asset failure and replacement management is disclosed. The system includes a communication interface and processor(s) configured to: receive an indication that the drone is part of a set of assets, wherein the set of assets are tasked with performing element(s) of task(s), and the set of assets comprises a plurality of drones; determine that at least one drone has experienced a failure; in response to a determination that the at least one drone has experienced the failure, update a plan to an updated plan to perform the task(s); and communicate, via the communication interface, information pertaining to the updated plan, wherein the information pertaining to the updated plan is communicated with at least one remaining drone of the set of assets.

Abstract: A system defining an operation using a set of assets is disclosed. A processor(s) is/are configured to: cause a first user interface to be displayed, the first user interface comprising selectable element(s) associated with a characteristic of task(s) to be performed; receive user selection(s) pertaining to the characteristic; in response to receiving the user selection(s) input to the first interface, cause a second user interface to be displayed, wherein: 1) the second user interface is configured based on user selection(s); and 2) the second user interface comprises selectable element(s) associated with a set of asset(s) that include drone(s); receive user selection(s) for an operation; determine the operation to be performed based on (i) the user selection(s) pertaining to the characteristic of the task(s) and (ii) the user selection(s) pertaining to the set of asset(s) to perform the operation; and communicate information pertaining to the operation.

Abstract: A system and method for grouping assets is disclosed. The system includes one or more processors configured to: receive, via the communication interface, data associated with one or more tasks to be performed by a set of assets, determine, from among a plurality of assets, the set of assets to perform the one or more tasks, including determining one or more capabilities associated with one or more characteristics of the one or more tasks, and determining the plurality of drones based at least in part on the one or more capabilities associated with one or more characteristics of the one or more tasks, and one or more drone capabilities respectively associated with the drones, and communicate an instruction to at least one drone in the set of assets, the instruction indicating that the one or more tasks are to be completed by the at least one drone.