Abstract: A method and system for serving assets is disclosed, comprising receiving an asset request to serve an asset, wherein the asset request originates at an application, and wherein the asset request comprises an advertisement of an asset to be served and a request for the network address of an asset server configured to serve the requested asset. The method further comprises causing a service discovery server to identify an asset server configured to serve the requested asset, and causing the requested asset to be served to the application.

Abstract: A method comprises creating metadata identifying columns of tables and column operations of one or more data transforms of the columns in a data pipeline and including links to code segments in human-readable form corresponding to the one or more data transforms; executing a build job that effects the one or more data transforms on one or more datasets to generate one or more derived datasets; causing, after the executing, a presentation of a graphical user interface (GUI) including a graphical representation of the one or more data transforms based on the metadata, wherein the method is performed by one or more processors.

Abstract: A system comprises an interface and a processor. The interface is configured to provide a request to join a publish group from a client or a point to point communication link of a lattice mesh; and receive a group key or a host public key. The processor is configured to determine whether a message has been received; in response to the message having been received, determine whether the message is to be sent on; in response to the message being determined not to be sent on, decode the message using the group key or the host public key; determine whether to store the message in a backfill database; in response to determining to store the mssage in the backfill database, store the message in the backfill database.

Abstract: A system comprises an interface and a processor. The interface is configured to provide a request to join a publish group from a client or a point to point communication link of a lattice mesh; and receive a group key or a host public key. The processor is configured to determine whether a message has been received; in response to the message having been received, determine whether the message is to be sent on; in response to the message being determined not to be sent on, decode the message using the group key or the host public key; determine whether to store the message in a backfill database; in response to determining to store the message in the backfill database, store the message in the backfill database.

Abstract: Techniques for propagation of deletion operations among a plurality of related datasets are described herein.

Abstract: A computer-implemented method comprises obtaining a first build task for building first source code in a first programming language of a plurality of programming languages; retrieving, by the processor, the first source code based on the first build task; building the first source code into one or more artifacts and one or more job specifications; storing the one or more artifacts in a cache shared across a cluster; and initializing an application module on the cluster based on the first programming language, the application module configured to receive a job specification of the one or more job specifications and execute a data transformation job using a reference to a location in the cache.

Abstract: A system for planning an operation includes a communication interface and processor(s). The processor(s) is/are configured to: receive an indication that the drone is part of a set of assets, wherein the set of assets are tasked with performing element(s) of task(s), and the set of assets comprises a plurality of drones; communicate information pertaining to the element(s), wherein: 1) the information pertaining to the element(s) is communicated with at least one other drone; 2) the information pertaining to the element(s) is based at least in part on information obtained by sensor(s) of the set of assets; and 3) the information pertaining to the element(s) is used in connection with determining a plan to perform the task(s); and communicate information pertaining to the plan to perform the task(s), wherein the information pertaining to the plan to perform the task(s) is communicated with at least one other drone.

Abstract: A method and system for serving assets is disclosed, comprising receiving an asset request to serve an asset, wherein the asset request originates at an application, and wherein the asset request comprises an advertisement of an asset to be served and a request for the network address of an asset server configured to serve the requested asset. The method further comprises causing a service discovery server to identify an asset server configured to serve the requested asset, and causing the requested asset to be served to the application.

Abstract: A system generating an environment for an operation using a set of assets includes processor(s) configured to: obtain data associated with task(s) to be performed by a set of assets, wherein: 1) the set of assets comprises semi-autonomous drones and 2) the data associated with the task(s) comprises parameter(s) pertaining to a geographic location in which at least one asset is to perform the task(s); determine a discretized representation of the geographic location, wherein the discretized representation comprises discrete elements each corresponding to a volume associated with the geographic location; annotate the discretized representation to create an annotated representation with the parameter(s) pertaining to the geographic location with a subset of the discrete elements based on a determination that the parameter(s) pertain to the geographic location; determine a plan to perform the task(s), wherein the plan is based on the annotated representation; and cause the task(s) to be performed.

Abstract: A system and method for grouping assets is disclosed. The system includes one or more processors configured to: receive, via the communication interface, data associated with one or more tasks to be performed by a set of assets, determine, from among a plurality of assets, the set of assets to perform the one or more tasks, including determining one or more capabilities associated with one or more characteristics of the one or more tasks, and determining the plurality of drones based at least in part on the one or more capabilities associated with one or more characteristics of the one or more tasks, and one or more drone capabilities respectively associated with the drones, and communicate an instruction to at least one drone in the set of assets, the instruction indicating that the one or more tasks are to be completed by the at least one drone.

Abstract: A system for generating an environment for an operation using a set of assets includes processor(s) configured to obtain data associated with task(s) to be performed by a set of assets, wherein: 1) the set of assets comprises semi-autonomous drones and 2) the data associated with the task(s) comprises other drone flight plan(s); determine a discretized representation of the geographic location, wherein the discretized representation comprises discrete elements each corresponding to a volume associated with the geographic location; annotate the discretized representation with the other drone flight plan(s) to create an annotated representation; determine a first flight plan of one drone, wherein the first flight plan is determined based on the annotated representation; and communicate information pertaining to the first flight plan to at least one other asset.

Abstract: A system for asset failure and replacement management is disclosed. The system includes a communication interface and processor(s) configured to: receive an indication that the drone is part of a set of assets, wherein the set of assets are tasked with performing element(s) of task(s), and the set of assets comprises a plurality of drones; determine that at least one drone has experienced a failure; in response to a determination that the at least one drone has experienced the failure, update a plan to an updated plan to perform the task(s); and communicate, via the communication interface, information pertaining to the updated plan, wherein the information pertaining to the updated plan is communicated with at least one remaining drone of the set of assets.

Abstract: A system defining an operation using a set of assets is disclosed. A processor(s) is/are configured to: cause a first user interface to be displayed, the first user interface comprising selectable element(s) associated with a characteristic of task(s) to be performed; receive user selection(s) pertaining to the characteristic; in response to receiving the user selection(s) input to the first interface, cause a second user interface to be displayed, wherein: 1) the second user interface is configured based on user selection(s); and 2) the second user interface comprises selectable element(s) associated with a set of asset(s) that include drone(s); receive user selection(s) for an operation; determine the operation to be performed based on (i) the user selection(s) pertaining to the characteristic of the task(s) and (ii) the user selection(s) pertaining to the set of asset(s) to perform the operation; and communicate information pertaining to the operation.

Abstract: Computer-implemented techniques for data extraction are described. The techniques include a method and system for retrieving an extraction job specification, wherein the extraction job specification comprises a source repository identifier that identifies a source repository comprising a plurality of data records; a data recipient identifier that identifies a data recipient; and a schedule that indicates a timing of when to retrieve the plurality of data records. The method and system further include retrieving the plurality of data records from the source repository based on the schedule, creating an extraction transaction from the plurality of data records, wherein the extraction transaction comprises a subset of the plurality of data records and metadata, and sending the extraction transaction to the data recipient.

Abstract: Data transformation in a distributed system of applications and data repositories is described. The subsystems for the overall framework are distributed, thereby allowing for customization to require only isolated changes to one or more subsystems. In one embodiment, a source code repository is used to receive and store source code. A build subsystem can retrieve source code from the source code repository and build it, using one or more criteria. By building the source code, the build subsystem can generate an artifact, which is executable code, such as a JAR or SQL file. Likewise, by building the source code, the build subsystem can generate one or more job specifications for executing the executable code. In one embodiment, the artifact and job specification may be used to launch an application server in a cluster. The application server can then receive data transformation instructions and execute the data transformation instructions.

Abstract: A method and system for serving assets is disclosed, comprising receiving an asset request to serve an asset, wherein the asset request originates at an application, and wherein the asset request comprises an advertisement of an asset to be served and a request for the network address of an asset server configured to serve the requested asset. The method further comprises causing a service discovery server to identify an asset server configured to serve the requested asset, and causing the requested asset to be served to the application.

Abstract: A system comprises an interface and a processor. The interface is configured to provide a request to join a publish group from a client or a point to point communication link of a lattice mesh; and receive a group key or a host public key. The processor is configured to determine whether a message has been received; in response to the message having been received, determine whether the message is to be sent on; in response to the message being determined not to be sent on, decode the message using the group key or the host public key; determine whether to store the message in a backfill database; in response to determining to store the mssage in the backfill database, store the message in the backfill database.

Abstract: Techniques for propagation of deletion operations among a plurality of related datasets are described herein.

Abstract: A system comprises an interface and a processor. The interface is configured to provide a request to join a publish group from a client or a point to point communication link of a lattice mesh; and receive a group key or a host public key. The processor is configured to determine whether a message has been received; in response to the message having been received, determine whether the message is to be sent on; in response to the message being determined not to be sent on, decode the message using the group key or the host public key; determine whether to store the message in a backfill database; in response to determining to store the message in the backfill database, store the message in the backfill database.

Abstract: A system comprises an interface and a processor. The interface is configured to provide a request to join a publish group from a client or a point to point communication link of a lattice mesh; and receive a group key or a host public key. The processor is configured to determine whether a message has been received; in response to the message having been received, determine whether the message is to be sent on; in response to the message being determined not to be sent on, decode the message using the group key or the host public key; determine whether to store the message in a backfill database; in response to determining to store the message in the backfill database, store the message in the backfill database.