Abstract: In some examples, a computing device determines a data manipulation from a job specification. The device determines a corresponding data-processing instruction using data-source metadata, and determines and executes a corresponding query. In some examples, a device receives search keys. The device searches data-source metadata using the search keys. The device weights a first data source based on producer-consumer relationships between data sources, and ranks the first data source using the weight. In some examples, a device determines structural and content information of a data record. The device determines a data-source identifier from the structural information and stores the content information with the data-source identifier in a database. In some examples, via a user interface, a device receives a job specification and annotation data. The device stores the spec and the annotation data in a metadata repository.

Abstract: Data assets, such as streams, databases, spreadsheets, or other data sources or types, are identified and representations of the data asset are stored. The representation of a data asset includes a schema used by the data asset, a location of the data asset, and keywords or other descriptive information. The representations of each data asset are indexed, and a search interface is provided that allows users to search for relevant data assets. In addition, dependencies, or other relationship information, among the various data assets is maintained and is used to generate a graph that shows the interrelatedness of the data assets. The graph can be explored by users to select data assets, and used to alert users when a change has been made to a data asset that may affect a data asset that they have used.

Abstract: Data assets, such as streams, databases, spreadsheets, or other data sources or types, are identified and representations of the data asset are stored. The representation of a data asset includes a schema used by the data asset, a location of the data asset, and keywords or other descriptive information. The representations of each data asset are indexed, and a search interface is provided that allows users to search for relevant data assets. In addition, dependencies, or other relationship information, among the various data assets is maintained and is used to generate a graph that shows the interrelatedness of the data assets. The graph can be explored by users to select data assets, and used to alert users when a change has been made to a data asset that may affect a data asset that they have used.

Abstract: In some examples, a computing device determines a data manipulation from a job specification. The device determines a corresponding data-processing instruction using data-source metadata, and determines and executes a corresponding query. In some examples, a device receives search keys. The device searches data-source metadata using the search keys. The device weights a first data source based on producer-consumer relationships between data sources, and ranks the first data source using the weight. In some examples, a device determines structural and content information of a data record. The device determines a data-source identifier from the structural information and stores the content information with the data-source identifier in a database. In some examples, via a user interface, a device receives a job specification and annotation data. The device stores the spec and the annotation data in a metadata repository.

Abstract: Many current computer software platforms support user customization and version upgradability. Unfortunately, upgrading a computer software platform may result in significant loss of user customization data. Additionally, it may be advantageous for users to export and import their customization data to share as customized business solutions with other instances of the computer software platforms. Accordingly, a technique for creating and importing a configuration package and a technique for creating and utilizing an update package is disclosed herein. The configuration package allows configuration data of elements within a computer software platform to be exported and imported. The update package allows elements to be exported within the update package. The update package may be utilized in upgrading, overwriting, and/or creating a new instance of elements. When an existing element is upgraded with an update element within the update package, the existing element's original configuration may be retained.

Abstract: Many current computer software platforms support user customization and version upgradability. Unfortunately, upgrading a computer software platform may result in significant loss of user customization data. Additionally, it may be advantageous for users to export and import their customization data to share as customized business solutions with other instances of the computer software platforms. Accordingly, a technique for creating and importing a configuration package and a technique for creating and utilizing an update package is disclosed herein. The configuration package allows configuration data of elements within a computer software platform to be exported and imported. The update package allows elements to be exported within the update package. The update package may be utilized in upgrading, overwriting, and/or creating a new instance of elements. When an existing element is upgraded with an update element within the update package, the existing element's original configuration may be retained.

Abstract: Method and system for recovering information from open files during a failure in a program module. Once a failure is detected in the program module, control passes to an exception handler that determines whether the open files have been modified. If so, the open files are verified and stored as recovery versions of the files at the time of the failure. The program module is then terminated and restarted. Upon restarting the program module, the recovery version of the file at the time of the failure is opened and displayed to the user.