Abstract: A computer system provides shared access to electronic data assets. The system may perform operations including: receiving, from a first user, a request to access a shared data asset, wherein: the shared data asset is associated with a shared data asset object, and the shared data asset object identifies at least a second user authorized to approve sharing of the shared data asset; in response to receiving the request from the first user: generating a data access request object including at least an identification of the first user and an identification of the shared data asset object; and providing an indication of the data access request object to the second user associated with the shared data asset object; receiving, from the second user, an approval of the request; and in response to receiving the approval of the request from the second user: granting the first user access to the shared data asset associated with the shared data asset object.

Abstract: The present disclosure provides a method for reporting a movement path and an electronic device. The method is applied to an intelligent locator and includes receiving, a movement path acquisition request sent by a reporting device within a reporting time threshold; acquiring a movement path including at least one piece of unreported location information from a database; and sending the movement path to the reporting device.

Abstract: A method of creating a dimension table or a fact table for a data warehouse includes accessing an ordered sequence of activities that are arranged in a template. A first set of code associated with creating the dimension table is organized into a dimension processing class, a second set of code associated with creating the fact table is organized into a fact processing class, and a third set of code associated with creating both the dimension table and the fact table is organized into a common processing class. The method further includes executing the ordered sequence of activities and creating the dimension table when an instance of the dimension processing class is created in the ordered sequence of activities and creating the fact table when an instance of the fact processing class is created in the ordered sequence of activities.

Abstract: A method of generating and storing metadata in a data processing system includes defining metadata sets of process definition metadata based on a process definition of the data processing system. The metadata sets include a first set of metadata corresponding to a processing step of the data processing system, a second set of metadata corresponding to a processing step successor, and a third set of metadata corresponding to a data object that is produced or consumed by the processing step in the data processing system. The method further includes executing one or more steps of the data processing system according to the process definition and generating runtime metadata during an execution of the one or more data processing system steps. The method further includes storing the runtime metadata and forming a metadata data store that integrates the runtime metadata and the metadata sets of process definition metadata.

Abstract: A method, system, and computer system for performing an operation with respect to a target table are disclosed. The method includes performing first and second jobs, obtaining one or more other resulting files based at least in part on unmatched rows, and obtaining a set of processed files based at least in part on performing a post-processing operation with respect to the set of resulting files. The set of processed files has less files than the set of resulting files. Performing the first job includes determining a set of matching target table files and storing target table information indicating for each of the set of matching target table files, a particular set of rows having matching rows. Performing the second job includes performing a matching action based on matched rows and obtaining the second job resulting file(s).

Abstract: An information handling system may include at least one processor and a memory. The information handling system may be configured to: receive an instruction to join an information handling system cluster; deploy at least one prerequisite service from the information handling system to the information handling system cluster; and cause a master node of the information handling system cluster to join the information handling system to the information handling system cluster.

Abstract: An embodiment of the present invention is directed to a Metadata-Driven Data Quality Framework and Engine that enables dynamic generation of code for assessing data quality based on qualified metadata content. The Data Quality Framework may be directed to an enterprise scaled application that embodies Data Quality disciplines for good/optimal Data Governance. An embodiment of the present invention may be integrated into a Metadata Management process of an overall Data Governance Program so the data user's meaning and understanding may become part of the automated data quality process.

Abstract: A method, system, and computer system for performing an operation with respect to a target table are disclosed. The method includes performing first and second jobs, and persist, in one or more deletion vector files, one or more deletion vectors for corresponding rows of the one or more target table files, and obtaining a resulting table based at least in part on the second job resulting file(s). Performing the first job includes determining a set of matching target table files and storing target table information indicating for each of the set of matching target table files, a particular set of rows having matching rows. Performing the second job includes performing a matching action based on matched rows and one or more deletion of vectors associated with previously removed rows of the matching target table files and obtaining the second job resulting file(s).

Abstract: In a computer-implemented method for transformation of inconsistent environmental data, environmental data is received from a plurality of data sources, wherein each data source of the plurality of data sources is associated with a geographic region and maintains the environmental data using at least one data format of a plurality of disparate data formats, such that the environmental data is received in the plurality of disparate data formats. The environmental data is transformed from the plurality of disparate data formats into a consistent data format, such that the transformed environmental data is in a standardized format capable of direct comparison and analysis. The transformed environmental data is stored in a database configured to receive and perform searches on the transformed environmental data.

Abstract: Systems and methods are provided for replicating data between different services used to update databases. One example system includes a database and a computing device coupled in communication with the database, wherein the computing device is configured to perform a create, update or delete operation on the data included in the database and to post an entry representative of the operation to an outbox data structure. The computing device is also configured to retrieve the entry from the outbox data structure; publish the entry as a first message to a message bus, thereby informing a different data system of the operation in the database; receive a second message from the message bus indicative of a create, update or delete operation at a database included in a different data system; and direct a service of the system to perform the create, update or delete operation of the second message.

Abstract: Methods, systems, and computer programs are presented for providing performance metrics in an online performance analysis system employing customer production workloads. A plurality of metric source data is received from a cloud data platform. A workload is identified as a stable workload candidate based at least in part on the plurality of metric source data. The cloud data platform generates a performance index based on the workload being identified as a stable workload candidate. The performance index is tracked over a period of time to identify changes in workload.

Abstract: A cloud-based write-once object store is configured to store inode-based data exported to the store from an enterprise file system. For each version of data (e.g., a file) exported to the store, there is a version of the inode corresponding to that data. As versions of the data are exported to the cloud, the system creates multiple versions of the inode. The set of inode versions corresponding to the versions of the file have a pointer associated therewith that specifies the latest version of the data associated with the inode. The inode versions in the set share the same pointer. The inode versions represent a revision history for the inode. For each inode version corresponding to a version of the data, information is received and stored in a new portion of the object store. The inode version for a file version comprises a list of data chunks for the file.

Abstract: Computations in Artificial neural networks (ANNs) are accomplished using simple processing units, called neurons, with data embodied by the connections between neurons, called synapses, and by the strength of these connections, the synaptic weights. Crossbar arrays may be used to represent one layer of the ANN with Non-Volatile Memory (NVM) elements at each crosspoint, where the conductance of the NVM elements may be used to encode the synaptic weights, and a highly parallel current summation on the array achieves a weighted sum operation that is representative of the values of the output neurons. A method is outlined to transfer such neuron values from the outputs of one array to the inputs of a second array with no need for global clock synchronization, irrespective of the distances between the arrays, and to use such values at the next array, and/or to convert such values into digital bits at the next array.

Abstract: Compiling a database query including receiving, by a query compiler from a client computing system, a state specification of a graphical user interface comprising a worksheet, wherein the worksheet is a presentation of a data set from a data warehouse; converting, by the query compiler, the state specification into a database query including determining a first order of operations for elements within the state specification; and sending the database query to the data warehouse.

Abstract: Methods, systems, and computer-readable storage media for receiving a query request including authorization data and a query, the authorization data indicating a privilege level index, determining a set of row ranges based on the privilege level index and a row range table, the set of row ranges including one or more row ranges having a privilege level associated therewith in the row range table, providing an initial results set including one or more records of a data table that are determined to be responsive, determining a final results set including at least one record of the initial results set, the at least one record being included in the final results set in response to determining that the at least one record is included in a row range of the set of row ranges, and outputting the final results set as at least a portion of a query result.

Abstract: Systems and methods are described for unified processing of indexed and streaming data. A system enables users to query indexed data or specify processing pipelines to be applied to streaming data. In some instances, a user may specify a query intended to be run against indexed data, but may specify criteria that includes not-yet-indexed data (e.g., a future time frame). The system may convert the query into a data processing pipeline applied to not-yet-indexed data, thus increasing the efficiency of the system. Similarly, in some instances, a user may specify a data processing pipeline to be applied to a data stream, but specify criteria including data items outside the data stream. For example, a user may wish to apply the pipeline retroactively, to data items that have already exited the data stream. The system can convert the pipeline into a query against indexed data to satisfy the users processing requirements.

Abstract: The subject matter described herein provides techniques to ensure that queries of a distributed database observe a consistent read of the database without locking or logging. In this regard, next-write timestamps uniquely identify a set of write transactions whose updates can be observed by reads. By publishing the next-write timestamps from within an extendable time lease and tracking a “safe timestamp,” the database queries can be executed without logging read operations or blocking future write transactions, and clients issuing the queries at the “safe timestamp” observe a consistent view of the database as it exists on or before that timestamp. Aspects of this disclosure also provide for extensions, done cheaply and without the need for logging, to the range of timestamps at which read transactions can be executed.

Abstract: Disclosed herein are system, method, and computer program product embodiments for non-blocking backup for tertiary initialization in a log replay only node. An embodiment operates by performing a standard log replay on a secondary server and briefly suspending the standard log replay in response to tertiary initialization. Further, the secondary server may determine backup block information and perform a page-aligned backup process from the secondary server to a tertiary server. Additionally, the secondary server may determine log replay block information, and perform a modified log replay concurrently with the backup process based on the backup block information.

Abstract: A method, apparatus and device for deleting a distributed system file, and a storage medium, comprising: querying whether an incomplete file deletion operation exists under a sub-tree root corresponding to a certain MDS (S102); if there is an incomplete file deletion operation, continuing to delete data under the sub-tree root corresponding to the MDS, and determining whether the sub-tree root is a copy (S103); and if the sub-tree root is a copy, deleting the sub-tree root copy in a memory of the MDS (S104). By means of the steps, the number of copies of the sub-tree root in the distributed file system can be reduced, thereby reducing the number of interaction times of master copy locking between different MDSs, improving the file deletion efficiency, and improving user friendliness and differentiated competitiveness of a product.

Abstract: The application is directed to techniques, devices, and systems for updating files. For example, a remote system may store first data representing a first version of a file and second data representing a second version of the file. The remote system may then determine that a first portion of the first data corresponds to a first portion of the second data. Based at least in part on the determination, the remote system may identify a second portion of the first data using the first portion of the first data and identify a second portion of the second data using the first portion of the second data. The remote system may then generate third data representing a difference between the second portion of the second data and the second portion of the first data. Additionally, the remote system may store the third data in association with the file.