Abstract: Systems and methods herein describe embodiments for handling a data drift. An example system accesses the data pipeline, which is comprised of a plurality of stages. For each stage of the plurality of stages in the data pipeline, the system identifies stage schema fields for processing data in the data pipeline and generates a set of stage schema fields comprising the identified stage schema fields in the stage. In response to detecting an origin stage, the system generates a set of pipeline schema fields, whereby the set of pipeline schema fields comprise a union of the generated sets of stage schema fields. The set of pipeline schema fields are then stored.

Abstract: Techniques for database normalization recommendation and transparent database normalization are described. A normalization engine can analyze the data stored by database tables to determine scenarios in which normalization of the tables may be beneficial. The normalization engine can recommend normalization to an end user, such as during a database migration process. The normalization engine can alternatively perform row-by-row or complete columnar normalization and cause queries issued against normalized tables based on the previous table schema to be automatically rewritten to adhere to the updated data layout.

Abstract: Cloud storage provides accessible interfaces, near-instant elasticity, scalability, multi-tenancy, and metered resources in a distributed framework providing fault tolerant solutions with high data durability. Stored data may have legal or compliance requirements defining retention periods ensuring the data is preserved without modification for a period of time. However, data privacy rules such as the European Union's General Data Protection Regulation can require modification or destruction of records at any point. Further, many retention structures are user driven but users make mistakes requiring a change to the record's associated retention period. Retention period mechanism enforced with immutable storage can satisfy compliance requirements but run contrary to data privacy rules as well as blocking adjustments.

Abstract: A blockchain based data management method performed by a computing device according to an embodiment of the present disclosure includes recording a deletion event for off-chain data and time information of the deletion event in a blockchain network, and selectively deleting the off-chain data based on a validity verification result calculated for the time information, wherein the validity verification result is calculated using a time-consensus algorithm of the blockchain network.

Abstract: Documents needing to be analyzed for various reasons, such as financial crimes, are ranked by examining the topicality and sentiment present in each document for a given subject of interest. In one approach a given document is classified to determine its category, and entity recognition is used to identify the subject of interest. Passages from the document that relate to the entity are grouped and analyzed for sentiment to generate a sentiment score. Documents are then ranked based on the sentiment scores. In another approach, a classification probability score is computed for each passage representing a likelihood that the passage relates to a category of interest, and the document is ranked based on the sentiment scores and the classification probability scores. The category classification uses an ensemble of natural language text classifiers. One of the classifiers is a naïve Bayes classifier with feature vectors generated using Word2Vec modeling.

Abstract: Systems and methods are provided for a supply knowledge portal. The supply knowledge portal provides a new metric dashboard that delivers real-time information on the status and health of the hospital supply chain. The new dashboard is driven by the transactional data generated from system point of use devices and allows end users to view data at various levels starting at the facility level and moving down to filter for specific areas, devices and, at the lowest level, items.

Abstract: The invention discloses a processing method for process changing time-series database table structure, wherein comprising following steps: an application side generates a data table containing a table name ID, a schema version, and a column ID; when a data column is increased, the application side modifies a schema of the data table, increases the schema version, assigns a new column ID number to a newly increased column incrementally, and assigns a default value to the newly increased column; according to a data insertion request of the application side, a data node receives data of a schema version carrying a data table from the application side and writes the received data, wherein writing the received data comprises: storing the schema version of the data table carried by data from the application side by the data node, and writing the received data, and writing the received data; when the data node receives new data from the application side, comparing the schema version of the data table carried by the

Abstract: Methods, systems and computer readable storage medium for updating a search engine (SE) version of a repository, the SE version of the repository maintained by a search engine system and corresponding to an SCM version of the repository maintained by an SCM system.

Abstract: Methods, systems, and computer-readable media for auto-scaling using temporal splits in a time-series database are disclosed. One or more stream processors of a time-series database write time-series data of a plurality of time series into a plurality of two-dimensional tiles, including an individual tile representing spatial boundaries and temporal boundaries. The heat of time-series data written to the individual tile exceeds a threshold. The current time is compared to the temporal boundaries, and the comparison indicates that the current time is beyond a threshold point within the temporal boundaries. Based at least in part on the comparison, a split is performed of the individual tile into a first new tile and a second new tile. The first new tile represents the spatial boundaries and a first portion of the temporal boundaries, and the second new tile represents the spatial boundaries and a second portion of the temporal boundaries.

Abstract: A cloud tethering subsystem is configured to ship snapshots of an application production storage group to a cloud repository. Dynamic storage group resizing operations are allowed on the application production storage group after creation of a snapshot and before transmission of the snapshot to the cloud, or while the snapshot is accessing data of the application production storage group in connection with shipping the snapshot to the cloud. Example dynamic storage group resizing operations include adding one or more volumes to the application production storage group, removing one or more volumes from the application production storage group, and resizing one or more of the volumes of the application production storage group. The cloud tethering subsystem maintains information about the size of the snapshot at the time of creation and uses the snapshot size to prevent dynamic storage group resizing operations from interfering with cloud snapshot shipping operations.

Abstract: Systems and methods include reception of an indication of a first data object to transmit from a first database tenant to a second database tenant, the first data object comprising user configuration settings metadata of a database application and associated with a first data object type, determination of whether a dependent data object may be associated with a data object of the first data object type, determination, if it is determined that a dependent data object may be associated with a data object of the first data object type, of whether a dependent object is dependent on the first data object, and automatic determination, if it is determined that a dependent object is dependent on the first data object, to transmit the dependent object from the first database tenant to the second database tenant.

Abstract: A method for enabling data set changes to be reverted to a prior point in time or state is disclosed. In one embodiment, such a method includes providing a data set comprising one or more data elements and a specified number of generations of the data elements. In certain embodiments, the data set is a partitioned data set extended (PDSE) data set, and the data elements are “members” within the PDSE data set. The method further includes tracking changes made by a job to data elements of the data set. The method further references, in a data structure (also referred to herein as a “cluster”) associated with the job, previous generations of the data elements changed by the job. In certain embodiments, the data structure is stored in the data set. A corresponding system and computer program product are also disclosed.

Abstract: An automated command assistance tool is provided for a browser-enabled command line interface of a cloud service. The automated command assistance tool provides examples illustrating the correct syntax for commands used to manage the resources of a cloud service. The command assistance tool learns the syntax of a command from usage patterns found in telemetric data, scripts and user documentation and forms templates containing a command's usage pattern and related information. The templates are used to generate examples that respond to a user query for assistance with usage of a particular command.

Abstract: The present disclosure involves systems, software, and computer implemented methods for improved design and implementation of data access metrics for automated physical database design. An example method includes identifying a database workload for which index advisor access counters are to be tracked. Each SQL statement in the database workload is executed. For each SQL statement, attribute sets are determined for which a selection predicate filters a result for an SQL statement. An output cardinality of each selection predicate is determined. A logarithmic counter for an attribute set corresponding to the selection predicate is determined based on the output cardinality of the selection predicate. The determined logarithmic counter is incremented. Respective values for logarithmic counters of the determined attributes are provided to an index advisor. The index advisor determines attribute sets for which to propose an index based on the logarithmic counters of the respective attribute sets.

Abstract: Methods, systems, and apparatus include computer programs encoded on a computer-readable storage medium, including a method for providing content. Co-located devices are identified, including first and second devices associated with first and second users. A determination is made that a device is configured to be viewable by multiple users based on device characteristics. Use data is gathered that is associated with current sessions associated with users related to their use of their respective devices, including first data related to the use of the first device and second data related to the use of the second device. The first and second data are aggregated and evaluated to identify a first content item to present on the first device. Second different content items are selected for display on other co-located devices based at least in part on the first content item.

Abstract: A database service that receives and manages data into columnar databases. Individual columnar databases or columnar database partitions are associated with a dictionary that provides an encoding for the data in the columnar database. The database service generates count information for the dictionary entries. The database service also maintains one or more augmented dictionary values that correspond to featurization criteria. The database service applies the augmented dictionary values to respond to requests for feature data.

Abstract: Disclosed are various embodiments for generating an index. A computing device provides a location of a requested file to a client device in response to receiving a search query of a master index from the client device. The computing device updates the master index with index data associated with the requested file, wherein the index data associated with the requested file is received from the client device.

Abstract: Syntax parsing on a SQL statement is performed to determine whether an extended syntax identifier exists in the SQL statement, where the extended syntax identifier indicates a target computing service for the SQL statement. It is determined that the extended syntax identifier exists in the SQL statement. A computing service description statement in a first statement format is generated based on the SQL statement, where the first statement format is a statement format that can be recognized by a target computing framework. The computing service description statement is submitted to the target computing framework. Data queried by the SQL statement is invoked, in the target computing framework based on the computing service description statement, to perform target computation, where the SQL statement includes a computing element needed by the target computing service.

Abstract: A request for performing a data storing operation directed to a database table that comprises a plurality of table columns is received. Columnar compression metadata is accessed to identify one or more table columns in the database table, each of the one or more table columns being designated to store compressed columnar values. The columnar compression metadata is used to apply one or more columnar compression methods to generate, from one or more uncompressed columnar values received with the request for the data storing operation, one or more compressed columnar values to be persisted in the one or more table columns in the database table. A database statement is executed to persist the one or more compressed columnar values in the one or more table columns in the database table.

Abstract: A database is selected from a plurality of databases included in the distributed database cluster. A shard map of the database is acquired, wherein the shard map includes a distribution of a plurality of shards on the plurality of nodes, and one or more nodes of the plurality of nodes each includes at least one shard of an old version of the database to be upgraded to a new version. A sustainable serviceability of the database corresponding to each of the one or more nodes is predicted according to the shard map based on the assumption that the at least one shard of each of the one or more nodes has been upgraded from the old version to the new version.