Abstract: A web services platform operates to monitor and control equipment of a building management system. The web services platform includes a data collector and a timeseries service. The data collector is configured to collect feedback samples provided by one or more sensors of a building management system and generate one or more feedback timeseries including a plurality of the feedback samples.

Abstract: Systems and methods are disclosed to implement a real-time data validation system that prevents problematic updates from being replicated from a primary database to a replica database. In embodiments, the data validation system injects a time delay into the replication process, so that when an update in a replication stream fails a specified data validation, the data validation system will prevent the update from being applied to the replica. In embodiments, the replication process is halted, a snapshot of the replica database is taken during the halt, and replication to the replica is resumed. Accordingly, if the problematic update is later confirmed to be invalid, the replica database can be rolled back to a point before the problematic update. Advantageously, the disclosed system can be used to implement a variety of data validations on top of a database replication process to protect the replica database from receiving undesired updates.

Abstract: A method, article of manufacture, and apparatus for recovering data. In some embodiments, this includes selecting an object to be recovered, recovering sub-objects of the object based on the priorities assigned to the sub-objects, and reprioritizing the sub-objects based on an application's I/O during recovery. In some embodiments, reprioritizing the sub-objects the sub-objects includes assigning a lower priority to the sub-objects when an application has completed I/O on the object. In some embodiments, recovering sub-objects includes recovering sub-objects to a remote location.

Abstract: Creating replicas of a time series database from across storage groups may be implemented for a time series database. Updates to a time series database may be maintained in an update log. Updates may be obtained from the log and ingested at different groups of copies of the time series database used to perform queries. Updates may be ingested at different rates at the different groups. A new copy may be added to one of the groups by copying a portion of the time series database for the new copy determined to be present in another group of copies and an update not found in the other from the log to the new copy.

Abstract: The present disclosure provides for consistent reads in a global database that is replicated to one or more global clones. A state machine is implemented, and executed independently, for each project in each region. Based on the state of a project when a read request is received, the read request will be served by the global database, served by the global clone, or ignored as an invalid request.

Abstract: A method of processing data stored in a distributive system may include receiving a data to be stored on a distributed ledger system; fractalizing the transaction data and/or storage data into a plurality of orthogonal components; determining a unique address on the distributed ledger system for each of the plurality of orthogonal components; partitioning the ledger into multiple portions or divisible shares; bifurcating the consensus mechanism between the partitioned ledgers; storing each of the plurality of orthogonal components at the corresponding address in a first ledger; and adding a new block to a second ledger, where the second ledger comprises the unique address on the distributed system for each of the plurality of orthogonal components.

Abstract: Disclosed herein are systems and methods for processing queries over external tables. In an embodiment, a database platform receives a query directed at least to data in an external table stored in a storage platform that is external to the database platform. The database platform uses metadata that summarizes the data in the external table to identify one or more partitions of the external table as potentially including data satisfying the query, and generates a query plan that includes a plurality of discrete subtasks that collectively include instructions to scan the identified one or more partitions of the external table for data satisfying the query. The database platform assigns, based on the metadata, the plurality of discrete subtasks to one or more nodes in an execution platform, and refreshes the metadata in response to a threshold number of modifications being made to the external table.

Abstract: An approach is provided for storing and retrieving map data using contextual information priors. The approach involves, for example, processing contextual information to determine a restricted range of location information relevant to at least one query. The approach also involves processing sensor data received from at least one sensor, the sensor data collected at at least one query location, to determine semantic information. The approach further involves filtering the map data based, at least in part, on the restricted range of location information relevant to the at least one query, the semantic information, or a combination thereof.

Abstract: Methods and systems for serverless data deduplication are disclosed. A blob of data is received at a cloud services platform, where the blob of data includes incremental data. The blob of data is used to create an object in a first object store included in the cloud services platform. A function as a service (FaaS) function is triggered when the object is created. The FaaS function deduplicates the object to generate a deduplicated object. The deduplicated object is stored in a second object store included in the cloud services platform.

Abstract: Web page items and other requests can be automatically categorized. An interaction with a web page item can be categorized based on previous categorizations of other web page items in which the same or similar data has been entered into a web page. A classification database containing categories of classified web page items is maintained. An interaction database containing interaction records of a user is maintained. The interaction records include a value corresponding to the user and a web page item. A web page item on a web page visited by a user and that is a user-fillable field that has been previously categorized in the classification database may be automatically populated with a value stored in an interaction database and that corresponds to the user and the user-fillable field.

Abstract: Techniques are described for characterizing and summarizing seasonal patterns detected within a time series. According to an embodiment, a set of time series data is analyzed to identify a plurality of instances of a season, where each instance corresponds to a respective sub-period within the season. A first set of instances from the plurality of instances are associated with a particular class of seasonal pattern. After classifying the first set of instances, a second set of instances may remain unclassified or otherwise may not be associated with the particular class of seasonal pattern. Based on the first and second set of instances, a summary may be generated that identifies one or more stretches of time that are associated with the particular class of seasonal pattern. The one or more stretches of time may span at least one sub-period corresponding to at least one instance in the second set of instances.

Abstract: Systems and methods are described for configuring a document management system. In various aspects, post data of a user who submitted an online posting to one or more document management systems is collected. The post data includes a node that identifies the user. Metadata is extracted from the post data, in which the metadata includes an identifier for identifying the posting distributed by the one or more document management systems. The identifier is used to collect reaction data from the one or more document management systems, where the reaction data is associated with the user's posting. A mapping is generated from the post data and the reaction data, in which the mapping includes an association of the node with at least one edge, the edge identifying a second user who reacted to the posting. At least one of the document management systems is then configured with the mapping.

Abstract: The present teaching relates to a method, system and programming for searching a data storage. A key is extracted from a request and a metadata object associated with the key is identified. Further, a determination is made as to whether the metadata object is associated with a data structure stored in a first portion of the data storage. In response to a successful determination, the data structure is searched to retrieve a value associated with the key from the first portion. In response to an unsuccessful determination, a cache is searched to retrieve the value associated with the key, and in response to the key being absent in the cache, a file associated with the metadata object is searched to retrieve the value associated with the key, wherein the file is stored in a second portion of the data storage.

Abstract: Disclosed herein are system, method, and computer program product embodiments for coordinated replication of heterogeneous database stores. An embodiment operates by determining a synchronization point based on a commit log of a primary data center. A current log position of each of a plurality of secondary slave servers associated with a secondary master server of a secondary data center is requested. It is determined that the current log position of at least one of the secondary slave servers does not correspond to the logged position of a corresponding primary slave server relative to the synchronization point. An update indicating that the current log position of each of the secondary slave servers corresponds to the logged position of each of the relative corresponding primary slave servers is received. A replay of each of the secondary slave servers up to the synchronization point is initiated.

Abstract: Disclosed herein are an apparatus, non-transitory computer readable medium, and method for querying big data and displaying the results of the query. A multilevel hierarchy of data structures is associated with a particular date to reduce the linearity of the search. The client receiving the query results stores the results in a linked list with a record format consistent with the resulting records. The client also periodically refreshes a graphical user interface with the query results until all the results are received.

Abstract: A user device includes a processing unit that executes a search application. Executing the search application causes the processing unit to receive a user search query, send the user search query to a plurality of target applications, and receive a set of search results from each of the target applications. Each search result includes application state access data configured to access an application state of the target application associated with the search result. Executing the search application causes the processing unit to rank the search results, display the ranked search results, and detect user selection of one of the displayed search results. Additionally, executing the search application causes the processing unit to send the application state access data associated with the selected search result to the target application associated with the selected search result and display the application state accessed using the application state access data.

Abstract: A request to open a file from a plurality of files in a storage is received from an application. The storage is made up of an index partition, containing recordings of file system indexes, and a data partition, containing recordings of the indexes and the file system data body. A file descriptor is created with an update flag that references the file. A determination is made that the file is being updated by the application, and the update flag is set to a value representing that the file is being updated. A request to write an index of the file system is received. A determination is made whether a specific file from the plurality of files is being updated. The index is written to the storage with an extended attribute for the specific file indicating that the specific file was being updated at the time the index was written.

Abstract: Embodiments of the present disclosure relate to creating and maintaining a separate compliance store within a domain. Files that are committed within the domain are linked to the compliance store using canonical links. Canonical links are guaranteed to be non-erasable and non-rewritable for the duration of their retention period. When using a source cluster of nodes as a primary production cluster and a target cluster of nodes as a backup cluster, file data and canonical links can be synced from the source cluster to the target cluster to maintain compliance with data retention rules. Non-canonical links can be modified as necessary to ensure snapshot consistency when failover or failback occurs between a source cluster of nodes and a target cluster of nodes.

Abstract: Systems, methods, and devices for automated maintenance of external tables in database systems are disclosed. A method includes receiving, by a database platform, read access to content in an external data storage platform that is separate from the database platform. The method includes defining an external table based on the content in the external data storage platform. The method includes connecting the database platform to the external table such that the database platform has read access for the external table and does not have write access for the external table. The method includes generating metadata for the external table, the metadata comprising information about data stored in the external table. The method includes receiving a notification that a modification has been made to the content in the external data storage platform, the modification comprising one or more of an addition of a file, a deletion of a file, or an update to a file in a source location for the external table.

Abstract: Sub-queries for a query are determined. The query is for retrieving a data item of a data graph. The data graph stores representations of the data item. Each representation of the data item stores knowledge represented by the data item in a different way or manner. Each sub-query corresponds to a different representation by which the data graph stores the data item. The sub-queries are evaluated to determine an appropriate representation of the data item in fulfillment of the query without duplicatively traversing the data graph, such as by reusing evaluation results of the sub-queries that overlap one another.