Abstract: A system, a method and a computer program product for storing data, which include receiving a data stream having a plurality of transactions that include at least one portion of data, determining whether at least one portion of data within at least one transaction is substantially similar to at least another portion of data within at least one transaction, clustering together at least one portion of data and at least another portion of data within at least one transaction, selecting one of at least one portion of data and at least another portion of data as a representative of at least one portion of data and at least another portion of data in the received data stream, and storing each representative of a portion of data from each transaction in the plurality of transactions, wherein a plurality of representatives is configured to form a chain representing the received data stream.

Abstract: Disclosed herein are systems and method for multiplexing data of an underlying index. In an exemplary aspect, an index handler may generate a plurality of slots and a plurality of data buckets for a traditional index. The index handler may receive, from a software application, a request to access a data file. The index handler may determine whether any slot of the plurality of slots is attached to a respective data bucket of the plurality of data buckets comprising the data file. In response to determining that a first slot of the plurality of slots is attached to a first data bucket comprising the data file, the index handler may enable, via the first data bucket attached to the first slot, access to the data file to the software application.

Abstract: Described are techniques for utilization of a disaster recovery site including a method comprising receiving a mirrored data stream at a disaster recovery site from a production site. The mirrored data stream includes a workload instruction stored in a designated location of the mirrored data stream. The workload instruction indicates an operation to perform on a set of data that is replicated between the production site and the disaster recovery site and a time indicator indicating a correct version of the set of data. The method further comprises generating a consistency point by retrieving replicated data from the disaster recovery site corresponding to the correct version of the set of data in the production site. The method further comprises performing the operation on the consistency point, generating an output, and transmitting the output to the production site.

Abstract: Systems and methods to intelligently optimize data collection requests are disclosed. In one embodiment, systems are configured to identify and select a complete set of suitable parameters to execute the data collection requests. In another embodiment, systems are configured to identify and select a partial set of suitable parameters to execute the data collection requests. The present embodiments can implement machine learning algorithms to identify and select the suitable parameters according to the nature of the data collection requests and the targets. Moreover, the embodiments provide systems and methods to generate feedback data based upon the effectiveness of the data collection parameters. Furthermore, the embodiments provide systems and methods to score the set of suitable parameters based on the feedback data and the overall cost, which are then stored in an internal database.

Abstract: Data in a storage system is deduplicated after receiving from at least one writing entity requests for a plurality of write operations for a corresponding plurality of data blocks in a storage object. The received blocks are buffered and sorted in order and a sequence of clumps is created from the buffered blocks, where each clump comprises a grouping of at least one of the sorted, buffered blocks. A boundary is determined between at least one pair of clumps based at least in part on the content of at least one of the buffered blocks, and it is then determined whether at least one of the clumps is a duplicate of a previously stored clump.

Abstract: Embodiments of the present invention provide systems, methods, and computer program products for processing responses from services (e.g., content providers) and managing content tailoring by services and/or recommender systems used by those services. Embodiments of the present invention can afford users with the ability to control the diversity of content in responses provided by services based one or more detected themes of the responses. Furthermore, embodiments of the present invention may be used to provide users with enriched responses from services, without needing cooperation of those services.

Abstract: A method for managing data includes obtaining, by a data processor, a time bucket calculation request, and in response to the time bucket calculation request: obtaining a plurality of data points from a database based on a period of time, wherein the period of time is specified in the time bucket calculation request, processing each data point in the plurality of data points based on a timestamp of each data point and a data point interval, generating a plurality of time buckets based on the processing, and storing the plurality of time buckets in the database.

Abstract: Embodiments of the present disclosure provide a distributed storage method and a distributed storage device. The method includes offline merging, by a first thread service of a distributed storage system, M small files in a file system, generating, by the first thread service, M pieces of metadata in the offline merging process, loading, by a second thread service of the distributed storage system, the M pieces of metadata into a metadata set, searching, by the second thread service, the metadata set for metadata of a first small file when the second thread service receives a first instruction, and performing, by the second thread service, the operation corresponding to the first instruction when the second thread service finds the metadata of the first small file in the metadata set.

Abstract: In some examples, a computer system may receive a data object including object data. For example, the system may be one of three or more systems located at different respective geographic locations. The system may determine a plurality of chunks by dividing the object data into a plurality of data chunks based on a total number of the systems and determining a parity chunk. The system may send some of the chunks to the other systems, while maintaining a complete instance of the object data at the first system. The system may associate a time with the object data based on receiving the data object. Additionally, the system may associate a time threshold with the complete instance of the object data. For example, the time threshold may indicate a time at which the complete instance of the object data is to be deleted from the system.

Abstract: A user annotation entered in association with a content document of a workflow process executed in association with a metadata context-driven processing system is detected. The user annotation entered in association with the content document is analyzed according to a process-level context associated with the content document within the workflow process. Process-level metadata of the workflow process is inferred based upon the analysis of the user annotation according to the process-level context. The inferred process-level metadata is stored as part of the process-level context of the workflow process.

Abstract: Taught is a search engine for science tools which dynamically evaluates search rank of said science tools through Natural Language Processing and machine learning. The search engine accepts into a corpus of public and private materials, which references individual science tools. Each item of the corpus is evaluated both as to how much that given item should be trusted, and what that item says about individual science tools. Each science tool is evaluated based on what the whole corpus of input data contains concerning those science tools, taking into account how valuable the source of the data is in order to render an overall score and search rank. The search engine generates a judgement of each individual science tool, which is dynamically updated as new information becomes available in the corpus of input data.

Abstract: A secure data system facilitates efficient searching of extensive data storage layers, e.g., a blockchain. The system may create an index for data elements of a predefined type recorded in the blockchain. The system may generate the index by invoking executable instructions stored in an executable data element (e.g., a smart contract) recorded in the blockchain and associated with the predefined type of data elements. The index facilitates fast query into the blockchain for the data elements of the predefined type.

Abstract: An improved content indexing system is disclosed herein that content indexing system combines the functionality of the backup metadata database and the content index database into a single backup and content index database to avoid the need to perform synchronization operations. By using a single backup and content index database, the content indexing system also reduces the computing performance costs that would be associated with the synchronization operations as the amount of indexed content increases, thereby solving scalability issues.

Abstract: A distributed database system may include storage layer. The storage layer may partition data and store the partitioned data in a distributed database. The system may further include access layer. The access layer may receive a transaction, identify target data corresponding to the transaction, and generate a lock request to lock the target data included in the partitioned data. The system may further include lock service layer. The lock service layer may identify, based on the lock request, a lock status for the target data according to a lock record for the target data. The lock service layer may lock, in response to the lock status being in an unlocked state, the target data. The lock service layer may block, in response to the lock status being in a locked state, the lock request and store the lock request in a queue.

Abstract: In a multitenant data platform architecture, one or more supporting data tables are used to efficiently retrieve data responsive to data retrieval requests. Programmatic code markers associated with contextual data about a data transaction thread are identified. The contextual data is examined using the one or more programmatic code markers invoked by the database in the data transaction thread at runtime. Based on the contextual data returning an indication of a data corruption in one or more supporting data structures, an action associated with the data transaction thread is performed. A log of data corruptions and corresponding call stack trace data may be generated. The data transaction thread may be allowed to continue to execute statements that modify data tables, or the data transaction thread may be terminated.

Abstract: Example implementations relate to encrypting data objects. In an example, data objects of a file system instance contained by a security domain are encrypted using a Data Encryption Key that is specific to the security domain and is wrapped by a Key Encryption Key shared exclusively within a cluster. A backup of the file system instance is created on a backup node. The backup includes at least some of the encrypted data objects. The DEK is sent to the backup node. The backup node cannot decrypt the backup unless the backup node is a member of the cluster and has access to the KEK to unwrap the DEK.

Abstract: Methods and systems for estimating recall while screening an ordered list of bibliographic references are provided. According to one embodiment, a method includes: sorting a list of bibliographic references according to a sorting algorithm to produce a first list in order from most to least relevant; selecting, from the list, the most relevant reference, and displaying, to a human screener, information associated with the selected reference; and receiving the screener's judgment of the relevance of the selected reference. If sufficiently relevant, the selected reference is moved from the first list to a second list. The received indication is used to re-sort the remaining references in the first list. A statistical model is used to estimate the number of relevant references remaining. That estimate is displayed to the screener. The process ends when the screener determines, based on the displayed estimate, that a sufficient number of relevant references has been found.

Abstract: A user annotation entered in association with a content document of a workflow process executed in association with a metadata context-driven processing system is detected. The user annotation entered in association with the content document is analyzed according to a process-level context associated with the content document within the workflow process. Process-level metadata of the workflow process is inferred based upon the analysis of the user annotation according to the process-level context. The inferred process-level metadata is stored as part of the process-level context of the workflow process.

Abstract: Techniques for creating snapshots of data storage objects that can perform certain operations (e.g., flushing dirty data, setting up extent pointers, allocating block storage space, etc.) during background (or deferred) processing. The disclosed techniques employ one or more extent copy trackers that can be created during processing of a transaction, while I/O request from host computers are suspended. The extent copy trackers are configured to perform some or all of the certain operations in the background, after the transaction has been committed and/or the processing of the transaction has been completed. By performing such operations during background processing, a processing time required to complete the snapshot transaction is reduced, thereby reducing latency in the resumption of the I/O requests from the host computers.

Abstract: A method of and system for re-associating location mappings of two uniform resource identifier named objects may include receiving a request over a network to switch a source site associated with a first URI with a target site associated with a second URI such that content of the target site can be accessed via the first URI, renaming the target site to associate the target site with the first URI, changing a lookup data associated with the first URI from the source site to the target site, and renaming the source site to associate the source site with a third URI.