Abstract: Method and system for partitioning of deduplication domains in storage systems. The method includes constructing a data structure having multiple nodes representing data chunks and edges between the nodes representing a weighting of deduplication references between the data chunks, and performing clustering of the nodes of the data structure to split the nodes into clusters of tightly related nodes based on the weightings of the edges. The data chunks represented by a cluster of nodes are migrated to a deduplication domain to restrict deduplication to between only the data chunks in the deduplication domain.

Abstract: A request for one or more files is received. It is determined that the requested one or more files have been archived at an archival storage tier. Access to a first portion of the one or more requested files stored at the archival storage tier is requested. Access is provided to the first portion in response to the request. Based at least in part on a metric associated with a utilization of the first portion, it is determined when to request access to a second portion of the one or more requested files stored at the archival storage tier.

Abstract: Synchronously replicating a dataset across cloud-based storage systems, including adding a cloud-based storage system to a set of storage systems that the dataset is synchronously replicated across, where access operations are applied to the dataset equivalently through all storage systems in the set, all storage systems in the set store a separate copy of the dataset, and operations to modify the dataset performed and completed through any of the storage systems in the set are reflected in access operations to read the dataset, the cloud-based storage system including one or more cloud computing instances executing a storage controller application, a virtual drive layer that includes one or more cloud computing instances with local storage for storing at least a portion of the dataset as block data, and an object storage layer for storing at least a portion of the dataset as object data.

Abstract: The present disclosure discloses a task processing method and a distributed computing framework. A specific embodiment of the method includes: parsing an expression corresponding to a distributed computing task, and constructing task description information corresponding to the distributed computing task, the task description information being used to describe a corresponding relationship between an operator and a distributed dataset, and the operator acting on at least one of the distributed dataset or distributed datasets obtained by grouping the distributed dataset; determining, based on the task description information, a distributed dataset the operator acting on; and performing distributed computing on the distributed dataset the operator acting on using the operator. In the distributed computing, the acting scope and nesting relationship of the operator is described by constructing a topology.

Abstract: Novel tools and techniques are provided for utilizing blockchain to implement named data networking. In various embodiments, a computing system might determine whether a cache that is communicatively coupled to the computing system contains data that is responsive to a first request received from a user. If so, the computing system might retrieve and send (to the client device) data that is responsive to the received first request. If not, the computing system might send, to a blockchain system, a second request for identifying a blockchain containing a block containing data responsive to the received first request. In response to identifying such a blockchain, the computing system might receive a copy of the identified blockchain; might abstract, from the identified blockchain, the block containing the data responsive to the received first request; might abstract the data from the identified block; and might send the data to the client device.

Abstract: Conventionally, biometric template protection has been achieved to improve matching performance with high levels of security by use of deep convolution neural network models. However, such attempts have prominent security limitations mapping information of images to binary codes is stored in an unprotected form. Given this model and access to the stolen protected templates, the adversary can exploit the False Accept Rate (FAR) of the system. Secondly, once the server system is compromised all the users need to be re-enrolled again. Unlike conventional systems and approaches, present disclosure provides systems and methods that implement encrypted deep neural network(s) for biometric template protection for enrollment and verification wherein the encrypted deep neural network(s) is utilized for mapping feature vectors to a randomly generated binary code and a deep neural network model learnt is encrypted thus achieving security and privacy for data protection.

Abstract: A query specifying a source repository and a target repository is received from a client device. A source index is generated that corresponds to the source repository and represents a snapshot of metadata associated with data contained in the source data repository. The source index is filtered based on filtering criteria specified by the query to obtain a filtered source index. Attributes of data corresponding to the filtered source index are determined as well as data retrieval type parameters. Without initiating a data migration of the data corresponding to the filtered source index from the source repository to the target repository, predicted data migration metrics associated with the data migration are determined and presented to an end user of the client device. The end user is provided with the capability to initiate or forego the data migration based on an evaluation of the predicted data migration metrics.

Abstract: A data management system having a storage appliance configured to store a snapshot of a virtual machine; and one or more processors in communication with the storage appliance. The one or more processors are configured to perform operations including: identifying a plurality of shards of the virtual machine; requesting a shard snapshot of each of the plurality of shards; receiving the shard snapshots asynchronously; ordering the received shard snapshots sequentially into a results queue; and storing a single snapshot of the virtual machine based on the ordered shard snapshots. The operations may further include maintaining a flow control queue that limits a number of the requested shard snapshots.

Abstract: Systems and methods include receiving an exception raised by a database storage system in response to a database operation requested by an application, providing, in response to the exception, the application with a pointer to a failover framework comprising a memory store, receiving, from the application and at the failover framework, a request to write first data, storing, in response to the request to write first data, the first data in a tree structure of the memory store in chronological order, receiving, from the application and at the failover framework, a request to read second data, and, in response to the request to read second data, sorting the tree structure primarily by user and secondarily by chronological order and reading the second data from the sorted tree structure.

Abstract: A storage manager for an information management system determines whether one or more predetermined conditions have been met for transferring metadata of previously performed backup jobs stored in a first management database. A backup job may correspond to a backup operation of a primary storage device of a first client computing device. In response to a determination that one or more of the predetermined conditions have been met, the storage manager may transfer metadata for a second plurality of backup jobs to a second management database of a recovery manager. The recovery manager may receive a request to restore data to the primary storage device of the first client computing device based on the metadata of the second plurality of backup jobs. A media agent managed by the recovery manager may then restore the requested data to the primary storage device of the first client computing device.

Abstract: Novel tools and techniques are provided for utilizing blockchain to implement named data networking. In various embodiments, a computing system might determine whether a cache that is communicatively coupled to the computing system contains data that is responsive to a first request received from a user. If so, the computing system might retrieve and send (to the client device) data that is responsive to the received first request. If not, the computing system might send, to a blockchain system, a second request for identifying a blockchain containing a block containing data responsive to the received first request. In response to identifying such a blockchain, the computing system might receive a copy of the identified blockchain; might abstract, from the identified blockchain, the block containing the data responsive to the received first request; might abstract the data from the identified block; and might send the data to the client device.

Abstract: A request from a user to access a report associated with one or more content items maintained by an electronic content management system can be received. A query, associated with the request and including one or more attributes of the request to access the report can be executed. A set of user permissions can be set. The requested report can be based on one or more results returned from the executing of the query. The requested report can include information consistent with the set of user permissions and generated to include a link to the one or more content items maintained by the electronic content management system. The analytics engine can be logically separate from the electronic content management system. A request can be received through the query to access the one or more content items. The one or more content items can then be presented to the user.

Abstract: Systems, methods, and devices for executing a task on database data in response to a trigger event are disclosed. A method includes executing a transaction on a table comprising database data, wherein executing the transaction comprises generating a new table version. The method includes, in response to the transaction being fully executed, generating a change tracking entry comprising an indication of one or more modifications made to the table by the transaction and storing the change tracking entry in a change tracking stream. The method includes executing a task on the new table version in response to a trigger event.

Abstract: An example operation may include one or more of receiving a request to store a data block on a hash-linked chain of data blocks, dynamically selecting a subset of non-consecutive data blocks which have been previously stored within the hash-linked chain of data blocks, generating a linking hash based on a hash value of the data block to be stored and an accumulation of hash values from the subset of non-consecutive data blocks, and adding the data block to the hash-linked chain of data blocks, wherein the added data block includes the linking hash stored therein.

Abstract: Systems, methods, and devices for executing a task on database data in response to a trigger event are disclosed. A method includes executing a transaction on a table comprising database data, wherein executing the transaction comprises generating a new table version. The method includes, in response to the transaction being fully executed, generating a change tracking entry comprising an indication of one or more modifications made to the table by the transaction and storing the change tracking entry in a change tracking stream. The method includes executing a task on the new table version in response to a trigger event.

Abstract: Structured data archival with reduced downtime is disclosed. One example is a system including a deployer that manages an active table (AT), and a non-active table (NAT), and creates an intermediate table (IT) to record, during data archival, changes to the data to be archived. The deployer creates triggers on the AT and the NAT to facilitate the record, by the IT, of the changes to the data to be archived. An archiver initiates the data archival by archiving the copy of the data to be archived from the NAT, merges the recorded data from the IT to the NAT upon receiving an indication that the client access to the AT is not enabled, and switches the client access from the AT to the NAT by changing a table synonym, where the client access to the NAT is enabled upon completion of the data archival.

Abstract: A first instance of a deployer application is executed in a server mode. The deployer application is configured to deploy service instances for a multi-tenant application. A first onboarding request is received for a first tenant for the multi-tenant application. A first service instance for the first tenant is created, in response to the first onboarding request. A first request to deploy artifacts to the first service instance is received, by the first instance of the deployer application. The artifacts are deployed, by the first instance of the deployer application, to the first service instance.

Abstract: Disclosed herein are methods, systems, and apparatus, including computer programs encoded on computer storage media, for blockchain-based hierarchical data storage. One of the methods includes determining, based on a blockchain stored in a database that includes multiple levels of storage, a level of storage of the multiple levels of storage that meets a data migration condition as a target level of storage, wherein state data of the blockchain are stored as state Merkle trees in data worksheets of the multiple levels of storage, generating, for the target level of storage, an empty data worksheet in response to determining that the target level of storage meets the data migration condition, and storing at least a portion of a state Merkle tree corresponding to a newly created block of the blockchain to the empty data worksheet.

Abstract: A method and apparatus for cloud infrastructure voting to optimize usage of the cloud infrastructure are provided. The method determines the need to access a database or cloud services within a cloud infrastructure, determining a time of that need to access the database or cloud services within the cloud infrastructure. Access to the database or cloud services within the cloud infrastructure is determined based on the time of the need to access the database or cloud services using predetermined access rules. The apparatus provides a voter and user information database that contains the predetermined access rules for accessing the cloud infrastructure.

Abstract: Disclosed herein are methods, systems, and apparatus, including computer programs encoded on computer storage media, for blockchain-based hierarchical data storage. One of the methods includes determining, based on a blockchain stored in a database that includes multiple levels of storage, a level of storage of the multiple levels of storage that meets a data migration condition as a target level of storage, wherein state data of the blockchain are stored as state Merkle trees in data worksheets of the multiple levels of storage, generating, for the target level of storage, an empty data worksheet in response to determining that the target level of storage meets the data migration condition, and storing at least a portion of a state Merkle tree corresponding to a newly created block of the blockchain to the empty data worksheet.

Abstract: Some embodiments provide a method for distributing a set of parameters associated with policies for authorizing Application Programming Interface (API) calls to an application. For a previously stored hierarchical first document that comprises a first set of elements in a first hierarchical structure, the method receives a hierarchical update second document that comprises a second set of elements in a second hierarchical structure corresponding to the first hierarchical structure, wherein at least a subset of elements in the first and the second documents correspond to the set of parameters for evaluating API calls. The method receives a first set of hash values for elements of the first document that are not specified in the second document, and generates a second set of hash values for a set of elements specified in the second document. The method generates an overall hash for the second document by using the received first set of hash values and the generated second set of hash values.

Abstract: A blockchain node receives a service request, where the service request comprises one or more data types and respective service data corresponding to the one or more data types that are stored in a blockchain. At least one of a service type or identification information is determined corresponding to the service request. The service request is parsed to obtain each data type of the service request and service data corresponding to each data type. Based on a mapping relationship between a data type and service data, the service data that is obtained through parsing in a relational database corresponding to the blockchain node is stored.

Abstract: A blockchain node receives a service request, where the service request comprises one or more data types and respective service data corresponding to the one or more data types that are stored in a blockchain. At least one of a service type or identification information is determined corresponding to the service request. The service request is parsed to obtain each data type of the service request and service data corresponding to each data type. Based on a mapping relationship between a data type and service data, the service data that is obtained through parsing in a relational database corresponding to the blockchain node is stored.

Abstract: An example operation may include one or more of receiving a request comprising a file segmented into a plurality of segments corresponding to a plurality of storage nodes, identifying a segment from among the plurality of segments which is designated for the storage node from among remaining segments designated for other storage nodes, storing the identified segment in a local storage of the storage node, hashing the identified segment, and transmitting a response to a client system which includes the hashed identified segment.

Abstract: Uploads of restored virtual machine (“VM”) data to cloud storage, e.g., VM restore-to-cloud operations, are performed without having to write whole restored virtual disk files to a proxy server before the virtual disk data begins uploading to cloud. Restored data blocks from a backup source are locally cached, staged for efficiency, and asynchronously uploaded to the cloud page-by-page without tapping mass storage resources on the proxy. Downloads of VM data from cloud storage, e.g., VM backup-from-cloud, are performed without having to download a virtual disk file in its entirety to the proxy server before the backup operation begins generating a backup copy. This speeds up “pulling” VM data from the cloud by pre-fetching and locally caching downloaded data blocks. The cached data blocks are processed for backup and stored page-by-page directly into a secondary copy of the cloud VM virtual-disk file without tapping mass storage resource at the proxy.

Abstract: An approach, for fileset based data locality management in Distributed File Systems. A data locality manager receives fileset identifiers and associated block allocation information, for storing in data block locality tables. The data locality manager determines data block locality factors based on the fileset identifiers and the block allocation information, creating a collection of the data block locality factors. The data locality manager stores the collection of the data block locality factors in the data block locality tables. The data locality manager receives the fileset identifiers for determining the collection of the data block locality factors associated to the fileset identifiers and outputs the collection of the data block locality factors.

Abstract: A system for providing user access to electronic mail includes an email client and an email server. The email client receives and communicates a user interaction with an email message The email server that receives the communication, determines whether the email message stored in a live database or in a backup storage. Upon determination that the email message is stored in a backup storage, the email server performs a message exchange with a backup storage system to perform the user-requested action.

Abstract: Techniques described and suggested herein include systems and methods for storing, indexing, and retrieving original data of data archives on data storage systems using redundancy coding techniques. For example, redundancy codes, such as erasure codes, may be applied to archives (such as those received from a customer of a computing resource service provider) so as allow the storage of original data of the individual archives available on a minimum of volumes, such as those of a data storage system, while retaining availability, durability, and other guarantees imparted by the application of the redundancy code. Sparse indexing techniques may be implemented so as to reduce the footprint of indexes used to locate the original data, once stored.

Abstract: Techniques described and suggested herein include systems and methods for storing, indexing, and retrieving original data of data archives on data storage systems using redundancy coding techniques. For example, redundancy codes, such as erasure codes, may be applied to archives (such as those received from a customer of a computing resource service provider) so as allow the storage of original data of the individual archives available on a minimum of volumes, such as those of a data storage system, while retaining availability, durability, and other guarantees imparted by the application of the redundancy code. Sparse indexing techniques may be implemented so as to reduce the footprint of indexes used to locate the original data, once stored.

Abstract: According to certain aspects, an information management system can include a client computing device residing in a primary storage subsystem configured to: identify a first application to archive to one or more secondary storage devices residing in a secondary storage subsystem, the first application being one of a plurality of applications installed on the client computing device; identify first data associated with the first application, the first data stored in the one or more primary storage devices associated with the client computing device; forward an executable instance of the first application and the first data to a first secondary storage controller computer to copy the executable instance of the first application and the first data to the one or more secondary storage devices; and delete the first application from the one or more primary storage devices.

Abstract: Certain embodiments of the present invention provide an improved method for using an intraoperative imaging system. The method includes acquiring an image using an intraoperative imaging system, labeling the image by associating the image with a label, and storing the image and the label.

Abstract: A contact management data processing system can be provided. The system can include a contact manager coupled to a list of contacts and stored staleness criteria stored in connection with the list of contacts. The system also can include stale contact management logic. The logic can include program code enabled to apply the stored staleness criteria to a selected contact to identify a stale contact, and to manage the stale contact in the list of contacts. In aspects of the embodiment, the list of contacts can be stored in a personal computer, in a server remotely disposed from the contact manager, in a telephone such as a cellular telephone or voice over Internet protocol (VoIP) telephone, or in a personal digital assistant to name but a few.

Abstract: Systems and methods are disclosed for a migration tool that rapidly transfers metadata between a source content archive and a target content archive. In one aspect, the rapid transfer is facilitated by customizable multithreading that includes the ability to suspend and/or resume migration. In a further aspect, migration between the source content archive and the target content archive is facilitated by allowing at least metadata associated with content stored in the source archive to be transferred between the systems. An external data storage component is provided that allows applications to access the target system using the migrated metadata while also providing access to associated content stored in other locations. Therefore, the actual content in the original source archive may be eventually migrated to the target system while applications are provided seamless access.

Abstract: Disclosed herein are techniques for archiving data objects. It is determined whether a data object was rejected by an archiving module due to an information field thereof violating a protocol. If it is determined that the data object was rejected due to violation of the protocol, a compliant information field that complies with the protocol is generated such that the compliant information field causes the archiving module to permit archiving of the data object violating the protocol.

Abstract: A method for archiving a file that has multiple file parts stored on multiple object storage devices of a computer system includes the steps of saving the file parts on one or more archive devices, allowing one or more changes to be made to the file during the saving step, and applying at least one of the changes made during the saving step to one of the file parts stored on a respective object storage device. Furthermore, the method is performed such that the file parts saved on the one or more archive devices do not include the one or more changes made to the file during the saving step.

Abstract: A standardized identification code is used to identify each flight parameter used on board an aircraft and to provide some of its characteristic information. Descriptive complementary information is advantageously associated with the identification codes to form parameter identification maps stored, for example, in a shared database. The parameter identification codes may in particular be used to perform certain checks when parameter values are received. These checks make it possible to process only the monitored parameter values and to generate alerts if an inconsistency is detected.

Abstract: Certain example embodiments of this invention relate to system and/or methods that pair a data extractor with a data accumulator, wherein these components may be located on any one or more computers in a network system. This distributed peer extract-accumulate approach is advantageous in that it reduces (and sometimes completely eliminates) the need for a “funnel” approach to data archiving, wherein all data is moved or backed up through a central computer or central computer system. In certain example embodiments, recall-accumulate, search, verify, and/or other archive-related activities may be performed in a similar peer-based and/or distributed manner. Certain example embodiments may in addition or in the alternative incorporate techniques for verifying the integrity of data in an archive system, and/or techniques for restoring/importing data from a non-consumable form.

Abstract: Methods, apparatus and articles of manufacture to archive data are disclosed. An example method to archive data disclosed herein comprises determining an initial data model representing functional dependencies among attributes of the data, the initial data model having fully interdependent functional dependencies among all attributes of the data, pruning one or more functional dependencies from the initial data model to determine a verified data model, and archiving a transaction included in the data to memory according to the verified data model.

Abstract: Database management and security is implemented in a variety of embodiments. In one such embodiment, data sets containing sensitive data elements are analyzed using aliases representing sensitive data elements. In another embodiment, the sensitive data elements are stored in an encrypted form for use from a secure access, while the alias is available for standard access.

Abstract: A computer system maintains a repository of software products. The software products include a plurality of business processes, and each business process includes a business object. The system maintains a plurality of archiving objects, and further maintains a mapping of each business process to at least one business object, a mapping of each business object to at least one related database table, and a mapping of each database table to at least one related archiving object. The system receives a selection of a business process for which data is to be archived, and uses the mapping of the each business process to the at least one business object, the mapping of the each business object to the at least one database table, and the mapping of the each database table to the at least one archiving object to determine the database tables to transmit to the archiving objects.

Abstract: A storage manager that interoperates with a file manager application that integrates with virtualization substantially enables end-user control and storage management of virtual machines (VMs). The storage manager may manage information management operations relative to virtual machines based on and/or in response to messages and/or instructions received from the file manager application. The storage manager may further report results to the file manager application for presentation to the user.

Abstract: A pluggable migration framework can interface with a plurality of repositories that store metadata related to one or more applications. A user can customize the applications to suit the user's business requirements. The user can develop and test the customized applications in a source environment, and the customized features can be stored as metadata in one or more of the plurality of repositories. When the customized application is ready to be used by others, it can be migrated to a target environment. The pluggable migration framework can include an orchestrator that enables the user to export metadata from the plurality of repositories in the source environment, and import the metadata to a plurality of repositories in the target environment, without requiring the user to re-implement the custom features.

Abstract: Methods and systems are disclosed for real-time transactional database transformation implemented as part of a real-time transactional database management system.

Abstract: A data management apparatus may include a non-transitory memory coupled to a processor. The processor may be configured for managing data associated with one or more applications by processing instructions stored in the memory. For example, the instructions may cause the processor to determine metadata associated with content of an associated data repository. In some cases, the metadata may include information corresponding to an application associated with the data repository. Based on the metadata, the instructions may then cause the processor to create a data archive from at least a portion of the data repository and periodically analyze the metadata according to one or more data retention policies to determine whether the associated data archive is a candidate for destruction.

Abstract: A data backup manager links data backup robustness to an external state. The data backup manager monitors the external state. Responsive to the external state, the data backup manager adjusts parameters controlling data backup, such as backup frequency, backup content, and backup retention time. The data backup manager can increase these parameters responsive to an increase in an external distress state level, and decrease them in response to a decrease in the external distress state level.

Abstract: Aspects of the present invention are directed to a system for next day reconciliation of transportation records. The system having a transportation record storage provider (TRSP) that receives and stores storage medium transportation requests; an outside service provider (OSP) inventory manager that receives and maintains records of transported storage mediums scanned at the OSP; and a reconciliation provider that receives a first list from the TRSP and a second list from the OSP inventory manger, for reconciliation. The reconciliation provider includes receivers for receiving the first and second list; a processing engine that reconciles the first list and the second list; and a reporting unit that reports the results of the reconciliation. The processing engine matches inbound and outbound records of the first list and second list, and processes invalid records; and analyzes and accounts for un-matched records.

Abstract: A unified context-aware content archive system allows enterprises to manage, enforce, monitor, moderate, and review business records associated with a variety of communication modalities. The system may store an information infoset derived or inferred from one or more documents representing communications according to the variety of communication modalities as interaction transcripts. An interaction transcript represents interactions between participants through the documents rather than the documents themselves allowing for derivation or inference of communication events, chronologies, and mappings to be stored in a common data structure. In one aspect, events correlation is provided between participants of communications that can be established by general time series analysis for the purposes of extracting meaningful statistics and interaction contexts and other characteristics of data. In another aspect, chronological mappings are provided of conversations between an established start and end time frame.

Abstract: A system for archiving composite files including metadata and payload data in a file system. In at least one embodiment, the system includes a database for storing, in particular exclusively, a first group of metadata of the archived composite files, corresponding to search criteria usable in a query; at least one information layer in the file system for storing a second group of metadata of the archived composite files in storage files, the second group in particular including the metadata of the first group and/or all metadata; and the archived composite files stored in the file system.

Abstract: Methods, systems, and computer readable media for content item purging are provided. A contact item purger, such as may be incorporated within a local client application of a content management system running on a user device, may leverage knowledge as to which items have been uploaded to the content management system, and how long such content items have been stored on the user device, to propose items for deletion from the user device so as to reclaim storage space. A contact item purger may run on one or more user devices, and may activate upon various triggering events, based on various conditions and parameters, with or without user interaction, thus maintaining available memory capacity at all times.

Abstract: At least one relationship among a plurality of data storage tables in a data repository is determined. An archival model is created based on the determined at least one relationship, where the archival model is useable to archive content of the data storage tables.