Abstract: A node based architecture that supports arbitrary access to any node in a system for data representation and access, while still providing virtual volume coherency that is global to all of the nodes in the system, and while providing underlying data management services that are also variously accessible from any node in the system.

Abstract: A multilayer manifest enables any file written to an object store using a proprietary storage process, including large virtual machine backup images, to be recovered without being dependent on the proprietary storage process. Upon synchronizing a file written to an object store in cloud-enabled storage, a multilayer manifest process generates a family of manifest files in a self-contained format that represents all the necessary information required to reconstruct the file. The family of manifest files includes an ancestral record used to initiate retrieval of a file, and multiple layers of manifest files associated with the ancestral record. During retrieval, each of the one or more multilayer manifest files is successively reconstructed and used to securely retrieve the next manifest file until no further manifest files remain in the family. Reconstruction of the last multilayer manifest file results in the recovery of the file for which the manifest files were generated.

Abstract: A system, a method and a computer program product for storing data, which include receiving a data stream having a plurality of transactions that include at least one portion of data, determining whether at least one portion of data within at least one transaction is substantially similar to at least another portion of data within at least one transaction, clustering together at least one portion of data and at least another portion of data within at least one transaction, selecting one of at least one portion of data and at least another portion of data as a representative of at least one portion of data and at least another portion of data in the received data stream, and storing each representative of a portion of data from each transaction in the plurality of transactions, wherein a plurality of representatives is configured to form a chain representing the received data stream.

Abstract: One embodiment is related to a method for encrypting a block based backup image file, comprising: preparing an unencrypted block based backup image file; determining whether a region of the unencrypted block based backup image file to be streamed to a backup medium corresponds to a block allocation table (BAT) region; streaming regions of the unencrypted block based backup image file determined as not corresponding to the BAT region unchanged to the backup medium; and encrypting regions of the unencrypted block based backup image file determined as corresponding to the BAT region before streaming the regions determined as corresponding to the BAT region to the backup medium.

Abstract: Methods for a content management system. In response to determining that a change has occurred to a management policy in the content management system and in response to further determining that the content management system includes one or more items that are affected by the change to the management policy, new attribute values are associated with the items asynchronously. The new attribute values are in accordance with the changed management policy.

Abstract: In certain embodiments, a system may include an interface configured to couple to a network, at least one optical sensor configured to capture optical data associated with packaging of a waste product, and a processor coupled to the interface and to the at least one optical sensor. The processor may be configured to search at least one data source to automatically identify the waste product based on the optical data and, when the waste product is not automatically identified based on its packaging, send an alert including the optical data to a social media website through the network to solicit identifying information from one or more subscribers.

Abstract: Embodiments described herein provide for a system and associated logic to enable browsing of a federated backup having a plurality of portions, each portion separately generated and indexed by a plurality of nodes. In one embodiment, the system performs a federated backup by generating a unique identifier on a primary node and providing the unique identifier to each secondary node tasked with generating the plurality of portions. The secondary nodes associate the unique identifier with each of the plurality of portions. The unique identifier can then be used by a recovery UI to generate and display a consolidated view of the plurality of portions.

Abstract: Techniques related to communication between independent containers are provided. In an embodiment, a first programmatic container includes one or more first namespaces in which an application program is executing. A second programmatic container includes one or more second namespaces in which a monitoring agent is executing. The one or more first namespaces are independent of the one or more second namespaces. A monitoring agent process hosts the monitoring agent. The monitoring agent is programmed to receive an identifier of the application program. The monitoring agent is further programmed to switch the monitoring agent process from the one or more second namespaces to the one or more first namespaces. After the switch, the monitoring agent process continues to execute in the second programmatic container, but communication is enabled between the application program and the monitoring agent via the monitoring agent process.

Abstract: A key-value store is adapted to represent hierarchical structures, such as directory structures, to be associated with objects otherwise mapped to a flat keyspace. For example, one or more key-value pairs stored in the key-value store are designated to have a key indicating the name of a hierarchical structure, and an associated value that maps the structure to a namespace (e.g., of a group of objects to be associated with a directory). Inbound requests for operations related to the objects in a given namespace and defining the structure are checked against such “redirecting” key-value pairs, as well as one or more policies associated with the structure, the namespace, the key-value pairs, or some combination thereof, to determine whether the structure is related to the namespace objects and whether one or more requested actions are authorized against that structure.

Abstract: Operating a data processing and storage apparatus to perform continuous backup monitoring for a collection of stored file system objects. In response to changes respective to a number of the file system objects, a set of Data Management Application Program Interface (DMAPI) events is created. For each of the events, accessory file system object information relative to a file system object subject to the change is determined. The events are grouped into an event group and a unique group identifier and an overall group size count are assigned to each of the events included in the event group. The events are sent together with the respective accessory file system object information, the respective group identifier and the respective group size to a number of backup clients registered as applications. The backup clients are to process the events together with the respective accessory file system object information, the respective group identifier and the respective group size into a number of backup requests.

Abstract: Apparatuses and methods are disclosed for protection of data servers configured for data replication of a database. As an example, one apparatus includes at least one processing circuit configured to receive records indicating respective modifications performed on a first version of the database stored in a first data server of the plurality of data servers. The at least one processing circuit is configured to delay replication of the modification in one or more additional servers in the plurality of data servers for a respective length of time specified for the servers in a security profile. While delaying replication of the modification, the processing circuit determines a probability that the modification is malicious based on a first set of factors indicated in a security profile. If the probability is greater than a threshold specified in the security profile, the processing circuit prevents the modification from being performed.

Abstract: A differentially private system receives a request from a client to perform a query on data stored in a database. The differentially private system establishes a set of permissions of the client with respect to the data in the database. The differentially private system deconstructs the query into query components. The query components include at least one relation that identifies a dataset in the database and at least one expressions specifying an operation to be performed in the identified dataset. The differentially private system identifies permissions necessary to perform the specified operation on the identified dataset. The differentially private system determines whether the established permissions grants of the client include the identified permissions necessary to perform the specified operation on the identified dataset. The differentially private system selectively executes the query responsive to the determination.

Abstract: According to one embodiment, a storage server includes first tiered storage devices, a network interface and a processor. The network interface communicates with each of a client and another storage server through a network. The other storage server includes second tiered storage devices. The processor reads, when a read request is received from the client, data designated by the read request from the first tiered storage devices, and transmits the read data to the client. The processor relocates data among the first tiered storage devices and transmits information indicative of data placement in the first tiered storage devices after the relocation of the data as a hint for data relocation among the second tiered storage devices, to the other storage server.

Abstract: Systems, methods, and computer readable storage mediums for maintaining the history of remapped data in a storage system. A first portion of a first medium may be remapped to a second medium as part of read optimization operations, wherein the second medium is younger than the first medium. A tag associated with the first portion of the first medium may be retained when the first portion is remapped to the second medium. When the second medium is replicated to another storage array, the first portion of the first medium may be prevented from being replicated based on the tag identifying the first portion as being part of a previous replication operation.

Abstract: There is disclosed in one example a computing apparatus, including: an interface to a backup source in a current state; a backup storage having stored thereon a first backup version of a previous state of the source; and a backup engine to: compute a delta between the current state and the previous state; save via the backup storage a second backup version sufficient to reconstruct the current state; and assign the second backup version a reputation relative to one or more previous backup versions.

Abstract: A method for highly efficient data sharding includes: receiving a dataset containing event data; identifying a classifier field of the dataset; identifying an event field of the dataset; generating a data structure for the dataset using the classifier field and the event field; and storing the dataset by partitioning the dataset into shards using the classifier field as a shard key and ordering data within each shard by the classifier field.

Abstract: Embodiments are directed to a large-scale data backup system and method. A backup process accesses a defined policy defining how the virtual machines are to be grouped into a plurality of groups, and groups the plurality of virtual machines into the plurality of groups according to the defined policy with each group containing a number of virtual machines that can be backed up in a single backup operation without causing a system error. It then takes a snapshot backup of each group of the plurality of groups in a respective data rollover operation, and saves the snapshot backup of each group to a storage media. The policy may be a user-defined policy or a dynamic system-defined policy, and may be based on characteristics such as total number of virtual machines, system characteristics, and backup system constraints.

Abstract: A computer-implemented method for increasing restore speeds of backups stored in deduplicated storage systems may include (1) identifying a backup that includes data stored in at least one data container within a deduplicated storage system, (2) detecting a subsequent backup that includes additional data, (3) calculating an amount of duplication between the additional data included in the subsequent backup and the data stored in the data container, (4) determining that the amount of duplication between the additional data and the data stored in the data container is below a predetermined threshold, (5) identifying at least one additional data container to store the additional data instead of deduplicating the additional data with respect to the data container, and then (6) storing the additional data in the additional data container to facilitate increasing a restore speed of the subsequent backup. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: Disclosed is a method, a device, and/or a system of authentication of a user and/or a device through parallel synchronous update of immutable hash histories. In one embodiment, a computer-implemented method for authentication includes receiving an identity claim from a device that includes a device root hash of a hashed history of the device, referred to as a device hastory. Data of a user profile associated with the device that includes a profile root hash of a profile hastory is retrieved. The device root hash and the profile root hash are compared and determined to be identical to verify an identity of a user and/or a device. A transaction record is generated and deposited as a new block in both in the profile hastory and device hastory. A new profile root hash is computed to evolve the identity of the user profile for a prospective authentication request.

Abstract: A system, a method, and a computer program product for performing deduplication of data using a scalable deduplication grid are disclosed. A listing of a plurality of zone stamps is generated, where each zone stamp represents a zone in the plurality of zones in a data stream. The listing contains a logical arrangement of the plurality of zone stamps obtained from each storage location and being accessible by a plurality of servers. A first zone stamp in the listing is compared to a second zone stamp in the listing. The first and second zones are delta-compressed based on a determination that the first zone stamp is substantially similar to the second zone stamp. A server is selected to perform the comparison and delta-compression.

Abstract: An approach for index B-tree page creation associated with linear sequential insertions in database management systems (DBMS). A linear pre-splitter receives a current index leaf page for linear sequential insertion. The linear pre-splitter asynchronously creates index leaf pages where the current index leaf page is in a predetermined position at least one page away from a last index leaf page. The linear pre-splitter updates index leaf page position identifiers associated with the index leaf pages where the index leaf page position identifiers link the index leaf pages and the last index leaf page and the linear pre-splitter inserts index leaf page identifiers and index key metadata associated with each of the index leaf pages into index non-leaf pages.

Abstract: Techniques are disclosed for facilitating the process of undoing and redoing modifications that are made to content using an online content management system (CMS). As a user makes changes to content, such as by editing a webpage using a web-based CMS, a history of the user's modifications is generated and stored locally on the client. When the user invokes an undo command, the modification history can be used to determine a previous state of the content and restore the content to that previous state. Similarly, when the user invokes a redo command, the modification history can be used to return to a state that had previously been undone. In some embodiments, the process of undoing or redoing the user's modifications is selectively performed on either a client side or a server side of the online system, depending on the type of content that is being manipulated.

Abstract: A database management system may utilize a log-structured storage system instead of a conventional storage system. The log-structured storage system may store a baseline of an object and a series of log entries describing changes to the object. At various positions in the log, a combined record may be written to contain a description of a change to the object and a copy of the corresponding version of the object. Combined records may be used to employ alternative strategies for constructing or transmitting a version of an object. Embodiments may employ these alternative strategies for replication and data caches.

Abstract: One or more techniques and/or computing devices are provided for replicating virtual machine disk clones. For example, a first storage controller, hosting first storage, may have a synchronous replication relationship with a second storage controller hosting second storage. A virtual machine, within the first storage, may be specified as having synchronous replication protection. Accordingly, virtual machine disk clones of a virtual machine disk of the virtual machine may be replicated from the first storage to the second storage. For example, virtual machine disk clones may be synchronous replicated, replicated by a resync process invoked by a hypervisor agent, and/or stored and replicated from a clone backup directory.

Abstract: Systems and methods are disclosed for managing resources associated with cluster-based resource pool(s). According to illustrative implementations, innovations herein may include or involve one or more of best fit algorithms, infrastructure based service provision, tolerance and/or ghost processing features, dynamic management service having monitoring and/or decision process features, as well as virtual machine and resource distribution features.

Abstract: A method is described that includes providing a snapshot counter for a storage system implemented with multiple distributed consistent database instances. The method further includes recognizing the taking of a snapshot of the storage system by incrementing the snapshot counter from a first snapshot counter value to a second snapshot counter value. The method further includes, in response to a first change for one of the distributed consistent databases subsequent to the taking of the snapshot, performing the following: saving state information of the distributed consistent database as the state information existed prior to the change and associating the first snapshot counter value to the state information. Associating the second snapshot counter's value with the distributed consistent database having the first change. Another method for the taking of a snapshot of a distributed consistent database is also described.

Abstract: When different client devices request the same document, most of content of the response from the server (i.e. the response document from a web server) will be the same. Embodiments allow the client devices to use fingerprints, i.e. hashes, sent by a capture system to pinpoint only the changing portions of the document instead of sending the entire document. In various embodiments, the client compares client-generated fingerprints for the document with capture system-generated fingerprints for most likely appearing portions of text of the document or related documents to fully represent and sends to the capture system the client document in a compact and efficient way.

Abstract: A sorter sorts a list of elements using a plurality of registers. Each register stores a value of at most one element. Each register receives an input from a previous one of the registers indicating whether the previous one of the registers is storing a value of a list element before storing a value of a list element. Each register supplies an indication to a next register whether the register is storing a list element value. A register sends a stored value and the register identification to a register stack. The register stack uses the value as an index to store a pointer to the register. In that way a sorted list is created in the register stack. A register stores list location information for one or more occurrences of a value stored by the register. Overflow of list location information is handled in a duplicate values stack.

Abstract: A system with distributed proxy for reducing traffic in a wireless network satisfies data requests made by a mobile application. The system includes a mobile device having a local proxy for intercepting a data request made by the mobile application. The local proxy simulates application server responses for the mobile application on the mobile device for data requests where responses are available in the local cache. A proxy server is coupled to the mobile device and an application server to which the data request is made. The proxy server is able to communicate with the local proxy. The local proxy forwards the data request to the proxy server for transmission to the application server for a response to the data request. The proxy server queries the application server for any changes to the data request that the mobile application has previously made and notifies the local proxy of such changes.

Abstract: A system and computer-implemented method for automatically balancing loads across two or more storage pools within a storage array, particularly with regard to storage capacity and/or performance utilization, in accordance with a user-instituted policy. A policy is activated and input criteria are specified. A current refresh date/time stamp is determined, and whether an active job is occurring is determined. A current operational (e.g., capacity or performance) percentage for each of storage pool is determined, pools with higher and pools with lower operational percentages are identified, and data is moved from the former to the latter to better balance the pools. If the pools are already closely balanced, no action is performed. The process is repeated at an interval specified in the set of input criteria. If multiple bases for balancing are selected, the process may alternate between them.

Abstract: Protecting newly restored clients from computer viruses is described. A system identifies a backed-up version of anti-virus software associated with a backup copy of a data set for a client. The system receives a request to restore the data set for the client. The system determines whether the backed-up version of the anti-virus software comprises a most recent version of the anti-virus software. The system restores the data set for the client based on the most recent version of the anti-virus software in response to a determination that the backed-up version of the anti-virus software does not comprise the most recent version of the anti-virus software.

Abstract: Disclosed in some examples are systems, methods, NAND memory devices, and machine readable mediums for intelligent SLC cache migration processes that move data written to SLC cache to MLC storage based upon a set of rules that are evaluated using the state of the NAND device. In some examples, the SLC cache migration process may utilize a number of NAND operational parameters to determine when to move the data written to SLC cache to MLC, how much data to move from SLC to MLC, and the parameters for moving the data.

Abstract: In one aspect, a method includes separating a set of virtual machines from a first consistency group to a second consistency group and third consistency group. The method also includes combining a first virtual machine of the second consistency group to the third consistency group to form a fourth consistency group.

Abstract: Methods and devices provide a wireless communications hub device and services enabling remote access to electronic medical or fitness devices in a manner that simplifies device networking. A wireless communication hub device may include a processor and wireless communication transceivers configured to connect to cellular and/or WiFi networks to access a remote server, and wired and/or wireless local networks for connecting to electronic medical or fitness devices. The wireless communication hub device may plug into a power source, connect to an electronic medical or fitness device, and communicate via a second wireless network with an associated server-based service. The system enables discovery of the wireless communication hub device and connected electronic medical or fitness devices.

Abstract: A system and method are presented for video analysis. In an embodiment, video analysis may be applied in a contact center environment to aid contact center agents in improving the effectiveness of interactions. Feedback may be provided in real time to an agent on their interaction. Body mechanics may be examined and rated. In an embodiment, body mechanics may be combined with indicators which inform an agent on their performance. Tips may also be provided to an agent on how to improve performance in the form of audio overlay, video overlay, reports, or any combination of these. Feedback may also be used to improve the routing of communications within the contact center. Static and dynamic visual characteristics may also be used to improve routing decisions.

Abstract: According to an aspect of the present invention, there is a method, computer program product and/or system for storing data that performs the following operations (not necessarily in the following order): (i) receiving a request to migrate a data file from primary storage to secondary storage; (ii) invoking a primary data extraction function, registered by a user, to determine primary data for the data file; and (iii) inserting the primary data into a stub file.

Abstract: An illustrative method according to a set of instructions stored on a memory of a computing device includes receiving, by a processor of the computing device, a search input. The method further includes searching, by the processor, a plurality of electronic storage locations for electronic files related to the search input. The method further includes determining, by the processor, the presence of an electronic file on a first electronic storage location of the plurality of electronic storage locations that is related to the search input. The method further includes displaying, by the processor, on a graphical user interface (GUI), representative information of the electronic file. The representative information includes descriptive information relating to the electronic file.

Abstract: Systems, methods, and devices are disclosed herein for data deduplication and storage. Methods include identifying first criteria associated with a data block included in a plurality of data blocks, the data block being identified based on a blockmap and an index, the blockmap characterizing a file stored in a deduplication repository, the index identifying data store identifiers, reference count data, and second criteria associated with the plurality of data blocks. The second criteria include the first criteria, and the first criteria characterize input/output (I/O) activity associated with the data block. The methods may also include identifying data stores based on the first criteria, the data stores being included in data storage tiers. The data stores are identified based on the I/O activity associated with the data block. The methods further include updating the first criteria stored in the index and associated with the data block.

Abstract: An ediscovery system filters a document corpus to identify a filtered document set. The filtered document set is further analyzed to identify a production document set. Documents of the document corpus are stored in one of online storage and nearline storage, nearline storage providing slower access times. Documents added to the production set and/or filtered document set are moved to online storage if not already present. A countdown is associated with each document in the online storage and the document is moved to nearline storage on expiration of the counter. For each document moved, a placeholder file is retained in online storage that includes searchable text of the document. Documents in the production set may have a countdown that is longer for documents in the filtered document set. Documents in the filtered document set may have a countdown that is longer than remaining documents in the document corpus.

Abstract: Systems, methods, apparatuses, and software for data storage systems are provided herein. In one example, a data storage system is provided that includes at least one storage drive and at least one processing module coupled over a Peripheral Component Interconnect Express (PCIe) fabric. The data storage system includes a first processing module in a first storage assembly configured to receive a storage operation for a storage drive managed by a second processing module in a second storage assembly. The first processing module is configured to identify the second processing module as managing the storage drive associated with the storage operation and responsively transfer the storage operation over a tunneled network connection for handling by the second processing module of the second storage assembly.

Abstract: Techniques for common users and roles, and commonly-granted privileges and roles are described. In one approach, the DBMS of a container database allows for the creation of common roles and common users that are shared across the container database. Thus, when a common role or a common user is established, the common role or common user is propagated to each database of the container database. In another approach, the DBMS of a container database allows privileges and roles to be granted commonly or locally. When a privilege or role is granted commonly, the privilege applies in each of the databases of a container database. When a privilege or role is granted locally, the privilege applies only in the database to which the grantor of the privilege or role established a connection.

Abstract: An apparatus in one embodiment comprises a multi-tier storage system having at least a front-end storage tier and a back-end storage tier. The multi-tier storage system is implemented at least in part utilizing a plurality of virtual machines of cloud infrastructure. The front-end storage tier comprises a plurality of storage nodes of a cluster file system, with the storage nodes being implemented on respective ones of the virtual machines. The front-end storage tier further comprises a software-defined storage pool accessible to the storage nodes and implemented utilizing local disk resources of respective ones of the virtual machines. The back-end storage tier of the multi-tier storage system comprises at least one object store. At least a subset of the virtual machines may further comprise respective compute nodes configured to access the multi-tier storage system. Other illustrative embodiments include systems, methods and processor-readable storage media.

Abstract: An in-memory cluster computing framework node is described. The node includes storage devices having various priorities. The node also includes a resource monitor to monitor the operation of the storage devices. The node also includes a resource scheduler. When the resource monitor indicates that a storage device is at or approaching saturation, the resource scheduler can migrate data from that storage device to another storage device of lower priority.

Abstract: The disclosed computer-implemented method for generating full backups of applications may include (1) storing, at a backup server that is remote from an application, an initial full backup of the application that indicates an initial version of each data block within the application, (2) after storing the full backup of the application, receiving, from the application, an incremental log file generated by the application that indicates at least one change made to a data block within the application after the initial full backup of the application was generated, and (3) creating, by applying the change made to the data block within the application to the initial full backup of the application, an updated full backup of the application that indicates the most current version of each data block within the application. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: A computer-readable storage medium stores computer-executable instructions that, when executed by a processor, perform operations including scheduling first and second threads to operate independently on first and second partitions of data. The operations include beginning a first operation on the first and second partitions by the first and second threads, respectively. The operations include tracking progress of the first operation by the first and second threads using a replicated data structure. The operations include, for a record on which the first operation will be performed, adding an entry to the replicated data structure with a timestamp indicating an epoch and iteration. The operations include determining a number of yet-to-be-processed records for a selected entry of the replicated data structure. The selected entry has the most recent timestamp for the first thread. The operations include terminating the first thread when the number of yet-to-be-processed records for the selected entry is zero.

Abstract: A method for data analysis of a backup system, including interrogating a plurality of computer systems to generate for each computer system at least one dump file, each dump file including configuration and state information; extracting predetermined configuration and state information from the respective dump files; and storing the extracted configuration and state information in a database in a normalized format.

Abstract: In one embodiment, a method includes creating a data extent catalog table including information related to data extents stored to computer readable storage media, receiving a query related to a first data extent, and determining whether the data extent is stored to the one or more computer readable storage media based on analysis of the data extent catalog table. Moreover, the method includes determining whether the first data extent is eligible for deletion based on a first sliding window time period. In addition, the method includes determining whether the first data extent is eligible for linkage based on a second sliding window time period.

Abstract: The disclosed computer-implemented method for providing data backup services in a virtual environment may include (1) identifying a data path used to transfer, via a storage area network, backup data between a client system and a host operating system of a backup server, (2) establishing communication between the host operating system and a backup agent on a guest operating system of the backup server, and (3) extending the data path to the guest operating system by facilitating data transfer between the host operating system and the backup agent of the guest operating system such that the backup data is transferred between the client system and the backup agent of the guest operating system. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: Provided are a computer program product, system, and method for recovering a volume table and data sets from a volume. Content from a backup volume table comprising a valid backup of a volume table from backup of the volume is processed to generate a recovery volume table for a recovery volume. The data sets in the volume are processed to determine whether they are valid. The valid data sets are moved to the recovery volume. A data recovery operation is initiated for the data sets determined not to be valid.

Abstract: A computer-implemented method for recovering data and concurrently rebuilding indexes for the recovered data in a database for a system configured to store fewer than all indexes in backup files may include copying data from one or more database files and storing the copied data to one or more backup files. A recovery manager executing on a processor may read the copied data from the one or more backup files and write the copied data to the one or more database files, wherein the data is recovered to the one or more database files. In response to the reading, an index manager executing on the processor may initiate a rebuilding of one or more indexes for the copied data at substantially the same time as the reading of the copied data.