Abstract: In an embodiment, a method for distributing and processing streams over wide area networks comprises receiving, at a unified data processing node, a continuous query; determining a parallel portion of the continuous query; sending the parallel portion to a plurality of distributed data processing nodes located in a plurality of data centers; at each distributed node in the plurality of distributed nodes, locally executing the parallel portion against independent data partitions, producing a partial summary data, sending the partial summary data to the unified node; continuously receiving, at the unified node, in real-time, the partial summary data.

Abstract: A content distribution system and or method can be used to align content stored in a remote source with content stored on a plurality of target units and content stored on a head end. A content distribution module can be utilized to distribute content using set logic. The content can include video, audio, graphic, or other files. Content distribution system and method can be used in an in-flight entertainment system that includes a central repository and a number of in-seat entertainment units.

Abstract: Described herein are methods, systems, and computer program products for data synchronization and conflict resolution in a distributed data storage system. A first data access node receives a first request to modify a data element and transmits a first lock event to each other node. A second data access node receives a second request to modify the data element at substantially the same time as the first request is received and transmits a second lock event to each of the other nodes. The system determines that the first node has priority to modify the data element. The first node modifies the data element and transmits a first unlock event to each other node. The second node determines whether the second request to modify conflicts with the prior modification and modifies the data element based upon the second request, if the second request does not conflict with the prior modification.

Abstract: Performing data management operations on replicated data in a computer network. Log entries are generated for data management operations of an application executing on a source system. Consistency point entries are used to indicate a time of a known good, or recoverable, state of the application. A destination system is configured to process a copy of the log and consistency point entries to replicate data in a replication volume, the replicated data being a copy of the application data on the source system. When the replicated data represents a known good state of the application, as determined by the consistency point entries, the destination system(s) may perform a storage operation (e.g., snapshot, backup) to copy the replicated data and to logically associate the copied data with a time information (e.g., time stamp) indicative of the source system time when the application was in the known good state.

Abstract: A system and method for providing a substantially constant-time copy operation for file system objects managed by a storage server begins by generating a snapshot of at least a portion of a data set managed by the storage server. The system then performs a copy operation in the storage server to generate a copy of the data set separate from the snapshot, on a set of block locations containing a predetermined reference value. During the copy operation to generate the copy of the data set separate from the snapshot, the system can receive from a requester a first read request directed to the copy of the data set that the copy operation is to generate. In response to the first data request, the system provides data from the snapshot to the requester by the storage server.

Abstract: Methods and systems for synchronizing data may enable a computer to synchronize data by connecting to a peer computer via a network connection. The computer may receive a remote table from the peer computer, wherein the remote table comprises an object comprising a vector. The computer may determine whether the object is present in a local table. When the object is present in the local table, the computer may determine whether the vector in the remote table and the vector in the local table match. When the vectors do not match, the computer may determine whether a record of a change to the object is present in a local transaction log. The computer may receive data from the peer computer indicating whether a record of a change to the object is present in a remote transaction log when the vectors do not match.

Abstract: A distributed indexing system spreads out the load on an index of stored data in a data storage system. Rather than maintain a single index, the distributed indexing system maintains an index in each media agent of a federated data storage system and a master index that points to the index in each media agent. In some embodiments, the distributed indexing system includes an index server (or group of servers) that handles indexing requests and forwards the requests to the appropriate distributed systems. Thus, the distributed indexing system, among other things, increases the availability and fault tolerance of a data storage index.

Abstract: A data indexing system including a plurality of servers and a tracked resource set client is provided. Each of the servers includes a plurality of resources that are part of a resource set. Each of the servers also includes a tracked resource set corresponding to the resource set. The tracked resource set describes the plurality of resources located in the resource set. The server identifies the plurality of resources using rules of linked data. The tracked resource set client is in communication with the plurality of servers. The tracked resource set client has a data index. The data index is built and kept up to date using the tracked resource set of each of the plurality of servers.

Abstract: A data indexing system including a plurality of servers and a tracked resource set client is provided. Each of the servers includes a plurality of resources that are part of a resource set. Each of the servers also includes a tracked resource set corresponding to the resource set. The tracked resource set describes the plurality of resources located in the resource set. The server identifies the plurality of resources using rules of linked data. The tracked resource set client is in communication with the plurality of servers. The tracked resource set client has a data index. The data index is built and kept up to date using the tracked resource set of each of the plurality of servers.

Abstract: The embodiments relate to transcoding, cataloging, and extracting metadata about files stored in a storage device. In one embodiment, a crawler runs on the storage device and maintains a database that is stored in the volume with the data that has been cataloged by the crawler. The crawler may discover files of any type and extract associated metadata about the files. The crawler can extract metadata about client interaction with various files, such as edits, play counts, etc. The crawler may discover files of any type and extract associated metadata about the files automatically during a scan or at the request of a client. In one embodiment, the crawler may be responsive to file system events that indicate changes to the file system, such as additions, deletions, or other types of changes. In addition, the crawler may synchronize the database with the file system so that they indicated the same state for a particular file.

Abstract: In one exemplary aspect, a method of a cluster-node load balancing system of a distributed database system includes receiving a request from a cluster with at least one node of a cluster of the distributed database system. The request includes a query for an identity of all other nodes known by the node as well as a metadata of all data maintained by the node. The identity of all other nodes known by the node as well as the metadata of all data maintained by the node is provided to the cluster.

Abstract: Embodiments of the present disclosure provide a method and system for providing additional functionality, including web functionality, to one or more online documents. Specifically, embodiments described herein include receiving a selection of a range of data to be used in a web extension and binding the selection of the range of data to the web extension. Once the data is bound, the binding is stored in a remote computing device. In response to the detection of the interaction with the bound range of data, the bound range of data is sent to the remote computing device where the bound range of data is updated based on the interaction. The updated data is then sent to the web extension to enable the web extension to be updated with the newly received data.

Abstract: Replication techniques are presented. According to an embodiment of a method, a node of a replicated storage network is assigned to be an owner of a data block to issue write memory block commands. The network includes at least two nodes including the node assigned to be the owner. If a read memory block command is received to read the data block, a read_lock is issued for the data block, the data block is read, and the read_lock for the data block is released. If a write memory block command is received to write new data to the data block, a write_lock is issued for the data block, the data block is written and a version associated with the data block is incremented, and the write_lock for the data block is released.

Abstract: Systems and methods for cluster maintenance are presented. In one embodiment a cluster configuration method includes: maintaining configuration information associated with a first node and a second node, including cluster configuration version information; evaluating the first node as a potential configuration update node for the second node, including evaluating an indication of potential partial snapshot update availability based upon the configuration information associated with the first node and configuration information associated with the second node; performing an update type selection, including continued analysis of partial snapshot update availability; and performing an update for the second node in accordance with results of the update type selection.

Abstract: A system for adapting virtual computing resource (e.g., virtual machine) templates for use with new software platforms without modifying, or otherwise requiring recertification of, the template itself is disclosed. The system enables the installation of a software agent to be bootstrapped to the installation and execution of an agent already included in a template. Installation of the bootstrapped software agent may be performed automatically during initial provisioning of a virtual machine with little or no additional effort required from an administrator. Accordingly, embodiments of the disclosure enable preexisting templates to repurposed for use with new and/or more advanced cloud management platforms.

Abstract: A share group of servers comprises a first server and a second server. The first server has a server partition and a management processor which is separate from said server partition. Usage rights may be transferred from the first server to the second server by executing machine readable instructions on the management processor which is separate from said server partition.

Abstract: A file storage performs control to create a virtual parent file having an identifier capable of uniquely identifying a parent file among storage systems and volumes, and to acquire block layout information of the parent file using said identifier. The file storage creates a virtual parent file in the volume in which the clone file is created, and sets the file as a virtual parent file of the clone file so as to enable creation of a clone file of a parent file that exists in a different volume or a different storage system. Moreover, by combining creating the virtual parent file and switching the identifier of the parent file which is pointed by the virtual parent file, migration of clone files and parent files astride storage systems and volumes is enabled.

Abstract: A self configuring knowledge representation system and method is presented which self configures based on the external stimuli in order to answer the query in a way best suited to the user. The domain knowledge representation here is by way of graphs that allows the knowledge to self configure based on the query intent to give “specific” to the query answers.

Abstract: A method includes providing an application accelerator to an IMS region controller, which is coupled to an IMS data language interpreter (DL/I) interface. The IMS DL/I interface provides standard data access paths to a user application launched in an IMS environment. The application accelerator is configured to make alternate data access paths available to the user application in addition to the standard data access paths provided by the IMS environment. The method further includes intercepting an IMS DL/I call made by the user application and determining whether the intercepted call should be processed by the IMS DL/I interface or by an I/O engine of the application accelerator.

Abstract: An information processing system in an illustrative embodiment comprises a sync point coordinator providing resilient high throughput job processing via coordinated resource scheduling across a distributed virtual infrastructure. In one aspect, a processing device of the information processing system comprises a processor coupled to a memory. The processing device implements a controller configured to coordinate interaction of each of multiple sync point components of the information processing system with distributed virtual infrastructure of the information processing system. The controller is coupled between each of the sync point components and the distributed virtual infrastructure. The controller may comprise, for example, a sync point coordinator having a schedule optimization module, and the sync point components may include, for example, a throughput scheduler, a resource manager, a job management system and a snapshot management system.

Abstract: In a first file storage apparatus, a first controller, which manages a first file system comprising a plurality of files, transfers a copy of the first file to a second file storage apparatus when managing the first file, manages the copy of the first file as a first replication file, configures the replication destination of the first replication file in the first file as a first pointer and, when processing a second file as a de-duplication target file, manages the first replication file as a copy of the first file and second file, configures a first pointer in the second file, and deletes the first data on condition that the storage destination of the first data which comprises the first file has been configured in the first file, or deletes the second data on condition that the storage destination of the second data which comprises the second file has been configured in the second file.

Abstract: In one aspect, in general, a method for managing data includes receiving, at a data deduplication engine of a computer system, data to be stored in a data storage system, computing a first value corresponding to at least one portion of the received data, determining that the first value matches a second value stored in a collection of identifiers, each identifier corresponding to a particular portion of data stored in the data storage system, each identifier comprising a computed value corresponding to the particular portion of data and including metadata indicating a location where the particular portion of data is being stored in the data storage system, and based on the determination that the first value matches a second value stored in the collection of identifiers, reallocating one or more physical locations from corresponding one or more virtual locations to different respective one or more virtual locations.

Abstract: Metadata-driven undo is described. In an embodiment, a metadata repository stores metadata that is associated with operations. Attributes associated with each operation are also stored in the metadata. Each operation is associated with an undolet that includes instructions for generating undo entries for operations of a particular operation type. Undo log entries are generated using the metadata and the undolet when a request is intercepted that includes an undoable operation. When an undo command is issued, the instructions in the undo log that are associated with a particular business transaction are executed to “rewind” the transaction.

Abstract: The subject disclosure relates to a distributed transaction management technique that ensures synchronization between participating nodes in a global or distributed database transaction. The technique leverages a commit protocol that uses local clocks at the respective participating nodes. Participants in a global transaction are configured to utilize the same commit timestamp and logical read time and can advance their respective local clocks to establish this synchronization. In one embodiment, distributed commit utilizes a modified version of two-phase commit that includes an extra phase to collect commit timestamp votes from participants. Additionally, a heartbeat mechanism can be used to establish loose synchronization between nodes. In another embodiment, a node can respond to a remote transaction request by returning a list of nodes involved in generating the result of the transaction and the types of access used by such nodes in addition to the transaction result itself.

Abstract: A method and apparatus for dependency tracking in a JavaScript is disclosed. The method comprises defining a plurality of properties as JavaScript property objects, evaluating at least one expression containing at least one property object in the plurality of property objects to define at least one dependent property, notifying the at least one dependent property when a state of the property object changes, and updating the state of the at least one dependent property based on the changed state of the property object.

Abstract: A mechanism is provided in a data processing system for volume placement across remote replication relationships. Responsive to applying a volume placement optimization to a source storage pool having at least one volume with a replication target in a target storage pool, the mechanism determines whether the source storage pool and the target storage pool have identical storage volume membership. Responsive to determining the source storage pool and the target storage pool not having the same storage volume membership, the mechanism generates workload performance data for each non-shared storage volume in the target storage pool that does not have a corresponding member of the source storage pool. The mechanism generates a hardware profile for hardware of the target storage pool.

Abstract: A mobile device protecting system and method are disclosed, in which an accelerometer sensor detects a tri-axis acceleration data, a trigger signal is transmitted to the mobile device when the tri-axis acceleration data is according with a falling status, so that a data of the mobile device is acquired to serve as a backup data and the backup data is stored in a backup space of the mobile protecting device, achieving in a technical efficacy of enhancing a protection result of the mobile device.

Abstract: Embodiments of the invention generate and share metadata for indexing synchronized content items. A server generates metadata for indexing synchronized content items and manages sharing of the metadata with client devices in accordance with user preferences that may be embodied in metadata generation and sharing management rules. For example, a content item stored at the server has been designated to be synchronized across at least a first client. The server generates metadata for indexing the content item and sends the metadata to at least a second client.

Abstract: For efficiently storing and retrieving data and metadata in phases, in a first phase, metadata tokens, which are assigned to most active metadata-emitting entities, are used for storing the data and the metadata together in a single input/output operation while piggybacking the metadata of least active metadata-emitting entities onto one of the most active metadata-emitting entities having one of the metadata tokens. In a second phase, the metadata is re-written to a metadata delta journal for reclaiming the metadata tokens. In a third phase, the metadata journal is applied to a metadata structure containing the metadata of the storage system, the metadata delta journal is then cleared after successfully updating the main metadata structure with the metadata of the metadata journal. The metadata journal is swapped with an empty metadata journal for concurrently adding metadata while retaining the metadata journal until applying the metadata delta journal to the metadata structure.

Abstract: A system and method verifies and restores the consistency of inode to pathname mappings. In a first embodiment, an off-line verification procedure is modified to verify and correct the primary name inode to pathname mapping information within inodes of a file system. In a second embodiment, an on-line file system verification process is modified to verify inode to pathname mapping information upon the loading of each inode within the file system.

Abstract: A system, method, and computer readable medium for asynchronous live migration of applications between two or more servers. The computer readable medium includes computer-executable instructions for execution by a processing system. Primary applications runs on primary hosts and one or more replicated instances of each primary application run on one or more backup hosts. Asynchronous live migration is provided through a combination of process replication, logging, barrier synchronization, checkpointing, reliable messaging and message playback. The live migration is transparent to the application and requires no modification to the application, operating system, networking stack or libraries.

Abstract: Systems and techniques for managing data in a relational database environment and a non-relational database environment. Data in the relational database environment that is static and to be maintained beyond a preselected threshold length of time is identified. The data is copied from the relational database and stored in the data the non-relational database. Access to the data is provided from the non-relational database via a user interface that accesses both the relational database and the non-relational database.

Abstract: A method for providing a storage device with content files for exhibition commences by identifying, from a work order, a needed set of content files. Thereafter, a storage device, whose previously written content files most closely match the needed set of content files identified from the work order, is selected from an inventory of storage devices. The set of content files on the selected storage device undergo adjustment so that the storage device stores at least the needed set of content files. For example, if one or more of the needed set of content files are missing from the selected storage device, these files are replicated onto the selected storage device as part of the content file adjustment process.

Abstract: Described is a memory searching system, including an indexing module and a searching module. The indexing module, provided with multiple indexed databases, acquires and records updated indexed data in an indexed database provided to the indexing module and synchronizes the searching module with the updated indexed data recorded in the indexed database provided to the indexing module. The searching module updates an indexed database in a memory with the updated indexed data received from the indexing module (the indexed database in the memory corresponds to the indexed database provided to the indexing module), and switches a pointer of the indexed database to the updated indexed database in the memory. Also described is a memory searching method, a real-time searching system and method, capable of better supporting real-time search and of updating indexed data in seconds in a realistic application, reducing the cost of hardware equipment and improving searching efficiency.

Abstract: The present invention relates to a method of executing an export process for an automated meta model driven export of entity parts from a source data base (10), wherein the meta model specifies an abstract model of the source data base (10) and comprises a description of an entity part and/or a reference relationship between entity parts being resolvable from a referencing entity part to a referenced entity part. The method comprising the steps identifying (S14) a set of entity parts being identifiable outside the source data base (10) by a public key, an internal key, or a mixture of a public key and an internal key as first level entity parts, supplementing (S16) the set of first level entity parts by a set of second level entity parts being referenced by the first level parts according to at least one reference relationship described in the meta model, and writing (S18) export data for the set of first level parts and the set of second level parts into an export file.

Abstract: A method and associated system for an automatically self-learning audit of a bidirectional synchronization means for synchronizing a source system and a target system. A processor identifies a mismatch between an element of production data of the source system and an analogous production-data element of the target system. If the mismatch is caused by an issue known to the synchronization means, the processor takes corrective action known to resolve the mismatch. Otherwise, the processor attempts to identify a resolution and, if successful, applies the resolution, teaches the resolution to the synchronization mechanism, records the solution, and resends data from the correct system to the incorrect system. If unable to identify a resolution, the processor implements a next-best solution that allows continued operation despite the unresolved mismatch. The processor then generates a report of the mismatch and continues searching for other mismatches in the loaded data models.

Abstract: A method to perform file system migration is described. The method comprises associating a source block device to a destination block device, wherein the source block device and the destination block device include a plurality of source blocks and destination blocks, respectively. At least one command for a source block from the plurality of source blocks is directed to the source block device or the destination block device based at least on the associating. Further, a destination block from the plurality of destination blocks is updated based, in part, on the at least one directed command.

Abstract: A computer program product is provided. The computer program product includes a tangible storage medium readable by a processing circuit and on which instructions are stored for execution by the processing circuit for performing a method. The method includes, upon receipt of a command relating to a file stored at a remote location, synchronizing the file between the remote location and a local device, determining whether a list of files linked to the file is stored in the local device, and, in an event the list is stored in the local device, synchronizing the files included in the list between the remote location and the local device.

Abstract: Exemplary methods, apparatuses, and systems that can intelligently copy data to a plurality of datastores using performance monitoring are described. In one embodiment, a shortest path tree determines the most efficient paths available for copying data from a source datastore to one or more destination datastores. During the copying of the data between a source datastore and the one or more destination datastores, a performance value of each of the datastores involved in the copying process is compared to a threshold. In response to determining that the performance value of a given source or destination datastore involved in the copying exceeds the threshold, the copying of the data to the corresponding destination datastore is suspended. An updated shortest path tree is determined to locate a more efficient path for copying data to the suspended destination datastore. Copying is resumed to the suspended destination datastore using the updated shortest path tree.

Abstract: Exemplary methods, apparatuses, and systems that can intelligently copy data to a plurality of datastores are described. In one embodiment, a distance value of a path between each datastore is determined. Based on the distance values, a graph cluster analysis creates clusters of the datastores within close proximity to one another. Also, a shortest path tree determines the most efficient paths available for copying data from a source datastore to one or more destination datastores. The source datastore is designated as the root of the shortest path tree, and the one or more destination datastores are designated as the vertices of the tree. After each child vertex of the source datastore is ordered in descending order according to a number of unique clusters to which descendants of the child vertex belong, the data is copied from the source datastore to the one or more destination datastores in the descending order.

Abstract: A computer program product is provided. The computer program product includes a tangible storage medium readable by a processing circuit and on which instructions are stored for execution by the processing circuit for, upon receipt of a command relating to a file stored at a remote location, synchronizing the file between the remote location and a local device, determining whether a list of files linked to the file is stored in the local device, and, in an event the list is stored in the local device, synchronizing the files included in the list between the remote location and the local device.

Abstract: A logging system includes an event receiver and a storage manager. The receiver receives log data, processes it, and outputs a data “chunk.” The manager receives data chunks and stores them so that they can be queried. The receiver includes buffers that store events and a metadata structure that stores metadata about the contents of the buffers. The metadata includes a unique identifier associated with the receiver, the number of events in the buffers, and, for each “field of interest,” a minimum value and a maximum value that reflect the range of values of that field over all of the events in the buffers. A chunk includes the metadata structure and a compressed version of the contents of the buffers. The metadata structure acts as a search index when querying event data. The logging system can be used in conjunction with a security information/event management (SIEM) system.

Abstract: This document describes techniques that enable an application to operate as if the application were running on its native computing system when it is actually running on another computing system. The techniques may do so by building a portable database having metadata particular to the application, which can be stored in a portable device along with that application. When that portable device is connected to another computing system, the portable database may be used to supplement or supplant the other computing system's database to enable the application to operate with its particular functionality.

Abstract: Methods and systems are directed to a maintenance procedure in a production environment comprising a primary database and a secondary database. Production data may be stored in the primary database and failover data may be stored in the secondary database. Data from the primary database may be replicated to the secondary database. The maintenance procedure may provide for modification of the primary database and the secondary database to conform to one or more modified requirements of a modified version of the application. During the maintenance procedure, data in the databases may be duplicated, data structures may be modified, and modification of certain data elements may be prohibited.

Abstract: According to one embodiment of the present invention, a system for managing data within a plurality of data management architectures comprises at least one processor. The system persists an entity managed by a first data management architecture to a second data management architecture. The first data management architecture manages entity data within one or more data sources, while the second data management architecture manages persisted entities with data from the one or more data sources within a common repository. A modification to data of the persisted entity is detected within the one or more data sources, and the modified data is synchronized with the persisted entity in the repository of the second data management architecture. Embodiments of the present invention further include a method and computer program product for managing data within a plurality of data management architectures in substantially the same manner described above.

Abstract: A device may receive information associated with a write operation to be performed on a storage volume included in a cloud computing environment, and may divide the information into a group of write frames. Each write frame may include a respective portion of the information. The device may determine information that identifies members of a replication set associated with the storage volume. The device may provide each write frame to each member. The device may receive a reply frame, associated with a write frame, from a member. The device may determine that the reply frame is a last reply frame associated with the write frame and may modify source information to form a modified reply frame. The device may provide the modified reply frame. The modified reply frame may be provided to indicate that the portion of the write operation, associated with the write frame, has been successfully performed.

Abstract: Data management systems and methods include a cloud-based platform coupled to a system of agents or folders hosted on client devices. The platform does not store actual data but instead makes use of metadata provided by the agents to track a location of all data in the system and manage the distributed storage, movement and processing of the actual data among the agents. In so doing, the platform pools networked storage into “virtual clusters” using local storage at the agents. The agents collectively monitor, store, and transfer or move data, and perform data processing operations as directed by the platform, as described in detail herein. The agents include agents hosted on or coupled to processor-based devices, agents hosted on devices of a local area network, agents hosted on devices of a wide area network, agents hosted on mobile devices, and agents hosted on cloud-based devices.

Abstract: A SAN management agent computes a validator corresponding to a full data set from which a relative (change) data set is derived. The validator, such as a checksum, identifies the full data set to which the relative data set is applicable. The validator is transmitted with the relative data set, and the store process compares the validator with the previous validator stored with the full data set in a database. If the validators correspond (i.e. match), then the received relative data set is applicable to the full data set stored at the database, and the relative data set may be processed as a change set. The remote agent therefore computes the validator on a full data set at a remote node, and transmits the validator with the change set. Subsequent relative data sets may then compare the current validator of the DB data set with the validator from which the relative set was derived.

Abstract: A technique for synchronizing a datum between a plurality of stores, wherein a version history is associated with the datum in each store. The version history has one or more entries, and each entry has an identifier and a value. The identifier identifies a store that has modified the datum, and indicates a number of modifications to the datum. When synchronizing the datum between stores, the version histories of the datum are compared to determine whether one version history is subordinate to another version history. The datum having the subordinate version history is then replaced with the datum having the dominant version history. Conflict resolution is required if the version histories are not identical, if the version histories do not have the same identifiers, and if one version history does not contain all of the identifiers with equal or greater values of those in the other version history.

Abstract: The present disclosure relates generally to the field of proactive data object replication in named data networks. In various examples, proactive data object replication may be implemented in one or more named data networks in the form of systems, methods and/or algorithms.