Abstract: Techniques for efficiently managing a file clone from a filesystem which supports efficient volume snapshots are provided. In some embodiments, a system may receive an instruction to remove the file clone from the filesystem. The file clone may be a point-in-time copy of metadata of an original file. The system may further—for a file map entry in a filesystem tree associated with the file clone, the file map entry indicating a data block—decrement a reference count in a reference count entry associated with the file map entry. The reference count entry may be stored in the filesystem tree according to a key and the key may comprise an identification of the original file. The system may further reclaim the data block in a storage system when the reference count is zero.

Abstract: A method includes: storing a first data extent on a physical medium, wherein the physical medium is divided into a plurality of storage blocks, wherein each of the storage blocks has a size that is different than a size of the first data extent, further wherein the first data extent is stored to a first block of the plurality of storage blocks; generating a descriptor for the first data extent, wherein the descriptor indicates that the first data extent starts within the first block of the plurality of blocks and indicates an offset from the beginning of the first block at which the first data extent starts; and storing the descriptor within the first block.

Abstract: Techniques for efficiently managing a file clone from a filesystem which supports efficient volume snapshots are provided. In some embodiments, a system may receive an instruction to remove the file clone from the filesystem. The file clone may be a point-in-time copy of metadata of an original file. The system may further—for a file map entry in a filesystem tree associated with the file clone, the file map entry indicating a data block—decrement a reference count in a reference count entry associated with the file map entry. The reference count entry may be stored in the filesystem tree according to a key and the key may comprise an identification of the original file. The system may further reclaim the data block in a storage system when the reference count is zero.

Abstract: Automated recovery of execution roles in a distributed historian system in accordance with actions and rules customized to each execution role. A monitoring service monitors the health status of execution roles and automatically performs a corrective action in response to the health state of an execution role triggering a predetermined rule.

Abstract: A method for data storage includes, in a system that includes multiple servers, multiple multi-queue storage devices and at least one storage controller that communicate over a network, storing data blocks by the servers on the storage devices. A shared data structure, which is accessible to the servers using remote direct memory access and which maps hash values calculated over the data blocks to respective storage locations of the data blocks on the storage devices, is maintained. The data blocks stored on the storage device are deduplicated, by looking-up the shared data structure by the servers without executing code on a processor of the storage controller.

Abstract: The present invention refers to a system, a method and product for automatically identifying quality defects in configuration parameters of a database system and for automatically correcting them according to predefined quality procedures. The method is executed on a central server (12) and on several satellite systems (10) as well. The method may be integral part of an enterprise resource planning system.

Abstract: A journaling file system may implement remote durable logging. Updates to a file system may be received, and log records describing the updates may be stored in a locally-accessible file system change log. The update may then be acknowledged as committed. The log records may then be sent to be stored in a network-based data store in a remote version of the file system change log. Once it may be determined that the log records are stored in the remote version, storage space for the log records in the local file system change log may be reclaimed. Various types of restoration and duplication techniques may be implemented based on the remote version of the change log to restore a file system at an originating device or to duplicate the file system at a different device.

Abstract: An input-output apparatus which is used in a process control system is provided. The input-output apparatus includes a first interface to which a lower-level apparatus is connected; a second interface to which a higher-level apparatus is connected; a third interface to which an external setting apparatus is connected; a switcher which switches between a connection of the second interface to the first interface and a connection of the third interface to the first interface; and a control device which, when in a first state in which the second interface is connected to the first interface by the switcher and the connection of the third interface to the first interface is permitted, controls the switcher to cause transitioning to a second state in which the third interface and the first interface are connected when a connection request to the first interface is input through the third interface.

Abstract: Described embodiments may provide systems and processes for migrating a replica hierarchy from at least one source device to at least one target device in a storage system. A configuration of the replica hierarchy is migrated, one or more internal nodes of the replica hierarchy are migrated, and one or more leaf nodes of the replica hierarchy are migrated. A cutover operation is performed by deactivating the at least one source device associated with the included replica hierarchy.

Abstract: A system for data storage includes multiple servers, which are configured to communicate over a network with multiple multi-queue storage devices and with at least one storage controller, to store on the storage devices compressed data belonging to a user volume, to specify storage locations, in which the compressed data is stored on the storage devices, in a shared data structure that is shared and modified by the servers using remote direct memory access, and to coordinate access to the compressed data by the servers by querying the shared data structure, without executing code on a processor of the storage controller.

Abstract: A service manages a plurality of virtual machine instances for low latency execution of user codes. The service can provide the capability to execute user code in response to events triggered on an auxiliary service to provide implicit and automatic rate matching and scaling between events being triggered on the auxiliary service and the corresponding execution of user code on various virtual machine instances. An auxiliary service may be configured as an event triggering service to detect events and generate event messages for execution of the user codes. The service can request, receive, or poll for event messages directly from the auxiliary service or via an intermediary message service. Event messages can be rapidly converted to requests to execute user code on the service. The time from processing the event message to initiating a request to begin code execution is less than a predetermined duration, for example, 100 ms.

Abstract: In some example embodiments, a method comprises: receiving, by a first node of a plurality of nodes in a distributed database system on a shared disk cluster infrastructure, a transaction request to perform a user database transaction a data item in a user database on a shared disk; acquiring, by the first node, a transaction lock for the data item; storing a lock file for the user database transaction in a lock information database on the shared disk, the lock file comprising lock information for the transaction lock and an indication of a status of the user database transaction, and the lock information comprising an identification of a location of the data item; and storing a transaction record of the user database transaction in the user database on the shared disk subsequent to the storing of the lock file in the lock information database on the shared disk.

Abstract: In a method for providing communication integrity within a distributed database computer system, a first node of a plurality of nodes transmits a change notification to a second node of the plurality of nodes. The second node is a neighbor of the first node. The first node receives at least one change confirmation from the second node. The change confirmation confirms acknowledgment of the change notification by the second node and by a third node of the plurality of nodes. The third node is not a neighbor of the first node. Responsive to receiving the at least one change confirmation, the first node determines that all the plurality of nodes have acknowledged the change notification.

Abstract: Techniques for providing data preview before recalling large data files are disclosed. In one aspect, a data file is made accessible while being offline by converting the data file from a native format to a preview format, storing the data file in the preview format in a primary storage that is locally available and moving, after the conversion to the preview format, the data file in the native format to a secondary storage. When a viewing request is received for the data file, the data file in the preview format is displayed to fulfill the viewing request.

Abstract: System and method for managing updates at clients used by a user to access a cloud-based collaboration service are disclosed. In one aspect, embodiments of the present disclosure include a method, which may be implemented on a system, for storing a representation of the action to queues of clients associated with the user in a distributed database cluster based on an action type of an action performed by a collaborator of the user. The clients of the user are selected based on the client category and the action type of the action, to receive a notification as a result of the action or to perform a synchronization with changes that occurred as a result of the action.

Abstract: Methods, systems, and articles of manufacture consistent with the present invention provide for managing a database. A data store is provided that is distributed over at least two sub data processing systems. A first information in the data store is associated with a first consistency level and a second information in the data store is associated with a second consistency level. At least one of the first consistency level and the second consistency level is selected according to an algorithm.

Abstract: In one aspect, a method to generate a point-in-time (PIT) snapshot of deduplication-based volume includes generating a virtual access data structure, generating a preliminary snapshot of the volume and modifying the preliminary snapshot to point to a block according to the virtual access data structure to generate the PIT snapshot of the deduplication-based volume.

Abstract: A system and method for enhancing data throughput in data warehousing environments by connecting multiple servers having local storages with designated external storage systems, such as, for example, those provided by SANS. The system and method may preserve a full reference copy of the data in a protected environment (e.g., on the external storage system) that is fully available. The system and method may enhance overall I/O potential performance and reliability for efficient and reliable system resource utilization.

Abstract: Multi-dimensional surrogation systems and methods are provided that generate at least one up-to-date data surrogate using information of data and numerous data changes received from at least one data source, including a production system. Embodiments described further perform bulk-to-brick transformation of the up-to-date data surrogate. Brick-level data, or item data, is further indexed and stored in an application-aware manner. The stored item data is easily accessible by many data management applications for integrated item search and recovery functions, audit functions, monitoring and supervision functions, legal discovery functions, compliance functions, archival functions, backup functions, disaster recovery functions, and more. Bulk-to-brick transformation and access of the stored item data occur off of the production system, thus contributing no performance degradation to the production system.

Abstract: Disclosed is a data processing and/or storage system. The data processing and/or storage system may include at least two interfaces, wherein each of the at least two interfaces includes a non-dedicated communication port for communicating data to and form external data systems or clients based on a rule base.

Abstract: Methods and systems for managing and locating available storage space in a system comprising data files stored in a plurality of storage devices and configured in accordance with various data storage schemes (mirroring, striping and parity-striping). A mapping table associated with each of the plurality of storage devices is used to determine the available locations and amount of available space in the storage devices. The data storage schemes for one or more of the stored data files are changed to a basic storage mode when the size of a new data file configured in accordance with an assigned data storage scheme exceeds the amount of available space. The configured new data file is stored in accordance with the assigned data storage scheme in one or more of the available locations and the locations of the new data file are recorded.

Abstract: Techniques to clone a writeable data object in non-persistent memory are disclosed. The writeable data object is stored in a storage structure in non-persistent memory that corresponds to a portion of a persistent storage. The techniques enable cloning of the writeable data object without having to wait until the writeable data object is saved to the persistent storage and without needing to quiesce incoming operations (e.g., reads and writes) to the writeable data object.

Abstract: A really simple syndication (RSS) feed generator provides a set of data related to an entity to a user in the form of a really simple syndication (RSS) feed in a manner so that the set of data includes entity information at the feed-level. A user of the RSS feed may use the feed-level entity information to consume the set of data in a number of different ways. In an embodiment, the feed-level entity information includes meta-data defining the entity such that a user may use the metadata to display the entity on the client side. The RSS feed generation system allows a user to manipulate a copy of an instance of entity data as necessary for a client.

Abstract: A system and method are provided for use in establishing secure end-to-end communication links over a VPN gateway via a network interface unit. Illustrative embodiments include establishing and providing secure communication relationships between users (customers) and companies for e-commerce and other business purposes. Each company's data and linkage to users remaining private and secure from the other participating companies as well as from the general public over the Internet. Login by user with network interface units, addressing, authentication, and other configuration operations achieved using a web page-based GUI are applied in establishing tunnels from LAN clients to desired VPN destinations. Required authentication exchanges and required encryption key exchanges facilitate the secure communications. Financial arrangements regarding the provisioning and use of network interface units are also disclosed.

Abstract: Synchronization of two or more items can be optimized through the use of parallel execution of synchronization tasks and adaptable processing that monitors and adjusts for system loading. Two or more synchronization tasks required to be performed for an item can, if not inherently serial in nature, be performed in parallel, optimizing synchronization of the item. Even if multiple synchronization tasks required for one item must be serially executed, e.g., download the item prior to translating the item, these synchronization tasks can be executed in parallel for different items, optimizing a download request involving two or more items. Moreover, multiple threads for one or more synchronization tasks can be concurrently executed when supportable by the current operating system resources. Rules can be established to ensure synchronization activity is not degraded by the overextension of system resources.

Abstract: A high availability DAS system uses a solid state cache to provide near active-active performance in a DAS duster, while retaining the implementation simplicity of active-passive or dual active system. Each node in the duster may include a solid state cache that stores hot I/O in an active-active mode, which allows the data to be read from or written to the underlying dual-active or active/passive DAS RAID system only when access to the “hot Region” cools down or in the case of Cache Miss. The hot I/O data includes hot read data that accumulated dynamically regardless of ownership of the drives where the hot read data is permanently stored. The hot I/O data also includes hot write data that is mirrored across the solid state cache memories to avoid potential dirty write data conflicts and also to provide High Availability in case of server failures.

Abstract: First and second local file systems remote one from another and having a hierarchical storage structure wherein files are stored within folders within the first local file system. A first file within the first local file system with an embedded link to a second file on the local system is mirrored with a third file within the second local file system. The second file is then mirrored to the second local file system and the third file comprises an embedded link to the mirrored second file on the second file system.

Abstract: An information retrieval system having: a client adapted for accessing a plurality of file sets stored on one of a plurality of file servers; a plurality of file servers configured to operate with a federated file system namespace; and a memory for storing re-direction information accessible by the client for identifying a request issued by the client for a file set at a first location in the namespace where the file set is located at a second, different location on one of the file servers and wherein the client in examining the re-direction information in the memory, re-directs the request to the second location in accordance with the re-direction information.

Abstract: A computational device maintains logical mirroring of a first file system with a second file system. A first set of input/output (I/O) requests is satisfied from the first file system while the second file system is undergoing defragmentation. A second set of I/O requests is satisfied from the second file system while the first file system is undergoing defragmentation.

Abstract: A method and system for synchronizing data records in a client with data records in a server system is disclosed. The method and system of the present invention includes creating setup information in the client and providing the same to the server, wherein the setup information enables the server system to identify the client, to identify where to find information the server system needs for synchronization, and to provide appropriate commands for the client.

Abstract: A storage system having a plurality of storage devices including a first type storage device and a second type storage device, a reliability attribute and/or a performance attribute of the first type storage device being different from a reliability attribute and/or a performance attribute of the second type storage device. The storage system also has a control unit and managing a plurality of virtual volumes. If necessary, a storage area allocated to a first portion of a virtual volume of the plurality of virtual volumes is changed from a first type storage area of the plurality of first type storage areas to a second type storage area of the plurality of second type storage areas while another first type storage area of the plurality of first type storage areas is allocated to a second portion of the virtual volume.

Abstract: Methods and apparatus, including computer program products, for business intelligence data extraction on demand. In general, a first request is sent from a first system to a second system for a query of a data structure to include indications of updates at the second system to data at both the first and second systems. An indication of an update at the second system is received in response to the first request, where the indication includes an identification of updated data. A second request is sent to a database data structure of the second system for data corresponding to the updated data. The updated data is received at the first system in response to the second request. Data is updated at the first system in accordance with the updated data in response to the receiving the updated data.

Abstract: Applications executing on various nodes in a distributed storage environment may write data to primary storage and may also replicate the data to secondary storage via a replication target. An interval coordinator may coordinate the periodic saving of checkpoints or snapshots of the replicated data. The interval coordinator may determine the length of consistency intervals between the saving of each of the checkpoints. Writes to the replication target from each of the nodes may be associated with the current consistency interval and, in some embodiments, with a unique per-node sequence number. When transitioning between consistency intervals, each node may be configured to temporarily suspend completion of the writes and to send the replication target a consistency interval marker indicating that the node has completed all writes for the current consistency interval.

Abstract: A unified data access mechanism can provide transparent access to data that is either stored locally or remotely. Application programs can direct data requests and data modifications to this singular component without foreknowledge of where the data is stored. The unified data access mechanism can work in concert with a synchronization mechanism that can maintain data synchronization between local data and remote data. Requested or modified data can be identified as stored locally or remotely based on the namespace of the data. If the data is stored remotely, the user credentials associated with the user's process space within which the application program is executing can be utilized to identify, and then provide, relevant authentication information to the remote data store, should it be required.

Abstract: Described herein are a system and method for remote mirroring/copying data and metadata sets from a local node to a remote node that reduces the number of metadata sets that are mirrored. In some embodiments, the local node may coalesce metadata sets into metadata chains, each metadata chain comprising a grouping of two or more metadata sets. In some instances, a “representative” metadata set of a metadata chain may be selected for sending to the remote node for storing, wherein the other metadata sets of the metadata chain are not sent to the remote node. In these embodiments, the selected metadata set may represent all the metadata sets in the chain and be the only metadata set in the chain that is transmitted and stored to the remote node. As such, the network congestion between the local and remote nodes may be reduced.

Abstract: A method for of accelerating database log hardening using specific per block data protection and damage control is provided. A per write specification is implemented to determine when database log data is mirrored synchronously or asynchronously. Synchronous mirroring is performed upon reaching a predetermined threshold, based on one or more parameters such as transaction value, both individual and cumulative, and the quantity of data written since the last synchronous mirroring. As data is added to the database log, it is written specifying asynchronous mirroring to the primary log file. Once a threshold is met, a write specifying synchronous mirroring is performed to both the primary and secondary log files, thereby hardening the log file in both primary and secondary storage subsystem.

Abstract: An apparatus, method and computer program operable in a network controls consistency guarantees of a plurality of data copies in a storage apparatus, and includes: a lease control component for extending a lease to the storage apparatus; and a consistency freeze/thaw component responsive to a failure indication for initiating a consistency freeze action at the storage apparatus prior to expiration of the current group lease period. It may further include a timer component for waiting the apparatus for a predetermined period after the consistency freeze action, where the consistency freeze/thaw component is operable to initiate a thaw action at the storage apparatus.

Abstract: A data transmission system is disclosed which optimizes transfer and updates of information between systems by providing difference information between the systems. The system transmits data packages having instructions for manipulating user data. The data packages include a header identifying the respective packages, as well as transaction objects for effecting a change to user data on a device having object instructions.

Abstract: Embodiments of the invention provide a method, a system and a computer program product for analyzing the effect of a software maintenance patch on configuration items of a CMDB. One embodiment, directed to a method, is associated with a CMDB containing information that relates to configuration items (CIs) included in one or more managed configurable systems. The method includes the step of generating a manifest that defines a target system, and contains a description of a maintenance patch disposed to update one or more specified software components. The method further includes using information contained in the manifest to search the CMDB, in order to detect each configurable system in the CMDB that corresponds to the definition of the target system, and contains at least one CI that includes at least one of the specified software components.

Abstract: Systems and methods are described for service availability that provides automated recovery of server service in a timely and application intelligent manner, maintaining application consistency and integrity, while preserving server identity. The systems and methods, referred to herein as a Service Preservation System (SPS), manage complete recovery of server data and preserve continuity of server service, reestablishing user access to server(s) after an event or disaster in which in which primary or other server(s) fail. The failures, disasters, and losses referred to herein can be at many levels and include, but are not limited to, accidental deletion of an item, loss of an entire mailbox, loss of an entire disk drive, loss of an entire server, and/or loss of an entire server site.

Abstract: A dispersed storage network includes a dispersed storage device to store data. The dispersed storage device includes a processing module operable to slice a data segment of a data object into data slices, in which the number of data slices corresponds to a number of pillars for storing the data object. The processing module further creates a slice name for each of the data slices. The slice name includes routing information containing a vault identifier that identifies at least one user of the data object and a slice index based on the vault identifier and a pillar identifier that identifies a pillar associated with the data slice. In addition, the slice name includes a source data name containing an identifier of the data object.

Abstract: A method for of accelerating database log hardening using specific per block data protection and damage control is provided. A per write specification is implemented to determine when database log data is mirrored synchronously or asynchronously. Synchronous mirroring is performed upon reaching a predetermined threshold, based on one or more parameters such as transaction value, both individual and cumulative, and the quantity of data written since the last synchronous mirroring. As data is added to the database log, it is written specifying asynchronous mirroring to the primary log file. Once a threshold is met, a write specifying synchronous mirroring is performed to both the primary and secondary log files, thereby hardening the log file in both primary and secondary storage subsystem.

Abstract: A remote copy system includes: a first storage system having a first logical volume accompanied with a first plurality of disk drives in the first storage system; a second storage system having a second logical volume, which is a virtual volume not accompanied with a second plurality of disk drives in the second storage system, the virtual volume configuring a first remote copy pair with the first logical volume; and a third storage system having a third logical volume accompanied with a third plurality of disk drives in the third storage system, the third logical volume configuring a second remote copy pair with the virtual volume and storing a copied data of data stored in the first logical volume. If the second storage system receives write data sent from the first storage system to the virtual volume, the second storage system transfers the write data to the third logical volume in the third storage system.

Abstract: Systems, methods, and computer-readable and executable instructions are provided for computing system reliability. A method for computing system reliability can include storing, on one of a plurality of devices, a checkpoint of a current state associated with the one of the plurality of devices. The method may further include storing the checkpoint in an erasure-code group across the plurality of devices.

Abstract: Systems and methods are disclosed that provide an indexing data structure. In one embodiment, the indexing data structure is mirrored index tree where the copies of the nodes of the tree are stored across devices in a distributed system. In one embodiment, nodes that are stored on an offline device are restored, and an offline device that comes back online is merged into the distributed system and given access to the current indexing data structure. In one embodiment, the indexing data structure is traversed to locate and restore nodes that are stored on offline devices of the distributed system.

Abstract: Managing file objects in a data storage system includes providing a plurality of metadata servers, each metadata server having information for only a subset of file objects in the storage system, each subset for each of the metadata servers being less than a total number of file objects for the system and includes providing at least one metadata location server, where an entity accessing a specific file object of the system determines which of the metadata servers contains data for the specific file object by first accessing the at least one metadata location server. Information for the subset of file objects may include a table having file identifiers and metadata location information. The metadata location information may point to data storage for a metadata object for a file.

Abstract: A method for mirroring one or more data changes from a first database server to one or more second database servers. The method includes intercepting one or more operations that make one or more changes to one or more data on the first database server. After intercepting these operations, the method merges the operations into one or more chunks, adds one or more log records having the chunks into a database log. The database log includes one or more database log blocks. The method then writes the database log blocks.

Abstract: In a data storage system having a plurality of storage nodes storing replicas of stripes, one storage node serves as a primary stripe node for a stripe. Client applications using the data storage system request operations affecting metadata stored in the stripe, and the data storage system creates workflow objects to implement the requested operation. Once the operation is completed, the workflow is acknowledged. A method for establishing a new primary stripe node comprises performing, by a selected storage node, a feasibility determination to determine the feasibility of the selected storage node becoming the new primary stripe node. It is feasible to become a new primary stripe node when doing so does not cause workflows that have been acknowledged, or that will be acknowledged, to result in strays.

Abstract: An apparatus and communication method that provide for communicating information on a standardized link compliant with a published standard and communicating information on a private link capable of operation at a throughput higher than maximum throughput of the published standard. The apparatus and method further provide for monitoring private link performance and increasing information throughput on the private link above the maximum standard throughput by an amount determined by the monitored private link performance.

Abstract: A disk array system including a plurality of disk drives, including: a plurality of first-type disk drives being used to form a first-type logical unit having a plurality of a first-type of chunks; a plurality of second-type disk drives being used to form a second-type logical unit having a plurality of a second-type of chunks; and a storage controller, if the storage controller copies data stored in a source chunk to a destination chunk, selecting the destination chunk from the first-type of chunks or the second-type of chunks.