Abstract: A method, system, and computer program product for use in replication comprising intercepting an IO for a file at an application layer at the production site, determining if the file is being replicated, and based on a determination the file is being replicated, sending the IO to a first data recovery appliance and recording the IO in a journal.

Abstract: In certain embodiments, a tiered storage system is disclosed that provides for failover protection during data backup operations. The system can provide for an index, or catalog, for identifying and enabling restoration of backup data located on a storage device. The system further maintains a set of transaction logs generated by media agent modules that identify metadata with respect to individual data chunks of a backup file on the storage device. A copy of the catalog and transaction logs can be stored at a location accessible by each of the media agent modules. In this manner, in case of a failure of one media agent module during backup, the transaction logs and existing catalog can be used by a second media agent module to resume the backup operation without requiring a restart of the backup process.

Abstract: Methods, devices and systems enable restoring a database system more efficiently. A server computing device may be configured to receive a database transaction request that includes information identifying a database operation, determine a priority value for the database operation, and add the database operation to a journaling log based on the determined priority value. After detecting a failure event, the server computing device may perform the database operations identified in the journaling log to restore the database system.

Abstract: A system includes a plurality of nodes. Each of the plurality of nodes includes a processor that executes a process. The process includes: storing logs in a memory; requesting another node other than the node in which an abnormality has occurred to send information that indicates order the logs stored in the memory are created; receiving, from the other node, information that indicates order the logs stored in the other node are created; and acquiring, based on the order indicated by the received information and the order the logs stored in the memory are created, when the other node that stores therein a log that is created newer than the logs stored in the memory is present, the log created newer than the logs stored in the memory from the other node that stores therein the log created newer than the logs stored in the memory.

Abstract: Aspects of the subject matter described herein relate database virtualization. In aspects, clusters of database servers may be located at various locations of the Internet. When a client seeks to access a logical database, the client may send a logical server and logical database name in a data structure. These names may be used to find a physical server(s) and database(s) that correspond to the logical database. Once the location is determined, a proxy component is used to intercept and/or forward communications between the client and the physical server(s) and database(s) corresponding to the logical database. Using this system, a client may access data from a logical database without knowing the physical address of the logical user database.

Abstract: Systems and methods for intelligent data replication are provided, which may include the identification and use of consistency points in application data, such that one or more replication volumes may be created using an “application aware” replication process that allows the system to intelligently replicate data or other information (e.g., metadata) relating to a particular process, application or specified set of data.

Abstract: A method facilitates auditing of database transactions by maintaining logical consistency between a source database table and a shadow database table. A bulk command is received that specifies edits to a plurality of rows in the source database table. The bulk command is executed on the source database table. The shadow database table is queried to obtain an indication of the plurality of rows edited by the bulk command. The indication is stored as part of an audit trail for the source database table.

Abstract: A method facilitates auditing of database transactions by maintaining logical consistency between a source database table and a shadow database table. A bulk command is received that specifies edits to a plurality of rows in the source database table. The bulk command is executed on the source database table. The shadow database table is queried to obtain an indication of the plurality of rows edited by the bulk command. The indication is stored as part of an audit trail for the source database table.

Abstract: System, method, computer program product embodiments and combinations and sub-combinations thereof for data replication in a database system environment are described. In an aspect, the data replication includes grouping, in-memory, a plurality of transactions to be replicated as a single transaction from a source database system to a target database system. A plurality of net row changes is compiled for the plurality of transactions, and data inconsistency detection and resolution within a command application order are performed. Further included is bulk application of the plurality of net row changes to the target database system.

Abstract: Techniques are provided for maintaining data persistently in one format, but making that data available to a database server in more than one format. For example, one of the formats in which the data is made available for query processing is based on the on-disk format, while another of the formats in which the data is made available for query processing is independent of the on-disk format. Data that is in the format that is independent of the disk format may be maintained exclusively in volatile memory to reduce the overhead associated with keeping the data in sync with the on-disk format copies of the data.

Abstract: Embodiments of a method and apparatus for replicating a process performed on a first computer on a remote computer, particularly for the replication of a database maintained of each of the computers. An offset is added to time stamps for a sequence of commands so that a correction in a command or data associated with the command that is subsequently received before the command is executed can be implemented. The correction can result in removing the command from the sequence of commands to be performed, changing the data associated with the command or delaying execution of the command, for example.

Abstract: A mechanism is provided for cross-allocated block repair in a mounted file system. A set of cross-allocated blocks are identified from a plurality of blocks within an inode of the mounted file system, based on a corresponding bit associated with each cross-allocated block in a duplicated block information bitmap being in a first identified state. The set of cross-allocated blocks are repaired using a user-defined repair process. Then one or more of the set of cross-allocated blocks are deallocated based on results of the user-defined repair process.

Abstract: A computer system that improves upon the traditional file system hierarchy is disclosed. The computer system includes a processor and a persistent data storage device that is accessible by the processor. The system also may include file system software that is executed by the processor. The file system software may operate to organize the files of the persistent data storage device into a plurality of records that are contained in a metafile. Within the metafile, the files and directories of the file system may be organized in an inverted hierarchical structure. In the inverted hierarchical structure, records corresponding to child files and child directories of a parent directory may directly point to a record in the metafile that corresponds to the parent directory. In one implementation of the file system, individual records of the metafile may be each addressable by a file identifier.

Abstract: A first plurality of log segments are generated in a data storage application. The log segments are sequentially positioned within a log area and at least one of the log segments contains log hole information identifying a portion of log to skip during replay of the log. Thereafter, a portion of log segments are replayed up to a specified position while skipping at least one portion of the log prior to the specified position that is identified by the at least one log hole. Related apparatus, systems, techniques and articles are also described.

Abstract: A system reserves and manages a hidden service partition through components of the hardware platform of a computing device. The hidden partition is not accessible by way of a host operating system on the computing device. A hardware platform controller provisions a portion of nonvolatile storage through configuration settings of the hardware platform controller. When the host system requests settings related to storage in the system, the request is routed through the interfaces of the hardware platform, and the hardware platform controller reports in accordance with the configuration settings, hiding the service partition. The hidden partition is dynamically modifiable through secure remote access to the hardware platform controller, not through the host system such as operating system or BIOS.

Abstract: A method of establishing the integrity of an audit record set is described. The method comprises receiving a set of audit records and generating a first set of random values wherein each audit record in the set corresponds to at least one value of the first set. The method further comprises generating a second set of values based on an audit record and a corresponding value of the first set for each audit record in the set and generating a summary value based on the second set of values. The method further comprises certifying the summary value to generate an integrity certificate enabling verification of the integrity of the audit record set and storing the audit record set and at least one of the first set of values and the generated digital signature.

Abstract: A method, article of manufacture, and apparatus for tracking a plurality of objects being stored are disclosed. In an embodiment, this comprises computing the hash value of the name of each object being stored, setting the corresponding bits in a bitmap, and storing the bitmap as a hint in an index. The size of the bitmap is determined by the space available for storing the hint, and the range of hash values is determined by the size of the bitmap. The range may be determined by choosing a prime number smaller than the space available for storing the bitmap. Either the hint or the longest pathname containing the objects can be stored, and this may be selected based on the application.

Abstract: A method for managing a journaling-capable file system is implemented by a computing device including a processor and a memory coupled to the processor. The memory includes a set of meta commands, a set of standard journaling commands, and a journaling-capable file system that is responsive to the set of standard journaling commands. Each meta command corresponds to at least one of the standard journaling commands. The method includes receiving a first meta command wherein the first meta command corresponds to a first plurality of the standard journaling commands, converting the first meta command to the first plurality of standard journaling commands, and executing the first plurality of standard journaling commands to perform at least one operation on the journaling-capable file system.

Abstract: A data retrieval system comprising a first computing device communicatively coupled to a second computing device; the first computing device having a processor that supports operation of at least one software application that is used for retrieving data; the second computing device communicatively coupled to one or more storage media; the software application having a retrieval module for retrieving data from the one or more storage media; a storage and backup map that maps to the second computing device; and a data index stored on the second computing device that indicates to the retrieval module a particular location of the data that is to be retrieved by the retrieval module.

Abstract: Multitier deduplication can reduce the amount of bandwidth and storage resources used during deduplication. In certain embodiments, the system can determine if a data block is stored in a first archive data storage. If so, the system can skip the data block. If not, the system can determine if the data block is stored or identified in a second archive data storage. In various implementations, the first archive data storage can be local to the system and the second archive data storage can be a global archive that may be remote from the system. The system can create a map of a plurality of backups stored at the first archive enabling the system to quickly check multiple archives. The multitier data deduplication can filter out inactive data blocks during or before performing the deduplication process.

Abstract: Managing versions of an electronic entity comprising many independently managed, but mutually-dependent, subcomponents can be challenging. File management functionality is provided for use with an integrated development environment to produce a visual indication of the relationships among the subcomponents. The approach described herein provides an improvement over source code control systems and backup systems in the ability to revert the state of one or more files as their content existed at an historical time point. The technique does not require a user to predict in advance at which time points the content state of one or more files will be interesting as historical time points for future use.

Abstract: A storage system maintains a journal and a snapshot of one or more data volumes. Two journal entry types are maintained, an AFTER journal entry and a BEFORE journal entry. Two modes of data recovery are provided: “fast” recovery and “undo-able”recovery. A combination of both recovery modes allows the user to quickly recover a targeted data state.

Abstract: Methods and systems for digital asset management are described. Some embodiments provide methods and systems for: (1) a high-performance database system for storing assets and the associated metadata, (2) computing an inverse delta between two files without generating any intermediate files or deltas, (3) uniquely identifying a digital asset and storing the digital asset's namespace change history in a version control system, (4) inferring dependencies amongst namespace changes, (5) a workflow management tool that is tightly integrated with a version control system, (6) publishing milestones in a project which can consistently maintain the namespace uniqueness invariant, and/or (7) implicitly versioning data and/or files that are associated with certain types of digital assets in a version control system.

Abstract: A distributed system with transaction support may have a transaction component and one or more data components. The transaction component may manage a transaction using a log sequence number for each operation, and then transmit operations to one or more data components with log sequence numbers. The data components may perform the data operations in an idempotent manner and return a reply. The transaction component may then write the operation, its log sequence number, and information from the reply message to its log. The transaction component is able to commit a transaction, as well as retry or undo portions of a transaction, by using the information stored on its log. This may be possible even when a single transaction uses multiple data components, which may be located on different devices or manage separate and independent data sources.

Abstract: Embodiments of the present invention provide a system, method, and computer program product for reverse audits based on server access of databases. In one embodiment, a data provider is determined, and a data request based on the data provider is sent to a server, wherein the data request promotes an entry of the data request to access a database. A data response is received from the server, wherein the data response corresponds to the data request. A message is output based on whether the data response includes specific data.

Abstract: Activity data is analyzed or evaluated to detect behavioral patterns and anomalies. When a particular pattern or anomaly is detected, a system may send a notification or perform a particular task. This activity data may be collected in an information management system, which may be policy based. Notification may be by way e-mail, report, pop-up message, or system message. Some tasks to perform upon detection may include implementing a policy in the information management system, disallowing a user from connecting to the system, and restricting a user from being allowed to perform certain actions. To detect a pattern, activity data may be compared to a previously defined or generated activity profile.

Abstract: A method, system, and program product for data replication comprising, building a virtual image of a point in time in a Data Protection Appliance (DPA), taking a storage array based snapshot of a current image, creating a hot pull session and exposing a LUN containing the point in time image at the DPA.

Abstract: Performing a transaction in the context of a computing system that has one or more persistent systems coupled to one or more processors over a bus. As an example, the persistent system may serve as at least part of the main memory of the computing system. The transaction might implement multi-versioning in which a record is not updated in place. Rather, each record is represented as a sequence of one or more record versions, each version having a valid interval during which the record version is considered to properly represent the record. As part of the transaction, post-commit processing information is generated to allow the computing system to recover in the event of a system failure.

Abstract: System and method for providing a permanent data record for a creative work. In one embodiment, a process is provided to include receiving a request for a permanent data record to be issued for the creative work. The request can indicate a type of data record to be issued. Data corresponding to the creative work may also be received. The process can include generating the permanent data record using the received data, such that the received data is unalterable. Further, the permanent data record can be associated with the creative work.

Abstract: A data center for data backup and replication, including a pool of multiple storage units for storing a journal of I/O write commands issued at respective times, wherein the journal spans a history window of a pre-specified time length, and a journal manager for dynamically allocating more storage units for storing the journal as the journal size increases, and for dynamically releasing storage units as the journal size decreases.

Abstract: Techniques are provided for managing cached data objects in a mixed workload environment. In an embodiment, a system, log data is stored in one or more buffers. In response to receiving a request to perform a logical write, a first process writes a first portion of the log data to a log file in persistent storage. While the first portion of the log data is being written to the log file, a second process writes a second portion of the log data in the one or more buffers to the log file in persistent storage. In another embodiment, a request to perform a second logical write may be received before the first logical write completes. While the first log data is being written to the log file, one or more processes write second log data for the second logical write to the log file.

Abstract: Embodiments of the present teachings disclose method, system, and programs for data driven dynamic logging. Data is received by a logging system where the data is flagged for dynamic logging when one or more dynamic flagging level criteria are satisfied. Data is evaluated by a logging module wrapper, which determines whether to log the data using the default logging level or dynamic logging level, according to whether the data is flagged. A logging module logs information in a logging database according to the default logging level or dynamic logging level. Based on the logged information and detected abnormalities the dynamic flagging level and dynamic logging level are automatically or manually adjusted.

Abstract: The described implementations relate to updating views in a database system. One implementation can identify an active view that retrieves records from a database and determine one or more physical tables in the database that are referenced by the active view. The implementation can track one or more columns in the physical tables that are used by the active view and identify a change to the physical tables in a transaction log of the database. If the change does not affect the one or more columns, the change can be treated as an ignorable change for the active view.

Abstract: A system and a method enable an information analyst to use a stand-alone computer-based investigation application to conduct a disconnected investigation on shared database data in a remote location where network access to a shared data repository of the system might be only periodically available, unreliable, or non-existent. In addition, the system and method enable the disconnected investigation to incrementally incorporate ongoing updates made to the shared repository of data, and to periodically publish interim or final results of the disconnected investigation to the shared data repository. A disconnected investigation can be conducted entirely at the disconnected investigation location without having any network connectivity to the shared repository of data.

Abstract: Described is a database audit system used to monitor, and optionally alert on database activity, providing a complete record of access to data and database structure. The data audit system may also provide an audit trail of data accesses and changes to database schema and permissions. A database audit may be performed by collecting data from database transaction logs and traces, exporting the collected data into a repository, and analyzing the data in the repository to create data audit reports and to provide data audit browsing capabilities.

Abstract: A failover input/output device and corresponding method are provided to manage failover events of input/output controller devices that operate in accordance with a computer expansion card standard, such as the Peripheral Component Interconnect Express (PCIe) standard. The failover input/output device connects to redundant first and second virtualized input/output controller devices each comprising multiple virtual network interfaces that are in an active or standby state at any given time, and to a computing device that hosts one or more processes. The failover input/output device broadcasts transactions in accordance with the computer expansion card standard initiated from the computing device to the first and second virtualized input/output controller devices.

Abstract: Consolidating a set of tenant log streams from separate user databases into a consolidated log stream. The method includes receiving a plurality of tenant log streams from separate user data bases. The method further includes recording the plurality of tenant log streams as a consolidated log stream. The method further includes maintaining metadata about the consolidated log stream to map log records from the plurality of tenant log streams to their location in the consolidated log stream.

Abstract: A data storage system protects data identified for deletion which has been created or modified between scheduled data backups. For instance, the system monitors data operations and when the data operation is a delete, the system determines whether the data identified for deletion has been protected by a backup operation. Data that has not been backed up, such as newly created data, is copied to temporary storage before deletion. When the data has been protected, the system determines whether the data has been modified after the backup operation. Data modified after the backup operation is copied to temporary storage before deletion.

Abstract: A system and method for determining the data that should be backed up by a plurality of backup policies are described. A global file change log that lists which files have been changed may be maintained. The global file change log may be processed to distribute the file change information into policy-specific file change logs. A global block change bitmap may also be maintained. The global block change bitmap may indicate which data blocks of the files have been changed. Performing a respective backup operation for a respective backup policy may include backing up only the data blocks that have changed in the files listed in the respective policy-specific file change log since a previous backup operation for the respective backup policy was performed. The data blocks that have changed may be specified in a respective policy-specific block change bitmap for the respective backup policy.

Abstract: A container database stores redo records and logical timestamps for multiple pluggable databases. When it is detected that a first read-write instance of the pluggable database is opened and no other read-write instances of the pluggable database are open, offline range data associated with the pluggable database is updated. When it is detected that a second read-write instance of the pluggable database is closed, and the second read-write instance is the last open read-write instance, the offline range data associated with the pluggable database is updated. The pluggable database is restored to a logical timestamp associated with a restore request based on the offline range data.

Abstract: A networked data storage system includes a primary volume and a pointer-based virtual secondary volume. The secondary volume has B-tree checkpoints of the state of a primary filesystem of the primary volume. Intermediate syncpoints are declared between checkpoint checkpoints. The syncpoints are logical locations on the secondary volume where the B-tree is known to be in a consistent state. The frequency of syncpoints may be set by an administrator in units of blocks, i.e., a syncpoint to be taken every n blocks. Before performing a B-tree split, entire images of the leaves and parent node involved in the split are written to an intent log in a relatively fast transaction that may comprise a single I/O operation to contiguous memory. Movement of data between leaf nodes and changes to the parent nodes as a result of the split operation proceed asynchronously. In the event of a reboot before the split operation is complete, the intent log is used to complete the split transaction from the most recent syncpoint.

Abstract: A system and a method for performing a warm shutdown and restart of a buffer pool. The buffer content, including pages and control structures associated with these pages, is partitioned into blocks, where block is saved to a disk as a sequential file. The size of each block is selected to provide an optimal I/O efficiency during buffer pool shutdown and restart operations. Blocks can be saved simultaneously using a plurality of writer threads. During restart of the buffer pool, the control information is read from the disk and restored to the buffer pool using reader threads. The buffer pool may be made available for reference to pages while the reader threads are enabled to read the saved information by blocks, to facilitate a more rapid restoration of information in the buffer pool.

Abstract: Provided is a storage system including: a first interface connected to a host computer; a second interface connected to a manager terminal; a control unit connected to the first interface and the second interface and equipping a processor and a memory; and one or more disk drives in which data that is requested to read by the host computer is stored, in which the control unit detects an access from the host computer to the first interface and an access from the manager terminal to the second interface, and generates log data of operations according to the accesses. Accordingly, log data concerning every action and every operation of the storage system is maintained and stored.

Abstract: Systems and methods for intelligent data replication are provided, which may include the identification and use of consistency points in application data, such that one or more replication volumes may be created using an “application aware” replication process that allows the system to intelligently replicate data or other information (e.g., metadata) relating to a particular process, application or specified set of data.

Abstract: A computing apparatus and method of recalculating upon changes to data by saving changes to the data; receiving a request to recalculate a result according to the data; retrieving only active data from the data according to the saved changes to the data; and recalculating the result based upon the active data.

Abstract: A system that implements a data storage service may store data on behalf of storage service clients. The system may maintain data in multiple replicas that are stored on respective computing nodes in the system. Updates to the stored data and to the membership of replica groups are propagated as replicated log records. A replica receiving a log record may compare metadata in the received log record to corresponding metadata in a log record that was previously appended to its log to determine a response. The metadata may include a sequence number, a lock generation identifier, an epoch identifier, or an indication of an epoch change. The replica may append the received log record to its log, drop the received log record, or cache the received log record for future use. If a log conflict indicates an invalid log stream branch, one or more log records may be deleted.

Abstract: Read access logging is performed by tracing data accesses in all domains. The logged data is traced on metadata level with some additions identifying the exposed data records. All data relevant for read access logging is stored at first in a temporary log, which is later processed, structured, and archived.

Abstract: A method, system, and program product for implementing consistent snapshots in a replication environment, the replication environment having a production site having a splitter, and a storage media the method comprising, selecting a set of media from the storage medium, creating a consistency group of the selected set of storage media, creating a journal at the production site, splitting I/O to the consistency group, and recording the split I/O in the journal.

Abstract: A log server is electronically connected to one or more hosts. The log server sends a scan command to all storage nodes connected to a host. The host obtains a log file from each storage node connected to the host, and transmits the log file and an identifier of the storage node to the log server. The log server then searches previously stored log files in relation to the storage node in a storage device according to the identifier, and determines if the received log file is an updated log file based on the search result. If the received log file is an updated log file, the log server stores the received log file into the storage device. Otherwise, if the received log file is not an updated log file, the log server abandons the received log file.

Abstract: A file recording apparatus handles a drive as a storage device, and the drive uses, as a removable recording medium, a cartridge on which a non-volatile memory is mounted and in which one of a disk-shaped recording medium and a tape-shaped recording medium is stored. In the file recording apparatus, when a change request is issued, a file system driver records journaling information of a file system recorded in the recording medium in the non-volatile memory.