Abstract: A scalable cloud-based data processing and computing platform to support a large volume data pipeline.

Abstract: A host for managing a storage device is provided. The host includes a storage host interface configured to communicate with the storage device comprising a cache and a non-volatile memory and at least one processor. The at least one processor may be configured to receive information indicating cache loss from the storage device after device reset of the storage device, suspend a data input/output operation for the storage device, transmit a buffer read command to the storage device, and receive cache information related to data remaining in the cache without being stored in the non-volatile memory before the device reset from the storage device in response to the buffer read command.

Abstract: Taking recovery actions for replicated datasets, including: determining whether a request to modify a dataset that is synchronously replicated among a plurality of storage systems has been applied on a particular storage system of the plurality of storage systems, wherein the plurality of storage systems is synchronously replicating the dataset by acknowledging the request as being complete when each storage system has modified its copy of the dataset; and applying a recovery action based on whether the request to modify the dataset has been applied on the particular storage system of the plurality of storage systems.

Abstract: A method, including: generating a layout plan that is associated with a dataset; obtaining a data record that is part of the dataset; assigning a serial number to the data record; storing the data record at a record storage location, the record storage location being selected based on the layout plan and the serial number that is assigned to the data record; generating a metadata record that corresponds to the data record, the metadata record including at least one of the serial number and an indication of the record storage location; storing the metadata record at a metadata storage location; generating a data image of a range of data storage locations, the range including the data storage location where the data record is stored; detecting whether the data image is corrupt based, at least in part, on the metadata record; and generating a diagnostic message.

Abstract: A system for secure recovery of an application group in a container deployment environment is presented. The system includes a backup controller configured to access an application group token and generate a corresponding backup token. The system further includes a backup module configured to initiate a backup based on the backup token and create a corresponding recovery point on a backup server. The system further includes a recovery access token module configured to access a recovery access token for a determined recovery point. The system further includes a recovery controller configured to generate a recovery token corresponding to the determined recovery point based on the recovery access token, and a recovery module configured to initiate a recovery of the application group from the backup server in a destination cluster based on the recovery token. A related method is also presented.

Abstract: The present specification relates to a data collection apparatus of a power system, the data collection apparatus comprising: a communication unit that communicates with a plurality of sites using different communication protocols to receive, from the plurality of sites, data about energy use information; a storage unit that stores a plurality of data models respectively corresponding to the communication protocols to store the data in each of the plurality of data models; and a processing unit that generates a basic data model by performing data modeling according to any one of the communication protocols, generates one or more extended data models by performing data modeling according to the rest of the communication protocols, includes the extended data models in the basic data model, and stores the included extended data models in the storage unit.

Abstract: A virtual machine migration method and apparatus, that the method includes: downloading an image file of a to-be-migrated virtual machine from an object storage; starting a preset command to process the downloaded image file, to obtain a private image corresponding to the image file of the to-be-migrated virtual machine, and provisioning, by using the private image, a virtual machine that runs on a destination virtualization platform, where the preset command is configured based on a difference between a source virtualization platform and the destination virtualization platform. According to the foregoing method, the image file of the to-be-migrated virtual machine is processed by executing the preset command, so that automatic migration of the image file of the to-be-migrated virtual machine can be implemented, and a user does not need to perform a manual operation. This effectively improves migration efficiency and meets a user requirement.

Abstract: An information management system according to certain aspects may be configured to generate a snapshot of data relating to a plurality of applications. The system may include a plurality of data agents, wherein each data agent is associated with at least one of a plurality of applications, and data generated by the plurality of applications is stored in a logical volume in primary storage. The system may also include a snapshot manager configured to detect the plurality of applications; check with the plurality of data agents whether the associated applications are in consistent states; obtain a snapshot of the logical volume in response to receiving notifications from the plurality of data agents that the associated applications are in consistent states; and generate mapping information between a particular one of the plurality of applications and a portion of the snapshot relating to the particular one of the plurality of applications.

Abstract: A data structure is generated to store information about a set of writers associated with a copy service. The information is gathered from the copy service and populated into the data structure. The information includes names of the writers, writer types as being system or application writers, and system writer subtypes as being one of bare metal recovery (BMR) writers or system state recovery (SSR) writers. The data structure is reviewed to determine whether a particular writer should participate in the backup. Based on the review, a list is generated including a subset of the participating writers. Instructions are issued, via the copy service, for the writers in the list to prepare for creation of a snapshot. Upon creation of the snapshot, data is backed up from the snapshot to secondary storage.

Abstract: Techniques are disclosed relating to using machine learning techniques to predict storage configurations for historical data. In some embodiments, a computer system stores representations of historical data according to a current set of storage parameters. The representations may include snapshots of historical data in a data repository at different points in time. The computer system may receive queries for historical data specifying points in time from which to retrieve the historical data. In some embodiments, the computer system responds to the queries using the stored representations and determines performance metrics for the responses. In some embodiments, the computer system trains a machine learning model using the performance metrics. Based on output of the trained model, the computer system updates the current set of storage parameters.

Abstract: A method, computer program product, and computer system for receiving, by a computing device, a Write-Same operation from a host for a range of logical block addresses of a destination. Data may be recorded in a buffer to indicate that the Write-Same operation is complete prior to completing the Write-Same operation. An acknowledgment may be sent to the host that the Write-Same operation is complete prior to flushing to a final destination. The Write-Same operation for the logical block addresses of the destination may be performed after sending the acknowledgment to the host that the Write-Same operation is complete.

Abstract: A method and system for enabling incremental backup operations targeting bare-metal recovery and system-state recovery data and metadata. These aforementioned forms of recovery focus on the protection of computing system state, including operating system binaries and configuration, as well as the data, metadata, and/or configuration of software application(s) installed on said computing system(s). Further, the data and/or metadata reflected in said computing system state often remains unchanged unless operating system and/or software application component(s) or feature(s) is/are uninstalled, installed, and/or upgraded. Existing solutions protecting said data and/or metadata tend to only support full backup operations, which are time and storage space inefficient. Ideally, incremental backup operations targeting said data and/or metadata should be provided.

Abstract: The present disclosure relates to a method for data synchronization between a source database system and target database system, wherein execution of a database transaction of the source database system is complete if a processing step followed by an application step of the database transaction is performed. For each identified database transaction, a processing step and/or application step may be performed.

Abstract: An identification of a new primary snapshot created for a primary storage system is received. A threshold time window based on a capture time associated with the new primary snapshot is determined. Entries of a storage log of the primary storage system occurring within the threshold time window are analyzed to identify any objects of the primary storage system that have changed during the threshold time window. Changed objects to capture in a new secondary backup stored at a secondary storage system and corresponding to the new primary snapshot are identified. Metadata of the new primary snapshot and metadata of a previous secondary backup are compared to determine for each of the objects of the primary storage system identified as having changed during the threshold time window whether a change to an object since the previous secondary backup is captured in the new primary snapshot.

Abstract: An example computer-implemented method embodying the disclosed technology comprises digitally storing a plurality of digital objects comprising first type digital objects and second type digital objects, each digital object comprising an electronic digital representation of natural language text, and certain first type digital objects each being associated with exactly one second type digital object; programmatically generating a corpus of digital documents from the plurality of digital objects; programmatically embedding the electronic digital representation of natural language text of each first type digital object not associated with one of the second type digital objects, thereby generating a second set of vectors; programmatically determining, for each of the second set of vectors, a corresponding set of nearest neighbor vectors from the first set of vectors; programmatically generating recommendation data indicating potential new associations between first type digital objects and second type digital ob

Abstract: Writers participating in a backup are identified. A mapping is generated between the writers and associated files. The mapping includes file properties. The mapping is initialized by tagging the writers with a full backup tag. A base backup copy of the writers is created by conducting a full backup of each writer tagged with the full backup tag. At a current backup operation after creating the base backup, a list of current files that will participate in the current backup operation is generated. The list of current files is compared against the files in the mapping to determine whether a particular writer associated with a current file should be tagged with the full backup tag or an incremental backup tag. The particular writer is tagged with the incremental backup tag when file properties associated with the current file have changed.

Abstract: A system includes reception of a request for recovery of a database to a recovery time, determination of a recovery logical timestamp corresponding to the recovery time, identification of database log records associated with a logical timestamp preceding the recovery logical timestamp, application of the identified database log records to the database sequentially according to log sequence number, identification, after applying the identified database log records, of one or more open transactions on the database, identification of a first one or more of the one or more open transactions which are associated with a commit log record associated with a logical timestamp preceding the recovery logical timestamp, and, in response to identification of the first one or more of the one or more open transactions, committing of the first one or more of the one or more open transactions.

Abstract: A method and intrusion manager (200) for handling intrusion to an electronic equipment (202). When a sensor (204) detects (2:2) an intrusion to the electronic equipment, an intrusion entry indicating the detected intrusion is stored (2:3), and an associated sign-off message which identifies the stored intrusion entry is also stored (2:5). The sign-off message comprises a signature that validates the detected intrusion, which signature may be received (2:4) as input from an authorised person. Thereby, any stored intrusion entry can be checked by searching for an associated sign-off message, and a stored intrusion entry having no matching sign-off message with a valid signature can be determined to be unauthorised.

Abstract: The present disclosure relates generally to techniques for processing asynchronous queries across multiple data cores including secondary data cores stored in the secondary storage system in a distributed computing system. Secondary data cores are recovered in the data plane from secondary storage in order to be accessible for searching. Using this technique, asynchronous queries are run in parallel allowing the client to dynamically manage the queries and receive notifications when results are available.

Abstract: Some embodiments may include a process for determining a type of snapshot to be stored using a data storage system. An example the process comprises identifying a snapshot chain for a first virtual machine, determining whether the snapshot chain includes a dependent base file, determining a maximum incremental chain length for the snapshot chain based on whether the snapshot chain includes a dependent base file, or based on an age of the backed up versions within the snapshot chain, determining whether a new snapshot chain should be created based on the maximum incremental chain length, and determining a type of snapshot to be stored for the first virtual machine based on the maximum incremental chain length.

Abstract: Described is a system for rule-based re-tiering of backup data stored on a cloud-based object storage. More specifically, the system may re-tier objects based on one or more storage rules such that the system retains the ability to efficiently perform a full restore of backup data even when incremental backups are performed to a cloud-based object storage. To provide such a capability, the system may maintain a specialized metadata database that stores information indicating the backup time for each backup, and a list of objects required to perform a full restore to each of the backup times. Accordingly, when initiating a re-tiering based on one or more storage rules, the system may intelligently select candidate objects for re-tiering by leveraging the metadata database to ensure that objects that may still need to be referenced are not unnecessarily moved to a lower storage tier.

Abstract: Recovering from system faults for replicated datasets, including: receiving, by the cloud-based storage system, a request to modify a dataset that is stored by the cloud-based storage system, wherein the dataset is synchronously replicated among a plurality of storage systems that includes the cloud-based storage system, wherein a request to modify the dataset is acknowledged as being complete when each of the plurality of storage systems has modified its copy of the dataset; generating recovery information indicating whether the request to modify the dataset has been applied on all storage systems in the plurality of storage systems synchronously replicating the dataset; and after a system fault, applying a recovery action in dependence upon the recovery information indicating whether the request to modify the dataset has been applied on all storage systems in the plurality of storage systems synchronously replicating the dataset.

Abstract: Methods and systems are described that secure application data being maintained in transient data buffers that are located in a memory that is freely accessible to other components, regardless as to whether those components have permission to access the application data. The system includes an application processor, a memory having a portion configured as a transient data buffer, a hardware unit, and a secure processor. The hardware unit accesses the transient data buffer during execution of an application at the application processor. The secure processor is configured to manage encryption of the transient data buffer as part of giving the hardware unit access to the transient data buffer.

Abstract: An intelligent method of selecting a data recovery site upon receiving a data recovery request. The backup system collects historical activity data of the storage system to identify work load of every data recovery site. A predicted activity load for each data recovery site is then generated using the collected data. When a request for data recovery is received, the system first identifies which data recovery site has copies of the files to be recovered. Then it uses the predicted work load for these data recovery sites to determine whether to use a geographically local site or a site that may be remote geographically, but has a lower work load.

Abstract: Described is a system for intelligent re-tiering of backup data stored on a cloud-based object storage. More specifically, the system may re-tier objects such that the system retains the ability to efficiently perform a full restore of backup data even when incremental backups are performed to a cloud-based object storage. To provide such a capability, the system may maintain a specialized metadata database that stores information indicating the backup time for each backup, and a list of objects required to perform a full restore to each of the backup times. Accordingly, when using a threshold time (e.g. expiry) to select object candidates for re-tiering, the system may leverage the metadata database to ensure that objects that may still need to be referenced are not unnecessarily moved to a lower storage tier.

Abstract: A method, electronic device, and a computer readable medium for managing backup data that includes determining an expiration time of backup data in a data set to be backed up in a source storage device, and determines a priority of the backup data to be migrated in a migration operation to be performed based on the expiration time. The method may also include migrating backup data with the same priority in the data set to be backed up to a target storage device to reduce a write amplification factor of a storage device, and prolong the service life of the storage device.

Abstract: Embodiments of the present disclosure include receiving one or more input/output (IO) requests at a storage array from a host device. Furthermore, the IO requests can include at least one data replication and recovery operation. In addition, the host device's connectivity access to a recovery storage array can be determined. Data replication and recovery operations can be performed based on the host device's connectivity to the recovery storage array.

Abstract: In some examples, a first computing device may receive, from a server, an indication that the server has recovered data. For instance, the first computing device may store metadata including a mapping for one or more file systems accessed by one or more client devices. Furthermore, a second computing device may store a copy of the mapping stored on the first computing device. The first computing device may receive, from the server, a mapping of the one or more file systems determined by the server based on the recovered data. The first computing device may compare the mapping from the server with the mapping of the one or more file systems on the first computing device, and may send, to the server, information about changes determined between the two mappings to enable the server to update the mapping on the server based on the changes.

Abstract: This disclosure provides a data query method and apparatus. The method includes: dividing an object storage system into a plurality of storage spaces based on time slices, establishing a mapping relationship between the storage spaces, the time slices, and operation records, recording time slice information corresponding to a snapshot after generating the snapshot, and implementing services such as a read-only service, a snapshot rollback service, and an object change service based on the snapshot, so as to improve query performance without adding extra storage overheads.

Abstract: A system includes a multi-process application that runs. A multi-process application runs on primary hosts and is checkpointed by a checkpointer comprised of at least one of a kernel-mode checkpointer module and one or more user-space interceptors providing at least one of barrier synchronization, checkpointing thread, resource flushing, and an application virtualization space. Checkpoints may be written to storage and the application restored from said stored checkpoint at a later time. Checkpointing may be incremental using Page Table Entry (PTE) pages and Virtual Memory Areas (VMA) information. Checkpointing is transparent to the application and requires no modification to the application, operating system, networking stack or libraries. In an alternate embodiment the kernel-mode checkpointer is built into the kernel.

Abstract: A data recovery method is provided. In the method, a backup type of a backup data packet is identified. Data recovery is performed based on physically backed up data in the backup data packet in a case that the identified backup type is a hybrid backup, the hybrid backup being a backup process that includes a physical backup and a logical backup. Data recovery is performed on logically backed up data in the backup data packet after the data recovery based on the physically backed up data is completed.

Abstract: A distributed storage system for the long-term storage of data objects that is implemented utilizing one or more distinct storage sites that may be comprised of system controllers and object storage systems that act in concert to embody a single distributed storage system. A system may include a one or more types and/or instances of object storage systems. A system may include object storage systems that are powered on for a limited time as required to complete queued data operations. A system may further include system controllers associated with logical and/or physical sites that coordinate object, user, device, and system management functionally.

Abstract: A method of deleting a first pointer block of a plurality of pointer blocks of a file system from a storage device used by a plurality of applications, wherein the plurality of pointer blocks are each subdivided into sub-blocks, includes the steps of: determining that a first sub-block of the first pointer block is marked as being empty of any addresses of the file system at which storage space is allocated to files of the applications, determining that a second sub-block of the first pointer block has not been marked as being empty; in response to the determining that the second sub-block has not been marked as being empty, determining that the second sub-block does not contain any addresses of the file system at which storage space is allocated to the files of the applications; and deleting the first pointer block from the storage device.

Abstract: Provided is an information processing apparatus that performs alteration detection processing on every occasion of starting a program, comprising a writing component capable of writing a setting indicating whether or not to perform the alteration detection processing to a first region referable by a first program that firstly performs the alteration detection processing on another program and to a second region not referable by the first program at a point when the first program is started. The first program performs the alteration detection processing in accordance with the setting written in the first region, and a second program capable of referring to the second region performs the alteration detection processing in accordance with the setting written in the second region.

Abstract: A method and system for leveraging file-based backups to facilitate bare-metal recovery (BMR) and/or system-state recovery (SSR) operations. In leading to a BMR operation (which may include, but is not limited to, data protected under a SSR operation), logical groupings of data, each including multiple files and/or directories that span across one or more file-systems, may be written to backup media to comply with data backup, archiving, and/or disaster recovery strategies. Backing up said logical groupings of data relies on block-based backup technologies, which upon requiring a subset of a given logical grouping of data to be restored, makes the restoration process impossible to fulfill since determining which blocks of data belong to which files and/or directories are not tracked. Accordingly, the disclosed method and system propose an intelligent scheme through which file-based backup technology may be employed to enable BMR and/or SSR from any single BMR-compliant backup copy.

Abstract: A method for performing a backup operation includes obtaining, by a backup agent, a backup request for a file system, and in response to the backup request: generating a first application partition for an application associated with the file system, performing a dependency analysis on the application to identify application dependency information, populating a first application partition with a copy of the application dependency information and a copy of application data associated with the application, and initiating a storage of a backup to a backup storage system, wherein the backup comprises the first application partition.

Abstract: A method and system for backing up and restoring data includes: determining, at a server storage area network (SAN) node, an LUN required for protection within a server SAN node based on communication between a backup agent and a logic unit number (LUN) agent in the server SAN node; determining a target backup device based on communication between the backup agent and respective target agent of a plurality of backup devices, the plurality of backup devices being connected with the server SAN node; and transmitting a virtual disk control command to the target backup device in response to the backup or restoration being triggered, such that data in the LUN required for protection is backed up to the target backup device or restored from the target backup device via an activated virtual disk interface of the target backup device.

Abstract: A file transfer system that includes a data source, a destination device, and a transfer server. The transfer server is configured to receive a file from the data source and determine a file size of the file. The transfer server is further configured to determine an available disk space for the destination device, to compare the available disk space to the file size of the file, and to determine that the available disk space is less than the file size of the file. In response to the determination, the transfer server is further configured to determine a file type for the file based on content within the file and to identify metadata linked with the determined file type. The transfer server is further configured to extract data from the file corresponding with the identified metadata and to send the data to the destination device.

Abstract: An example computing device includes a first storage device storing a firmware. The computing device also includes a second storage device storing an operating system of the computing device. The computing device further includes a processor. The processor is to retrieve a recovery agent from another computing device via the firmware; validate the recovery agent; execute the recovery agent to retrieve recovery data; validate the recovery data; and repair the operating system using the recovery data via the recovery agent.

Abstract: A method can include obtaining catalog data of a catalog. The catalog can include one or more records. The method can further include detecting one or more damaged records among the one or more records and isolating the one or more damaged records. The method can further include identifying one or more undamaged records among the one or more records. The method can further include transferring the one or more undamaged records to a backup catalog. The method can further include obtaining a transfer status of a first undamaged record of the one or more undamaged records. The method can further include obtaining an access request corresponding to the first undamaged record. The method can further include determining, based on the transfer status, a response to the access request and generating, based at least in part on the backup catalog, a restored catalog.

Abstract: Online restore operations for a database engine can be performed. A request to restore a database to a previous state can be received. Previously stored content of the database, such as snapshot stored prior to the previous state, can be identified along with log records describing changes to be made to the content prior to the previous state. State information in a query engine can be updated based on the previously stored content and log records so that queries can be processed based on the state information at the database restore to the previous state.

Abstract: A RAID data storage system incorporates permanently empty blocks into each stripe, distributed among all the data storage devices, to accelerate rebuild time by reducing the number of blocks that need to be rebuilt in the event of a failure.

Abstract: The present disclosure is a system and method for improved RAID rebuilds under host IO conditions, that greatly improves rebuild times and prevents host IO starvation. A queue in a drive that is part of the RAID is used to store rebuild and host IO requests, with rebuild IOs issued to the head of the drive queue. Rebuild requests in the drive are delayed by a delay time. This delay ensures there is no unintended side effect of this invention that may result in host IO starvation for the RAID system. Delay is computed as a heuristic function from a plurality of variables, such as disk head response times, time allotted for rebuild, number of rebuild threads, drive behavior, rebuild IO profile, host IO profile including workload and locality, and a timeline of sequenced events, which in one preferred embodiment cycles every 70 seconds.

Abstract: A disk array memory system comprises: a plurality of disks in a disk array for storage of content data and parity data in stripes, content data in a same stripe sharing parity bits of said parity data, each disk having a spare disk capacity including at least some of a predefined array spare capacity, said array spare capacity providing a dynamic space reserve over said array to permit data recovery following a disk failure event; a cache for caching content data prior to writing to said disk array; and a controller configured to select a stripe currently having a largest spare stripe capacity, for a current write operation of data from said cache, thereby to write all said data of said current write operation on a same stripe, thereby to maximize sharing of parity bits per write operation and minimize separate parity write operations.

Abstract: A method and system for recovering from stack-overflow or stack-underflow faults without restarting software or hardware. At every task switch operation in an application program, a portion of the memory stack is copied to a backup location, so that portion of the stack can be restored if it is subsequently corrupted by a stack-overflow or stack-underflow fault during the execution of the next task. State variable data is similarly copied to a backup location, so that it can be used to restore or estimate the output of the next task if that task experiences a fault. Techniques are disclosed for selecting which state variable data and which portion of the memory stack to copy to backup, and for detecting a stack-overflow or stack-underflow fault and restoring state variable and memory data in the event of such a fault.

Abstract: High performance, enterprise-level data protection system and method provides efficient block-level incremental snapshots of primary storage devices, and instant availability of such snapshots in immediately mountable form that can be directly used in place of the primary storage device. Related systems and applications are described, including an “Enterprise Image Destination” (EID) for backup images; a mirroring technique whereby a replacement physical primary facility may be created while working with a second storage unit as the primary source file system; and a technique for eliminating redundant data in backup images when multiple systems with partially common contents (e.g., operating system files, common databases, application executables, etc.) are being backed up. A number of examples showing “Fast Application Restore” (FAR) with the use of the invention are also provided.

Abstract: Pursuant to execution of a predetermined failback policy, if a storage device is not preexistent in a source storage system operable in the computing environment, and an owner of the storage device is one of a DR storage system and a storage system having previously withdrawn from a replication grid, and the DR storage system has authorization to transfer ownership of the storage device by a replacement operation, an instance of the storage device is replicated to the source storage system to generate a replicated instance of the storage device on the source storage system, and ownership of the storage device is designated as the source storage system for each of the instance and the replicated instance of the storage device.

Abstract: Methods and apparatus involve migrating workloads and disaster recovery. A snapshot is taken of a source volume using a volume shadow service. Depending whether a user seeks a migration or disaster recovery action, blocks of data read from the snapshot are transferred to a target volume in various amounts. The amounts of transfer include all of the blocks, only changed blocks between the volumes, or only blocks incrementally changed since a last transfer operation. Users make indications for transfer on a computing device storing and consuming data on the volumes and optionally do so in the context of Novell's Platespin® products. Other features contemplate kernel drivers to monitor the blocks of the volumes, as well as techniques for comparing them. Still other features involve computing systems, volume devices, such as readers, writers and filters, and computer program products, to name a few.

Abstract: A backup image generator can create a primary image and periodic delta images of all or part of a primary server. The images can be sent to a network attached storage device and a remote storage server. In the event of a failure of the primary server, the failure can be diagnosed to develop a recovery strategy. Based on the diagnosis, at least one delta image may be applied to a copy of the primary image to generate an updated primary image at either the network attached storage or the remote storage server. The updated primary image may be converted to a virtual server in a physical to virtual conversion at either the network attached storage device or remote storage server and users may be redirected to the virtual server. The updated primary image may also be restored to the primary server in a virtual to physical conversion. As a result, the primary data storage may be timely backed-up, recovered and restored with the possibility of providing server and business continuity in the event of a failure.

Abstract: A method for managing a redundant memory architecture for an information handling system (IHS) may include providing redundant memory for a portion of system memory wherein the redundant memory is configured to mirror data stored in the portion of system memory. The method may further include reporting a parameter associated with the portion of system memory to an operating system of the IHS and executing a program from the portion of system memory.