Abstract: A computer-implemented method for recovering data and concurrently rebuilding indexes for the recovered data in a database for a system configured to store fewer than all indexes in backup files may include copying data from one or more database files and storing the copied data to one or more backup files. A recovery manager executing on a processor may read the copied data from the one or more backup files and write the copied data to the one or more database files, wherein the data is recovered to the one or more database files. In response to the reading, an index manager executing on the processor may initiate a rebuilding of one or more indexes for the copied data at substantially the same time as the reading of the copied data.

Abstract: A cyber-security monitoring (CSM) computer device for responding to cybersecurity threats is provided. The CSM computer device includes a processor in communication with a memory. The processor is configured to monitor a virtual network including plurality of virtual machines, detect a cybersecurity threat to a first virtual machine of the plurality of virtual machines, generate a second virtual machine based on the first virtual machine, adjust the second virtual machine based on the cybersecurity threat, disconnect the first virtual machine from the virtual network to prevent communication between the first virtual machine and the plurality of virtual machines included in the virtual network, and connect the second virtual machine to the virtual network.

Abstract: Serving resources. A method includes receiving from a client, a request for one or more operations to be performed. The method further includes attempting to perform the one or more operations. The method further includes determining that the one or more operations are not complete at a present time. As a result, the method further includes sending a message to the client indicating that the client should attempt to obtain status information for the one or more operations at a predetermined later time. The method further includes receiving a request from the client for status information about the one or more operations. The method further includes repeating sending a message to the client and receiving a request from the client for status information.

Abstract: A data management system for backup, recovery, and mount of a partition including a specific number of records recorded in a time-series mode includes a backup managing part configured to record partition data in a backup file in response to an input conditional clause, and a recovery processing part configured to recover a database by reading the backup file in a case of receiving a recovery instruction, wherein the partition data includes at least a part of time-series data and is classified from other partition data through a partition index to which a recording time of the at least a part of time-series data is applied.

Abstract: Restoring a virtual machine is disclosed. An indication of the virtual machine of a primary site to be restored at a remote site using a copy stored at the remote site of a backup data of the virtual machine of the primary site is received. The virtual machine is restored to the remote site using a backup application deployed at the remote site as a virtual appliance managed using a virtual environment management platform.

Abstract: Application-level replication, the synchronization of data updates within a cluster of application servers, may be provided by having application servers themselves synchronize all updates to multiple redundant databases, precluding the need for database-level replication. This may be accomplished by first sending a set of database modifications requested by the transaction to a first database. Then a message may be placed in one or more message queues, the message indicating the objects inserted, updated, or deleted in the transaction. Then a commit command may be sent to the first database. The set of database modifications and a commit command may then be sent to a second database. This allows for transparent synchronization of the databases and quick recovery from a database failure, while imposing little performance or network overhead.

Abstract: A system, method, and computer program product are provided for handling bulk initial downloads of databases to mobile devices. Rather than straining the resources of a mobile device to recreate the database locally, a server can construct the database to the mobile device's requirements at the server by impersonating the mobile device. The server can then send the database, compressed and over an encrypted session, to the mobile device. The mobile device can then decrypt and uncompress the pages received, and then encrypt them using a local key for secure storage on a local storage device.

Abstract: A single system merges primary data storage, data protection, and intelligence. Intelligence is provided through in-line data analytics, and data intelligence and analytics are gathered on protected data and prior analytics, and stored in discovery points, all without impacting performance of primary storage. As data is written it is automatically mirrored for data protection as part of a High Availability (HA) process. Real-time analysis is done in-line with the HA processing, enabling a variety of data analytics. Data content can be mined from within files or blocks. The gathered intelligence is used to tag objects with extended metadata, enabling both valuable search options and rapid restore options. Data recovery begins with metadata restoration, followed by near-instantaneous access to “hot” regions of data being restored, allowing site operation to continue or resume while a restore is ongoing.

Abstract: A data backup method for a mobile terminal and a mobile terminal including the same. The method includes: receiving a data backup request; backing up information data by blocks and generating backup data of each block; scanning the backup data of each block and generating corresponding statistics information; and storing the backup data and the statistics information of each block.

Abstract: Techniques are disclosed for consuming and integrating with representational state transfer (REST) based services. In one embodiment, a multiple-step extract, transform, load (ETL) job includes one or more REST steps. Each step in the ETL job performs a particular well-defined task, and the REST step in particular constructs REST requests, invokes REST services, and retrieves REST responses. The REST step may be mapped to a vector of inputs such that multiple REST service calls are made for each of the inputs. Further, a reusable connection may be employed so that one connection can be used to make multiple REST service calls. URLs used to make REST service calls may be dynamically constructed based on input data parameters and ETL job parameters. Additionally, a graphical user interface (GUI) allows users to configure aspects of a REST step.

Abstract: A method, executed by a computer, for recording data includes splitting a file into sequential extents, reordering the sequential extents into non-sequential extents, writing the non-sequential extents to a storage medium, writing dummy data to the storage medium, and writing extent placement information corresponding to a placement for the non-sequential extents to the storage medium. A computer program product and computer system corresponding to the above method are also disclosed herein.

Abstract: Implementations are provided for scalable cloud backup. A coordinator process can manage worker processes on nodes to package file system data that is targeted for cloud backup into node local upload objects. File data can be arranged into distinct block offsets of the node local upload object. A set of metadata tables can be generated that characterize each file that is backed up as well as file block location information for each data block. The node local upload objects can be uploaded to a cloud service provider. The set of metadata tables generated by the worker process can be coalesced into a global set of metadata tables that describe the data that has been backed up. In one implementation, after an initial cloud backup has occurred, a snapshot service of the file system can be used to incrementally backup blocks of the file that have been changed.

Abstract: A system and method for data storage by shredding and deshredding of the data allows for various combinations of processing of the data to provide various resultant storage of the data. Data storage and retrieval functions include various combinations of data redundancy generation, data compression and decompression, data encryption and decryption, and data integrity by signature generation and verification. Data shredding is performed by shredders and data deshredding is performed by deshredders that have some implementations that allocate processing internally in the shredder and deshredder either in parallel to multiple processors or sequentially to a single processor. Other implementations use multiple processing through multi-level shredders and deshredders. Redundancy generation includes implementations using non-systematic encoding, systematic encoding, or a hybrid combination.

Abstract: Collecting bandwidth data includes producing master and slave text files in response to simultaneous collection of data samples from a network device by servers, generating a clean data file by sorting data in the master and slave text files by the network device port, sorting data samples for the port by collection time, and for each of the samples: adding a designated interval of time to a time on the network device resulting in a target network device time whereby the time on the network device corresponds to a time the data sample was collected, examining data samples in the master and slave text files corresponding to the time the respective data samples were collected, selecting from one of the master and slave text files the sample with a collection time most closely matching the target network device time, and storing the selected sample in the clean data file.

Abstract: De-duplicating results of queries of data repositories is described. A system associates each data object of the first set of duplicate data objects stored by multiple data repositories with a first unique duplicate set identifier, and each data object of the second set of duplicate data objects stored by the multiple data repositories with a second unique duplicate set identifier. The system identifies a first data object of the first set of duplicate data objects and a second data object of the first set of duplicate data objects in response to a query. The system determines that the first data object is associated with the first unique duplicate set identifier, and that the second data object is also associated with the first unique duplicate set identifier. The system outputs a query result that includes only the first data object.

Abstract: Autosave and manual save modes in an application user interface on a computing device are provided. The computing device may be utilized to display a menu for receiving a selection of a menu option from the application user interface. The application user interface may display an electronic document to be saved. The menu option may include an option for switching between an autosave mode and a manual save mode for saving the electronic document. A selection of the menu option may then be received by the computing device. The computing device may then be utilized to activate one or more unique features associated with either the autosave mode or the manual save mode, based on the selected menu option, from the application user interface.

Abstract: A method, article of manufacture, and apparatus for transferring data from a source tier to a target tier. In some embodiments, this may include dividing an object stored in the source tier into a plurality of segments, determining if the target tier is missing at least one of the segments, writing the missing segments to the target tier, and deleting the object from the source tier. In some embodiments, the object's metadata is updated to indicate that the object is in the target tier.

Abstract: A method for execution by one or more processing modules of a distributed storage network includes encoding a data segment of data using a dispersed storage error coding function to produce a write threshold number of encoded data slices and identifying primary storage units available for storing the write threshold number of encoded data slices. The method further includes issuing a write slice request that includes a slice name and an encoded data slice corresponding to each of the available primary storage units. For those primary storage units that are unavailable the method continues by selecting a storage approach for storing an encoded data slice and selecting a foster storage unit. The method continues by issuing a write imposter slice request to each selected foster storage unit, where the imposter encoded data slice includes an information dispersal algorithm (IDA) index corresponding to the associated unavailable storage unit.

Abstract: Managing versions of an electronic entity comprising many independently managed, but mutually-dependent, subcomponents can be challenging. File management functionality is provided for use with an integrated development environment to produce a visual indication of the relationships among the subcomponents. The approach described herein provides an improvement over source code control systems and backup systems in the ability to revert the state of one or more files as their content existed at an historical time point. The technique does not require a user to predict in advance at which time points the content state of one or more files will be interesting as historical time points for future use.

Abstract: Computer-implemented methods and apparatuses for application testing are provided. Such apparatuses may include a data repository that stores a copy of at least some of a set of stored reference data. Such apparatuses may also include a test data generation component that generates a set of input data for testing the application. The test data generation component may process a set of received input data and the set of stored reference data according to a data processing operation. The set of received input data and set of stored reference data may each comprise one or more attributes, each with at least one value. The test data generation component may generate the set of input data by selecting at least one value from the copy of the set of stored reference data, and outputting the selected at least one value in the generated set of input data for testing the application.

Abstract: The method includes identifying, by one or more computer processors, a first content consumed by a user. The method further includes identifying, by one or more computer processors, objects in the first content. The method further includes identifying, by one or more computer processors, a second content on the Internet that is similar to the first content, wherein the second content includes one or more objects that reach a threshold similarity to the identified objects in the first content. The method further includes identifying, by one or more computer processors, a date of creation for the identified first content and the date of creation of the second content. The method further includes arranging, by one or more computer processors, the identified first content and the identified second content in chronological order.

Abstract: A fast snapshot is configured to determine if a snapshot is utilized for asynchronous mirroring. The fast snapshot operation is performed by avoiding reference counts of the one or more data units associated with the snapshot from being updated at a creation time and a deletion time when the snapshot is utilized for asynchronous mirroring.

Abstract: A system for building a restore list for a restore includes a processor and a memory. The processor is configured to determine whether a next sibling record of a directory index record of a root directory includes a subdirectory or a file, wherein the content of the directory index is determined from an incremental backup of the root directory. In the event that the next sibling record comprises a subdirectory of the root directory, the processor is configured to push a directory path associated with the next sibling record onto a directory stack. In the event that the next sibling record comprises a file, the processor is configured to add the latest index record associated with the file to a restore list in the event that the file is not already in the restore list. The restore list is provided for a restore of the state of data of the root directory at a desired time.

Abstract: A node based architecture that supports arbitrary access to any node in a system for data representation and access, while still providing virtual volume coherency that is global to all of the nodes in the system, and while providing underlying data management services that are also variously accessible from any node in the system.

Abstract: The present disclosure relates to a data storage system, and processes and computer programs for such data storage system, for example including processing of: managing one or more metadata tree structures for storing data to one or more storage devices of the data storage system in units of blocks, each metadata tree structure including a root node pointing directly and/or indirectly to blocks, and a leaf tree level having one or more direct nodes pointing to blocks, and optionally including one or more intermediate tree levels having one or more indirect nodes pointing to indirect nodes and/or direct nodes of the respective metadata tree structure; maintaining the root node and/or nodes of at least one tree level of each of at least one metadata structure in a cache memory; and managing I/O access to data based on the one or more metadata structures.

Abstract: Embodiments are described for automatic backup and replication of virtual machines in a virtual center. A system or processor-based operation defines policies governing backup conditions and criteria for backing up and recovering the virtual machines, continuously polls the VMs of the virtual center to determine the health or change in each virtual machine. A backup component backs up at least one VM by copying or transferring data including content and state information of the VM to a storage device or other virtual center. The system detects if a failure condition or change in excess of a defined threshold value exists for any virtual machine, and if so, initiates a recovery operation, and then sends a message to the system administrator regarding the backup and recovery.

Abstract: An apparatus for data replication is disclosed. A method and computer program product also perform the functions of the apparatus. In one embodiment, an apparatus includes a replication module configured for replicating, in response to a determination that a received object corresponds to a storage policy, the received object to a data storage node. The apparatus also includes a tagging module configured for marking the received object with a file attribute indicative of the received object being excluded from migration to a cold storage device during the replicating, and removing the file attribute after the replicating. The apparatus may also include a migration module configured for migrating, in response to a determination that the file attribute has been removed, the received object to the cold storage device.

Abstract: Disclosed methods and systems leverage resources in a storage management system to partially synchronize primary data files based on synchronizing selected portions thereof without regard to changes that may be occurring in other non-synchronized portions. Accordingly, a number of primary data files may be partially synchronized by synchronizing designated portions thereof via auto-restore operations from backup data. This approach relies on storage management resources to designate portions of source data that is to be kept synchronized across any number of targets; detect changes to the designated portions; back up changes to secondary storage; and distribute the changes from secondary storage to the associated targets, with minimal impact to the primary data environment. The approach may be mutually applied, so that changes in any one of an associated group of source data files may be likewise detected, backed up, and distributed to the other members of the group.

Abstract: In a hierarchical storage memory (HSM), a file recalled by a specific application is migrated as soon as possible after completion of the application process. Specifically, the effective UID of a specific process is preregistered on an HSM client. After a recall operation is performed on a certain file from the user ID, when there is no access from the UID to the file for a given length of time, the file is migrated. This prevents files premigrated by access from any application other than the specific one from being handled in the same way, resolving a disadvantageous problem caused when these (premigrated) files are not desired to be migrated preferentially.

Abstract: Data from applications is published using a web feed document such as according to the Really Simple Syndication (RSS) protocol. The applications can be information technology (IT) services, such as an Application Performance Management program and a Service Desk program, which are used by an organization. The data is received at an Application Programming Interface (API) and stored in a database in a format which is usable by the web feed document. For example, the data can provide a parameter name, parameter label, severity and user type which are associated with placeholder elements in the web feed document. The user type may be used to restrict the publishing of certain parameters to certain users based on their business roles in an organization. The feed server may provide additional details in response to the user selecting a hyperlink in the web feed document.

Abstract: A method, non-transitory computer readable medium and storage server computing device that allocates monotonically increasing sequence numbers to storage operations based on an order of the storage operations corresponding entries in a log. The storage operations are sequenced including by identifying a subset of the storage operations that are parallelizable. A file system data structure is allocated and populated with data associated with one of the storage operations. A determination is made when a rollback is detected based on whether a replay ledger index field of the file system data structure comprises one of the sequence numbers that is greater than another one of the sequence number corresponding to the one of the storage operations. The another one of the sequence numbers is inserted into the replay ledger index field, when the determining indicates that a rollback is not detected.

Abstract: An information processing apparatus includes a search unit, a selection unit, and a mounting processor. The search unit is configured to search for a plurality of roll back points of a file system. The selection unit is configured to select, from the plurality of roll back points searched for by the search unit, a roll back point corresponding to an operation made by a user. The mounting processor is configured to mount the file system at the roll back point selected by the selection unit to a read-only state, and further mount the file system to a readable and writable state according to an operation made by the user.

Abstract: A method is used in managing snapshots of data. Identity information of a snapshot of data is updated. The snapshot represents a state of the data at a particular prior point in time. A new snapshot of the data is created. The new snapshot is created based on the identity information of the snapshot.

Abstract: Provided are a computer program product, system, and method for assigning device adaptors to use to copy source extents in source ranks to target extents in target ranks in a copy relation. A determination is made of an order of the target ranks in the copy relation. Target ranks in the copy relation are selected according to the determined order. For each selected target rank, indication is made in a device adaptor assignment data structure of a source device adaptor and target device adaptor of the device adaptors to use to copy the source rank to the selected target rank indicated in the copy relation, wherein indication is made for the selected target ranks according to the determined order. The source ranks are copied to the selected target ranks using the source and target device adaptors indicated in the device adaptor assignment data structure.

Abstract: A system can maintain multiple queues for deduplication requests of different priorities. The system can also designate priority of storage units. The scheduling priority of a deduplication request is based on the priority of the storage unit indicated in the deduplication request and a trigger for the deduplication request.

Abstract: Techniques for partition balancing. Organization identifiers (orgIDs) are acquired for one or more organizations within a multi-organization on-demand services environment having multiple nodes, each of which have one or more partitions. A mapping of the orgIDs to the partitions within the multi-organization on-demand services environment is determined. Resource consumption for the organizations is determined. Resource consumption for the partitions based on the resource consumption of the organization and the mapping of the organization to the partitions is determined. A score for the partitions based on the resource consumption is generated. The partitions are redistributed among the nodes based on the partition scores.

Abstract: A database recovery and index rebuilding method involves reading data pages for a database to be recovered as recovery bases; retrieving all log records from stored post-backup updates and sorting the retrieved log records; as the data pages to be recovered are read, applying the sorted log records to their respective data pages; as the applying completes for individual data pages, extracting and sorting index keys from the individual data pages for which the applying is complete, until all index keys have been extracted from all individual data pages and sorted; on an individual recovered page basis, writing the recovered individual data pages into the database; and when all index keys have been extracted and sorted from all of the recovered individual data pages, rebuilding indexes of the database using the sorted index keys and writing the rebuilt indexes to the non-transitory storage.

Abstract: A data storage system uses the free space that is not yet filled with data after the deployment of the data store. The free space is used to store additional ‘opportunistic’ protection information for stored data, possibly above and beyond the specified protection level. As the system fills up, the additional protection information is deleted to make room for more data and specified protection information.

Abstract: Backup objects, native security descriptors that describe access rights to the backup objects, and object metadata are received from platforms where each backup object has corresponding object metadata. Each native security descriptor is transformed into a platform independent security descriptor. A partitioned structure is generated, including by associating each platform independent security descriptor with those object metadata that correspond to the plurality of backup objects for which that platform independent security descriptor describes access rights to.

Abstract: Systems and methods for checking data integrity of a data object copied between storage pools in a storage system by comparing data samples copied from data objects. A series of successive copy operations are scheduled over time for copying a data object from a source data store to a target data store. A first data sample is generated based on a sampling scheme comprising an offset and a period. A second data sample is generated using a similar sampling scheme. The blocks of data in the first data sample and the second data sample are compared to determine if they differ to thereby indicate that the data object at the target store differs from the corresponding data object at the source data store.

Abstract: Methods, systems, apparatus, and computer programs encoded on computer storage medium for automatically migrating on-premise data objects used by an on-premise application to on-demand data objects used by an on-demand application including retrieving mapping rules corresponding to the on-premise data objects from a rule repository; extracting data corresponding to on-premise data objects that are affected during execution of the on-premise application, the on-premise application being executed within an on-premise computing environment, the data being stored in an on-premise database based on an on-premise database schema; generating an export file comprising the data; generating an import file based on the export file and the mapping rules, the import file comprising the data; and providing the import file to an on-demand computing environment that hosts the on-demand application, the import file being process-able by the on-demand computing environment to write the data from the import file into an on-dema

Abstract: A method for defragmenting volumes in a mirrored system. The method includes determining that a defragmentation process has been performed on a second server. The method further includes storing a before and after mapping of a second set of tracks, wherein the before and after mapping includes information identifying at least one track of the second set of tracks and a corresponding first location of the respective track before the performing of the defragmentation process and a second location of the respective track after the performing of the defragmentation process and sending an indication to a first server to relocate at least one track of a first set of tracks on the first server from a first location on the first server to a second location on the first server according to the stored before and after mapping of the corresponding second set of tracks on the second server.

Abstract: A distributed backup method includes defining a server group having a plurality of server computers, and providing each server computer with an identical backup policy and an identical storage policy. The method also includes transmitting, at each server computer of the server group to every other server computer of the server group, advertisement messages describing available storage space for storing backups, and receiving, at each server computer from the server, at least some of the advertisement messages. The method also includes identifying, at a first server computer using the backup policy, at least a first service to be backed up, selecting a second server computer using the received advertisement messages, transmitting, from the first server computer to the second server computer, a backup including information corresponding to the at least one service, and storing the backup, by the second server computer using the storage policy.

Abstract: Input backup data is deduplicated with data of a synthetic backup previously constructed by a deduplication storage system. A synthetic backup is constructed by processing metadata instructions provided by a backup application. Deduplication digests are calculated based on the data of the synthetic backup and the deduplication digests are stored in a digests index. When new backup data is processed, deduplication digests of the new data are calculated and searched in the digests index. Matching digests of previously constructed synthetic backups are located in the digests index. Each of the located matching digest references stored data are included in the synthetic backup, and the stored data is similar to the input backup data. Data matches are found in the input backup data and data in the synthetic backup.

Abstract: A backup method is provided for a file system for managing hierarchical storage including one or more storage media on a computer system including one or more computers. Each of the one or more storage media includes a data part which is separated from an index and on which updated information is appended and kept. Each of a plurality of pieces of data within the file system is managed to be migrated to at least any of the one or more storage media. The backup method includes backing up metadata of the plurality of pieces of data migrated within the file system; and backing up the index of each of the one or more storage media to which the plurality of pieces of data have been migrated, substantially at the same time point as the metadata.

Abstract: A method, article of manufacture, and apparatus for providing content services on a distributed file system is discussed. These services may be applied to files, data blocks, and/or metadata. A content fabric that resides within or sits along side the distributed file system may apply the services.

Abstract: Some embodiments provide, for a particular device in a set of related devices, a method for backing up data synchronized between the devices. The method receives a command to create a backup for a subset of data synchronized between a subset of the devices, which is a subset of all data synchronized between the devices. The method identifies the subset of synchronization data from the set of all synchronization data. The subset of synchronization data is tagged as pertaining to a particular set of criteria for synchronization between only the subset of devices. The method stores a backup of the subset of synchronization data in a backup storage encrypted in such a way that requires a recovery key associated with any one of the devices in the subset of devices to access the backup while preventing access to the backup with recovery keys of any of the other devices.

Abstract: An information processing apparatus configured to record logs includes a log collection unit that collects logs recorded according to executed functions and store an audit log file including the collected logs, a detection unit that detects an error in the collection of logs recorded according to the executed functions, and a control unit that, when the error is detected, compresses the stored audit log file and separately stores the compressed log file while continuing to collect logs.

Abstract: Programmatic generation of an actionable recovery workflow from data stored inside a Configuration Management Database which may be primarily populated through automated discovery. The programmatic workflow can be sent to an orchestration engine for execution, leveraging underlying automation components.

Abstract: Processing devices receive a file having entries having data items separated by delimiters. Each data item has an ordinal position. The processing device(s) cause display of a table, having rows and columns, in a graphical user interface. Each data items of a particular entry appears in a respective column of the same row. Each column corresponds to the ordinal position of its respective data item. User input is received designating, for each respective column, a field name and an entity definition component type to which the respective column pertains, and stores for each of the data items of the particular entry a value of an element of an entity definition. The element has the element name designated for the respective column in which the data item appeared, and is associated with an entity definition component having the type designated for the respective column in which the data item appeared.