Abstract: The present invention provides a data copying method, a direct memory access controller, and a computer system. The data copying method of embodiments of the present invention includes reading, by a DMA controller, target data from storage space corresponding to a source physical address of the target data by using an ACP, where the storage space corresponding to the source physical address includes a first buffer; and storing, by the DMA controller, the target data into storage space corresponding to a destination physical address of the target data by using the ACP, where the storage space corresponding to the destination physical address includes a second buffer. The embodiments of the present invention can lower CPU usage.

Abstract: A computer-implemented method to store data may include writing data to at least one of a database or one or more local storage devices. The method may also include generating redundancy information for the data. The method may also include writing the redundancy information to at least one of a remote storage device or a removable storage device.

Abstract: In one implementation, this disclosure provides a method for executing a partial band rewrite operation comprising identifying a first track of a shingled data band to receive data of a write received at a shingled media storage device and writing a first subset of the received data to a media cache, where the first subset corresponds to the first track of the shingled data band to receive data of the write command. The method also includes writing a remaining subset of the received data to target locations within the shingled data band without updating data on the first track within the shingled data band corresponding to the first subset of the received data.

Abstract: Storage management is performed by detecting installation of at least one new physical tape drive in a storage system. The storage system may include a plurality of tape drives. The plurality of tape drives include physical tape drives and virtual tape drives. Based on the detection, a unique name of at least one virtual tape drive is transferred to the at least one new physical tape drive.

Abstract: A system includes a data store and a memory cache subsystem. A method for pre-fetching data from the data store for the cache includes determining a performance characteristic of a data store. The method also includes identifying a pre-fetch policy configured to utilize the determined performance characteristic of the data store. The method also includes pre-fetching data stored in the data store by copying data from the data store to the cache according to the pre-fetch policy identified to utilize the determined performance characteristic of the data store.

Abstract: Systems and methods are described herein for modular expansion of data storage libraries. In one or more embodiments, an apparatus for modularly expanding a base module apparatus comprises a plurality of drive trays and a network switch for coupling the apparatus to the base module apparatus. The first drive tray may be coupled to the network switch and include a first hardware processor that sends status information about a first hardware device to the base module apparatus over a first network path. The second drive tray may also be coupled to the network switch and include a second hardware processor that sends status information about a second hardware device to the base module apparatus over a second network path. Network addresses may be assigned to the hardware devices based on the module's position in the library relative to the base module.

Abstract: An example system for committing metadata to a non-volatile storage device may include a controller that includes determines a count of metadata that has been altered after being committed to the non-volatile storage device. Based on the count being above a first threshold, the controller may prevent alterations to the metadata. Based on the count being above a second threshold, the controller may commit the altered metadata to the non-volatile metadata.

Abstract: A mechanism for multiple coexisting configurations support in virtual tape applications. Specifically, the introduction of various additional computer processes facilitate the introduction or modification of user specific configurations on a virtual tape solution: (i) without requiring the shutdown and re-initialization of the virtual tape solution; and (ii) without compromising the performance of computing resources allocated towards the implementation of other user specific configurations already existing on the virtual tape solution.

Abstract: A computer-implemented method, according to one embodiment, includes: receiving a read request for data stored on a magnetic tape, determining whether a copy of a portion of the requested data is located in a cache, instructing a tape drive to access portions of the requested data determined to not be located in the cache, for each of the portions of the requested data that are not located in the cache, determine whether performing a locate command or performing a read command a plurality of times will retrieve the portions of the requested data in a shorter amount of time, issuing the command determined to retrieve the portions of the requested data in the shorter amount of time, combining the portions of the requested data that are not located in the cache with the portion of the requested data located in the cache, and satisfying the read request.

Abstract: In various embodiment, the present invention teaches a sequencer that identifies an address point of a first data block within a memory and a length of data that comprises that data block and is related to an input of a matrix processor. The sequencer then calculates, based on the block length, the input length, and a memory map, a block count representative of a number of data blocks that are to be retrieved from the memory. Using the address pointer, the sequencer may retrieve a number of data blocks from the memory in a number of cycles that depends on whether the data blocks are contiguous. In embodiments, based on the length of data, a formatter then maps the data blocks to the input of the matrix processor.

Abstract: In various embodiments, a method comprises detecting a removable media device coupled to a digital device, authenticating a password to access the removable media device, injecting redirection code into the digital device, intercepting, with the redirection code, a request for data, determining to allow the request for data based on a security policy, and providing the data based on the determination. The method may further comprise selecting the security policy from a plurality of security policies based, at least in part, on the password and/or filtering the content of the requested data. Filtering the content may comprise scanning the data for malware. Filtering the content may also comprise scanning the data for confidential information.

Abstract: A processing device of a storage server that manages a plurality of physical storage devices arranged in a plurality of stripes receives a request to write data. The processing device determines a total number of available stripe units to satisfy the request, identifies one or more stripes of the plurality of stripes that collectively include at least the total number of available stripe units, allocates the one or more stripes to the request, and stores the data for the request in the available stripe units of the one or more stripes.

Abstract: Data volumes for a customer can be placed on various storage tiers, including different hardware types or storage systems, that are determined to be appropriate for the anticipated usage of those data volumes. The actual usage can be monitored to determine one or more types of workload for the data volume, and a determination made as to whether all, or portions, of the data volume could obtain a significant performance improvement by being migrated to a different storage tier. In some instances the chunks or partitions of a volume can be concurrently distributed across multiple different storage tiers in order to satisfy various performance and/or cost criteria. Once workload information is available for a customer, that information can be used to determine the storage tiers for initial placement of subsequent data volumes.

Abstract: According to one embodiment, a storage system includes a nonvolatile memory and a controller. The controller classifies blocks in the nonvolatile memory into a plurality of first blocks and a plurality of second blocks organized as a plurality of block groups each including a set of blocks. The controller receive a first read, write or erase command from a host, and performs a read, write or erase operation on one first block in the first blocks that is designated by a physical address of the first read, write or erase command. The controller receive a second read, write or erase command from the host, and performs a read, write or erase operation on blocks in one block group in the block groups that is designated by a physical address of the second read, write or erase command.

Abstract: Methods, systems and devices to stream media content are described. A user interface is presented to a user via a media device. When the media device has determined that an interaction with the user interface has occurred (e.g., the user has begun scrolling through a list, or has performed a keyword search), the media device requests, from a media content source, a subset of first media content based on the interaction with the user interface and prior to selection of the first media content via the user interface. The subset of first media content is then displayed in response to the selection of the first media content.

Abstract: Reducing time required to write a file to tape is provided. Synchronous processing is performed in a file system implementing a Linear Tape File System (LTFS) file format, wherein the synchronous processing includes writing, to a tape medium of a tape cartridge, index information and one or more files. A type of the synchronous processing is determined, wherein the type is either an index-MAM sync type or an index-only sync type. Updated information is stored to a media auxiliary memory of the tape cartridge in response to determining that the synchronous processing is of the index-MAM sync type.

Abstract: A mechanism for non-disruptive virtual tape drives removal and reconfiguration. Specifically, the introduction of various additional computer processes permit the removal and reconfiguration of a virtual tape drive without requiring the shutdown and re-initialization of the host application on which the virtual tape drive is being emulated.

Abstract: A storage area network comprises: one or more replicating source and target storage volumes accessible by one or more hosts; a volume replication status checker for determining an active replication relationship between a source storage volume and a target storage volume; and a volume visibility engine for setting the target storage volume to be hidden from a host if the target storage volume is visible to the host and has a determined active relationship. The volume replication status checker is further for determining an inactive replication relationship between a source storage volume and a target storage volume; and the volume visibility engine is further for setting the target storage volume to be visible to a host if the target storage volume is hidden from the host and has a determined inactive replication relationship.

Abstract: A storage system and method are provided for flush optimization. In one embodiment, a storage system is provided comprising a cache, a non-volatile memory, and a controller. The controller is configured to: store, in the cache, data received from a host and to be written in the non-volatile memory; receive a command from the host to move the data stored in the cache into the non-volatile memory; without having executed the command, send a confirmation to the host that the command was executed; and execute the command after sending the continuation to the host.

Abstract: A backup is performed by collecting in a report database attributes associated with a filer and backup application. Rules are stored in a rule database specifying one or more backup configuration settings to be applied when a rule is satisfied. A request is received from the backup application to perform a backup of a dataset stored on the filer. Attributes associated with the filer and backup application are fetched from the report database. A rule from the rule database is evaluated against attributes fetched from the report database and associated with the filer and backup application. Based on the rule evaluation, a configuration setting for the backup is generated. The filer is instructed to perform the backup according to the configuration setting.

Abstract: A computer-implemented metadata processing method and a system includes writing metadata to or reading metadata from a storage medium in which an index that contains metadata of each of one or more pieces of data is stored. The method and system include determining, in response to a processing request, which includes a write request or a read request, when to communicate with a storage area outside the index. At least a portion of content of the metadata relating to the processing request is processed, and accessed, including storing or obtaining, in the index, location information indicating the storage area of the portion of content of the metadata.

Abstract: A storage technique includes selectively tagging a set of write requests by applying tags to write requests that are pursuant to copy operations and not applying tags to at least some write requests that are not pursuant to copy operations. For each of the set of write requests, the technique further includes performing a decision operation configured to (i) direct the write request down a first processing path that supports inline deduplication in response to the write request satisfying a set of criteria and (ii) direct the write request down a second processing path that does not support inline deduplication in response to the write request failing to satisfy the set of criteria. The set of criteria include whether the write request has a tag applied, such that the decision operation preferentially directs write requests down the first processing path in response to the write requests being tagged.

Abstract: A computer-executable method, computer program product, and system for parsing a data log from a device, the computer-executable method comprising receiving the data log from the device, sampling the data log to create a sampled portion of data, wherein the sampled portion of data includes each attribute in the data log, constructing a metadata table based on the sampled portion of data, constructing data dictionaries based on the sampled portion of data, and parsing the data log using the metadata table and the data dictionaries to create a data field mapping table.

Abstract: An example computer-implemented method for restoring data consistency in a RAID array can include detecting failure of a disk of the RAID array, maintaining tracking information for write input/output (“I/O”) operations that effect a data block or a parity block stored on the failed disk, re-commissioning the failed disk and re-synchronizing the RAID array using the tracking information. The tracking information can be used to restore consistency to at least one of the data stripes. For example, the RAID array can store data in one or more data stripes, where each data stripe has a plurality of data and parity blocks. Additionally, the data stripes to which consistency is restored can include a data block or a parity block that is stored on the re-commissioned disk and that is effected by the write I/O operations and stored on the re-commissioned disk.

Abstract: A memory that includes a data partition and an index partition is mounted. The data partition includes an original data and an original index written directly after the original data. The index partition includes the original index at the beginning of the index partition. The first data is written to a data partition of the memory. The first data is written directly after the at least one data on the data partition and the original index is deleted and invalidated. Responsive to a time interval elapsing, a first index is written to the data partition of the memory directly after the first data. The time interval starts at the writing of the first data. Responsive to the time interval elapsing, the first index is written to the index partition of the memory at the closest location, in terms of movement time, to the first index on the data partition.

Abstract: Systems and techniques are provided for managing performance of a backup environment. A set of rules are stored, with each rule specifying a threshold value of a backup configuration parameter. Configurations of the backup environment are periodically obtained. Each obtained configuration includes a current value of the backup configuration parameter. A determination is made for each configuration as to whether the current value exceeds a suggested value, where the suggested value is based on the threshold value. If the current value exceeds the suggested value, an entry including an alert of a first type is written to a log. The log is analyzed, and if the frequency of entries in the log including alerts of the first type exceeds a threshold frequency, an entry including an alert of a second type, different from the first type, is written to the log. The threshold value of the backup configuration parameter may specify a maximum number of backup streams or a maximum number of backup clients, for example.

Abstract: One embodiment is related to a method for determining a faulty hardware component within a data storage system, comprising: collecting data relating to a plurality of input/output (IO) errors associated with a first storage processor within the data storage system; compiling IO error statistics based on the data relating to the plurality of IO errors; and determining a faulty hardware component based on the IO error statistics, wherein the determining of the faulty hardware component comprises utilizing a second storage processor of the data storage system independent from the first storage processor.

Abstract: Embodiments of the present invention provide methods, systems, and computer program products for estimating mount time completion in file systems. In an embodiment, at a time of unmounting storage media, an index file is provided, which records information stored in the storage media. Information associated with a number of tags of the index file, the types of contents of the tags, and a size of the contents of an element are stored, in response to an unmounting operation of the storage media. A predicted time associated with loading the index file into the memory during a mounting operation of the storage media is calculated, based on the stored information.

Abstract: A data protection scheduling system provides a flexible or rolling data protection window that analyzes various criteria to determine an optimal or near optimal time for performing data protection or secondary copy operations. While prior systems may have scheduled backups at an exact time (e.g., 2:00 a.m.), the system described herein dynamically determines when to perform the backups and other data protection storage operations, such as based on network load, CPU load, expected duration of the storage operation, rate of change of user activities, frequency of use of affected computer systems, trends, and so on.

Abstract: Linear Tape File System that can accommodate various storage orders, such as sequential and reverse sequential, on a tape medium. The storage order may be reversed (or otherwise changed) at the block level and also the bit order within the block level. The LFTS related data associated with the LFTS file system stores data sufficient to indicate storage order (for example, reverse), so that the motions of the tape medium and tape drive can be coordinated during reading or erasing operations to be performed in the correct order, with a view to the order the data was stored on the tape. Storing data in reverse order on an LFTS tape can lead to certain operational advantages.

Abstract: The present disclosure describes processing a write command directed to a block-based main storage device, and having a target logical sector and write data. The processing may include writing an address of a physical sector in the main storage device that contains the target logical sector to a header portion of a scratch block stored in a byte-addressable storage. The write data may be written to a slot the scratch block. The scratch block may be committed a scratch block in persistent storage. Subsequent to processing the write command, a write completion response may be signaled to the sender of the write command to indicate to the sender completion of the write command, without having committed the write data to the main storage device. Write data from several write commands may be subsequently committed to the main storage device.

Abstract: A memory controller includes a scheduler that decides a processing order of a plurality of requests provided from an external device with reference to a timing parameter value for each of the requests; and a timing control circuit that adjusts the timing parameter value according to a corresponding address to access a memory device, the corresponding address being used to process a corresponding request of the plurality of requests.

Abstract: A computer-implemented method includes receiving, from a cloud server by a vehicle, a manifest indicating network locations of software updates determined according to an interrogator log generated by the vehicle; installing update binaries retrieved from the network locations to an inactive installation of a plurality of storage installations; and setting the inactive installation to be an active installation upon vehicle restart, in place of another of the storage installation currently set as the active partition.

Abstract: A total bytes written (TBW) requirement associated with solid state storage is obtained. A size of a cache associated with the solid state storage is determined based at least in part on the TBW requirement.

Abstract: Described herein is an extensible extract, transform and load (ETL) framework. In accordance with one aspect of the framework, a file location object and a corresponding file format object are retrieved from a repository. The file location object stores file location parameters that specify a remote file system directory and a local file system directory, while the file format object stores location configuration parameters that specify a data file and the file location object. The data file may be transferred from the remote file system directory to the local file system directory according to the file location parameters and the location configuration parameters. An extract, transform and load (ETL) job may then be performed on the data file to generate an output file.

Abstract: Application program data stored in system memory may be selectively persisted. An indication may be provided to an application program that an application data object or a range of application data stored in system memory may be treated as persistent. Data backup may be enabled for the application data object or range of application data in the event of a system failure, copying the application data object or range of application data from system memory to non-volatile data storage. Upon recovery from a system failure, further data backup for the application data object or the range of application data may be disabled. In some embodiments, at least some of the application data object or range of application data may be recovered for the application program to access. Data backup for the application data object or the range of application data may also be re-enabled.

Abstract: A method for writing a plurality of files includes receiving data of the plurality of files requested to be written to a tape from an application of a host, dividing a group of the received plurality of files into segments with specified sizes, and writing a series of the plurality of respective segments of the group of the plurality of files in sequence in a specified order, the respective segments having the specified sizes, wherein when writing the segments in the specified order, a left end portion of the tape is positioned and respective top segments of the files are first collectively written thereto.

Abstract: Techniques and constructs to facilitate data management can provide improved response time and space efficiency for time-series data such as from connected devices. The constructs may enable receiving a stream of time-series data comprising a plurality of objects and a time identification associated with each of the objects. One or more tags are associated with the objects. The constructs may also chunk the stream into a plurality of contiguous chunks, each including a plurality of objects, create an index associating the time identification and the one or more tags, transmit the chunks to a first, remote storage, and then store the index.

Abstract: The present invention relates to a method and system for providing parity protection in an object storage system. The present invention allows for tracking the storage requirements for chunks in a distributed storage cluster when transitioning from replica-based protection to parity or erasure coding-based protection and when transitioning from parity or erasure coding-based protection to replica-based protection.

Abstract: Batch job data staging combining synchronous/asynchronous staging. In pre-processing, a stage-in source file, and a target file for stage-out, in permanent storage, are identified using a batch script. From data amounts, time for stage-in/stage-out to/from temporary storage are estimated. Stage-in is based on the time, stage-out being asynchronous, and each asynchronous staging is classified short/long term depending on the time, each staging being recorded in a table. If a source file is modified, incremental staging is added to the table. With a staging list scheduling for batch jobs stage-in is performed, monitoring progress in the table, and resources may be allocated for the jobs nodes without waiting for stage-in to complete. The job generates results in the temporary storage, and using post-processing, stage-out transfers results to the target file in permanent storage.

Abstract: A method of providing one or more computing devices with access to a plurality of resources. The plurality of resources are provided by at least one physical device. The method comprises, at a first control element receiving a data packet transmitted by one of said one or more computing devices, and determining whether said data packet comprises a command including a first logical identifier identifying one of said resources. If it is determined that said data packet comprises a command including a first logical identifier a second logical identifier is obtained, the second logical identifier being associated with said first logical identifier and identifying said one of said resources. A request including said second logical identifier is transmitted to a second control element, the second control element being arranged to identify a physical device associated with said second logical identifier and to forward said request to the identified physical device.

Abstract: Virtual computing instance data that are stored across multiple storage volumes are replicated in a manner such that the write order is maintained. The frequency of the replication is set so that the recovery point objective defined for the VM data can be satisfied. The replication includes the steps of determining a set of logical storage volumes across which the virtual computing instance issues dependent write IOs, issuing a first command to the virtual computing instance to block new IOs and to block receipt of IO acknowledgements, issuing a command to create replicas of all the logical storage volumes in the set, and then issuing a second command to the virtual computing instance to unblock new IOs and unblock receipt of IO acknowledgements.

Abstract: An information processing apparatus, backup method, and program product that enable efficient differential backup. In one embodiment, an information processing apparatus for files stored in a storage device includes: a metadata management unit for managing metadata of files stored in the storage device; a map generation unit for generating a map which indicates whether metadata associated with an identification value uniquely identifying a file in the storage device is present or absent; and a backup management unit for scanning the metadata to detect files that have been created, modified, or deleted since the last backup, and storing at least a data block and the metadata for a detected file in a backup storage device as backup information in association with the identification value.

Abstract: When a WORM cartridge is formatted for Tape File System (LTFS) in advance, such as prior to shipment, Linear Tape File System Library Edition (LTFS LE) is expanded by software to reduce consumption of the index partition and to support elimination of the appending of unnecessary data. More specifically, instead of recording metadata in the index partition during normal unmounting, the metadata is recorded in separate local storage such as on hard disk drive (HDD), and the index partition is updated only when the cartridge is ejected from the library. In this way, the present invention is able to significantly reduce the frequency of index partition updates. Because an update occurs only when the user intentionally ejects a cartridge, overflow of the index partition before overflow of the data partition can be prevented.

Abstract: When a WORM cartridge is formatted for Tape File System (LTFS) in advance, such as prior to shipment, Linear Tape File System Library Edition (LTFS LE) is expanded by software to reduce consumption of the index partition and to support elimination of the appending of unnecessary data. More specifically, instead of recording metadata in the index partition during normal unmounting, the metadata is recorded in separate local storage such as on hard disk drive (HDD), and the index partition is updated only when the cartridge is ejected from the library. In this way, the present invention is able to significantly reduce the frequency of index partition updates. Because an update occurs only when the user intentionally ejects a cartridge, overflow of the index partition before overflow of the data partition can be prevented.

Abstract: A method for writing a plurality of files that reduces average seek time includes receiving data of the plutality of files requested to be written to a tape from an application of a host, dividing a group of the received plurality of files into segments with specified sizes, and writing a series of the plurality of respective segments of the group of the plurality of files in sequence in a specified order, the respective segments having the specified sizes, wherein when writing the segments in the specified order, a left end portion of the tape is postioned and respective top segments of the files are first collectively written thereto. A tape drive system in which the method for writing is implemented reduces an average time required for seek of a plurality of image files.

Abstract: A method, system and computer program product are provided for implementing block extent granularity authorization model processing in Coherent Accelerator Processor Interface (CAPI) adapters. The CAPI adapter includes an authorization table and a file system authorization function to authenticate data access for a client at an extent granularity and to prevent an application from accessing unauthorized data in the CAPI adapter. Each authorization table entry provides for the CAPI client, a CAPI client identification (ID), a CAPI server register space assigning resource ownership to the CAPI client with a CAPI set of allowed functions.

Abstract: A mechanism is provided for providing information about fragmentation of a file on a sequential access medium by a computer system is disclosed. An actual time for reading the file recorded on the sequential access medium is estimated based on a physical position of the file. A total length of the file on the sequential access medium is calculated based on a physical length of each data piece constituting the file. An expected time for reading the file by assuming that the file is rewritten continuously is estimated based on the total length of the file. Information about the fragmentation of the file is then provided based on the actual time and the expected time.

Abstract: A memory that includes a data partition and an index partition is mounted. The data partition includes an original data and an original index written directly after the original data. The index partition includes the original index at the beginning of the index partition. The first data is written to a data partition of the memory. The first data is written directly after the at least one data on the data partition and the original index is deleted and invalidated. Responsive to a time interval elapsing, a first index is written to the data partition of the memory directly after the first data. The time interval starts at the writing of the first data. Responsive to the time interval elapsing, the first index is written to the index partition of the memory at the closest location, in terms of movement time, to the first index on the data partition.

Abstract: A method, device and non-transitory computer readable medium that manages read access includes organizing a plurality of requests for objects on one or more storage media, such as tapes or spin-down disks, based on at least a deadline for each of the plurality of requests. One of one or more replicas for each of the objects on the one or more storage media is selected based on one or more factors. An initial schedule for read access is generated based at least on the deadline for each of the plurality of requests, the selected one of the replicas for each of the objects, and availability of one or more drives. The initial schedule for read access on the one or more of the drives for each of the plurality of requests for the objects is provided.