Abstract: Causing an application on a host to access a point-in-time image on a storage system includes the application generating concurrent copy commands that are designed to cause data to be copied from a first location to a second location independent of whether the data is accessed by the host following initiating creation of a concurrent copy, intercepting concurrent copy commands and data generated by the application prior to sending the commands and data from the host to the storage system, transforming the concurrent copy commands and data to revised commands and data that are used to access the point-in-time image. Transforming the concurrent copy commands may include allocating temporary space on the storage system. The revised commands and data are sent from the host to the storage system. All commands generated by the application may be intercepted by the drivers layer. Only concurrent copy commands may be transformed.

Abstract: Adapting a storage system in response to operation of a corresponding host includes determining whether the host is performing a boot up operation, determining whether the host is performing a shutdown operation, and adapting operation of the storage system in response to the host performing one of: a boot up operation or a shutdown operation. Adapting operation of the storage system may include suspending low-priority housekeeping tasks, decreasing work queue scan times to be more responsive to incoming work, moving cores from other emulations, increasing thread counts, and/or preloading specified files into cache memory of the storage system. Determining whether the host is performing a boot up operation may include making a call from the storage system to the host that causes the host to return an indication thereof. Operations that are characteristic of booting up may be determined by machine learning.

Abstract: Communicating between a first device and a second device includes the first device generating command mode control words for communication with the second device, the first device converting the command mode control words into transport mode control words prior to transmitting the control words to the second device, the first device receiving transport mode control words from the second device, and the first device converting the transport mode control words received from the second device into received command mode control words. An application running on the first device may generate command mode control words for communication with the second device. The application may directly provide command mode control words to an ssch or channel subsystem layer. The first device may convert the command mode control words into transport mode control words using an ssch or channel subsystem layer. The first device may be a host computing system.

Abstract: Extending snapshot retention for a storage system includes creating a plurality of entries, each of the entries corresponding to snapshot data on the storage system and containing data that was written in connection with the snapshot and containing a map indicating which portions of the storage system were modified and includes transferring the entries to an external storage that is separate from the storage system. The map may be an SDDF map that indicates tracks of data that were modified. The external storage may be a cloud storage. Each of the entries may be created prior to deleting data for a corresponding snapshot on the storage system. The entries may be transferred directly from the storage system to the external storage. Extending snapshot retention for a storage system may also include periodically writing a full version of data from the storage device to the external storage.

Abstract: Communicating with a tape drive emulation unit that communicates using command mode or transport mode includes the tape drive emulation unit receiving an inquiry about whether the tape drive emulation unit communicates using transport mode, the tape drive emulation unit responding to the inquiry by indicating that the tape drive emulation unit does communicate using transport mode, and the tape drive emulation unit servicing transport mode commands until receiving a release command. The tape drive emulation unit may include a front end component, a data mover/server, and a tape emulation storage device. The data mover/server may include an NFS server. A host may communicate with the tape emulation unit. The host and the tape emulation unit may be coupled using a FICON connection. A host application may send commands to the tape emulation unit and may receive commands from the tape emulation unit using command mode.

Abstract: Backing up logical data from a storage system to a backup system includes accessing data on the storage system corresponding to logical file structures of data stored on the storage system, using machine learning to ascertain file access patterns and frequency of file backups, determining backup data based on the logical file structure of data stored on the storage system and the file access patterns and frequency of file backups, and directly transferring data corresponding the backup data from the storage system to the backup system. The logical file structures may be provided by file metadata. The file metadata may include at least one of: a VTOC (volume table of contents), an IXVTOC (indexed VTOC), VSAM (virtual storage access method) information, a VVDS (VSAM volume data set), file attributes, and/or catalog data. The file attributes may include management class information for each of the files.

Abstract: Accessing data using a first storage device and a second storage device that is a synchronous mirror of the first storage device includes determining if the first and second storage devices support alternative mirroring that bypasses having the first storage device write data to the second storage device and choosing to write data to the first storage device only or both the first and second storage device based on criteria that includes metrics relating to timing, an identity of a calling process or application, a size of an I/O operation, an identity of a destination volume, a time of day, a particular host id, a particular application or set of applications, and/or particular datasets, extents, tracks, records/blocks. A single I/O operation may be bifurcated to provide a portion of the I/O operation to only the first storage device or to both the first storage device and the second storage device.

Abstract: Creating snapshot data sets for a plurality of logical devices of a storage system includes marking an initial set of the logical devices for a snapshot in response to each of the initial set of logical devices having been modified since obtaining a previous snapshot data set, suspending I/O operations, marking an additional set of the logical devices for a snapshot in response to each of the additional set of logical devices having been modified prior to suspending I/O, performing a snapshot of the logical devices in the initial set of logical devices and in the additional set of logical devices, and resuming I/O operations. Pointers to snapshots for the snapshot data set may be placed in a table that includes a plurality of entries for a plurality of snapshot data sets. None of the additional set of logical devices may be part of the initial set of logical devices.

Abstract: Providing continuous data protection includes maintaining a database having substantially all data modifications made to a primary volume over a recovery interval. The database is maintained in conjunction with a copying operation where the data of the primary volume are mirrored to a remote volume to permit recovery of mirrored data in the event of loss of primary volume data. The contents of the remote volume generally lag behind the contents of the primary volume by substantially the recovery interval. Providing continuous data protection also includes providing data roll-back to a precise point in time within the recovery interval by applying, to the contents of the remote volume, all data modifications in the database that occurred between the latest data modification to the remote volume and the precise point in time within the recovery interval. A time stamp mechanism of sufficient precision and granularity may be used.

Abstract: Changing operational backup parameters on a storage system includes a first actor generating a request to change operational backup parameters, providing the request from the first actor to a second actor, the second actor authorizing the request, and modifying the operational backup parameters in response to the second actor authorizing the request. The first actor may be assigned a role that allows the first actor to generate the request to change operational backup parameters of the storage system and the second actor may be assigned a role that allows the second actor to authorize the request to change operational backup parameters of the storage system. The request may include a time window provided by the first actor. Authorizing a request to change operational backup parameters of the storage system may create a token and an authorization key. The token may be indicative of the request provided by the first actor.

Abstract: A backup data storage system includes non-volatile memory units, a disk interface coupled to at least some of the non-volatile memory units, a connection component that facilitates exchanging data with the backup data storage system, and a smart network interface controller, coupled to the disk interface and the connection component to provide tape emulation to a host coupled to the backup data storage system. The disk interface, the connection component, and the smart network interface controller may be coupled using a PCIe bus. Tape data written to the backup storage device may be stored on the non-volatile memory units. A processor coupled to the smart network interface controller and the disk interface may receive the data from the smart network interface controller and may provide the data to the disk interface to store the data on the non-volatile memory units. The connection component may be a FICON connection component.

Abstract: Using high speed data transfer protocol to transfer data between a host and a storage system includes determining if a portion of data is a candidate for being transferred using the high speed data transfer protocol if the portion is not a candidate for high speed data transfer, transferring the data using a relatively low speed data transfer protocol if the portion is a candidate for high speed data transfer, attempting to transfer the data using the high speed data transfer protocol, and if transferring the data using the high speed data transfer protocol is unsuccessful, transferring the data using the relatively low speed data transfer protocol. The high speed data transfer protocol may use a first connection and the relatively low speed data transfer protocol may use a second connection. The first connection may be a PCIe or InfiniBand connection. The second connection may be a FICON connection.

Abstract: A high performance logical device having low latency may be provided. I/Os to the logical device may be sent only to a primary director having sole ownership of the logical device. The primary director may perform operations locally for the logical device. Such operations may include allocating global memory for use with the logical device from only a global memory portion that is local to the primary director. The global memory may be a distributed global memory including memory from multiple directors and possibly multiple engines. Cached data for the logical device may be mirrored automatically by the data storage system. Alternatively, the cached data for the logical device may be mirrored using a host-based mirroring technique.

Abstract: A host coupled to a storage system accesses secondary storage coupled to the storage system and to the host by determining if direct data access between the storage system and the secondary storage is operational, the host forwarding commands to the storage system to directly access the secondary storage in response to direct data access between the storage system and the secondary storage being operational, and the host generating modified commands to cause the host to directly access the secondary storage in response to direct data access between the storage system and the secondary storage not being operational. The secondary storage may be a cloud storage. The secondary storage may be a tape emulation unit. The host may directly access data of the tape emulation unit by accessing a storage device of the tape emulation unit. Commands on the host may be modified by a drivers layer on the host.

Abstract: A host coupled to a storage system accesses secondary storage coupled to the storage system and to the host by determining if direct data access between the storage system and the secondary storage is operational, the host forwarding commands to the storage system to directly access the secondary storage in response to direct data access between the storage system and the secondary storage being operational, and the host generating modified commands to cause the host to directly access the secondary storage in response to direct data access between the storage system and the secondary storage not being operational. The secondary storage may be a cloud storage. The secondary storage may be a tape emulation unit. The host may directly access data of the tape emulation unit by accessing a storage device of the tape emulation unit. Commands on the host may be modified by a drivers layer on the host.

Abstract: Causing an application on a host to access a point-in-time image on a storage system includes the application generating concurrent copy commands that are designed to cause data to be copied from a first location to a second location independent of whether the data is accessed by the host following initiating creation of a concurrent copy, intercepting concurrent copy commands and data generated by the application prior to sending the commands and data from the host to the storage system, transforming the concurrent copy commands and data to revised commands and data that are used to access the point-in-time image. Transforming the concurrent copy commands may include allocating temporary space on the storage system. The revised commands and data are sent from the host to the storage system. All commands generated by the application may be intercepted by the drivers layer. Only concurrent copy commands may be transformed.

Abstract: Reclaiming storage space in a tape emulation unit includes determining portions of a tape image of the tape emulation unit that correspond to data/files that have expired, for each of the portions that have expired, overwriting each of the portions with a same value, and the tape emulation unit performing at least one of: compression or deduplication on each of the portions to reclaim storage space maintained by each of the portions. The same value may be zeros. Expiration information may be provided by header information on the tape image. The expiration information may be written by a host computer coupled to the tape emulation unit. The host computer may determine portions that have expired based on the header information. The host computer may run tape management software. The tape emulation unit may determine portions that have expired based on the header information.

Abstract: Maintaining versions of data from a storage system includes detecting that a snapshot of the data has been performed at the storage device, transferring a previous version of the data to a cloud storage, and prohibiting deletion of the snapshot until the previous version of the data has been completely transferred to the cloud storage. The data may be a volume on the storage system. The cloud storage may be public cloud storage or part of a private network. The cloud storage may be accessible from any location via the World Wide Web. A connection between the storage device and the cloud storage may be provided by the Internet, a TCP/IP network, a dedicated connection, or a FICON connection. The snapshot may store a log entry in a log device corresponding to a particular point-in-time version of the data prior to data being written to the storage device.

Abstract: Data replication techniques may include receiving, at a first data storage system, a write operation that writes first data to a source logical device, wherein the source logical device is configured for remote replication using a first replication technology and also configured for remote replication using a second replication technology different from the first replication technology. The first technology may be a first vendor and the second replication may be from a second vendor different from the first vendor. Responsive to receiving the write operation on the first data storage system, processing may be performed comprising: replicating the write operation and writing the first data to a first target logical device on a second data storage system using the first replication technology; and replicating the write operation and writing the first data to a second target logical device on a third data storage system using the second replication technology.

Abstract: Detecting data corruption in a storage system includes examining portions of the data for encryption anomalies and providing an indication in response to detecting an encryption anomaly. The encryption anomalies may be based on entropy of the data. The entropy of the data may vary based on an inherent nature of the data. One of the portions of data may be deemed to be encrypted in response to an entropy value exceeding a predetermined threshold. The predetermined threshold may be based on prior data accesses. The predetermined threshold may be determined using machine learning. Portions of the data may be examined for encryption anomalies during data accesses. Data accesses may be suspended in response to detecting an encryption anomaly. Encryption anomalies may include data that is flagged to be encrypted not being detected as being encrypted and/or data that is flagged to not be encrypted being detected as being encrypted.