Abstract: Methods, apparatus, and processor-readable storage media for implementing host-controlled service levels are provided herein. An example computer-implemented method includes obtaining, at a storage node of a storage system, information comprising one or more identifiers and one or more service levels that are assigned to virtual machines identified by the one or more identifiers; extracting one of the one or more identifiers from an input-output operation received at the storage node; identifying, based on the extracted identifier, the service level that is assigned to the virtual machine that initiated the input-output operation; and controlling storage resources allocated for one or more additional input-output operations from one or more of the virtual machines based at least in part on the identified service level.

Abstract: Techniques are provided for selective powering of storage drive components in a storage node based on system performance limits. One method comprises determining a number of storage drive components, of multiple storage drive components in a storage node, needed to support at least one workload of the storage node, wherein the determining is based at least in part on a number of storage drive components needed to support a system performance limit determined using a component performance limit of at least one other component of the storage node, wherein the component performance limit is based at least in part on one or more of an expected number of input/output operations of the storage node and an expected bandwidth of the storage node; and initiating an application of power to the determined number of storage drive components of the storage node.

Abstract: A storage control system is configured to obtain first data associated with a logical data device and to store the first data in a first entry of a log-structured array. The storage control system is further configured to invalidate a second entry of the log-structured array based at least in part on the storage of the first data in the first entry. The second entry comprises second data that was associated with the logical data device prior to obtaining the first data. The storage control system is further configured to determine that a first indication in a first metadata indicates that the invalidated second entry corresponds to a transaction log and to defer reclamation of the second entry based at least in part on the determination that the first indication in the first metadata indicates that the invalidated second entry corresponds to the transaction log.

Abstract: An apparatus comprises at least one processing device comprising a processor coupled to memory. The at least one processing device is configured to obtain an input-output request issued by an application executing on a compute node via at least one network and to identify a storage node as corresponding to the obtained input-output request based at least in part on the obtained input-output request. The at least one processing device is configured to associate information corresponding to the compute node with the input-output request and to submit the input-output request and the associated information that corresponds to the compute node to the storage node via the at least one network. The storage node is configured to submit a response to the input-output request to the compute node via the at least one network based at least in part on the information.

Abstract: In some embodiments, a storage system comprises at least one processor coupled to memory. The processor is configured to obtain a write operation that comprises first data associated with a logical data device and to store the first data in a first entry of a log-structured array (LSA). The at least one processor is configured to invalidate a second entry based at least in part on the storage of the first data in the first entry. The second entry comprises second data associated with the logical data device that was stored in the second entry prior to obtaining the write operation. The at least one processor is configured to determine that a first indication in LSA metadata associated with the LSA indicates that the invalidated second entry comprises data that is awaiting replication and to defer reclamation of the second entry based at least in part on the determination.

Abstract: An apparatus comprising a processing device is configured to communicate with a storage node of a storage system via at least one network and to communicate with a compute node that implements at least a portion of an application via the at least one network. The at least one processing device is configured to obtain an input-output request associated with the application from the compute node via the at least one network and to associate information corresponding to the compute node with the input-output request. The at least one processing device is further configured to submit the input-output request and the associated information that corresponds to the compute node to the storage node. The storage node is configured to submit a response to the input-output request to the compute node via the at least one network based at least in part on the information.

Abstract: In some embodiments, a storage system comprises at least one processor coupled to memory. The processor is configured to obtain a write operation that comprises first data associated with a logical data device and to store the first data in a first entry of a log-structured array (LSA). The at least one processor is configured to invalidate a second entry based at least in part on the storage of the first data in the first entry. The second entry comprises second data associated with the logical data device that was stored in the second entry prior to obtaining the write operation. The at least one processor is configured to determine that a first indication in LSA metadata associated with the LSA indicates that the invalidated second entry comprises data that is awaiting replication and to defer reclamation of the second entry based at least in part on the determination.

Abstract: An apparatus comprises at least one processing device comprising a processor coupled to memory. The at least one processing device is configured to obtain an input-output request issued by an application executing on a compute node via at least one network and to identify a storage node as corresponding to the obtained input-output request based at least in part on the obtained input-output request. The at least one processing device is configured to associate information corresponding to the compute node with the input-output request and to submit the input-output request and the associated information that corresponds to the compute node to the storage node via the at least one network. The storage node is configured to submit a response to the input-output request to the compute node via the at least one network based at least in part on the information.

Abstract: An apparatus comprising a processing device is configured to communicate with a storage node of a storage system via at least one network and to communicate with a compute node that implements at least a portion of an application via the at least one network. The at least one processing device is configured to obtain an input-output request associated with the application from the compute node via the at least one network and to associate information corresponding to the compute node with the input-output request. The at least one processing device is further configured to submit the input-output request and the associated information that corresponds to the compute node to the storage node. The storage node is configured to submit a response to the input-output request to the compute node via the at least one network based at least in part on the information.

Abstract: A storage control system is configured to obtain first data associated with a logical data device and to store the first data in a first entry of a log-structured array. The storage control system is further configured to invalidate a second entry of the log-structured array based at least in part on the storage of the first data in the first entry. The second entry comprises second data that was associated with the logical data device prior to obtaining the first data. The storage control system is further configured to determine that a first indication in a first metadata indicates that the invalidated second entry corresponds to a transaction log and to defer reclamation of the second entry based at least in part on the determination that the first indication in the first metadata indicates that the invalidated second entry corresponds to the transaction log.

Abstract: A processing platform is configured to communicate over a network with one or more client devices, and to receive a request from a given one of the client devices for a proposed configuration of a storage system. The processing platform identifies based at least in part on the received request at least one processor to be utilized in implementing the storage system, selects a particular one of a plurality of storage system performance models based at least in part on the identified processor, computes a performance metric for the storage system utilizing the selected storage system performance model and one or more characteristics of the identified processor, generates presentation output comprising: (i) the performance metric, and (ii) information characterizing at least a portion of the proposed configuration of the storage system, and delivers the presentation output to the given client device over the network.

Abstract: Techniques and mechanisms for establishing and implementing performance objectives for an application based at least in part on a workload type of the application. A system includes a storage system on which an application imposes a workload by utilizing storage resources of the storage system, and a performance level has been associated with the application. A workload type is associated with the application based on the type of workload, and a performance objective is determined for the application based on the performance level and the workload type of the application. The storage resources are manipulated to achieve the performance objective.

Abstract: A method includes (a) receiving workload data for a data storage system, the data storage system having a plurality of processing cores, the data storage system being configured to operate according to any of a plurality of profiles, each of the plurality of profiles having a respective assignment of respective cores of the plurality of cores to particular storage roles of the data storage system, (b) for each profile of the plurality of profiles, simulating operation of the data storage system running a workload based on the received workload data using the assignment of respective cores of the plurality of cores to particular storage roles for that profile, thereby producing a set of utilization scores, (c) selecting a profile of the plurality of profiles based on the set of utilization scores, and (d) outputting an indication of the selected profile for use by the data storage system.

Abstract: Described are techniques for configuring data storage. Criteria identifying limits is received for a plurality of storage tiers for one or more logical devices. The storage tiers include a first storage tier and one or more other storage tiers where the first storage tier is higher performing than the other storage tiers. First processing is performed to determine a first set of data portions of the logical devices to be stored on physical devices of the first storage tier subject to limits included in said criteria. First processing includes determining scores for data portions of the logical devices. Each score is calculated using one or more metrics including a first metric weighted based on an expected I/O size. The data portions are ranked in accordance with the scores. The first set of data portions stored in the first storage tier is selected based on the score ranking.

Abstract: Determining cumulative workload skew is described. Measurements for one or more logical devices are determined. The set of measurements include, for each of N storage tiers, a workload measurement identifying workload directed to the single tier, and a capacity measurement identifying an amount of data stored in the single tier. N points may be determined using the measurements. Each point corresponds to a different storage tier and has a first coordinate identifying a cumulative percentage of data portions stored in the storage tier and all other tiers having a higher performance ranking than the one storage tier, and a second coordinate denoting an aggregated percentage of total workload directed to the foregoing cumulative percentage of data portions. A curve representing a cumulative workload skew may be determined using these N points and a point of origin.

Abstract: Described are techniques for processing collected workload and performance data. Components of a component category are selected, filtering criteria is specified, the filtering criteria is applied to the collected workload and performance data for the components selected and thereby generating filtered data results, and the filtered results are viewed. The filtering criteria may include a first operation and a first set of one or more metrics included in the collected workload and performance data for the components selected. The first operation may be applied to the first set of one or more metrics and may be selected from a plurality of operations. The plurality of operations may include at least one arithmetic operation, at least one logical operation and at least one relational operation.

Abstract: A method, apparatus and computer program product for providing pre-calculated performance simulation is presented. Performance simulations for a storage system are provided by selecting a subset of system configuration options from a large set of system configuration options. Simulation results for the subset of system configuration options are pre-calculated. The simulation results for the subset of system configuration options are loaded on a portable device. System configuration requirements for a customer are received and at least one system configuration option is selected from the subset of system configuration options based on the simulation results and the system configuration requirements for a customer.

Abstract: Described are techniques for processing a data operation in a data storage system. A front-end component of the data storage system receives the data operation. In response to receiving the data operation, the front-end component performs first processing. The first processing includes determining whether the data operation is a read operation requesting to read a data portion which results in a cache miss; and if said determining determines that the data operation is a read operation resulting in a cache miss, performing read miss processing. Read miss processing includes sequential stream recognition processing performed by the front-end component to determine whether the data portion is included in a sequential stream.

Abstract: Described are techniques for destaging data. Write data for write operations are stored in cache page(s). The cache may be partitioned into cache pages and write data stored thereon may be marked as write pending denoting that write data needs to be written out to physical storage. Weight values may be determined for the cache pages in accordance with factors. A first cache page may be selected having a highest such weight value where the selected first cache page includes at least some write data marked as write pending. The write data of the selected first cache page may be destaged to physical storage.

Abstract: Determining cumulative workload skew is described. Measurements for one or more logical devices are determined. The set of measurements include, for each of N storage tiers, a workload measurement identifying workload directed to the single tier, and a capacity measurement identifying an amount of data stored in the single tier. N points may be determined using the measurements. Each point corresponds to a different storage tier and has a first coordinate identifying a cumulative percentage of data portions stored in the storage tier and all other tiers having a higher performance ranking than the one storage tier, and a second coordinate denoting an aggregated percentage of total workload directed to the foregoing cumulative percentage of data portions. A curve representing a cumulative workload skew may be determined using these N points and a point of origin.