Abstract: Techniques for grouping data portions are disclosed. Each group includes data portions determined to exhibit similar behavior. The techniques may include determining whether an affinity measurement with respect to two groups exceeds an affinity threshold; merging the two groups into a single group responsive to the affinity measurement exceeding the affinity threshold; modeling movement of at least one data portion of the single group between two storage tiers at a particular time of day using predicted workload metrics; and performing the data movement of the at least one data portion between the two storage tiers. Predicted workload metrics may be determined by revising first modeled workload metrics using a bias value, where bias values are associated with different times of day, and the bias value is selected based on the particular time of day that the predicted workload metrics are modeling.

Abstract: Described are techniques for determining whether to move data between devices. A first cost metric is determined for a first device and a second device. At least one portion of data is selected for movement from one of the first device and the second device to another of the first device and the second device. A second cost metric is determined for the first device and the second device based on moving said at least one portion of data between said first device and said second device. It is determined using the first cost metric and the second cost metric whether to move the at least one portion of data.

Abstract: An efficient linear technique is used to determine allocation of tiered storage resources among data extents based on system performance and SLOs. Efficiency is achieved by first determining a system performance boundary condition via hardware performance modeling under desirable system performance zones. SLOs are then balanced and SLO achievement improved by exchanging workload activities among SG donors and SG receivers while system performance boundary conditions are maintained. Remaining unutilized capacity is the uniformly distributed to further improve SLO achievement.

Abstract: An information processing system comprises a centralized database and at least one processing device implementing a selection algorithm for automated provisioning and management of a plurality of storage arrays based on information collected from the storage arrays and stored in the centralized database. The information stored in the centralized database may comprise at least one of storage utilization, performance, network bandwidth and end of service for each of the storage arrays. The selection algorithm is configured to determine optimal placement of data across the storage arrays based on the information stored in the centralized database. For example, the selection algorithm may be configured to determine one or more locations within the plurality of storage arrays to allocate as new storage responsive to a provisioning request.

Abstract: The data storage capacity of a storage array, data center or networked data storage system is managed and allocated in terms of chunks of capacity at different service levels, where each service level is defined based on one or more of tiered storage policy settings, drive size, drive speed, drive count, RAID protection, engine fractions, bandwidth and availability and characterized by one or more performance capabilities, e.g., IOs per second. The physical storage devices at each service level may have similar capabilities or be tiered arrangements of devices having different capabilities. A request for storage indicates number of chunks and service level required, thereby avoiding typical allocation complexity. Monitoring and billing logic enables procurement on a per chunk basis at each service level, thereby optionally decoupling the cost of additional units of storage from underlying resources from the perspective of a customer.

Abstract: A virtual storage unit from one data storage system may be migrated to another data storage system. Utilization impacts on system resources by one or more virtual storage units on multiple data storage systems may be quantified, for each data storage system as a whole, or for a functional component of each data storage system. Based on these quantifications, multiple “what-if” scenarios may be considered to determine the consequences of migrating one or more virtual storage units from one of the data storage systems to another one of the data storage systems. If it is determined that a virtual storage unit is to be migrated, a live migration may be performed such that one or more hosts maintain access to the data of the virtual storage unit while the virtual storage unit is being migrated.

Abstract: Described is storage system and method for reducing power consumption. The storage system has first and second physical disks configured to provide mirroring. The first physical disk is placed into a power-saving mode of operation, while the second physical disk is in an active mode of operation responding to read and write requests. The first physical disk transitions from the power-saving mode of operation to an active mode of operation for destaging writes pending from cache to the first physical disk, while the second physical disk responds to read and write requests. The second physical disk transitions from the active mode of operation to the power-saving mode of operation, while the first physical disk responds to read and write requests.

Abstract: To facilitate both minimal allocations and adaptive allocations, two sets of storage group policies are defined—one policy setting minimal allocation values for storage group access to storage resources and one policy setting maximal allocation values for storage group access to storage. In addition, a set of priority weights is specified that is used to balance access to storage tiers across storage groups. Upon existence of contention for storage resources, minimum allocation values for storage groups are determined based on the priority weights for the storage groups, resulting in threshold values being set to enable at least partial access to storage resources for all storage groups without requiring priority weighting of the activity density distributions of the competing storage groups. Allocations other than the minimal allocations are provided based on relative activity density distribution of storage extents between groups.

Abstract: Managing data in a storage system having a plurality of classes of storage includes determining an amount of data to be provided on at least one of the classes of storage according to a policy, dynamically setting a threshold according to the amount of data to be provided on the at least one of the classes or an expected performance based on the threshold, and placing data on particular classes of storage based on the threshold. Dynamically setting a threshold may include sorting data portions according to at least one score thereof and may include determining a particular score corresponding to the amount of data to be provided. The data portions may be provided in a histogram having a horizontal scale corresponding to a score value and a vertical scale corresponding to a number of data portions having a particular value.

Abstract: Described is storage system and method for reducing power consumption. The storage system has first and second physical disks configured to provide mirroring. The first physical disk is placed into a power-saving mode of operation, while the second physical disk is in an active mode of operation responding to read and write requests. The first physical disk transitions from the power-saving mode of operation to an active mode of operation for destaging writes pending from cache to the first physical disk, while the second physical disk responds to read and write requests. The second physical disk transitions from the active mode of operation to the power-saving mode of operation, while the first physical disk responds to read and write requests.

Abstract: Described are techniques for evaluating data movement alternative. A set of criteria including capacity and performance limits is received. First processing is performed to evaluate a plurality of alternatives for use in data movement with respect to a set of logical devices having data stored on a set of physical storage devices. Each of the plurality of alternatives includes a different set of data movement criteria comprising capacity limits and a different set of performance limits. The set of physical storage devices includes at least a first physical device of one of a plurality of storage tiers and a second physical device of another one of the plurality of storage tier. One of the sets of performance limits is selected in accordance with the first processing.

Abstract: Described are techniques for configuring data storage. A plurality of devices is selected. It is determined, for each of the plurality of devices, whether data for said each device should be located in a first storage tier or another storage tier. The first storage tier is higher performance storage tier than the other storage tier. For each of the plurality of devices that the determining step determines should be located in the first storage tier, data of said each device is automatically located on a physical storage device of the first storage tier.

Abstract: Described are techniques for performing data storage optimizations. A data storage optimizer on a first data storage system connected to a set of other data storage systems receives performance classification information. The first data storage system includes a first set of storage devices of a first performance classification. The set of other data storage systems includes a second set of storage devices of a second performance classification different from the first performance classification. A write operation is received from the host to write first data to a target address of a virtually provisioned device. It is determined that physical storage is not currently allocated for the target address of the virtually provisioned device. A first portion of physical storage is allocated for storing the first data. The first portion of physical storage is included in a storage device of the second set having the second performance classification.

Abstract: Described are techniques for processing data operations. A request is sent from an application to perform a data operation on a key-value data store. The request is in accordance with a first application-level protocol for performing the data operation on the key-value data store and includes a first key of a first key-value pair used by a data storage system to perform the data operation. The request is received at the data storage system such as by a key-value server that processes requests in accordance with the first application-level protocol for the key-value data store. In response to receiving the request at the data storage system, first processing is performed on the data storage system for the data operation and a response is returned to the application.

Abstract: Described are techniques for discovering physical device dependencies. A set of baseline response times for logical devices of a data storage system are received. A first of the logical devices is selected and a remaining set of logical devices includes each of the logical devices other than the first logical device. Data operations are issued to the first logical device at a first rate while also issuing data operations to the remaining logical devices. A set of observed response times for the remaining logical devices is received. For each remaining logical device, it is determined whether the logical device has a corresponding observed response time that is significantly more the logical device's baseline response time. A first logical device set is determined having physical device dependencies that includes the first logical device set and each remaining logical device having an observed response time significantly greater than it's baseline response time.

Abstract: Described are techniques for determining whether to move data between devices. A first cost metric is determined for a first device and a second device. At least one portion of data is selected for movement from one of the first device and the second device to another of the first device and the second device. A second cost metric is determined for the first device and the second device based on moving said at least one portion of data between said first device and said second device. It is determined using the first cost metric and the second cost metric whether to move the at least one portion of data.

Abstract: Described are techniques for tracking activity for one or more devices. Each of the one or more devices is partitioned into one or more extents. Each of the one or more extents includes a plurality of sub extents. Each of the sub extents includes a plurality of chunks. For each of said one or more extents of each of said one or more devices, extent activity level information is determined including one or more metrics indicating an activity level for said each extent; and For each of said one or more extents of each of said one or more devices, an activity bitmap is determined. The activity bitmap includes an entry for each sub extent included in said each extent, said entry indicating an activity level for said each sub extent.

Abstract: Described are techniques for tracking activity for one or more devices. Each of the one or more devices is partitioned into one or more extents. Each of the one or more extents includes a plurality of sub extents. Each of the sub extents includes a plurality of chunks. For each of said one or more extents of each of said one or more devices, extent activity level information is determined including one or more metrics indicating an activity level for said each extent; and For each of said one or more extents of each of said one or more devices, an activity bitmap is determined. The activity bitmap includes an entry for each sub extent included in said each extent, said entry indicating an activity level for said each sub extent.

Abstract: Described are techniques for configuring data storage. A plurality of devices is selected. It is determined, for each of the plurality of devices, whether data for said each device should be located in a first storage tier or another storage tier. The first storage tier is higher performance storage tier than the other storage tier. For each of the plurality of devices that the determining step determines should be located in the first storage tier, data of said each device is automatically located on a physical storage device of the first storage tier.

Abstract: Described is a storage system and method for managing and optimizing power consumption in a storage system. Logical devices are mapped to physical disk drives. A plurality of power profiles is defined. Each power profile is associated with a mode of operation for a physical disk drive. One of the power profiles is assigned to each logical device. One of the physical disk drives is identified for which every logical device mapped to that physical disk drive has been assigned the same power profile. The identified physical disk drive is operated in the mode of operation associated with said same power profile. The mapping of the logical devices to the physical disk drives may be changed in order to group logical devices assigned the same power profile onto the same physical disk drive.