Abstract: Techniques are disclosed for managing data storage in data storage systems. The techniques comprise providing a number of RAID groups. Each RAID group relating to a respective set of data storage drives that support RAID storage in the RAID group. The techniques also comprise monitoring I/O operations to identify read-active data stored by data storage drives of a RAID group. The techniques also comprise copying the read-active data from the data storage drives of the RAID group to data storage drives of another RAID group.

Abstract: A peer to peer remote copy operation is performed between a primary storage controller and a secondary storage controller, to establish a peer to peer remote copy relationship between a primary storage volume and a secondary storage volume. Subsequent to indicating completion of the peer to peer remote copy operation to a host, a determination is made as to whether the primary storage volume and the secondary storage volume have identical data, by performing operations of staging data of the primary storage volume from auxiliary storage of the primary storage controller to local storage of the primary storage controller, and transmitting the data of the primary storage volume that is staged, to the secondary storage controller for comparison with data of the secondary storage volume stored in an auxiliary storage of the secondary storage controller.

Abstract: Techniques manage a storage system. In accordance with certain techniques, respective response times of multiple storage devices associated with the storage system are obtained. An extent whose workload satisfies a predefined condition is selected as a source extent from multiple extents on a source storage device in response to a response time of the source storage device among the multiple storage devices being above a predefined threshold. A destination storage device is selected from the multiple storage devices, the destination storage device having a lower workload than the source storage device. Data on the source extent are moved to a free extent on the destination storage device. Additionally, a balance may be stricken between workloads of various storage devices in a resource pool, and then the overall response speed of the resource pool may be increased.

Abstract: Systems and methods for I/O acceleration in a virtualized system include receiving, at a hypervisor from an application executing under a guest OS, a request to write new data to a RAID system, redirecting the request to the VSA owning the RAID drives, moving the new data from guest OS physical address space to VSA physical address space, preparing, by a RAID driver in the VSA, the new data for writing according to a RAID redundancy policy, reading, by the RAID driver into a first buffer, old data and old parity information, performing, by an architectural data mover, inline XOR copy operations to compute a difference between the old and new data, compute new parity information, and write the difference and new parity information into the second buffer, and writing, by the RAID driver, the difference and new parity information to the RAID system using the redundancy policy.

Abstract: A plurality of computing devices are communicatively coupled to each other via a network, and each of the plurality of computing devices is operably coupled to one or more of a plurality of storage devices. The computing devices may use local caches in a coherent manner when accessing the plurality of storage devices.

Abstract: A composite layout including a plurality of ranked sub-layouts may be used to provide various functionality for data object look-up and file system activities. Each sub-layout may include mapping information linking one or more extents of a data object to one or more locations on one or more storage apparatuses. Generally, mapping information in the highest priority sub-layout including mapped extents may be used during “reads” while the highest priority sub-layout may be used for “writes.

Abstract: Disclosed are systems, methods, and non-transitory computer-readable storage media for migrating content items from a source user account to a target user account. A user can specify content items in the source user account to be migrated to an existing or new target user account. A new content entry including an account identifier of the target account and a pointer to the content item can be created for each migrated content item. Further, a determination can be made as to whether a sharing link to each content item exists, and if so, the content pointer of the old content entry is modified to forward or redirect to the new content entry. An active flag associated with the old content entry can be set to false or 0 to indicate that the old content entry is no longer active.

Abstract: A distributed control system for a vehicle includes a configuration controller and at least three nodes communicatively coupled to the configuration controller. Each of the at least three nodes includes a memory device for storing local data and portions of shared data of the distributed control system. Further, portions of the shared data are dissimilarly copied across the at least three nodes using dissimilar methods. More specifically, the dissimilar methods include at least one of striping the shared data amongst the at least three nodes, storing parity information of the shared data amongst at least one of the at least three nodes, storing unique identification or signatory information of the shared data amongst at least one of the at least three nodes, storing subsets of the shared data amongst the at least three nodes, and/or storing exact copies of the shared data amongst at least one of the at least three nodes so as to increase redundancy of the shared data.

Abstract: Container-image layers can be managed. For example, a computing device can determine a first score for a first layer of a container image and a second score for a second layer of the container image. The computing device can determine that the first score corresponds to a first storage destination among several possible storage destinations. The computing device can also determine that the second score corresponds to a second storage destination among the possible storage destinations. The second storage destination can be different from the first storage destination. The computing device can then store (i) the first layer in the first storage destination based on the first layer being correlated to the first score, and (ii) the second layer in the second storage destination based on the second layer being correlated to the second score.

Abstract: A device can receive a specification identifying information associated with a stateful microservices application. The device can provide a request for storage information associated with the stateful microservices application based on the information included in the specification. The device can receive the storage information based on providing the request. The device can execute a storage installation procedure to provide the stateful microservices application with a storage volume based on receiving the storage information. The storage volume can be capable of providing persistent data storage. The device can provide a notification that the stateful microservices application is available for deployment on the device based on executing the storage installation procedure.

Abstract: Technologies for offloading acceleration task scheduling operations to accelerator sleds include a compute device to receive a request from a compute sled to accelerate the execution of a job, which includes a set of tasks. The compute device is also to analyze the request to generate metadata indicative of the tasks within the job, a type of acceleration associated with each task, and a data dependency between the tasks. Additionally the compute device is to send an availability request, including the metadata, to one or more micro-orchestrators of one or more accelerator sleds communicatively coupled to the compute device. The compute device is further to receive availability data from the one or more micro-orchestrators, indicative of which of the tasks the micro-orchestrator has accepted for acceleration on the associated accelerator sled. Additionally, the compute device is to assign the tasks to the one or more micro-orchestrators as a function of the availability data.

Abstract: The embodiments disclosed herein relate to intelligent configuration of a cloud-service gateway based on a pattern recognition algorithm. A machine-learning model is trained to learn the patterns of correlation among many configuration parameters affecting the performance of the system when processing an observed or estimated workload. Training the model may be performed off-line with performance data observed during experiments performed with a variety of configurations and workloads. Once trained, the model may be used to recommend: (a) new configuration parameter values based on constraints of the system being configured, (b) an amount of work that can be performed at a certain performance level when the system is configured with certain parameter values, or (c) the expected performance level when running a certain workload on the system configured with certain configuration parameter values.

Abstract: A virtual storage system according to an aspect of the present invention includes multiple storage systems each including: a storage controller that accepts a read/write request for reading or writing from and to a logical volume; and multiple storage devices. The storage system defines a pool that manages the storage device capable of allocating any of storage areas to the logical volume, and manages the capacity (pool capacity) of the storage areas belonging to the pool, and the capacity (pool available capacity) of unused storage areas in the pool. Furthermore, the storage system calculates the total value of the pool available capacities of the storage systems included in the virtual storage system, and provides the server with the total value as the pool available capacity of the virtual storage system.

Abstract: A data storage device can have one or more timestamps to indicate chronological information associated with data stored in the data storage device. A controller may be connected to a timestamp module and a transducing head to allow a timestamp to be written to a magnetic data storage medium as directed by the timestamp module. The timestamp can consist of chronological information relating to user-generated data stored on the data storage medium.

Abstract: Methods, computing systems and computer program products implement embodiments of the present invention that include presenting, on a display, multiple storage objects and their respective current utilizations, and forecasting a respective subsequent utilization for each of the storage objects at each of one or more future times. Examples of the storage objects include of a storage facility having multiple sites, one or more storage systems at a given site, storage pools in the storage systems, and logical volumes in the storage pools. Upon receiving a first input indicating a change to the multiple storage objects, and receiving a second input indicating a given future time, the respective forecasted subsequent utilizations of the changed multiple storage objects at the given future time is presented on a display. Examples of changes to the storage objects include adding an additional storage object and moving or resizing a storage object.

Abstract: Optimizing copy operations in a storage array, including: receiving a plurality of copy operations; detecting a triggering event that causes a storage array controller to initiate execution of the plurality of copy operations; and combining, in dependence upon a metadata optimization policy, the plurality of copy operations into a single copy operation.

Abstract: Example tiered storage systems, storage devices, and methods provide tier configuration by peer storage devices. Each tiered storage device is configured to communicate with a plurality of peer storage devices with storage device identifiers. The storage devices may query each other for performance characteristics and/or self-assigned performance tiers and organize the storage devices into a tier configuration. Each storage device, a storage controller, another system, and/or some combination may store metadata that describes the tier configuration. The tier configuration may then be used to route host data commands among the plurality of peer storage devices.

Abstract: Methods and apparatus are provided for reporting fragment filling in storage systems. An exemplary method comprises obtaining at least one compressed allocation unit of data in a storage system; reserving space for the at least one compressed allocation unit in a compressed segment based on a greater of (i) a size of the at least one compressed allocation unit, and (ii) a minimum target fragment length specified for at least one write operation class; and writing the at least one compressed allocation unit to the reserved space. An attempt is optionally first made to fill the at least one compressed allocation unit of data in a free extent and/or a hidden fragment of at least one compressed segment prior to reserving the space. The reserving the space is optionally only performed if the attempt to fill the at least one compressed allocation unit of data is not successful.

Abstract: A size associated with a first content file is determined to be less than a threshold size. In response to determining that the size associated with the first content file is less than the threshold size, a combined metadata structure is updated at least in part by combining metadata of the first content file with metadata of a second content file in the combined metadata structure. A snapshot tree is updated to reference a first portion of the combined metadata structure corresponding to the first content file and to reference a second portion of the combined metadata structure corresponding to the second content file.

Abstract: This application relates to distributed storage, and in particular, to a distributed shard storage technology. In a method for storing data shards in a distributed storage system, M data nodes on which to-be-stored data will be stored are determined, N replicas of the to-be-stored data are obtained, and each of the N replicas is sharded into X data shards in a same sharding mode. Then the to-be-stored data is stored on the M storage nodes, that is, N replicas of each of the X data shards are respectively stored on N storage nodes, and a quantity of data shards whose data shard replicas are stored on same N storage nodes is P or P+1, where P is an integer quotient of X divided by CMN.

Abstract: A method, computer program product, and computer system for monitoring host IO latency. It may be identified that a rate of the host IO latency is at a one of a plurality of levels. At least one of a rate of background IOs and a rate of host IOs may be regulated based upon, at least in part, the rate of the host IO latency being at the one of the plurality of levels.

Abstract: Techniques manage a storage system comprising a group of storage devices. The techniques involve: determining from the group of storage devices a first storage device which is in a rebuilding state; in response to a second storage device in the group of storage devices failing, obtaining a recoverability indication indicating whether a data block in the second storage device, which corresponds to a target data block in the first storage device, is recoverable or not on the basis of a data state of the target data block; and recovering data in the data block in the second storage device corresponding to the target data block on the basis of the recoverability indication.

Abstract: A system comprises a processor programmed to send an address range to a server corresponding to a capability of a controller to perform an update; responsive to receiving update data from the server, write the update data into the controller; and responsive to receiving a resume signal to resume the update from a paused state, send a new address range to the server based on a last-successfully-written address received from the controller.

Abstract: An operating method of a storage device which includes a plurality of banks includes receiving a write command including stream identification information from a host, allocating a bank, in which data are to be stored, from among the plurality of banks based on a striping size corresponding to the stream identification information, in response to the write command, and writing the data in the allocated bank.

Abstract: Embodiments for adaptive placement of parity information within Redundant Array of Independent Disks (RAID) stripes in a computer storage environment. A RAID controller periodically collects a physical capacity usage of each of a plurality of storage devices within the RAID. The RAID controller determines a placement of data and the parity information within at least one of the plurality of storage devices according to at least one of a plurality of factors associated with the physical capacity usage. The RAID controller writes the data and the parity information to the at least one of the plurality of storage devices according to the determined placement.

Abstract: A storage control system to provide file-level storage and block-level storage services. The storage control system has a computer system including a second I/O unit configured to receive block-level storage related requests, a processor unit, a first memory unit, and a storage unit; and a programmable logic device including a first I/O unit configured to receive file-level storage related requests, an interface unit configured to communicate with the computer system, one or more programmable hardware-implemented processing units and for processing of file-level storage related requests, and a second memory unit.

Abstract: A method includes determining an encoding modification for a set of encoded data slices where a data segment of data is dispersed storage error encoded into the set of encoded data slices based on dispersed storage error encoding parameters. The method further includes determining a plurality of tasks for executing the encoding modification, where the encoding modification includes altering one or more parameters of the dispersed storage error encoding parameters. The method further includes assigning a first task of the plurality of tasks to a first storage unit and assigning remaining tasks of the plurality of tasks to a set of storage units. The method further includes executing, by the first storage unit and at least some storage units of the set of storage units, the first task and the remaining tasks of the plurality of tasks, respectively, to produce a modified set of encoded data slices.

Abstract: An embodiment of a semiconductor apparatus for use with redundant storage may include technology to cache all data for a write request for at least two member persistent storage drives in a persistent cache with a write access latency at least as low as a lowest write access latency of the at least two member persistent storage drives, write the data for the write request to one member persistent storage drive of the at least two member persistent storage drives, and indicate that the write request is complete after the data for the write request is redundantly stored in the persistent cache and the one member persistent storage drive. Other embodiments are disclosed and claimed.

Abstract: Bulk scaling out of a geographically diverse storage system is disclosed. Bulk scaling out can result in addition of at least two zone storage components to the geographically diverse storage system. Bulk scaling out can provide an avenue to move and compact data to benefit the geographically diverse storage system. Benefits can include faster access to data, faster recovery time for data that becomes less accessible, reduced computing resource demands, etc. Chunks can be moved for greater diversity in a bulk scaled out system. The greater diversity can allow for compaction of data protection chunks, which can result in consuming less storage space to protect more diversified data storage. In some embodiments data from existing zone storage components can be moved to added zone storage components. In some embodiments, protection data from existing zone storage components can be moved to added zone storage components in a more compacted condition.

Abstract: Placing workloads in a multi-array system comprising a plurality of storage arrays, including: determining, for each of a plurality of storage arrays, a current system activity level trend of the storage array; receiving a performance profile of a workload to be executed on one of the storage arrays; generating, for each of the plurality of storage arrays in dependence upon the current system activity level trend of the storage array and the performance profile of the workload, a projected system activity level trend for the storage array; identifying, in dependence upon the projected system activity level trend for each of the plurality of storage arrays, an optimal storage array for receiving the workload; and placing the workload on the optimal storage array.

Abstract: A computer-implemented method, according to one embodiment, includes: receiving a write request at a storage system which includes more than one storage device, determining a storage location for data included in the write request, and determining a storage location for parity information corresponding to the data included in the write request. A first copy of the data included in the write request is sent to a first storage device which corresponds to the storage location for the data included in the write request. Moreover, a second copy of the data included in the write request is sent to a second storage device which corresponds to the storage location for the parity information. One or more instructions to compute the parity information via a decentralized communication link with the remaining storage devices are sent to the second storage device. The first storage device is different than the second storage device.

Abstract: A method of facilitating communication from an embedded computer in a computational storage device to a host or an external device includes receiving a message from an embedded user process for transmission to a user process running at either the host or the external device, determining that a destination address of the message corresponds to the host or the external device, in response to the determination, forwarding the message to an embedded relay process associated with the host or the external device, instructing a storage controller of the computational storage device about the message to be delivered, notifying a host relay process at the host of a presence of the message, receiving a send message request from the host in response to the notification, and in response to receiving the send message request, transmitting the message to the host.

Abstract: Ensuring crash-safe forward progress of a system configuration update in a storage system that includes a storage array controller and a plurality of storage devices, including: determining a number of storage devices in the storage system; determining a number of unavailable storage devices in the storage system; and determining, for the one or more system configurations, whether the system configuration can be reconstructed in dependence upon the number of storage devices in the storage system and the number of unavailable storage devices in the storage system.

Abstract: A method for converting a redundant array of independent disks (RAID) to a more robust RAID level is disclosed. Such a method identifies, in a data storage environment, higher risk storage drives having a failure risk above a first threshold. The method determines a number of the higher risk storage drives that are contained within a RAID array of the data storage environment. The method determines whether the number exceeds a second threshold. The method also determines whether a destage rate associated with the RAID array is below a third threshold. In the event the number exceeds the second threshold and the destage rate is below the third threshold, the method converts the RAID array to a more robust RAID level. A corresponding system and computer program product are also disclosed.

Abstract: An architecture for improving reliability of a multi-server system is provided. The hard disk backplane is provided with at least two hard disk modules, each of which includes a power supply isolation unit and a signal isolation unit. The power connection board is connected to the power supply isolation unit in each of the at least two hard disk modules, so that power supplies of the at least two hard disk module are isolated from each other. Each of the at least two server nodes is connected to at least one of the hard disks through a corresponding signal isolation unit. The server node, the signal isolation unit and the hard disk which are connected to each other form an isolated data communication group. Signal isolation units in any two of isolated data communication groups belong to different hard disk modules.

Abstract: A wireless network comprises a Network Function (NF), Network Exposure Function (NEF), and Application Function (AF). The NF selects a status key. The NF hashes the status key and transfers the status hash. The NEF stores the status hash. The AF hashes an AF ID and transfers the AF ID hash. The NEF decodes the AF ID hash to authenticate and identify privileges for the AF. The NEF hashes the privileges and transfers the privilege hash to the AF. The AF decodes the privilege hash and identifies a status privilege. The AF hashes its ID and a status request and transfers the ID hash and status request hash to the NEF. The NEF decodes the NF status request hash to identify the status request and transfer the status hash to the AF. The AF decodes the NF status hash to identify the current NF status.

Abstract: Implementations of the subject matter described herein provide a storage management method and system. The storage management method comprises: in response to receiving a write request, dividing data to be written into a plurality of data blocks with a predetermined size, the plurality of data blocks having their respective logic block addresses; evenly mapping, based on the logic block addresses, the plurality of data blocks to a plurality of RAID extents of a Redundant Array of Independent Disks (RAID); mapping the plurality of data blocks in the plurality of RAID extents to the disk, so that the plurality of data blocks are distributed in order of size of logic block addresses in the disk.

Abstract: A data storage device comprises a storage array containing first data, a buffer containing RAID units, and a controller in communication with the storage array and the buffer. The controller is configured to receive a read request from a host device for a second data stored in the storage array, and determine an identifier associated with the requested second data. The controller is also configured to determine if the requested second data contains an unrecoverable error. The controller then accumulates first data, including a parity value, contained in the storage array associated with the same identifier as the requested second data in a reconstruction buffer, if the requested second data contains an unrecoverable error.

Abstract: A memory system includes: a memory device storing data in a location determined by a physical address corresponding to a logical address; and a controller updating the physical address corresponding to the logical address for moving the data associated with the logical address to another location, storing the data including update history of the physical address corresponding to the logical address into the another location determined by the updated physical address, and tracking the data associated with the logical address based on the update history of the physical address when the data is not stored normally into the another location. The data processing system is capable of efficiently storing a plurality of data managed in a tree structure.

Abstract: A method and a device for configuring RAID are provided. When a RAID configuration is required, an Integrated Fast Intelligent Scalable Toolkit (IF) start command is sent to each server to perform a RAID configuration in a batch manner. Each server completes the start of the IF based on the received IF start command and sends a RAID configuration command to an Agent in the IF for RAID configuration.

Abstract: A method for execution by a computing device of a dispersed storage network includes identifying a DSN address for data to be accessed within a DSN. A plurality of storage cohorts associated with the data to be accessed are identified. Ranked scoring information for each storage cohort obtaining ranked scoring information for each storage cohort of the plurality of storage cohorts with regards to the data to be accessed is obtained. A storage cohort of the plurality of storage cohorts is selected based on the ranked scoring information. Slice access requests are issued to a set of storage units of the selected storage cohort for the data to be accessed. Slice access responses received from at least one of the set of storage units of the selected storage cohort are processed.

Abstract: A processor can determine that a set of the memory cells is controlled by signals from a first portal. The processor can determine a function of a second portal in a relationship between the first portal and the second portal. The processor can cause, in response to a determination that the function of the second portal is a specific function, a memory control circuitry to be configured so that a subset, of the set, is controlled also by signals from the second portal. The processor can determine a function of a third portal in a relationship between the first portal and the third portal. The processor can cause, in response to a determination that the function of the third portal is the specific function, the memory control circuitry to be configured so that the subset, of the set, is controlled also by signals from the third portal.

Abstract: A memory system includes a memory device comprising a plurality of planes and a controller suitable for controlling the memory device. The controller may include a processor suitable for determining at least one busy plane and at least one idle plane among the plurality of planes in response to a host command, and controlling the memory device such that the busy plane performs an operation associated with the host command and the idle plane performs an operation of erasing a complete dirty block in the idle plane. The busy plane and the idle plane may operate in parallel in response to control of the processor.

Abstract: An aspect includes generating a checkpoint for a storage system containing an image for a point in time. An aspect also includes storing, in a reserved area, volume configuration data corresponding to volumes for the point in time, layers of metadata and physical data for the point in time. An aspect further includes creating consistent snapshots for the volumes, destaging a control module journal and persisting a hash tree and dirty tree metadata, destaging a code cache, dumping hash metadata and physical layout metadata to a separate location in the storage and enabling new metadata updates to a default location. An aspect also includes redirecting new data and metadata IOS to stripes reserved during preparation of the separate location relating to the checkpoint and protecting checkpointed data and metadata, and generating a consistent checkpoint copy of a management module repository in the reserved area of storage.

Abstract: A device implementing a system for object placement includes at least one processor configured to identify an object stored on two of a plurality of storage devices, and to determine a pairing value for each pair of the plurality of storage devices, the pairing value corresponding to a number of stored objects common to the pair. The at least one processor is further configured to select, based on the determined pairing values, two storage devices having a lowest pairing value relative to the determined pairing values, and to move the object to each of the two selected storage devices.

Abstract: An apparatus to facilitate copying surface data is disclosed. The apparatus includes copy engine hardware to receive a command to access surface data from a source location in memory to a destination location in the memory, divide the surface data into a plurality of surface data sub-blocks, process the surface data sub-blocks to calculate virtual addresses to which accesses to the memory are to be performed and perform the memory accesses.

Abstract: Based on a system configuration change (e.g., of a Decentralized, or Distributed, Agreement Protocol (DAP)) within a dispersed storage network (DSN), a computing device identifies a reallocating encoded data slice (EDS) number that is no more than a pillar width minus a performance threshold. The computing device then directs storage units (SUs) to update system configuration of the DAP (e.g., from a first to a second system configuration) by throttling and controlling the number of SUs permitted to update at a time. For example, the computing device permits no more than the reallocating EDS number of SUs to perform simultaneous (or substantially or approximately simultaneous) update of the system configuration of the DAP. The computing device also directs the SUs to operate based on the first system configuration before the condition(s) is/are met and then to operate based on the second system configuration after the condition(s) is/are met.

Abstract: Mechanisms for controlling access to storage volumes on the secondary storage system is provided. A determination is made as to whether a first site computing device has sent a notification of a failure condition of a first site. In response to a determination that the notification of the failure condition of the first site has not been received, secondary workloads of a second site computing device are permitted to access storage volumes on the secondary storage system. In response to a determination that the notification of the failure condition of the first site has been received, a mode of operation of the second site is modified from a normal mode of operation to a failure mode of operation. In the failure mode of operation, the storage system controller of the second site blocks at least a portion of access requests from secondary workloads of the second site computing device.

Abstract: A server-based desktop-virtual machines architecture may be extended to a client machine. In one embodiment, a user desktop is remotely accessed from a client system. The remote desktop is generated by a first virtual machine running on a server system, which may comprise one or more server computers. During execution of the first virtual machine, writes to a corresponding virtual disk are directed to a delta disk file or redo log. A copy of the virtual disk is created on the client system. When a user decides to “check out” his or her desktop, the first virtual machine is terminated (if it is running) and a copy of the delta disk is created on the client system. Once the delta disk is present on the client system, a second virtual machine can be started on the client system using the virtual disk and delta disk to provide local access to the user's desktop at the client system. This allows the user to then access his or her desktop without being connected to a network.

Abstract: A system and method for dynamic RAID geometries. A computer system comprises client computers and data storage arrays coupled to one another via a network. A data storage array utilizes solid-state drives and Flash memory cells for data storage. A storage controller within a data storage array is configured to configure a first subset of the storage devices for use in a first RAID layout, the first RAID layout including a first set of redundant data. The controller further configures a second subset of the storage devices for use in a second RAID layout, the second RAID layout including a second set of redundant data. Additionally, when writing a stripe, the controller may select from any of the plurality of storage devices for one or more of the first RAID layout, the second RAID layout, and storage of redundant data by the additional logical device.