Abstract: A containerized storage microservice is described. The containerized storage microservice, and its corresponding architecture, provide an environment wherein an application container accesses containerized storage services through a direct connection. This allows the operating system file system to be effectively bypassed in the provision of storage services. In one example, a library provides a basic file system and is arranged underneath the application container. The library essentially intercepts storage requests and emulates a thin file system. Instead of invoking the kernel of the operating system to process each storage request, the library allows the storage request to bypass the kernel and pass the storage request to the storage microservice. The containerized storage microservices are available in different types, and are configured so that they can be stacked to provide customized sets of storage services to different types of application containers.

Abstract: One-to-one join is widely used in machine learning and business intelligent applications. Disclosed herein is an efficient method for one-to-one join to reduce memory usage and thus disk I/O accesses with limited memory. Disclosed method outputs and removes a pair of tuples immediately when they are matched to each other to allow join results to be generated without reading entire tables. Meanwhile, disclosed method increases matching rate for in memory blocks through the predication of data distribution patterns based on both statistics and history block matching information.

Abstract: A data storage device capable of namespace re-sizing comprises a nonvolatile semiconductor storage device containing data accessed via a logical address that includes a namespace identifier and a logical block address, and a controller. The storage device can convert the namespace identifier to a base address using a first look up table. The storage device can further convert the logical block address to namespace allocation units of storage. The storage device can also determine a pointer using the base address, the namespace allocation units, and a second look up table. Further, the storage device can determine a full logical cluster address using the pointer.

Abstract: A technique for managing storage of directories in a file system performs a testing operation on a file-system block of a directory file. The testing operation determines whether the file-system block contains any directory element that identifies a currently-present content object in the directory. In response to the testing operation determining that the file-system block contains no directory element that identifies any currently-present content object, the file system performs a hole-punching operation on the file-system block, removing the block from the directory file and freeing the block for other use.

Abstract: Embodiments of systems and methods are provided for data storage in a tiered storage system comprising at least two storage tiers. A method comprises: providing storage information for each storage tier of the storage tiers to a user. The storage information comprising values of storage parameters, wherein the storage parameters comprise at least one of a storage quota limit of the user, usable storage capacity in the tier for the user based on the storage quota limit, and consumed storage capacity of the tier by the user. The storage information is used to move data between the storage tiers.

Abstract: In an example embodiment, a solution is used to provide for a highly efficient application installer. A software packaging format, known as vSolution, is provided that allows software developers to ship multiple artefacts of different types in a single container. Unlike traditional mechanisms, this container does not contain a dedicated installer executable or any sort of installation routine. Rather, the container format encourages a declarative approach to describe what an installation routine should perform, via the organization of the artefacts based on content type and using a naming convention.

Abstract: One or more techniques and/or systems are provided for incremental transfer with unused data block reclamation. For example, source volume of a source storage filer may have a physical replication relationship with a destination volume of a destination storage filer. Snapshots of a file system of the source volume may be used to identify new data blocks (e.g., data blocks allocated or reallocated to a new snapshot) and/or unused data blocks (e.g., data blocks of a deleted snapshot) used to incrementally update the destination volume so that the destination volume is a mirrored replication of the source volume. In this way, new data blocks may be updated and unused data blocks may be punched out (e.g., deallocated) of the destination volume during execution of an incremental update.

Abstract: A mechanism is provided in a data processing system for managing filesystem inodes. The mechanism monitors inode consumption in a filesystem. The mechanism periodically determines a number of inodes to add to the filesystem based on the inode consumption and adds the number of inodes to the filesystem.

Abstract: Exposing a proprietary image backup to a hypervisor as a disk file that is bootable by the hypervisor. In one example embodiment, a method of exposing a proprietary image backup to a hypervisor as a disk file that is bootable by the hypervisor may include identifying the proprietary image backup having a proprietary format and storing an operating system, identifying a plugin file corresponding to the proprietary image backup, gathering operating system data from the proprietary image backup, reformatting the operating system data into a native format of the hypervisor, and booting the operating system in a guest virtual machine of the hypervisor.

Abstract: In one example, a method for writing data includes receiving a write request and performing a first type of logging process in connection with the write request, and creating a corresponding first logging record. Additionally, a second type of logging process is performed in connection with the write request, and a corresponding second logging record created, where the second type of logging process is different from the first type of logging process. Next, a determination is made, as between the two logging records, which of the logging records requires the least amount of non-volatile random access memory (NVRAM), and the logging record that requires the least amount of NVRAM is written to the NVRAM.

Abstract: The method, computer program product and computer system of the present invention may include a computing device that replicates data from a first data storage site, which may have a plurality of data storage tiers, to one or more second data storage sites. The computing device may identify a portion of the data on a first tier of the first data storage site to be inactive and move the inactive data to a second tier of the first data storage site. The computing device may compute a number of slices to slice the inactive data into and a location to store the slices of inactive data using an information dispersal algorithm. The computing device may send the computed number of slices and storage location for the inactive data to the one or more second data storage sites to apply to the data replicated from the first data storage site.

Abstract: According to an embodiment, an information processing apparatus includes a non-volatile memory manager. The non-volatile memory manager is configured to save, in a non-volatile memory section, information of a plurality of storage sections to be read after rebooting. The non-volatile memory section is configured to keep storing information even if power is off.

Abstract: A storage array presents a logical production volume that is backed by tangible data storage devices. The production volume is organized into fixed size front end allocation units. The tangible data storage devices are organized into discrete size back end allocation units of a plurality of different sizes. Data associated with each one of the front end allocation units is stored on only one of the back end allocation units. For example, compressed data may be stored on a back end allocation unit that is smaller than a front end allocation unit while maintaining a 1-to-1 relationship between the front end allocation unit and the back end allocation unit.

Abstract: A memory package in which a plurality of stacked non-volatile memory dies is connected to one another through a plurality of vertical vias is used in a memory system. The dies are classified into a plurality of die groups including a first die group that includes a plurality of dies connected to a first channel, and a second die group that includes a plurality of dies connected to a second channel. A data write/read operation on the first die group is performed through the first channel in response to an I/O command designating a first area corresponding to the first die group, and a data write/read operation on the second die group is performed through the second channel in response to an I/O command designating a second area corresponding to the second die group.

Abstract: An example system in accordance with an aspect of the present disclosure includes a cache engine, a validate engine, and an access engine. The cache engine is to cache, into an address cache of an object reference, an object address corresponding to an object, in response to performing a lookup of the object via at least one indirection. The validate engine is to validate that an object ID of the object located at the cached object address corresponds to a reference object ID that is stored in the object reference and associated with the object. The access engine is to access the object via a lookup of the object address cached in the address cache of the object reference, in response to validating the reference object ID.

Abstract: Disclosed is a method for creating and reading a contiguous file in an extensible file system. During the creation of a file on the storage media, the file system format check the bitmap to determine if there are areas of free space on the media that would permit the storage of the file in a contiguous manner. By storing the file in a contiguous manner the file may later be read without resorting to the file allocation table, because the file itself would not be fragmented on the storage media. Once an area of free space has been identified, the file is written to the media in a contiguous manner. Further, an associated entry for the file in the directory entry is updated or created to indicate that the file is a contiguous file and also provides basic parameters necessary to read the file without resorting to accessing the file allocation table.

Abstract: Techniques for transferring files between machines include creating a zero-length target file on non-volatile storage, truncating the file to a desired size, and allocating storage on the non-volatile storage for each block of the target file. The technique also includes determining a logical block address (LBA) for each location in the target file. The technique further includes sending a request to an input/output (I/O) node to transfer a source file to the non-volatile storage, where the request includes a mapping between the LBAs and file offsets. The technique includes opening the source file and a block device at the I/O node. The technique further includes reading each block from the source file and writing each block to the target file on the non-volatile storage utilizing the block device, and then closing the source file and the block device.

Abstract: A method and apparatus is disclosed herein for maintaining deduplication metadata on disk separate from an in-memory deduplication file system for a deduplication computing system. The method may include reading deduplication metadata from a first memory of a deduplication computing system. Furthermore, the method may include maintaining deduplicated data for a file system in a second memory, and maintaining the deduplication metadata that describes the deduplicated data of the file system in the first memory of the deduplication computing system, wherein the first memory is a different type of memory and separated from the second memory in the deduplication computing system. Furthermore, the method may include accessing the deduplication metadata in the second memory in response to receipt of a request by the deduplication computing system to perform a first operation with deduplicated data of the file system in the second memory.

Abstract: There is a storage apparatus which provides a storage area, comprises a cache memory, reads data into the cache memory from the storage area according to a read request and sends the data from the cache memory, and a computer is coupled to the storage apparatus. The computer receives a data processing request, determines an access usage based on the data processing request (or, the information relating to an access usage of the data processing request), selects a logical device corresponding to the determined access usage from a plurality of logical devices which are allocated to the storage area and issues a read request to the selected logical device.

Abstract: A method, article of manufacture, and apparatus for maintaining a cache index inside a deduplicated storage system is discussed. A determination is made to flush a cache buffer to the cache index, wherein both the cache buffer and the cache index comprise a plurality of cache buckets, wherein the cache buckets are stored on a plurality of logical data blocks. A write is initiated to at least one of the plurality of logical data blocks, wherein the write comprises at least one of the cache buckets. An error is received in response to the write request. The error is stored in a memory on the deduplicated storage system.

Abstract: In one embodiment, a method includes writing a file into a data partition of a tape medium. The method also includes storing a high resolution tape directory (HRTD) having location information of data in the data partition as part of end of data (EOD) of the index partition. The storing the HRTD as part of the EOD of the index partition includes requesting movement of the tape medium to the index partition in order to update an index file after changes have occurred to data in the data partition, and writing an updated index file into the index partition concurrent to writing an updated HRTD into the EOD of the index partition.

Abstract: A method, article of manufacture, and apparatus for populating an index cache on a deduplicated storage system is discussed. A determination to flush an in-memory index to a hard drive (“HDD”) on the deduplicated storage system is made, wherein the in-memory index comprises in-memory hash buckets containing fingerprint identifiers and container identifiers. A first HDD index is loaded from the HDD into a memory, wherein the first index includes a plurality of HDD buckets. The fingerprint identifiers and the container identifiers are merged from the in-memory hash buckets into the HDD buckets. The HDD buckets are mapped to a plurality of solid state drive (“SSD”) buckets, the SSD buckets together comprising a SSD index. The fingerprint identifiers and container identifiers are inserted into the plurality of SSD buckets.

Abstract: An apparatus, method, system, and program product are disclosed for tape copying. One method includes mounting a first source tape of multiple source tapes on a source tape drive. The method includes mounting a destination tape on a destination tape drive. The method also includes copying a first index of an index partition of the first source tape to a first copied index of an index partition of the destination tape. The method includes storing first position information corresponding to the first copied index on the destination tape. The method also includes copying first data of a data partition of the first source tape to a first copied data of a data partition of the destination tape. The method includes storing second position information corresponding to the first copied data on the destination tape.

Abstract: System for generating a pseudo-repository. The system scans a directory to detect compiled binary files, and assembles an index of the compiled binary files based on metadata describing the compiled binary files. Then the system generates a pseudo-repository based on the index that maps each compiled binary file with at least one associated artifact, wherein the pseudo-repository responds to client requests for one of the binary files.

Abstract: A technique for managing file system expansions includes receiving a request to perform a file system expansion, the request specifying or implying an increase in size of a file system to a new target size. The request is received while a previous file system expansion is already in progress. The technique includes merging the previous file system expansion into the file system expansion specified by the request, to increase the size of the file system to the new target size.

Abstract: Exposing a proprietary image backup to a hypervisor as a disk file that is bootable by the hypervisor. In one example embodiment, a method of exposing a proprietary image backup to a hypervisor as a disk file that is bootable by the hypervisor may include identifying the proprietary image backup having a proprietary format and storing an operating system, identifying a plugin file corresponding to the proprietary image backup, reconfiguring the operating system to cause the operating system to be bootable when using hardware emulated by the hypervisor, gathering operating system data from the proprietary image backup, reformatting the operating system data into a native format of the hypervisor, and booting the operating system in a virtual machine of the hypervisor.

Abstract: A data storage system synchronously or asynchronously determines data storage usage policies in connection with incoming data storage requests so as to improve policy compliance and system efficiency. In some embodiments, a synchronous usage meter is used to make such policy decisions, and variously implement consistent hashing techniques to improve system availability and efficiency. In some embodiments, an asynchronous usage meter is used, and is implemented using an ordered queueing engine so as to improve the accuracy of policy decisions.

Abstract: A logging tool running on a computing device serializes system and application events. The logging tool analyzes a logging stream from a process to identify if the logging stream includes a formatting instruction. The logging tool identifies at least one argument associated with the formatting instruction, and serializes the formatting instruction and the at least one argument by recording, to a buffer, the formatting instruction and the at least one argument without formatting the logging stream.

Abstract: Described are methods, systems, and apparatus, including computer program products for expanding a storage pool-backed file system. A file system expansion trigger is detected. First reserved space in the storage pool is reserved. A LUN size attribute associated with a LUN underlying the file system is increased. A file system size attribute associated with the file system is increased. First data to write to the file system is received. In response to receiving the first data, an expansion result is determined, wherein the expansion result indicates whether to expand the LUN and the file system. If the expansion result indicates to expand the LUN and the file system, a first portion of the first reserved space is provisioned and formatted. The first data is written to the file system.

Abstract: A method of managing logical unit numbers (LUNs) in a storage system includes identifying one or more LUN logical block address (LBA)-groups being affected. The one or more LUN LBA-groups defining a LUN. The method further determining the existence of an association of each of the affected LUN LBA-groups to a portion of a storage pool and maintaining a mapping table to track the association of the LUN LBA-groups to the storage pool.

Abstract: A storage apparatus includes a data storage unit, management information storage unit, compression judgment unit, and compression control unit. The data storage unit stores the data of files. The management information storage unit stores management information on the files. The compression judgment unit evaluates compression effectiveness for a file at prescribed execution timing and determines whether the compression of the file is appropriate or not. The compression control unit updates the management information so as to reflect the determination result obtained by the compression judgment unit, and then stores the compressed data of the file in a compressed format in the data storage unit if the determination result indicates that the compression is appropriate, and stores the uncompressed data of the file in an uncompressed format in the data storage unit if the determination result indicates the compression is inappropriate.

Abstract: A memory system including parent data and clone data is disclosed, where the clone data represents a clone of the parent data. The system determines whether clone data to be accessed is different from corresponding data in the parent. The system also determines a physical location of the data to be accessed based on whether the data to be accessed is different from the corresponding parent data. The system also accesses the data based on the physical location.

Abstract: A memory system including parent data and clone data is disclosed, where the clone data represents a clone of the parent data. The system determines whether clone data to be accessed is different from corresponding data in the parent. The system also determines a physical location of the data to be accessed based on whether the data to be accessed is different from the corresponding parent data. The system also accesses the data based on the physical location.

Abstract: A die assignment scheme assigns data, in the order it is received, to multiple memory dies with some randomness. Randomization events, such as skipping dies or reversing direction, occur at intervals, with a deterministic assignment scheme used between randomization events. Intervals between randomization events may be of random length, or of fixed length.

Abstract: A CM 10 includes an unmount detector 142 and a mount detector 144 that monitor unmount and mount of each disk 21 of a RAID configuration, a write request manager 143 that manages a write request for writing data to a disk 21 that is unmounted, a consistency determination unit 145 that, when mount of a disk 21 of the RAID configuration is detected, makes a determination on consistency of the data of the disk 21 in which mount is detected on the basis of the managed write request, and a RAID incorporating unit that, when it is determined that the data lacks consistency, performs processing for recovering data expected to be written by the write request issued to the disk 21 in which mount is detected while the disk 21 is unmounted and incorporates the disk 21 in an original RAID configuration.

Abstract: The method and an apparatus provides a virtualized file system enabling indirect access to a second file system in a data storage system comprising a plurality of client computers 100 and a second file system managing unit 410 for managing the second file system and enabling client access to the second file system, the method comprising interconnecting a first file system managing unit 310 between the plurality of client computers 100 and the second file system managing unit 410, creating a directory /root in a first file system managed by the first file system managing unit 310, a directory /root of the second file system with the directory /root of the first file system, enabling on-demand virtualization of the second file system by the first file system managing unit 310 based on client requests received from the client computers 100 at the first file system managing unit 310.

Abstract: The present invention provides a metadata storage system and a management method for a cluster file system. The metadata of the cluster file system is stored by using a DRAM+SSD+HDD three-tier architecture, and the metadata is written sequentially into a metadata buffer in the DRAM based on write-in time. When a metadata buffer fully written, it is written back into the SSD sequentially to form a new metadata storage unit, and corresponding metadata index information in a header structure thereof is stored into the DRAM in a form of a metadata index unit.

Abstract: An apparatus, system, and method are disclosed for offloading data processing. An offload task hosted on a first data processing system provides internal functionality substantially equivalent to that of a second task 304 hosted on a second data processing system of a potentially different architecture. A proxy task hosted on the second data processing system provides an external interface substantially equivalent to that of the second task. A communication mechanism between the first and second data processing systems may be comprised of a network, shared storage, and shared memory. The proxy task substantially replaces the second task, delegating the internal functionality of the second task to the offload task via mapping of arguments and accessing and translating of input and output data as required.

Abstract: Local storage on player instruments provides the ability for adding further amendments and most recent supplements to the optical disc content. A problem arising with this technically applicable possibility is the protection of copyrights bound to disc and supplement data. The present invention describes a technique to ensure a security framework that is able to handle this, by creating a virtual file system (VFS) by merging optical disc data and local storage data based upon a common identifier.

Abstract: Disclosed herein are systems, methods, and software for attaching applications to a computing device based on a file type selection. In one example, a method for operating an application attaching system to dynamically make applications available to a computing device includes identifying an application attach triggering event based on a file selection of a certain file type on the computing device. The method further includes, in response to the application attach triggering event, identifying an application within an application volume based on the certain file type. The method also includes attaching the application volume to computing device, and associating the application to the certain file type on the computing device.

Abstract: Local storage on player instruments provides the ability for adding further amendments and most recent supplements to the optical disc content. A problem arising with this technically applicable possibility is the protection of copyrights bound to disc and supplement data. The present invention describes a technique to ensure a security framework that is able to handle this, by creating a virtual file system (VFS) by merging optical disc data and local storage data based upon a common identifier.

Abstract: A logical volume manager (LVM) may manage a plurality of logical volumes and a plurality of drives in a logical data storage using metadata stored on the plurality of drives. The metadata (e.g., global metadata) may include a first set of permissions for a storage location in one of the logical volumes. The LVM may analyze permission data (e.g., local permission data) associated with the storage location and may override the metadata (e.g., the permissions in the global metadata) with a second set of permissions obtained from the permission data. The LVM may use the second set of permission data to access the storage location (e.g., a logical volume, logical volume group, file, partition directory/folder, set of data blocks). Permission data may be generated based on an identifier for a virtual machine, computing device, or user, and may be generated based on user input.

Abstract: A storage system includes a plurality of storage modules. Each storage module may be interconnected by a module interconnect switch and may include a memory, a central processing unit, a cache, and a plurality of storage devices. Storage space may be reclaimed in the storage system by a storage module requesting a copy of a file system bitmap, receiving a request to write data to a partition of the storage module, updating a write table to indicate the partition write, querying the copy of the file system bitmap and the write table to determine if the partition has been written to and if the partition may be reclaimed, and reclaiming the partition for subsequent reallocation and reuse.

Abstract: Provided is a storage device configured to store a file system including (1) a personality oriented file information (PFI) directory entry including a first directory entry having a file allocation table (FAT) structure, and a second directory entry having a structure different from that of the first directory entry, the second directory entry including additional information instructing an access device on at least one parameter associated with creation and storing of a storage file, and (2) an entry table including location information of the PFI directory entry.

Abstract: A data retrieval system comprising a first computing device communicatively coupled to a second computing device; the first computing device having a processor that supports operation of at least one software application that is used for retrieving data; the second computing device communicatively coupled to one or more storage media; the software application having a retrieval module for retrieving data from the one or more storage media; a storage and backup map that maps to the second computing device; and a data index stored on the second computing device that indicates to the retrieval module a particular location of the data that is to be retrieved by the retrieval module.

Abstract: Embodiments of the invention are directed to optimizing reconstruction of operation data in volatile memory of solid-state storage subsystems. In various embodiments, operation data is stored in the volatile memory with persistent backup data of the operation data in the non-volatile memory. In one embodiment, operation data includes a superblock table that is used to identify most or all groups of blocks (superblocks) within the storage device that certain firmware components operate on. Sometimes operation data in the volatile memory is lost or corrupted due to a power interruption or system shutdown. To optimize the reconstruction of the superblock table or other similar operation data in the volatile memory, embodiments of the invention use a “snapshot entry” to identify the latest entry information, allowing the controller to quickly identify the most updated physical locations of the operation data portions and complete the reconstruction in an efficient manner.

Abstract: Disclosed is an improved approach for using advanced metadata to implement an architecture for managing I/O operations and storage devices for a virtualization environment. According to some embodiments, a Service VM is employed to control and manage any type of storage device, including directly attached storage in addition to networked and cloud storage. The advanced metadata is used to track data within the storage devices. A lock-free approach is implemented in some embodiments to access and modify the metadata.

Abstract: An object based file system for storing and accessing objects is disclosed. The file system may be implemented as a method in hardware, firmware, software, or a combination thereof. The method may include receiving from an application program an object write request. A selected storage node on which to store the object may be selected, including identifying a least busy storage node and/or a least full storage node. The object and the object write request may be sent to the selected storage node. A write success message may be received from the selected storage node. The successful writing of the object may be reported to the application program.

Abstract: The method and an apparatus provides a virtualized file system enabling indirect access to a second file system in a data storage system comprising a plurality of client computers 100 and a second file system managing unit 410 for managing the second file system and enabling client access to the second file system, the method comprising interconnecting a first file system managing unit 310 between the plurality of client computers 100 and the second file system managing unit 410, creating a directory /root in a first file system managed by the first file system managing unit 310, a directory /root of the second file system with the directory /root of the first file system, enabling on-demand virtualization of the second file system by the first file system managing unit 310 based on client requests received from the client computers 100 at the first file system managing unit 310.

Abstract: An object based file system for storing and accessing objects is disclosed. The file system may be implemented as a method in hardware, firmware, software, or a combination thereof. The method may include receiving from an application program an object write request. A selected storage node on which to store the object may be selected, including identifying a least busy storage node and/or a least full storage node. The object and the object write request may be sent to the selected storage node. A write success message may be received from the selected storage node. The successful writing of the object may be reported to the application program.