Abstract: A system and method are presented that utilize separate append-only arrays to track metadata and real data for a file. All modifications to the file result in metadata records being appended to the end of the metadata array. Write modification commands cause real data to be appended to the file data array. The location of real data on the file data array is identified by a record in the metadata array. Modification commands can be grouped into sets, which complete as a set. Modification sets can rely upon the completeness of prior sets. Read-like commands cause the creation of a virtual array based upon the records of the metadata array. The created virtual array has the same size as the actual file but does not contain the real data for the file. Rather, the virtual file array maps to the actual data stored in the file data array.

Abstract: A method includes error encoding data to produce a plurality of data slices. Metadata is determined for a data slice of the plurality of data slices. The metadata is stored in a metadata storage tree. The data slice is stored in a slice storage location indicated by the metadata. Based on determining to access the data slice, the metadata for the data slice is accessed in the metadata storage tree to determine the slice storage location for the data slice, and the data slice is accessed in the slice storage location based on determining the slice storage location for the data slice via accessing the metadata storage tree.

Abstract: Methods, devices and computer program products facilitate the storage, access and management of log files that are associated with particular client devices. The log files provide a record of user or client device activities that are periodically sent to a data backup center. A dedicated log file server facilitates the processing and storage of an increasingly large number of log files that are generated by new and existing client devices. A storage server pre-processes the received log files to facilitate the processing and storage of the log files by the log file server. This Abstract is provided for the sole purpose of complying with the Abstract requirement rules. This Abstract is submitted with the explicit understanding that it will not be used to interpret or to limit the scope or the meaning of the claims.

Abstract: Techniques for integrated authentication for a container-based environment are described herein. An aspect includes accessing, by an application that is running in a container in a container environment that is hosted by a hypervisor on a host system, an authentication module that is located in the container environment. Another aspect includes invoking an authentication handler in the container environment based on the accessing of the authentication module. Another aspect includes passing control to the hypervisor from the authentication handler. Another aspect includes retrieving a security artifact from a security database of the host system by the hypervisor. Another aspect includes providing the retrieved security artifact to the application via the authentication handler. Another aspect includes performing an authentication operation by the application using the security artifact.

Abstract: Journaling for files in a distributed file system may be dynamically changed. A write request for a file in a distributed file system may be received. An evaluation of the file may be performed with respect to a journaling type change criteria. If the evaluating indicates a change to journaling type, then the write request may be performed according to a different type of journaling than was applied to prior write request. If the evaluating does not indicate a change, then a current journaling type may be applied to perform the write request.

Abstract: In general, embodiment relate to a method for provisioning a plurality of client application nodes in a distributed system using a management node, the method comprising: creating a file system in a namespace; associating the file system with a scale out volume; mounting the file system on a metadata node in the distributed system, wherein mounting the file system comprises storing a scale out volume record of the scale out volume; storing file system information for the file system in a second file system on the management node, wherein the file system information specifies the file system and the metadata node on which the file system is mounted; wherein storing the file system information triggers distribution of the file system information to at least a portion of a plurality of client application nodes.

Abstract: In a hierarchical storage management system including: a hierarchical storage that is provided in an individual data center and has at least one storage medium; and a hierarchical storage control apparatus that manages at least one hierarchical storage, the hierarchical storage control apparatus includes a calculation unit that performs processing for obtaining, for individual data managed by the hierarchical storage control apparatus, a storage medium in a data center that satisfies an operation policy by calculating power consumption needed for storing the data, a cost needed for storing the data, and communication time for transferring the data from a data center to a reference source area and by comparing the calculated power consumption, cost, and communication time with the operation policy set for the data.

Abstract: A memory system according to an embodiment includes a memory system includes a nonvolatile memory and a memory controller. The nonvolatile memory includes blocks. The memory controller includes first and second tables, and first and second storage areas. The first table is managed in units of map segments. The second table includes first entries associated with a plurality of map segments included in the first table. The first storage area is configured to store a change history of the first table. The second storage area is configured to store a physical address of a block that is a storage destination of a copy of a changed map segment and a change history of the second table.

Abstract: A peripheral device includes a host interface and processing circuitry. The host interface is to communicate with one or more hosts over a peripheral bus. The processing circuitry is to expose on the peripheral bus a peripheral-bus device that communicates with the one or more hosts using one or more instances of at least one bus storage protocol, to receive, using the exposed peripheral-bus device, Input/Output (I/O) transactions that are issued by the one or more hosts, and to complete the I/O transactions for the one or more hosts in accordance with one or more instances of at least one network storage protocol, by running at least part of a host-side protocol stack of the at least one network storage protocol.

Abstract: Techniques are provided for remote object store error handling. A storage system may store data within one or more tiers of storage, such as a local storage tier (e.g., solid state storage and disks maintained by the storage system), a remote object store (e.g., storage provided by a third party storage provider), and/or other storage tiers. Because the remote object store may not provide the same data consistency and guarantees that the storage system provides for clients such as through the local storage tier, additional validation is provided by the storage system for the remote object store. For example, when data is put into an object of the remote object store, a verification get operation is performed to read and validate information within a header of the object. Other verifications and checks are performed such as using a locally stored metafile to detect corrupt or lost metadata and/or objects.

Abstract: The technology described herein efficiently determines whether a real inode is shared among views, or owned. In-memory data structures include a view snapshot generation counter that is increased as a snapshot that generates a view is created, and an inode total weight. An in-memory virtual inode cache dataset for a filesystem object associated with the view is instantiated with the value of snapshot generation counter, sharing-related data based on the inode mapping file entry for the object, and an inode access weight. To determine whether the inode is shared (and needs to be split), such as on a write to the object, the in-memory data is evaluated. The real inode is shared if the generation counters are unequal, if the sharing-related data indicates sharing at an intermediate indirect block level, or indicates sharing at the inode level and the inode access weight is less than the inode total weight.

Abstract: Systems, methods, and computer-readable media for constant file replacement operations in a bundle of executable files are disclosed. Systems and methods may involve receiving a plurality of files, reading contents of an impure file in the plurality of files, identifying a link between the impure file and at least one pure file in the plurality of files, and reading contents of the at least one pure file to determine exported values. The at least one pure file may lack side effects. The impure file may be traversed to determine at least one reference to the at least one pure file and ascertaining at least one exported value referenced by the at least one pure file. Systems and methods may involve replacing the at least one reference in the impure file with the ascertained at least one exported value and unlinking the at least one pure file from the impure file.

Abstract: An automated method and system are provided for comparing a source database and a target database that are intended to be kept in synchronization with each other. An application processes transactions that are posted to the source database and replicated to the target database. Before images of changes made to records or rows of the source database resulting from transactions posted to the source database into a first change log are collected. The before images of changes made to records or rows of the source database are replicated to the target database. Current images of records or rows of the target database that correspond to the before images of changes made to records or rows of the source database are read. Representations of the before images of changes made to records or rows of the source database are compared with representations of the current images of records or rows of the target database that correspond to the before images of changes made to records or rows of the source database.

Abstract: A vehicular device includes a control unit, a non-volatile first storage unit, a second storage unit, a notification unit, and a backup unit. Multiple operating systems operate in the control unit. The backup unit is provided in each operating system and is configured to back up, on the first storage unit, data temporarily stored in the second storage unit. The backup unit is configured to back up the data on the first storage unit upon being notified of the change in the power supply state by the notification unit. The backup unit running on one operating system is configured to pass, to the backup unit provided in another operating system, target data or information identifying the target data. When a failure occurred in the one operating system, the backup unit provided in the other operating system backs up the target data or the information identifying the target data.

Abstract: Disclosed is an execution information sharing system that duplicates execution information to a provider target (and other targets) as it is being loaded to a consumer target. A consumer account of a data sharing platform executes an application shared with it by a provider account of the platform. Consumer and provider configurations indicating consumer and provider targets respectively are generated. The consumer configuration and provider configurations are provided to an event context to generate a first and second event unloaders respectively, wherein the event context maintains a mapping linking both the first event unloader and the second event unloader to the application. In response to receiving execution information from the application, the first event unloader and the second event unloader are retrieved. The execution information is then written to the consumer target and the provider target using the first event unloader and the second event unloader respectively.

Abstract: A server system includes a first plurality of mass-storage devices, a central processing unit (CPU), and at least one near data processing (NDP) engine. The CPU is coupled to the first plurality of the mass-storage devices, such as solid-state drive (SSD) devices, and the at least one NDP engine is associated with a second plurality of the mass-storage devices and interposed between the CPU and the second plurality of the mass-storage devices associated with the NDP engine. The second plurality of the mass-storage devices is less than or equal to the first plurality of the mass-storage devices. A number of NDP engines may be based on a minimum bandwidth of a bandwidth associated with the CPU, a bandwidth associated with a network, a bandwidth associated with the communication fabric and a bandwidth associated with all NDP engines divided by a bandwidth associated with a single NDP engine.

Abstract: A system and method are disclosed for managing snapshots of a file system. In accordance with one implementation, the method includes receiving, by a processing device, a request to access a snapshot of a file system and in response to determining that the requested snapshot is active, providing, to the user account, access to the requested snapshot. The method also includes in response to determining that the requested snapshot is inactive: activating the requested snapshot, providing to the user account, after the activating, access to the requested snapshot; and in response to determining, after the activating, that a number of active snapshots exceeds a threshold number of active snapshots, selecting an active snapshot and deactivating the selected active snapshot, wherein the threshold number of active snapshots corresponds to a limit on resources of the file system that are devoted to active snapshots.

Abstract: A method includes receiving data for storage and encoding the data to produce a plurality of data slices. Metadata is determined for a data slice of the plurality of data slices. The metadata is stored in a metadata storage tree. The metadata storage tree is stored via a first plurality of memory devices of a first memory type. The data slice is stored in a slice storage location in a second plurality of memory devices of a second memory type. The slice storage location is indicated by the metadata. The first memory type has a higher performance level than the second memory type based on a utilization approach.

Abstract: A data protection system is disclosed. The data protection system comprises a cloud management platform and at least one data storage device. The cloud management platform includes a database stored with at least one key. The data storage device includes a data storage unit, a microprocessor, and a network communication component. The microprocessor is communicated with the cloud management platform by the network communication component. The data storage unit comprises a controller and a plurality of flash memories. The flash memories store a plurality of encrypted data. The microprocessor sends a key extraction request including a unique code to the cloud management platform. The cloud management platform selects the key matching to the unique code in the key extraction request from the database, and transmits the selected key to the data storage device. The controller of the data storage device decrypts the encrypted data by the key.

Abstract: A write request is transmitted from a client to a metadata server (“MDS”), wherein the write request comprises an object identifier associated with a data object. An object store location for an object store is received from the MDS. A conditional write request is transmitted to the object store using the object store location, wherein the conditional write request includes the object identifier and the data object. A metadata response is received from the object store. The metadata response is determined to contain an object designator. A commit request is transmitted to the MDS, wherein the commit response includes the object designator.

Abstract: Hosts in a cluster in a virtualized computing environment bypass a management layer when communicating with an external key management service (KMS). One of the hosts is configured with KMS configuration information (including digital certificate information) that enables the host to directly communicate with the KMS via a secure communication connection, instead of communicating with the KMS via the management layer. This KMS configuration information is replicated in a distributed manner from the host to the other hosts in the cluster, thereby enabling the other hosts in the cluster to also directly and independently communicate with the KMS to obtain encryption keys to perform cryptographic operations.

Abstract: Systems and methods described herein support tag based resource limits or quotas in a cloud infrastructure environment. Cloud administrators do not generally have the ability to restrict resource usage in existing clouds. Granting a user permission to create resources allows them to create any number of resources up to a predefined account limit. Tags are associated with resources for allowing administrators to restrict a user's resource usage to the appropriate level by allowing fine-tuned cost control. A usage of resources in a tenancy associated with a resource tag corresponding to a request characteristic of a request to provision a resource is determined and compared against a plurality of tag-based quotas, wherein the request to provision the resource is dropped based on the determined usage exceeding one of the plurality of tag-based quotas.

Abstract: The present disclosure relates to a method, an electronic device, and a computer program product for monitoring a storage system. For example, a method of monitoring a storage system is provided. This method may include setting a quota type of a folder to be monitored in the storage system to a monitored type. This method may further include acquiring quota monitoring data of which the quota type is the monitored type from a quota monitoring report associated with the storage system. In addition, this method may further include generating storage information of the folder based on the quota monitoring data. In this way, the time spent on monitoring the storage system can be shortened, the system resources can be saved, and ultimately, the user experience can be improved.

Abstract: Techniques for address mirroring of a file system journal are presented. A transactional file system update can correspond to a write operation to be performed at a first participant node of a data storage system. A journal transfer component can transfer the transactional file system update from an initiator node of the data storage system to a first journal associated with the first participant node and recovery information relating to the update to a second journal associated with a second participant node of the data storage system. The recovery information can be determined based on the update. To facilitate the update, a journal descriptor block can be generated and sent to the second participant node, such block comprising the recovery information, which can include transaction state, block addresses involved in the transaction, error correction-related information, or a mirror block address set for the block addresses where desired.

Abstract: Systems and methods facilitating fault tolerance for transaction mirroring are described herein. A method as described herein can include receiving a commit command for a data transaction from an initiator node of the system, wherein the data transaction is associated with a first failure domain, and wherein the commit command is directed to a primary participant node and a secondary participant node of the system; determining whether a response to the commit command has been received at the primary participant node from the secondary participant node in response to the receiving; and, in response to determining that the response to the commit command was not received at the primary participant node, indicating that the secondary participant node is invalid in a data store associated with a second failure domain that is distinct from the first failure domain.

Abstract: A system and method are presented that utilize separate append-only arrays to track metadata and real data for a file. All modifications to the file result in metadata records being appended to the end of the metadata array. Write modification commands cause real data to be appended to the file data array. The location of real data on the file data array is identified by a record in the metadata array. Modification commands can be grouped into sets, which complete as a set. Modification sets can rely upon the completeness of prior sets. Read-like commands cause the creation of a virtual array based upon the records of the metadata array. The created virtual array has the same size as the actual file but does not contain the real data for the file. Rather, the virtual file array maps to the actual data stored in the file data array.

Abstract: Various systems and methods for implementing a soft reset state. A server device includes processing circuitry; and at least one storage device including instructions embodied thereon, wherein the instructions, which when executed by the processing circuitry, configure the processing circuitry to perform operations of a soft reset operation, the operations to: define a soft reset state; cause a check of a secure virtual resource (SVR) of the server device, while in the soft reset state; and transition from the soft reset state in response to an event.

Abstract: Systems and methods for performing data protection operations including replication management or data copy operations. Agent-less data protections are performed. A management server is configured to perform data operations on a production host without installing an agent on the production host. A driver is adapted to aid in performing the data protection operations and communications between the management server and the driver such as commands are achieved via a storage array.

Abstract: A memory system stores user data including file content in clusters of memory space, folder entries, metadata, and a file allocation table FAT including FAT entries. The system comprises a cache memory, an addressable memory including memory space, and control logic coupled to the addressable memory and the cache memory. The control logic is configured to store user data in a current cluster at a current cluster offset including file content, and corresponding metadata including the current cluster offset, and a linked cluster offset of a linked cluster linking to the current cluster in the addressable memory, and to cache a FAT entry pointing to the current cluster in the cache memory.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for selecting a template for a content item. In one aspect, a method includes receiving a content item request that includes context data. A content item that is eligible to be presented in response to the content item request is identified. A determination is made that the content item includes a template variable that is resolved based on the context data. A template feed including a set of templates is identified based on the template variable. A template is selected from the template feed for the content item. The template can be selected based on the context data. The selected template is populated with content for the content item to create a formatted content item. The formatted content item is provided in response to the content item request.

Abstract: A system and method are presented that utilize separate append-only arrays to track metadata and real data for a file. All modifications to the file result in metadata records being appended to the end of the metadata array. Write modification commands cause real data to be appended to the file data array. The location of real data on the file data array is identified by a record in the metadata array. Modification commands can be grouped into sets, which complete as a set. Modification sets can rely upon the completeness of prior sets. Read-like commands cause the creation of a virtual array based upon the records of the metadata array. The created virtual array has the same size as the actual file but does not contain the real data for the file. Rather, the virtual file array maps to the actual data stored in the file data array.

Abstract: Techniques to back up data are disclosed. In various embodiments, a function pointer associated with a system call by an application is modified to point to a custom write function. A request to write application data is received at the custom write function. The application data is written to a backup destination based at least in part on a determination that the request is associated with invocation of a backup method of the application.

Abstract: A shared storage dynamic user quota system includes a storage management device coupled to a storage system having a shared storage space. The storage management device receives a data storage request from a user device to store data in the shared storage space. If the storage management device determines that the storage of the data in the shared storage space will exceed a user storage quota for a user associated with the user device, it determines whether the user qualifies to store the data in the shared storage space and exceed the user storage quota. In response to determining that the user qualifies to store the data in the shared storage space and exceed the user storage quota, the storage management device stored the data in the shared storage space.

Abstract: A technique for validating metadata includes creating log entries for virtualization structures pointed to by mapping pointers in a mapping tree and processing the log entries in multiple passes. A current pass validates a current level of redirection and creates new log entries to be processed during a next pass. The new log entries represent a next level of redirection, and as many next passes are processed in sequence as there are next levels of redirection.

Abstract: This application discloses a system for processing requests for data in production and archive/backup databases. The system stores a mapping of data in production and archive databases to multiple different data storage locations, including a production system storing at least one production database and an archive system storing at least one archive database. The system receives a data request from an application component, which manages or receives data from a user interface and has received the data request directly from the user interface. The system translates the data request to one or more database queries based on the mapping. The system causes to execute the database queries against data on the production or archive system. The system returns a result of executing the one or more database queries to the application component, where the application component returns the result to the user via the user interface.

Abstract: In one example, a method includes receiving metadata in the form of a modification to metadata represented by a file system namespace abstraction, wherein the file system namespace abstraction corresponds to less than an entire file system namespace, and the file system namespace abstraction includes one or more pages, and one of the pages corresponds to a particular cached block, updating the file system namespace abstraction based on the received metadata, determining if caching is enabled for the file system namespace abstraction, when caching is enabled for the file system namespace abstraction, caching the updated file system namespace abstraction in SSD storage that includes the cached block, and maintaining a status of the cached block in a Dtable of the SSD storage.

Abstract: In one set of embodiments, a storage system can execute a repair process for a first component of a file or object stored on the storage system, where the repair process is initiated in response to the first component becoming inaccessible by the storage system, and where the file or object is split across a plurality of components including the first component. The executing can include, for each chunk in an address space of the first component starting from an initial chunk pointed to by a cursor: (1) determining whether the chunk is mapped to the first component, (2) if the chunk is mapped to the first component, copying data for the chunk from a mirror copy of the first component to a second component in the plurality of components, and (3) updating the cursor to point to a next chunk in the address space.

Abstract: A designated storage system receives a request to store data in the local storage as a backup copy. The designated storage system requests a file system in the computer system to store the backup copy as a file in the local storage and maintains a record describing storage locations for each of the one or more sets of contiguous available file system data blocks. The storage system may transmit the record to a management computer configured to track which of the computer systems has stored the backup copy. The storage system then requests the file system to delete the file, whereupon the file system removes the file descriptor and frees the one or more file system data blocks in order to satisfy the deletion request but does not delete the data stored in the one or more file system data blocks.

Abstract: A content management system interface at a local computer device configured to receive user file commands from a file manager and translate the user file commands into content management commands for sending to the remote content management system via a network interface. The content management system interface is further be configured to receive remote file information from the remote content management system via the network interface and translate the remote file information into user file information for the file manager.

Abstract: A computer determines the file system that contains a first partition, a second partition and a third partition. The first partition contains metadata comprising metadata associated with a WORM-specified file, and metadata associated with a rewritable file. The second partition contains a file body of a file and a copy of the metadata. The third partition contains metadata associated with the WORM-specified file. The computer receives a request to set a file setting of a target file to a WORM setting. The computer stores metadata associated with the target file in the first partition, the second partition, and the third partition.

Abstract: A method of storage system operation, and related computer-readable media and storage system are disclosed. One or more processors or storage system controllers monitor accesses of blocks of storage memory of the storage system. The monitoring is to detect one or more characteristics of the accesses of the blocks. From the characteristic(s), it is determined the one or more accesses of the blocks are indicative of a malicious action. In response to such determining, the storage system performs a reaction action.

Abstract: A method for controlling the interoperation of a plurality of software applications and resources includes intercepting communications from a first application to a second application or resource, directing the communication to a context management system, generating a candidate list of contexts for the communication, evaluating the candidate list according to at least one policy defined for these contexts to identify the resultant action and namespace for the communication, and performing the action as defined by the policies within the identified namespace. The method further includes tracking one or more versions of the second application, as well as tracking an evolution of application and/or resource names. The method further includes identifying one or more operations associated with a context on the candidate list, and executing the identified operations prior to a further communication.

Abstract: Systems, apparatuses, methods, and computer readable mediums for implementing an I/O router to route requests based on characteristics of the requests. The I/O router may receive requests targeting a single file, and the I/O router may route requests to multiple extent maps based on characteristics of the requests. For example, requests of a first size may be mapped to a first extent map, requests of a second size may be mapped to a second extent map, requests of a third size may be mapped to a third extent map, and so on. Additionally, the system may utilize different deduplication policies for the different types of requests which are mapped to different extent maps.

Abstract: Systems and methods are disclosed for cross-system user-level management of data objects stored in one or more information management systems, and for user-level management of data storage quotas in information management systems, including data objects in secondary storage. An illustrative quota manager is associated with one or more information management systems. The quota manager comprises a quota value representing the maximum amount of data storage allowed for a given end-user's primary and secondary data in the one or more information management systems. The quota manager determines whether data associated with the end-user has exceeded the storage quota, and if so, prompts the end-user to select data for deletion, the deletion to be implemented globally, across the primary and secondary storage subsystems of the respective one or more information management systems. Meanwhile, so long as the quota is exceeded, the quota manager instructs storage managers to block backups of end-user's data.

Abstract: A system and methods for instrumented research aggregation of content are provided. Crawling processes having multiple instances and multiple IP regions per instance are distributed to multiple processors for a variety of designated content sources and feeds. An aggregated content database is generated and trigger parameters and/or subscriptions are set in relation to the database. As new content is posted to the designated content sources and feeds, a full copy of the content document is downloaded and stored, raw text is extracted from the stored document and stored, and content analysis is performed on the text document and the results are stored. For any new content that trips the set triggers/subscription parameters, a notification is sent to the associated users with a link to the stored document and an abstract of relevant text.

Abstract: Described is a system that recovers multiple virtual machines (or other computing resource) by leveraging similarities between recovery (or backup) data. The system may identify the recovery data for a particular virtual machine as a primary set of data using specialized calculations and/or heuristics. The system may leverage this primary set of data by replicating a data storage for the remaining number of virtual machines to be recovered. The system may then determine a remaining (or differing) set of data for each of the remaining virtual machines to be recovered. Accordingly, the system may only be required to rehydrate the differing set of data chunks and write those data chunks to the data storage associated with each recovery virtual machine. These recovery virtual machines may then be used to restore corresponding virtual machines within a production environment.

Abstract: Disclosed herein are methods, systems, and apparatus, including computer programs encoded on computer storage devices, for data processing. One of the methods includes determining, by a storage system from an index log file, information of a data log file stored in a storage device. The data log file includes one or more of block data, transaction data, or state data generated by a blockchain network. The storage system determines whether the data log file needs a rewritten placement. In response to determining that the data log file needs a rewritten placement, the storage system determines a source storage location of the data log file, reads the data log file from the source storage location, rewrites the data log file to a destination storage location; and generates a destination index log file that indicates the destination storage location corresponding to the data log file.

Abstract: An apparatus includes a plurality of non-volatile memory cells and control circuitry connected to the plurality of non-volatile memory cells. The control circuitry is configured to receive write commands from a host and identify write commands associated with temporary data. In a recovery operation, control data associated with the temporary data is omitted from rebuilt control data.

Abstract: A content management system interface at a local computer device is configured to receive user file commands from a file manager and translate the user file commands into content management commands for sending to the remote content management system via a network interface. The content management system interface can further be configured to receive remote file information from the remote content management system via the network interface and translate the remote file information into user file information for the file manager.

Abstract: A system and methods are disclosed for adding slots to a group of slots for instantiating compute instances. Compute capacity of a computing system of a plurality of computing systems is detected. A first slot and a second slot of the group of slots are determined based on compute instances instantiated on the computing systems. The first slot is associated with a first type of compute instance and the second slot is associated with a second type of compute instance. The first type of compute instance and the second type of compute instance have different computing resource values associated therewith. The first slot and the second slot are added to the group of slots for respectively instantiating the first type and the second type of compute instances.