Abstract: A peer-to-peer global namespace for storage system metadata federations. Specifically, the disclosure proposes a peer-to-peer metadata federation architecture, where enterprise storage metadata for any and all geo-distributed sites may be distributed across and continually reconciled by a network of nodes, instead of being maintained by a single node assigned to a given geographic location. In implementing a federation, the network of nodes may lack exploitable, centralized points of vulnerability, and therefore, may exhibit no central point of failure. Furthermore, the disclosure proposes the implementation of a global metadata namespace for the enterprise storage metadata spanning the entirety of an enterprise (across all geographic locations). The global metadata namespace may be maintained on each node through event-based synchronization.

Abstract: A system and a method for locating application-specific data that has been previously deleted and located in an address of the data storage device marked as being available for storing new data. The method includes accessing unidentified data from at least one data storage device; examining the unidentified data to detect at least one application-specific data pattern associated with at least one application; for each detected application-specific data pattern, executing an application-specific validation process to determine whether the unidentified data includes valid data associated with a corresponding application; and if it is determined that the unidentified data includes valid data associated with the corresponding application, then recovering the valid data.

Abstract: The field of high-speed data acquisition and network data processing, and particularly relates to an Ethernet data stream recording method, an Ethernet data stream recording system, and an Ethernet data stream recording device for a high-speed data acquisition system. It is intended to solve problems such as a low utilization rate of CPU, poor system compatibility, difficulty in packaging and deployment and low reliability of system transmission of the traditional high-speed data acquisition system.

Abstract: Examples described herein include virtualized environments including a virtualized file server. Examples of file server virtual machine managers are described which may setup and/or configure file server virtual machines in accordance with a target number of connections and/or a target throughput for the virtualized file server. The virtualized file server may be scaled up, scaled down, scaled in, and/or scaled out.

Abstract: Aspects and features include using a virtual disk image to improve computational performance when applying a software patch. Compressed extents within a stored disk image are detected. The compressed extents are virtually reordered to form compressed forks within a virtual disk image and the compressed forks are selected for decompression based on code to be patched. A decompressed fork with the patch is virtually written to the same or another virtual disk image as an updated fork, and the virtual disk image is used to write to storage, either to overwrite the same stored disk image or to produce an updated, compressed disk image. In some examples, the virtual disk image is validated prior to writing to the compressed image by comparing an output hash from the compressed disk image with a known hash to validate the virtual disk image.

Abstract: A device configured to identify a first link between a value of a first data element in a first plurality of data elements and values of a first set of data elements in a second plurality of data elements and to remove the first link between the first data element and the first set of data elements. The device is further configured to input the data elements into a machine learning model that is configured to output a second link between the first data element and a second set of data elements. The device is further configured to create an entry in a relationship table that identifies the first data element and the second set of data elements. The device is further configured to generate a data stream with the first data element and the second set of data elements and to output the data stream.

Abstract: Examples described herein include virtualized environments including a virtualized file server. Examples of file server virtual machine managers are described which may setup and/or configure file server virtual machines in accordance with a target number of connections and/or a target throughput for the virtualized file server. The virtualized file server may be scaled up, scaled down, scaled in, and/or scaled out.

Abstract: Cryptographic information is compiled by: (a) determining a first portion of the cryptographic information based on an input and a randomness; (b) checking a rejection criterion based on the first portion; (b1) re-starting step (a) with a different randomness if the rejection criterion is fulfilled; (b2) if not all portions of the cryptographic information have been generated, determining a subsequent portion of the cryptographic information based on the input and the randomness and continuing with step (b) or, otherwise, continuing with step (c); (c) determining the first portion of the cryptographic information based on the input and the randomness; (d) conveying the respective portion of the cryptographic information; and (e) if not all portions of the cryptographic information have been generated, determining a subsequent portion of the cryptographic information based on the input and the randomness and continuing with step (d).

Abstract: Accelerating artificial intelligence workflows, including: receiving, from a computing process of an artificial intelligence workflow, a request for information stored on a data repository; issuing, from a user space of an operating system environment, parallel requests to the data repository using a network protocol that operates serially at the kernel level of the operating system environment; receiving, from the data repository, one or more responses to the parallel requests; and providing, to the computing process of the artificial intelligence workflow and based on the one or more responses to the parallel requests, a response to the request for information.

Abstract: Systems and methods for sharing information between distributed computer systems connected to one or more data networks. In particular, a replication system implements methodologies for sharing database information between computer systems where the databases use different classification schemes for information access control.

Abstract: A system can determine that a first destination inode number of a first destination inode of destination inodes is equal to a first source inode number of a file. The system can create a second file on the source file system, wherein the second file is stored in a second source inode of the source inodes having a second source inode number of the source inode numbers. The system can determine that the destination file system lacks an inode that has the second source inode number. The system can move a third file stored in the first destination inode to a second destination inode of the destination inodes that has a second destination inode number of the destination inode numbers. The system can migrate the first file to the destination file system, wherein the destination file system stores the first file with the first destination inode number.

Abstract: Method and apparatus creating test environments for blockchain systems involving recreating system configurations and state database without block data to set up staging environments for blockchain systems. The example implementations involve a function getting the latest config block and database files of state database from a production environment. Further, there is a function extracting system configurations from the received latest config block, replacing root certifying authority certificate(s) in the system configurations with the certificate(s) for the staging environment, creating a system configuration transaction and sending the system configuration transaction to the staging environment to reflect the system configurations. Further, there is a function extracting a list of states from database files, creating a transaction request message having the list of states and sending a transaction to the staging environment to load the states into the state database.

Abstract: A system (100) for managing data is provided. The system includes at least one processor (102) configured to convert a source dataset (302) to a root dataset (312) by obtaining a plurality of intermediary datasets (306, 308). The root dataset (312) is shorter compared to the source dataset (302) and the intermediary datasets (306, 308) are intermediate to the source dataset (302) and the root dataset (312). At least one of the intermediary datasets comprises reference bits, wherein the reference bits enable identification of one or more functions that should be used to obtain a dataset from which the intermediary dataset comprising the reference bits was obtained in the process of converting the source dataset (302) and the root dataset (312).

Abstract: A computer-implemented method for managing updates to a knowledge graph with incoming change requests is disclosed. The method comprises creating a snapshot of the knowledge graph, building sub-regions of the knowledge graph, classifying each incoming change to the knowledge graph so that it relates to one of the sub-regions, creating at least one change layer, wherein each of the at least one change layer relates to one of the sub-regions, wherein each of the at least one change layer comprises a portion of the incoming change requests, closing the at least one change layer upon reaching a predetermined threshold value for the at least one change layer, and integrating the at least one change layer into the knowledge graph, thereby generating a updated knowledge graph.

Abstract: A distributed cloud-based storage system, where the distributed cloud-based storage system includes: receiving, by one or more storage controller applications of the cloud-based storage system, one or more storage operations; storing, among one or more cloud computing instances of the cloud-based storage system, the one or more storage operations; and distributing, among one or more cloud computing instances within respective one or more cloud computing environments within distinct geographic regions, one or more of the one or more storage operations.

Abstract: An illustrative method includes a storage management system ingesting a data item into a unified storage system via a storage system interface among a plurality of storage system interfaces associated with the unified storage system, determining, in response to the ingesting of the data item into the unified storage system, an operation based on the data item, and providing a notification of the operation to an orchestration system configured to manage an execution of the operation by a computing system associated with the unified storage system. In certain embodiments, the unified storage system may be implemented as compute-aware storage system such as a container orchestrator-aware storage system.

Abstract: A multivariate time series model such as a Vector Auto Regression (VAR) model is built using fabric utilization, disk utilization, and CPU utilization time series data. The VAR model leverages interdependencies between multiple time-dependent variables to predict the start and length of an aperiodic backup time window, and to cause backup operations to occur during the aperiodic backup time window to thereby exploit the aperiodic backup time window for use in connection with backup operations. By automatically starting backup operations during predicted aperiodic backup time windows where the CPU, disk, and fabric utilization values are predicted to be low, it is possible to implement backup operations during time windows where the backup operations are less likely to interfere with primary application workloads, or system application workloads that need to be implemented to maintain optimal operation of the storage system.

Abstract: A method for supporting files names in a storage system, the method may include receiving a first protocol request for creating an object having a requested object name that comprises one or more sets of slashes, wherein the first protocol does not use the one or more sets as hierarchy separators; wherein each set of slashes comprises one or more consecutive slashes; determining a role of each set of the one or more sets in a second protocol that uses slashes as hierarchy separators; and generating a path name for accessing the object, when using either one of the first and second protocols, wherein the generating is based on the requested object name and the role of each set.

Abstract: Disclosed are system and methods for processing and storing data files, using a data edge file format. The data edge file format separates information about what symbols are in a data file and information about the corresponding location of those symbols in the data file. Examples convert a source file comprising symbols into a data edge index having a manifest portion, a symbol portion, and a locality portion. The symbol portion contains a sorted unique set of symbols from the source file, and the locality portion contains a plurality of location values referencing the symbol portion. Examples include normalizing structured data from the source file by modifying the locality manifest portion of the data edge file to include a description of at least one nonexistent column empty locality value at a respective position within the locality file representing an omission of data at an associated position in the source file.

Abstract: A method for the reverse deletion of a plurality of snapshots in a chain of snapshots is provided. The method includes in reverse order, starting from a latest snapshot in time to an earliest snapshot in time of the plurality of snapshots: identifying at least one of a first set of one or more data blocks of a snapshot that are shared with an earlier snapshot in time in the chain of snapshots or a second set of one or more data blocks of the snapshot that are owned by the snapshot and processing the second set of one or more data blocks and skipping processing the first set of one or more data blocks, wherein processing the second set of one or more data blocks comprises performing one or more actions to maintain and/or delete data blocks of the second set of one or more data blocks.

Abstract: Techniques are disclosed relating to managing distributed storage of data for various entities according to classifications for these entities. A database node of a distributed storage system may receive, from a first entity of a plurality of entities, a request to store a set of data. The database node may further obtain metadata associated with the first entity, wherein the metadata specifies one of a plurality of classifications for the entities. The database node may provide the set of data to one or more of a plurality of caches for storage. The caches may be located in two or more availability zones and are configured to store the set of data based on the classification for the first entity identified in the metadata associated with the first entity. The database node may also store the set of data in a shared object storage coupled to the database node.

Abstract: A system (100) for managing data is provided. The system includes at least one processor (102) configured to convert a source dataset (302) to a root dataset (312) by obtaining a plurality of intermediary datasets (306, 308). The root dataset (312) is shorter compared to the source dataset (302) and the intermediary datasets (306, 308) are intermediate to the source dataset (302) and the root dataset (312). At least one of the intermediary datasets comprises reference bits, wherein the reference bits enable identification of one or more functions that should be used to obtain a dataset from which the intermediary dataset comprising the reference bits was obtained in the process of converting the source dataset (302) and the root dataset (312).

Abstract: Embodiments of the present invention provide methods, systems, apparatuses, and computer program products for predicting network asset requests for a future network time interval.

Abstract: A system, apparatus, and method for processing queries wherein the query includes a request to access or delete data and accessing metadata associated with the set of data, the metadata defining data characteristics of the set of data and identifying at least sets of data that need or not need to be accessed or deleted based on the metadata without accessing the actual data in the set of data; also methods to optimize processing of some operations based on the collected metadata on data.

Abstract: Apparatus and methods for managing provision of digital content within a content distribution network. In one embodiment, a content application manager (CAM) process is used to provide one or more centralized redirection functions for network client processes such as just-in-time (JIT) packagers and cloud digital video recorders (cDVRs). A local database accessible to the CAM is updated with “live” or other content storage locations within the network, and accordingly each of the client processes can be made simpler and not require any intrinsic knowledge of content asset storage locations. This simplifies the client process configuration, enhances performance in terms of reduced end-user request servicing latency, and allows for single-point automated database updates versus having to provide updates to each client process as under the prior art.

Abstract: The retrieval of files can be facilitated in real-time in the general context of backup and recovery. A processor can receive a request to retrieve a particular volume of data from an object storage database. A virtual volume can be presented to an emulator for creation of a virtual machine representing the particular volume of data. A request can be received to access a particular file from the particular volume of data at a specific point in time. In response to the request to access the file, the data stream can be paused, the particular file can be fetched, and the particular file can be transmitted to the emulator.

Abstract: The present disclosure provides systems, methods, and non-transitory computer-readable storage media for determining container to leaf switch connectivity information in a data center in a presence of blade switches and servers. In one aspect of the present disclosure, a method of determining container to leaf switch connectivity information of a data center utilizing at least one blade switch and at least one blade server, includes receiving, at a network controller, link connectivity information that includes south-bound neighboring information between the at least one blade switch of the data center and the at least one blade server of the data center; determining, at the network controller, the container to leaf switch connectivity information of the data center, based on the link connectivity information; and generating a visual representation of a topology of the data center based on the container to leaf switch connectivity information.

Abstract: Techniques for accessing a file involve determining whether a client requests a permission for a target file, the permission allowing the client to cache data associated with the target file. The techniques further involve in response to determining that the client requests the permission, obtaining pattern information related to an access pattern in which the client accesses the target file. The techniques further involve determining availability of the permission to the client by applying the pattern information to a decision model, the decision model being trained based on training pattern information and training permission information. The techniques further involve providing, to the client, an indication on the availability. Accordingly, access conflicts can be reduced, so that the performance of the client and server can be improved.

Abstract: Systems and methods are described for facilitating operation of a plurality of computing devices. Data indicative of enumerated resources of a computing device is collected. The data is collected without dependency on write permissions to a file system of the one computing device. A condition of the computing device is determined based on historical data associated with enumerated resources of other computing devices. The identified condition can be updated as updated historical data becomes available. A communication to the computing device may be sent based on the identified condition.

Abstract: The present disclosure provides a virtual file management method and apparatus, and a computer-readable recording medium thereof, which may comprises obtaining an object identifier for distinguishing objects, wherein the object includes at least one of a virtual file or a virtual folder and obtaining the object based on the obtained object identifier.

Abstract: Disclosed are various approaches for preauthorizing the joining of a client device to a domain managed by a cloud-based directory service. An authorization token can be generated prior to a client device joining the domain. The authorization token can be subsequently installed on a client device at an OEM facility. When a user first logs into the client device, the client device can send the authorization token to the cloud-based directory service in lieu of administrative credentials to prove that the client device has been previously authorized to join the domain.

Abstract: Techniques for load balancing communication sessions in a networked computing environment are described herein. The techniques may include establishing a first communication session between a client device and a first computing resource of a networked computing environment. Additionally, the techniques may include storing, in a data store, data indicating that the first communication session is associated with the first computing resource. The techniques may further include receiving, at a second computing resource of the networked computing environment, traffic associated with a second communication session that was sent by the client device, and based at least in part on accessing the data stored in the data store, establishing a traffic redirect such that the traffic and additional traffic associated with the second communication session is sent from the second computing resource to the first computing resource.

Abstract: A computer-implemented method may comprise receiving proposals to mutate a data stored in a distributed and replicated file system coupled to a network, the distributed and replicated data system comprising a plurality of nodes, each comprising a server. A metadata service maintains and updates a replica of a namespace of the distributed and replicated file system and coordinates updates to the data by generating an ordered set of agreements corresponding to the received proposals, the ordered set of agreements specifying an order in which the nodes are to mutate data stored in data nodes and cause corresponding changes to the state of the namespace. For each agreement in the generated ordered set of agreements, a corresponding writers list may be provided that comprises an ordered list of nodes to execute the agreement and make corresponding changes to the namespace.

Abstract: A computer system including in-memory cache storage may be used to store collections of metadata that provide a semantic layer for a query of a data source. The computer system may provide multiple users access to the metadata collection, using different security policies for the users, without duplicating the metadata collection in the in-memory storage. For instance, the computer system may retrieve the metadata collection and provide the first user access to the metadata collection based on a first security policy of the first user. The computer system may then provide a second user access to the metadata collection based on a second security policy of the second user, without the metadata collection being duplicated in the in-memory cache storage.

Abstract: A method includes: receiving, by a computing device, input defining a custom storage class in a first dispersed storage network; receiving, by the computing device, input defining a data management rule in the first dispersed storage network; determining, by the computing device, a data object in the first dispersed storage network satisfies the data management rule; and moving, by the computing device and in response to the determining, the data object to a second dispersed storage network according to the custom storage class.

Abstract: Systems and methods are described for modifying input and output (I/O) to an object storage service by implementing one or more owner-specified functions to I/O requests. Such functions can include data access control functions, data manipulation functions, and the like. The owner of an object collection maintained by the object storage service can specify code execution environment rules that can give privileges to the execution of such functions such as by allowing the functions to access external services or the requesting user's private resources. In this manner, owners of the object collection are provided with greater control over how the object collection is accessed.

Abstract: A distributed system that implements an online exchange may comprise a plurality of server nodes, each of which being configured to receive exchange transaction proposals from customers of the online exchange over a computer network and each being configured to store a copy of a blockchain distributed ledger of completed exchange transactions. A consensus engine may be coupled, over the computer network, to the plurality of server nodes and may receive a plurality of exchange transaction proposals from the plurality of server nodes. The consensus engine may be being further configured to achieve consensus on the plurality of exchange transaction proposals and to generate, in response, an ordering of agreed-upon exchange transaction proposals that includes the plurality of exchange transaction proposals on which consensus has been reached.

Abstract: Methods and systems for dynamically provisioning storage on a blockchain are provided. In one embodiment, a method is provided that includes receiving a request that includes a data unit for storage. The data unit may be buffered in a data stack that stores one or more data units. The data unit may be stored in the data stack until (i) a predetermined amount of time has passed and/or (ii) a size of the data stack exceeds a predetermined threshold. The data units stored in the data stack may then be encrypted and included in one or more storage transactions. The storage transactions may also include encryption keys used to encrypt the data units. The storage transactions may then be transmitted to nodes for storage on a blockchain.

Abstract: Techniques described herein relate to a method for performing data services. The method may include receiving, from a monitor agent, a global name and metadata corresponding to data written to a data structure of storage of a data host; performing a services assessment using the global name, the metadata, and a data service policy rule to obtain at least one data service to perform on the data; and performing the at least one data service based on the services assessment.

Abstract: Techniques are provided for dependency aware parallel splitting of operations. For example, a count of pending data operations being executed by a first node and replicated in parallel to a second node are tracked. A metadata operation is executed at the first node based upon the count being less than a threshold (e.g., the count being zero). A first list of affected inodes modified by the metadata operation is identified. A dependency of the metadata operation with respect to pending metadata operations replicated to the second node is determined. The metadata operation is dispatched to the second node based upon the dependency indicating that the metadata operation is independent of the pending metadata operations.

Abstract: Systems and methods for migrating file locks in distributed file systems. An example method may comprise: receiving, by a file system server, over a first connection initiated by a file system client, a connection identifier comprising a file identifier; identifying, in view of the connection identifier, a second connection initiated by the file system client, the second connection associated with a file lock with respect to a file identified by the file identifier; and associating the file lock with the first connection.

Abstract: The various implementations described herein include methods and devices for creating and using trust binaries. In one aspect, a method includes obtaining executable code for a program, identifying a plurality of executable functions from the executable code, and for each executable function of the plurality of executable functions, generating a respective function digest based on one or more static parts of the respective executable function. The method further includes constructing a respective trust binary comprising the respective digest for each executable function of the plurality of executable functions, generating a trust binary name by applying a hash function to a header of the executable code, and indexing the trust binary in a trust database utilizing the trust binary name.

Abstract: Techniques described herein relate to systems and methods of data storage, and more particularly to providing layering of file system functionality on an object interface. In certain embodiments, file system functionality may be layered on cloud object interfaces to provide cloud-based storage while allowing for functionality expected from a legacy applications. For instance, POSIX interfaces and semantics may be layered on cloud-based storage, while providing access to data in a manner consistent with file-based access with data organization in name hierarchies. Various embodiments also may provide for memory mapping of data so that memory map changes are reflected in persistent storage while ensuring consistency between memory map changes and writes. For example, by transforming a ZFS file system disk-based storage into ZFS cloud-based storage, the ZFS file system gains the elastic nature of cloud storage.

Abstract: Scalable virtual memory metadata management comprising a plurality of pre-instantiated VM metadata containers representing the entire amount of real physical memory available to a computing system, with additional instantiated VM metadata containers created as needed. Individual and/or groups of VM metadata containers are assigned to metadata container groups, wherein each container group is controlled by an acquired lock assigned to the VM metadata container groups. Virtual memory metadata is managed using a “least used” technique. In response to allocation requests, the allocator scans the container groups/VM containers and fulfills memory object metadata allocation to the least used VM metadata container of the least used container group, filling the individual VM metadata containers and/or the container groups at a nearly equal rate.

Abstract: Various systems facilitate encrypted file storage. A client device may generate an encrypted version of a file. The client device may obtain at least one reference to at least one storage location for the encrypted version of the file. The client device may cause the encrypted version of the file to be store at the at least one storage location using the at least one reference to the at least one storage location.

Abstract: Aspects of the present disclosure relate to a unified activity service. In one aspect, different files stored on different storage platforms may be rendered on different user interfaces. Multiple activities associated with each of the different files may be obtained from the activity service. In another aspect, activity metadata corresponding to the multiple activities may be stored in the activity service. Activities associated with the different files may include content changes in a file (e.g., edits and deletions), sharing a file, renaming a file, comments within a file, messaging, and conversations related to a file. The different storage platforms may be independent of the activity service.

Abstract: Concepts and technologies directed to distributed load balancing for processing of high-volume data streams in datacenters are disclosed herein. In various aspects, a system can include a processor and memory storing instructions that, upon execution, cause performance of operations. The operations can include receiving raw data items in an incoming queue, and generating, within each of a plurality of worker processing threads, a load hash set that includes a load hash value for each of the raw data items in the incoming queue. The operations can include determining, within each worker processing thread, which of the raw data items to process from the incoming queue based on the load hash set, and processing, via one of the plurality of worker processing threads, each of the raw data items in the incoming queue based on the load hash value for each of the raw data items.

Abstract: A method for managing file systems includes receiving, by a unified namespace manager, a first message that indicates a new file system has been created on a first node, performing an update on a top level file system namespace to include a reference to the new file system to generate an updated top level file system namespace, generating, based on the update, a second message that indicates the top level file system namespace has been updated, and sending, to a second node, the second message.

Abstract: A method for managing data includes obtaining, by a database proxy server, a document manifest, wherein the document manifest specifies a plurality of queries, wherein each of the plurality of queries specifies data and a policy to be implemented on the data, wherein the data is stored in a central database, and processing the plurality of queries.

Abstract: Testing is performed to ensure integrity of a file system auditing component and of a file system. A list of file access events is built. This list includes expected events that should be triggered by the file system and found in a log. The events in the list are run on the file system and logged. The log of expected events is then compared with actual events logged by the file system to determine the integrity of the file system auditing component and the file system.