Abstract: Examples described herein generally relate to a scalable multi-tier storage system. An entry may be added and/or deleted within the storage system. To delete an entry, the storage system may determine whether the entry corresponds to the file or the directory based on directory metadata, and request deletion of the directory metadata associated with the entry from the directory volume based on determining that the entry corresponds to the directory, and further requesting deletion of the file from a file volume based on a determination that the entry corresponds to the file. To add a file, the storage system may generate directory metadata associated with the entry in the directory volume based on a determination that the entry corresponds to the directory, and may further allocate file metadata in the file volume based on a determination that the entry corresponds to the file.

Abstract: Operation testing without side effects may be enabled by a method including preparing a copy of a directory set of at least a part of a host system disk, creating a link to a file in a first directory in the host system disk, in a second directory of the copy of the directory set, wherein the second directory corresponds in position to the first directory in the directory set, and starting a non-privileged system using a disk image including the copy of the directory set and the created link.

Abstract: This application provides an application program (APP) management method, a terminal device, a server, and a system. According to the method, APPs downloaded on a terminal device can be automatically clustered. This saves time of a user and improves user experience. The method is applicable to a terminal device, and the method includes: obtaining a target desktop folder based on type information of an APP downloaded by the terminal device and attribute information of a desktop folder on the terminal device, where the downloaded APP is to be clustered in the target desktop folder; and clustering the downloaded APP into the target desktop folder.

Abstract: As a part of an embedded system environment, an overlay filesystem package manager obtains package files for a filesystem operation. the package files are stored in a temporary memory location. a composite layer presenting upper and lower filesystems of an overlay filesystem, is accessed to compare the package files with an associated files in the composite layer. When a difference is detected between a package file and an associated file, the package file is copied or moved to the upper filesystem. If the package file is not different from the associated file in the composite layer, it is not copied and deleted from the temporary memory location.

Abstract: A method for managing data includes obtaining, by a file system metadata manager, a data access request for a file system, wherein the data access request is obtained from an analytics engine, in response to the data access request: obtaining a metadata backup, wherein the metadata backup is associated with the file system, extracting file system metadata from the metadata backup, generating, using the file system metadata, a virtual file system associated with the file system, and providing the virtual file system to the analytics engine, wherein the analytics engine performs an analysis on the file system using the virtual file system.

Abstract: A method, apparatus and device for deleting a distributed system file, and a storage medium, comprising: querying whether an incomplete file deletion operation exists under a sub-tree root corresponding to a certain MDS (S102); if there is an incomplete file deletion operation, continuing to delete data under the sub-tree root corresponding to the MDS, and determining whether the sub-tree root is a copy (S103); and if the sub-tree root is a copy, deleting the sub-tree root copy in a memory of the MDS (S104). By means of the steps, the number of copies of the sub-tree root in the distributed file system can be reduced, thereby reducing the number of interaction times of master copy locking between different MDSs, improving the file deletion efficiency, and improving user friendliness and differentiated competitiveness of a product.

Abstract: A computing system generates a default view of content items associated with a user account. The default view is representative of an underlying hierarchical structure of the content items associated with the user account. The computing system receives a request to transition from the default view to a modified view of the content items. The computing system ranks the content items based on a predicted likelihood of the user interacting with the particular content item. The computing system identifies the subset of content items for the modified view based on the ranking. The computing system generates the modified view based on the identified subset of the content items. The modified view maintains the underlying hierarchical structure of the content items associated with the user account. The computing system provides the modified view to the user associated with the user account for display.

Abstract: A method and system for maintaining live database data across hybrid storage. Specifically, the disclosed method and system entail accessing live backup database data in part residing on local storage and in part residing on remote storage. That is, on occasion, available local storage capacity may fall short of the required free storage space to accommodate the full restoration or recovery of a given database. Accordingly, to overcome this shortfall, the disclosed method and system detect and cycle the recovery of frequently accessed asset (or database) data files, of the given database, from remote storage onto local storage.

Abstract: A method facilitating business continuity of an enterprise computer network includes receiving an initiate network recovery message at a disaster recovery orchestration platform identifying an enterprise computer network to be recovered. Predetermined network configuration information associated with the enterprise computer network is retrieved from a storage device accessible to the disaster recovery orchestration platform. A virtual recovered enterprise network is built in a virtual computing environment based at least in part on the predetermined network configuration information. A system to facilitate business continuity of an enterprise computer network is also provided. The system includes a disaster recovery orchestration platform, a storage device, and at least one communication interface. The disaster recovery orchestration platform including at least one platform computing device. Each platform computing device including at least one processor and associated memory.

Abstract: A computer-implemented method according to one embodiment includes determining a starting folder within a file system, computing, for each child folder of the starting folder, a similarity metric indicating a level of similarity to a file, selecting two child folders of the starting folder having greatest similarity metrics, comparing a difference between the greatest similarity metrics of the two child folders to a predetermined threshold, and conditionally selecting the starting folder as a recommended folder to which the file is saved, based on the comparing.

Abstract: Methods, systems, and computer program products for building an encrypted document store are provided herein. A computer-implemented method includes building an encrypted ordered key-value store; encrypting one or more sensitive keys to be stored in the ordered key-value store using an order preserving encryption scheme; storing a state of the order preserving encryption scheme in the ordered key-value store; and encrypting one or more values corresponding to the one or more sensitive keys using a semantically secure encryption scheme.

Abstract: The disclosed technology relates to a system configured to detect a modification to a node in a tree data structure. The node is associated with a content item managed by a content management service as well as a filename. The system may append the filename and a separator to a filename array, determine a location of the filename in the filename array, and store the location of the filename in the node.

Abstract: In accordance with an embodiment, described herein are systems and methods for providing direct access to a sharded database. A shard director provides access by software client applications to database shards. A connection pool (e.g., a Universal Connection Pool, UCP) and database driver (e.g., a Java Database Connectivity, JDBC, component) can be configured to allow a client application to provide a shard key, either during connection checkout or at a later time; recognize shard keys specified by the client application; and enable connection by the client application to a particular shard or chunk. The approach enables efficient re-use of connection resources, and faster access to appropriate shards.

Abstract: Systems and methods for generating a template directory based on an existing directory using the hierarchy of files in the directory. The system may use clustering analysis to determine similarities between items within the directory or files to generate a profile based on the characteristics of the saved items. The template directory may then be moved to another computing environment and items on the new computing environment may be arranged in a structure the mimics the existing directory. The system may update the profile of files in the directory dynamically as new items are created and saved within the computing environment hosting the template directory.

Abstract: Various aspects provide for implementation of a cloud service for running, monitoring, and maintaining cloud distributed database deployments and in particular examples, provides cloud based services to run, monitor and maintain deployments of the known MongoDB database. Various embodiments provide services, interfaces, and manage provisioning of dedicated servers for the distributed database instances (e.g., MongoDB instances). Further aspects, including providing a database as a cloud service that eliminates the design challenges associated with many distributed database implementations, while allowing the client's input on configuration choices in building the database. In some implementations, clients can simply identity a number of database nodes, capability of the nodes, and within minutes have a fully functioning, scalable, replicated, and secure distributed database in the cloud.

Abstract: Systems, methods, and apparatus for communication virtualized general-purpose input/output (GPIO) signals and control messages over a serial communication link. An apparatus includes a serial bus, and a controller configured to represent a series of signaling state of physical general-purpose input/output (GPIO) in a batch that comprises a sequence of virtual GPIO messages and control messages, generate a first header that includes timing information configured to control timing of execution of the batch, transmit the first header over a communication link, and transmit the batch over the communication link.

Abstract: Systems and methods for operating a graphical user interface with a dynamically sized group pill includes receiving a first indication of an opening of a context related to a first type of action in a graphical user interface. The group pill is expanded to an expanded size based at least in part on receiving the first indication. When a second indication of a closing of the context is received, the group pill is collapsed to a collapsed size displaying less information than the expanded size.

Abstract: Techniques and architectures to estimate storage system capacity are disclosed. Deduplicated data and an index of object entries are maintained in a storage system. The entries contain shallow reference counts. The shallow reference count values indicate a number of parent metadata objects that hold a reference to corresponding object. One or more tree milli-indices and one or more node milli-indices of object entries are maintained in the storage system. The entries correspond to a subset of objects stored in the storage system. The entries also have truncated object signature values and deep reference count values for the corresponding objects in the storage system. A capacity utilization of the storage system is determined based on analysis utilizing the deep reference count values to perform various multiset operations.

Abstract: Techniques described herein relate to systems and methods of data storage, and more particularly to providing layering of file system functionality on an object interface. In certain embodiments, file system functionality may be layered on cloud object interfaces to provide cloud-based storage while allowing for functionality expected from a legacy applications. For instance, POSIX interfaces and semantics may be layered on cloud-based storage, while providing access to data in a manner consistent with file-based access with data organization in name hierarchies. Various embodiments also may provide for memory mapping of data so that memory map changes are reflected in persistent storage while ensuring consistency between memory map changes and writes.

Abstract: Techniques are generally described for adding transactional support to a distributed storage environment. In various examples, first data may be written to a first set of locations in a distributed computer-readable non-transitory storage system through a non-transactional file system interface. In various further examples, metadata associated with the first data may be generated during the writing of the first data. In some examples, the metadata may be stored associated with the first data in at least a second location in a second computer-readable non-transitory memory. In some examples, a manifest may be generated defining a transactional commit of at least a portion of the first data. In some examples, the manifest may be generated by processing the metadata using first committer logic. In some further examples, the manifest may be stored in a third computer-readable non-transitory memory.

Abstract: The disclosed computer-implemented method for storing information within hybrid storage with local and cloud-based storage devices may include (1) dividing, if required, at the computing device, a file into multiple portions, (2) storing a first portion of the multiple portions as at least one first respective separate object on a local volume stored on the local storage device, (3) storing a second portion of the multiple portions as at least one second respective separate object on a cloud-based volume stored on a cloud-based storage device, and (4) naming each stored portion of the file with a respective object name comprising file metadata describing respective characteristics of the respective portion of the file. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: Aspects of the present disclosure involve, a customizable system and infrastructure which can used to retrieve and scout metadata on a distributed file system for data management. In one embodiment, a system is introduced which can be used to scout metadata from a distributed file system using an isolated node which can enable the determination and response to customized queries. The customizable system can include a NameNodeAnalytics module which can stream, filter, and process client queries without locking the NameNode in the distributed file system. In another embodiment, the analytics distributed file system can communicate with a streaming API and other time-series module for the reporting and visual representation of the metrics obtained.

Abstract: A file system includes: an application programming interface (API) configured to provide a file system access to an application running on a host computer; a key value file system configured to represent a file or a directory as an inode including one or more key-value pairs; a virtual file system configured to direct a file system call received from the application to the key value file system; and a key value API configured to provide the file system access to data stored in a data storage device. Each key-value pair contained in the inode includes a name of the file or the directory as a key and an identifier of a container that is associated with the file or the directory as a value. The data of the file is stored in the data storage device as being divided into one or more data blocks of a fixed size, and each of the one or more data blocks associated with the data of the file is accessible within the key value file system using the one or more key-value pairs.

Abstract: Systems and methods for rapid importation of data including temporally tracked object recognition. One of the methods includes receiving datasets each indicating information associated with one or more objects. Information indicating unique identifying information associated with the objects is accessed, and an updated dataset joining information from datasets that is associated with each object is generated. The updated dataset is maintained to include most recent versions of each of the datasets, with one or more datasets being replaced with more recent versions, and with one or more other datasets being propagated to be the most recent versions. Queries received from clients are responded to, with the queries indicating requests for specific information related to objects.

Abstract: Embodiments of the present invention provide systems and methods for storing, accessing, and/or promoting previous versions of changed or overwritten content in a cloud computing or multitenant environment. According to various embodiments, the system may list all the versions, promote a version to be the current version of the node, delete a specific version of the node, and/or rename/move all the node versions. Metadata associated with file versioning may be stored in a dynamic table with concatenated identifiers as a hash key and a content version as another hash key. Accordingly, the method may include securely storing a copy of an object handle instead of copying the entire content at a new location, which reduces storage and resource requirements, as well as improve on security and performance by efficient lookups in the table for read, writes, updates, and deletes for the given node version.

Abstract: Universal, automatic file conversion may be provided by a universal file conversion system or application. An input file may be received by the universal file conversion system. An input file type for the input file and a recipient of the input file may be determined. Programs available to the recipient for accessing a file may be determined. A target file type accessible to the recipient may be determined for converting the input file. A sequence of file conversions to convert the input file to the target file type may be determined. The input file may be converted to the target file type based on the sequence of file conversions. The converted file may be provided to the recipient. The recipient may return the converted file, and the converted file may be automatically converted back to the original input file type and provided to the original source of the input file.

Abstract: In some aspects, there is provided a method for database query execution planning using table adapters. In some aspects, a method may include receiving, at a database execution engine, a query; generating, by the database execution engine, a query plan for execution of the query, the query requiring access to at least one table; calling, by the database execution engine, a table adapter to prepare at least one table object to enable access, during runtime, to the at least one table; and receiving, by the database execution engine, the at least one table object prepared by the table adapter. Related systems, methods, and articles of manufacture are also described.

Abstract: The present invention provides a parking trajectory calculation apparatus and a parking trajectory calculation method capable of calculating a parking trajectory from an arbitrary parking start position. An aspect of the present invention recognizes a parking space for parking a subject vehicle in a preset limited area Area1, calculates a first parking trajectory from P1 to P0 for guiding the subject vehicle from the arbitrary parking start position to the parking space by causing the subject vehicle to first move backward, calculates a second parking trajectory from P2 to P0 by causing the subject vehicle to move backward after moving forward if the first parking trajectory from P1 to P0 cannot be calculated, and ends the calculation of the parking trajectory if the second parking trajectory from P2 to P0 cannot be calculated.

Abstract: A data storage and retrieval system for a computer storage memory, incorporating a tag pyramid data structure. The tag pyramid data structure may include a plurality of tag pyramid elements, including a root level element and one or more children branching from the root. Each of the children may have a hierarchical immutable tag sequence, including one or more immutable tags, which may define how the tag pyramid data structure is to be built. Each child may also have a mutable tag, selected from the hierarchical immutable tag sequence, which may serve as an identifier for that child. Children may be automatically grouped based on common tags, and may be organized into sequences based on the common tags.

Abstract: An apparatus comprises at least one container host device implementing containers for respective tenants of a multi-tenant environment. The containers are configured to utilize storage resources of at least one storage platform. A given one of the containers comprises at least one application, and an application file system security layer configured to communicate with the storage platform. The application file system security layer comprises a container storage volume supported by the storage platform, and an encryption engine configured to encrypt and decrypt data of the container storage volume utilizing one or more data encryption keys that are encrypted under a tenant-specific key encryption key. The tenant-specific key encryption key is provided to the application file system security layer by a tenant key manager that is external to the container. The tenant key manager is illustratively controlled by the tenant for which the given container is implemented.

Abstract: A server in a cloud-based environment interfaces with storage devices that store shared content accessible by two or more users. Individual items within the shared content are associated with respective object metadata that is also stored in the cloud-based environment. Download requests initiate downloads of instances of a virtual file system module to two or more user devices associated with two or more users. The downloaded virtual file system modules capture local metadata that pertains to local object operations directed by the users over the shared content. Changed object metadata attributes are delivered to the server and to other user devices that are accessing the shared content. Peer-to-peer connections can be established between the two or more user devices. Object can be divided into smaller portions such that processing the individual smaller portions of a larger object reduces the likelihood of a conflict between user operations over the shared content.

Abstract: Disclosed are various embodiments relating to virtual file systems for customers having network sites hosted by a hosting provider. A file system with multiple files of a customer is maintained for a hosting provider. Customer access to a virtualized version of the file system is facilitated. The virtualized version of the file system includes a virtual file that is dynamically generated based at least in part on one of the files in response to an access of the virtual file by the customer. The file system excludes the virtual file. A modification to the virtual file by the customer is obtained. The file in the file system is updated based at least in part on the modification to the virtual file.

Abstract: A proxy and a method for providing a unique user identification (UUID) to a mobile device executing a plurality of mobile applications includes receiving a request to access an resource by a mobile application of the plurality of mobile applications; generating a unique user identification (UUID) to uniquely identify the mobile device, thereby the UUID enables the at least one resource to uniquely identify the mobile device regardless of which of the plurality of mobile applications made a request to the resource; associating to the request the UUID; and forwarding the request with the UUID to the resource.

Abstract: An image processing apparatus which is capable of transmitting document data in a proper document format to an external system. An original input section inputs document data. A document data transmission section transmits the input document data to the system. A workflow execution section executes a workflow defined as a series of processes that can include a process for inputting the document data, and a process for transmitting the document data to the external system. A document format acquisition section acquires a document format of the document data required by the system, from the system. When the workflow execution section executes the workflow including the process for transmitting the document data to the external system, a document format check section judges whether or not the document data to be transmitted satisfies the acquired document format.

Abstract: Apparatus and computer program products implement embodiments of the present invention that enable a computer that is executing a first operating system kernel to load a second operating system kernel and one or more software components to a region in a memory. Using functions incorporated in the kernel, the region in the memory is tagged, and the computer initiates a boot of a second operating system kernel while preserving in the tagged region contents stored therein. Following the boot of the second operating system kernel, the computer executes the one or more software components from the tagged region that was preserved during the boot.

Abstract: In one embodiment, one or more components of a user interface are arranged in a hierarchy of layers. The user interface is presented according to the structure of the hierarchy, with one or more first components from a first layer floating on top of a second component from a second layer beneath the first layer. The first components are children of the second components. A user may interact with components uniformly, meaning that each specific user interaction applied to each component results in similar response from each component.

Abstract: A storage system for application servers is disclosed. The storage system comprises a network-attached storage device comprising a plurality of files that include a plurality of server applications in a plurality of network zone directories. Each of the network zone directories corresponds to one of a plurality of network zones. Access is restricted between each of the network zones. The storage system also comprises one or more application servers in each of the network zones. Each application server is configured to mount only a network zone directory of the network zone directories corresponding to a network zone of the network zones within which the corresponding application server resides based on a policy associated with the network-attached storage device and access one or more of the files including at least one server application of the server applications in the network zone directory.

Abstract: A method, system, and computer program product for providing, via a provisioning engine, a scalable set of indexed key-value pairs enabled to store objects in a data storage environment; wherein the data representing the objects is enabled to be spread across arrays in the data storage environment; wherein additional arrays are enabled to be added to the data storage environment and included in the indexed key-value pairs; wherein the data stored across the arrays may be balanced.

Abstract: A system and method for parameter driven data format conversion in a client/server architecture are disclosed. A format conversion framework is provided in a protocol layer between the client and the server. The format conversion framework passes a format conversion identifier (ID) with a request from the client from the client to the server. A conversion module is looked up by the format conversion framework based on the format conversion ID, the conversion module providing a conversion routine. The format conversion framework then executes the conversion routine on a result returned from the server to the client based on the request, the conversion routine converting a format of the result into a format used by the client.

Abstract: A network-based method for managing locks in a shared file system (SFS) for a group of hosts that does not require any configuration to identify a server for managing locks for the SFS. Each host in the group carries out the steps of checking a predetermined storage location to determine whether there is a host ID written in the predetermined location. If there is no host ID written in the predetermined location, the first host to notice this condition writes its host ID in the predetermined location to identify itself as the server for managing locks. If there is a host ID written in the predetermined location, the host ID of the server for managing locks is maintained in local memory. When the host needs to perform IO operations on a file of the SFS, it communicates with the server for managing locks over the network using the host ID of the server for managing locks to obtain a lock to the file.

Abstract: The present invention provides a system and method for handling large transactions by a storage virtualization system. Current storage virtualization systems can only manage a limited number of data objects stored on an associated NAS system because of the cost or hardware constraints of physical main memory. The present invention will enable a storage virtualization system to increase the number of data objects managed by a factor of five or more by using an associated secondary memory store, such as a disk, to store information or metadata about data objects stored on associated NAS systems. The invention also provides a method for moving metadata from the storage virtualization system memory to the secondary store and back, and recovering metadata if corrupted. The invention thereby increases the number of data objects handled by the storage virtualization system with negligible loss of performance as perceived by clients of the storage virtualization system.

Abstract: In order to make more efficient virtual folder creation work which is required at the time of virtually classifying files, the present invention provides a system having: a function of extracting keywords and frequencies thereof included in metadata; and a function of creating a virtual folder on the basis of the extracted keywords and the extracted frequencies thereof. At the time of extracting the keywords, character strings which can be considered as the keywords are comprehensively extracted. In addition, at the time of creating the virtual folder, the virtual folder is provided with a hierarchical structure including at least two hierarchical levels of a parent folder and a child folder. At the time of creating the child folder, in the case where child folder candidates having equivalent frequencies exist, a candidate having a longer character string is adopted.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for file system management. In one aspect, a method includes receiving a request at a kernel to perform a file operation on a particular file; identifying a flag bit associated with the file; invoking user space file handler to perform particular action when the flag bit is set; determining whether notification that action has been performed by file handler is received; and allowing the file operation on the file when notification is received.

Abstract: A method for creating a virtual directory includes locating at least one file of a designated type by traversing a storage region, extracting attribute information of the at least one file, and creating a virtual directory according to the attribute information of the at least one file. The attribute information including at least two of a name, a play address, or episode information of the at least one file.

Abstract: A write allocation technique extends a conventional write allocation procedure employed by a write anywhere file system of a storage system. A write allocator of the file system implements the extended write allocation technique in response to an event in the file system. The extended write allocation technique efficiently allocates blocks, and frees blocks, to and from a virtual volume (vvol) of an aggregate. The aggregate is a physical volume comprising one or more groups of disks, such as RAID groups, underlying one or more vvols of the storage system. The aggregate has its own physical volume block number (pvbn) space and maintains metadata, such as block allocation structures, within that pvbn space. Each vvol also has its own virtual volume block number (vvbn) space and maintains metadata, such as block allocation structures, within that vvbn space.

Abstract: A method and system for the protected storage of downloaded media content via a virtualized platform. A method comprises downloading content to a special purpose virtual machine and then storing the downloaded content at a location, where the location is only accessible via the special purpose virtual machine. The stored content is then streamed over a virtual network to a general purpose virtual machine, where the special purpose virtual machine and the general purpose virtual machine exist on the same personal computer (PC).

Abstract: Techniques for establishing a files system that exposes a virtual file system for backup operations are presented. Changes to files of a file system are maintained separately or collected and presented as a VFS. The VFS is then used to perform backup operations. Moreover, the files identified in the VFS can be customized based on search parameters, criterion, and/or criteria supplied by a user or supplied as parameters to backup and VFS mount operations.

Abstract: A technique to enable the user of storage clouds to use of a plurality of storage clouds without the user of storage clouds being aware of which data is being entrusted to which storage cloud and without sacrificing safety or ease-of-use by selecting at least one storage cloud to store an entity file storable in a cloud-utilizing terminal from among a plurality of storage clouds connected via a network to the cloud-utilizing terminal. This technique includes referencing the attributes or context of an entity file, or the attributes of a virtual folder and each attribute of a plurality of storage clouds, in response to the creation or update of the entity file in the virtual folder in the cloud-utilizing terminal, and selecting at least one storage cloud from among a plurality of storage clouds for storing the entity file so as to satisfy predefined rules.

Abstract: One example embodiment includes a method for constructing a unified namespace carried out by a domain manager service executing on a domain node in a domain network comprised of domain nodes. The method includes establishing a single, hierarchical domain tree that encompasses digital computers in a distributed data service network, where the domain manager service sends a request to all domain member nodes requesting that each domain node export the root of its sub-domain to the domain manager. The method also includes receiving the exported sub-domain roots. The method further includes grafting onto a domain root of the domain manager service the received exported sub-domain roots.

Abstract: A method of executing an operation in a directory information system, includes performing a first operation within a directory information system in accordance with a predetermined procedure, where the first operation comprising a search for one or more of a plurality of directory objects. The plurality of directory objects are stored in a computer-readable medium that has a directory information structure. In one particular embodiment, the search generates one or more first results. The method also includes performing a second operation within the directory information system in accordance with the predetermined procedure. The second operation uses at least a portion of the one or more first results generated by the search for the one or more of the plurality of objects. In this embodiment, the second operation generates one more second results. The method further includes returning the one or more second results based at least in part on the second operation.