Abstract: Provided is a method of providing an integrate cloud storage service through a home gateway communicating with smart devices through a first network formed by the home gateway and communicating with cloud storages through a communication network. The method may include obtaining information on cloud storage accounts associated with a smart device, as cloud storage account information, upon generation of a predetermined event associated with the smart device, generating an integrated cloud storage list based on information on folders and data of cloud storages accessible by the cloud storage account information, and providing the generated integrated cloud storage list to the smart device.

Abstract: A device may receive application information associated with an application. The application information may include information associated with a native homepage associated with the application, and may include a single file that includes content associated with the application. The device may receive an indication associated with running the application. The device may present, for display, the native homepage. The native homepage may include information associated with accessing the content. The device may determine that the content, associated with the application, is not current content. The device may obtain the current content, associated with the application, based on determining that the content is not the current content. The device may store the current content based on obtaining the current content. The device may load the current content based on storing the current content. The current content may be loaded to prepare the current content to be displayed to a user.

Abstract: A method for providing access to a file by a requestor including creating an empty file in a format understood by the requestor, intercepting one or more reads by the requestor of the empty file, determining if a portion of the empty file being read by the requestor should contain expected content, if the portion of the empty file should contain expected content then, before fulfill ling the read, adding the expected content to the empty file to transform the empty file into a requested file, and fulfilling a read of the requested file.

Abstract: Provided is a distributed computing system, which includes a plurality of slave devices configured to dispersively store each of a plurality of data blocks; a master device configured to divide data into the plurality of data blocks, to manage distributed storage information about the plurality of data blocks, and to process an access request; and an optimization device configured to calculate a target value of each of at least one performance parameter, wherein the target value sets an operation environment with a target performance, and the target value is calculated by repeatedly changing a value of each of the at least one performance parameter until the operation environment with the target performance is set.

Abstract: A request is received to store a file in a storage device, wherein the storage device deems the file discardable. The file is marked as a discardable file. A controller determines a download condition associated with the request to store the discardable file in the storage device and determines whether to delay a download to the storage device of the discardable file based on the determined download condition. The controller manages the download of the discardable file to the storage device based on the determination of whether to delay the download of the discardable file to the storage device. The controller manages the storage of the downloaded discardable file in the storage device based on the marking of the file as a discardable file.

Abstract: A computer-implemented method may include establishing a proxy file system that facilitates file archiving for a primary file system that does not support file archiving. The computer-implemented method may also include identifying a request to archive a file stored in a primary file system and copying the file to an archive file system such that a reference to the file is created in the proxy file system. The computer-implemented method may further include replacing the file in the primary file system with a symbolic link that identifies the reference in the proxy file system. Various other methods, systems, and computer-readable media are also disclosed.

Abstract: A system and method is provided for determining an available space in one or more data blocks. A physical data storage area associated with one or more portions of a database may be determined. An available space in each data block of one or more data blocks in the physical data storage area may be determined. A number of new data rows that can be added to each data block may also be determined.

Abstract: A client computer migrates data objects from a first data store employing a flat namespace to a second data store employing a hierarchical directory-based file system. File storing includes (1) generating a data object (for user data file) and an object identifier which is returned to an application for use in retrieving the user data file; (2) mapping the object identifier to originate a subdirectory name; and (3) sending a write request to the file system to create the named subdirectory and store the data object therein. File retrieving includes (4) sending a read request including the object identifier to the first data store; (5) extracting a user data file from a received data object and returning it to the application; and (6) performing the steps of the file storing to store the data object at the second data store, completing the migration of the data object.

Abstract: A request is received to store a file in a storage area of a storage device, the file being discardable and having associated therewith data in a data structure associated with the storage device. The file is marked as a discardable file. In some implementations a file system structure of the data structure is marked to indicate that the file is a discardable file, where in other implementations, the file itself is marked to indicate that the file is a discardable file. A download manager determines a download condition associated with the request to store the discardable file in the storage area of the storage device and determines whether to delay a download to the storage device of the discardable file based on the determined download condition. The download manager manages the download of the discardable file to the storage device based on the determination of whether to delay the download of the discardable file to the storage device.

Abstract: A system for exposing data stored in a cloud computing system to a content delivery network provider includes a database configured to receive and store metadata about the data, the database being implemented in the cloud computing system to store configuration metadata for the data related to the content delivery network, and an origin server configured to receive requests for the data from the content delivery network provider, and configured to provide the data to the content delivery network provider based on the metadata.

Abstract: A method for archiving a file that has multiple file parts stored on multiple object storage devices of a computer system includes the steps of saving the file parts on one or more archive devices, allowing one or more changes to be made to the file during the saving step, and applying at least one of the changes made during the saving step to one of the file parts stored on a respective object storage device. Furthermore, the method is performed such that the file parts saved on the one or more archive devices do not include the one or more changes made to the file during the saving step.

Abstract: Data transfer between storage apparatuses is reduced, and performance of data access of a storage system is improved. In a case where a processor of a first storage apparatus receives a write request from a host computer as a request for data access to a virtual volume and a cache memory of any of the storage apparatuses is not allocated to a virtual storage area in the virtual volume designated by the data access request, the processor of the first storage apparatus selects a second storage apparatus and a third storage apparatus among candidates satisfying a predetermined state condition among the storage apparatuses based on connection information indicating connection between the storage apparatuses through a communication line.

Abstract: Systems and methods for migrating file locks in distributed file systems. An example method may comprise: receiving, by a file system server, over a first connection initiated by a file system client, a connection identifier comprising a file identifier; identifying, in view of the connection identifier, a second connection initiated by the file system client, the second connection associated with a file lock with respect to a file identified by the file identifier; and associating the file lock with the first connection.

Abstract: Systems and techniques relating to network file systems for balancing caching load in peer-to-peer based network file systems are described. In one aspect, a method includes maintaining, by a cluster containing two or more computer systems, information about files cached at a network that includes three or more computer systems configured to cache data associated with a file server system. The method also includes receiving, from one of the computer systems of the network, a request to identify at least one computer system of the network that caches a specified file. Further, the method includes identifying, by the cluster in response to the received request, one or more computer systems of the network that cache the specified file based on the maintained information. Furthermore, the method includes providing, by the cluster to the requesting computer system, information referencing at least the identified one or more computer systems of the network.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for transferring electronic data. In general, one aspect of the subject matter described in this specification can be embodied in methods that include the actions of identifying a data item to be chunked; determining the type of the data item; determining whether the type of the data item is one of a specified one or more types; if it is determined that the type of the data item is not one of the specified one or more types, performing a first chunking of the data item; and if it is determined that the type of the data item is one of the specified one or more types, performing a second chunking of the data item that is based on the particular content portions of the data item.

Abstract: A file storage system to receive a file from a client device includes a determination module to determine a primary set of virtual segments from amongst a plurality of virtual segments of the file to be received from the client device. Each of the plurality of virtual segments is a logical portion of the file. The file storage system further includes a receiving module to establish a secure connection and a plurality of file transfer protocol connections corresponding to the secure connection, with the client device, to receive the primary set of virtual segments from the client device. The receiving module further receives, in parallel, the primary set of virtual segments from the client device for storage, through the plurality of file transfer protocol connections.

Abstract: There is provided a method implemented in a data storage system including a plurality of storage nodes connected to each other via a communications network. At least one storage node of the plurality of storage nodes may store a first data item. The data item may be arranged to include a reference to a second data item stored in the data storage system. The method may include providing an identifier of the second data item. The method may also include providing status information about the first data item. The identifier may be used to update the first data item, for example based on the status information. The first data item may be stored at the at least one storage node.

Abstract: Methods to determine and automatically recommend or adjust configuration parameters for storing files in large-scale distributed storage systems are disclosed. These methods may receive file metadata and trace data that allows the system to identify file access patterns. Additionally, the methods may receive information about distributed storage systems in a datacenter. This information can be used to choose storage parameters on a per-file basis for storing files.

Abstract: An embodiment Media-Aware File System (MAFS) includes a network node having a processor executing programming stored on a non-transitory computer readable medium of the network node. The programming includes instructions to: receive a first media stream made up of a plurality of primary frames; receive a primary namespace for the first media stream; determine a first file name for the first media stream and a second file name for a second media stream in accordance with the primary namespace; and determine a partition index for partitioning the first media stream into a plurality of groups of primary frames, including a first group having a first length in frames and a second group having a different length. The programming also includes instructions to determine the second media stream that includes a derived group of frames, including at least one frame that is derived in accordance with the first group.

Abstract: Methods to determine and automatically recommend or adjust configuration parameters for storing files in large-scale distributed storage systems are disclosed. These methods may receive file metadata and trace data that allows the system to identify file access patterns. Additionally, the methods may receive information about distributed storage systems in a datacenter. This information can be used to choose storage parameters on a per-file basis for storing files.

Abstract: Disclosed herein are systems and methods of providing file services. According to the disclosed systems and methods, a networking device may be configured to (a) receive installation of an application that provides access to one or more file services, and (b) after receiving the installation, make the one or more file services available for access on a given client device of the one or more client devices without requiring the given client device to separately install an application that provides access to the one or more file services. In one example, the networking device may make the one or more file services available for access on the given client device by sending the given client device an instruction to dynamically update its graphical user interface (e.g., a context menu) to reflect that the one or more file services are available for access on the given client device.

Abstract: A method for file block placement in a distributed file system network that includes a plurality of data storage nodes, the method comprising the steps of generating a plurality of file block placement options for a file block, each block placement option being associated with at least one of the data storage nodes, the file block placement options being based on a set of network parameters associated with the distributed file system, determining a cost valuation parameter associated with each of the plurality of file block placement options, and selecting one of the plurality of file block placement options based at least in part on the cost valuation parameter associated with each file block placement option.

Abstract: A method and apparatus of a device that transfers files and performs file browsing using an ad hoc file sharing service is described. In an exemplary method, the device transmits an advertisement of the ad hoc file sharing service to each of one or more of other devices. The transmitted advertisements each include a user identity of the user associated with the first device. Furthermore, access to the ad hoc file sharing service is granted on a per-user basis. The device establishes a connection with each of the other devices and transfers files with each of the plurality of other devices.

Abstract: Identifying symbolic links in network file systems is provided. An absolute path may be determined at a network file server. This may include determining a complete client path from an initial client path and combining the complete client path with a server export path. Once the absolute path is determined, it may be traversed using a file descriptor of each file in the absolute path to identify a symbolic link.

Abstract: A system for managing files over a network comprises a first computer hosting managed folders and files and one or more second computers. The first computer comprises database management software, server software such as server pipe software, and a first unique token. The second computer comprises a software module adapted and configured to be integrated into application software, client software such as client pipe software, and a second unique token. The computers communicate in part using the server and client software to establish a secure session for file access and transfer between the first and second computers.

Abstract: A near end network optimizer receives, from a client device, a request for a network resource. Responsive to determining that a version of the network resource is stored in the near end network optimizer, a request for the network resource is transmitted to a far end network optimizer along with a version identifier that identifies that version. The near end network optimizer receives, from the far end network optimizer, a response that includes a differences file that specifies the difference(s) between the version of the network resource stored in the near end network optimizer with a most current version of the network resource. The response does not include the entire network resource. The near end network optimizer applies the specified difference(s) to the version that it has stored to generate an updated version of the network resource, and transmits the updated version of the network resource to the client device.

Abstract: A method and system are disclosed that permit a host application to obtain cluster location data, for example logical addresses associated with the clusters of a file, and a host application to communicate the logical block address mapping information to firmware of a storage device. The method includes the host transmitting one or more clusters or partial clusters having a signature to the storage device where the storage device knows or has been instructed to look for the signature. The storage device may receive clusters having a signature and, responsive to a host request, return logical address information to a host for the location in the storage device of the marked clusters. The host may parse a data structure on the storage device to obtain remaining cluster location information using a file's first cluster location or may request that the storage device return the cluster location information.

Abstract: A method in a data processing system and apparatus for organizing files or web pages, structured or unstructured, of multiple users stored across one or more server computers into hierarchical file structures on a recordable medium of a data processing system. A user-defined metalabel is assigned to each of the electronic files or web pages. The electronic files or web pages are organized as a function of the metalabels into the hierarchical file structures.

Abstract: Embodiments are directed to establishing a metadata repository that aggregates metadata for a plurality of data sources, inferring data source metadata at a metadata repository and to providing recommendations to data managers based on aggregated inputs. In one scenario, a computer system establishes a reference to one or more data sources, where each data source includes data elements. The computer system receives a data request for specified data elements stored on the data sources and accesses the established references to determine which data source the specified data elements are stored on. The computer system then retrieves at least one of the specified data elements from its determined data source and sends the retrieved data elements to a specified computer system, along with an indication of additional data elements that are relevant to the received data request, and a further indication of how those additional data elements are to be accessed.

Abstract: A system facilitates collaborative communications and information sharing in a network defined by a model. The model and a portion of the system are stored on a storage component coupled to a terminal. The system captures context information and user-defined data, the user-defined data provided during user interaction of the user in a first domain of the network, and dynamically stores the context information as metadata associated with the user-defined data, the user-defined data and the metadata stored on the storage component; a tracking component for tracking a change of the user from the first domain to a second domain of the network and dynamically updating the stored metadata based on the change, where the user accesses the user-defined data from the second domain; and an interface to the system that permits the user to create and view the user-defined data according to the model of the network.

Abstract: A file system (i) permits storage capacity to be added easily, (ii) can be expanded beyond a given unit, (iii) is easy to administer and manage, (iv) permits data sharing, and (v) is able to perform effectively with very large storage capacity and client loads. State information from a newly added unit is communicated (e.g., automatically and transparently) to central administration and management operations. Configuration and control information from such operations is communicated (e.g., automatically) back down to the newly added units, as well as existing units. In this way, a file system can span both local storage devices (like disk drives) and networked computational devices transparently to clients. Such state and configuration and control information can include globally managed segments as the building blocks of the file system, and a fixed mapping of globally unique file identifiers (e.g., Inode numbers) and/or ranges thereof, to such segments.

Abstract: A method for file management, the method may include: calculating, by a management server that is located within a cloud computing environment, signatures of multiple files that are stored at multiple storage entities; and finding, by the management server, groups of similar files out of the multiple files, wherein the finding is in response to similarities between signatures of the multiple files; wherein the multiple storage entities comprise at least a first storage entity that is managed by a first management entity and a second storage entity that is managed by a second management entity that differs from the first management entity.

Abstract: An improved technique for distributed data storage employs multiple DHT (distributed hash table) rings provided at different levels of a network hierarchy. A computing node is identified for data storage by performing multiple hashing operations, one for each DHT ring. The hashing operations for the different rings are distinct in that they are performed using different hashing functions and/or are performed on different data sources. In one example, a 2-level DHT is formed from a group of LANs forming a first DHT ring and a group of computing nodes, within each LAN, forming a second DHT ring.

Abstract: A cluster of nodes in a distributed file system may include; at least two namenodes, each coupled to a plurality of data nodes and each configured to store a state of a namespace of the cluster and each being configured to respond to a request from a client while other(s) of the namenodes are responding to other requests from other clients; and a coordination engine coupled to each of the namenodes. The coordination engine may be configured to receive proposals from the namenodes to change the state of the namespace by replicating, deleting and/or adding data blocks stored in the data nodes and to generate, in response, an ordered set of agreements that specifies an order in which the namenodes are to change the state of the namespace. The namenodes are configured to delay making changes thereto until after the ordered set of agreements is received from the coordination engine.

Abstract: Systems and methods implementing a path resolver facilitating client access to a distributed file system. An example method may comprise: receiving, by a processing device, file identifier comprising a symbolic link; producing, by a user space process being executed by the processing device, a modified file identifier, by replacing a pre-defined sequence of characters within the file identifier by a path to a mount point of a distributed file system; and identifying, in view of the modified file identifier, a data structure comprising information about a file identified by the file identifier.

Abstract: Adaptive parallel data processing techniques are described. In one or more embodiments, a request is received to process a data file. The data file is split into multiple portions and sent to multiple nodes, where each node is configured to process a respective portion of the data file. Responsive to an amount of processing of the data file being completed, at least one of the multiple portions of the data file is dynamically split into multiple sub-portions. The sub-portions are submitted to one or more of the multiple nodes for processing of the sub-portions.

Abstract: A system and method for file transfer management are disclosed. An example embodiment includes: initiating a transfer of a file from a source system to a target system; deconstructing a file into logical components based on the format of the file; storing the cacheable logical components in a parent cache; generating an element list including a component identifier of the cacheable logical components; and delivering the element list to the target system. The example embodiment includes: receiving, at the target system the element list; determining if cacheable logical components are present in a child cache; fetching the cacheable logical components from the child cache; fetching other cacheable logical components and non-cacheable gap components from the source system; reconstructing the file by combining the fetched components; storing the missing cacheable logical components into the child cache; and delivering the reconstructed file to a destination.

Abstract: A cluster of nodes in a distributed file system may include; at least two namenodes, each coupled to a plurality of data nodes and each configured to store a state of a namespace of the cluster and each being configured to respond to a request from a client while other(s) of the namenodes are responding to other requests from other clients; and a coordination engine coupled to each of the namenodes. The coordination engine may be configured to receive proposals from the namenodes to change the state of the namespace by replicating, deleting and/or adding data blocks stored in the data nodes and to generate, in response, an ordered set of agreements that specifies an order in which the namenodes are to change the state of the namespace. The namenodes are configured to delay making changes thereto until after the ordered set of agreements is received from the coordination engine.

Abstract: A method is used in managing properties collection. Storage objects for which properties information is to be refreshed are determined. A bulk request for properties information from file systems corresponding to the storage objects is generated and is issued to the file systems. Based on a response to the bulk request, a blocking transaction is used to update a model of the storage objects that is made available to management software.

Abstract: A system for bilaterally transferring information between a client and a remote server. The client is coupled with a server proxy running on a second receive server via a first network and communicates thereon. Processed first information is passed to a first send server via a dedicated network connection. The first send server causes the first information to be transmitted to the remote server, via a first one-way data link, a first receive server, a second dedicated network connection and a client proxy running on a second send server. The remote server is coupled to the client proxy via a second network. The client proxy forwards information received from the server to the client via a second one-way link, the server proxy running on the second receive server, and the first network.

Abstract: Techniques are disclosed for providing a file system interface for an object store intended to support simultaneous access to objects stored in the object store by multiple clients. In accordance with one method, an abstraction of a root directory to a hierarchical namespace for the object store is exposed to clients. The object store is backed by a plurality of physical storage devices housed in or directly attached to the plurality of host computers and internally tracks its stored objects using a flat namespace that maps unique identifiers to the stored objects. The creation of top-level objects appearing as subdirectories of the root directory is enabled, wherein each top-level object represents a separate abstraction of a storage device having a separate namespace that can be organized in accordance with any designated file system.

Abstract: A method begins, in accordance with a segmentation approach, dividing large data to be stored into regions and dividing a region into segments. The method continues by generating preliminary DSN storage information for one or more regions. The method continues by identifying other large data stored in the DSN that has a relationship with the large data to be stored in the DSN and retrieving DSN storage information for the other large data. The method continues by comparing, at a region level, the preliminary DSN storage information with the retrieved DSN storage information. When a region of the large data to be stored has substantially similar DSN storage information as a region of the other large data, the method continues by utilizing the DSN storage information for the region of the other large data for the DSN storage information of the region of the large data.

Abstract: A file storage system may be implemented by coordinating non-exhaustible and exhaustible storage devices. The exhaustible storage devices may be lower grade flash based storage devices. The non-exhaustible storage devices may be storage devices based on magnetic recording mechanisms or higher grade flash storage. The file storage system may store received content items on the exhaustible storage devices. The file storage system may additionally store metadata for the content items and/or the file storage system on the non-exhaustible storage devices. During operation, the file storage system may globally optimize the content items on the exhaustible storage devices such that more heavily accessed items are moved to exhaustible storage devices that have experienced relatively few data operations. The file storage system can move less frequently accessed content items to exhaustible storage devices that have experienced a relatively large number of data operations.

Abstract: A storage system provides shared storage by utilizing dispersed storage devices while optimizing both the placement of data across the dispersed storage devices and the method for accessing the stored data. The storage system enables high level of scalability and performance while minimizing resource consumption.

Abstract: A device management apparatus is capable of communicating with a plurality of devices connected thereto via a network. The device management apparatus includes a storage unit that stores therein setting items and setting values for the devices; an acquiring unit that acquires, from each of the devices, a file describing a setting item currently set in the device and a current setting value of the setting item; a determination unit that determines whether the acquired file includes a setting item not being stored in the storage unit; and a storage controller that causes the storage unit, if the acquired file includes a setting item not being stored in the storage unit, to store therein the setting item not being stored in the storage unit and a current setting value of the setting item.

Abstract: A method for storage reclamation in a shared storage device. The method includes executing a distributed computer system having a plurality of file systems accessing storage on a shared storage device, and initiating a reclamation operation by using a reclamation agent that accesses the shared storage device. The method further includes reading the file system data structure that represent unallocated storage blocks of one of the plurality of file systems that will undergo a reclamation operation. A plurality of I/O resources that are used to provide I/O to the unallocated storage blocks are then interrupted. Storage from the unallocated storage blocks is then reclaimed, and normal operation of the I/O resources that are used to provide I/O to the unallocated storage blocks is resumed.

Abstract: Methods and systems for offloading data to a remote storage resource from a local storage resource on an information handling system may involve using a data location management agent and an offload mapping. The data location management agent may detect requests for access to files stored on a file system and may offload files to the remote storage resource to maintain a specified available capacity of the local storage resource, based on at least in part on the offload mapping. The data location management agent may classify certain files as pinned files that are excluded from offloading.

Abstract: A method begins by a dispersed storage (DS) processing module receiving a data object co-locate write request. The method continues with the DS processing module obtaining a plurality of sets of encoded data slices for a data object to co-locate. The method continues with the DS processing module generating a plurality of sets of slice names for the data object to co-locate based on another plurality of sets of slice names associated with a data object to be co-located with. The method continues with the DS processing module storing the plurality of sets of encoded data slices in the DSN using the generated plurality of sets of slice names for the data object co-locate.

Abstract: Embodiments of a system and method manage a configuration of a plurality of content switching devices in a networked system by generating a first configuration data file and translating the first configuration data file into one or more device specific configuration data files, each device specific configuration file corresponding to a device type of the one or more content switching devices. Some embodiments of the system and method then communicate the one or more device specific configuration data files to each content switching device of a corresponding device type to configure each content switching device.

Abstract: A method of processing system event logs (SELs) of a second electronic device using a first electronic device. The SELs are stored in a second storage device of the second electronic device. Once a baseboard management controller (BMC) of the second electronic device sends warning signal, which indicates that a remaining space of the second storage device, is less than a predetermined value, the first electronic device obtains the SELs in the second storage device, and stores the obtained SELs in a first storage device of the first electronic device. The first electronic device further controls the BMC to delete the SELs in the second storage device, to release space of the second storage device.