Abstract: Examples described herein are generally directed towards file server access controls, and more specifically towards a mechanism to create consistent access control lists for local users across different file servers in a distributed file server environment. In operation, a local user system SID (e.g., external SID) may be generated for a first user of a first file server. A global ID based on attributes associated with the user of the first file server may also be generated. The global ID for the user may be stored in metadata associated with an access control list (ACL) for a file accessible through the first file server. Data, including the file may be migrated to a second file server. Based on receiving an access request at the second file server associated with the user based on the external ID, the external ID for the user may be translated into the global ID, and used to determine access to the file.

Abstract: A copy-on-write union filesystem. A computer system identifies a first filesystem namespace as a mutable layer, and a second filesystem namespace as an immutable layer. The computer system exposes a merged filesystem namespace as a union filesystem that merges the mutable layer and the immutable layer, and that overlays the first filesystem namespace over the second filesystem namespace. The computer system identifies an operation on the merged filesystem namespace that requests to read from a file within the merged filesystem namespace, the file being stored in the second filesystem namespace and not being stored in the first filesystem namespace. The computer system returns a handle referencing a proxy object stored in a system memory. The proxy object includes a mapping to a file object corresponding to the file as stored in the second filesystem namespace.

Abstract: Semantic analysis to resolve ambiguous user input data with respect to a request for data includes identifying tokens based on the text string, identifying a tables in a database, wherein a token indicates a column from a table and a token indicates a column from another table, identifying candidate join paths for joining tables, obtaining respective candidate results using the candidate join paths, outputting combined candidate results including values from the respective candidate results, obtaining second user input data indicating a selected value, identifying the request for data as unambiguous and identifying a selected join path based on the selected value, and, in response to identifying the request for data as unambiguous, outputting data responsive to the request for data using the selected join path.

Abstract: A system for dynamic, secure, real-time, data streaming leveraging quantum computing is provided. The system may include a receiver and router, a plurality of short-term servers, a mid-term database, a k-nearest neighbor number identifier and a quantum random number generator. The receiver and router may receive a request to stream a data element from a source location to an end location. The receiver and router may retrieve the requested data element from one of the short-term servers, the mid-term database and/or the source location. Once the data element is retrieved, the data element may be indexed by the k-nearest neighbor number identifier. The quantum random number generator may tag the data element with a quantum-resilient random number. Based on the random number, a short-term server may be selected. The data element may be forwarded to the selected short-term servers. The short-term storage may stream the data element to the end location.

Abstract: A method, an apparatus, an electronic device, a computer-readable storage a medium and a computer program product for labeling data are provided. The method may include: obtaining a labeling accuracy requirement for to-be-labeled data; determining a process monitoring parameter matching the to-be-labeled data; weighting the process monitoring parameter with a coefficient having a corresponding size to obtain a comprehensive accuracy according to dependent and causal relationships between contents of different to-be-labeled data; and outputting, in response to the comprehensive accuracy satisfying the labeling accuracy requirement, labeled data.

Abstract: Semantic analysis to resolve ambiguous user input data with respect to a request for data includes identifying tokens based on the text string, identifying a tables in a database, wherein a token indicates a column from a table and a token indicates a column from another table, identifying candidate join paths for joining tables, obtaining respective candidate results using the candidate join paths, outputting combined candidate results including values from the respective candidate results, obtaining second user input data indicating a selected value, identifying the request for data as unambiguous and identifying a selected join path based on the selected value, and, in response to identifying the request for data as unambiguous, outputting data responsive to the request for data using the selected join path.

Abstract: Described in detail herein are systems and methods for managing single instancing data. Using a single instance database and other constructs (e.g. sparse files), data density on archival media (e.g. magnetic tape) is improved, and the number of files per storage operation is reduced. According to one aspect of a method for managing single instancing data, for each storage operation, a chunk folder is created on a storage device that stores single instancing data. The chunk folder contains three files: 1) a file that contains data objects that have been single instanced; 2) a file that contains data objects that have not been eligible for single instancing; and 3) a metadata file used to track the location of data objects within the other files. A second storage operation subsequent to a first storage operation contains references to data objects in the chunk folder created by the first storage operation instead of the data objects themselves.

Abstract: A system and method for storing and recovering a computer file. The method includes calculating fingerprint data of the file, separating the file into a plurality of data sub-files each having the same size and a single data sub-file having a smaller size than the other data sub-files, and attaching file metadata to the single data sub-file or as a metadata sub-file. The method also includes padding the single data sub-file including the metadata so that it is the same size as the plurality of data sub-files or the metadata sub-file so that it is the same size as the plurality of data sub-files, adding a header to each data sub-file that includes information about the sub-file, assigning a unique filename to each data sub-file, encrypting each data sub-file, and storing each data sub-file as separate files under their unique filename.

Abstract: A first cloud vendor is registered by a backup application. A file is moved from backup storage of the backup application to the first cloud vendor. A reference is maintained at the backup storage to the first file residing at the first cloud vendor. A second cloud vendor is registered by the backup application. The backup application directs a migration of the file from the first cloud vendor to the second cloud vendor without recalling the file to the backup storage. A reference maintained at the backup storage is updated to refer to the file now residing at the second cloud vendor. The updated reference is maintained at the backup storage.

Abstract: According to one embodiment, when a read request received from a host includes a first identifier indicative of a first region, a memory system obtains a logical address from the received read request, obtains a physical address corresponding to the obtained logical address from a logical-to-physical address translation table which manages mapping between logical addresses and physical addresses of the first region, and reads data from the first region, based on the obtained physical address. When the received read request includes a second identifier indicative of a second region, the memory system obtains physical address information from the read request, and reads data from the second region, based on the obtained physical address information.

Abstract: According to one embodiment, when a read request received from a host includes a first identifier indicative of a first region, a memory system obtains a logical address from the received read request, obtains a physical address corresponding to the obtained logical address from a logical-to-physical address translation table which manages mapping between logical addresses and physical addresses of the first region, and reads data from the first region, based on the obtained physical address. When the received read request includes a second identifier indicative of a second region, the memory system obtains physical address information from the read request, and reads data from the second region, based on the obtained physical address information.

Abstract: An XML fragmenting mechanism uses an XML schema for the XML file to split up the XML file in a hierarchal structure of data blocks for storage in a storage system with a limited block size such as a cluster coordination service. The XML fragmenting mechanism creates an XML file map to document the structure of the XML file in the storage system. The XML fragmenting mechanism stores the data blocks in the storage system according to the XML file map and supports retrieval of all or part of the data in a format that supports XML validation.

Abstract: Systems and method for expanding a cluster with nodes before an upgrade so that the cluster can handle a failover event during an upgrade and still continue operating. The system and method includes receiving, at a processor, a signal indicating a cluster is about to commence an upgrade; computing, by the processor, a first number of nodes; adding, by the processor, the first number of nodes from a network to the cluster before the upgrade is performed on the cluster; receiving, at the processor, a signal indicating the cluster finished the upgrade; and removing a second number of nodes that is no greater than the first number of nodes from the cluster after the processor receives the signal indicating the upgrade is complete.

Abstract: The present subject matter relates to file creation. In one example a user request for creating a new file is received. An inode corresponding to a pre-created file is retrieved from a pre-created pool of files in response to receiving the user request. Further, the inode is associated with an in-memory dentry corresponding to the new file. Further, a log entry is created in an intent log to indicate intent of lazy linking of the pre-created file with a target directory in which the new file is to be created. Further, lazy linking of the pre-created file with the target directory is performed using a file system link operation upon occurrence of a predefined event.

Abstract: A cluster file system comprises a front-end file system, a back-end file system, data mover modules arranged between the front-end and back-end file systems, and a quota manager associated with at least a given one of data mover modules. The data mover modules are configured to control archiving of data between the front-end file system and the back-end file system for respective users based at least in part on respective user quotas established by the quota manager and identifying corresponding portions of the back-end file system available to the users. The front-end file system may comprise archive directories configured for respective ones of the users, with the data mover modules being configured to archive a given file from the front-end file system in the back-end file system responsive to a link to that file being stored in a corresponding one of the archive directories of the front-end file system.

Abstract: Identification of an entity performing a deletion or modification action on locally stored files and notification to mitigate risks to cloud stored files is provided. A local or remote file watcher may monitor locally stored files and detect a deletion or modification action. The file watcher may also identify an entity performing the deletion or modification action. The entity may be an application, a process, a user other than the user that is the owner of the files, or the user himself/herself. The file watcher may further determine one or more alert conditions or rules associated with the affected file(s) and/or the entity, that is under which circumstances an alert is to be issued. The alert notification(s) may be issued to the user, an administrator, a cloud storage service, and/or a data protection service such that protective measures can be taken if necessary.

Abstract: A method of storing and outputting associated audio. The associated audio and the main audio are stored in, and output from, a single multimedia container. In this manner, when the main language is changed, the associated audio automatically changes with minimal audio artifacts.

Abstract: Various embodiments for repository management in a data deduplication system, by a processor device, are provided. Metadata of a pre-allocated file system is captured and exported. The exported metadata is then imported into a data deduplication repository for configuring the data deduplication repository with minimum overhead.

Abstract: A method, system, GUI, apparatus, and machine-readable media for enabling a customer to access information associated with a hosted user profile via a third party information source are provided. A customer may request information associated with a user profile via a mechanism provided by a third party information source via, for example, a mobile communications device. The customer may be enabled to access the information associated with the hosted user profile and an account associated with the customer may be updated to reflect the access. An account associated with the user may be updated to show the transaction and a statement regarding transactions associated with the user profile may be prepared and presented to the user.

Abstract: A cluster of nodes in a distributed file system may include; at least two namenodes, each coupled to a plurality of data nodes and each configured to store a state of a namespace of the cluster and each being configured to respond to a request from a client while other(s) of the namenodes are responding to other requests from other clients; and a coordination engine coupled to each of the namenodes. The coordination engine may be configured to receive proposals from the namenodes to change the state of the namespace by replicating, deleting and/or adding data blocks stored in the data nodes and to generate, in response, an ordered set of agreements that specifies an order in which the namenodes are to change the state of the namespace. The namenodes are configured to delay making changes thereto until after the ordered set of agreements is received from the coordination engine.

Abstract: A cluster of nodes in a distributed file system may include; at least two namenodes, each coupled to a plurality of data nodes and each configured to store a state of a namespace of the cluster and each being configured to respond to a request from a client while other(s) of the namenodes are responding to other requests from other clients; and a coordination engine coupled to each of the namenodes. The coordination engine may be configured to receive proposals from the namenodes to change the state of the namespace by replicating, deleting and/or adding data blocks stored in the data nodes and to generate, in response, an ordered set of agreements that specifies an order in which the namenodes are to change the state of the namespace. The namenodes are configured to delay making changes thereto until after the ordered set of agreements is received from the coordination engine.

Abstract: In one embodiment, a layered file system of a storage input/output (I/O) stack executes on one or more nodes of a cluster. The layered file system includes a flash-optimized, log-structured layer configured to provide sequential storage of data and metadata (i.e., a log-structured layout) on solid state drives (SSDs) of storage arrays in the cluster to reduce write amplification, while leveraging a data de-duplication feature of the storage I/O stack. An extent store layer of the file system performs and maintains mappings of the extent keys to SSD storage locations, while a volume layer of the file system performs and maintains mappings of the LUN offset ranges to the extent keys. Separation of the mapping functions between the volume and extent store layers enables different volumes with different offset ranges to reference a same extent key (and thus a same extent).

Abstract: Various techniques and solutions are described for rule-based access to removable storage devices. For example, a request can be received to perform a file system operation using a removable storage device that is formatted with a file system that does not support access controls. A rules-based check of the received request can be performed by a service by checking the request against a plurality of rules. Based on results of the rules-based check, the request can be allowed or denied.

Abstract: Data stored on a storage medium can be referenced by multiple independently addressable active symbolic links, with each active symbolic link representing the data through a different transformation. The active symbolic links can be in the form of file system objects, such as files or directories. A single active symbolic link can reference the data stored in multiple collections, or, conversely, a subset of data from a single collection. Active symbolic links can be automatically created for common data transformations. Searching across active symbolic links referencing encrypted data can be performed by multiple protection-specific search engines, or a single search engine that can generate a protection-level aware search index.

Abstract: Several systems and methods for accessing files stored in a storage device are disclosed. In an embodiment, the method includes accessing a file allocation table (FAT) in a computer file system associated with the storage device. The FAT includes a plurality of cluster addresses corresponding to a plurality of clusters allocated to a file stored in the storage device. A cluster address is read to identify a location of a next cluster. One or more bits in the cluster address are read to determine a presence of a signature value indicating allocation of a set of contiguous clusters from among the plurality of clusters. A number of contiguous clusters is computed based on a pre-determined number of consecutive cluster addresses succeeding the cluster address if the signature value is present. The set of contiguous clusters are read from the storage device based on the computed number of contiguous clusters.

Abstract: A file server for displaying, on a client, files to be retrieved, a method of providing a display on the client, and a computer program product with program instructions executable on the file server. The number of files to be displayed and start point information related to the start point of a file list to be extracted is acquired from a client, and a file list is extracted from files stored as a partitioned data set in a storage device based on the number of files and start point information acquired. The numbers of preceding and succeeding files stored before and behind the extracted file list are calculated, the calculated numbers of the preceding and succeeding files and the extracted file list are sent to the client. The client displays the file list and the received numbers of remaining files before and behind the received file list, respectively.

Abstract: A system and method for the automatic generation of a website. The website is created upon a user request, where the user provides identification information that is used to search an information database. The information will provide a reference to a code that relates to a template that is used to specify the layout, style and content of the website that is to be generated, and the website is then generated in accordance with the structure of the template, based on content contained in the information database. The user may engage the system and method by means of e-mail or a dedicated website or other such suitable means.

Abstract: Each of plurality of nodes connected to each other via a network includes a local instance processor and a user application processor. The local instance processor executes a data sharing method for accessing shared data. The data sharing method includes: storing a value of first shared data with a function identifier of an update function upon receiving a registration request, wherein the update function is commutative and idempotent; updating the stored value of the first shared data to a first update value in accordance with an execution result of the update function upon receiving an update request; returning a completion message upon updating the stored value of the first shared data stored in the first node; and transmitting a first reflection request to a second node upon updating the stored value of the first shared data stored in the first node.

Abstract: It is becoming more and more common for users to store personal documents or indeed copies of these documents on their computer. A difficulty for a user is how to store these documents. The present application relates to file storage on a computer and in particular provides a method and system for creating a personalized directory structure for electronically storing personal information.

Abstract: A law enforcement officer involved in a traffic stop is provided with a means to submit details of contraband locations within the stopped vehicle to a cloud-based server or database. This method of submitting information allows any other officer to be able to retrieve up-to-date information regarding the location of contraband hidden with a particular vehicle. The data submitted, stored, and accessed from the cloud-based server or database may include methods and instructions for accessing the hiding places, or other relevant information useful for an officer to retrieve contraband.

Abstract: A method of data storage and retrieval using a relational database can include defining a first table in a relational database including a plurality of entries having a first value for a first field. A second table in the relational database including a plurality of entries can be defined. Each of the plurality of entries in the second table can specify an additional value for the first field of a corresponding entry in the first table. Responsive to a query, a data item selected from at least one of the plurality of entries in the first table can be presented.

Abstract: One example method presents a synthetic view of data stored by a shared device file system. The synthetic view provides a “fictional” single namespace for data stored by the shared device file system. The method includes accepting a command to access data stored by the shared device file system. The command may be native to a user requesting the access. The command addresses the data stored by the shared device file system using the single namespace provided by the synthetic view. The method includes creating a replacement command(s) for accessing data stored by the shared device file system using one or more actual namespaces different from the single fictional namespace provided by the synthetic view. With the replacement command(s) prepared, the method proceeds to access data stored by the shared device file system using the replacement command(s).

Abstract: Program code determines whether a retention base, defined as a property within a disposition schedule has a value, wherein the disposition schedule defines additional properties and instructions for disposal of a record, and wherein the additional properties include a retention period. The program code identifies a change to at least one of the retention base and the retention period. The program code generates a point in time to perform the disposal of the record based on the change that is identified, wherein the disposal is an action defined for a phase of the disposition schedule.

Abstract: An object-sharing method used in a object sharing system is provided. The object-sharing method comprises the steps outlined below. An object-sharing request that intends to share an object in a first object storage to a second object storage is received. First and second object paths are compared. Whether a naming conflict condition occurs is determined. The second object storage receives the object and keeps the first object path when the naming conflict condition does not occur. The second object storage receives the object and merges the first and the second object paths when the naming conflict condition occurs and the first and the second object storages are from the same user. An alternative sharing destination is generated to receive the object when the naming conflict condition occurs and the first and the second object storages are not from the same user.

Abstract: Systems and methods for trend detection using frequency analysis in accordance with embodiments of the invention are disclosed. In one embodiment of the invention, trend detection includes generating a discrete time sequence of word counts for a target word using a trend detection device, performing frequency analysis of the discrete time sequence of word counts to determine contributions of frequency components within different frequency ranges to the discrete time sequence of word counts using the trend detection device, and detecting that the target word is a trending keyword based upon at least the frequency analysis of the discrete time sequence of word counts for the target word using the trend detection device.

Abstract: A system may receive a request for comments associated with a particular document, identify a comment associated with the particular document, generate an objective score for the comment that is independent of a user associated with the request, identify the user associated with the request, generate a subjective score for the comment based on parameters associated with the identified user, generate a combined score for the comment by combining the objective score and the subjective score, and provide the comment, ranked based on the combined score, to the user for presentation with the particular document.

Abstract: Exemplary embodiments of the present invention disclose a method, computer program product, and system for optimizing a clustered virtual computing environment. In exemplary embodiments, performance attributes are identified for a set of operating devices within the clustered virtual computing environment. Historical data of the identified performance attributes is obtained to create a historical data repository. A rulebase is developed using the historical data repository and input from user. A combined correlation pattern repository is generated using a first correlation pattern, a second correlation pattern and a scale-time invariant weight fraction.

Abstract: A method and a system are provided for encoding and processing digital information. The digital information is encoded according to binary encoding formats corresponding to primitive data types. The primitive data types comprise scalar data types including Boolean, integer, float, decimal, time stamp, string, symbol, binary large object, and character large object data types. The primitive data types also comprise composite data types including structure, list and S-expression data types. The binary-encoded digital information is stored in a message with a predetermined format for transmission. No metadata is included in the message.

Abstract: Methods, systems, and computer program products for identifying a container associated with a plurality of files are disclosed. According to one aspect, a method includes providing for associating a file with a container associated with at least one file to form a plurality of associated files. The prevailing metadata is not required to be from all of the plurality of associated files. Further, the container may be identified based on the prevailing metadata.

Abstract: In an object information provision system, at least one matching data is transmitted from an object information provision device to a terminal, and a result of image analysis based on the matching data is transmitted from the terminal to the object information provision device, and the amount of information of matching data is adjusted based on the image processing result. The success or failure of extraction of a valid physical object represented by the matching data in the terminal is thereby reflected on the amount of information of matching data.

Abstract: There is provided a method implemented in a data storage system including a plurality of storage nodes connected to each other via a communications network. At least one storage node of the plurality of storage nodes may store a first data item. The data item may be arranged to include a reference to a second data item stored in the data storage system. The method may include providing an identifier of the second data item. The method may also include providing status information about the first data item. The identifier may be used to update the first data item, for example based on the status information. The first data item may be stored at the at least one storage node.

Abstract: Various embodiments include a method and system for configuring a smart energy network using a link key database. An energy services interface, on the smart energy network, extracts a unique identifier associated with a smart energy device from a communication with the smart energy device. The energy services interface may then use the unique identifier to receive information associated with the smart energy device from the link key database.

Abstract: Embodiments relate to systems and methods for conditioning the distribution of data in a hierarchical database. A data store can store data in a hierarchical format. Higher-level data, such as yearly profit, may be desired to be spread from parent nodes to lower nodes, such as quarters. Parent nodes can be associated with a set of programmatic placeholder nodes. A spreading tool can insert child nodes representing quarters, months, or other at insertion point(s) represented or encoded by a set of placeholder nodes, dividing quantities appropriately. In aspects, data can be spread from multiple parents at once. In aspects, the spreading tool can access or host sequence logic to ensure that data is spread in an order that takes dependencies, formatting, output connections, or other factors into account.

Abstract: A method includes defining a host capability; creating for a storage device a second directory tree from a first directory tree of the storage device that is included in a file system within the storage device; and, for a data file that is stored in the storage device and is selectable for consumption by a host through the first directory tree that is included in the storage device's file system, determining whether the data file requires for consumption a host having the defined host capability. If the data file requires a host having the defined host capability, an entry is created in the second directory tree in which the data file is not selectable for consumption by the host. Otherwise, an entry is created in the second directory tree in which the data file is selectable for consumption by the host.

Abstract: Embodiments relate to systems and methods for a cloud-based directory system based on hashed values of parent and child storage locations. Platforms and techniques are provided to store a data object to cloud storage resources in two or more locations recorded in a consistent hash structure. A file management tool can store one copy of the data object to a location corresponding to the hashed value of the file path or name, and a second copy to a location corresponding to the hashed value of the parent directory of the data object. All files sharing a common parent directory or other location therefore have at least one copy stored to the same location, in common with the parent. Directory-wide read, write, and/or search operations can therefore be performed more efficiently, since the constituent files of a directory or other location can be accessed from one location rather than distributed locations.

Abstract: Systems and methods are provided for storing and restoring digital data. In some implementations, a method is provided. The method includes initiating a backup operation of data including a plurality of items, interrupting the backup operation, where interrupting occurs after a portion of the data has been completed, receiving an input to resume the backup operation, identifying a previously completed portion of the backup data, and performing a backup of a remaining uncompleted portion of the backup data. Other embodiments of this aspect include corresponding systems, apparatus, computer program products, and computer readable media.

Abstract: A file list generation device creates, at high speed, a list of added, changed, or deleted file data by acquiring the directory URLs of search target files from a first storage, counting the number of directories in each layer through analysis of the directory URLs, and, based on the result of the counting, determines a dividing policy to divide a scan target directory scanning operation, which is to be performed with a distributed server cluster. Directories of the search target files are divided in accordance with the determined dividing policy, and a snapshot of a current directory tree is acquired.

Abstract: Some embodiments provide a method for storing a document. The method stores a content stream representation of the document that includes an ordered stream of code representations for primitive elements of the document. Each code representation of a primitive element has an index that indicates the order in the content stream of the primitive element representation. The method stores an object representation of the document that includes a set of object nodes arranged in a tree structure. Each object node references a range of indices in the content stream.

Abstract: A system having an agent manager and a plurality of parallel agents for assisting a user in reaching a conclusion is provided in at least one embodiment. In at least one embodiment, the system is in communication with at least one database housing information to be analyzed by at least one of the agents. Further embodiments include the operation of the system and its interaction with the at least one database. In at least one further embodiment, the method includes the development and publication of the agents.

Abstract: A mobile platform includes a sensor configured to collect raw data, a memory device, and a first processing device coupled to the sensor and to the memory device. The first processing device is configured to receive raw data from the sensor and determine, based on a significance of the raw data, whether to store the raw data in the memory device or to transmit the raw data.