Abstract: Disclosed herein are embodiments for committing changes of an image of a virtual machine-based container running on a host computer system. A starting image for a container is obtained from a guest starting folder, and while the container runs the starting image changes to the image made by the running container are captured in a guest folder that is union mounted with the guest starting folder. Another union folder, which is the union of a new host folder and the starting folder, contains the changed image which can be used for the container or transferred to a different container.

Abstract: Systems and methods relating to fragmenting content based on metadata are disclosed. In one embodiment, metadata is obtained from data that is accessible from an interface. A content descriptor, based on at least a portion of the metadata, may be utilized to determine fragment size. The content descriptor value may be derived from multiple forms of metadata, such as for example, genre, sub-genre, presence of live media, and combinations thereof. The fragments may be either virtual or physically discrete segments or files. In one aspect, the value may be the sole basis for determining the fragment lengths. In another aspect of the embodiment, the division of the content is conducted such that each resultant fragment comprises a single frame type.

Abstract: A plurality of computing devices are communicatively coupled to each other via a network, and each of the plurality of computing devices is operably coupled to one or more of a plurality of storage devices. The computing devices may use local caches and storing snapshots in a coherent manner when accessing the plurality of storage devices spread across multiple data centers.

Abstract: A provider system is connected to one or more readers corresponding to one or more access points. A secure local connection is established between the user device and the provider system via one reader. The provider system receives from the user device a request for user access via one access point corresponding to the one reader, the provider system sends to the user device a request for identification information of the user, and the user device sends user information associated with a first mobile identification credential (MIC) which the user device received from an authorizing party system (APS), the user having consented to release the user information to the provider system, and the user information having been verified. The provider system uses the verified user information associated with the first MIC to verify or not verify the identity of the user before granting or denying the request to the user.

Abstract: Described are systems and methods for storing a variable number of instances of data objects (e.g., 1, 2, 3, or up to N?1 instances, where N is the number of instances of the data object included in primary data) in secondary storage across a data storage network. In some examples, a system for storing a variable number of instances of data objects includes, one or more computing devices storing a set of data objects and multiple storage devices distinct from the one or more computing devices. Each of the multiple storage devices is configured to store at least a single instance of a data object. The system also includes a database configured to store information associated with the data objects. This information includes substantially unique identifiers for the data objects and, for each of the data objects, a number of instances of the data object stored on the multiple storage devices.

Abstract: Techniques are disclosed for content storage in a way that facilitates consistent and concurrent read/write processing of stored documents. An example methodology implementing the techniques includes segmenting the contents of a document into a plurality of content segments and storing the plurality of content segments within a data structure, the data structure including storage blocks having storage portions and buffer portions. The storage of the plurality of content segments includes storage of content segments within a storage portions of the storage blocks of the data structure. The method also includes receiving at least one change to the content and utilizing a buffer portion of at least one storage block to store the at least one change to the content.

Abstract: Computerized systems and methods facilitate searches by identifying instances in which search input is an ambiguous query and resolving the ambiguous query. The search system identifies ambiguous queries by querying a common data store prior to querying a patient database. More particularly, when the search system receives search input entered into a search tool, the search system queries the common name data store before querying the patient database to determine if the search input matches a common name and is an ambiguous query. If so, the search system may provide a notification to the user to indicate the search input is an ambiguous query with a common name and prompt the user to enter additional search criteria. In some instances, the search system may prevent a search from being performed on the patient database if the search input matches a common name until additional search criteria is entered.

Abstract: A search apparatus (1) coupled to a database, the apparatus (1) comprising: a processor configured to execute instructions; a memory storing instructions which, when executed by the processor, cause the processor to: search the database for items containing a search term, wherein items containing the search term are matched items; identify fields corresponding to attributes of the matched items; define a range of values for each field; divide the range of values for each field into a plurality of ranged field buckets; distribute the matched items between the ranged field buckets based on attributes of the matched items that are within the range of values for each ranged field bucket; calculate an effectiveness value for each field based on the number of matched items in each of the ranged field buckets; select one or more top fields, each top field having an effectiveness value that is greater than a predetermined effectiveness value; and provide an effectiveness indicator output which is indicative of the ef

Abstract: Images of the plurality of document pages are scanned to generate image data with one scanning instruction. A single folder named with a received character string is determined as a storage destination of image data corresponding to the plurality of document pages generated with the scanning instruction.

Abstract: Disclosed herein are system, method, and computer program product embodiments for storing a large object (LOB) in a database. An embodiment operates by identifying the LOB to be stored in an on-disk store of the database and determining the size of the LOB. Thereafter, an index vector for the on-disk store to include an identifier corresponding to the LOB is created. Additionally, a dictionary for the on-disk store to include a copy of the identifier and corresponding LOB data is also created. The LOB data corresponds to the LOB itself or a LOB location inside of the on-disk store based on the LOB's size.

Abstract: A recording apparatus that is capable of preventing degradation of a writing speed of management information under recording without increasing the recording preparation time when a plurality of files are recorded simultaneously. The recording apparatus includes a memory and a processor that function as a recording unit that records a file in a recording medium, and a controller that controls so as to record a directory entry of a file in a designated sector in the recording medium. The recording medium consists of blocks each of which includes a plurality of pages, allows to write data in a page unit, allows to erase data in a block unit, and allows to access a page corresponding to a sector designated by a sector number. When a plurality of files will be recorded, the controller controls so that directory entries of the plurality of files will be recorded in a same sector.

Abstract: A method for managing processing power in a storage system is provided. The method includes providing a plurality of blades, each of a first subset having a storage node and storage memory, and each of a second, differing subset having a compute-only node. The method includes distributing authorities across the plurality of blades, to a plurality of nodes including at least one compute-only node, wherein each authority has ownership of a range of user data.

Abstract: An abstraction layer communicates with a plurality of applications executing on a multi-application platform. The abstraction exposes a standard interface for the plurality of applications to communicate content status information. An indication is received that a new content item will be generated. A record is generated that is immutably associated with the new content item. The record is updated with information received from the application associated with the content item, the information pertaining to a changed status of the content item. In response to a command to delete the content item, it is determined whether to confirm deletion of the content item based on one or more data retention policies. The record is updated to indicate a reason for granting or denying the deletion and a source of the delete command.

Abstract: The present disclosure discloses a NVM-based method for performance acceleration of containers. The method comprises classifying each image layer of mirror images as either an LAL (Layer above LDL) or an LBL (Layer below LDL) during deployment of containers; storing the LALs into a non-volatile memory and selectively storing each said LBL into one of the non-volatile memory and a hard drive; acquiring hot image files required by the containers during startup and/or operation of the containers and storing the hot image files required by the containers into the non-volatile memory; and sorting the mirror images in terms of access frequency according to at least numbers of times of access to the hot image files so as to release the non-volatile memory currently occupied by the mirror image having the lowest access frequency when the non-volatile memory is short of storage space.

Abstract: Systems and methods are provided for use in authenticating a software artifact, including target applications for a payment network. One exemplary computer-implemented method includes retrieving metadata and a stage log for an artifact from a stage of a pipeline, the metadata including a result of the stage. A keyword count is generated of the stage log, and a checksum for the stage log is generated based on a hashing function. A stage record is compiled for the artifact and the stage. The stage record includes the checksum, a representation of the keyword count, and the result, but not the stage log. The stage record is stored in at least two different data structures. The artifact is authenticated based on the stage records for the artifact in each of the at least two data structures, prior to releasing the artifact into production.

Abstract: In an example, a computer system includes a hardware platform and a hypervisor executing on the hardware platform. The hypervisor includes a kernel and a plurality of user-space instances within a user-space above the kernel. Each user-space instance is isolated from each other user-space instance through namespaces. Each user-space instance includes resources confined by hierarchical resource groups. The computer system includes a plurality of virtual hypervisors, where each virtual hypervisor executes in a respective user-space instance of the plurality of user-space instances.

Abstract: Protecting data stored on a storage system through the use of different storage levels, including: creating a snapshot of a dataset stored on a storage system, wherein the snapshot includes user data and metadata, and wherein the metadata describes the storage layout of the dataset, offloading the snapshot to a first storage level storage system, and migrating, in accordance with a lifecycle policy, the snapshot from the first storage level storage system onto a second storage level storage system.

Abstract: A system and method for content management, may include receiving content created by a creator; creating a container to contain the created content and storing the created content in the container; determining a content type for the content; based on the determined content type, identifying items of metadata specified for the content type (name metadata; support data; corresponding; determining whether an identified item of specified metadata corresponding to the content is missing from the container; and prompting a user to supply identified missing metadata corresponding to the container.

Abstract: Disclosed is a folder management apparatus including a memory and a processor electrically connected to the memory. The processor is configured to detect access of a user terminal and to display at least one folder permitted to be accessed by the user terminal along with a folder badge corresponding to the folder, wherein, when update histories including modification and new generation with respect to the folder permitted to be accessed by the user terminal are generated, the folder badge indicates the number of update histories which have not been yet read by the user terminal among the update histories.

Abstract: Methods and apparatus are described for facilitating the client-side caching of media content based on one or more properties of the media content. Information relating to the cacheability of different types of content is communicated to the media player on a client device in the manifest or playlist employed by the media player to request fragments of the media content. The media player uses this information to make decisions about how to cache the corresponding content.

Abstract: A memory system includes a nonvolatile memory apparatus, and a write-same manager configured to perform a write-same operation on the nonvolatile memory apparatus, wherein the write-same manager merges a first write-same operation and a second write-same operation by comparing first operation information of the first write-same operation and second operation information of the second write-same operation.

Abstract: The disclosure herein describes mounting a shared data store, remote from a client cluster, as a remote data store on the client cluster. An abstraction interface of the remote data store on the client cluster is configured to receive data operations that are in a local data store-based format. A control path interface is established between the server cluster and the client cluster, and network location data associated with the shared data store is received by the client cluster via the established control path interface. Based on the network location data, a data path interface is established between the client cluster and the shared data store of the server cluster, whereby data operations directed to the abstraction interface of the remote data store on the client cluster are routed to the shared data store of the server cluster via the established data path interface.

Abstract: Occurrence of a RAID double failure in a slice of a RAID protection group (failed slice) renders data stored in the back-end tracks of the failed slice vulnerable to loss. When a RAID double failure is detected, a new slice is added to the RAID protection group. Front-end tracks that map to the good back-end tracks of the failed slice are moved from the back-end tracks of the failed slice to the back-end tracks of the newly added slice. Any front-end tracks that mapped to the bad back-end tracks of the failed slice are made to be write pending and written to corresponding back-end tracks of the newly added slice. Front-end tracks that map to the bad back-end tracks may be made to be write-pending in connection with a host write operation, by reading the front-end tracks from a local backup, or from a remote backup location.

Abstract: A method, system and computer program product for detecting sensitive personal information in a storage device. A block delta list containing a list of changed blocks in the storage device is processed. After identifying the changed blocks from the block delta list, a search is performed on those identified changed blocks for sensitive personal information using a character scanning technique. After identifying a changed block deemed to contain sensitive personal information, the changed block is translated from the block level to the file level using a hierarchical reverse mapping technique. By only analyzing the changed blocks to determine if they contain sensitive personal information, a lesser quantity of blocks needs to be processed in order to detect sensitive personal information in the storage device in near real-time. In this manner, sensitive personal information is detected in the storage device using fewer computing resources in a shorter amount of time.

Abstract: Data in a storage system is deduplicated after receiving from at least one writing entity requests for a plurality of write operations for a corresponding plurality of data blocks in a storage object. The received blocks are buffered and sorted in order and a sequence of clumps is created from the buffered blocks, where each clump comprises a grouping of at least one of the sorted, buffered blocks. A boundary is determined between at least one pair of clumps based at least in part on the content of at least one of the buffered blocks, and it is then determined whether at least one of the clumps is a duplicate of a previously stored clump.

Abstract: A data storage system implements aggregation, bifurcation, and/or reduction techniques to improve the efficiency of processing data storage requests. Data storage requests and/or their associated payloads may be aggregated based on one or more parameters. Data to be the stored and the associated commands may be separated so as to optimize a system's throughput and latency for each. Furthermore, extraneous commands and requests may be reduced or eliminated based on heuristics associated with the requests and the data.

Abstract: Embodiments are disclosed for a method for a tape library in hierarchical storage. The method includes receiving a recall request for a recall file having two copies stored in two tape libraries that are performing two migrations of two sets of files. The method also includes determining two migration progress values corresponding to the two migrations. Additionally, the method includes assigning the recall request to one of the two tape libraries having a greater value of the two migration progress values.

Abstract: Particular embodiments described herein provide for a system that can be configured to determine an identification (ID) of a computer processing unit (CPU) using one or more tests and/or measurements, intercept the result of a query from a process to determine the ID of the CPU, replace the result of the query if the result of the query does not match the determined ID of the CPU, and communicate the result of the query that includes the determined ID of the CPU to the process. In an example, the query is a CPUID opcode and the results of the query are intercepted after passing through a hypervisor.

Abstract: A data storage method includes the following steps: storing data to be stored into a mutable table, the mutable table being located in a RAM. If a storage content of the mutable table is greater than or equal to a preset storage content threshold, modifying the mutable table into an immutable table and stopping receiving storage of the data to be stored; if a storage content of a lowest level in a disk is greater than or equal to a storage content threshold of a present level, and next level higher in the disk is stored with columnar format, storing data of the lowest level to the next level in the columnar format; and if the lowest level is stored with row format, storing data in the immutable table to the lowest level in the row format.

Abstract: Disclosed are systems and methods for encryption of an ephemeral layer of one or more containers. An exemplary method comprises detecting a container starting execution in an operating system, generating a temporary encryption key and storing the temporary encryption key in memory of a kernel of the operating system, creating an encrypted area as the ephemeral layer in a storage device, the encrypted area accessible only by the container, providing to the container access to the encrypted area, and responsive to stopping execution of the container, destroying the temporary encryption key.

Abstract: Techniques are disclosed for querying for members in multiple groups. A list of unique members in the multiple groups may be received in response to the query. An example methodology implementing the techniques may include generating a group contexts dictionary and a job stack. The group contexts dictionary may include group context objects, each group context object associated with a group within a domain. The job stack may include one or more group context hashset keys, wherein a group context hashset key identifies a group context object. The method may include retrieving one or more group context hashset keys from the job stack and, for each retrieved group context hashset key, traversing a group associated with a group context object identified by a group context hashset key to determine membership information of the group, and generating a list of unique members by removing duplicate entries in the membership information.

Abstract: Techniques for creating snapshots of data storage objects that can perform certain operations (e.g., flushing dirty data, setting up extent pointers, allocating block storage space, etc.) during background (or deferred) processing. The disclosed techniques employ one or more extent copy trackers that can be created during processing of a transaction, while I/O request from host computers are suspended. The extent copy trackers are configured to perform some or all of the certain operations in the background, after the transaction has been committed and/or the processing of the transaction has been completed. By performing such operations during background processing, a processing time required to complete the snapshot transaction is reduced, thereby reducing latency in the resumption of the I/O requests from the host computers.

Abstract: In accordance with the present disclosure, files may be deduplicated in a distributed storage system having a plurality of storage volumes. A uniqueness metric for each file may indicate a degree of deduplication of the respective data files in the given storage volume. The uniqueness metric may be used to identify files for rebalancing in the distributed storage system. The uniqueness metric may be efficiently calculated with enough accuracy using a sampling methodology.

Abstract: Systems and method of the present invention are directed to data transfer systems and methods. Embodiments enable a user to access an electronic file to ascertain certain attribute data associated with one or more files, and allow the user to modify certain elements of the subject attributes file during the course of transferring the one or more files from a source location to a target or destination location.

Abstract: Transportable storage devices are communicatively coupled behind one or more dedicated “edge” data servers to take advantage of the benefits of the data servers and transportable storage devices while limiting their disadvantages. Each edge data server ingests data from one or more client devices and copies the data to one or more of the transportable storage devices for eventual transport to a cloud data center for upload to a cloud storage system. Object identifiers of objects stored on the transportable storage devices are maintained in a namespace of the data servers after decoupling of the transportable storage devices from the data servers so that the object identifiers remain visible to client devices.

Abstract: Systems and methods for distributed storage systems using dynamic spreading policies are described. Distributed storage elements may be accessed using various storage paths through hierarchically organized storage system components to store data blocks corresponding to data elements. A higher priority hierarchical spreading policy is selected for determining the storage elements to receive the data blocks. If the first hierarchical spreading policy is determined not to have been met, a lower priority hierarchical spreading policy is selected and the data blocks are stored according to the lower priority hierarchical spreading policy. Data block stored at the lower priority hierarchical spreading policy may automatically be migrated to the higher priority hierarchical spreading policy.

Abstract: A tiering service that supports cold tier indexing includes a warm tier and a cold tier and a resource manager that automatically relocates data items between the warm tier and the cold tier or removes data items from the cold tier in accordance with a tiering policy. The tiering service also includes a client interface configured to receive a request specifying index criteria for a cold tier index to be created. The tiering service generates a cold tier index based on data items stored in cold tier flat files satisfying the index criteria included in the request to create a cold tier index. Also, the tiering service automatically updates the cold tier index after it is stored in the cold tier as data items are relocated between the warm tier and the cold tier or removed from the cold tier in accordance with the tiering policy. In some embodiments, the tiering service also provides a common interface for accessing the cold tier index and a warm tier index.

Abstract: A data storage system operates a file system as a thinly provisioned file system having a host-visible virtual space and a smaller allocated space of underlying physical storage from a pool. The file system applies formatting to the allocated space and utilizes formatted allocated space for storing host files. The file system receives a file I/O request that requires increasing the allocated space of the file system, and in response (1) obtains an extent of physical storage from the pool and adds it to the file system as added allocated space, and (2) formats an initial portion of the added allocated space and satisfies the file I/O request using the formatted initial portion. Over a subsequent period the file system incrementally formats additional portions of the added allocated space and satisfies subsequent file I/O requests from the added portions.

Abstract: Coordinated storage media verification is provided by checking usage of a plurality of storage media, maintaining a storage media check database indicating media verification to be performed for one or more of the plurality of storage media, where the maintaining includes determining and comparing a time since a last load of a selected storage medium to a verification frequency threshold and determining whether media verification of the selected storage medium is to be performed, coordinating media verification of at least one storage medium of the plurality of storage media based on the storage media check database, which coordinating includes selecting at least one storage medium to be verified in an ascertained window of time, and initiating media verification of the selected at least one storage medium.

Abstract: An open block management apparatus, system, and method for non-volatile memory devices is disclosed herein, providing improved performance for namespace-based host applications. The namespace identifier is applied to determine the open blocks to which to direct data from storage commands. One benefit of the disclosed technique is fewer de-fragmentation operations and more efficient memory garbage collection. Another benefit is the ability to secure private allocations of physical memory without needing to assign a partition or implement hardware isolation.

Abstract: An apparatus in one embodiment comprises an ingestion manager, a plurality of ingestion engines associated with the ingestion manager, and an analytics platform configured to receive data from the ingestion engines under the control of the ingestion manager. The ingestion manager is configured to interact with one or more of the ingestion engines in conjunction with providing data to a given one of a plurality of analytics workspaces of the analytics platform. For example, the analytics workspaces of the analytics platform are illustratively configured to receive data from respective potentially disjoint subsets of the ingestion engines under the control of the ingestion manager. Additionally or alternatively, the ingestion manager may be configured to implement data-as-a-service functionality for one or more of the analytics workspaces of the analytics platform.

Abstract: A method of managing a database system that includes a swarm database with nodes of processors and memory. The memory stores programs that can be executed on the processors. Determining data files to delete, moving the data files to delete to a trash directory, truncating using a trash daemon, larger files to delete to smaller sized file pieces and deleting the smaller sized file pieces by a local operation system.

Abstract: Data classification includes tracking classification of columns of data into data classes of a collection of classes available for classifying the columns, obtaining a target column of data, of a target dataset, to be classified into a data class of the collection of candidate classes, and classifying the target column of data into a data class of the collection of classes based on historical data classification characteristics provided by the tracking. The classifying includes selecting a group of candidate data classes of the collection of classes to compare to value(s) of the target column, the selecting excludes at least some candidate data classes of the collection from comparison to the value(s), and establishing a priority between the candidate data classes of the group of candidate classes in comparing the value(s) of the target column of data to the selected group of candidate classes.

Abstract: A plurality of computing devices are communicatively coupled to each other via a network, and each of the plurality of computing devices is operably coupled to one or more of a plurality of storage devices. The computing devices may use local caches and storing snapshots in a coherent manner when accessing the plurality of storage devices spread across multiple data centers.

Abstract: Data security access and management may require a server dedicated to monitoring document access requests and enforcing rules and policies to limit access to those who are not specifically identified as having access to the data. One example of operation may include selecting data to access via a user device, applying at least one policy to the data that limits access to the data to user profiles assigned privileges to the policy, encrypting the data, generating metadata indicating the policy and pairing the metadata with the data, and storing the data and the metadata in a policy server.

Abstract: Disclosed herein are a metadata server and a method for distributing metadata in units of directories using the metadata server. The method includes receiving a request for at least one of creation, deletion and retrieval from a user file system; acquiring an inode corresponding to an identifier of a parent inode, which is included in the request; searching the parent inode for a dentry corresponding to the request when the request is a request to create a directory; selecting a secondary metadata server in which a new directory is to be created in order to distribute metadata in units of directories; requesting the selected secondary metadata server to create an inode; receiving an identifier of the created inode from the secondary metadata server; and adding a new dentry to the parent inode using the identifier of the inode.

Abstract: A computer-implemented method according to one embodiment includes creating journal entries in response to performing predetermined operations on a sequential storage medium, storing the journal entries in a memory in response to creation thereof for creating an operation journal, and upon occurrence of a predefined event, saving the operation journal. A computer program product according to another embodiment includes a computer readable storage medium having program instructions embodied therewith. The computer readable storage medium is not a transitory signal per se. The program instructions are readable and/or executable by a controller to cause the controller to perform a method including creating, by the controller, journal entries in response to performing predetermined operations on a sequential storage medium. The journal entries are stored, by the controller, in a memory in response to creation thereof for creating an operation journal.

Abstract: Disclosed is a multimedia pipeline device including first pipeline circuits and a processor. The first pipeline circuits include: a first circuit generating first data according to input data and recording characteristic information of the input data; and a second circuit generating second data according to the first data and recording characteristic information of the first data. The processor determines whether the characteristic information of the input data and the characteristic information of the first data are correct according to first and second prestored information respectively, in which at least a part of the first prestored information is recorded by the first circuit according to verified input data in advance and at least a part of the second prestored information is recorded by the second circuit according to verified first data in advance, and the verified input data and the input data originate from the same multimedia test file.

Abstract: A computer provides a first cache area and a second cache area on a cache memory in a data processing system comprising a database repository and the cache memory for the database repository. The computer receives, in a first time window, streaming data and writing the streaming data on the first cache area. The computer prohibits, in the first time window, carrying out synchronization between the first cache area and the database repository. The computer enables, in at least part of the first time window, synchronization between the database repository and the second cache area. The computer enables, upon elapse of the first time window, synchronization between the first cache area and the database repository.

Abstract: A media storage device includes a media security controller circuit and a memory to store data that relates to a media item to be rendered by a rendering device. The media security controller circuit sends a message to the rendering device that causes the rendering device to obtain a portion of data from memory of the media storage device and provide it to the media security controller circuit. The portion is received and transformed by the media security controller circuit. The media security controller circuit sends the transformed portion to the rendering device.