Abstract: A tiering service that supports cold tier indexing includes a warm tier and a cold tier and a resource manager that automatically relocates data items between the warm tier and the cold tier or removes data items from the cold tier in accordance with a tiering policy. The tiering service also includes a client interface configured to receive a request specifying index criteria for a cold tier index to be created. The tiering service generates a cold tier index based on data items stored in cold tier flat files satisfying the index criteria included in the request to create a cold tier index. Also, the tiering service automatically updates the cold tier index after it is stored in the cold tier as data items are relocated between the warm tier and the cold tier or removed from the cold tier in accordance with the tiering policy. In some embodiments, the tiering service also provides a common interface for accessing the cold tier index and a warm tier index.

Abstract: A data storage system operates a file system as a thinly provisioned file system having a host-visible virtual space and a smaller allocated space of underlying physical storage from a pool. The file system applies formatting to the allocated space and utilizes formatted allocated space for storing host files. The file system receives a file I/O request that requires increasing the allocated space of the file system, and in response (1) obtains an extent of physical storage from the pool and adds it to the file system as added allocated space, and (2) formats an initial portion of the added allocated space and satisfies the file I/O request using the formatted initial portion. Over a subsequent period the file system incrementally formats additional portions of the added allocated space and satisfies subsequent file I/O requests from the added portions.

Abstract: Coordinated storage media verification is provided by checking usage of a plurality of storage media, maintaining a storage media check database indicating media verification to be performed for one or more of the plurality of storage media, where the maintaining includes determining and comparing a time since a last load of a selected storage medium to a verification frequency threshold and determining whether media verification of the selected storage medium is to be performed, coordinating media verification of at least one storage medium of the plurality of storage media based on the storage media check database, which coordinating includes selecting at least one storage medium to be verified in an ascertained window of time, and initiating media verification of the selected at least one storage medium.

Abstract: An open block management apparatus, system, and method for non-volatile memory devices is disclosed herein, providing improved performance for namespace-based host applications. The namespace identifier is applied to determine the open blocks to which to direct data from storage commands. One benefit of the disclosed technique is fewer de-fragmentation operations and more efficient memory garbage collection. Another benefit is the ability to secure private allocations of physical memory without needing to assign a partition or implement hardware isolation.

Abstract: An apparatus in one embodiment comprises an ingestion manager, a plurality of ingestion engines associated with the ingestion manager, and an analytics platform configured to receive data from the ingestion engines under the control of the ingestion manager. The ingestion manager is configured to interact with one or more of the ingestion engines in conjunction with providing data to a given one of a plurality of analytics workspaces of the analytics platform. For example, the analytics workspaces of the analytics platform are illustratively configured to receive data from respective potentially disjoint subsets of the ingestion engines under the control of the ingestion manager. Additionally or alternatively, the ingestion manager may be configured to implement data-as-a-service functionality for one or more of the analytics workspaces of the analytics platform.

Abstract: A method of managing a database system that includes a swarm database with nodes of processors and memory. The memory stores programs that can be executed on the processors. Determining data files to delete, moving the data files to delete to a trash directory, truncating using a trash daemon, larger files to delete to smaller sized file pieces and deleting the smaller sized file pieces by a local operation system.

Abstract: Data classification includes tracking classification of columns of data into data classes of a collection of classes available for classifying the columns, obtaining a target column of data, of a target dataset, to be classified into a data class of the collection of candidate classes, and classifying the target column of data into a data class of the collection of classes based on historical data classification characteristics provided by the tracking. The classifying includes selecting a group of candidate data classes of the collection of classes to compare to value(s) of the target column, the selecting excludes at least some candidate data classes of the collection from comparison to the value(s), and establishing a priority between the candidate data classes of the group of candidate classes in comparing the value(s) of the target column of data to the selected group of candidate classes.

Abstract: A plurality of computing devices are communicatively coupled to each other via a network, and each of the plurality of computing devices is operably coupled to one or more of a plurality of storage devices. The computing devices may use local caches and storing snapshots in a coherent manner when accessing the plurality of storage devices spread across multiple data centers.

Abstract: Data security access and management may require a server dedicated to monitoring document access requests and enforcing rules and policies to limit access to those who are not specifically identified as having access to the data. One example of operation may include selecting data to access via a user device, applying at least one policy to the data that limits access to the data to user profiles assigned privileges to the policy, encrypting the data, generating metadata indicating the policy and pairing the metadata with the data, and storing the data and the metadata in a policy server.

Abstract: Disclosed herein are a metadata server and a method for distributing metadata in units of directories using the metadata server. The method includes receiving a request for at least one of creation, deletion and retrieval from a user file system; acquiring an inode corresponding to an identifier of a parent inode, which is included in the request; searching the parent inode for a dentry corresponding to the request when the request is a request to create a directory; selecting a secondary metadata server in which a new directory is to be created in order to distribute metadata in units of directories; requesting the selected secondary metadata server to create an inode; receiving an identifier of the created inode from the secondary metadata server; and adding a new dentry to the parent inode using the identifier of the inode.

Abstract: A computer-implemented method according to one embodiment includes creating journal entries in response to performing predetermined operations on a sequential storage medium, storing the journal entries in a memory in response to creation thereof for creating an operation journal, and upon occurrence of a predefined event, saving the operation journal. A computer program product according to another embodiment includes a computer readable storage medium having program instructions embodied therewith. The computer readable storage medium is not a transitory signal per se. The program instructions are readable and/or executable by a controller to cause the controller to perform a method including creating, by the controller, journal entries in response to performing predetermined operations on a sequential storage medium. The journal entries are stored, by the controller, in a memory in response to creation thereof for creating an operation journal.

Abstract: Disclosed is a multimedia pipeline device including first pipeline circuits and a processor. The first pipeline circuits include: a first circuit generating first data according to input data and recording characteristic information of the input data; and a second circuit generating second data according to the first data and recording characteristic information of the first data. The processor determines whether the characteristic information of the input data and the characteristic information of the first data are correct according to first and second prestored information respectively, in which at least a part of the first prestored information is recorded by the first circuit according to verified input data in advance and at least a part of the second prestored information is recorded by the second circuit according to verified first data in advance, and the verified input data and the input data originate from the same multimedia test file.

Abstract: A media storage device includes a media security controller circuit and a memory to store data that relates to a media item to be rendered by a rendering device. The media security controller circuit sends a message to the rendering device that causes the rendering device to obtain a portion of data from memory of the media storage device and provide it to the media security controller circuit. The portion is received and transformed by the media security controller circuit. The media security controller circuit sends the transformed portion to the rendering device.

Abstract: A computer provides a first cache area and a second cache area on a cache memory in a data processing system comprising a database repository and the cache memory for the database repository. The computer receives, in a first time window, streaming data and writing the streaming data on the first cache area. The computer prohibits, in the first time window, carrying out synchronization between the first cache area and the database repository. The computer enables, in at least part of the first time window, synchronization between the database repository and the second cache area. The computer enables, upon elapse of the first time window, synchronization between the first cache area and the database repository.

Abstract: The disclosure relates in some aspects to the use of host metadata by a controller of a data storage device, such as the controller of a solid state device (SSD) having non-volatile memory (NVM) arrays that is coupled to a host device. In some aspects, the controller parses metadata within host commands to extract relevant hints and then correlates the hints with actual host device behavior. If the controller finds a strong correlation between the metadata hints and the host behavior, the hints are used for command storage optimization. Later, if there ceases to be a strong correlation between the hints and the host behavior, hint-based storage optimization may be suspended. In other aspects, the controller uses metadata to provide for virtual or expanded write streams. In still other aspects, the controller and the host device negotiate a structure for metadata during an initialization phase.

Abstract: A technique handles metadata corruption to avoid data unavailability. The technique involves performing metadata evaluation operations on metadata describing pages of written data in a data-log that holds data en route to volumes in secondary storage. The technique further involves, while results of the metadata evaluation operations indicate that there is no corrupt metadata, flushing the pages of written data from the data-log to the volumes in the secondary storage. The technique further involves, in response to a result of a particular metadata evaluation operation indicating that metadata for a particular page of written data in the data-log is corrupt, quarantining the particular page of written data from the data-log to a containment cache to enable further flushing of other pages of written data from the data-log to the volumes in the secondary storage.

Abstract: An abstraction layer communicates with a plurality of applications executing on a multi-application platform. The abstraction exposes a standard interface for the plurality of applications to communicate content status information. An indication is received that a new content item will be generated. A record is generated that is immutably associated with the new content item. The record is updated with information received from the application associated with the content item, the information pertaining to a changed status of the content item. In response to a command to delete the content item, it is determined whether to confirm deletion of the content item based on one or more data retention policies. The record is updated to indicate a reason for granting or denying the deletion and a source of the delete command.

Abstract: A technique for managing cloud storage provides a unified framework that supports both block-type data, such as LUNs (Logical UNits) and volumes, and file-type data, such as files, and expresses both types of data in the form of objects, which form a common base for both types of data. The framework includes a single API (application program interface) for managing storage and retrieval of block-derived objects and file-derived objects from the cloud, e.g., from a cloud-based data store.

Abstract: Auditing of mortgage documents is faster and simpler. An electronic mortgage application often contains or references a collection of many separate electronic mortgage documents. Electronic data representing an original version of an electronic mortgage document and its current version may be hashed to generate digital signatures. Any auditor may then quickly compare the digital signatures. If the digital signatures match, then the audit reveals that the electronic mortgage document has not changed since its creation. However, if the digital signatures do not match, then the electronic mortgage document has changed since its creation. The auditor may thus flag the electronic mortgage document for additional auditing processes.

Abstract: In one embodiment, a system for managing a virtualization environment includes a set of host machines, each of which includes a hypervisor, virtual machines, and a virtual machine controller, and a file server splitting system configured to split an existing virtualized file server (VFS) into a set of new virtualized file servers (VFSs), the splitting system configured to select one or more existing file server virtual machines (FSVMs) to be removed from the existing VFS. For each existing FSVM, the splitting system is configured to identify an available FSVM that is separate from the existing VFS, provide resources of the existing FSVM to the available FSVM, incorporate the available FSVM into one of the new VFSs, and remove the existing FSVM from the existing VFS. The splitting system may be further configured to re-direct requests to access storage items served by the existing FSVM to the available FSVM.

Abstract: A method includes obtaining a plurality of sets of write requests regarding a plurality of sets of encoded data slices. During a first time period, the method continues by identifying a set of storage units of a dispersed storage network and identifying a first namespace subrange of a namespace associated with the set of storage units. The method continues by issuing a first set of write requests of the plurality of sets of write requests to a first subset of storage units of the set of storage units regarding first sets of encoded data slices to be stored in the first namespace subrange. The method continues by issuing a second set of write requests of the plurality of sets of write requests to a second subset of storage units of the set of storage units regarding second sets of encoded data slices to be stored in the first namespace subrange.

Abstract: A system and method is disclosed for using data blocks to optimize file storage in electronic data storage. An example method includes storing data objects in a storage service that correspond to a main block and multiple secondary blocks. The main block is stored in a first bucket and the secondary blocks are stored in one or more second buckets, with the main block including metadata indicating a unique identifier of the second bucket. The method further includes receiving a request to delete the data file to free storage; marking the main block of the data file for deletion that prevents a reading operation or a writing operation of additional data to the data file; deleting the secondary blocks of the data file; and after the secondary blocks are deleted, deleting the marked main block of the data file.

Abstract: A system can serialize moves and mounts across namespaces based on lamport clocks. In some examples, the system obtains a request to move a content item from a source namespace to a destination namespace. The system processes an incoming move at the destination and an outgoing move at the source. The system processes for the content item a delete at the source and an add at the destination. The system assigns a first clock to the incoming move and a second clock to the outgoing move, the first clock being lower than the second clock. The system assigns a third clock to the delete and a fourth clock to the add, the third clock being higher than the second clock and lower than the fourth clock. The system serializes the incoming and outgoing moves, the delete and the add based on the first, second, third and fourth clocks.

Abstract: Case management systems and techniques are disclosed. In various embodiments, a trait definition is received that associates with a case node comprising a case model an object associated with an external system, e.g., a document or other content object and/or a business or other software object. The trait definition is used to bind respective instances of the object to corresponding instances of the case node in case instances created based on the case model.

Abstract: Due diligence of mortgage documents is faster and simpler. An electronic mortgage application often contains or references a collection of many separate electronic mortgage documents. Electronic data representing an original version of an electronic mortgage document and its current version may be hashed to generate digital signatures. Any auditor may then quickly conduct the due diligence by comparing the digital signatures. If the digital signatures match, then the due diligence reveals that the electronic mortgage document has not changed since its creation. However, if the digital signatures do not match, then the electronic mortgage document has changed since its creation. The auditor may thus flag the electronic mortgage document for additional due diligence. Regardless, a result of the due diligence may be incorporated into one or more blockchains.

Abstract: A method, system and computer program product for detecting sensitive personal information in a storage device. A block delta list containing a list of changed blocks in the storage device is processed. After identifying the changed blocks from the block delta list, a search is performed on those identified changed blocks for sensitive personal information using a character scanning technique. After identifying a changed block deemed to contain sensitive personal information, the changed block is translated from the block level to the file level using a hierarchical reverse mapping technique. By only analyzing the changed blocks to determine if they contain sensitive personal information, a lesser quantity of blocks needs to be processed in order to detect sensitive personal information in the storage device in near real-time. In this manner, sensitive personal information is detected in the storage device using fewer computing resources in a shorter amount of time.

Abstract: A method, system and computer program product for detecting sensitive personal information in a storage device. A block delta list containing a list of changed blocks in the storage device is processed. After identifying the changed blocks from the block delta list, a search is performed on those identified changed blocks for sensitive personal information using a character scanning technique. After identifying a changed block deemed to contain sensitive personal information, the changed block is translated from the block level to the file level using a hierarchical reverse mapping technique. By only analyzing the changed blocks to determine if they contain sensitive personal information, a lesser quantity of blocks needs to be processed in order to detect sensitive personal information in the storage device in near real-time. In this manner, sensitive personal information is detected in the storage device using fewer computing resources in a shorter amount of time.

Abstract: Systems and methods for matching data variables across different data domains are disclosed. An example method includes: identifying a first data parameter included in a first programming statement; selecting a mapping file that includes one or more mappings between parameters associated with in a first type of programming language and parameters associated with in a second type of programming language. The second type of programming language is different form the first type of programming language. The example method further includes identifying, based on the one or more mappings, second one or more data parameters associated with a second programming statement; receiving a user section of the first data parameter; and responsive to the user section, presenting the second one or more data parameters to a user.

Abstract: A computing device that is configured for remotely invoking dynamic classes is described. The computing device includes a processor, memory in electronic communication with the processor and instructions stored in the memory. The computing device deploys one or more assemblies, which are used by an unreferenced derived class. A byte array that includes the unreferenced derived class is received from a remote node. The unreferenced derived class includes an implementation of a common base class. The computing device further receives a class name and one or more assembly names from the remote node. The computing device decodes the byte array to reconstitute the unreferenced derived class and calls the implementation of the common base class. One or more operations may be performed with the unreferenced derived class.

Abstract: Protecting data stored on a storage system through the use of different storage levels, including: creating a snapshot of a dataset stored on a storage system, wherein the snapshot includes user data and metadata, and wherein the metadata describes the storage layout of the dataset, offloading the snapshot to a first storage level storage system, and migrating, in accordance with a lifecycle policy, the snapshot from the first storage level storage system onto a second storage level storage system.

Abstract: Methods and apparatuses for a computerized system are disclosed. A data processing device receives information from at least one source of log information in the computerized system and detects, based at least in part on said received log information, at least one security protocol related event at a first host device, the at least one security protocol related event being initiated by a second host device. Information is then stored for determination of a trust relationship record based on the detected at least one security protocol related event and information of the second host device.

Abstract: Techniques for improving storage efficiency of a data storage system are provided. The techniques include (a) performing a testing operation to evaluate whether a test condition is satisfied for a filesystem having a plurality of subspaces, each subspace being provisioned with a respective amount of storage, each subspace of the filesystem being dedicated to storing different respective types of filesystem content, wherein the test condition indicates that a first subspace has available space in excess of a threshold percentage, (b) in response to determining that the test condition is satisfied for the filesystem, performing a reduction operation on the first subspace to remove a portion of storage provisioned to that subspace while retaining the removed portion for use by the filesystem, and (c) upon a second subspace reaching a fullness threshold, provisioning the removed portion to the second subspace and storing content of the respective type of the second subspace thereon.

Abstract: One embodiment provides a method for storage management in a hierarchical file system. The method includes tracking directories for sub-file systems of the hierarchical set of file systems and maintaining a corresponding directory in a top-file system and a number of symbolic pointers in the corresponding directory which each point from the corresponding directory to a sub-file system where any portion of the tracked directory resides. If available space in a first sub-file system is below a threshold, the system identifies a second sub-file system with available space above the threshold, wherein the first sub-file system contains a first portion of the directory. If a second portion of the directory does not exist in the second sub-file system, the system creates the second portion of the directory in the second sub-file system and creates a link from the first portion of the directory to the second portion of the directory.

Abstract: A cohort associated with a user is identified. A virtual object is generated according to the cohort. An augmented reality setting of a location is generated in relation to the user. A context of the location is determined. The virtual object is modified in the augmented reality setting according to the context and the cohort.

Abstract: One embodiment provides a method for storage management in a hierarchical file system. The method includes tracking directories for sub-file systems of the hierarchical set of file systems and maintaining a directory while providing the directory is capable of residing in more than one sub-file system within the hierarchical file system. If available space in a first sub-file system is below a threshold, the system identifies a second sub-file system with available space above the threshold, wherein the first sub-file system contains a first portion of the directory. If a second portion of the directory exists in the second sub-file system, the system creates or expands a file in the second portion of the directory, otherwise the system first creates the second portion of the directory in the second sub-file system and then creates a link from the first portion of the directory to the second portion of the directory.

Abstract: A method, system, and computer program product for providing, via a provisioning engine, a scalable set of indexed key-value pairs enabled to store objects in a data storage environment; wherein the data representing the objects is enabled to be spread across arrays in the data storage environment; wherein additional arrays are enabled to be added to the data storage environment and included in the indexed key-value pairs; wherein the data stored across the arrays may be balanced.

Abstract: Data processing systems, user interfaces and methods are provided, which allow a user to select information sources, to rearrange associations between links to content items in the information sources and thematic information aggregations including the links and to access any of the information sources via the thematic information aggregation which contains the respective link. The user interface may be graphic, highly interactive, user-modifiable and zoomable, and implement elements of semantic analysis to allow the user arrange multiple content items from various sources into thematic information aggregations sharing unified interface, using only links to the content items. The thematic information aggregations may be synchronized across user devices and user statuses may be preserved.

Abstract: A method for emergency data destruction includes: identifying, by a data identification module, one or more data files for emergency destruction stored in one or more data storage devices; identifying, by the data identification module, at least one file system utilized by the one or more data storage devices; overwriting, by a data generation module, a header of each of the one or more data files, wherein the header of each of the one or more data files is identified based on the at least one file system; truncating, by a data modification module, a file size of each of the one or more data files; and deleting, by a data destruction module, each of the one or more data files, wherein the overwriting and truncating steps are performed prior to deletion of each of the one or more data files.

Abstract: The present invention relates to methods and file systems for tracking the chain of custody on unstructured data in a file system. More particularly, the present invention relates to methods and file systems for tracking the chain of custody between a source file and a destination file from a source file system to a destination file system.

Abstract: A computer implemented method for updating a file system tree structure through an atomic operation, comprising one or more hardware processor adapted for designating a file system comprising a plurality of files arranged in a plurality of tree structures, the file system is based on a direct mapping persistent memory, receiving instructions from a client to alter an altered file of the plurality of files, creating an alternate tree structure to apply the alteration in case the alteration involves a non-atomic tree structure operation to an original tree structure of the plurality of tree structures containing the altered file and committing the alteration to the file system through an atomic operation.

Abstract: Provided is a method and apparatus of dynamic loading file extraction. The method for extracting a specific dynamic generated file of an application running in an Android container environment includes conducting first analysis to identify if a file extension that is stored in the Android container corresponds to a preset critical extension, to extract a file with the critical extension, and conducting second analysis to identify a deleted file standing for a file deleted after stored in the Android container, and running the application again and extracting the deleted file based on a result of the second analysis.

Abstract: A technology is described for managing computing capacity within a computing service environment. An example method may include determining a state of a computing service environment having a group of physical hosts that execute computing instances and determining a predicted demand for computing instance launches on the group of physical hosts. A co-location of the computing instance launches on the group of physical hosts may then be determined by applying the predicted demand for computing instance launches to the state of the computing service environment. A predicted launch time for the computing instance launches may then be determined using the co-location of the computing instance launches as an input feature. An additional physical host may then be added to the group of physical hosts to decrease the predicted launch time.

Abstract: Case management systems and techniques are disclosed. In various embodiments, for each of a plurality of case nodes comprising a case model a trait definition comprising a corresponding set of traits associated with that case node is received. The respective trait definitions are used to bind each set of traits to the case node with which the set of traits is associated in case instances created based on the case model.

Abstract: A media storage device includes a media security controller circuit and a memory to store data that relates to a media item to be rendered by a rendering device. The media security controller circuit sends a message to the rendering device that causes the rendering device to obtain a portion of data from memory of the media storage device and provide it to the media security controller circuit. The portion is received and transformed by the media security controller circuit. The media security controller circuit sends the transformed portion to the rendering device.

Abstract: Providing joint access to an isolated computer object by both an isolated computer application and a non-isolated computer application. In one embodiment, a method may include executing a first computer application as a virtualized first computer application in an isolation layer, executing a second computer application as an actual second computer application in an operating system outside the isolation layer, creating a virtualized second computer object in the isolation layer in a location accessible to the virtualized first computer application, creating a gateway third computer object associated with the virtualized second computer object, storing the gateway third computer object outside the isolation layer in a location accessible to the operating system, and enabling joint access to the gateway third computer object by both the virtualized first computer application and the actual second computer application.

Abstract: Methods and apparatus, including computer program products, implementing and using techniques for decompressing data in a database system. A query is received, which pertains to a subset of data within a compressed set of data. One or more decompression strategies are evaluated using a cost model. The cost model includes an estimated filter factor. A low cost decompression strategy is selected based on the results of the evaluation of the one or more decompression strategies. One or more bytes representing the requested subset of data are located within the compressed set of data. Only a portion of the compressed data that corresponds to the subset of data is decompressed, using the selected decompression strategy, while leaving the remaining set of data in a compressed state.

Abstract: Techniques for decompressing data in a database system. A query is received, which pertains to a subset of data within a compressed set of data. One or more decompression strategies are evaluated using a cost model. The cost model includes an estimated filter factor. A low cost decompression strategy is selected based on the results of the evaluation of the one or more decompression strategies. One or more bytes representing the requested subset of data are located within the compressed set of data. Only a portion of the compressed data that corresponds to the subset of data is decompressed, using the selected decompression strategy, while leaving the remaining set of data in a compressed state.

Abstract: A data object management method and a data object management system are provided. The data object management method includes the following steps. Generate a space allocation list according to an operation parameter of a space consuming device. The space allocation list records information about a plurality of storage spaces. Update the space allocation list and a target storage space. The target storage space is one of the storage spaces. Send a playlist corresponding to the space allocation list when a reading request corresponding to the space consuming device is received.

Abstract: A Token Key Infrastructure and a method using Polymorphic Executable or its variants for the exchange of digital information, including digital data and digital executable codes, over network or internet in a secure way with the use of Dynamism, Polymorphism and Dynamic Polymorphism, as well as integrating with Public Key Infrastructure where considered appropriate for the protection of intellectual property rights, privacy and confidentiality of digital information.

Abstract: In order to write data to a storage system accessible with a first and second file system, a manager receives a data write request associated with a file. The manager determines if a function supported by the second file system is needed to complete the write request. If so, the file is opened and extended with the first file system. The file is then opened and written to by the second file system. The file is truncated by the first file system, and closed by both file systems. If the second file system function is not needed, the file is opened, written, and closed by the first file system. In order to read data from a storage system using a function supported by the second file system, the second file system's cached storage system index is updated, and then the file is opened, read, and closed by the second file system.