Abstract: When a deletion request to delete a file system is made and a retention period of the file system to be deleted has not expired, the retention period end date and time is displayed at high speed. A CPU 11 gives a retention period attribute to each file of a file system 16 and manages the furthest future retention period end date and time, from among the retention periods of the files, as a retention period end date and time of the file system. If a deletion request to delete the file system 16 is made and the retention period end date and time of the file system 16 is future time ahead of the current time when the deletion request is made, processing for deleting the file system 16 is stopped and the retention period end date and time of the file system 16 is displayed on a screen 235.

Abstract: Systems and methods of electronic document handling permit organizations to comply with legal or regulatory requirements, electronic discovery and legal hold requirements, and/or other business requirements. The systems described provide a unified approach to data management that enables compliance, legal and IT personnel to focus efforts on, e.g., a single data repository. The systems permit users to define and utilize information governance policies that help automate and systematize different compliance tasks. In some examples, organizations may push data in any third-party data format to the systems described herein. The systems may permit compliance or IT personnel to detect when a legally sensitive production file has been changed or deleted. The systems may also provide a unified dashboard user interface. From a dashboard interface, users may perform searches, participate in collaborative data management workflows, obtain data management reports, and adjust policies.

Abstract: In an embodiment, a first row of data is stored in a database. The first row of data is hidden until a current date is later than a hidden expiration date. An indication is returned, to a requestor, that the first row does not exist in response to a query from the requestor that specifies a key that identifies the first row if the current date is before the hidden expiration date. The first row is returned, to the requestor, in response to the query if the current date is after the hidden expiration date.

Abstract: Embodiments are directed towards a system and method for a cloud-based front end that may abstract and enable access to the underlying cloud-hosted elements and objects that may be part of a multi-tenant application, such as a search application. Search objects may be employed to access indexed objects. An amount of indexed data accessible to a user may be based on an index storage limit selected by the user, such that data that exceeds the index storage limit may continue to be indexed. Also, one or more projects can be elastically scaled for a user to provide resources that may meet the specific needs of each project.

Abstract: Methods, systems, and apparatus, including computer program products feature selecting a file in a distributed file system. The file is associated with a time to live derived from a path name for the file. The file is divided into a plurality of chunks that are distributed among a plurality of servers. Each chunk has a respective modification time indicating when the chunk was last modified. A latest respective modification time among the respective modification times of each of the plurality of chunks is selected. A determination is made as to whether an elapsed time based on the latest modification time is equal to or exceeds the time to live. Each of the chunks of the file is deleted responsive to the determination. Other embodiments of this aspect include corresponding systems, apparatus, and computer program products.

Abstract: Aspects of the present invention are directed to a system for next day reconciliation of transportation records. The system having a transportation record storage provider (TRSP) that receives and stores storage medium transportation requests; an outside service provider (OSP) inventory manager that receives and maintains records of transported storage mediums scanned at the OSP; and a reconciliation provider that receives a first list from the TRSP and a second list from the OSP inventory manger, for reconciliation. The reconciliation provider includes receivers for receiving the first and second list; a processing engine that reconciles the first list and the second list; and a reporting unit that reports the results of the reconciliation. The processing engine matches inbound and outbound records of the first list and second list, and processes invalid records; and analyzes and accounts for un-matched records.

Abstract: Embodiments are directed towards a system and method for a cloud-based front end that may abstract and enable access to the underlying cloud-hosted elements and objects that may be part of a multi-tenant application, such as a search application. Search objects may be employed to access indexed objects. An amount of indexed data accessible to a user may be based on an index storage limit selected by the user, such that data that exceeds the index storage limit may continue to be indexed. Also, one or more projects can be elastically scaled for a user to provide resources that may meet the specific needs of each project.

Abstract: A system, computer-readable storage medium storing at least one program, and a computer-implemented method for updating content are presented. A first version of content residing on a user device is determined, and a second version of content relating to the first version of content is determined. Version information for each file within a second set of files organized within a second archive of the second version of content is sequentially accessed based on a second order of the second set of files in the second archive, the version information indicating a version of each file. A determination is made of when version information indicating a newer version of content has been accessed from the second archive, and new content associated with the newer version is provided to the user device.

Abstract: A method of searching a biometric database includes storing biometric data corresponding to a number of users in a database, and defining one or more data subsets in the database according to inputs from users expecting to pass through a given biometric acquisition device that is linked with the database within a certain time period. A search initiated by the given acquisition device at a given time is then scaled down to only those data subsets defined by the inputs from those users expecting to pass through the acquisition device at the given time. This modification of the database and database search is performed continuously and automatically based on dynamic information provided by other automatic and/or manual systems, and then optionally the information on the databases can be automatically modified or deleted based either on a biometric match result or based on rules encoded in the database records.

Abstract: An apparatus, method and computer program operable in a network controls consistency guarantees of a plurality of data copies in a storage apparatus, and includes: a lease control component for extending a lease to the storage apparatus; and a consistency freeze/thaw component responsive to a failure indication for initiating a consistency freeze action at the storage apparatus prior to expiration of the current group lease period. It may further include a timer component for waiting the apparatus for a predetermined period after the consistency freeze action, where the consistency freeze/thaw component is operable to initiate a thaw action at the storage apparatus.

Abstract: A storage system 1 including: a plurality of data storage systems 3000 each including a storage apparatus 5000 providing a data storage area to an external apparatus 1000, and an information processor 4000 controlling data input and output between the external apparatus and the storage apparatus, the storage system comprising; a data attribute information retention part 4420 holding data delete allow/disallow information 4423 and data attribute information 4421 and 4424; a management information retention part 2420 that is a list holding at least one of data attribute information 2421, and data storage location information 2422 of each piece of data; and a data delete control part 4440 receiving a data delete command and controlling a process of deleting the data stored in the storage apparatus based on the command.

Abstract: This disclosure relates to systems, methods and apparatuses for managing the retention and disposition of data for an event consumer using an Enterprise Retention Management System wherein the management is driven by business events.

Abstract: Specifying the policies with which (portion of) an email communication is to be stored as a record, within the content of the email communication. In an embodiment, an attachment file specifies such policies in the form of XML tags. As a result, a user may merely need to attach a file specifying the desired policies, and send the email communication. In one implementation, the user specifies a pre-specified email address as a recipient to cause the email communication to be saved as a record.

Abstract: There is provided, in a computer processing system, an apparatus for storage lifecycle management for a plurality of managed objects. The apparatus includes a policy decision manager for creating and managing a policy decision stash. The policy decision stash is associated with predictive policy decisions for the plurality of managed objects and is configured to allow the predictive policy decisions for the plurality of managed objects to be incrementally updated and accessed in the policy decision stash by a policy identifier and an effective timestamp.

Abstract: A host of a multi-device file system may instruct an external data mover implementing a third party copy to move data from one storage device to another without the host reading or writing data as part of the move. The data being moved may remain accessible through the file system after being moved. A host may instruct an external data mover to write moved data to multiple mirrored devices. A host may instruct the data mover to move data between storage classes in a multi storage class file system. A journaling file system may utilize an external data mover implementing a third party copy to move data from a system log to another storage destination and may also instruct the data mover to move metadata as well as data.

Abstract: Disclosed is a system in which an index registration unit registers an index, which will be used for search processing, as a partitioned index which is partitioned on a time series basis, and a search means reads indexes older than a specified point in time, which is used as a search base point, to perform search processing, thereby searching for information based on a point in time in the past.

Abstract: A method, and apparatus for software and resource management with a model-based architecture.

Abstract: Provided are a method, system, and program for receiving a request to remove a record. A determination is made as to whether a state associated with the record includes at least one hold state and whether the state associated with the record includes at least a retention period that has not expired. The request to remove the record is denied in response to determining that the state associated with the record includes at least one of at least one hold state and one retention period that has not expired.

Abstract: An image processing apparatus capable of executing a plurality of types of jobs includes a storage unit configured to store an integrated document including image data and a plurality of types of accompanying information related to the image data, a receiving unit configured to receive an instruction for executing a job for the integrated document stored in the storage unit, a deletion unit configured to delete at least a part of the accompanying information of the integrated document for which the instruction for executing the job is received by the receiving unit if the job for which the instruction for execution is received by the receiving unit is a predetermined type of job, and an execution unit configured to execute the job for which the instruction for execution is received by the receiving unit.

Abstract: A method (and system) of storing data in a value-based storage system, includes optimizing a value of data stored in the value-based storage system.

Abstract: Systems and processes for detecting and storing occurrence data using mote networks are disclosed. In some embodiments, a system includes a computing component coupled with a data storage device and operable to receive data from one or more motes. Instructions on the data storage device configure the computing component to receive data from one or more motes into a received data set, receive an input selection corresponding to a target-occurrence having a representative feature, the representative feature including at least one recognizable pattern of at least one parameter in the data received from the one or more of the motes, select a pattern recognition criteria corresponding one of the representative features of the target-occurrence, and in response to the input selection corresponding to the target-occurrence, automatically search the received data set for data correlating to the target-occurrence representative feature using the selected pattern recognition criteria.

Abstract: A system and method for record archive disposition is implemented with a computer system comprising one or more computer processors operatively connected to memory. Archival records are stored in memory, each archival record being associated with at least one metadata attribute. At least one or more legal holds are stored in memory, each legal hold having legal hold metadata attributes. A deletion candidate list is generated with at least one of the processors for at least one record type by including on the deletion candidate list archival records identified as having one or more archival record metadata attributes corresponding to the at least one record type, and excluding from the deletion candidate list identified archival records if a selected set of legal hold metadata attributes for at least one legal hold corresponds to at least a subset of metadata attributes for the identified archival records. Archival records included on the deletion candidate list are deleted from memory.

Abstract: A method of anonymize business data. The method includes responsive to a request from an application for data objects stored in a database system, retrieving the data objects from a non-transitory storage of the database system, prior to transmitting the data object to the application, retrieving pre-determined rules from a rule engine, wherein the rules include conditions for retaining data, comparing the request against the rules to determine portions of the data objects that are to be anonymized, anonymizing the portions of the data objects, and transmitting the data object to the application.

Abstract: Techniques for providing content management services are described. Managing content services includes determining a value of content and determining storage actions of the content based on the value. The value of the content is determined by weighting factors, such as access frequency, a rating, a size of the content, a type of the content, and a security level of the content. Based on the value of the content, one or more storage actions may be determined for the content to optimize storage. The storage actions may include identifying a version of the content to be saved, compressing the content, determining a back up of the content to store, identifying a location to store the content, performing erasure encoding of the content, and/or removing the content.

Abstract: Integration between Enterprise Records Management systems (ERMs) and Records Management Systems (RMSs) is provided, thus providing a robust record classification and retention schedule enforcement process in large enterprises. Typically, ERMs have been designed from the ground up to be highly scalable across multiple national and regional jurisdictions, whereas RMS's were primarily departmental. Proper integration between ERMs and RMSs, as provided by the invention, allows corporations to deploy larger scale multi-organizational instances of RMSs, thus achieving a better level of control and significant economies of scale.

Abstract: The present invention relates to an apparatus and method for managing a file in a distributed storage system. The apparatus and method for managing a file in a distributed storage system calculates a retention time of the file based on at least one of a current time, a file creation time, a file modification time and a recent file inquiry time; selects the file as an archive file if the retention time of the file is larger than a predetermined reference time; and relocates an original file and some or all of copy files of the file selected as an archive file from an active server to an archive server or from an active disk to an archive disk.

Abstract: Methods, systems and computer program products for reducing database workload volume. Methods include collecting a sequence of database commands directed to a single database record in a database. The sequence of database commands are reduced to a net result by combining database commands within the sequence of database commands. The net result is written to an output entity when the net result includes a database command.

Abstract: A system and method is disclosed which enables network administrators and the like to quickly analyze the data produced by log-producing devices such as network firewalls and routers. Unlike systems of the prior art, the system disclosed herein automatically parses and summarizes log data before inserting it into one or more databases. This greatly reduces the volume of data stored in the database and permits database queries to be run and reports generated while many types of attempted breaches of network security are still in progress. Database maintenance may also be accomplished automatically by the system to delete or archive old log data.

Abstract: An information processor may include a command receiving unit that receives an immediate processing command in which a deletion target to be deleted from the database is conditioned, and a registration processing unit that registers information defining the deletion target into a management data unit. In addition, the information processor may include a deletion processing unit that deletes the deletion target from a database, and deregisters the deleted deletion target from the management data unit. The information processor can also include a data manipulation command processing unit, which, in the case where a data manipulation command having a manipulation target that coincides with a table of the deletion target registered in the management data unit is received, processes the data manipulation command in a state where a condition to exclude the deletion target from the manipulation target is added to the data manipulation command.

Abstract: Systems and methods for decomposing and decaying data over time by decomposing a type of data item into constituent units of the data item, establishing relationship factors between data items to other data items and between constituent units, creating a shelf-life criterion for the constituent units priority dimensions, calculating or updating a decomposability index for each constituent unit as a function of the priority dimensions while also applying a relationship factor and optionally incrementing for another dimension, and then decaying over time the data items by deleting all constituent units which have decomposability indices exceeding a configured threshold.

Abstract: An image forming apparatus, an image forming system and a file managing method thereof include displaying a file list, selecting a deletion target file from the displayed file list, and storing the selected deletion target file in a temporary storing unit.

Abstract: A software method and utility for performing a user-controlled data shredding operation for overwriting an entire file structure inclusive of all black-shaded blocks of data associated with a particular file of interest, then removing all references to the data structure in the operating environment, then renaming the data structure, and finally deleting the data structure. This ensures utmost security of the scrubbed data, plus it gives a user a number of scrubbing options including a one-click scrubbing feature and scheduled scrubbing operations.

Abstract: A technique for determining an amount of storage space that would be recovered in a storage system by deleting a list of logical containers of data is provided. In one embodiment, data blocks referenced by the list of files are first identified. The data blocks (e.g., deduplicated data blocks) may be referenced by two or more files. A number of references made by the identified list of files to each data block is compared against a number of references made by all files stored in a dataset of the storage system. A total amount of storage space is then calculated based on a sum of storage spaces utilized by each data block for which the two reference numbers match. This total amount of storage space is the storage space that would be reclaimed through deletion of the identified list of files.

Abstract: An image processing apparatus including: a correspondence determination unit configured to refer to respective additional information data included in a file and another file and determine whether identical additional information data exists; a size determination unit configured to compare a combined size of the two files with a reference size when judged that identical additional data exists; a flag addition unit configured to add a flag indicating data exempt from search target to identical additional information data included in either one of the two files when judged that the combined size is smaller than the reference size; a deletion unit configured to delete identical additional information data included in either one of the two files when judged that the combined size is equal to or greater than the reference size; and a storing unit configured to store a combined file.

Abstract: An archival computer system for receiving digital documents from document source computers, archiving such digital documents, and providing the digital documents to client computer systems. The archival computer system is provided with a document database, a supplemental digital media database, a document input device, an archival computer, and a server. The document input device receives digital documents from the document source computers. The digital documents include non-pixalated, non-rastered digital documents, and supplemental media. The archival computer receives the digital documents, and archives data from the non-pixalated, non-rastered digital documents in the document database, and data from the supplemental media in the supplemental digital media database. The server, upon request, outputs a composite document including data stored in the document database and the supplemental digital media database.

Abstract: A database archive, and a system and method for generating database archives is disclosed. A processor may store in a database archive an index that includes record entries that each references one or more record fields of a database, and may store the record fields independently of the database archive.

Abstract: An image forming apparatus capable of preventing the degradation of performance when the log data is outputted to an external device. An output unit outputs an operation condition about image forming as log data to an external device. A changing unit changes a detailed degree of the log data outputted by the output unit according to a log level that classifies the detailed degrees of the log data into some levels. A setting unit sets up a limit value corresponding to volume of the log data outputted by the output unit. A control unit controls the log level based on the limit value set up by the setting unit.

Abstract: An archive cluster application runs in a distributed manner across a redundant array of independent nodes. Each node preferably runs a complete archive cluster application instance. A given nodes provides a data repository, which stores up to a large amount (e.g., a terabyte) of data, while also acting as a portal that enables access to archive files. Each symmetric node has a set of software processes, e.g., a request manager, a storage manager, a metadata manager, and a policy manager. The request manager manages requests to the node for data (i.e., file data), the storage manager manages data read/write functions from a disk associated with the node, and the metadata manager facilitates metadata transactions and recovery across the distributed database. The policy manager implements one or more policies, which are operations that determine the behavior of an “archive object” within the cluster. The archive cluster application provides object-based storage.

Abstract: The invention relates generally to copying electronic data. More particularly, the invention provides a computerized method for identifying, in a first backup data set, a data item satisfying a selection criterion, and copying to a second backup data set at least a portion of the data item.

Abstract: Methods, apparatus and computer programs are provided for data replication, such as for replicating a database or updating a cache. Source database change transactions are captured and batched together for efficient data transfer. On receipt at a target replica system, the batch of transactions within a message is separated and separate apply transactions corresponding to the source transactions are performed in parallel. A ‘transaction processed’ table is updated to reflect apply processing for each apply transaction. This table provides a confirmation of the status of each transaction that can be used during recovery processing to prevent re-apply of an apply transaction. The table can also be used to determine when it is safe to delete an incoming message from persistent storage on the target system, and to facilitate one-phase commit processing.

Abstract: Methods, systems, and software for enforcing archival of data objects into archive objects and managed destruction of the archive objects are disclosed. In some cases, the computer techniques include enforcing a retention rule, such as a retention date and archive properties, and a destruction indication, such as an expiration date, of data identified for archival. The data objects are archived under hierarchical paths in a long-term storage system according to retention-related properties of the data objects and the retention rules. Further, the archived data can be destroyed according to destruction indications. Once archived, destruction of the data may be prevented by a hold applied to the data.

Abstract: A proposal is made of a file management system and method capable of reliably deleting unnecessary data. In a file management console and method for reading or writing data of a file from or in a first volume, which is provided by a storage device, in response to a request sent from a host computer, one snapshot or multiple snapshots that relate to the first volume and can be updated are created. In response to an externally issued designated file deletion command, a designated file is deleted from all of the first volume and snapshots or part thereof specified in the deletion command. At this time, the data items of the designated file in the first volume and/or snapshots from which the designated file should be deleted are overwritten with invalid data. Moreover, pieces of management information on the designated file are changed to a reference-disabled state.

Abstract: Methods and systems are provided for retaining and managing global records of an organization. In one implementation, a method is provided for retaining global records of an organization. The method may include storing, in a memory device, at least one arrangement of data items classified according to a hierarchical classification structure providing a normalization scheme for classifying the data items, the data items comprising global data of an organization and a retention schedule corresponding to the global data. Additionally, the method may include retaining the data items according to the retention schedule, wherein the retention schedule comprises a plurality of retention rules including a global retention rule defining a first duration for retaining the data items consistent with a set of predetermined requirements, and at least one exception rule for retaining at least one data item for a second duration.

Abstract: A system matches accounts based on attributes of the accounts, and scores the matched account pairs based on a probability of the matched accounts being duplicate accounts. The system can utilize the matched and scored account pairs to determine duplicate accounts, and terminate at least one of the accounts in a duplicate account pair.

Abstract: A system and method for record archive disposition is implemented with a computer system comprising one or more computer processors operatively connected to memory. Archival records are stored in memory, each archival record being associated with at least one metadata attribute. At least one or more legal holds are stored in memory, each legal hold having legal hold metadata attributes. A deletion candidate list is generated with at least one of the processors for at least one record type by including on the deletion candidate list archival records identified as having one or more archival record metadata attributes corresponding to the at least one record type, and excluding from the deletion candidate list identified archival records if a selected set of legal hold metadata attributes for at least one legal hold corresponds to at least a subset of metadata attributes for the identified archival records. Archival records included on the deletion candidate list are deleted from memory.

Abstract: One aspect of the present invention provides an operation for recovering lost space and maintaining data consistency in a storage environment by providing a two-way orphan reconciliation method for extremely large file systems, such as a Hierarchical Storage Management (HSM) system which manages billions of files. This highly scalable and parallelizable orphan identification process may be used in a HSM controlled environment to enable the execution of a two-way file orphan check. In one embodiment, this orphan check identifies file system client orphans and server object orphans in a single pass by comparing a queue containing a list of migrated files on a storage repository server with a queue containing a list of stub files on a file system. If the queue elements do not match, a file system orphan or server object orphan can appropriately be identified.

Abstract: A method by which a disk-based distributed data storage system is organized for protecting historical records of stored data entities. The method comprises recording distinct states of an entity, corresponding to different moments of time, as separate entity versions coexisting within the distributed data storage system, and assigning expiration times to the entity versions independently within each of a plurality of storage sites according to a shared set of rules, before which times deletion is prohibited.

Abstract: The invention relates to systems and methods for archiving business objects, particularly unstructured information from email and journaling agents and file systems. The systems and methods include a remotely installed archiving agent on a target server connected via VPN to a source system at a client location. The target servers are located at a remote Tier IV, SAS70 certified data center that is staffed by operators monitoring the archive process. The systems and methods include the movement of data from individual target servers to individual SQL servers to a data warehouse which provides support for a web portal. This web portal allows for enhanced search capabilities across different file types of archived business objects.

Abstract: A method and apparatus for preserving optimization hints in a transformed query is provided. In one embodiment, the methodology is implemented by query optimization logic. Upon receiving a first query to access values in a column of a table protected by an access control policy, the query optimization logic creates a second query that is equivalent to the first query as subject to the access control policy. Furthermore, the second query contains a new predicate that conjunctively joins a clone of a first expression in a predicate of the first query with a second expression that is derived, based on the access control policy, from the first expression. In one embodiment, the query optimization logic submits the second query for execution.

Abstract: Provided are a method, system, and program for archiving files. A hierarchical file system having directories is provided. An archival retention policy is associated with at least one of the directories in the hierarchical file system, wherein the retention policy applies to files included in the associated directory, and wherein the retention policy specifies a retention time indicating a time period during which a file is subject to the retention policy.